Information processing method, device, and computer-readable storage medium

Abstract

The present application provides an information processing method, a device, and a computer-readable storage medium. The method comprises: when a first content is displayed on a first screen, acquiring pose information of a user, the first screen being a screen that operates when an electronic device is in a first configuration; on the basis of the pose information, determining a gaze content of the user from the first content; and when the electronic device switches from the first configuration to a second configuration, by highlighting the gaze content, displaying on a second screen a second content containing the gaze content, wherein the second screen is a screen that operates when the electronic device is in the second configuration. When an electronic device switches from a first configuration to a second configuration, a gaze content of a user when the electronic device is in the first configuration can be highlighted on a screen operating in the second configuration, ensuring that the user can seamlessly continue browsing, maintaining reading fluency and continuity, and greatly enhancing user experience.

Description

An information processing method, apparatus and computer-readable storage medium

[0001] This application claims priority to Chinese Patent Application No. 202410985880.6, filed on July 22, 2024, entitled "An Information Processing Method, Apparatus and Computer-Readable Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminals, and more particularly to an information processing method, device, and computer-readable storage medium. Background Technology

[0003] A foldable phone is a mobile phone with a foldable screen design. In its folded form, the screen can shrink to the size of a traditional mobile phone, making it convenient for users to carry and store; in its unfolded form, the screen expands to a larger size, providing users with a wider field of view and more operating space. However, when a foldable phone switches between different forms, the significant change in screen size and the flipping of the opening and closing forms cannot guarantee the continuity of reading scenarios, thus reducing the user experience. Summary of the Invention

[0004] This application provides an information processing method, device, and computer-readable storage medium. When an electronic device switches from a first form to a second form, it can highlight the content that the user was looking at in the first form on the screen where the second form is operating, ensuring that the user can seamlessly transition and continue browsing, guaranteeing the fluency and continuity of reading, and greatly improving the user experience.

[0005] In a first aspect, an information processing method is provided, applied to an electronic device. The method includes: when a first screen displays first content, acquiring user posture information, the posture information including facial posture information and / or eye information, wherein the first screen is a screen that operates when the electronic device is in a first state; determining the user's gaze content from the first content based on the posture information; and when the electronic device transitions from the first state to a second state, displaying second content containing the gaze content on a second screen in a manner that highlights the gaze content, wherein the second screen is a screen that operates when the electronic device is in the second state.

[0006] It should be understood that electronic devices can be devices that can transform between different forms, such as foldable phones and foldable tablets. The screens that operate differ depending on the form of the electronic device.

[0007] For example, the first form is a folded form and the second form is an unfolded form; or, the first form is an unfolded form and the second form is a folded form.

[0008] It should be understood that user posture information can be acquired in real time or periodically.

[0009] For example, facial posture information may include, but is not limited to, at least one of head tilt angle, facial orientation, and facial expression information; eye information may include at least one of pupil position and size, eyelid state, and eye movement.

[0010] It should be understood that the content being gazed upon can be the content that a user is gazing upon while viewing the content on the first screen (i.e., the first content).

[0011] It should be understood that the first content refers to the content displayed on the first screen when the electronic device is in its first state.

[0012] It should be understood that the second content includes at least a portion of the first content, and that at least a portion of the first content contains spectral content. Content in the second content other than spectral content may be referred to as non-spectral content.

[0013] In one possible implementation, the second content is the first content.

[0014] In one possible implementation, the second content is a portion of the first content.

[0015] In one possible implementation, the second content includes the first content and the third content, where the third content is related to the first content.

[0016] It should be understood that the second content may be determined by the electronic device based on the layout of the first content and / or the size of the second screen.

[0017] For example, if the size difference between the size of the first screen and the size of the second screen is less than a size difference threshold, the second content is determined to be the first content or a portion of the first content; wherein, the portion of content can be determined from the first content based on the layout of the first content. If the size difference between the size of the first screen and the size of the second screen is greater than or equal to the size threshold, and the size of the second screen is greater than the size of the first screen, third content related to the first content is obtained, and the third content and the first content are used as the second content. If the size difference between the size of the first screen and the size of the second screen is greater than or equal to the size threshold, and the size of the second screen is less than the size of the first screen, the second content is determined to be a portion of the first content, and this portion of content can be determined from the first content based on the layout of the first content.

[0018] In one possible implementation, the layout of the first content is different from the layout of the second content.

[0019] For example, the arrangement of the first content displayed on the first screen is different from the arrangement of the second content displayed on the second screen.

[0020] Thus, even though the layout of the first and second content differs, the information processing method provided in this application allows users to immediately find the content they were previously looking at on the first screen on the second screen. This ensures a seamless transition and continued browsing, guaranteeing the smoothness and continuity of reading and greatly enhancing the user experience. Unlike related technologies, it eliminates the need to spend significant time searching for previously viewed content on the second screen, solving the problem of wasted time and interrupted reading, resulting in a poor user experience.

[0021] In one possible implementation, displaying second content containing the gazed content on the second screen in a manner that highlights the gazed content includes: displaying the second content on the second screen starting from the gazed content in a progressive display manner.

[0022] The above solution guides the user's gaze smoothly to the second screen without interrupting the user's current reading, allowing the user to naturally browse more non-focused content while maintaining attention on the content being read, thus ensuring the continuity of the user's reading and improving the user's visual experience.

[0023] In one possible implementation, displaying second content containing the gazed content on a second screen in a manner that highlights the gazed content includes: displaying the gazed content on the second screen at a first brightness and displaying content other than the gazed content in the second content at a second brightness, wherein the first brightness is higher than the second brightness.

[0024] The above solution allows users to immediately recover from reading breaks, ensuring reading continuity and improving the user's visual experience.

[0025] In one possible implementation, displaying second content containing the gazed content on a second screen in a manner that highlights the gazed content includes: displaying the gazed content dynamically on the second screen, and displaying the content other than the gazed content in the second content statically.

[0026] The above solution attracts user attention, ensuring that users can immediately spot the content they are looking at on the second screen. Simultaneously, non-focused content is displayed statically, allowing users to browse it without distraction. This combination of dynamic and static elements not only ensures continuity of reading but also achieves a clear hierarchy of information, enabling users to understand the presented information more efficiently.

[0027] In one possible implementation, the display brightness of the gazed content is higher than that of at least the display brightness of the non-gazed content.

[0028] The above solution uses brightness contrast to highlight the content being viewed, making it easier for users to quickly find and continue browsing the content on the second screen, thus improving reading efficiency and comfort and further enhancing the user experience.

[0029] In one possible implementation, after displaying second content containing the gazed content on a second screen in a manner that highlights the gazed content, the method further includes displaying the second content on the second screen at a third brightness.

[0030] It should be understood that the third brightness can be the same as the first brightness; the third brightness can also be the same as the second brightness. Of course, the third brightness can also be a brightness between the first and second brightness; or, the third brightness can be higher than the first brightness.

[0031] This solution ensures that users can seamlessly transition from focusing on highlighted content to reading all content normally (i.e., the second content). This process not only improves the efficiency of finding the highlighted content but also guarantees the continuity and comfort of reading, providing users with a smoother and more enjoyable experience.

[0032] In one possible implementation, the way to highlight the gaze content includes at least one of color contrast, size adjustment, layout adjustment, embellishment, and marking.

[0033] In one possible implementation, obtaining the user's posture information includes: obtaining the posture information if one or more of the following conditions are met: the user's gaze duration on the first screen meets a first duration threshold; the distance between the user and the first screen meets a target distance threshold; the working time of the first screen meets a second duration threshold; or, the first content is target content.

[0034] In one possible implementation, determining the user's gaze content from the first content based on the posture information includes: determining the user's gaze position on the first screen based on the posture information; and determining the gaze content from the first content based on the gaze position.

[0035] Secondly, an information processing method is provided, which can be executed by an electronic device, by a component of an electronic device, or by a logic module or software that can realize all or part of the functions of an electronic device.

[0036] The method includes: when a first screen displays first content, acquiring user posture information through the operating system on the electronic device, the posture information including facial posture information and / or eye information, wherein the first screen is the screen in operation when the electronic device is in a first state; determining the user's gaze content from the first content based on the posture information through a target application on the electronic device, wherein the first content is the content of the display interface of the target application; and when the electronic device switches from the first state to a second state, displaying second content containing the gaze content on a second screen through the target application in a manner that highlights the gaze content, wherein the second screen is the screen in operation when the electronic device is in the second state.

[0037] The above solution, through the collaborative work of the operating system and the target application, allows the screen in the second form to display the content the user was looking at in the first form when the electronic device transitions from the first to the second form. This ensures a seamless transition and continued browsing, guaranteeing the smoothness and continuity of reading and significantly improving the user experience. Unlike related technologies, this eliminates the need for users to spend considerable time searching for previously viewed content on the second screen, thus resolving the problem of wasted time and interrupted reading, resulting in a poor user experience.

[0038] In one possible implementation, the layout of the first content is different from the layout of the second content.

[0039] In one possible implementation, displaying second content containing the gazed content on the second screen in a manner that highlights the gazed content includes: displaying the second content on the second screen starting from the gazed content in a progressive display manner.

[0040] In one possible implementation, displaying second content containing the gazed content on a second screen in a manner that highlights the gazed content includes: displaying the gazed content on the second screen at a first brightness and displaying content other than the gazed content in the second content at a second brightness, wherein the first brightness is higher than the second brightness.

[0041] In one possible implementation, displaying second content containing the gazed content on a second screen in a manner that highlights the gazed content includes: displaying the gazed content dynamically on the second screen, and displaying the content other than the gazed content in the second content statically.

[0042] In one possible implementation, the display brightness of the gazed content is higher than the display brightness of the content other than the gazed content in the second content.

[0043] In one possible implementation, after displaying second content containing the gazed content on a second screen in a manner that highlights the gazed content, the method further includes displaying the second content on the second screen at a third brightness.

[0044] In one possible implementation, the way to highlight the gaze content includes at least one of color contrast, size adjustment, layout adjustment, embellishment, and marking.

[0045] In one possible implementation, obtaining the user's posture information includes: obtaining the posture information if one or more of the following conditions are met: the user's gaze duration on the first screen meets a first duration threshold; the distance between the user and the first screen meets a target distance threshold; the working time of the first screen meets a second duration threshold; or, the first content is target content.

[0046] In one possible implementation, determining the user's gaze content from the first content based on the posture information includes: determining the user's gaze position on the first screen based on the posture information; and determining the gaze content from the first content based on the gaze position.

[0047] Thirdly, embodiments of this application provide an electronic device, which includes a processor and a memory. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, causing the electronic device to perform any of the methods in the first aspect.

[0048] Fourthly, embodiments of this application provide an electronic device, which includes a processor and a memory. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, causing the electronic device to perform the method of any of the second aspects.

[0049] Fifthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to perform any of the methods in the first aspect.

[0050] In a sixth aspect, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to perform the method of any one of the second aspects.

[0051] In a seventh aspect, embodiments of this application provide a computer program product, which includes computer program code that, when executed by an electronic device, causes the electronic device to perform any of the methods in the first aspect.

[0052] Eighthly, embodiments of this application provide a computer program product, the computer program product including: computer program code, which, when executed by an electronic device, causes the electronic device to perform any of the methods in the second aspect.

[0053] In a ninth aspect, embodiments of this application provide a chip system including a processing circuit and a storage medium storing computer program instructions; when the computer program instructions are executed by the processing circuit, they implement any of the methods in the first aspect.

[0054] Optionally, the processing circuitry in the above-mentioned chip system can be replaced by a processor, and the storage medium can be replaced by a memory. Optionally, the chip system may also include a communication interface for enabling communication between the chip system and external devices.

[0055] In a tenth aspect, embodiments of this application provide a chip system including a processing circuit and a storage medium storing computer program instructions; when the computer program instructions are executed by the processing circuit, they implement any of the methods in the second aspect.

[0056] Optionally, the processing circuitry in the above-mentioned chip system can be replaced by a processor, and the storage medium can be replaced by a memory. Optionally, the chip system may also include a communication interface for enabling communication between the chip system and external devices.

[0057] The beneficial effects of the technical solutions in the third to tenth aspects of this application can be referred to the beneficial effects of the technical solutions in the first or second aspects, which will not be repeated here. Attached Figure Description

[0058] Figure 1 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0059] Figure 2 is a software structure block diagram of an electronic device 100 according to an embodiment of this application;

[0060] Figure 3 is a schematic diagram of the interface when the form of the foldable phone changes in the related technology provided in the embodiments of this application;

[0061] Figure 4 is a schematic diagram of the display interface of a foldable mobile phone in an information processing method provided in an embodiment of this application;

[0062] Figure 5 is a schematic diagram of the display interface of a foldable mobile phone in another information processing method provided in an embodiment of this application;

[0063] Figure 6 is a schematic diagram of the display interface of a foldable mobile phone in another information processing method provided in the embodiments of this application;

[0064] Figure 7 is a schematic diagram of the display interface of a foldable mobile phone in an information processing method provided in another embodiment of this application;

[0065] Figure 8 is a schematic diagram of the display interface of a foldable mobile phone in another information processing method provided in another embodiment of this application;

[0066] Figure 9 is a flowchart illustrating an information processing method provided in an embodiment of this application;

[0067] Figure 10 is a flowchart illustrating another information processing method provided in an embodiment of this application;

[0068] Figure 11 is a schematic diagram of another electronic device provided in an embodiment of this application. Detailed Implementation

[0069] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0070] In the description of the embodiments of this application, unless otherwise stated, " / " means "or"; for example, A / B can mean A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more.

[0071] Hereinafter, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first," "second," or "third" may explicitly or implicitly include one or more of that feature.

[0072] This application provides an electronic device for executing the information processing method provided in this application. In some embodiments of this application, the electronic device may be a foldable mobile phone, tablet computer, wearable device, in-vehicle device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), etc., or may be other devices or apparatuses capable of information processing. This application does not limit the specific type of electronic device.

[0073] For example, FIG1 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0074] As shown in Figure 1, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a charging management module 130, an antenna 1, an antenna 2, a display screen 140, a mobile communication module 150, a wireless communication module 160, etc.

[0075] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0076] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0077] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0078] The processor 110 may also include a memory for storing instructions and data.

[0079] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0080] Internal memory 121 can be used to store computer executable program code, including instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function, etc.

[0081] The charging management module 130 is used to receive charging input from the charger. The charger can be a wireless charger or a wired charger.

[0082] Electronic device 100 implements display functions through a GPU, display screen 140, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 140 and the application processor. The GPU performs mathematical and geometric calculations and is used for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information. Display screen 140 can display text, images, or videos from a human-computer interaction interface.

[0083] In some embodiments, the display screen 140 can be a flexible screen, which can be stretched or unfolded to form a larger display screen, or rolled or folded to form a smaller display screen.

[0084] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0085] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the same device as at least some modules of the processor 110.

[0086] The wireless communication module 160 can provide wireless communication solutions for use on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), and near field communication (NFC) technologies. In some embodiments, antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and antenna 2 is coupled to the wireless communication module 160, enabling the electronic device 100 to communicate with networks and other terminal devices via wireless communication technologies.

[0087] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. The structures of antennas 1 and 2 in Figure 1 are merely one example. Each antenna in the electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0088] It should be understood that, apart from the various components or modules listed in Figure 1, the embodiments of this application do not specifically limit the structure of the electronic device 100. In other embodiments of this application, the electronic device 100 may also include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0089] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses a layered Android system as an example to illustrate the software structure of electronic device 100.

[0090] Figure 2 is a schematic diagram of the software structure of the electronic device 100 according to an embodiment of this application.

[0091] It should be understood that a layered architecture can divide software into several layers, each with a clear role and division of labor; the layers can communicate with each other through software interfaces.

[0092] As shown in Figure 2, the Android system can be divided into four layers: from top to bottom, the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer can include a series of application packages.

[0093] As shown in Figure 2, the application package can include applications such as camera, gallery, calendar, map, navigation, WLAN, Bluetooth, music, video, and home management. Among these, the home management application could be, for example, Huawei's Smart Life application.

[0094] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0095] As shown in Figure 2, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0096] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0097] Content providers store and retrieve data, making that data accessible to applications. This data can include videos, images, audio, phone calls made and received, browsing history and bookmarks, phone books, and more.

[0098] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views.

[0099] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0100] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0101] The notification manager allows applications to display notification information in the status bar. It can be used to convey informational messages and can disappear automatically after a short time without user interaction.

[0102] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0103] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0104] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0105] The system library can include multiple functional modules, such as: surface manager, media libraries, 3D graphics processing libraries (e.g., Open Graphics Library for Embedded Systems, OpenGL ES) and 2D graphics engines (e.g., Skia Graphics Library, SGL).

[0106] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0107] The media library supports playback and recording of various audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, Moving Picture Experts Group Audio Layer III (MP3), Advanced Audio Coding (AAC), Adaptive Multi-rate (AMR), Joint Photographic Experts Group (JPG), and Portable Network Graphics (PNG).

[0108] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0109] A 2D graphics engine is a graphics engine for 2D drawing.

[0110] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0111] For ease of understanding, the following embodiments of this application will use the electronic devices shown in Figures 1 and 2 as examples, and in conjunction with the accompanying drawings and application scenarios, to specifically illustrate the information processing methods provided in the embodiments of this application.

[0112] The relevant background information related to the embodiments of this application will be explained below.

[0113] Currently, when foldable phones switch from a folded form to an unfolded form, or vice versa, the significant change in screen size and the flipping of the opening and closing form make it impossible to guarantee continuity for users in reading scenarios, thus reducing the user experience.

[0114] For example, in its folded state, a foldable phone may have a smaller screen size, suitable for one-handed operation or portability. However, when users want a wider field of view or a more comfortable reading experience, they can choose to convert the foldable phone from its folded state to its unfolded state. This sudden increase in screen size not only changes the user's visual focus but may also require the user to reposition or adapt to a new reading interface due to the rearrangement of content. This significant change in screen size makes it difficult for users to maintain continuity during reading. Moreover, the flipping of the unfolded state is not just a simple screen unfolding and folding; it may involve a physical flip of the phone's form factor, causing a change in the device's orientation or angle, potentially interrupting the reading experience. Figure 3(a) shows the display interface of the phone in its folded state, where the outer screen is active and the inner screen is inactive, with some application icons displayed on the outer screen; Figure 3(b) shows the display interface of the phone in its unfolded state, where the inner screen is active and the outer screen is inactive. As shown in Figure 3(a), when the phone is in folded mode, if the content on the external screen is, for example, the memo icon, when the phone changes from folded mode to unfolded mode, the user needs to find the memo icon again from the display interface shown in Figure 3(b) due to the rearrangement of the displayed content, which interrupts the viewing process and makes the user experience poor.

[0115] Based on this, embodiments of this application provide an information processing method applied to an electronic device. When the electronic device is in a first state, the method determines the user's gaze content from the content displayed on a first screen (the screen on which the electronic device operates when in the first state). When the electronic device transitions from the first state to a second state, at least a portion of the content displayed on the first screen is displayed on the second screen (the screen on which the electronic device operates when in the second state) to highlight the gaze content. This at least a portion of the content includes the gaze content. Thus, when the electronic device transitions from the first state to the second state, the user can immediately find the gaze content on the second screen, ensuring reading continuity and improving the user experience.

[0116] Electronic devices can be devices capable of transforming between different forms, such as foldable phones and foldable tablets. Focused content refers to the specific screen area or elements on which a user's gaze is focused and lingers for a specific duration to obtain visual information when viewing the primary screen. This area or element can be visual objects such as text, video, images, icons, and buttons on the primary screen.

[0117] For example, the first form is a folded form and the second form is an unfolded form; or, the first form is an unfolded form and the second form is a folded form.

[0118] For example, the content being gazed upon can be a visual object such as text, video, image, icon, or button on the first screen.

[0119] For example, the electronic device is a foldable phone. When the foldable phone is in a folded state, the screen that operates is the outer screen; when the foldable phone is in an unfolded state, the screen that operates is the inner screen. The size of the outer screen is smaller than the size of the inner screen.

[0120] The content displayed on the first screen includes, but is not limited to, at least one of the following:

[0121] 1) Images: Photos taken by users, video screenshots, images shared on social media, emojis, etc.

[0122] 2) Text: News feeds, blog posts, etc.

[0123] 3) Application interface: home screen, application startup screen, game interface, etc.

[0124] 4) Icons: application icons, function icons, navigation indicator icons, etc.

[0125] 5) User interaction elements: buttons, sliders, etc.

[0126] The following example, using a foldable mobile phone as an example, where the foldable mobile phone changes from a folded state to an unfolded state and the content displayed on the screen in the folded state is an image, will provide a detailed explanation of the changes in the display interface in the information processing method provided in this application embodiment.

[0127] Figure 4 is a schematic diagram of the display interface of a foldable mobile phone in an information processing method provided in this application embodiment. Figure 4 shows the interface change when the foldable mobile phone changes from a folded form to an unfolded form, highlighting the content being viewed. The first display interface 41 shown in Figure 4(a) is the display interface of the foldable mobile phone when it is in the folded form, where the content being viewed is one of the multiple images displayed on the first display interface 41. When the foldable mobile phone detects that it has changed from the folded form to the unfolded form, it displays the second display interface 42 shown in Figure 4(b) on the screen where it operates in the unfolded form; the second display interface 42 includes the content of the first display interface 41, and the content being viewed is highlighted on the second display interface 42, while the content other than the content being viewed is displayed at a relatively low brightness. Subsequently, the foldable mobile phone displays the third display interface 43 shown in Figure 4(c). The third display interface 43 displays the same content as the second display interface 42, but with different brightness. The content displayed on the third display interface 43 is displayed at the same, but higher, brightness.

[0128] In the above solution, when the foldable phone changes from its folded to its unfolded state, it can display all the content shown in the folded state on the second display interface 42, highlighting the content the user was looking at in the folded state (i.e., the content being viewed), allowing the user to immediately resume reading from where they left off. Subsequently, the foldable phone displays a third display interface 43, which also fully displays all the content shown in the folded state, but all content is presented with a uniform brightness, without highlighting distinctions. This provides the user with an immersive and continuous reading environment, ensuring smooth and continuous reading and enhancing the user's reading experience.

[0129] Figure 5 is a schematic diagram of the display interface of a foldable phone in another information processing method provided in this application embodiment. Figure 5 shows the interface changes when the foldable phone changes from a folded form to an unfolded form, using a progressive display method to gradually display the content displayed in the folded form, starting from the content being viewed. The fourth display interface 51 shown in Figure 5(a) is the display interface of the foldable phone in the folded form, where the content being viewed is one of the multiple images displayed on the fourth display interface 51. When the foldable phone detects that it is changing from a folded form to an unfolded form, the foldable phone will use a progressive display method on the screen where it works in the unfolded form, gradually transitioning from the content being viewed to all the content displayed in the folded form. In this process, the foldable phone will first display the fifth display interface 52 shown in Figure 5(b) with the content being viewed as the core. Subsequently, the foldable phone will display the sixth display interface 53 shown in Figure 5(c). The sixth display interface 53 retains the content on the fifth display interface 52 while further expanding the display range, allowing the user to see more of the content displayed in the folded form. Finally, the foldable phone will display the seventh display interface 54 shown in Figure 5(d), at which point all the content displayed in the folded form is fully shown.

[0130] The above solution ensures a smooth and natural transition process, enhancing the visual experience and maintaining the continuity and comfort of the user's reading experience.

[0131] Figure 6 is a schematic diagram of the display interface of a foldable mobile phone in another information processing method provided in this application embodiment. Figure 6 shows the interface changes when the foldable mobile phone changes from a folded form to an unfolded form, displaying the observed content dynamically and the non-observed content statically. The eighth display interface 61 shown in Figure 6(a) is the display interface of the foldable mobile phone when it is in the folded form, where the observed content is one of the multiple images displayed on the eighth display interface 61. When the foldable mobile phone detects that it is changing from the folded form to the unfolded form, it will display the observed content dynamically and the non-observed content statically on the screen where it works in the unfolded form. In this process, the foldable mobile phone will first display the ninth display interface 62 as shown in Figure 6(b), where the observed content is highlighted and the non-observed content is displayed at a lower brightness. The non-observed content is the content in the ninth display interface 62 other than the observed content. Then, the tenth display interface 63 as shown in Figure 6(c) is displayed. Compared with the ninth display interface 62, the size of the area where the observed content is located is increased in the tenth display interface 63, the highlighting is still maintained, and the non-observed content remains at a low brightness. Finally, the foldable phone displays an eleventh display interface 64 as shown in Figure 6(d), at which point all content displayed in the folded form is fully shown. The eleventh display interface 64 displays the same content as the tenth display interface 63, but with different brightness. On the eleventh display interface 64, both viewed and unviewed content are displayed with the same, higher brightness, and the size of the area containing the viewed content is the same as the size of the area containing each unviewed content.

[0132] The above solution allows the foldable phone to highlight the content the user is focused on in the folded state with a brighter, larger display as it unfolds, while simultaneously displaying non-focused content at a lower brightness. This process guides the user's gaze to the content they are looking at. Subsequently, the unfolded screen displays all the content shown in the folded state at the same brightness and size, ensuring continuity of reading and visual comfort, thus improving the user experience.

[0133] In the interface embodiments corresponding to Figures 4 to 6 above, the first display interface 41 shown in Figure 4(a), the fourth display interface 51 shown in Figure 5(a), and the eighth display interface 61 shown in Figure 6(a) are the same. The third display interface 43 shown in Figure 4(c), the seventh display interface 54 shown in Figure 5(d), and the eleventh display interface 64 shown in Figure 6(d) are the same.

[0134] The following example, using a foldable mobile phone as an electronic device, where the foldable phone changes from a folded state to an unfolded state and the content displayed on the screen in the folded state is an application icon, will provide a detailed explanation of the changes in the display interface in the information processing method provided in this application embodiment.

[0135] Figure 7 is a schematic diagram of the display interface of a foldable mobile phone in an information processing method according to another embodiment of this application. Figure 7 shows the interface change when the mobile phone changes from a folded state to an unfolded state, highlighting the content being viewed using a border mark. The twelfth display interface 71 shown in Figure 7(a) is the display interface when the mobile phone is in the folded state, where the content being viewed is one of the multiple application icons displayed on the twelfth display interface 71, such as the "Memo" icon. When the mobile phone detects that it has changed from a folded state to an unfolded state, the mobile phone will display the thirteenth display interface 72 shown in Figure 7(b) on the screen where the unfolded state is working; where the thirteenth display interface 72 includes the content of the twelfth display interface 71, and the content being viewed is displayed on the thirteenth display interface 72 with a border. In this way, it is convenient for the user to quickly find the content being viewed on the thirteenth display interface 72, without the user wasting a lot of time searching for the content being viewed on the thirteenth display interface 72, ensuring the continuity of the user's reading experience.

[0136] In one possible implementation, when the phone detects that it has changed from a folded to an unfolded state, it can also display the fourteenth display interface 73 shown in Figure 7(c) on the unfolded screen. The fourteenth display interface 73 includes the content of the twelfth display interface 71, and includes a prompt box pointing to the viewed content. This prompt box indicates the location of the viewed content. In this way, the user can immediately find the viewed content on the unfolded screen based on the prompt box, ensuring the continuity of the user's reading experience.

[0137] In one possible implementation, when the phone detects that it is changing from a folded to an unfolded state, it can also display the fifteenth display interface 74 shown in Figure 7(d) on the unfolded screen. The fifteenth display interface 74 includes the content of the twelfth display interface 71. On the fifteenth display interface 74, the content being viewed is highlighted in an enlarged form, with the size of the area containing the viewed content being larger than the size of any area containing non-viewed content. The non-viewed content can be application icons on the fifteenth display interface 74 other than the "Memos" icon. This display method attracts the user's attention, allowing the user to immediately find the viewed content on the unfolded screen, ensuring a continuous reading experience.

[0138] In one possible implementation, when the phone detects that it has changed from a folded to an unfolded state, it can also display the sixteenth display interface 81 shown in Figure 8 on the unfolded screen. In the sixteenth display interface 81, the content of the twelfth display interface 71 is displayed around the content being viewed. The size of the area containing the viewed content on the sixteenth display interface 81 is larger than the size of each area containing non-viewed content. Of course, the size of the area containing the viewed content can also be the same as the size of each area containing non-viewed content, or the size of the area containing the viewed content can be smaller than the size of each area containing non-viewed content; this embodiment does not limit this. In this way, the user can quickly find the viewed content on the unfolded screen, thus ensuring a smooth and continuous reading experience.

[0139] In the interface embodiments corresponding to Figures 4 to 6 above, the gaze content is shown as an image. In the interface embodiments corresponding to Figures 7 and 8, the gaze content is shown as an application icon. In actual applications, the gaze content can also be text, buttons, or other visual objects. This application embodiment does not limit the type of gaze content.

[0140] Furthermore, the interface embodiments corresponding to Figures 4 to 8 above illustrate a scenario where the foldable phone changes from a folded state to an unfolded state. Similarly, when the foldable phone changes from an unfolded state to a folded state, the above method can also be used to highlight the content the user is looking at in the unfolded state on the screen where the phone is in the folded state.

[0141] Figure 9 is a schematic flowchart of an information processing method provided in an embodiment of this application. This information processing method can be applied to electronic devices (such as foldable phones). The method is not limited to the specific order shown in Figure 9. It should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. As shown in Figure 9, the information processing method includes steps S901 to S903, which are explained in detail below.

[0142] S901. When the first screen displays the first content, obtain the user's posture information.

[0143] The posture information includes facial posture information and / or eye information, and the first screen is the screen on which the electronic device operates when it is in its first state. The first content can be all the content displayed on the screen on which the electronic device operates when it is in its first state.

[0144] In this embodiment, the electronic device can be a device capable of switching between different forms, with different screens (i.e., displays) used in each form. The electronic device includes at least two forms: a first form and a second form. The size of the first screen used in the first form can be the same as or different from the size of the second screen used in the second form. Examples of electronic devices include foldable phones and foldable tablets.

[0145] For example, the first form can be a folded form, in which the first screen used by the electronic device in the first form is the outer screen, and the second form is an unfolded form, in which the second screen used by the electronic device in the second form is the inner screen, and the size of the inner screen is larger than the size of the outer screen.

[0146] For example, the first form can be an unfolded form, and the first screen used by the electronic device in the second form is an inner screen. The second form is a folded form, and the second screen used by the electronic device in the second form is an outer screen. The size of the inner screen is larger than the size of the outer screen.

[0147] In this embodiment, the electronic device can acquire multiple images to be processed for the user in real time or periodically using its own image acquisition component, and analyze the multiple images to obtain posture information. Of course, the posture information can also be acquired by other devices and sent to the electronic device.

[0148] In one possible implementation, eye information may include at least one of the following: pupil position and size, eyelid state, eye movement, etc.

[0149] In one possible implementation, facial pose information may include, but is not limited to, at least one of the following:

[0150] 1) Head tilt angle: The degree to which the head tilts relative to a set baseline;

[0151] 2) Facial orientation: The overall orientation of the user's face.

[0152] 3) Facial expression information: used to express the user's emotional state, such as happiness, sadness, anger, surprise, fear, and disgust.

[0153] In this embodiment of the application, when the first screen displays the first content, the user's posture information can be obtained through at least one of the following methods:

[0154] Method 1: When the first content is displayed on the first screen and the user's gaze duration on the first screen meets the first duration threshold, the posture information is obtained.

[0155] In this embodiment, the electronic device can acquire multiple eye images of the user through its own image acquisition component, and determine the user's eye movements based on these multiple eye images, thereby analyzing the user's gaze duration on the first screen. If the gaze duration meets a first duration threshold, the user's posture information is acquired to ensure that the user intentionally opened or operated the first screen, rather than accidentally, thus improving the effectiveness of the acquired posture information. For example, the first duration threshold is 10 seconds; when the gaze duration exceeds 10 seconds, it is determined that the gaze duration meets the first duration threshold.

[0156] Method 2: When the first content is displayed on the first screen and the distance between the user and the first screen meets the target distance threshold, obtain the posture information.

[0157] In this embodiment, the electronic device can acquire the distance between the user and the first screen using its own distance sensor; or, it can acquire an image of the user and the first screen, and determine the distance between the user and the first screen by analyzing the image. If the distance is less than or equal to a target distance threshold, it is determined that the distance meets the target distance threshold. In this case, posture information is acquired to ensure that the user intentionally opens or operates the first screen, rather than accidentally, thus improving the effectiveness of the acquired posture information.

[0158] Method 3: Obtain posture information when the first content is displayed on the first screen and the working duration of the first screen meets the second duration threshold.

[0159] In this embodiment, if the working duration of the first screen is greater than or equal to a second duration threshold, the working duration of the first screen is determined to meet the second duration threshold. This indicates that the user is using the first screen and viewing the content displayed on it. The electronic device can collect this posture information to obtain the user's gaze content, improving the accuracy and effectiveness of the obtained gaze content. The first duration threshold and the second duration threshold can be the same or different.

[0160] Method 4: When the first content is displayed on the first screen and the first content is the target content, obtain the posture information.

[0161] In this embodiment, the target content can be content that the user is interested in. The target content can be pre-set by the user or determined by the electronic device based on the user's historical browsing behavior, search history, likes, shares, and other interactive data. When the first content is the target content, it indicates that the user is browsing content they are interested in. The posture information collected at this time more accurately reflects the user's true reaction and interest, allowing for subsequent determination of the user's gaze content based on the posture information, thus improving the accuracy and effectiveness of the collected gaze content.

[0162] It should be understood that at least one of the above four methods can be flexibly selected to obtain attitude information according to the actual application scenario, which improves the flexibility and selectivity of obtaining attitude information.

[0163] It should be understood that the first content includes at least one of video, image, text, application interface, icon and user interaction elements.

[0164] For example, the display interface of the first screen may be the first display interface 41 shown in Figure 4(a), and the first content may be the content of the first display interface 41, i.e., multiple images. Alternatively, the display interface of the first screen may be the twelfth display interface 71 shown in Figure 7(a), and the first content may be the content of the twelfth display interface 71, i.e., multiple application icons.

[0165] S902. Based on posture information, determine the content the user is looking at from the first content.

[0166] In this embodiment, the user's gaze direction can be determined based on posture information, and the user's gaze content can be determined from the first content based on the gaze direction. Thus, the gaze content can be automatically determined from the first content based on posture information, eliminating the need for manual user operation and improving the efficiency of acquiring the gaze content.

[0167] Among them, determining the user's gaze content from the first content based on posture information can be achieved in the following ways:

[0168] Based on posture information, the user's gaze position on the first screen is determined; based on the gaze position, the content the user is gazing at is determined from the first content. Here, the gaze position is the location where the user's eyes are focused.

[0169] Specifically, the user's gaze direction can be determined based on posture information, and then mapped onto the screen coordinate system of the first screen to obtain the gaze position. Subsequently, the first content displayed on the first screen can be divided into regions to obtain content in multiple regions; from the content in multiple regions, the content of the region corresponding to the gaze position can be determined to obtain the gaze content.

[0170] For example, the first content may be multiple images of the first display interface 41 shown in FIG4(a). As shown in FIG4(a), the gaze content may be an image determined from multiple images based on posture information. Alternatively, the first content may be multiple application icons of the twelfth display interface 71 shown in FIG7(a). The gaze content may be an application icon determined from multiple application icons based on posture information, such as a memo icon.

[0171] S903. When the electronic device changes from the first mode to the second mode, a second content containing the gazed content is displayed on the second screen in a way that highlights the gazed content.

[0172] The second screen is the screen that operates when the electronic device is in its second state.

[0173] In the embodiments of this application, the second content includes the first content, or includes a portion of the first content.

[0174] For example, the second content is the same as the first content. That is, the content displayed remains the same regardless of whether the electronic device's form factor changes. When the first screen operates when the electronic device is in a folded state, and the second screen operates when the electronic device is in an unfolded state, the first content can be displayed on the second screen either enlarged or at the same size as the content displayed on the first screen. When the first screen operates when the electronic device is in an unfolded state, and the second screen operates when the electronic device is in a folded state, the first content can be displayed on the second screen in a smaller size.

[0175] For example, the second content is a portion of the first content; that is, the content displayed before and after the form of the electronic device changes is different. When the first screen operates when the electronic device is in a folded state, and the second screen operates when the electronic device is in an unfolded state, on the second screen, a portion of the first content can be displayed at an enlarged size. When the first screen operates when the electronic device is in an unfolded state, and the second screen operates when the electronic device is in a folded state, on the second screen, a portion of the first content can be displayed at a reduced size.

[0176] For example, the second content consists of the first content and the third content, where the third content is related to the first content. In other words, the content displayed differs before and after the form factor of the electronic device changes. For instance, when a user browses an article on a first screen, due to the size limitation of the first screen, only a portion of the article's content is displayed. The first content could be a portion of the article, and the third content could be another portion of the article. Alternatively, the first screen might display the entire article; in this case, the first content could be the entire article, and the third content could be content that the electronic device recommends to the user based on the first content, content that might be of interest to the user.

[0177] In this embodiment, the gazed content can be at least one of the following: video, image, text, icon, interactive element, etc. Interactive elements can be, for example, cards, buttons, sliders, etc., that allow users to interact with the screen content. The content other than the gazed content in the second content is non-gaze content. Specifically, the gazed content may be displayed before the non-gaze content on the second screen; the gazed content and non-gaze content may also be displayed simultaneously.

[0178] Among them, electronic devices can detect whether their shape has changed. The detection process can be achieved through the following steps:

[0179] For example, an electronic device such as a foldable phone can use its internal sensors (such as a gyroscope, accelerometer, or a dedicated folding screen sensor) to continuously monitor changes in its physical form, such as changes in the folding angle. These sensors can transmit the monitored data to a processor on the foldable phone, so that the processor can determine whether the foldable phone is currently in a folded or unfolded state based on the data.

[0180] It should be understood that the layout of the first content is different from that of the second content.

[0181] For example, the arrangement of the first content displayed on the first screen is different from the arrangement of the second content displayed on the second screen.

[0182] In this embodiment, displaying the second content containing the content to be gazed upon on the second screen by highlighting the content to be gazed upon can be understood as follows: when the second content is displayed on the second screen, the content to be gazed upon is highlighted. This ensures that the user can immediately spot the content to be gazed upon on the second screen, thus ensuring the continuity of the user's reading experience.

[0183] The methods for highlighting the content being gazed upon may include, but are not limited to, at least one of the following: color contrast, brightness adjustment, size adjustment, embellishment of the content being gazed upon, dynamic display, layout adjustment, marking, and prompts.

[0184] The following provides a detailed explanation of these methods.

[0185] 1) Color contrast: By choosing colors that contrast sharply with non-focused content, the focusable content can be made to stand out more visually.

[0186] 2) Size adjustment: If the content being gazed upon is text, the font size of the content being gazed upon can be increased; if the content being gazed upon is an image or video, the size of the area where the content being gazed upon is located can be increased.

[0187] 3) Enhancement: Adding background color blocks to the content being observed can visually distinguish it from non-observed content.

[0188] 4) Dynamic display method: Display the content being viewed through animation, flashing or other dynamic effects to make it more visually appealing.

[0189] 5) Layout adjustment: By adjusting the layout and position of the content, the content to be focused on can be made more visually prominent.

[0190] 6) Marking: Add icons, borders or other markers to the content being viewed to make it stand out from the crowd of information.

[0191] 7) Use pop-up windows or prompts to indicate the location of the content being observed.

[0192] In this way, by using at least one of the above methods, the content being gazed upon can be highlighted, ensuring that after the form of the electronic device changes, the user can immediately find the content being gazed upon on the screen where the form changes, thus ensuring the continuity of reading and greatly improving the user experience.

[0193] The following provides a detailed explanation of several schemes for refining the step of "displaying second content containing the gazed content on a second screen in a manner that highlights the gazed content" using at least one of the above methods. The content in the second content other than the gazed content can be referred to as non-gazed content.

[0194] Option 1: Display the gazed content at a first brightness level and the non-gazed content at a second brightness level on the second screen, with the first brightness level being higher than the second brightness level.

[0195] In this embodiment of the application, the content being gazed upon is displayed on the second screen at a first brightness, while the content not being gazed upon is displayed at a second brightness. In other words, the content being gazed upon is highlighted on the second screen.

[0196] For example, taking a foldable phone as an example, the first display interface 41 shown in Figure 4(a) is the display interface when the foldable phone is in its folded state, and the first content is the content of the first display interface 41. When the foldable phone detects that its shape has changed from a folded state to an unfolded state, it can display the second display interface 42 shown in Figure 4(b). On the second display interface 42, the viewed content and the non-viewed content are displayed with different brightness levels, with the displayed brightness of the viewed content being higher than that of the non-viewed content. The non-viewed content refers to the content of the second display interface 42 other than the viewed content. In this way, the user can immediately find the viewed content on the second display interface 42, ensuring the continuity of reading and greatly improving the user experience.

[0197] Furthermore, after displaying the gazed content at a first brightness and at least the non-gazed content at a second brightness on the second screen, at least the content displayed on the first screen can be displayed on the second screen at the same brightness (i.e., a third brightness). This ensures that the user can seamlessly transition from the highlighted gazed content to reading all content normally. This process not only improves the efficiency of the user in finding the gazed content but also ensures the continuity and comfort of reading, providing the user with a smoother and more enjoyable experience.

[0198] It should be understood that the third brightness can be the same as the first brightness; the third brightness can also be the same as the second brightness. Of course, the third brightness can also be a brightness between the first brightness and the second brightness; or, the third brightness can be higher than the first brightness. The embodiments of this application do not specifically limit the third brightness.

[0199] For example, taking a foldable phone as an example, the first display interface 41 shown in Figure 4(a) is the display interface when the foldable phone is in its folded state. When the foldable phone detects that its shape has changed from the folded state to the unfolded state, the foldable phone can switch the display interface from the first display interface 41 shown in Figure 4(a) to the second display interface 42 shown in Figure 4(b), and then display the third display interface 43 shown in Figure 4(c). All content in the third display interface 43 is displayed at the same brightness, which is the same as the brightness of the content displayed on the second display interface 42.

[0200] Option 2: Using a progressive display method, display the second content on the second screen, starting with the content being viewed.

[0201] This progressive display method begins with the content the user is focused on, highlighting it with high brightness to attract their attention. Then, non-focused content gradually unfolds and appears around this focused content, ensuring the information is presented in a layered yet abrupt manner. In this way, without interrupting the user's current reading, the viewer's gaze is smoothly guided to the second screen, allowing them to maintain focus on the current content while naturally browsing more non-focused information. This ensures reading continuity and enhances the user's visual experience.

[0202] For example, taking a foldable phone as an example, the fourth display interface 51 shown in Figure 5(a) is the display interface when the foldable phone is in its folded state. When the foldable phone detects that it is changing from its folded state to its unfolded state, it can sequentially display the fifth display interface 52 shown in Figure 5(b), the sixth display interface 53 shown in Figure 5(c), and the seventh display interface 54 shown in Figure 5(d). During this process, the second content is gradually displayed with the viewed content as the visual center. The entire transition process is natural and smooth, which not only enhances the visual enjoyment but also ensures the continuity and comfort of the user's reading experience.

[0203] Option 3: Display the gazed content dynamically on the second screen, and display the non-gazed content other than the gazed content in the second content statically.

[0204] The display method employs dynamic techniques to show the content that is being watched, such as through animation or flashing. This attracts the user's attention, ensuring that the user immediately notices the content on the second screen. Simultaneously, non-watchful content is displayed statically, allowing the user to browse it without distraction. This combination of dynamic and static methods not only ensures the continuity of the user's reading experience but also achieves a clear division of information hierarchy, enabling the user to understand the presented information more efficiently.

[0205] For example, taking a foldable phone as an example, the eighth display interface 61 shown in Figure 6(a) is the display interface of the foldable phone in its folded state. When the foldable phone detects that it is changing from its folded state to its unfolded state, it can sequentially display the ninth display interface 62 shown in Figure 6(b) and the tenth display interface 63 shown in Figure 6(c). During this process, the content being observed is presented in a jumping manner, making the size of the area where the content being observed is located in the tenth display interface 63 smaller than the size of the area where the content being observed is located in the eleventh display interface 64. In this way, through the visual scaling effect, the user can immediately notice the content being observed, providing the user with a smooth interface transition experience.

[0206] In addition, after displaying the gazed content in a dynamic manner on the second screen and at least the non-gazed content in a static manner, the content displayed on the first screen can also be displayed on the second screen at the same brightness (i.e., a third brightness).

[0207] For example, taking a foldable phone as an example, the eighth display interface 61 shown in Figure 6(a) is the display interface of the foldable phone when it is in the folded state. When the foldable phone detects that it is changing from the folded state to the unfolded state, it can sequentially display the ninth display interface 62 shown in Figure 6(b), the tenth display interface 63 shown in Figure 6(c), and the eleventh display interface 64 shown in Figure 6(d). In this way, after highlighting the content being viewed, it can seamlessly transition from highlighting the content being viewed to reading all content normally. This process not only improves the efficiency of the user in finding the content being viewed, but also ensures the continuity and comfort of reading, providing the user with a smoother and more enjoyable user experience.

[0208] Option 4: While displaying the second content on the second screen, highlight the content being observed using a border marker.

[0209] For example, taking a foldable phone as an example, the twelfth display interface 71 shown in Figure 7(a) is the display interface of the foldable phone in its folded state, where the content being observed is, for example, a memo icon. When the foldable phone detects that it is changing from its folded state to its unfolded state, it can display the thirteenth display interface 72 shown in Figure 7(b). In the thirteenth display interface 72, the content being observed is displayed within a border. The line color, line thickness, and size of the border can be flexibly set, and this embodiment does not limit this.

[0210] The above solution uses border markings to frame the content being gazed upon, thus highlighting it. This method attracts the user's attention, allowing the user to immediately spot the content being gazed upon on the second screen, ensuring the continuity of the user's reading and improving the user's reading experience.

[0211] Option 5: While displaying the second content on the second screen, use a prompt box to highlight the content being observed.

[0212] For example, taking a foldable phone as an example, the twelfth display interface 71 shown in Figure 7(a) is the display interface of the foldable phone in its folded state, where the content being observed is, for example, a memo icon. When the foldable phone detects that it has changed from its folded state to its unfolded state, it can display the fourteenth display interface 73 shown in Figure 7(c). In the fourteenth display interface 73, there is a prompt box pointing to the content being observed, and the content in the prompt box is "I'm here." The user can immediately find the content being observed in the fourteenth display interface 73 based on the prompt box.

[0213] The above solution uses a prompt box to indicate the location of the content being viewed, thus highlighting it. This method attracts the user's attention and allows the user to immediately find the content on the unfolded screen, ensuring the continuity of reading and improving the user's reading experience.

[0214] Option 6: While displaying the second content on the second screen, highlight the content being viewed by adjusting its size.

[0215] For example, taking a foldable phone as an example, the twelfth display interface 71 shown in Figure 7(a) is the display interface of the foldable phone in its folded state, where the viewed content is, for example, a memo icon. When the foldable phone detects that it is changing from its folded state to its unfolded state, it can display the fifteenth display interface 74 shown in Figure 7(d). In the fifteenth display interface 74, the size of the area containing the viewed content is larger than the size of the area containing any non-viewed content. Each non-viewed content refers to every image on the fifteenth display interface 74 other than the viewed content.

[0216] The above solution increases the size of the area where the content is being viewed by adjusting its dimensions, thereby highlighting the content. This method can attract the user's attention and allow the user to immediately find the content on the unfolded screen, ensuring the continuity of the user's reading and improving the user's reading experience.

[0217] Option 7: While displaying the second content on the second screen, use layout adjustments to highlight the content being observed.

[0218] For example, taking a foldable phone as an example, the twelfth display interface 71 shown in Figure 7(a) is the display interface of the foldable phone in its folded state, where the focused content is, for example, the memo icon. When the foldable phone detects that it is changing from its folded state to its unfolded state, it can display the sixteenth display interface 81 as shown in Figure 8. In the sixteenth display interface 81, the focused content is in the center position, and non-focused content is displayed around the focused content. The non-focused content consists of the icons other than the memo icon among the multiple application icons in the sixteenth display interface 81.

[0219] The above solution highlights the content to be viewed by adjusting the layout. This method can attract the user's attention and make the content immediately visible on the unfolded screen, ensuring the continuity of the user's reading and improving the user's reading experience.

[0220] It should be noted that, in the embodiments of this application, S901 can be executed by the operating system of the electronic device or by a target application on the electronic device. Similarly, S902 can be executed by the operating system or by the target application; S903 can be executed by the operating system or by the target application.

[0221] In one possible implementation, the first screen of the electronic device in its first form displays an application interface, and the target application can be the application corresponding to that application interface.

[0222] For example, when the electronic device is in its first form, the display interface of the first screen is the first display interface 41 shown in Figure 4(a), which is an image browsing interface of a gallery. In this case, the target application can be a gallery. Alternatively, when the electronic device is in its first form, the display interface of the first screen is the interface of a home management application, such as the interface of a smart living application. In this case, the target application can be a smart living application.

[0223] Alternatively, if the first screen of the electronic device in its first state displays the interface of a video application A, then the target application can be application A.

[0224] Alternatively, if the first screen of the electronic device in its first state displays the interface of a document-type application B, then the target application can be application B.

[0225] In one possible implementation, if the display interface of the first screen of the electronic device in its first form is a non-application interface, then the target application can be a preset one.

[0226] For example, the target application can be a theme application, a desktop management application, or a system application.

[0227] This application provides an information processing method applied to an electronic device. When a first screen displays first content, the method acquires the user's posture information, including facial posture information and / or eye information. The first screen is the screen on which the electronic device operates in a first state. Based on the posture information, the method determines the user's gaze content from the first content. When the electronic device transitions from the first state to a second state, the method displays second content containing the gaze content on a second screen, highlighting the gaze content. The second screen is the screen on which the electronic device operates in the second state. Thus, when the electronic device transitions from the first state to the second state, the user's gaze content from the first state can be displayed on the screen operating in the second state, ensuring a seamless transition and continued browsing for the user. This guarantees the smoothness and continuity of reading and greatly improves the user experience. It eliminates the need for users to spend a significant amount of time searching for previously viewed content (i.e., gaze content) on the second screen, as in related technologies, thus solving the problem of users wasting considerable time searching for gaze content on the second screen, leading to reading interruptions and a poor user experience.

[0228] The following describes in detail the information processing method provided in this application embodiment, using the following examples: "acquiring user posture information" executed by the operating system of the electronic device; "determining the user's gaze content from the first content based on the posture information" executed by the target application on the electronic device; and "displaying second content containing the gaze content on the second screen in a way that highlights the gaze content when the electronic device transitions from a first form to a second form" executed by the target application. Figure 10 is a flowchart of this information processing method. As shown in Figure 10, the method includes S1001 to S1006. Wherein:

[0229] S1001. When the first screen displays the first content, the user's posture information is obtained through the operating system on the electronic device. The posture information includes facial posture information and / or eye information. The first screen is the screen that the electronic device operates when it is in the first state.

[0230] S1002, The operating system sends the attitude information to the target application. Correspondingly, the target application receives the attitude information.

[0231] For example, the display interface of the first screen is the first display interface 41 shown in Figure 4(a), which is an image browsing interface of a gallery, and the target application can be a gallery. Alternatively, in the first form, the display interface of the first screen of the electronic device is the interface of a home management application, such as the interface of a smart living application, and the target application can be a smart living application.

[0232] S1003, Target application, determines the user's gaze content from the first content based on posture information.

[0233] S1004 and S1005 can be executed after S1003. Alternatively, S1006 can be executed after S1003.

[0234] S1004. When the electronic device changes from the first form to the second form, the operating system sends a control instruction to the target application. The control instruction is used to control the target application to display second content containing the gazed content on the second screen in a way that highlights the gazed content.

[0235] S1005. The target application displays second content on the second screen in a way that highlights the content being viewed, based on control commands.

[0236] S1006. When the electronic device changes from the first form to the second form, the target application displays second content containing the gazed content on the second screen in a way that highlights the gazed content.

[0237] The second screen is the screen that operates when the electronic device is in its second state.

[0238] In this embodiment of the application, when the electronic device switches from a first form to a second form, the target application can actively display at least the content displayed on the first screen on the second screen in a way that highlights the content being viewed.

[0239] It should be noted that the descriptions of the same steps and contents in the embodiments of this application as in other embodiments can be referred to the descriptions in other embodiments, and will not be repeated here.

[0240] This application provides an information processing method applied to an electronic device. When a first screen displays first content, the user's posture information, including facial posture information and / or eye information, is obtained through the operating system on the electronic device. The first screen is the screen on which the electronic device operates in a first state. Based on the posture information, a target application on the electronic device determines the user's gaze content from the first content, where the first content is the content of the target application's display interface. When the electronic device transitions from the first state to a second state, the target application displays second content containing the gaze content on the second screen in a way that highlights the gaze content. Thus, when the electronic device transitions from the first state to the second state, the user's gaze content from the first state can be displayed on the screen operating in the second state, ensuring a seamless transition and continued browsing, guaranteeing the smoothness and continuity of reading, and greatly improving the user experience.

[0241] Figure 11 shows a schematic diagram of another electronic device provided in this application. The dashed lines in Figure 11 indicate that the unit or module is optional. The electronic device 1100 can be used to implement the methods described in the above method embodiments. The electronic device 1100 can be a terminal device, such as a foldable mobile phone.

[0242] The electronic device 1100 includes one or more processors 1101, which can support the electronic device 1100 in implementing the methods in the corresponding method embodiments of FIG9 or FIG10. The processor 1101 can be a general-purpose processor or a special-purpose processor. For example, the processor 1101 can be a central processing unit (CPU). The CPU can be used to control the electronic device 1100, execute software programs, and process data from the software programs. The electronic device 1100 may also include a communication unit 1105 for implementing signal input (reception) and output (transmission).

[0243] The aforementioned electronic device 1100 may be a chip (system) including a memory and a processor, wherein the processor is configured to execute a computer program stored in the memory to implement the methods shown in the various embodiments above.

[0244] The communication unit 1105 may be an input and / or output circuit of the chip (system), or the communication unit 1105 may be a communication interface of the chip (system), and the chip (system) may be a component of the electronic device 1100.

[0245] For example, communication unit 1105 may be a transceiver of electronic device 1100, or communication unit 1105 may be a transceiver circuit of electronic device 1100. Electronic device 1100 may include one or more memories 1102, which store program 1104. Program 1104 may be executed by processor 1101 to generate instructions 1103, causing processor 1101 to execute the method described in the above method embodiments according to instructions 1103. Optionally, memory 1102 may also store data. Optionally, processor 1101 may also read data stored in memory 1102, which may be stored at the same memory address as program 1104, or the data may be stored at a different memory address than program 1104.

[0246] The processor 1101 and memory 1102 can be configured separately or integrated together, for example, integrated on a system-on-chip (SOC) of an electronic device. For details on how the processor 1101 performs the bag detection method, please refer to the relevant description in the method embodiments.

[0247] It should be understood that the steps of the above method embodiments can be implemented by hardware logic circuits or software instructions in the processor 1101. The processor 1101 may be a CPU, a digital signal processor (DSP), a field programmable gate array (FPGA), or other programmable logic devices, such as discrete gate, transistor logic devices, or discrete hardware components.

[0248] This application also provides a computer program product that, when executed by processor 1101, implements the method of any of the method embodiments in this application. The computer program product can be stored in memory 1102, for example, as program 1104. Program 1104 undergoes preprocessing, compilation, assembly, and linking processes to ultimately be converted into an executable object file that can be executed by processor 1101.

[0249] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a computer, implements the method of any of the method embodiments of this application. The computer program may be a high-level language program or an executable object program.

[0250] The computer-readable storage medium is, for example, memory 1102. Memory 1102 can be volatile memory or non-volatile memory, or memory 1102 can include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), SynchLink DRAM (SLDRAM), and Direct Rambus RAM (DRRAM).

[0251] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process and technical effects of the above-described apparatus and equipment can be referred to the corresponding processes and technical effects in the foregoing method embodiments, and will not be repeated here.

[0252] The systems, apparatuses, and methods disclosed in the embodiments provided in this application can be implemented in other ways. For example, some features of the method embodiments described above may be omitted or not performed. The apparatus embodiments described above are merely illustrative; the division of units is only a logical functional division, and in actual implementation, there may be other division methods. Multiple units or components may be combined or integrated into another system. Furthermore, the coupling between units or components can be direct or indirect, including electrical, mechanical, or other forms of connection.

[0253] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

[0254] Finally, the above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An information processing method characterized by comprising: The method comprises: When a first screen displays first content, obtaining posture information of a user, the posture information comprising face posture information and / or eye information, the first screen being a screen working when the electronic device is in a first form; Based on the posture information, determining a gaze content of the user from the first content; In a case where the electronic device is converted from the first form to a second form, displaying second content containing the gaze content on a second screen in a manner of highlighting the gaze content, wherein the second screen is a screen working when the electronic device is in the second form.

2. The method of claim 1, wherein, The layout of the first content and the layout of the second content are different.

3. The method according to claim 1 or 2, characterized in that, The displaying of the second content containing the gaze content on the second screen in the manner of highlighting the gaze content comprises: Displaying the second content starting from the gaze content on the second screen in a progressive display manner.

4. The method according to claim 1 or 2, characterized in that, The displaying of the second content containing the gaze content on the second screen in the manner of highlighting the gaze content comprises: Displaying the gaze content on the second screen at a first brightness, and displaying content other than the gaze content in the second content on the second screen at a second brightness, the first brightness being higher than the second brightness.

5. The method according to claim 1 or 2, characterized in that, The displaying of the second content containing the gaze content on the second screen in the manner of highlighting the gaze content comprises: Displaying the gaze content on the second screen in a dynamic display manner, and displaying content other than the gaze content in the second content on the second screen in a static display manner.

6. The method of claim 5, wherein, The display brightness of the gaze content is higher than the display brightness of the content other than the gaze content in the second content.

7. The method of any one of claims 4-6, wherein, After the displaying of the second content containing the gaze content on the second screen in the manner of highlighting the gaze content, the method further comprises: Displaying the second content on the second screen at a third brightness.

8. The method of claim 1 or 2, wherein, The manner of highlighting the gaze content comprises at least one of color contrast, size adjustment, layout adjustment, decoration, and marking.

9. The method according to any one of claims 1 to 8, characterized in that, The obtaining of the posture information of the user comprises: obtaining the posture information in a case where one or more of the following conditions is met: A gaze duration of the user with respect to the first screen meets a first duration threshold; A distance between the user and the first screen meets a target distance threshold; A working duration of the first screen meets a second duration threshold; or The first content is target content.

10. The method according to any one of claims 1 to 9, characterized in that, The determining of the gaze content of the user from the first content based on the posture information comprises: Based on the posture information, determining a gaze position of the user on the first screen; Based on the gaze position, determining the gaze content from the first content.

11. An information processing method characterized by comprising: The method comprises: When a first screen displays first content, obtaining posture information of a user by an operating system on an electronic device, the posture information comprising face posture information and / or eye information, the first screen being a screen working when the electronic device is in a first form; determine, by a target application program on the electronic device, a gaze content of the user from the first content based on the posture information, the first content being content of a display interface of the target application program; in a case where the electronic device is converted from the first form to a second form, display, by the target application program, second content containing the gaze content in a manner of highlighting the gaze content on a second screen, the second screen being a screen that works when the electronic device is in the second form.

12. An electronic device, comprising: comprising: a processor coupled to a memory storing programs or instructions that, when executed by the processor, cause the electronic device to perform the method of any one of claims 1-10 or 11.

13. A chip system, characterized by The chip system includes a memory and a processor configured to execute a computer program stored in the memory to implement the method of any one of claims 1-10 or 11.

14. A computer readable storage medium having stored thereon a computer program or instructions, characterized in that, The computer program or instructions, when executed, cause a computer to perform the method of any one of claims 1-10 or 11.

15. A computer program product, characterised in that, comprising computer program instructions that cause the computer to perform the method of any one of claims 1-10 or 11.

Images