Information processing method and device and computer readable storage medium

Abstract

The invention provides an information processing method and device and a computer readable storage medium, and the method comprises the steps: obtaining the posture information of a user when a first screen displays a first content, the first screen being a screen working when an electronic device is in a first form; determining a gaze content of the user from the first content based on the posture information; and under the condition that the electronic equipment is converted from the first form to the second form, second content containing the gazing content is displayed on a second screen in a mode of highlighting the gazing content, and the second screen is a screen working when the electronic equipment is in the second form. When the electronic equipment is converted from the first form to the second form, the content watched by the user when the electronic equipment is in the first form can be highlighted on the screen working in the second form, so that seamless connection and continuous browsing of the user can be ensured, the smoothness and continuity of reading are ensured, and the use experience of the user is greatly improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the terminal field, and in particular to an information processing method, device and computer readable storage medium. BACKGROUND

[0002] Foldable mobile phone is a kind of mobile phone with foldable screen design. In the folded form, the screen can be reduced to the size of a traditional mobile phone, making it convenient for users to carry and store; in the unfolded form, the screen will expand to a larger size, providing users with a wider field of view and more abundant operation space. However, when the foldable mobile phone is converted between different forms, due to the significant change in screen size and the flip of the open and closed forms, it cannot guarantee the continuity of the user in the reading scenario, reducing the user experience. SUMMARY

[0003] The present application provides an information processing method, device and computer readable storage medium, which can highlight the user's gaze content in the first form on the screen working in the second form when the electronic device is converted from the first form to the second form, ensuring that the user can seamlessly continue browsing, ensuring the smoothness and continuity of reading, and greatly improving the user experience.

[0004] In a first aspect, an information processing method is provided, applied to an electronic device, the method comprising: when a first screen displays a first content, acquiring posture information of a user, the posture information comprising face posture information and / or eye information, the first screen being a screen working when the electronic device is in a first form; determining, based on the posture information, a gaze content of the user from the first content; in the case where the electronic device is converted from the first form to a second form, displaying a second content containing the gaze content on a second screen in a manner of highlighting the gaze content, wherein the second screen is a screen working when the electronic device is in the second form.

[0005] It should be understood that the electronic device can be a device capable of being converted between different forms, such as a foldable mobile phone, a foldable tablet computer and the like. Among them, the screens working in different forms of the electronic device are different.

[0006] Exemplarily, the first form is a folded form, and the second form is an unfolded form; or, the first form is an unfolded form, and the second form is a folded form.

[0007] It should be understood that the posture information of the user can be acquired in real time or periodically.

[0008] Exemplarily, the face posture information can include, but is not limited to, at least one of a head tilt angle, a face orientation, and face expression information; and the eye information can include at least one of pupil position and size, eyelid state, and eye movement information.

[0009] It should be understood that the gaze content can be content that the user gazes at when viewing content (i.e., first content) of the first screen.

[0010] It should be understood that the first content is content displayed by the first screen when the electronic device is in the first form.

[0011] It should be understood that the second content includes at least part of the first content, and the at least part of the first content includes the gaze content. Content in the second content other than the gaze content can be referred to as non-gaze content.

[0012] In a possible implementation, the second content is the first content.

[0013] In a possible implementation, the second content is part of the first content.

[0014] In a possible implementation, the second content includes the first content and third content, and the third content is content related to the first content.

[0015] It should be understood that the second content can be determined by the electronic device based on a layout of the first content and / or a size of the second screen.

[0016] Exemplarily, in a case where a size difference between the size of the first screen and the size of the second screen is less than a size difference threshold, the second content is determined to be the first content or part of the first content; and the part of the content can be determined from the first content based on a layout of the first content. In a case where the size difference between the size of the first screen and the size of the second screen is greater than or equal to the size threshold, and the size of the second screen is greater than the size of the first screen, third content related to the first content is obtained, and the third content and the first content are taken as the second content. In a case where the size difference between the size of the first screen and the size of the second screen is greater than or equal to the size threshold, and the size of the second screen is less than the size of the first screen, the second content is determined to be part of the first content, and the part of the content can be determined from the first content based on the layout of the first content.

[0017] In a possible implementation, the layout of the first content and the layout of the second content are different.

[0018] Exemplarily, an arrangement manner of the first content displayed on the first screen is different from an arrangement manner of the second content displayed on the second screen.

[0019] In this way, although the layout of the first content and the layout of the second content are different, the user can immediately find the gaze content on the second screen by using the information processing method provided in the present application, and ensure that the user can seamlessly continue browsing, ensuring the fluency and continuity of reading, greatly improving the user experience. It does not need to spend a lot of time on the second screen to find the previous gaze content as in the related art, which solves the problem of low user experience caused by the user wasting a lot of time on the second screen to find the gaze content, which causes the reading to be interrupted.

[0020] In a possible implementation, the second content containing the gaze content is displayed on the second screen in a highlighted manner, including: displaying the second content starting from the gaze content on the second screen in a progressive display manner.

[0021] The above scheme smoothly transitions the user's line of sight to the second screen without interrupting the user's current reading, allowing the user to naturally browse more non-gaze content while maintaining focus on the gaze content, ensuring the continuity of the user's reading and improving the user's visual experience when reading.

[0022] In a possible implementation, the second content containing the gaze content is displayed on the second screen in a highlighted manner, including: displaying the gaze content on the second screen with a first brightness, and displaying the content other than the gaze content in the second content on the second screen with a second brightness, the first brightness being higher than the second brightness.

[0023] The above scheme allows the user to immediately find the reading breakpoint, ensuring the continuity of the user's reading and improving the user's visual experience when reading.

[0024] In a possible implementation, the second content containing the gaze content is displayed on the second screen in a highlighted manner, including: displaying the gaze content on the second screen in a dynamic display manner, and displaying the content other than the gaze content in the second content on the second screen in a static display manner.

[0025] The above scheme can attract the user's attention and ensure that the user can immediately find the gaze content on the second screen. At the same time, non-gaze content is also displayed statically, allowing the user to browse non-gaze content without distraction. This combination of dynamic and static display not only ensures the continuity of the user's reading, but also clearly divides the levels of information, allowing the user to more efficiently understand the presented information.

[0026] In a possible implementation, the display brightness of the gaze content is higher than the display brightness of at least the non-gaze content.

[0027] The above scheme highlights the gaze content through the brightness contrast, so that the user can quickly find the gaze content on the second screen and continue browsing, thereby improving the reading efficiency and comfort, and further enhancing the user experience.

[0028] In a possible implementation, after displaying the second content containing the gaze content on the second screen in the manner of highlighting the gaze content, the method further includes: displaying the second content on the second screen with a third brightness.

[0029] It should be understood that the third brightness can be the same as the first brightness; the third brightness can also be the same as the second brightness. Of course, the third brightness can also be a brightness between the first brightness and the second brightness; or, the third brightness is higher than the first brightness.

[0030] The above scheme ensures that the user can seamlessly transition from the highlighted gaze content to the state of normally reading all content (i.e., the second content). This process not only improves the user's efficiency in finding the gaze content, but also guarantees the continuity and comfort of reading, providing a more smooth and enjoyable user experience.

[0031] In a possible implementation, the manner of highlighting the gaze content includes at least one of color contrast, size adjustment, layout adjustment, decoration, and marking.

[0032] In a possible implementation, the obtaining of the posture information of the user includes: obtaining the posture information in a case where one or more of the following conditions are met: a gaze duration of the user on the first screen meets a first duration threshold; a distance between the user and the first screen meets a target distance threshold; a working duration of the first screen meets a second duration threshold; or the first content is target content.

[0033] In a possible implementation, the determining of the gaze content of the user from the first content based on the posture information includes: determining a gaze position of the user on the first screen based on the posture information; and determining the gaze content from the first content based on the gaze position.

[0034] In a second aspect, an information processing method is provided. The method can be executed by an electronic device, a component of the electronic device, or a logic module or software that can realize all or part of the functions of the electronic device.

[0035] The method comprises: when a first screen displays first content, acquiring, by an operating system on the electronic device, posture information of a user, the posture information comprising face posture information and / or eye information, the first screen being a screen that works when the electronic device is in a first form; determining, by a target application program on the electronic device, based on the posture information, a gaze content of the user from the first content, the first content being content of a display interface of the target application program; in a case where the electronic device is converted from the first form to a second form, displaying, by the target application program, second content containing the gaze content on a second screen in a manner of highlighting the gaze content, the second screen being a screen that works when the electronic device is in the second form.

[0036] The above scheme, through the cooperative work of the operating system and the target application program, can display the gaze content of the user in the first form on the screen that works in the second form when the electronic device is converted from the first form to the second form, ensuring that the user can seamlessly continue browsing, guaranteeing the fluency and continuity of reading, and greatly improving the user experience. The user does not need to spend a lot of time on the second screen to find the gaze content in the first form as in the related art, solving the problem of low user experience caused by the waste of a lot of time in the related art when reviewing the gaze content in the first form.

[0037] In a possible implementation, the layout of the first content and the layout of the second content are different.

[0038] In a possible implementation, the displaying, in a manner of highlighting the gaze content, of the second content containing the gaze content on the second screen comprises: displaying, in a progressive display manner, the second content starting from the gaze content on the second screen.

[0039] In a possible implementation, the displaying, in a manner of highlighting the gaze content, of the second content containing the gaze content on the second screen comprises: displaying the gaze content on the second screen at a first brightness, and displaying content other than the gaze content in the second content on the second screen at a second brightness, the first brightness being higher than the second brightness.

[0040] In a possible implementation, the displaying, in a manner of highlighting the gaze content, of the second content containing the gaze content on the second screen comprises: displaying the gaze content on the second screen in a dynamic display manner, and displaying content other than the gaze content in the second content on the second screen in a static display manner.

[0041] In a possible implementation, the display brightness of the gaze content is higher than the display brightness of the content other than the gaze content in the second content.

[0042] In a possible implementation, after displaying the second content containing the gaze content on the second screen in the manner of highlighting the gaze content, the method further includes: displaying the second content on the second screen in a third brightness.

[0043] In a possible implementation, the manner of highlighting the gaze content includes at least one of color contrast, size adjustment, layout adjustment, decoration, and marking.

[0044] In a possible implementation, the obtaining of the posture information of the user includes: obtaining the posture information in a case where one or more of the following conditions are met: a gaze duration of the user on the first screen meets a first duration threshold; a distance between the user and the first screen meets a target distance threshold; a working duration of the first screen meets a second duration threshold; or the first content is target content.

[0045] In a possible implementation, the determining of the gaze content of the user from the first content based on the posture information includes: determining a gaze position of the user on the first screen based on the posture information; and determining the gaze content from the first content based on the gaze position.

[0046] In a third aspect, an electronic device is provided, which includes a processor and a memory. The memory is configured to store a computer program, and the processor is configured to invoke and run the computer program from the memory, so that the electronic device executes the method in any one of the first aspect.

[0047] In a fourth aspect, an electronic device is provided, which includes a processor and a memory. The memory is configured to store a computer program, and the processor is configured to invoke and run the computer program from the memory, so that the electronic device executes the method in any one of the second aspect.

[0048] In a fifth aspect, a computer readable storage medium is provided, which stores a computer program. When the computer program is executed by a processor, the processor executes the method in any one of the first aspect.

[0049] In a sixth aspect, a computer readable storage medium is provided, which stores a computer program. When the computer program is executed by a processor, the processor executes the method in any one of the second aspect.

[0050] In a seventh aspect, an embodiment of the present application provides a computer program product, which comprises computer program codes, and when the computer program codes are executed by an electronic device, the electronic device performs any of the methods in the first aspect.

[0051] In an eighth aspect, an embodiment of the present application provides a computer program product, which comprises computer program codes, and when the computer program codes are executed by an electronic device, the electronic device performs any of the methods in the second aspect.

[0052] In a ninth aspect, an embodiment of the present application provides a chip system, which comprises processing circuitry and a storage medium, and the storage medium stores computer program instructions; when the computer program instructions are executed by the processing circuitry, any of the methods in the first aspect is implemented.

[0053] Optionally, the processing circuitry in the chip system can be replaced by a processor, and the storage medium can be replaced by a memory. Optionally, the chip system can further comprise a communication interface, which is configured to realize communication between the chip system and an external device.

[0054] In a tenth aspect, an embodiment of the present application provides a chip system, which comprises processing circuitry and a storage medium, and the storage medium stores computer program instructions; when the computer program instructions are executed by the processing circuitry, any of the methods in the second aspect is implemented.

[0055] Optionally, the processing circuitry in the chip system can be replaced by a processor, and the storage medium can be replaced by a memory. Optionally, the chip system can further comprise a communication interface, which is configured to realize communication between the chip system and an external device.

[0056] The beneficial effects of the technical solutions in the third aspect to the tenth aspect of the present application can refer to the beneficial effects of the technical solutions in the first aspect or the second aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0057] Figure 1 FIG. 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0058] Figure 2 FIG. 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0059] Figure 3 FIG. 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0060] Figure 4 FIG. 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0061] Figure 5 A display interface schematic diagram of the foldable mobile phone in another information processing method provided by an embodiment of the present application;

[0062] Figure 6 A display interface schematic diagram of the foldable mobile phone in another information processing method provided by an embodiment of the present application;

[0063] Figure 7 A display interface schematic diagram of the foldable mobile phone in another information processing method provided by an embodiment of the present application;

[0064] Figure 8 A display interface schematic diagram of the foldable mobile phone in another information processing method provided by an embodiment of the present application;

[0065] Figure 9 A flowchart of the information processing method provided by an embodiment of the present application;

[0066] Figure 10 A flowchart of another information processing method provided by an embodiment of the present application;

[0067] Figure 11 A structural schematic diagram of another electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0068] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

[0069] In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or; for example, A / B can represent A or B; "and / or" in this document is only a description of the association relationship of the associated objects, which means that there can be three relationships; for example, A and / or B, which means that there are three cases of A alone, A and B together, or B alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0070] Hereinafter, the terms "first", "second", "third" are only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first", "second", "third" can explicitly or implicitly include one or more features.

[0071] Embodiments of the present application provide an electronic device for performing the information processing method provided by the present application. In some embodiments of the present application, the electronic device can be a foldable mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc., or can be other devices or apparatuses capable of information processing. The specific type of the electronic device is not limited in the embodiments of the present application.

[0072] Exemplarily, Figure 1 FIG. 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present application.

[0073] As Figure 1 shown, the electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a charge management module 130, an antenna 1, an antenna 2, a display screen 140, a mobile communication module 150, a wireless communication module 160, etc.

[0074] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0075] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or can be integrated in one or more processors.

[0076] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of instruction fetching and instruction execution.

[0077] The processor 110 can also be provided with a memory for storing instructions and data.

[0078] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video and other files are saved in the external memory card.

[0079] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function, and the like.

[0080] The charging management module 130 is used to receive the charging input of the charger. The charger can be a wireless charger or a wired charger.

[0081] The electronic device 100 realizes the display function through the GPU, the display screen 140, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 140 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information. The display screen 140 can display text, images or videos in a human-computer interaction interface.

[0082] In some embodiments, the display screen 140 can be a flexible screen. The display screen 140 can form a larger display screen by stretching or unfolding the flexible screen, or form a smaller display screen by rolling up or folding the flexible screen.

[0083] The wireless communication function of the electronic device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0084] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the same device as at least part of the modules of the processor 110.

[0085] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), near field communication (NFC), etc. applied to the electronic device 100. In some embodiments, the antenna 1 of the electronic device 100 and the mobile communication module 150 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other terminal devices through wireless communication technology.

[0086] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Figure 1 The structure of the antenna 1 and the antenna 2 in the electronic device 100 is only an example. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0087] It should be understood that, in addition to the various components or modules listed in Figure 1 The structure of the electronic device 100 is not specifically limited in the embodiments of the present application. In some other embodiments of the present application, the electronic device 100 can further include more or fewer components than those shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0088] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiments of the present application take an Android system with a layered architecture as an example to exemplarily illustrate the software structure of the electronic device 100.

[0089] Figure 2 is a schematic diagram of the software structure of the electronic device 100 in the embodiments of the present application.

[0090] It should be understood that the layered architecture can divide software into several layers, each of which has a clear role and division of labor; layers can communicate with each other through software interfaces.

[0091] As shown in Figure 2 , the Android system can be divided into four layers; from top to bottom, the application layer, the application framework layer, the Android runtime and the system library, and the kernel layer. The application layer can include a series of application packages.

[0092] As shown in Figure 2 , the application package can include camera, gallery, calendar, map, navigation, WLAN, Bluetooth, music, video, home management and other applications. Among them, the home management application, such as Huawei's smart life application.

[0093] The application framework layer provides the application programming interface (application programming interface, API) and programming framework for the application layer application. The application framework layer includes some pre-defined functions.

[0094] As shown in Figure 2 , the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0095] The window manager is used to manage the window program. The window manager can get the display screen size, judge whether there is a status bar, lock the screen, intercept the screen, etc.

[0096] The content provider is used to store and obtain data, and makes these data accessible to applications. The data can include video, image, audio, dialing and answering phone, browsing history and bookmark, phonebook, etc.

[0097] The view system includes visual controls, such as controls that display text, controls that display pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views.

[0098] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of call state (including connection, hang up, etc.).

[0099] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0100] The notification manager enables applications to display notification information in the status bar, which can be used to convey notification type messages that can automatically disappear after a short stay without user interaction.

[0101] The Android runtime includes a core library and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0102] The core library contains two parts: one part is a function function that the java language needs to call, and the other part is the core library of Android.

[0103] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform functions such as management of object life cycle, stack management, thread management, security and exception management, and garbage collection.

[0104] The system library can include multiple functional modules, such as: a surface manager, media libraries, a three-dimensional graphics processing library (such as: open graphics library for embedded systems (OpenGL ES) and a 2D graphics engine (such as: skia graphics library (SGL)).

[0105] The surface manager is used to manage the display subsystem and provides fusion of 2D and 3D layers for multiple applications.

[0106] The media library supports playback and recording of multiple audio formats, playback and recording of multiple video formats, and static image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, moving picture experts group audio layer III (MP3), advanced audio coding (AAC), adaptive multi-rate (AMR), joint photographic experts group (JPG), and portable network graphics (PNG).

[0107] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.

[0108] The 2D graphics engine is a drawing engine for 2D drawing.

[0109] The kernel layer is a layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0110] For ease of understanding, the following embodiments of the present application will be described with reference to the electronic device shown in Figure 1 and Figure 2 , in combination with the accompanying drawings and application scenarios.

[0111] First, the related background involved in the embodiments of the present application will be explained.

[0112] Currently, when the foldable mobile phone is converted from the folded form to the unfolded form, or from the unfolded form to the folded form, due to the significant change in screen size and the flipping of the open and closed forms, the continuity of the user in the reading scenario cannot be guaranteed, and the user experience is reduced.

[0113] Exemplarily, in the folded form, the screen size of the foldable mobile phone may be small, suitable for single-handed operation or portability requirements. However, when the user wants to obtain a wider field of view or a more comfortable reading experience, the foldable mobile phone can be converted from the folded form to the unfolded form, and in this process, the sudden increase in screen size not only changes the user's visual focus, but also may cause the user to need to reposition or adapt to the new reading interface due to the rearrangement of the content. This significant change in screen size makes it difficult for the user to maintain continuity during reading. Moreover, the flipping of the open and closed forms is not simply the unfolding and folding of the screen, but may be accompanied by the physical flipping of the phone form. This flipping causes the direction or angle of the device to change, which may cause the interruption of reading content. Figure 3 In (a), the display interface of the mobile phone in the folded form is shown, at this time, the outer screen of the mobile phone is in the working state, and the inner screen is in the non-working state. Some application icons can be displayed on the outer screen; Figure 3 In (b), the display interface of the mobile phone in the unfolded form is shown, at this time, the inner screen of the mobile phone is in the working state, and the outer screen is in the non-working state. Among them, as shown in (a) in Figure 3 , when the mobile phone is in the folded form, the gaze content on the outer screen is, for example, the icon of the memo, when the mobile phone is converted from the folded form to the unfolded form, because of the rearrangement of the display content, the user needs to find the icon of the memo from the display interface shown in (b) in Figure 3 , the interruption of checking makes the user's experience poor.

[0114] Based on this, the embodiment of the present application provides an information processing method, which is applied to an electronic device. In the case that the electronic device is in a first form, the gaze content of a user is determined from the content displayed by a first screen (a screen working when the electronic device is in the first form). In the case that the electronic device is transformed from the first form to a second form, at least part of the content displayed by the first screen is displayed on a second screen (a screen working when the electronic device is in the second form) in a manner of highlighting the gaze content, and the gaze content is contained in the at least part of the content. In this way, when the electronic device is transformed from the first form to the second form, the user can immediately find the gaze content on the second screen, ensuring the continuity of reading and improving the user experience.

[0115] The electronic device can be a device capable of being transformed between different forms, such as a foldable mobile phone or a foldable tablet computer. The gaze content refers to the information or elements of a specific screen area focused and stayed by the user's line of sight when the user watches the first screen to obtain visual information. For example, the area or elements can be visual objects such as text, video, image, icon, button, etc. on the first screen.

[0116] Exemplarily, the first form is a folded form, and the second form is an unfolded form; or the first form is an unfolded form, and the second form is a folded form.

[0117] Exemplarily, the gaze content can be visual objects such as text, video, image, icon or button, etc. on the first screen.

[0118] Exemplarily, the electronic device is a foldable mobile phone. The screen working when the foldable mobile phone is in the folded form is an outer screen. The screen working when the foldable mobile phone is in the unfolded form is an inner screen. The size of the outer screen is smaller than the size of the inner screen.

[0119] The content displayed by the first screen includes but is not limited to at least one of the following:

[0120] 1) Image: photos taken by the user, video screenshots, pictures shared on social media, and emoticons, etc.

[0121] 2) Text: news push, blog articles, etc.

[0122] 3) Application interface: home screen, start-up interface of application program, game interface, etc.

[0123] 4) Icon: application program icon, function icon, navigation instruction icon, etc.

[0124] 5) User interactive element: button, slider, etc.

[0125] The following takes the electronic device as a foldable phone, the content displayed on the screen of the foldable phone when changing from the folded form to the unfolded form is an image as an example to explain the change of the display interface in the information processing method provided by the embodiment of the application in detail.

[0126] Figure 4 The display interface diagram of the foldable phone in the information processing method provided by the embodiment of the application. Figure 4 The interface change condition of highlighting the gaze content when the foldable phone changes from the folded form to the unfolded form is shown. Figure 4 The first display interface 41 shown in (a) is the display interface when the foldable phone is in the folded form, wherein the gaze content is an image among the multiple images displayed on the first display interface 41. When the foldable phone detects that it is converted from the folded form to the unfolded form, the foldable phone displays the content displayed in the folded form on the screen working in the unfolded form, that is, the second display interface 42 shown in (b) of FIG. 4. Figure 4 The second display interface 42 shown in (b) includes the content of the first display interface 41, and the gaze content is highlighted on the second display interface 42, while the content other than the gaze content on the second display interface 42 is displayed with a relatively low brightness. Subsequently, the foldable phone displays the third display interface 43 shown in (c) of FIG. 4, and the content displayed on the third display interface 43 is the same as that on the second display interface 42, but the brightness is different. The content displayed on the third display interface 43 is displayed with the same and relatively high display brightness. Figure 4

[0127] The above scheme, when the foldable phone changes from the folded form to the unfolded form, the foldable phone can display all the content displayed in the folded form on the second display interface 42, and highlight the content (i.e., the gaze content) gazed by the user in the folded form, so as to enable the user to immediately find the reading breakpoint. Subsequently, the foldable phone displays the third display interface 43, and the third display interface 43 also completely displays all the content displayed in the folded form, but all the content is presented with a uniform brightness without highlighting distinction, which provides an immersive and coherent reading environment for the user, guarantees the coherent and smooth reading, and improves the reading experience of the user.

[0128] Figure 5 The display interface diagram of the foldable phone in another information processing method provided by the embodiment of the application. Figure 5 The interface change condition of gradually displaying the content in the folded form from the gaze content when the foldable phone changes from the folded form to the unfolded form is shown. Figure 5 ​The fourth display interface 51 shown in (a) is a display interface when the foldable mobile phone is in the folded form. The gazed content is an image among the multiple images displayed on the fourth display interface 51. When the foldable mobile phone detects that it is converted from the folded form to the unfolded form, the foldable mobile phone displays all the content displayed in the folded form on the screen working in the unfolded form by using a gradual display manner. In this process, the foldable mobile phone first displays, for example, Figure 5 the fifth display interface 52 shown in (b). Subsequently, the foldable mobile phone displays Figure 5 the sixth display interface 53 shown in (c), which further expands the display range while retaining the content on the fifth display interface 52, so that the user can see more content displayed in the folded form. Finally, the foldable mobile phone displays Figure 5 the seventh display interface 54 shown in (d), which fully shows all the content displayed in the folded form.

[0129] The above scheme makes the whole transition process natural and smooth, which not only improves the visual enjoyment, but also ensures the continuity and comfort of the user's reading experience.

[0130] Figure 6 Another information processing method provided by the embodiment of the present application shows the display interface of the foldable mobile phone. Figure 6 The interface change when the foldable mobile phone changes from the folded form to the unfolded form is shown, which displays the gazed content by using a dynamic display manner and displays the non-gazed content by using a static display manner. Figure 6 The eighth display interface 61 shown in (a) is a display interface when the foldable mobile phone is in the folded form. The gazed content is an image among the multiple images displayed on the eighth display interface 61. When the foldable mobile phone detects that it is converted from the folded form to the unfolded form, the foldable mobile phone displays the gazed content by using a dynamic display manner and displays the non-gazed content by using a static display manner on the screen working in the unfolded form. In this process, the foldable mobile phone first displays, for example, Figure 6 the ninth display interface 62 shown in (b), in which the gazed content is highlighted, and the non-gazed content is displayed with a lower brightness. The non-gazed content is the content other than the gazed content in the ninth display interface 62. Then, the foldable mobile phone displays, for example, Figure 6 the tenth display interface 63 shown in (c), in which the size of the area where the gazed content is located is increased compared with the ninth display interface 62, the highlight display is still, and the non-gazed content remains low brightness. Finally, the foldable mobile phone displays, for example, Figure 6the eleventh display interface 64 shown in (d) in FIG. 6, at this time, all the content displayed in the folded mode is fully shown. Among them, the content displayed on the eleventh display interface 64 is the same as that on the tenth display interface 63, but the brightness is different. The gaze content and the non-gaze content on the eleventh display interface 64 are displayed with the same and higher display brightness, and the size of the area where the gaze content is located is the same as the size of the area where each non-gaze content is located.

[0131] The above scheme, when the foldable mobile phone changes from the folded mode to the unfolded mode, the foldable mobile phone can highlight the gaze content of the user in the folded mode in a high-brightness and size-increased jumping manner, while presenting the non-gaze content in a lower brightness and static manner. This process can guide the user's visual focus to the gaze content. Subsequently, all the content displayed in the folded mode is displayed on the screen working in the unfolded mode with the same brightness and size, ensuring the continuity of reading and the comfort of vision, and improving the user experience.

[0132] In the above Figures 4 to 6 In the interface embodiment corresponding to Figure 4 the first display interface 41 shown in (a) in FIG. 4, Figure 5 the fourth display interface 51 shown in (a) in FIG. 5, Figure 6 the eighth display interface 61 shown in (a) in FIG. 6 are the same. Figure 4 the third display interface 43 shown in (c) in FIG. 4, Figure 5 the seventh display interface 54 shown in (d) in FIG. 5, Figure 6 the eleventh display interface 64 shown in (d) in FIG. 6 are the same.

[0133] The following takes the foldable mobile phone as an example, the foldable mobile phone changes from the folded mode to the unfolded mode, and the content displayed on the screen in the folded mode is an application icon, to explain in detail the change of the display interface in the information processing method provided by the embodiment of the application.

[0134] Figure 7 The display interface schematic diagram of the foldable mobile phone in the information processing method provided by another embodiment of the application. Figure 7 The interface change condition of highlighting the gaze content by using the frame mark when the mobile phone changes from the folded mode to the unfolded mode is shown. Figure 7 The twelfth display interface 71 shown in (a) in FIG. 7 is the display interface when the mobile phone is in the folded mode, wherein the gaze content is an icon among the plurality of application icons displayed on the twelfth display interface 71, which is, for example, the icon of “Memo”. When the mobile phone detects that it is converted from the folded mode to the unfolded mode, the mobile phone will display Figure 7the thirteenth display interface 72 shown in (b) of FIG. 7; wherein the thirteenth display interface 72 includes the content of the twelfth display interface 71, and the gaze content is displayed in a frame. In this way, the user can quickly find the gaze content from the thirteenth display interface 72, without wasting a lot of time to find the gaze content from the thirteenth display interface 72, ensuring the continuity of the user's reading experience.

[0135] In a possible implementation, when the phone detects that it is converted from the folded form to the unfolded form, the phone can also display the fourteenth display interface 73 shown in (c) of FIG. 7 on the screen in the unfolded form. Figure 7 the fourteenth display interface 73 shown in (c) of FIG. 7; wherein the fourteenth display interface 73 includes the content of the twelfth display interface 71, and there is a prompt box in the fourteenth display interface 73 pointing to the gaze content, which is used to prompt the location of the gaze content. In this way, the user can immediately find the gaze content on the screen worked in the unfolded form according to the prompt box, ensuring the continuity of the user's reading experience.

[0136] In a possible implementation, when the phone detects that it is converted from the folded form to the unfolded form, the phone can also display the fifteenth display interface 74 shown in (d) of FIG. 7 on the screen in the unfolded form. Figure 7 the fifteenth display interface 74 shown in (d) of FIG. 7; wherein the fifteenth display interface 74 includes the content of the twelfth display interface 71, and the gaze content is highlighted in the form of being enlarged in size on the fifteenth display interface 74, and the size of the area where the gaze content is located is greater than the size of each area where non-gaze content is located. The non-gaze content can be the application icons other than the icon of the memo in the fifteenth display interface 74. Through this display mode, the user's attention can be attracted, so that the user can immediately find the gaze content on the screen worked in the unfolded form, ensuring the continuity of the user's reading experience.

[0137] In a possible implementation, when the phone detects that it is converted from the folded form to the unfolded form, the phone can also display the sixteenth display interface 81 shown in (e) of FIG. 7 on the screen in the unfolded form. Figure 8 the sixteenth display interface 81 shown in (e) of FIG. 7; wherein the gaze content is displayed as the core in the sixteenth display interface 81, and the content of the twelfth display interface 71 is displayed around the gaze content. The size of the area where the gaze content is located on the sixteenth display interface 81 is greater than the size of each area where non-gaze content is located. Of course, the size of the area where the gaze content is located can also be the same as the size of each area where non-gaze content is located, or the size of the area where the gaze content is located is less than the size of each area where non-gaze content is located, which is not limited in the embodiments of the present application. In this way, the user can quickly find the gaze content on the screen worked in the unfolded form, thereby ensuring the fluency and continuity of the reading experience.

[0138] In the above Figures 4 to 6 The gaze content is shown as an image in the corresponding interface embodiment, Figures 7 to 8 The gaze content is shown as an application icon in the corresponding interface embodiment, and in actual applications, the gaze content can also be text, buttons, and other visual objects. The type of gaze content is not limited in this embodiment.

[0139] In addition, in the above Figures 4 to 8 The corresponding interface embodiment is exemplified by the scenario where the foldable phone changes from a folded form to an unfolded form. Similarly, when the foldable phone changes from an unfolded form to a folded form, the above-mentioned manner can also be used to highlight the user's gaze content on the screen working in the folded form when in the unfolded form.

[0140] Figure 9 A flowchart of an information processing method provided by an embodiment of the present application. The information processing method can be applied to an electronic device (such as a foldable phone), and the information processing method is not limited to a specific order Figure 9 It should be understood that in other embodiments, the order of some steps in the method can be exchanged according to actual needs, or some steps can be omitted or deleted. As Figure 9 shown, the information processing method includes S901-S903, and each step is explained and described in detail below.

[0141] S901, when the first screen displays the first content, obtaining the posture information of the user.

[0142] The posture information includes facial posture information and / or eye information, and the first screen is the screen working when the electronic device is in the first form. The first content can be all the content displayed on the screen working when the electronic device is in the first form.

[0143] In the embodiment of the present application, the electronic device can be a device capable of converting between different forms, and the screen (i.e. the display screen) used by the electronic device is different in different forms. The electronic device includes at least two forms, which are the first form and the second form, respectively. The size of the first screen used by the electronic device in the first form can be the same as or different from the size of the second screen used by the electronic device in the second form. The electronic device can be a foldable phone, a foldable tablet, or the like.

[0144] Exemplarily, the first form can be a folded form, and the first screen used by the electronic device in the first form is an outer screen. The second form is an unfolded form, and the second screen used by the electronic device in the second form is an inner screen, and the size of the inner screen is larger than that of the outer screen.

[0145] Exemplarily, the first mode can be an unfolded mode, the first screen used by the electronic device in the second mode is an inner screen, the second mode is a folded mode, the second screen used by the electronic device in the second mode is an outer screen, and the size of the inner screen is greater than the size of the outer screen.

[0146] In the embodiment of the present application, the electronic device can collect a plurality of to-be-processed images of the user in real time or periodically through its own image acquisition component, and analyze the plurality of to-be-processed images to obtain the posture information. Of course, the posture information can also be obtained by other devices and sent to the electronic device.

[0147] In a possible implementation, the eye information can include at least one of pupil position and size, eyelid state, eye movement, and the like.

[0148] In a possible implementation, the facial posture information can include, but is not limited to, at least one of the following:

[0149] 1) Head tilt angle: the tilt degree of the head relative to a certain reference line;

[0150] 2) Face orientation: the overall orientation of the user's face.

[0151] 3) Facial expression information: used to represent the emotional state of the user, such as happiness, sadness, anger, surprise, fear, disgust.

[0152] In the embodiment of the present application, when the first screen displays the first content, the posture information of the user can be obtained by at least one of the following ways:

[0153] Method one, when the first screen displays the first content and the gaze duration of the user on the first screen meets a first duration threshold, the posture information is obtained.

[0154] In the embodiment of the present application, the electronic device can collect a plurality of eye images of the user through its own image acquisition component, and determine the eye movement of the user through the plurality of eye images, so as to analyze the gaze duration of the user on the first screen. In the case where the gaze duration meets the first duration threshold, the posture information of the user is collected, so as to ensure that the user intentionally opens or operates the first screen, rather than misoperation, thereby improving the effectiveness of the collected posture information. Exemplarily, the first duration threshold is 10s; when the gaze duration is greater than 10s, it is determined that the gaze duration meets the first duration threshold.

[0155] Method two, when the first screen displays the first content and the distance between the user and the first screen meets a target distance threshold, the posture information is obtained.

[0156] In the embodiments of the present application, the electronic device can collect the distance between the user and the first screen through its own distance sensor, or collect an image of the user and the first screen, and determine the distance between the user and the first screen by analyzing the image. In the case where the distance is less than or equal to the target distance threshold, it is determined that the distance meets the target distance threshold. At this time, the gesture information is collected to ensure that the user intentionally opens or operates the first screen, rather than mistakenly operating, thereby improving the effectiveness of the collected gesture information.

[0157] Method three: In the case where the first screen displays the first content and the working time length of the first screen meets the second time length threshold, the gesture information is acquired.

[0158] In the embodiments of the present application, in the case where the working time length of the first screen is greater than or equal to the second time length threshold, it is determined that the working time length of the first screen meets the second time length threshold. At this time, it indicates that the user is using the first screen to view the content displayed on the first screen, and the electronic device can collect the gesture information to acquire the gaze content of the user, thereby improving the accuracy and effectiveness of the acquired gaze content. The first time length threshold and the second time length threshold can be the same or different.

[0159] Method four: In the case where the first screen displays the first content and the first content is target content, the gesture information is acquired.

[0160] In the embodiments of the present application, the target content can be content of interest to the user, which can be pre-set by the user or determined by the electronic device according to the user's historical browsing behavior, search records, likes, shares and other interactive data. In the case where the first content is target content, it indicates that the user is browsing content of interest to himself, and the gesture information collected at this time can more accurately reflect the real reaction and interest of the user, so as to subsequently determine the gaze content of the user based on the gesture information, thereby improving the accuracy and effectiveness of the acquired gaze content.

[0161] It should be understood that at least one of the above four methods can be selected flexibly according to the actual application scenario to acquire the gesture information, thereby improving the flexibility and selectivity of acquiring the gesture information.

[0162] It should be understood that the first content includes at least one of a video, an image, a text, an application interface, an icon and a user interaction element.

[0163] For example, the display interface of the first screen is, for example, the first display interface 41 shown in (a) of FIG. 41, and the first content can be the content of the first display interface 41, i.e., a plurality of images. Alternatively, the display interface of the first screen is, for example, the first display interface 41 shown in (b) of FIG. 41, and the first content can be the content of the first display interface 41, i.e., a plurality of icons. Figure 4 Figure 7 ​The first content can be the content of the twelfth display interface 71, i.e., a plurality of application icons.

[0164] S902, determining, based on the posture information, a gaze content of the user from the first content.

[0165] In the embodiments of the present application, the gaze direction of the user can be determined based on the posture information, and the gaze content of the user can be determined from the first content based on the gaze direction. In this way, the gaze content can be automatically determined from the first content based on the posture information, without the need for manual operation of the user, thereby improving the efficiency of obtaining the gaze content.

[0166] The gaze content of the user from the first content based on the posture information can be implemented in the following manner:

[0167] The gaze position of the user on the first screen is determined based on the posture information, and the gaze content of the user is determined from the first content based on the gaze position. The gaze position is the position where the user's eyes focus.

[0168] Specifically, the gaze direction of the user can be determined according to the posture information, the gaze direction is mapped to the screen coordinate system of the first screen to obtain the gaze position. Then, the first content displayed by the first screen can be regionally divided to obtain the content of a plurality of regions, and the content of the region corresponding to the gaze position is determined from the content of the plurality of regions to obtain the gaze content.

[0169] Exemplarily, the first content can be Figure 4 the plurality of images of the first display interface 41 shown in (a) of FIG. 4, such as Figure 4 As shown in (a) of FIG. 4, the gaze content can be an image determined from the plurality of images based on the posture information. Alternatively, the first content can be Figure 7 the plurality of application icons of the twelfth display interface 71 shown in (a) of FIG. 7, and the gaze content can be an application icon determined from the plurality of application icons based on the posture information, such as the icon of the memo.

[0170] S903, in the case where the electronic device is converted from the first form to the second form, displaying the second content containing the gaze content on the second screen in a manner of highlighting the gaze content.

[0171] The second screen is the screen that works when the electronic device is in the second form.

[0172] In the embodiments of the present application, the second content includes the first content, or includes part of the first content.

[0173] Exemplarily, the second content is the first content. That is, the content displayed before and after the form of the electronic device changes is the same. When the first screen is a screen working when the electronic device is in the folded form and the second screen is a screen working when the electronic device is in the unfolded form, on the second screen, the first content can be displayed in a magnified size or in the same size as that on the first screen. When the first screen is a screen working when the electronic device is in the unfolded form and the second screen is a screen working when the electronic device is in the folded form, on the second screen, the first content can be displayed in a reduced size.

[0174] Exemplarily, the second content is part of the first content. That is, the content displayed before and after the form of the electronic device changes is different. When the first screen is a screen working when the electronic device is in the folded form and the second screen is a screen working when the electronic device is in the unfolded form, on the second screen, part of the first content can be displayed in a magnified size. When the first screen is a screen working when the electronic device is in the unfolded form and the second screen is a screen working when the electronic device is in the folded form, on the second screen, part of the first content can be displayed in a reduced size.

[0175] Exemplarily, the second content is composed of the first content and a third content, and the third content is content related to the first content. That is, the content displayed before and after the form of the electronic device changes is different. For example, when a user is browsing an article through the first screen, due to the size limitation of the first screen, only part of the content of the article is displayed on the first screen, the first content can be part of the content of the article, and the third content can be another part of the content of the article. Or, the entire content of the article is displayed on the first screen, the first content can be the entire content of the article, and the third content can be content that the electronic device recommends to the user based on the first content.

[0176] In the embodiments of the present application, the gaze content can be at least one of video, image, text, icon, interactive element, etc. The interactive element can be, for example, a card, a button, a slider, etc. The content in the second content other than the gaze content is non-gaze content. Wherein, the gaze content can be displayed before the non-gaze content on the second screen; the gaze content and the non-gaze content can also be displayed at the same time.

[0177] Wherein, the electronic device can detect whether its form changes, and the detection process can be achieved by the following steps:

[0178] Exemplarily, the electronic device is a foldable phone, which can continuously monitor its physical form changes, such as folding angle changes, by using its internal sensors, such as a gyroscope, an accelerometer or a special folding screen sensor. These sensors can transmit the monitored data to the processor on the foldable phone, so that the processor determines whether the foldable phone is currently in a folded form or an unfolded form based on the data.

[0179] It should be understood that the layout of the first content is different from the layout of the second content.

[0180] Exemplarily, the arrangement of the first content displayed on the first screen is different from the arrangement of the second content displayed on the second screen.

[0181] In the embodiments of the present application, displaying the second content containing the gaze content on the second screen in a manner of highlighting the gaze content can be understood as: when the second content is displayed on the second screen, the gaze content in it is highlighted. In this way, it ensures that the user can immediately find the gaze content on the second screen, and ensures the continuity of the user's reading experience.

[0182] The manner of highlighting the gaze content can include, but is not limited to, at least one of the following manners: color contrast, brightness adjustment, size adjustment, modifying the gaze content, dynamic display, layout adjustment, marking, prompting, etc.

[0183] The following will explain these manners in detail.

[0184] 1) Color contrast: by selecting a color that contrasts sharply with non-gaze content, the gaze content can be more visually prominent.

[0185] 2) Size adjustment: if the gaze content is text, the font size of the gaze content can be increased; if the gaze content is an image or a video, the size of the area where the gaze content is located can be increased.

[0186] 3) Modification: adding a background color block to the gaze content can make it visually distinguishable from non-gaze content.

[0187] 4) Dynamic display: displaying the gaze content through animation, flashing or other dynamic effects can make it more visually attractive.

[0188] 5) Layout adjustment: adjusting the layout and position of the content can make the gaze content more visually prominent.

[0189] 6) Marking: adding an icon, a border or other markings to the gaze content can make it more eye-catching among a large amount of information.

[0190] 7) Prompting: using a pop-up window or a prompt box to prompt the location of the gaze content.

[0191] In this way, the gazed content can be highlighted by at least one of the above-mentioned manners, ensuring that the user can quickly find the previously gazed content (i.e., the gazed content) on the screen worked after the form of the electronic device changes, thereby guaranteeing the continuity of reading and greatly improving the user experience.

[0192] The following explains several schemes of refining the step of "displaying the second content containing the gazed content on the second screen in a manner of highlighting the gazed content" in the above-mentioned at least one manner. The content in the second content other than the gazed content can be referred to as non-gazed content.

[0193] Scheme one, displaying the gazed content on the second screen with a first brightness and displaying the non-gazed content with a second brightness, the first brightness being higher than the second brightness.

[0194] In the embodiment of the present application, the gazed content is displayed on the second screen with a first brightness and the non-gazed content is displayed with a second brightness, in other words, the gazed content is highlighted on the second screen.

[0195] Exemplarily, taking the electronic device as a foldable mobile phone, Figure 4 the first display interface 41 shown in (a) is a display interface when the foldable mobile phone is in a folded form, and the first content is the content of the first display interface 41. When the foldable mobile phone detects that its form changes from the folded form to the unfolded form, the second display interface 42 shown in (b) can be displayed. Figure 4 The gazed content and the non-gazed content are displayed with different brightnesses on the second display interface 42, the display brightness of the gazed content being higher than that of the non-gazed content. The non-gazed content is the content of the second display interface 42 other than the gazed content. In this way, the user can immediately find the gazed content on the second display interface 42, guaranteeing the continuity of reading and greatly improving the user experience.

[0196] In addition, after displaying the gazed content on the second screen with a first brightness and displaying the non-gazed content with a second brightness, at least the content displayed by the first screen can be displayed on the second screen with the same brightness (i.e., a third brightness). In this way, it is ensured that the user can seamlessly transition from the highlighted gazed content to the state of normally reading all the content. This process not only improves the user's efficiency in finding the gazed content, but also guarantees the continuity and comfort of reading, providing the user with a more smooth and enjoyable user experience.

[0197] It should be understood that the third brightness can be the same as the first brightness; the third brightness can also be the same as the second brightness. Of course, the third brightness can also be a brightness between the first brightness and the second brightness; or, the third brightness is higher than the first brightness. The embodiments of the present application do not specifically limit the third brightness.

[0198] Exemplarily, taking the electronic device as a foldable mobile phone, Figure 4 The first display interface 41 shown in (a) is a display interface when the foldable mobile phone is in a folded form. When the foldable mobile phone detects that the form thereof is changed from the folded form to an unfolded form, the foldable mobile phone can switch the display interface from Figure 4 The first display interface 41 shown in (a) to Figure 4 The second display interface 42 shown in (b), and then, display Figure 4 The third display interface 43 shown in (c). All the contents in the third display interface 43 are displayed with the same brightness, and the brightness shown in the third display interface 43 is the same as the display brightness of the gaze content in the second display interface 42.

[0199] Scheme two, by a progressive display mode, display the second content from the gaze content on the second screen.

[0200] Wherein, by using this progressive display mode, the gaze content is first highlighted with a higher brightness to attract the attention of the user. Then, around this gaze content, the non-gaze content is gradually expanded and displayed, which ensures that the display of information has levels and is not too conspicuous. In this way, without interrupting the current reading of the user, the user's line of sight is smoothly transitioned to the second screen, so that the user can naturally browse more non-gaze content while maintaining attention to the gaze content, ensuring the continuity of the user's reading and improving the visual experience of the user when reading.

[0201] Exemplarily, taking the electronic device as a foldable mobile phone, Figure 5 The fourth display interface 51 shown in (a) is a display interface when the foldable mobile phone is in a folded form. When the foldable mobile phone detects that the form thereof is changed from the folded form to an unfolded form, the foldable mobile phone can display in sequence Figure 5 The fifth display interface 52 shown in (b), Figure 5 The sixth display interface 53 shown in (c), Figure 5 The seventh display interface 54 shown in (d). In this process, the second content is gradually displayed with the gaze content as the visual center. The whole transition process is natural and smooth, not only improving the visual enjoyment, but also ensuring the continuity and comfort of the user's reading experience.

[0202] Option 3: Display the gazed content dynamically on the second screen, and display the non-gazed content other than the gazed content in the second content statically.

[0203] The display method employs dynamic techniques to show the content that is being watched, such as through animation or flashing. This attracts the user's attention, ensuring that the user immediately notices the content on the second screen. Simultaneously, non-watchful content is displayed statically, allowing the user to browse it without distraction. This combination of dynamic and static methods not only ensures the continuity of the user's reading experience but also achieves a clear division of information hierarchy, enabling the user to understand the presented information more efficiently.

[0204] For example, taking a foldable phone as an example, Figure 6 The eighth display interface 61 shown in (a) is the display interface of the foldable phone when it is in the folded state. When the foldable phone detects that it is changing from the folded state to the unfolded state, it can display the following in sequence: Figure 6 The ninth display interface 62 shown in (b) is shown in the figure. Figure 6 The tenth display interface 63 is shown in (c). During this process, the content being gazed upon is presented in a jumping manner, making the area containing the content being gazed upon in the tenth display interface 63 smaller than the area containing the content being gazed upon in the eleventh display interface 64. This visual scaling effect allows the user to immediately notice the content being gazed upon, providing a smooth interface transition experience.

[0205] In addition, after displaying the gazed content in a dynamic manner on the second screen and at least the non-gazed content in a static manner, the content displayed on the first screen can also be displayed on the second screen at the same brightness (i.e., the third brightness).

[0206] For example, taking a foldable phone as an example, Figure 6 The eighth display interface 61 shown in (a) is the display interface of the foldable phone when it is in the folded state. When the foldable phone detects that it is changing from the folded state to the unfolded state, it can display the following in sequence: Figure 6 The ninth display interface 62 shown in (b) is shown in the figure. Figure 6 The tenth display interface 63 shown in (c) and Figure 6 The eleventh display interface 64 is shown in (d) in the diagram. This allows for a seamless transition from highlighting the content being viewed to reading all content normally. This process not only improves the efficiency of finding the viewed content but also ensures the continuity and comfort of reading, providing a smoother and more enjoyable user experience.

[0207] Scheme four, while displaying the second content on the second screen, the gaze content is highlighted by a frame.

[0208] Exemplarily, taking the electronic device as a foldable phone, Figure 7 The twelfth display interface 71 shown in (a) is a display interface when the foldable phone is in a folded state, and the gaze content is, for example, an icon of a memo. When the foldable phone detects that it is converted from the folded state to the unfolded state, the thirteenth display interface 72 shown in (b) can be displayed. Figure 7 The gaze content is displayed in a frame in the thirteenth display interface 72. The line color, line thickness, and size of the frame can be flexibly set, and the embodiments of the present application do not limit them.

[0209] The above scheme highlights the gaze content by a frame to highlight the gaze content. This way can attract the user's attention, so that the user can immediately find the gaze content on the second screen, ensure the continuity of the user's reading, and improve the user's reading experience.

[0210] Scheme five, while displaying the second content on the second screen, the gaze content is highlighted by a prompt box.

[0211] Exemplarily, taking the electronic device as a foldable phone, Figure 7 The twelfth display interface 71 shown in (a) is a display interface when the foldable phone is in a folded state, and the gaze content is, for example, an icon of a memo. When the foldable phone detects that it is converted from the folded state to the unfolded state, the thirteenth display interface 72 shown in (b) can be displayed. Figure 7 The thirteenth display interface 72 has a prompt box pointing to the gaze content, and the content in the prompt box is "I am here, oh". The user can immediately find the gaze content in the thirteenth display interface 73 according to the prompt of the prompt box.

[0212] The above scheme highlights the gaze content by a prompt box to highlight the gaze content. This way can attract the user's attention, so that the user can immediately find the gaze content on the unfolded screen, ensure the continuity of the user's reading, and improve the user's reading experience.

[0213] Scheme six, while displaying the second content on the second screen, the gaze content is highlighted by size adjustment.

[0214] Exemplarily, taking the electronic device as a foldable phone, Figure 7The twelfth display interface 71 shown in (a) is a display interface when the foldable mobile phone is in the folded form. The gaze content is, for example, an icon of a memo. When the foldable mobile phone detects that it is converted from the folded form to the unfolded form, the sixteenth display interface 81 shown in (b) can be displayed. The gaze content is in the center of the sixteenth display interface 81, and the non-gaze content is displayed around the gaze content. The non-gaze content is, for example, an icon of an application program other than the memo. Figure 7 The fifteenth display interface 74 shown in (d) is a display interface when the foldable mobile phone is in the unfolded form. The size of the area where the gaze content is located on the fifteenth display interface 74 is greater than the size of the area where each non-gaze content is located.

[0215] The above scheme increases the size of the area where the gaze content is located by size adjustment, so as to highlight the gaze content. This way can attract the attention of the user, so that the user can immediately find the gaze content on the screen in the unfolded form, ensure the continuity of reading of the user, and improve the reading experience of the user.

[0216] Scheme seven, while displaying the second content on the second screen, highlights the gaze content by layout adjustment.

[0217] Exemplarily, taking the electronic device as a foldable mobile phone, Figure 7 The twelfth display interface 71 shown in (a) is a display interface when the foldable mobile phone is in the folded form. The gaze content is, for example, an icon of a memo. When the foldable mobile phone detects that it is converted from the folded form to the unfolded form, the sixteenth display interface 81 shown in (b) can be displayed. The gaze content is in the center of the sixteenth display interface 81, and the non-gaze content is displayed around the gaze content. The non-gaze content is, for example, an icon of an application program other than the memo. Figure 8 The sixteenth display interface 81 shown in (b) is a display interface when the foldable mobile phone is in the unfolded form. The gaze content is in the center of the sixteenth display interface 81, and the non-gaze content is displayed around the gaze content. The non-gaze content is, for example, an icon of an application program other than the memo.

[0218] The above scheme highlights the gaze content by layout adjustment. This way can attract the attention of the user, so that the user can immediately find the gaze content on the screen in the unfolded form, ensure the continuity of reading of the user, and improve the reading experience of the user.

[0219] It should be noted that in the embodiments of the present application, S901 can be executed by an operating system of the electronic device, or by a target application program on the electronic device. Similarly, S902 can be executed by the operating system or the target application program; S903 can be executed by the operating system or the target application program.

[0220] In a possible implementation, when the display interface of the first screen of the electronic device in the first form is an application program interface, the target application program can be an application program corresponding to the application program interface.

[0221] Exemplarily, the display interface of the first screen of the electronic device in the first form is the first display interface 41 shown in (a) of FIG. 1, which is an image browsing interface of a gallery, and then the target application program can be the gallery; or the display interface of the first screen of the electronic device in the first form is an interface of an application program of a home management type, such as an interface of a smart life application program, and then the target application program can be the smart life application program. Figure 4

[0222] Alternatively, the display interface of the first screen of the electronic device in the first form is an interface of an application program A of a video type, and then the target application program can be the application program A.

[0223] Alternatively, the display interface of the first screen of the electronic device in the first form is an interface of an application program B of a document type, and then the target application program can be the application program B.

[0224] In a possible implementation, in a case where the display interface of the first screen of the electronic device in the first form is not an interface of an application program, the target application program can be preset.

[0225] Exemplarily, the target application program can be a theme type application program, a desktop management application program, or a system level application program.

[0226] The embodiment of the present application provides an information processing method, which is applied to an electronic device. When a first screen displays first content, posture information of a user is acquired, the posture information including face posture information and / or eye information, and the first screen is a screen working when the electronic device is in a first form. Based on the posture information, a gaze content of the user is determined from the first content. In a case where the electronic device is converted from the first form to a second form, second content containing the gaze content is displayed on a second screen in a manner of highlighting the gaze content, and the second screen is a screen working when the electronic device is in the second form. In this way, when the electronic device is converted from the first form to the second form, the gaze content of the user in the first form can be displayed on the screen working in the second form, so that the user can seamlessly continue browsing, the fluency and continuity of reading are ensured, and the use experience of the user is greatly improved. The user does not need to spend a lot of time on the second screen to find the content (i.e., the gaze content) browsed in the first form, as in the related art, thereby solving the problem that the user wastes a lot of time in reading the gaze content on the second screen in the related art, which leads to interruption of reading and low user experience.

[0227] ​The following is an example of the information processing method provided by the present application, in which "obtaining the posture information of the user" is performed by the operating system of the electronic device, "determining the gaze content of the user from the first content based on the posture information" is performed by the target application program on the electronic device, and "displaying the second content containing the gaze content on the second screen in a manner of highlighting the gaze content in the case where the electronic device is converted from the first form to the second form" is performed by the target application program. Figure 10 As shown in the flowchart of the information processing method, Figure 10 the method comprises S1001-S1006. Among them:

[0228] S1001, when the first screen displays the first content, obtaining the posture information of the user through the operating system on the electronic device, the posture information includes facial posture information and / or eye information, and the first screen is the screen worked when the electronic device is in the first form.

[0229] S1002, the operating system sends the posture information to the target application program. Correspondingly, the target application program receives the posture information.

[0230] Exemplarily, the display interface of the first screen is the first display interface 41 shown in (a) of Figure 4 , which is the image browsing interface of the gallery, and the target application program can be the gallery. Or, the display interface of the first screen of the electronic device in the first form is the interface of the application program of the home management type, such as the interface of the smart life application program, and then the target application program can be the smart life application program.

[0231] S1003, the target application program determines the gaze content of the user from the first content based on the posture information.

[0232] Among them, S1004 and S1005 can be executed after S1003. Or, S1006 is executed after S1003.

[0233] S1004, in the case where the electronic device is converted from the first form to the second form, the operating system sends a control instruction to the target application program, and the control instruction is used to control the target application program to display the second content containing the gaze content on the second screen in a manner of highlighting the gaze content.

[0234] S1005, the target application program displays the second content on the second screen in a manner of highlighting the gaze content based on the control instruction.

[0235] S1006, in the case where the electronic device is converted from the first form to the second form, the target application program displays the second content containing the gaze content on the second screen in a manner of highlighting the gaze content.

[0236] The second screen is a screen that works when the electronic device is in the second form.

[0237] In the embodiments of the present application, in the case where the electronic device is converted from the first form to the second form, the target application program can actively display at least the content displayed by the first screen on the second screen in a manner of highlighting the gaze content.

[0238] It should be noted that the descriptions of the same steps and the same content in the embodiments of the present application and other embodiments can refer to the descriptions in other embodiments, and will not be described here.

[0239] The embodiments of the present application provide an information processing method, applied to an electronic device. When a first screen displays first content, the posture information of a user is acquired through an operating system on the electronic device. The posture information includes face posture information and / or eye information. The first screen is a screen that works when the electronic device is in a first form. The gaze content of the user is determined from the first content based on the posture information through a target application program on the electronic device. The first content is the content of the display interface of the target application program. In the case where the electronic device is converted from the first form to a second form, the second content containing the gaze content is displayed on a second screen in a manner of highlighting the gaze content through the target application program. In this way, when the electronic device is converted from the first form to the second form, the gaze content of the user in the first form can be displayed on the screen that works in the second form, ensuring that the user can seamlessly continue browsing, ensuring the fluency and continuity of reading, and greatly improving the user experience.

[0240] Figure 11 A structure schematic diagram of another electronic device provided by the present application is shown. Figure 11 The dashed line indicates that the unit or the module is optional. The electronic device 1100 can be used to implement the method described in the above method embodiments. The electronic device 1100 can be a terminal device, such as a foldable mobile phone.

[0241] The electronic device 1100 includes one or more processors 1101, which can support the electronic device 1100 to implement the methods in the corresponding method embodiments. The processor 1101 can be a general-purpose processor or a special-purpose processor. For example, the processor 1101 can be a central processing unit (CPU). The CPU can be used to control the electronic device 1100, execute software programs, and process data of the software programs. The electronic device 1100 can also include a communication unit 1105 to realize the input (reception) and output (transmission) of signals. Figure 9 or Figure 10 The methods in the corresponding method embodiments. The processor 1101 can be a general-purpose processor or a special-purpose processor. For example, the processor 1101 can be a central processing unit (CPU). The CPU can be used to control the electronic device 1100, execute software programs, and process data of the software programs. The electronic device 1100 can also include a communication unit 1105 to realize the input (reception) and output (transmission) of signals.

[0242] The electronic device 1100 can be a chip (system) including a memory and a processor, wherein the processor is configured to execute a computer program stored in the memory to implement the method shown in each of the above embodiments.

[0243] The communication unit 1105 can be an input and / or output circuit of the chip (system), or the communication unit 1105 can be a communication interface of the chip (system), which can be a component of the electronic device 1100.

[0244] For another example, the communication unit 1105 can be a transceiver of the electronic device 1100, or the communication unit 1105 can be a transceiver circuit of the electronic device 1100. One or more memories 1102 can be included in the electronic device 1100, and the memories 1102 have programs 1104 stored thereon, the programs 1104 can be run by the processor 1101 to generate instructions 1103, so that the processor 1101 executes the method described in the above method embodiments according to the instructions 1103. Optionally, the memories 1102 can also store data. Optionally, the processor 1101 can also read the data stored in the memories 1102, and the data can be stored in the same storage address as the programs 1104, or the data can be stored in different storage addresses from the programs 1104.

[0245] The processor 1101 and the memories 1102 can be separately arranged, or can be integrated together, for example, integrated on a system on chip (SOC) of the electronic device. The specific manner in which the processor 1101 executes the method of the drop detection can be referred to the related description in the method embodiments.

[0246] It should be understood that each step of the above method embodiments can be completed by a logic circuit in the form of hardware in the processor 1101 or instructions in the form of software. The processor 1101 can be a CPU, a digital signal processor (DSP), a field programmable gate array (FPGA), or other programmable logic devices, for example, discrete gates, transistor logic devices, or discrete hardware components.

[0247] The present application also provides a computer program product, which, when executed by the processor 1101, implements the method of any method embodiment of the present application. The computer program product can be stored in the memory 1102, for example, the program 1104, which is finally converted into an executable object file that can be executed by the processor 1101 after preprocessing, compiling, assembling, and linking.

[0248] The application also provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a computer to implement the method of any method embodiment in the application. The computer program can be a high-level language program or an executable target program.

[0249] The computer readable storage medium is, for example, the memory 1102. The memory 1102 can be a volatile memory or a non-volatile memory, or the memory 1102 can include both volatile memory and non-volatile memory. Among them, the non-volatile memory can be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), or a flash memory. The volatile memory can be a random access memory (Random Access Memory, RAM) used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (SynchLink DRAM, SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DRRAM).

[0250] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described device and equipment and the generated technical effects can refer to the corresponding process and technical effects in the foregoing method embodiments, which will not be described here.

[0251] In several embodiments provided in the present application, the disclosed system, device and method can be implemented in other ways. For example, some features of the above-described method embodiments can be omitted or not performed. The above-described device embodiments are merely illustrative, and the splitting of units is merely a logical function splitting, and actual implementation can have another splitting manner. Multiple units or components can be combined or integrated into another system. In addition, the coupling between units or the coupling between components can be direct coupling or indirect coupling, and the above coupling includes electrical, mechanical or other forms of connection.

[0252] The above embodiments are only used to illustrate the technical solutions of the present application, rather than limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to some technical features, and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

[0253] Finally, the above is only a specific implementation of the present application, but the protection scope of the present application is not limited to this. Any changes or replacements within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An information processing method characterized by comprising: The method comprises: When a first screen displays first content, obtaining posture information of a user, the posture information comprising face posture information and / or eye information, the first screen being a screen working when the electronic device is in a first form; Based on the posture information, determining a gaze content of the user from the first content; In a case where the electronic device is converted from the first form to a second form, displaying second content containing the gaze content on a second screen in a manner of highlighting the gaze content, wherein the second screen is a screen working when the electronic device is in the second form.

2. The method of claim 1, wherein, The layout of the first content and the layout of the second content are different.

3. The method according to claim 1 or 2, characterized in that, The displaying of the second content containing the gaze content on the second screen in the manner of highlighting the gaze content comprises: Displaying the second content starting from the gaze content on the second screen in a progressive display manner.

4. The method according to claim 1 or 2, characterized in that, The displaying of the second content containing the gaze content on the second screen in the manner of highlighting the gaze content comprises: Displaying the gaze content on the second screen at a first brightness, and displaying content other than the gaze content in the second content on the second screen at a second brightness, the first brightness being higher than the second brightness.

5. The method according to claim 1 or 2, characterized in that, The displaying of the second content containing the gaze content on the second screen in the manner of highlighting the gaze content comprises: Displaying the gaze content on the second screen in a dynamic display manner, and displaying content other than the gaze content in the second content on the second screen in a static display manner.

6. The method of claim 5, wherein, The display brightness of the gaze content is higher than the display brightness of the content other than the gaze content in the second content.

7. The method of any one of claims 4-6, wherein, After the displaying of the second content containing the gaze content on the second screen in the manner of highlighting the gaze content, the method further comprises: Displaying the second content on the second screen at a third brightness.

8. The method of claim 1 or 2, wherein, The manner of highlighting the gaze content comprises at least one of color contrast, size adjustment, layout adjustment, decoration, and marking.

9. The method according to any one of claims 1 to 8, characterized in that, The obtaining of the posture information of the user comprises: obtaining the posture information in a case where one or more of the following conditions is met: A gaze duration of the user with respect to the first screen meets a first duration threshold; A distance between the user and the first screen meets a target distance threshold; A working duration of the first screen meets a second duration threshold; or The first content is target content.

10. The method according to any one of claims 1 to 9, characterized in that, The determining of the gaze content of the user from the first content based on the posture information comprises: Based on the posture information, determining a gaze position of the user on the first screen; Based on the gaze position, determining the gaze content from the first content.

11. An information processing method characterized by comprising: The method comprises: When a first screen displays first content, obtaining posture information of a user by an operating system on an electronic device, the posture information comprising face posture information and / or eye information, the first screen being a screen working when the electronic device is in a first form; determine, by a target application program on the electronic device, a gaze content of the user from the first content based on the posture information, the first content being content of a display interface of the target application program; in a case where the electronic device is converted from the first form to a second form, display, by the target application program, second content containing the gaze content in a manner of highlighting the gaze content on a second screen, the second screen being a screen that works when the electronic device is in the second form.

12. An electronic device, comprising: comprising: a processor coupled to a memory storing programs or instructions that, when executed by the processor, cause the electronic device to perform the method of any one of claims 1-10 or 11.

13. A chip system, characterized by The chip system includes a memory and a processor configured to execute a computer program stored in the memory to implement the method of any one of claims 1-10 or 11.

14. A computer readable storage medium having stored thereon a computer program or instructions, characterized in that, The computer program or instructions, when executed, cause a computer to perform the method of any one of claims 1-10 or 11.

15. A computer program product, characterised in that, comprising computer program instructions that cause the computer to perform the method of any one of claims 1-10 or 11.

Images