Display method and electronic device

By using the floating window mode on the terminal device to display horizontally on the application interface that does not support horizontal or vertical screen display, the user experience interruption caused by device rotation is solved, and a consistent browsing experience is achieved across application scenarios.

WO2024234906A1PCT designated stage expired Publication Date: 2024-11-21HUAWEI TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/088211
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-18
Filing Date
2024-04-17
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

On terminal devices such as mobile phones and tablets, when the user is placed horizontally, when clicking the control to jump to an application interface that does not support landscape display, the device needs to rotate to obtain the best visual experience, resulting in interruption of the user experience.

Method used

The application interface that does not support horizontal or vertical display is displayed through the floating window mode, so that it is displayed horizontally in the floating window, so that the user does not need to manually adjust the device orientation.

Benefits of technology

Improves user experience, avoids the experience interruption caused by device rotation, and achieves a consistent browsing experience across application scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024088211_21112024_PF_FP_ABST
    Figure CN2024088211_21112024_PF_FP_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of terminals, and discloses a display method and an electronic device. The method is applied to a transversely placed terminal device, and the method specifically comprises: displaying a first application interface; in response to a user operation on the first application interface, keeping the terminal device transversely placed; and displaying a second application interface in a floating window, wherein the second application interface does not support landscape display or only supports portrait display. When the device is transversely placed and the newly started second application interface does not support landscape display, the second application interface can be directly opened in the form of a floating window, such that a user does not need to rotate the device, it is ensured that browsing experience is not interrupted, and user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Display method and electronic device Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a display method and electronic device. Background Art

[0002] Currently, mobile phones, tablets, and other terminal devices are equipped with a variety of applications, providing users with a rich and colorful audio-visual entertainment experience. As shown in Figure 1, if a user places the terminal device horizontally and application interface A is displayed in landscape mode, and clicks a control on application interface A to jump to application interface B (which does not support landscape mode), application interface B will be displayed in full screen in the vertical direction of the device and cover the original application interface A. At this time, the user needs to rotate the terminal device to obtain a better visual experience. This will interrupt the user's smooth user experience.

[0003] Summary of the Invention

[0004] The present application provides a display method and electronic device. When the display direction of the application interface setting is different from the placement direction of the device, the application interface can be directly started through the floating window mode. The user does not need to manually adjust the placement direction of the device, thereby improving the user experience.

[0005] In the first aspect, an embodiment of the present application provides a display method, which includes: displaying a first application interface on a terminal device, the application interface including a control for triggering the launch of a second interface, receiving a user operation acting on the control, and when the second application interface does not support horizontal screen or supports vertical screen display, in response to the user operation, displaying the second application interface in horizontal screen in a floating window.

[0006] The above-mentioned second application interface is set to only be displayed in portrait mode and does not support landscape mode. Therefore, the browsing direction of the second application interface is different from the placement direction of the device. The method provided in the embodiment of the present application can display the above-mentioned second application interface in landscape mode in a floating window, so that the display direction of the application interface in the floating window is consistent with the display direction of the terminal device system. The user no longer needs to manually adjust the placement direction of the device, thereby improving the user experience.

[0007] In combination with the first aspect, in a possible implementation, the second application interface also does not support the parallel view mode.

[0008] In this implementation, the second application interface supports neither landscape display nor parallel view mode. In this case, launching the second application interface in floating window mode allows the second application interface to be displayed in landscape mode without the user having to rotate the terminal device and without interrupting the user's browsing experience. In conjunction with the first aspect, in another possible implementation, the first application interface belongs to the first application, the second application interface belongs to the second application, and the first application and the second application are different.

[0009] In this implementation, the first application interface and the second application interface belong to different applications, achieving consistency in user browsing experience across application scenarios.

[0010] In combination with the first aspect, in another possible implementation, the first application interface and the second application interface belong to the same application.

[0011] In this implementation, the first application interface and the second application interface belong to the same application, achieving consistency in user browsing experience across application scenarios.

[0012] In combination with the first aspect, in another possible implementation, before starting the second application interface through the floating window mode in response to a user operation, the terminal device obtains configuration information of the second application interface, which is used to indicate whether the second application interface supports floating window display.

[0013] In this implementation, the terminal device determines whether the second application interface supports floating window display by obtaining configuration information of the second application interface. If floating window display is supported, the second application interface is started in floating window mode.

[0014] In combination with the first aspect, in another possible implementation method, the configuration information of the second application interface is also used to indicate whether the second application interface supports parallel vision, or the configuration information of the second application interface is also used to indicate that the second application interface does not support horizontal screen display or only supports vertical screen display.

[0015] After obtaining the configuration information for the second application interface, the terminal device determines the launch mode for the second application interface based on the capabilities of the second application interface indicated in the configuration information and the orientation of the terminal device. When the terminal is positioned horizontally and the second application interface does not support the parallel view launch mode, does not support landscape display, and supports floating window display, the content of the second application interface may be displayed in landscape mode in the floating window.

[0016] In combination with the first aspect, in another possible implementation, before displaying the second application interface in the floating window, the method also includes: obtaining startup mode combination information, the startup mode combination information being used to indicate that when jumping from the first application interface to the second application interface, the second application interface is started in a floating window mode; and displaying the second application interface in the floating window according to the startup mode combination information.

[0017] In this implementation, the preset startup mode combination information has indicated that when jumping from the first application interface to the second application interface, the second application interface is started in the floating window mode, and the terminal device does not need to make any further judgment.

[0018] In combination with the first aspect, in another possible implementation, the startup mode combination information is generated according to the user's last selection, or the startup mode combination information is preset through system settings.

[0019] In this implementation, the terminal device can record the user's selection when launching the second application interface last time and save the selection so that it can be opened directly in the user's preferred method in the future. Alternatively, the user can set in the system settings that the second application interface will be opened in a certain way when it is launched from the first application interface. Alternatively, the user can set that whenever the second application interface is opened, whether it is triggered from the desktop or from the first application, it will be launched in a fixed way.

[0020] In combination with the first aspect, in another possible implementation, the first application interface is a desktop, and the user operation is an operation of clicking a desktop application icon, or the user operation is an operation of clicking a system notification.

[0021] In this implementation, the user can click on an application on the desktop to trigger the launch of the second application interface, or, upon receiving a user notification, the user clicks / drags the notification to trigger the launch of the second application interface.

[0022] In combination with the first aspect, in another possible implementation, the first application interface is an interface of a first application, and the user operation is an operation of clicking a control on the first application interface.

[0023] In this implementation, the user first opens a first application interface belonging to a first application, and then clicks a control on the application interface to trigger the launch of a second application interface.

[0024] In combination with the first aspect, in another possible implementation, the method further includes: creating a new task stack in response to the user operation, and placing the second application interface in the new task stack.

[0025] In this implementation, when starting the second application interface, a new task stack needs to be created, and the second application interface is placed in the newly created task stack. In this way, the task can be managed separately, and the user can also view the task through the task manager.

[0026] In a second aspect, the present application provides a terminal device, which includes: one or more processors and one or more memories; the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute any one of the methods described in the first aspect above.

[0027] In a third aspect, the present application provides a computer-readable storage medium comprising instructions, characterized in that when the instructions are executed on an electronic device, the electronic device executes any one of the methods described in the first aspect above.

[0028] In a fourth aspect, the present application provides a computer program product, characterized in that when the computer program product is run on an electronic device, the electronic device executes any one of the methods described in the first aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] FIG1 is a schematic diagram of the background technology provided by an embodiment of the present application.

[0030] FIG2 is a hardware diagram of a terminal device provided in an embodiment of the present application.

[0031] FIG3 is a schematic diagram of the software architecture of a terminal device provided in an embodiment of the present application.

[0032] FIG4 is a schematic diagram of a method flow chart of scenario 1 provided in an embodiment of the present application.

[0033] FIG5 is a schematic diagram of a saved startup mode combination provided in an embodiment of the present application.

[0034] FIG6 is a schematic diagram of a method flow chart of scenario 2 provided in an embodiment of the present application.

[0035] FIG7 is a schematic diagram of a parallel field of view provided in an embodiment of the present application.

[0036] FIG8 is a schematic diagram of a scenario of launching a new interface across applications provided in an embodiment of the present application.

[0037] FIG9 is a schematic diagram of a scenario of launching a new interface within an application provided in an embodiment of the present application.

[0038] FIG10 is a schematic diagram of a process for starting a new interface provided in an embodiment of the present application.

[0039] FIG11 is a flow chart of saving a user-selected startup mode combination according to an embodiment of the present application.

[0040] FIG12 is a schematic diagram of a process for saving or deleting a startup mode combination according to an embodiment of the present application. DETAILED DESCRIPTION

[0041] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0042] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "multiple" means two or more. In addition, the objects modified by different prefixes may be the same or different. For example, if the described object is a "device", then the "first device" and the "second device" may be devices of the same type or devices of different types; for another example, if the described object is "information", then the "first information" and the "second information" may be information of the same content or information of different contents. In short, the use of prefixes such as ordinal numbers to distinguish between the described objects in the embodiments of the present application does not constitute a restriction on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and no unnecessary restrictions should be constituted due to the use of such prefixes.

[0043] Before introducing the embodiments provided in this application, the following terms are defined and explained:

[0044] Landscape / horizontal device placement: From the user's current viewing angle, the width of the terminal device is greater than its height. Take a tablet device as an example, as shown in Figures 1(a) and (b).

[0045] Device portrait / vertical placement: From the user's current viewing angle, the width of the terminal device is smaller than its height. Take a tablet device as an example, as shown in Figure 1(c).

[0046] The application interface is displayed in landscape / horizontal / landscape mode: As shown in the interface of application A in Figure 1(a), the browsing perspective of the interface is the same as the viewing perspective of the terminal device when the device is placed horizontally, that is, when the device is placed horizontally, the application interface can be browsed normally. In some embodiments, the application obtains the system direction and then controls the display direction of the application interface to be consistent with the system direction. The above-mentioned system direction can be specifically understood as, when the device is placed horizontally, the system direction is landscape. In some embodiments, the application interface of some applications is set so that its display direction can only be landscape / horizontal / landscape display, or can only be portrait / vertical / portrait display.

[0047] The application interface is displayed vertically / vertically / in portrait mode: As shown in the interface of application B in Figures 1(b) and 1(c), the browsing perspective of the interface is the same as the viewing perspective of the terminal device when the device is placed vertically, that is, when the device is placed vertically, the application interface can be browsed normally. In some embodiments, the application obtains the system direction and then controls the display direction of the application interface to be consistent with the system direction. The above-mentioned system direction can be specifically understood as, when the device is placed vertically, the system direction is vertical / portrait. In some embodiments, the application interface of some applications is set so that its display direction can only be horizontal / horizontal / landscape display, or can only be vertical / vertical / portrait display.

[0048] Task stack: The task stack includes multiple activities. A single application interface can be understood as an activity. In the embodiments provided in this application, an activity can also be called an application component.

[0049] Parallel horizons: In the embodiment provided in the present application, a schematic diagram of parallel horizons is shown in FIG7 , and pages b1 and b2 are associated pages, and b1 and b2 belong to the same application. Exemplarily, parallel horizons may include navigation mode or shopping mode. Navigation mode specifically means that when a new page is opened on page b1, the new page will be added to the right area for display, i.e., it will cover page b2; when a new page is opened on page b2, the new page will be added to the right area for display, i.e., it will cover the original page b2. Shopping mode specifically means that when a new page is opened on page b1, the new page will be added to the right area for display, and the original page b2 will be moved to the left area for display, i.e., it will cover the original page b1; when a new page is opened on page b2, the new page will be added to the right area for display, i.e., it will cover the original page b2. It should be noted that when there is only one page and the page startup mode is parallel horizon mode, the page can be displayed in the center, with blank space or blurred processing on both sides of the screen.

[0050] When the current user is using a terminal device, he can browse the page content in both horizontal and vertical directions. For example, when the device is placed horizontally (and the current interface is also displayed in horizontal mode), if the user clicks a button to jump to the page, and the page after the jump can only be displayed in vertical mode, the user needs to rotate the current device to continue browsing the page after the jump, thus interrupting the user's smooth experience. Therefore, this application provides a solution that can directly enter the split-screen / floating window display in a preset scenario, so as to improve the user experience of large-screen devices across applications or across pages within applications.

[0051] The terminal device described in the embodiments of the present application may include, but is not limited to, a smartphone, a netbook, a tablet computer, a smart watch, a smart bracelet, a phone watch, a smart camera, a PDA, a personal computer (PC), a personal digital assistant (PDA), a portable multimedia player (PMP), an augmented reality (AR) / virtual reality (VR) device, a television, a projection device, or a somatosensory game console in a human-computer interaction scenario. Alternatively, the terminal device may also be an electronic device of other types or structures including a camera, which is not limited in the embodiments of the present application.

[0052] Please refer to Figure 2, which shows a hardware structure diagram of an electronic device provided in an embodiment of the present application. The electronic device 100 can be understood as the terminal device described in the embodiment of the present application, and is used to execute the method provided in the embodiment of the present application.

[0053] The electronic device 100 may include at least one of a mobile phone, a foldable electronic device, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer, a netbook, a cellular phone, a PDA, an AR device, a VR device, an artificial intelligence device, a wearable device, an in-vehicle device, a smart home device, and a smart city device. The embodiments of the present application do not impose any particular restrictions on the type of the electronic device 100.

[0054] The electronic device 100 may include a processor 110, an internal memory 121, a USB connector 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone connector 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, a memory card connector 120, and a SIM card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0055] The structures illustrated in the embodiments of the present application do not limit the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown. The components shown in the illustrations may be implemented in hardware, software, or a combination of software and hardware.

[0056] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor, a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0057] The processor 110 can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and execution.

[0058] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 may be a cache memory. The memory may store instructions or data that have been used or are frequently used by the processor 110.

[0059] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit I2C interface, an I2S interface, a PCM interface, a UART interface, a MIPI interface, a GPIO interface, a SIM interface, and / or a USB interface. The processor 110 may be connected to a touch sensor, an audio module, a wireless communication module, a display screen, or a camera module through at least one of the above interfaces.

[0060] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is merely an illustrative description and does not limit the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0061] USB connector 130 is a connector that complies with USB standards and can be used to connect electronic device 100 and peripheral devices. USB connector 130 can be a Mini-USB connector, a Micro-USB connector, a USB Type-C connector, etc. USB connector 130 can be used to connect to a charger to charge electronic device 100. It can also be used to connect to other electronic devices to enable data transmission between electronic device 100 and other electronic devices. It can also be used to connect headphones to output audio stored in the electronic device through the headphones. This connector can also be used to connect to other electronic devices, such as VR devices.

[0062] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB connector 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via a wireless charging coil. While charging the battery 142, the charging management module 140 can also power the electronic device 100 via the power management module 141. The battery 142 can include at least one set of electrode terminals, each set of electrode terminals including at least one positive terminal. In one embodiment, when the battery includes two sets of electrode terminals, the electronic device can be configured with two wired charging paths or two wireless charging paths, each connected to at least one set of electrode terminals. This allows the battery 142 to be charged simultaneously via multiple charging paths, thereby increasing charging power and reducing temperature rise. In another embodiment, when the battery includes two sets of electrode terminals, one set of electrode terminals is used for wired charging and the other set of electrode terminals is used for wireless charging, providing greater flexibility in the charging circuit layout. Based on the same design concept, those skilled in the art can configure more than two sets of electrode terminals and more than two charging paths as needed.

[0063] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the display 194, the camera 193, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0064] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0065] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0066] The mobile communication module 150 can provide a solution for wireless communications including at least one of 2G, 3G, 4G, 5G, or 6G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier, etc. The mobile communication module 150 can filter, amplify, and perform other processing on the electromagnetic waves received by the antenna 1, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0067] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0068] The wireless communication module 160 can provide a wireless local area network module, a Bluetooth module, a BLE module, an ultra wide band (UWB) module, a global navigation satellite system (GNSS) module, an FM module, a near field communication (NFC) module, or an infrared module, etc., which can be applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0069] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with other electronic devices through wireless communication technology. The wireless communication technology may include GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include GPS, global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0070] Electronic device 100 can implement display functions using a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and render graphics. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0071] Display screen 194 is used to display images, videos, etc. In some embodiments, electronic device 100 may include one or more display screens 194. Display screen 194 may be at least one of an LCD, an OLED display screen, an AMOLED display screen, a FLED display screen, a MiniLED display screen, a MicroLed display screen, a Micro-oLed display screen, a quantum dot light-emitting diode (QLED) display screen, etc.

[0072] The electronic device 100 can realize the camera function through the camera module 193, ISP, video codec, GPU, display screen 194, application processor AP, neural network processor NPU, etc.

[0073] The camera module 193 can be used to capture color image data and depth data of the subject. The ISP can be used to process the color image data captured by the camera module 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then transmitted to the ISP for processing and converted into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise, brightness, and skin color. The ISP can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be provided in the camera module 193.

[0074] In some embodiments, the camera module 193 may be composed of a color camera module and a 3D sensing module.

[0075] In some embodiments, the color camera module's camera sensor may include a CCD or CMOS phototransistor. The sensor converts light signals into electrical signals, which are then transmitted to the ISP for conversion into digital image signals. The ISP then outputs the digital image signals to the DSP for processing.

[0076] In some embodiments, the 3D sensing module may be a structured light 3D sensing module. The structured light 3D sensing module may include an infrared emitter, an infrared camera module, and the like. The structured light 3D sensing module first emits a light spot of a specific pattern to the object being photographed, then receives the light spot pattern code on the surface of the object, and then compares the similarities and differences with the original projected light spot to determine the three-dimensional coordinates of the object. The three-dimensional coordinates may include the distance between the electronic device 100 and the object being photographed. The 3D sensing module can obtain the distance (i.e., depth) between the 3D sensing module and the object being photographed by the time it takes for the infrared light to return, so as to obtain a 3D depth map.

[0077] Structured light 3D sensing modules can also be used in areas such as face recognition, somatosensory gaming consoles, and industrial machine vision inspection. 3D sensing modules can also be used in gaming consoles, AR, VR, and other fields.

[0078] In other embodiments, the camera module 193 may also be composed of two or more cameras. These two or more cameras may include a color camera, which can be used to collect color image data of the object being photographed. These two or more cameras may use stereo vision technology to collect depth data of the object being photographed.

[0079] In some embodiments, the electronic device 100 may include one or more camera modules 193. The electronic device 100 may include one front camera module 193 and one rear camera module 193. The front camera module 193 may be used to capture color image data and depth data of the photographer, while the rear camera module may be used to capture color image data and depth data of the subject (e.g., a person, scenery, etc.) that the photographer is facing.

[0080] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as MPEG1, MPEG2, MPEG3, and MPEG4.

[0081] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0082] The memory card connector 120 can be used to connect a memory card, such as a Micro SD card or a Nano SD card, to expand the storage capacity of the electronic device 100. The memory card communicates with the processor 110 through the memory card connector 120 to implement data storage. In some embodiments, the memory card and the SIM card can share the same connector in a time-sharing manner, and the electronic device can identify whether the card set in the connector is a memory card or a SIM card to implement the corresponding function. Alternatively, the memory card and the SIM card can be set in the same connector at the same time, and electrically connected to different springs of the electronic device 100 respectively, to implement the storage function and the SIM function respectively.

[0083] The internal memory 121 can be used to store computer executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional methods or data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0084] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone connector 170D, and the application processor.

[0085] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0086] The speaker 170A, also called a "speaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or output audio signals for hands-free calls through the speaker 170A.

[0087] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0088] The microphone 170C, also known as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two or more microphones 170C, which can not only collect sound signals but also realize noise reduction functions. In other embodiments, the electronic device 100 can also use the microphone to identify the source of the sound and realize directional recording functions, etc.

[0089] The headphone connector 170D is used to connect a wired headphone. The headphone connector 170D can be the USB connector 130 or a 3.5mm connector that complies with the Open Mobile Terminal Platform (OMTP) standard or the Cellular Telecommunications Industry Association of the USA (CTIA) standard.

[0090] The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be provided on the display screen 194.

[0091] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, controls the reverse movement of the lens to offset the shaking of the electronic device 100, and achieves anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0092] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0093] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. If the electronic device is a foldable device, the magnetic sensor 180D can be used to detect whether the electronic device is folded or unfolded, or the folding angle. In some embodiments, if the electronic device 100 is a flip device, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the leather case or the flip cover, features such as automatic unlocking of the flip cover can be configured.

[0094] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0095] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0096] The proximity light sensor 180G may include, for example, a light emitting diode and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When the intensity of the detected reflected light is greater than a threshold, it can be determined that an object is approaching the electronic device 100. When the intensity of the detected reflected light is less than a threshold, the electronic device 100 can determine that no object is approaching the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect when the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0097] The ambient light sensor 180L can be used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking photos. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is blocked, for example, when the electronic device is in a pocket. When it is detected that the electronic device is blocked or in a pocket, some functions (such as the touch function) can be disabled to prevent accidental operation.

[0098] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0099] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to implement a temperature management strategy. For example, when the temperature detected by temperature sensor 180J exceeds a threshold, electronic device 100 reduces processor performance to reduce power consumption of the electronic device for thermal protection. In other embodiments, when the temperature detected by temperature sensor 180J is below another threshold, electronic device 100 heats battery 142. In other embodiments, when the temperature is below yet another threshold, electronic device 100 may boost the output voltage of battery 142.

[0100] The touch sensor 180K is also called a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a location different from that of the display screen 194.

[0101] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bones of the human body's vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be set in headphones to form bone conduction headphones. The audio module 170 can parse the voice signal based on the vibration signal of the vibrating bones of the vocal cords acquired by the bone conduction sensor 180M to implement the voice function. The application processor can parse the heart rate information based on the blood pressure signals acquired by the bone conduction sensor 180M to implement the heart rate detection function.

[0102] The buttons 190 may include a power button, a volume button, etc. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0103] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0104] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0105] The SIM card interface 195 can be a hardware module for connecting a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or removing it from the SIM card interface 195. The electronic device 100 can support one or more SIM card interfaces. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0106] It should be understood that the structure illustrated in FIG2 of the present application does not constitute a specific limitation on the terminal device of the present application. In other embodiments of the present application, the terminal device may include more or fewer components than shown in the figure, or may combine or separate certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0107] As a possible example, please refer to Figure 3, which shows a schematic diagram of the software structure of a terminal device provided in an embodiment of the present application. As shown in Figure 3, the operating system of the terminal device may include an application layer, a framework layer (framework, FWK) and a driver layer.

[0108] The application layer may include a series of applications, such as the settings application, desktop applications, and third-party applications shown in Figure 3. The third-party applications in the application layer may include, but are not limited to, word processing systems (WPS), mailboxes, memos, cameras, galleries, calendars, calls, maps, navigation, Bluetooth, music, videos, short messages, etc. For ease of description, applications will be referred to as applications below. The above applications may be native applications (such as applications integrated into the operating system) or functions, applications downloaded and installed by users through the application store, which are not limited in the embodiments of this application. Settings applications are generally system-level applications, and users can use settings applications to make system settings. Desktop applications can be understood as the desktop of the terminal device. When the user triggers the launch of a new interface on the desktop, settings application, or third-party application, the Activity Manager Service (AMS) launches the corresponding activity. In the embodiments provided in this application, activities can also be referred to as application components. The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. As shown in Figure 3, the framework layer may include an activity management service (ActivityManagerSerive, AMS), a display management service (DisplayManagerService, DMS) and a task stack management module. Among them, AMS is mainly responsible for the management of window activities, and DMS is mainly used to manage information such as screen objects of terminal devices, such as creating virtual screens, mapping virtual screens, etc. The task stack management module includes a scene recognition module, a configuration management module and a startup mode management module in the embodiment provided in this application. The scene recognition module is mainly used to determine the startup method of the activity based on the preset configuration information and the current state of the device. The configuration management module is mainly used to store preset configuration information, such as whether the user starts the floating window function of a certain application; or whether the application itself has a parallel field of view, whether the application itself supports floating window display, etc. In addition, the configuration management module may also store interface jump combination settings. For example, the user configures that when interface 2 is newly launched from interface 1, interface 2 must be presented in the form of a floating window.

[0109] The kernel layer is the layer between hardware and software. It can include camera drivers, input / output device drivers (such as keyboard drivers, touch screen drivers, and microphone drivers), audio drivers (such as headphone drivers and speaker drivers), sensor drivers, and Bluetooth drivers. The camera driver is used to call and control the camera hardware through the driver, such as shooting control (such as starting, pausing, and ending shooting) and adjusting shooting parameters.

[0110] It should be noted that Figure 3 is merely an example of a software structure diagram for a terminal device, which simply lists the layers and software modules relevant to the present application. In actual applications, the operating system of the terminal device may further include other layers, and each layer may further include other software modules for implementing one or more functions or services. This embodiment of the present application does not specifically limit this.

[0111] It should be noted that this application is not limited to opening an interface that can only be displayed in the vertical direction of the device when the device is placed horizontally. It can also be opened when the device is placed vertically and can only be displayed in the horizontal direction of the device. The principles are similar and this application will not be further described. The following uses the horizontal position of a tablet device as an example, with the system orientation being horizontal, to introduce the method provided in the embodiments of this application.

[0112] Scenario 1: Launching a new interface across applications

[0113] Step S401: receiving a user operation, the terminal device triggers the launch of a new application interface belonging to another application.

[0114] Prior to step S401, the terminal device may be in the home page or desktop state, or the terminal device may have opened an application interface of a certain application, which is presented in full screen or floating window form. It should be noted that both the desktop and the aforementioned application can be referred to as the current application in step S401. Step S401 triggers the launch of a new application interface belonging to another application from the application interface of the current application.

[0115] Among them, the user operation can be an operation of clicking an application icon on the desktop, an operation of clicking a control button on the currently displayed application interface, an operation of clicking a message notification when receiving a message notification from another application, or an operation of sliding out a sidebar and clicking an application icon on the sidebar. This application does not specifically limit how to trigger the launch of a new application interface belonging to another application.

[0116] Step S402: The terminal device determines whether the new application interface supports parallel horizons.

[0117] Exemplarily, the terminal device may obtain configuration information based on the application identifier to which the application interface belongs or the component information corresponding to the application interface to determine whether the new application interface supports parallel horizons.

[0118] When the new application interface supports parallel view, the new application interface is displayed in the center, and the left and right sides of the screen are left blank or blurred. When the new application interface does not support parallel view, step S403 is executed.

[0119] Step S403: The terminal device determines whether the new application interface supports horizontal screen display.

[0120] It should be noted that this embodiment of the application uses the device in a horizontal orientation as an example, so the determination in step S403 is whether the newly launched application interface supports landscape display. When the device is currently in a vertical orientation, the determination in step S403 is whether the new application interface supports portrait display. Before executing step S403, the terminal device will obtain the device orientation in advance.

[0121] The terminal device can obtain configuration information based on the application identifier of the application interface or the component information corresponding to the application interface to determine whether the new application interface supports landscape display. For example, when an application sets its display direction to "portrait", the application interface of the application supports portrait display, as shown in Figure 1(b). When an application sets its display direction to "landscape", the application interface of the application supports landscape display, as shown in Figure 1(a).

[0122] When the terminal device determines that the new application interface supports horizontal screen display, the terminal device can display the new application interface in full screen.

[0123] When the terminal device determines that the new application interface does not support horizontal screen display, step S403 can be executed.

[0124] Step S404: The terminal device determines whether the new application interface supports floating windows.

[0125] The terminal device can obtain configuration information based on the application identifier to which the application interface belongs or the component information corresponding to the application interface to determine whether the new application interface supports floating window display.

[0126] When the new application interface supports floating windows, the terminal device presents the new application interface in the form of a floating window. In some embodiments, the new interface is initially set to not be displayed in landscape mode or only in portrait mode. For example, the interface's display orientation is set to "portrait." After starting in floating window mode, the system orientation remains landscape, but the application can be notified that the current orientation is "portrait" and the application interface content is then presented in the floating window container, thereby achieving landscape display in the floating window.

[0127] It should be noted that the above embodiment steps sequentially determine whether the application interface supports parallel vision, whether it supports horizontal screen display, and whether it supports floating windows. In fact, step S402 or step S403 can be omitted, or both step S402 and step S403 can be omitted.

[0128] In addition, in the above embodiment, whether parallel vision is supported, whether horizontal screen is supported, and whether floating window is supported are all judged separately in turn. The terminal device can also directly obtain all the configuration information, and directly determine to start the new application interface in the form of a floating window based on the configuration information and the current placement direction of the terminal device.

[0129] In another embodiment, the terminal device may also directly enter the split-screen scene after receiving a user operation. For example, when a message notification is received from another application, the split-screen scene is directly entered by clicking on the message notification, or the split-screen scene is triggered by dragging the message notification, or the split-screen scene is directly triggered after clicking on a page jump control on the current application interface. The above-mentioned split-screen scene may specifically be to display the application interface of the current application in the left half area of ​​the device screen, and the application interface of another newly launched application in the right half of the device screen. Alternatively, the current application has two applications that are already in a split-screen state. After receiving the first user operation, the new application interface is displayed on the right half of the device screen, and the previous two applications are displayed in the upper and lower areas of the left half respectively. This application does not specifically limit the division of specific screen areas in the split-screen mode after the new interface is launched.

[0130] In the embodiments provided in the present application, the user or the system can configure the startup mode. As shown in Figure 5, when the user triggers the startup of a new application interface belonging to another application, the system can pop up a prompt box for the user to choose a way to open the new application interface, and record the user's choice so that the new application interface can be directly opened in this way later. For example, when opening the interface of application B, the user can choose to save the startup in split-screen mode or floating window mode. In addition, the user can also enter the window startup mode setting through the "Settings" application to directly set the display mode when each application interface jumps, including startup in the form of a floating window, or startup in split screen, etc. For example, the user can set multiple startup mode combinations, for example, when jumping from the interface of application A to the interface of application B, it starts in floating window mode, and when jumping from application A to the interface of application C, it starts in floating window mode. The above startup mode combination can also be referred to as configuration information in the embodiments of the present application.

[0131] In the embodiments provided herein, the definition of configuration information is relatively broad, primarily used to indicate the properties of the second application interface. This configuration information records whether the second application interface supports parallel view, landscape mode, or floating window display, among other things. Configuration information can also be user-configured configuration information, such as a preset startup mode combination.

[0132] Scenario 2: Launching a new interface within the app

[0133] Step S601: receiving a user operation, the terminal device triggers and starts a new interface of the current application.

[0134] Before step S601, the terminal device may be in the home page or desktop state, or the terminal device may have opened an application interface of a certain application, which is presented in the form of a full screen or a floating window.

[0135] Among them, the user operation can be an operation of clicking a control button on the currently displayed application interface, or an operation of clicking a message notification when receiving a message notification from the application, or an operation of sliding out the sidebar and clicking the application icon of the application on the sidebar. This application does not specifically limit how to trigger the launch of a new application interface of the current application.

[0136] Step S602: The terminal device determines whether the new interface supports parallel horizons.

[0137] If the application described in the new interface supports parallel horizons, the terminal device triggers the display of the new interface in parallel horizons, that is, the interface before receiving the user operation is displayed in the left area of ​​the screen, and the new interface is displayed in the right area of ​​the screen.

[0138] If the application to which the new interface belongs does not support parallel horizons, step S603 may be executed.

[0139] Step S603: The terminal device determines whether the new interface supports horizontal screen display.

[0140] It should be noted that this embodiment of the application uses the device in landscape orientation as an example, so the determination in step S603 is whether the newly launched application interface supports landscape display. When the device is currently in portrait orientation, the determination in step S603 is whether the new application interface supports portrait display. Before executing step S603, the terminal device can obtain the device orientation.

[0141] The terminal device can obtain configuration information based on the application identifier of the application to which the application interface belongs or the component information corresponding to the application interface to determine whether the new application interface supports landscape display. For example, when an application sets the display direction to "portrait", the application interface of the application can only be displayed in portrait mode, as shown in Figure 1(b). When an application sets the display direction to "landscape", the application interface of the application can only be displayed in landscape mode, as shown in Figure 1(a).

[0142] When the terminal device determines that the new application interface supports horizontal screen display, the terminal device can display the new application interface in full screen.

[0143] When the terminal device determines that the new application interface does not support horizontal screen display but only supports vertical screen display, step S504 can be executed.

[0144] Step S604: The terminal device determines whether the new application interface supports floating windows.

[0145] When the new application interface supports floating windows, the terminal device presents the new application interface in landscape mode in the form of a floating window. In some embodiments, the new interface is initially configured to not be displayed in landscape mode or to be displayed only in portrait mode. For example, the interface's display orientation is set to "portrait." After starting in floating window mode, the system orientation remains landscape, but the application can be notified that the current orientation is "portrait." The received application interface content is then presented in the floating window container, thereby achieving landscape display in the floating window.

[0146] It should be noted that in some embodiments, the above steps do not need to be executed sequentially. For example, steps S601, S602, and S604 may be executed, or step S604 may be executed directly after step S601. That is, after receiving a user operation, the new interface launched within the application can be directly launched in floating window mode.

[0147] Similar to Scenario 1, after receiving a user operation, the terminal device can also directly enter the split-screen scenario, without executing steps S602-S604. For example, when a message notification from a social application is received on the news interface of the application, clicking the message notification can directly trigger the split-screen scenario. Specifically, the news interface of the social application can be displayed on the left side of the device, and the message page of the social application can be displayed on the right side of the device. This application does not specifically limit the layout of the application interface after splitting the screen.

[0148] In addition, similar to scenario 1, users can also set the startup mode for the new interface launched within the application. For example, the user can set a certain application to start in the form of a floating window when opening a file, or to start in the form of a split screen when opening the news interface. The above startup mode combination can also be referred to as configuration information in the embodiment of this application.

[0149] Figure 8 is a specific example of launching a new interface across application scenarios. The interface of application B does not support landscape display and can only be displayed in portrait mode. As shown in Figure 8, when the "Featured" control is clicked on the interface of application A, the newly launched interface of application B is presented as a floating window, and the user no longer needs to rotate the device. Furthermore, this solution can also be applied to scenarios such as cross-application sharing and cross-application price comparison, improving the user experience of terminal devices in cross-application scenarios.

[0150] Figure 9 shows a specific example of launching a new interface within an app. In a chat app, clicking on a file sent by a friend directly opens the file in a floating window. This allows users to view both chat content and file content simultaneously, improving browsing efficiency.

[0151] Figure 10 illustrates the specific implementation of a terminal device when launching a new interface. This new interface can be a new interface within an application or across applications. The terminal device's software modules specifically include the AMS and a task stack management module. The task stack management module includes a scene recognition module, a configuration management module, and a startup mode management module.

[0152] Step S101: The user clicks a control to trigger the launch of a new interface.

[0153] In this embodiment, the new interface may be a new interface across applications or a new interface belonging to the same application.

[0154] The user can click an application icon on the desktop application to trigger the launch of a new interface, or when an application interface is open, click a control on the application interface to trigger the launch of a new interface.

[0155] Step S102: The AMS obtains the application identifier or application component information of the application to which the new interface belongs.

[0156] When a user clicks a control, AMS listens for the event of opening a new screen and determines the application ID and application component information of the application to which the new screen belongs. The application ID indicates which application the new screen belongs to, and the application component information identifies the specific activity, such as the activity name, attributes, and type.

[0157] Step S103: The AMS sends the application identifier and application component information obtained in step S102 to the scene recognition module.

[0158] Step S104: The scene recognition module obtains configuration information of the new interface from the configuration management module according to the application identifier or application component information.

[0159] For example, when querying using an application identifier, the configuration management module stores the configuration information of application A. For example, whether application A supports parallel view mode, whether application A supports landscape display, or whether the application enables floating window display. For example, all interfaces of application A are configured to start in floating window form. For another example, application A is configured to start in floating window form when the device is in landscape mode.

[0160] For example, when querying application component information, the configuration management module stores the configuration information for a specific activity under application A. For example, type a activity under application A is launched as a floating window, or type b interface under application A is launched as a split screen. Alternatively, an activity is configured to launch in floating window mode even when the device is in landscape mode. Alternatively, this configuration information indicates whether the activity has a parallel view mode, supports landscape display, or supports floating window display.

[0161] Step S105: The scene recognition module determines the startup mode of the new interface according to the queried configuration information and the current device orientation, and notifies the startup mode management module to modify to the updated startup mode.

[0162] The scene recognition module obtains the current device orientation. This application takes the device in a horizontal position as an example. It should be noted that this application does not specifically limit the timing of the scene recognition module obtaining the device orientation.

[0163] The scene recognition module determines how to start the new interface based on the acquired configuration information and the current device orientation. In a cross-application scenario, the scene recognition module can first determine whether the current scene (from application A to application B) has been preset for split-screen display based on the configuration information. If not, it can further determine whether the current new interface supports horizontal screen display. If it does not support horizontal screen display, and the application to which the new interface belongs is turned on / has a floating window function, it can be determined to start the new interface in the form of a floating window. In the scenario of starting a new interface within an application, the scene recognition module can first determine whether the interface supports parallel field of view display. If not, it can further determine whether the interface is displayed in horizontal screen. If it does not support horizontal screen display and the application to which the new interface belongs is turned on / has a floating window function, it can be determined to start the new interface in the form of a floating window.

[0164] After determining a new startup mode (such as split screen, floating window, etc.), the scene recognition module notifies the startup mode management module to update the startup mode to the new startup mode.

[0165] Step S106: The AMS starts the new interface according to the updated startup mode.

[0166] In the embodiment provided in the present application, when a new interface is launched (including the scenario of launching a new interface across applications or the scenario of launching a new interface within an application), a new task stack will be created, and the activity corresponding to the new interface will be placed in the newly created task stack and independent of the original task stack. Therefore, the new interface will be displayed as an independent task on the multi-task management page, and the user can manually clear the task. In conjunction with Figure 8(b), the background A application interface and the B application interface displayed in the floating window belong to different task stacks. In conjunction with Figure 9(b), the background chat interface and the file page in the floating window also belong to different task stacks.

[0167] The specific implementation of saving the startup mode combination in the embodiment of the present application is introduced in conjunction with Figure 11 and Figure 5 (a). In Figure 11, when the user triggers the startup interface, the system pops up a window for the user to select the startup mode and stores the selection.

[0168] Step S111: The user clicks on a control to trigger the launch of a new interface.

[0169] Step S112: The AMS identifies the trigger event and confirms the application identifier or application component information of the application to which the new interface belongs.

[0170] Step S113: The user selects a startup mode combination of the new interface, and the startup mode combination is sent to the startup mode management module via the AMS.

[0171] Step S114: the startup mode management module stores the startup mode combination selected by the user.

[0172] Another specific implementation of saving the startup mode combination in the embodiment of the present application is introduced in conjunction with Figure 12 and Figure 5 (b). In Figure 12, the startup mode combination is set or deleted through the "Settings" application.

[0173] Step S121: The user sets the startup mode combination through the "Settings" application.

[0174] Step S122: The "Settings" application sends the startup mode combination to the configuration management module.

[0175] Step S123: The configuration management module stores the received startup mode combination.

[0176] Step S124: The user deletes the startup mode combination through the "Settings" application.

[0177] Step S125: The configuration management module deletes the corresponding startup mode combination according to the received notification.

[0178] The present application also provides an electronic device, the terminal device includes: one or more processors, one or more memories; the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the above method.

[0179] The present application also provides a computer-readable storage medium, comprising instructions, characterized in that when the instructions are executed on an electronic device, the electronic device executes the above method.

[0180] It should be understood that the various schemes of the embodiments of the present application can be reasonably combined and used, and the explanations or descriptions of the various terms appearing in the embodiments can be referenced or explained with each other in the various embodiments, without limitation to this.

[0181] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0182] It is understandable that, in order to implement the functions of any of the above-mentioned embodiments, the terminal device includes hardware structures and / or software modules corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and algorithm steps of the various examples described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0183] The embodiments of the present application can divide the terminal device into functional modules. For example, each functional module can be divided into corresponding functional modules, or two or more functions can be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical functional division. In actual implementation, other division methods may be used.

[0184] It should also be understood that the various modules in the terminal device can be implemented in software and / or hardware, without specific limitation. In other words, the electronic device is presented in the form of functional modules. The "module" here can refer to an application-specific integrated circuit (ASIC), a circuit, a processor and memory that executes one or more software or firmware programs, an integrated logic circuit, and / or other devices that can provide the above-mentioned functions.

[0185] In an optional manner, when data transmission is implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is implemented in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disk (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)).

[0186] The steps of the method or algorithm described in conjunction with the embodiments of the present application can be implemented in hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, mobile hard disk, CD-ROM or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a terminal device. Of course, the processor and the storage medium can also exist as discrete components.

[0187] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

Claims

1. A display method, applied to a horizontally placed terminal device, characterized in that: The method comprises: Displaying a first application interface, wherein the first application interface includes a control for triggering the launch of a second application interface; receiving a user operation acting on the control; When the second application interface does not support horizontal screen display or only supports vertical screen display, the second application interface is displayed horizontally in the floating window in response to the user operation.

2. The method according to claim 1, characterized in that The second application interface does not support parallel vision mode.

3. The method according to claim 1 or 2, characterized in that: The first application interface belongs to a first application, the second application interface belongs to a second application, and the first application and the second application are different applications.

4. The method according to claim 1 or 2, characterized in that: The first application interface and the second application interface belong to the same application.

5. The method according to any one of claims 1 to 4, characterized in that: Before displaying the second application interface in the floating window in response to the user operation, the method further includes: Obtaining configuration information of the second application interface, where the configuration information is used to indicate whether the second application interface supports floating window display; When the configuration information indicates that the second application interface supports floating window display, the second application interface is displayed in the floating window.

5. The method according to claim 4 is characterized in that the configuration information of the second application interface is also used to indicate whether the second application interface supports parallel vision, or the configuration information of the second application interface is also used to indicate that the second application interface does not support horizontal screen display or only supports vertical screen display.

6. The method according to any one of claims 1 to 5, characterized in that: Before displaying the second application interface in the floating window, the method further includes: Acquire startup mode combination information, where the startup mode combination information is used to indicate that when jumping from a first application interface to a second application interface, the second application interface is started in a floating window mode; According to the startup mode combination information, a second application interface is displayed in the floating window.

7. The method according to claim 6, characterized in that The startup mode combination information is generated according to the user's last selection, or the startup mode combination information is preset through system settings.

8. The method according to any one of claims 1, 2, 4-7, characterized in that: The first application interface is a desktop, and the user operation is an operation of clicking an application icon on the desktop, or the user operation is an operation of clicking a system notification.

9. The method according to any one of claims 1-3, 5-7, characterized in that: The first application interface is an interface of a first application, and the user operation is an operation of clicking a control on the first application interface.

10. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: In response to the user operation, a new task stack is created, and the second application interface is placed in the new task stack.

11. An electronic device, characterized in that: The electronic device includes: one or more processors and one or more memories; the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute any of the methods described in claims 1-10.

12. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device is caused to execute the method as claimed in any one of claims 1 to 10.

13. A computer program product, characterized in that When the computer program product is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Method for quickly calling out small windows in full-screen display video, graphical user interface and terminal

    CN109445572A

  • Application display method and electronic equipment

    CN114397979A

  • Application interface interaction method, electronic equipment and computer readable storage medium

    CN115866122A

  • Display method and electronic device

    WO2022161119A1