Screen switching method and device, computer readable medium and electronic device
By detecting the operating status of the wearable device and automatically switching the display screen, the problem of high power consumption and poor battery life when displaying auxiliary content is solved, achieving more efficient battery use and better user experience.
Patent Information
- Application Number
- CN202110626311.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-06-04
- Publication Date
- 2025-02-28
- Estimated Expiration
- 2041-06-04
AI Technical Summary
When the wearable device is connected to the terminal device, the display requirements for auxiliary content are high, resulting in large power consumption of the terminal device and poor battery life.
By detecting the current operating status of the wearable device and determining the auxiliary interface to be displayed, automatically switch the appropriate display screen, and selecting a second display screen with lower power consumption (such as an ink screen) for display, to reduce unnecessary waste of power consumption.
It effectively reduces the power consumption of terminal equipment, improves the battery life of terminal equipment, simplifies user operations, and improves user experience.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Background Art
[0002] With the continuous improvement of people's living standards, virtual technologies such as AR (Augmented Reality) technology and VR (Virtual Reality) technology have been widely used.
[0003] At present, when wearable devices with AR / VR functions, such as AR smart glasses, are connected to terminal devices, some auxiliary content, such as AR controller interface, needs to be displayed on the terminal device. However, the display requirements of auxiliary content are not high, which will cause higher power consumption and lead to poor battery life of terminal devices. Summary of the invention
[0004] The purpose of the present disclosure is to provide a screen switching method, a screen switching device, a computer-readable medium and an electronic device, thereby reducing the power consumption generated when a wearable device is connected to a terminal device to at least a certain extent, and improving the battery life of the terminal device.
[0005] According to a first aspect of the present disclosure, a screen switching method is provided, comprising:
[0006] In response to detecting that a communication connection is established with the wearable device, detecting a current operating state of the wearable device;
[0007] Determine the auxiliary interface that needs to be displayed in the current running state;
[0008] A target display screen to be opened is determined according to the auxiliary interface, and the target display screen includes a first display screen and a second display screen.
[0009] According to a second aspect of the present disclosure, a screen switching device is provided, comprising:
[0010] A device detection module, configured to detect a current operating state of the wearable device in response to detecting that a communication connection is established with the wearable device;
[0011] An auxiliary interface determination module, used to determine the auxiliary interface to be displayed in the current running state;
[0012] The screen switching module is used to determine a target display screen to be opened according to the auxiliary interface, and the target display screen includes a first display screen and a second display screen.
[0013] According to a third aspect of the present disclosure, a computer-readable medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the above method is implemented.
[0014] According to a fourth aspect of the present disclosure, there is provided an electronic device, characterized in that it includes:
[0015] Processor; and
[0016] The memory is used to store one or more programs. When the one or more programs are executed by one or more processors, the one or more processors implement the above method.
[0017] A screen switching method provided by an embodiment of the present disclosure detects the current operating state of the wearable device when it is detected that a communication connection is established with the wearable device, and determines the auxiliary interface that needs to be displayed in the current operating state, and then determines the target display screen to be turned on according to the auxiliary interface, and the target display screen includes a first display screen and a second display screen. On the one hand, when it is detected that a communication connection is established with the wearable device, the appropriate display screen is automatically switched according to the current operating state of the wearable device, and the user does not need to switch the display screen through manual operations such as pressing buttons or flipping, thereby improving the flexibility of switching display screens, simplifying user operations, and improving user experience; on the other hand, according to the auxiliary interface that needs to be displayed in the current operating state of the wearable device, the target display screen to be turned on is determined, and it can switch to the most suitable screen at the moment without affecting user use, effectively reducing unnecessary power consumption waste, improving the battery life of the terminal device, and improving user experience.
[0018] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:
[0020] Figure 1 A schematic diagram showing an exemplary system architecture to which embodiments of the present disclosure may be applied;
[0021] Figure 2 A schematic diagram showing an electronic device to which the embodiments of the present disclosure can be applied;
[0022] Figure 3 A flowchart schematically illustrates a screen switching method in an exemplary embodiment of the present disclosure;
[0023] Figure 4 A flowchart for authenticating a wearable device in an exemplary embodiment of the present disclosure is schematically shown;
[0024] Figure 5 A flowchart for determining a target display screen in an exemplary embodiment of the present disclosure is schematically shown;
[0025] Figure 6 A flowchart of switching a display screen according to interface attributes in an exemplary embodiment of the present disclosure is schematically shown;
[0026] Figure 7 A flowchart of intelligently switching display screens when a wearable device is connected in an exemplary embodiment of the present disclosure is schematically shown;
[0027] Figure 8 The figure schematically shows the composition of the screen switching device in the exemplary embodiment of the present disclosure. DETAILED DESCRIPTION
[0028] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the disclosure will be more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0029] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.
[0030] Figure 1 A schematic diagram of a system architecture of an exemplary application environment to which a screen switching method and device according to an embodiment of the present disclosure can be applied is shown.
[0031] like Figure 1 As shown, the system architecture 100 may include one or more of terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc. The terminal devices 101, 102, 103 may be various electronic devices with image processing functions, including but not limited to desktop computers, portable computers, smart phones, tablet computers, etc. It should be understood that Figure 1The number of terminal devices, networks and servers in the embodiment is only for illustration. According to the implementation requirements, there may be any number of terminal devices, networks and servers. For example, the server 105 may be a server cluster composed of multiple servers.
[0032] The screen switching method provided in the embodiment of the present disclosure is generally executed by the terminal devices 101, 102, and 103, and accordingly, the screen switching device is generally set in the terminal devices 101, 102, and 103. However, it is easy for those skilled in the art to understand that the screen switching method provided in the embodiment of the present disclosure can also be executed by the server 105, and accordingly, the screen switching device can also be set in the server 105, which is not particularly limited in this exemplary embodiment.
[0033] An exemplary embodiment of the present disclosure provides an electronic device for implementing a screen switching method, which may be Figure 1 The terminal device 101, 102, 103 or the server 105 in the embodiment of the present invention. The electronic device at least comprises a processor and a memory, the memory is used to store executable instructions of the processor, and the processor is configured to execute the screen switching method by executing the executable instructions.
[0034] Below Figure 2 Taking the mobile terminal 200 in FIG. 1 as an example, the structure of the electronic device is exemplarily described. It should be understood by those skilled in the art that, in addition to the components specifically used for mobile purposes, Figure 2 The structure in the figure can also be applied to fixed type devices. In other embodiments, the mobile terminal 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware. The interface connection relationship between the components is only shown schematically and does not constitute a structural limitation of the mobile terminal 200. In other embodiments, the mobile terminal 200 may also adopt the same Figure 2 Different interface connection methods, or a combination of multiple interface connection methods.
[0035] like Figure 2As shown, the mobile terminal 200 may specifically include: a processor 210, an internal memory 221, an external memory interface 222, a Universal Serial Bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 271, a receiver 272, a microphone 273, an earphone interface 274, a sensor module 280, a display screen 290, a camera module 291, an indicator 292, a motor 293, a button 294, and a subscriber identification module (SIM) card interface 295, etc. The sensor module 280 may include a depth sensor 2801, a pressure sensor 2802, a gyroscope sensor 2803, etc.
[0036] The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor and / or a neural network processor (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0037] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of the mobile terminal 200 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0038] The processor 210 is provided with a memory. The memory can store instructions for implementing six modular functions: detection instructions, connection instructions, information management instructions, analysis instructions, data transmission instructions, and notification instructions, and the execution is controlled by the processor 210.
[0039] The charging management module 240 is used to receive charging input from the charger. The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240 to power the processor 210, the internal memory 221, the display screen 290, the camera module 291 and the wireless communication module 260.
[0040] The wireless communication function of the mobile terminal 200 can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modulation and demodulation processor and baseband processor. Among them, antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals; mobile communication module 250 can provide solutions for wireless communication including 2G / 3G / 4G / 5G applied on mobile terminal 200; modulation and demodulation processor can include modulator and demodulator; wireless communication module 260 can provide solutions for wireless communication including wireless local area network (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT) and the like applied on mobile terminal 200. In some embodiments, antenna 1 of mobile terminal 200 is coupled with mobile communication module 250, and antenna 2 is coupled with wireless communication module 260, so that mobile terminal 200 can communicate with network and other devices through wireless communication technology.
[0041] The mobile terminal 200 implements the display function through a GPU, a display screen 290, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 290 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs that execute program instructions to generate or change display information.
[0042] The mobile terminal 200 can realize the shooting function through the ISP, the camera module 291, the video codec, the GPU, the display screen 290 and the application processor, etc. Among them, the ISP is used to process the data fed back by the camera module 291; the camera module 291 is used to capture static images or videos; the digital signal processor is used to process digital signals, and can process other digital signals in addition to digital image signals; the video codec is used to compress or decompress digital videos, and the mobile terminal 200 can also support one or more video codecs.
[0043] The external memory interface 222 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile terminal 200. The external memory card communicates with the processor 210 through the external memory interface 222 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0044] The internal memory 221 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the mobile terminal 200 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory (Universal Flash Storage, UFS), etc. The processor 210 executes various functional applications and data processing of the mobile terminal 200 by running instructions stored in the internal memory 221 and / or instructions stored in a memory provided in the processor.
[0045] The mobile terminal 200 can implement audio functions such as music playing and recording through the audio module 270 , the speaker 271 , the receiver 272 , the microphone 273 , the earphone interface 274 and the application processor.
[0046] The depth sensor 2801 is used to obtain the depth information of the scene. In some embodiments, the depth sensor can be arranged in the camera module 291.
[0047] The pressure sensor 2802 is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 2802 can be arranged on the display screen 290. There are many types of pressure sensors 2802, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc.
[0048] The gyro sensor 2803 can be used to determine the motion posture of the mobile terminal 200. In some embodiments, the angular velocity of the mobile terminal 200 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 2803. The gyro sensor 2803 can be used for shooting anti-shake, navigation, somatosensory game scenes, etc.
[0049] In addition, sensors with other functions may be set in the sensor module 280 according to actual needs, such as an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.
[0050] The mobile terminal 200 may also include other devices that provide auxiliary functions. For example, the key 294 includes a power key, a volume key, etc., and the user can generate key signal input related to the user settings and function control of the mobile terminal 200 through key input. For example, the indicator 292, the motor 293, the SIM card interface 295, etc.
[0051] In the related art, two display screens are set on the terminal device. A normal display screen can be set on one side of the terminal device for normal use scenarios, and an ink screen can be set on the other side, mainly for reading and other scenarios. At the same time, wearable devices such as AR / VR smart glasses have also received more and more attention and applications. AR smart glasses give users an experience of virtual and real superposition. For example, AR photography can take special effects photos that synthesize virtual scenes and real scenes; VR brings users a completely immersive experience, such as 3D videos and VR games. Because AR / VR devices require a lot of image calculations when working, they require a lot of power consumption. At the same time, the hardware performance requirements of the terminal device itself running the AR / VR system are very high. In addition, for split AR glasses, in addition to being a computing unit for the integrated AR system, another major function of the terminal device is to act as a remote control for the AR system.
[0052] At present, when dual-screen terminal devices switch the display screen, they need to press buttons or flip the terminal device to achieve it, and cannot automatically switch according to the particularity of AR / VR devices. When the AR / VR system is running, the power consumption is relatively large. In addition, for split AR / VR smart glasses, the terminal device, in addition to being a computing unit for the integrated AR system, mainly serves as a remote control interface display. It does not require such a high refresh rate or brightness of the display screen, which causes unnecessary power consumption of the terminal device and reduces the endurance of the terminal device.
[0053] Based on one or more of the above problems, this exemplary embodiment first provides a screen switching method. Taking the execution of a terminal device as an example, the screen switching method of the exemplary implementation of the present disclosure is specifically described below.
[0054] Figure 3 The flow of a screen switching method in this exemplary embodiment is shown, which may include steps S310 to S330:
[0055] In step S310, in response to detecting that a communication connection is established with a wearable device, a current operating state of the wearable device is detected.
[0056] In an exemplary embodiment, a wearable device may refer to a portable device with computing hardware support. For example, the wearable device may be AR smart glasses or a head display with AR functions. This exemplary embodiment does not specifically limit this.
[0057] The communication connection can be a communication method for connecting a terminal device and a wearable device and transmitting data. For example, the communication connection can be a Bluetooth communication connection, a WiFi communication connection, or a communication connection based on a 2G / 3G / 4G / 5G mobile network. Of course, it can also be other communication methods that can connect the first terminal device and the second terminal device and transmit data. For example, the communication connection can also be a communication method for wired connection by supporting interface protocols such as Micro-USB, Type-C, Thunderbolt 3, etc. This example embodiment does not specifically limit this.
[0058] The current operating state of the wearable device may refer to the working state of the wearable device when the wearable device is connected to the terminal device. For example, if the wearable device is executing a function corresponding to AR / VR, such as executing an AR game, when the wearable device is connected to the terminal device, then the current operating state of the wearable device may be considered to be the state of executing the AR / VR function; if the wearable device is playing a picture or video when the wearable device is connected to the terminal device, then the current state of the wearable device may be considered to be the state of executing the image playback function. Of course, this is only an example, and this example embodiment does not make any special limitation on this.
[0059] In step S320, the auxiliary interface that needs to be displayed in the current running state is determined.
[0060] In an exemplary embodiment, the auxiliary interface may refer to an interface that the wearable device needs to transmit to the terminal device for display in the current operating state. For example, assuming that the current operating state of the wearable device may be the state of running an AR / VR game, then the auxiliary interface may be an operating interface displayed on the terminal device for controlling the operation of the AR / VR game; the current operating state of the wearable device may also be the state of executing image playback, then the auxiliary interface may be an interface displayed on the terminal device for controlling the progress of an image or video, or an interface for displaying detailed information of an image or video; of course, the auxiliary interface may also be other interfaces that need to be transmitted by the wearable device to the terminal device for display, and this exemplary embodiment does not specifically limit this.
[0061] In step S330, a target display screen to be opened is determined according to the auxiliary interface, and the target display screen includes a first display screen and a second display screen.
[0062] In an exemplary embodiment, the target display screen refers to a display screen selected according to the auxiliary interface and used to display the auxiliary interface. Specifically, the terminal device in this exemplary embodiment may include a first display screen and a second display screen. The first display screen and the second display screen may be set on the front and back sides of the terminal device, or may be set in different areas on the same side. Of course, the second display screen may also be set in a certain area of the first display screen. This exemplary embodiment does not specifically limit this.
[0063] The first display screen can be the main screen normally used by the terminal device. For example, the first display screen can be a liquid crystal display screen (LCD screen) or a flexible display screen (OLED screen). Of course, it can also be other display screens that can be used as daily display screens for terminal devices. For example, the first display screen can also be a MiniLED display screen. This example embodiment does not make any special limitations on this.
[0064] The second display screen can be a low-power screen used by the terminal device as an auxiliary main screen display. For example, the second display screen can be an ink screen (e-ink, also known as electronic paper display technology) or a black and white display screen. This example embodiment does not specifically limit this.
[0065] The brightness, color richness, display refresh rate, and touch sampling rate of the first display screen are all higher than those of the second display screen, and the power consumption of the second display screen is lower than that of the first display screen.
[0066] Through the determined auxiliary interface, a display screen that is adapted to the current auxiliary interface is selected from the first display screen and the second display screen as the target display screen. For example, assuming that the display screen adapted to the auxiliary interface is the first display screen (or the second display screen), the first display screen (or the second display screen) can be turned on and the second display screen (or the first display screen) can be turned off; of course, in some scenarios, both the first display screen and the second display screen can also be used as target display screens, and this example embodiment does not make any special limitation to this.
[0067] Steps S310 to S330 are described in detail below.
[0068] In an exemplary embodiment, when it is detected that a communication connection is established with a wearable device, Figure 4 The steps in the implementation of wearable device authentication to ensure the security of connected wearable devices and improve the data security of terminal devices, refer to Figure 4 As shown, it may specifically include:
[0069] Step S410, in response to detecting that a communication connection is established with a wearable device, obtaining device identification information of the wearable device;
[0070] Step S420, matching the device identification information with a stored device identification information list;
[0071] Step S430: If the matching is successful, the current operating state of the wearable device is detected.
[0072] Among them, the device identification information refers to a unique identifier for identifying a wearable device. For example, the device information can be a device manufacturer identifier (such as VID), a device product identifier, a device serial number (such as PID), etc. Of course, it can also be other information that can uniquely identify a wearable device. This example embodiment does not make any special limitations on this.
[0073] The device identification information list refers to the device identification list of wearable devices with security authentication stored in the terminal device, or the device identification list of wearable devices authorized and authenticated by the user. For example, when a new wearable device requests to establish a communication connection, the user can be notified to perform authorization authentication, and after authorization authentication, the device identification information of the wearable device can be recorded in the device identification information list as information for subsequent security authentication.
[0074] Through the device identification information and the device identification information list, on the one hand, wearable devices that are not secure can be filtered to ensure the data security of the terminal device; on the other hand, wearable devices that can execute display screen switching instructions can be identified in advance to ensure the compatibility of wearable devices and terminal devices.
[0075] In an exemplary embodiment, since image calculations are all performed in the terminal device for wearable devices with AR / VR functions, such as split AR glasses, greater power consumption will be generated. At the same time, since the terminal device is only used for calculations, two operating systems can be set up. When the wearable device is connected to the terminal device, it can be switched to the operating system designed for the wearable device to reduce the occupation of computing resources by other irrelevant applications, thereby further reducing the power consumption of the terminal device.
[0076] Specifically, in response to detecting that a communication connection has been established with a wearable device, the currently running first operating system can be switched to a second operating system, and the second operating system can include virtual functions. Among them, the first operating system can be an ordinary operating system, which is the main system of the terminal device. For example, the first operating system can be an Android operating system or an IOS operating system, and this example embodiment does not specifically limit this. The second operating system can be an operating system designed by a developer to adapt to the connected wearable device. For example, the second operating system can be an AR / VR operating system designed to adapt to the AR / VR content on the connected wearable device. Of course, this example embodiment is not limited to this. Virtual functions refer to functions that can support the operation of AR / VR applications or related to AR / VR technology, such as virtual functions can be functions for running AR / VR games.
[0077] In an exemplary embodiment, the Figure 5 The steps in the following table are used to determine the target display screen to be opened according to the auxiliary interface. Figure 5 As shown, it may specifically include:
[0078] Step S510, obtaining interface attributes corresponding to the auxiliary interface;
[0079] Step S520: determining a target display screen to be opened according to the interface attributes.
[0080] Among them, the interface attributes can be attribute parameters corresponding to the content contained in the auxiliary interface. For example, assuming that the auxiliary interface can be a controller interaction interface for controlling AR / VR games displayed on a wearable device, the interface attributes of the auxiliary interface can be considered to be an interactive interface or interactive; assuming that the auxiliary interface can be detailed parameters (such as data format, data size, data storage path, etc.) for displaying images or videos played on a wearable device, the interface attributes of the auxiliary interface can be considered to be a non-interactive interface or non-interactive; of course, this is only a schematic example and should not impose any special limitations on this example embodiment.
[0081] Specifically, you can Figure 6 The steps in the implementation of the target display screen to be opened according to the interface properties, refer to Figure 6 As shown, it may specifically include:
[0082] Step S610, if it is detected that the interface attribute is an interactive interface, determining that the target display screen to be opened is the first display screen;
[0083] Step S620, if it is detected that the interface attribute is a non-interactive interface, determining that the target display screen to be opened is the second display screen;
[0084] Among them, an interactive interface refers to an interface with interactive properties. For example, if the auxiliary interface displays the controller interaction interface of an AR / VR game displayed on a wearable device, it can be considered that the user needs to perform touch operations through the auxiliary interface, and the user needs to interact with the auxiliary interface to generate input. At this time, the auxiliary interface can be considered an interactive interface.
[0085] Since the interactive interface needs to detect user input and feedback user operations, the display screen needs to have a higher touch sampling rate (that is, the sampling speed or sampling rate at which the display screen collects user input operations) to improve the real-time nature of user input operations and avoid input delays. The display screen also needs to have a higher screen refresh rate to facilitate timely feedback on user operations. The touch sampling rate and screen refresh rate can improve the tracking of user operations and enhance the user experience.
[0086] A non-interactive interface refers to an interface that does not have interactive properties. For example, if the auxiliary interface displays detailed parameters of an image or video played on a wearable device, it can be considered that the auxiliary interface only needs to display part of the data and does not need to interact with the user. In this case, the auxiliary interface can be considered a non-interactive interface.
[0087] Specifically, in this example implementation, the touch sampling rate of the first display screen can be greater than that of the second display screen, the refresh rate of the first display screen can be greater than that of the second display screen, the second display screen can be an ink screen, and the power consumption generated by the second display screen is less than that of the first display screen. Therefore, when it is detected that the interface attribute of the auxiliary interface is an interactive interface, it can be determined that the target display screen to be turned on is the first display screen, and the first display screen is turned on and the second display screen is turned off; when it is detected that the interface attribute is a non-interactive interface, it can be determined that the target display screen to be turned on is the second display screen, and the second display screen is turned on and the first display screen is turned off.
[0088] The interface attributes of the auxiliary interface sent by the wearable device to the terminal device for display are intelligently switched to the display screen to be turned on. On the one hand, it can ensure that it does not affect the user's use while effectively reducing the power consumption of the terminal device and improving the battery life of the terminal device; on the other hand, it enables the terminal device to apply more image computing resources to AR / VR functions, improve the stability of AR / VR functions, and reduce the rendering delay of AR / VR content; on the other hand, the user does not need to manually switch the display screen all the time, thereby simplifying the user's operation.
[0089] In an exemplary embodiment, in response to detecting that the communication connection with the wearable device is disconnected, the target display screen to be turned on can be determined to be the first display screen, or in response to detecting that the communication connection with the wearable device is disconnected, the recorded historical display screen is obtained, and the historical display screen is used as the target display screen to be turned on.
[0090] Among them, when it is detected that the communication connection with the wearable device is disconnected, it can be considered that the user has ended the use of the wearable device. Therefore, no matter whether the current display content is the first display screen or the second display screen, it is switched to the first display screen that can be used as the daily main screen. The user does not need to switch manually, which simplifies the user's operation.
[0091] Of course, before the terminal device establishes a communication connection with the wearable device and switches the display screen according to the auxiliary interface, the historical display screen before switching the display screen on the terminal device can be recorded, and when it is detected that the communication connection with the wearable device is disconnected, the display screen can be restored according to the recorded historical display screen.
[0092] For example, when the wearable device establishes a communication connection with the terminal device and switches the display screen according to the auxiliary interface, the user is browsing an e-book through the second display screen. At this time, when the instruction to switch the display screen is received, it is recorded that the second display screen is currently being used and the browsing progress of the current e-book. When it is detected that the communication connection with the wearable device is disconnected, the display screen is switched back to the second display screen and the browsing progress of the e-book is displayed on the second display screen, so as to restore to the state before the user used the wearable device and improve the user experience.
[0093] Figure 7 A flowchart of intelligently switching display screens when a wearable device is connected in an exemplary embodiment of the present disclosure is schematically shown.
[0094] refer to Figure 7 As shown, step S701, detecting whether a communication connection is established with a wearable device, if it is detected that a communication connection is established with the wearable device, executing step S702, otherwise terminating the current process;
[0095] Step S702, obtaining device identification information corresponding to the wearable device;
[0096] Step S703, matching the device identification information with the information in the preset device identification information list, if the match is successful, executing step S704, otherwise terminating the current process;
[0097] Step S704, switching the running first operating system to a second operating system adapted to the wearable device, where the second operating system may include a virtual function;
[0098] Step S705, determining the interface attributes of the auxiliary interface to be displayed, where the interface attributes may include an interactive interface and a non-interactive interface;
[0099] Step S706, determining whether the interface attribute of the auxiliary interface is an interactive interface, if so, executing step S707, otherwise, it can be considered that the interface attribute of the auxiliary interface is a non-interactive interface, and executing steps S708 and S709;
[0100] Step S707, determining that the target display screen to be turned on is the first display screen;
[0101] Step S708, determining that the target display screen to be turned on is the second display screen, wherein the refresh rate and touch sampling rate of the first display screen are greater than those of the second display screen, the power consumption generated by the second display screen is less than that of the first display screen, and the second display screen may be an ink screen;
[0102] Step S709: Allocate the released computing resources to the second operating system. Since the second display screen consumes fewer computing resources than the first display screen, when switching to the second display screen for display, the terminal device can release a portion of computing resources for the AR / VR function of the wearable device.
[0103] Step S710, rendering a display auxiliary interface on the turned-on target display screen, and ending the process.
[0104] In summary, in this exemplary embodiment, when it is detected that a communication connection is established with a wearable device, the current operating state of the wearable device is detected, and the auxiliary interface that needs to be displayed in the current operating state is determined, and then the target display screen to be turned on can be determined according to the auxiliary interface, and the target display screen includes a first display screen and a second display screen. On the one hand, when it is detected that a communication connection is established with a wearable device, the appropriate display screen is automatically switched according to the current operating state of the wearable device, and the user does not need to switch the display screen through manual operations such as buttons or flipping, thereby improving the flexibility of switching display screens, simplifying user operations, and improving user experience; on the other hand, according to the auxiliary interface that needs to be displayed in the current operating state of the wearable device, the target display screen to be turned on is determined, and it can switch to the most suitable screen at the moment without affecting user use, effectively reducing unnecessary power consumption waste, improving the endurance of the terminal device, and improving user experience.
[0105] It should be noted that the above figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.
[0106] For further reference, Figure 8 As shown, in the implementation of this example, a screen switching device 800 is also provided, which may include a device detection module 810, an auxiliary interface determination module 820 and a screen switching module 830. Among them:
[0107] The device detection module 810 is used to detect the current operating state of the wearable device in response to detecting that a communication connection is established with the wearable device;
[0108] The auxiliary interface determination module 820 is used to determine the auxiliary interface that needs to be displayed in the current running state;
[0109] The screen switching module 830 is used to determine a target display screen to be opened according to the auxiliary interface, and the target display screen includes a first display screen and a second display screen.
[0110] In an exemplary embodiment, the device detection module 810 may also be used to:
[0111] In response to detecting that a communication connection is established with a wearable device, obtaining device identification information of the wearable device;
[0112] Matching the device identification information with a stored list of device identification information;
[0113] If the match is successful, the current operating state of the wearable device is detected.
[0114] In an exemplary embodiment, the screen switching device 800 may further include an operating system switching module, and the operating system switching module may be used to:
[0115] A currently running first operating system is switched to a second operating system, where the second operating system includes a virtual function.
[0116] In an exemplary embodiment, the screen switching module 830 may also be used to:
[0117] Obtaining interface properties corresponding to the auxiliary interface;
[0118] The target display screen to be opened is determined according to the interface attributes.
[0119] In an exemplary embodiment, the screen switching module 830 may also be used to:
[0120] If it is detected that the interface attribute is an interactive interface, determining that the target display screen to be opened is the first display screen;
[0121] If it is detected that the interface attribute is a non-interactive interface, determining that the target display screen to be opened is the second display screen;
[0122] Among them, the touch sampling rate of the first display screen is greater than that of the second display screen, and the refresh rate of the first display screen is greater than that of the second display screen.
[0123] In an exemplary embodiment, the second display screen is an ink screen.
[0124] In an exemplary embodiment, the screen switching device 800 may further include a display screen recovery module, and the screen recovery module may be used to:
[0125] In response to detecting that the communication connection with the wearable device is disconnected, determining that the target display screen to be turned on is the first display screen; or
[0126] In response to detecting that the communication connection with the wearable device is disconnected, a recorded historical display screen is obtained, and the historical display screen is used as a target display screen to be turned on.
[0127] The specific details of each module in the above device have been described in detail in the implementation method of the method part. The undisclosed details can be found in the implementation method of the method part, so they will not be repeated here.
[0128] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "circuits", "modules" or "systems".
[0129] The exemplary embodiments of the present disclosure also provide a computer-readable storage medium on which a program product capable of implementing the above-mentioned method of the present specification is stored. In some possible implementations, various aspects of the present disclosure can also be implemented in the form of a program product, which includes program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section of the present specification, for example, it can execute Figures 3 to 7 Any one or more steps in .
[0130] It should be noted that the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0131] In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
[0132] In addition, program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).
[0133] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.
[0134] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A screen switching method, characterized in that: include: In response to detecting that a communication connection is established with the wearable device, detecting a current operating state of the wearable device; Determine the auxiliary interface that needs to be displayed in the current running state; Determine a target display screen to be opened according to the auxiliary interface, wherein the target display screen includes a first display screen and a second display screen; The step of determining a target display screen to be opened according to the auxiliary interface includes: Obtaining interface properties corresponding to the auxiliary interface; Determine the target display screen to be opened according to the interface attributes; The step of determining a target display screen to be opened according to the interface attribute includes: If it is detected that the interface attribute is an interactive interface, determining that the target display screen to be opened is the first display screen; If it is detected that the interface attribute is a non-interactive interface, determining that the target display screen to be opened is the second display screen; Among them, the touch sampling rate of the first display screen is greater than that of the second display screen, and the refresh rate of the first display screen is greater than that of the second display screen.
2. The method according to claim 1, characterized in that In response to detecting that a communication connection is established with the wearable device, detecting a current operating state of the wearable device includes: In response to detecting that a communication connection is established with a wearable device, obtaining device identification information of the wearable device; Matching the device identification information with a stored list of device identification information; If the match is successful, the current operating state of the wearable device is detected.
3. The method according to claim 2, characterized in that The method further comprises: A currently running first operating system is switched to a second operating system, where the second operating system includes a virtual function.
4. The method according to claim 1, characterized in that The second display screen is an ink screen.
5. The method according to claim 1, characterized in that The method further comprises: In response to detecting that the communication connection with the wearable device is disconnected, determining that the target display screen to be turned on is the first display screen; or In response to detecting that the communication connection with the wearable device is disconnected, a recorded historical display screen is obtained, and the historical display screen is used as a target display screen to be turned on.
6. A screen switching device, characterized in that: include: A device detection module, configured to detect a current operating state of the wearable device in response to detecting that a communication connection is established with the wearable device; An auxiliary interface determination module, used to determine the auxiliary interface to be displayed in the current running state; A screen switching module, used to determine a target display screen to be opened according to the auxiliary interface, wherein the target display screen includes a first display screen and a second display screen; The screen switching module is further used to obtain the interface attributes corresponding to the auxiliary interface; and determine the target display screen to be opened according to the interface attributes; The screen switching module is also used to determine that the target display screen to be turned on is the first display screen if it is detected that the interface attribute is an interactive interface; if it is detected that the interface attribute is a non-interactive interface, determine that the target display screen to be turned on is the second display screen; wherein the touch sampling rate of the first display screen is greater than that of the second display screen, and the refresh rate of the first display screen is greater than that of the second display screen.
7. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.
8. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to perform the method of any one of claims 1 to 5 by executing the executable instructions.
Citation Information
Patent Citations
Display method and electronic equipment
CN105892967A
Screen display method and device, storage medium and terminal
CN110737323A
Input method, device and system
US20190335034A1