Display method and related apparatus

Abstract

The present application discloses a display method and a related apparatus. A display screen of an electronic device is turned off. When the display screen remains in a screen-off state, it is detected that a user enters a first region; and when it is detected that the user stays in the first region for a first duration and stays in a second region for the first duration, the display screen is switched from the screen-off state to a screen-on state and a first interface is displayed on the display screen, the first region comprising the second region. When the first interface is displayed on the display screen, when it is detected that a duration from the moment when the user leaves the first region reaches a second duration, the display screen is switched from displaying the first interface to the screen-off state. When it is detected that the user stays in the first region for the first duration, but does not stay in the second region for the first duration, the display screen remains in the screen-off state. Therefore, when it is detected that the user enters the first region, the electronic device still remains in the screen-off state, until it is determined that the user stays in the second region for the first duration, and then the electronic device displays a mural interface, so as to avoid frequent screen-on operations of the electronic device when the user passes by, which interferes with user actions, so that the power consumption is reduced.

Description

A display method and related device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on September 11, 2023, with application number 202311175841.1 and application name “A display method and related device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminals, and in particular to a display method and related devices. Background Art

[0003] Currently, electronic devices like televisions can provide users with movie viewing capabilities, allowing them to enjoy better viewing experiences through their large screens. When not watching, these devices can also display paintings, photos, and more. They can serve as decorations, enhancing the aesthetics of the surrounding environment.

[0004] However, in order to display paintings, photos and other works, electronic devices keep their screens on for a long time, which consumes a lot of power.

[0005] Summary of the Invention

[0006] This application provides a display method and related device that implements timely display of a mural interface based on the displayed interface and the state of a designated area after switching. The mural interface can be used to decorate a room, making the entire space more beautiful and harmonious. Electronic devices can also turn off the screen in a timely manner based on changes in the state of the designated area, saving power consumption of the electronic device.

[0007] In a first aspect, the present application provides a display method, which is applied to an electronic device, the electronic device including a display screen, the method comprising:

[0008] The display screen turns off; while the display screen remains off, it is detected that the user enters the first area; if it is detected that the user stays in the first area for the first time period and in the second area for the first time period, the display screen is switched from off to on and the first interface is displayed on the display screen, and the first area includes the second area; after the first interface is displayed on the display screen, if it is detected that the user has left the first area for the second time period, the display screen is switched from displaying the first interface to off; if it is detected that the user has stayed in the first area for the first time period but has not stayed in the second area for the first time period, the display screen remains off. In this way, after detecting that the user appears in the designated area, the electronic device remains in the off state until the electronic device determines that the user has stayed in the designated sub-area for the first time period, and then the first interface is displayed. This avoids the electronic device frequently lighting up the screen when the user passes by, interfering with the user's actions, and saves power consumption of the electronic device.

[0009] In some examples, reaching means being greater than or equal to. The time duration for detecting that the user leaves the first area reaches the second time duration means that the time duration for detecting that the user leaves the first area is greater than or equal to the second time duration.

[0010] In one possible implementation, the method further includes: in response to receiving the first input, switching the display screen from on to off; while the display screen is off, detecting whether the user has left the first area; and if it is detected that the user has been away from the first area for a third time period, detecting whether the user has entered the first area, where the third time period is less than the second time period. In this way, when the electronic device receives the first input while the screen is on, it can be assumed that the user intends to turn off the screen and has no intention of turning the screen on and displaying the first interface. That is, even though the user is in the designated area, the electronic device 100 will not turn on the screen and display the first interface.

[0011] In one possible implementation, the method also includes: displaying a second interface on the display screen, the second interface being different from the first interface; when the display screen displays the second interface, detecting user input, and if it is detected that the time period for which no user input has been received reaches a fourth time period, displaying the first interface on the display screen; when displaying the first interface on the display screen, detecting whether the user has left the first area, and if it is detected that the time period for which the user has left the first area reaches a fifth time period, turning off the display screen.

[0012] The second interface is a non-task interface, that is, an interface other than the first interface and the task interface. The second interface may include a main interface.

[0013] In this way, the electronic device detects that the user has not operated the electronic device within the fourth time period, and the electronic device displays the first interface, showing the painting or photo, thereby improving the aesthetics of the space where the electronic device 100 is located.

[0014] In one possible implementation, after displaying the first interface on the display screen, and before switching the display screen from displaying the first interface to turning off the screen, the method further includes: detecting that the time the user has been away from the first area for a third time period, displaying a first countdown on the first interface, the time the first countdown lasts is equal to the sixth time period, and the sixth time period is the difference between the second time period and the third time period; or detecting that the time the user has been away from the first area for a seventh time period, displaying a second countdown on the first interface, the time the second countdown lasts is equal to the sixth time period, and the sixth time period is the difference between the fifth time period and the seventh time period. In this way, the electronic device displays the first countdown to indicate the time point when the electronic device turns off the screen.

[0015] In one possible implementation, after displaying the first countdown on the first interface, the method further includes: before detecting that the user has left the first area for a second time period, if the electronic device detects that the user has entered the first area, canceling the display of the first countdown. Thus, before the first countdown ends, if the electronic device detects that a person has entered the first area, the first countdown is interrupted, and the mural interface remains displayed.

[0016] In a possible implementation, after displaying the first countdown on the first interface, the method further includes: before detecting that the user has left the first area for a fifth time period, if detecting that the user has entered the first area, canceling the display of the second countdown.

[0017] In some examples, the first countdown is the same as or different from the second countdown.

[0018] In a possible implementation, the electronic device further includes a camera, and the first area is within the field of view (FOV) of the camera. In this way, the electronic device determines whether the user stays in the designated sub-area through the camera.

[0019] In one possible implementation, the first interface is a wallpaper interface. In this way, the electronic device displays the mural interface at the appropriate time based on the display state and switching conditions, meeting the user's need to view the mural interface while turning off the screen when not needed, saving power consumption of the electronic device.

[0020] In one possible implementation, the method further includes one or more of the following: in response to detecting that a user enters a first area, switching the unmanned state to an occupied non-staying state; in response to detecting that a user stays in a second area for a first period of time, switching the occupied non-staying state to an occupied and staying state; in response to detecting that the user leaves the first area for a third period of time, switching the occupied and staying state to an unmanned state.

[0021] In some examples, in response to switching the occupied non-stop state to the occupied and stopped state, the display screen is turned on and the first interface is displayed.

[0022] In one possible implementation, after the first interface is displayed on the display screen, if it is detected that the time when the user leaves the first area reaches a second time period, the display screen is switched from displaying the first interface to turning off the screen, specifically including: detecting that the time when the presence of a person and the stay state is switched to the unmanned state reaches a sixth time period, turning off the display screen, and the sixth time period is the difference between the second time period and the third time period.

[0023] In some examples, in response to detecting that there is someone and the duration of switching from the stay state to the unmanned state reaches a sixth duration, the display screen is turned off.

[0024] In one possible implementation, the method further includes one or more of the following: in response to a first input, setting the state to be occupied and staying; in response to detecting that the time duration for which the user has left the first area reaches a third time duration, switching the state to be occupied and staying to the state to be unoccupied.

[0025] In some examples, in response to being set to an occupied and staying state, the display screen is turned off.

[0026] In one possible implementation, the method further includes one or more of the following: in response to detecting that a period of no input has reached a fourth period, setting the state to an occupied, non-staying state; and in response to detecting that a user has left the first area for a seventh period, switching the occupied, non-staying state to an unoccupied state, wherein the seventh period is less than the fifth period.

[0027] In some examples, in response to setting the state to an occupied non-staying state, the first interface is displayed.

[0028] In one possible implementation, if it is detected that the time duration for which the user has left the first area reaches the fifth time duration, the display screen will be turned off, specifically including: detecting that the time duration for switching the occupied non-stop state to the unoccupied state reaches the sixth time duration, turning off the display screen, and the sixth time duration is the difference between the fifth time duration and the seventh time duration.

[0029] In one possible implementation, upon detecting that a user has remained within a second area of ​​a first area for a first duration, illuminating the display screen and displaying the first interface on the display screen may specifically include: capturing M frames of images via a camera for the first duration; detecting that the user is within the second area in the M frames of images, illuminating the display screen and displaying the first interface on the display screen. Thus, the electronic device determines whether the user is within the first area based on the captured images.

[0030] In one possible implementation, upon detecting that a user has left the first area for a second duration, turning off the display screen may include: capturing N frames of images via a camera for the second duration; and detecting that the N frames of images do not include the user, turning off the display screen. Thus, the electronic device determines whether the user is located in the first area based on the captured images.

[0031] In one possible implementation, if the room where the electronic device is located is decorated in a first style and the light in the room is a first color temperature, the first interface includes first display content; if the room where the electronic device is located is decorated in the first style and the light in the room is a second color temperature, the first interface includes second display content, the first color temperature is different from the second color temperature, and the first display content and the second display content have different tones; if the room where the electronic device is located is decorated in the second style and the light in the room is the first color temperature, the first interface includes third display content, the first decoration style is different from the second decoration style, and the first display content and the third display content have different types. In this way, the electronic device displays works consistent with the style of the environment where the electronic device is located in the first interface, enhancing the user's sense of immersion and surrounding, and improving the user experience.

[0032] In one possible implementation, after displaying the first interface, the method further includes: receiving a second input for the first interface; and displaying a first animation effect on the first interface in response to the second input. Receiving a third input for the first interface; and displaying a second animation effect on the first interface in response to the third input, wherein the second input is different from the third input, and the first animation effect is different from the second animation effect. In this way, the first interface provides the user with interactive functionality, and the electronic device perceives the user's interactive behavior and outputs corresponding interactive results based on the user's interactive behavior, thereby increasing the fun and interactivity of the mural interface.

[0033] In a second aspect, the present application provides a display method for an electronic device, the electronic device including a display screen. The method comprises: turning off the display screen; while the display screen remains off, detecting a user entering a first area; after detecting the user entering the first area, if it is detected that the user has been gazing at the display screen for a first duration, switching the display screen from off to on and displaying a first interface on the display screen; after displaying the first interface on the display screen, if it is detected that the user has left the first area for a second duration, switching the display screen from displaying the first interface to off; after detecting the user entering the first area, if it is detected that the user has not been gazing at the display screen for the first duration, keeping the display screen off. In this way, the electronic device detects whether the user is gazing at the electronic device after detecting that the user is in a designated area, thereby saving power consumption in determining the user's field of view. Furthermore, after detecting that the user has been gazing at the electronic device for a preset duration, the electronic device 100 can confirm that the user wants to view a mural interface and provide the mural interface to the user. When the user is in the designated area, the electronic device 100 does not need to determine whether the user is gazing at the electronic device, thereby reducing power consumption.

[0034] In some examples, a gaze is a user's gaze falling on an electronic device.

[0035] In one possible implementation, the method further includes: in response to receiving a first input, turning off the display screen; when the display screen is turned off, detecting whether the user has left the first area; if it is detected that the time duration for which the user has left the first area reaches a third time duration, detecting whether the user has entered the first area, and the third time duration is less than the second time duration.

[0036] In one possible implementation, the method also includes: displaying a second interface on the display screen, the second interface being different from the first interface; when the display screen displays the second interface, detecting user input, and if it is detected that the time period for which no user input has been received reaches a fourth time period, displaying the first interface on the display screen; when displaying the first interface on the display screen, detecting whether the user has left the first area, and if it is detected that the time period for which the user has left the first area reaches a fifth time period, turning off the display screen.

[0037] In one possible implementation, after displaying the first interface on the display screen, before switching the display screen from displaying the first interface to turning off the screen, the method further includes: detecting that the time duration for which the user has left the first area reaches a third time duration, displaying a first countdown on the first interface, the time duration of the first countdown being equal to a sixth time duration, and the sixth time duration being the difference between the second time duration and the third time duration; or detecting that the time duration for which the user has left the first area reaches a seventh time duration, displaying a second countdown on the first interface, the time duration of the second countdown being equal to a sixth time duration, and the sixth time duration being the difference between the fifth time duration and the seventh time duration.

[0038] In a possible implementation, after displaying the first countdown on the first interface, the method further includes: before detecting that the user has left the first area for a second time period, if detecting that the user has entered the first area, canceling the display of the first countdown.

[0039] In a possible implementation, after displaying the first countdown on the first interface, the method further includes: before detecting that the user has left the first area for a fifth time period, if detecting that the user has entered the first area, canceling the display of the second countdown.

[0040] In some examples, the first countdown is the same as or different from the second countdown.

[0041] In a possible implementation, the electronic device further includes a camera, and the first area is within the field of view (FOV) of the camera. In this way, the electronic device determines whether the user stays in the designated sub-area through the camera.

[0042] In one possible implementation, the first interface is a wallpaper interface. In this way, the electronic device displays the mural interface at the appropriate time based on the display state and switching conditions, meeting the user's need to view the mural interface while turning off the screen when not needed, saving power consumption of the electronic device.

[0043] In one possible implementation, the method further includes one or more of the following: in response to detecting that a user enters a first area, switching the unmanned state to an occupied non-staying state; in response to detecting that a user stares at the electronic device for a first period of time, switching the occupied non-staying state to an occupied and staying state; in response to detecting that the user leaves the first area for a third period of time, switching the occupied and staying state to an unmanned state.

[0044] In some examples, in response to switching the occupied non-stop state to the occupied and stopped state, the display screen is turned on and the first interface is displayed.

[0045] In one possible implementation, after the first interface is displayed on the display screen, if it is detected that the time when the user leaves the first area reaches a second time period, the display screen is switched from displaying the first interface to turning off the screen, specifically including: detecting that the time when the presence of a person and the stay state is switched to the unmanned state reaches a sixth time period, turning off the display screen, and the sixth time period is the difference between the second time period and the third time period.

[0046] In some examples, in response to detecting that there is someone and the duration of switching from the stay state to the unmanned state reaches a sixth duration, the display screen is turned off.

[0047] In one possible implementation, the method further includes one or more of the following: in response to a first input, setting the state to be occupied and staying; in response to detecting that the time duration for which the user has left the first area reaches a third time duration, switching the state to be occupied and staying to the state to be unoccupied.

[0048] In some examples, in response to being set to an occupied and staying state, the display screen is turned off.

[0049] In one possible implementation, the method further includes one or more of the following: in response to detecting that a period of no input has reached a fourth period, setting the state to an occupied, non-staying state; and in response to detecting that a user has left the first area for a seventh period, switching the occupied, non-staying state to an unoccupied state, wherein the seventh period is less than the fifth period.

[0050] In some examples, in response to setting the state to an occupied non-staying state, the first interface is displayed.

[0051] In one possible implementation, if it is detected that the time duration for which the user has left the first area reaches the fifth time duration, the display screen will be turned off, specifically including: detecting that the time duration for switching the occupied non-stop state to the unoccupied state reaches the sixth time duration, turning off the display screen, and the sixth time duration is the difference between the fifth time duration and the seventh time duration.

[0052] In one possible implementation, detecting that a user has been gazing at the electronic device for a first duration, lighting up the display screen and displaying a first interface on the display screen, specifically includes: capturing M frames of images via a camera for the first duration; detecting that the user has been gazing at the electronic device in the M frames of images, lighting up the display screen and displaying the first interface on the display screen. Thus, the electronic device determines whether the user is located in the first area based on the captured images.

[0053] In one possible implementation, upon detecting that a user has left the first area for a second duration, turning off the display screen may include: capturing N frames of images via a camera for the second duration; and detecting that the N frames of images do not include the user, turning off the display screen. Thus, the electronic device determines whether the user is located in the first area based on the captured images.

[0054] In a third aspect, the present application provides an electronic device comprising: a display screen, one or more processors and one or more memories, wherein the one or more memories are coupled to multiple processors, and the one or more memories are used to store executable programs. When the one or more processors execute the executable programs, the electronic device executes any possible implementation method as in the first aspect or the second aspect.

[0055] In a fourth aspect, the present application provides a readable storage medium that stores a program. When the program runs on a processor of an electronic device, the electronic device executes the method of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] FIG1 is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0057] FIG2 is a schematic diagram of a state switching provided in an embodiment of the present application;

[0058] 3A-3D are schematic diagrams of a group of designated areas provided in an embodiment of the present application;

[0059] FIG4 is a schematic diagram of a state switching process provided by an embodiment of the present application;

[0060] FIG5A is another state switching schematic diagram provided in an embodiment of the present application;

[0061] FIG5B is another schematic diagram of a flow chart provided in an embodiment of the present application;

[0062] FIG6 is a schematic diagram of a line of sight projection range provided in an embodiment of the present application;

[0063] FIG7 is a schematic diagram of a coordinate system provided in an embodiment of the present application;

[0064] 8A-8D are schematic diagrams of a set of sight projection ranges provided in an embodiment of the present application;

[0065] FIG9 is another schematic diagram of a flow chart provided in an embodiment of the present application;

[0066] Figures 10A-10C are a set of scenario diagrams provided in an embodiment of the present application;

[0067] FIG11 is another schematic diagram of a flow chart provided in an embodiment of the present application;

[0068] Figures 12A-12C are a set of scenario diagrams provided in an embodiment of the present application;

[0069] 13A-13B are another set of scenario schematic diagrams provided in an embodiment of the present application;

[0070] 14A-14B are another set of scenario schematic diagrams provided in an embodiment of the present application;

[0071] FIG15 is another schematic diagram of a scenario provided in an embodiment of the present application. DETAILED DESCRIPTION

[0072] The following is a clear and detailed description of the technical solutions in the embodiments of the present application, with reference to the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of "or." For example, A / B can represent A or B. "and / or" in the text is merely a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone.

[0073] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0074] First, the electronic device 100 provided in an embodiment of the present application is introduced.

[0075] The electronic device 100 may be an electronic device including a display screen. For example, the electronic device 100 may be a television, a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device, and / or a smart city device. In some examples, the electronic device 100 may also be a projection device, and the embodiments of the present application do not impose any particular restrictions on the specific type of the electronic device.

[0076] FIG1 shows a schematic diagram of the hardware structure of an electronic device 100 .

[0077] The electronic device 100 may include, but is not limited to, a processor 110 , a display screen 120 , an audio module 130 , a camera 140 , a communication module 150 , a memory 160 , a power module 170 , and the like.

[0078] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0079] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0080] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0081] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0082] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, etc. Among them, the HDMI interface is a fully digital video and sound transmission interface that can send uncompressed audio and video signals. In some embodiments, the electronic device 100 can establish a connection with a set-top box through the HDMI interface and obtain video and audio signals through the set-top box. Among them, the USB interface is an interface that complies with USB standard specifications, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface can be used to transmit data between the electronic device 100 and other electronic devices.

[0083] It will be understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above-mentioned embodiments, or a combination of multiple interface connection methods. It will be understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above-mentioned embodiments, or a combination of multiple interface connection methods.

[0084] Electronic device 100 implements display functionality through a GPU, display screen 120, and an application processor. The GPU is a microprocessor for image processing that connects display screen 120 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0085] The display screen 120 is used to display images, videos, and the like. The display screen 120 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, the electronic device 100 can include one or N display screens 120, where N is a positive integer greater than one.

[0086] The electronic device 100 may also include a pressure sensor, a touch sensor, and the like. The pressure sensor may be used to sense pressure signals and convert the pressure signals into electrical signals. In some examples, the pressure sensor may be provided on the display screen 120 to detect pressure signals generated when a user presses the display screen 120. The touch sensor is also referred to as a "touch panel". The touch sensor may be provided on the display screen 120, and the touch sensor and the display screen 120 form a touch screen, also referred to as a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor may transmit the detected touch operation to the application processor to determine the type of touch event. The electronic device 100 may provide visual output related to the touch operation through the display screen 120. In other embodiments, the touch sensor may also be provided on the surface of the electronic device 100, which is different from the position of the display screen 120.

[0087] The audio module 130 can be used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signals. The audio module 130 can also be used to encode and decode audio signals. In some embodiments, the audio module 130 can be set in the processor 110, or some functional modules of the audio module 130 can be set in the processor 110. The speaker 130A can be used to convert audio electrical signals into sound signals. The electronic device 100 can listen to the dubbing of video games, music, or listen to calls, etc. through the speaker 130A. The microphone 130B can be used to convert sound signals into electrical signals. The electronic device 100 can use the microphone 130B to collect sound signals, reduce noise, identify sound sources, record, and other functions.

[0088] The electronic device 100 can implement a shooting function through an ISP, a camera 140, a video codec, a GPU, a display 120, and an application processor. The ISP is used to process data fed back by the camera 140. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then transmitted to the ISP for processing and converted into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise and brightness. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 140.

[0089] The camera 140 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 140, where N is a positive integer greater than 1.

[0090] In the embodiment of the present application, the electronic device 100 can capture images captured by the camera 140. The images captured by the camera can be used by the electronic device 100 to determine whether the user is in a designated area and whether the user's line of sight projection range includes the electronic device 100. The images captured by the camera can also be used by the electronic device 100 to search for and display a mural interface that fits the current scene.

[0091] The communication module 150 can be used to transmit data between the electronic device 100 and other electronic devices. The communication module 150 can provide communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), infrared technology (IR), Bluetooth (BT), frequency modulation (FM), and near field communication (NFC) for application on the electronic device 100. Among them, the Bluetooth communication solution can include one or more of classic Bluetooth (basic rate / enhanced data rate, BR / EDR) or Bluetooth low energy (BLE).

[0092] In an embodiment of the present application, the electronic device 100 can receive a control signal from the remote control device 200 through the communication module 150. The processor 110 can perform operations such as switching channels, adjusting the volume, turning off the screen, and turning on the screen based on the control signal. For example, the control signal sent by the remote control device 200 can be an infrared signal, a Bluetooth signal, and the like. For example, the remote control device 200 may include a power button, a return button, and the like. The power button can be used to trigger the remote control device 200 to notify the electronic device 100 to turn off or turn on the screen. The remote control device 200 can be a remote controller. In this way, the electronic device 100 can process the control signal sent by the remote control device 200 and feed back the processing result to the user through the display screen 120. The user can control the content displayed by the electronic device 100 through the remote control device 200.

[0093] In some examples, the electronic device 100 may display a cursor, which may be used to prompt the user to point the remote control device 200 at an icon displayed on the electronic device 100. The remote control device 200 may be used to receive input from the user moving the remote control device 200 and send a control signal to the electronic device 100. The control signal may be used to control the movement of the cursor on the display screen of the electronic device 100. In this way, the user can move the cursor displayed on the electronic device 100 by moving the remote control device 200 to select a corresponding icon.

[0094] Alternatively, the remote control device 200 may include a touchpad that can be used to receive a user's touch input and generate a control signal based on the user's finger touch action. The control signal can be used to control the cursor to move on the display screen of the electronic device 100. In this way, the cursor of the electronic device 100 can move as the user moves on the touchpad of the remote control device 200. The user can control the cursor displayed on the electronic device 100 through the remote control device 200.

[0095] It should be noted that the remote control device 200 is not limited to a remote control and may also be an electronic device such as a mobile phone or tablet. The remote control device 200 may be installed with a remote control application, which can display controls corresponding to the function keys of the remote control device 200 on the touch screen of the remote control device 200. The user can control the functions of the electronic device 100 using the controls provided by the remote control application.

[0096] The memory 160 may be used to store various software programs and / or multiple sets of instructions. The processor 110 may implement application functions provided by the electronic device 100 by running the software programs and / or multiple sets of instructions stored in the memory 160. In a specific implementation, the memory 160 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.

[0097] The power module 170 can be used to receive power input and supply power to various components of the electronic device 100 .

[0098] In some examples, the electronic device may further include an ambient light sensor, which may be used to sense ambient light intensity.

[0099] In some examples, the electronic device 100 may further include one or more buttons, which may include but are not limited to a power button, a volume button, etc.

[0100] In some examples, the electronic device 100 may further include one or more ambient lights. When displaying the mural interface, the electronic device 100 may illuminate the one or more ambient lights and control the brightness, color temperature, and other characteristics of the one or more ambient lights. This allows the user to enjoy a better viewing experience of the mural interface.

[0101] In one possible implementation, the electronic device 100 turns off the screen. If the electronic device 100 detects that the user has entered a designated area, the screen turns on and displays the mural interface. If the electronic device 100 detects that the user has left the designated area and the duration of absence from the designated area has reached a preset departure time, the screen turns off. In this way, the electronic device 100 can display the mural interface when it detects that the user has stopped in front of the electronic device 100. The electronic device 100 can also turn off the screen after detecting that the user has left, achieving the effect of the screen turning on when the user is present and turning off when the user leaves.

[0102] In order to better describe the display method provided in the embodiment of the present application. First, the type of user interface displayed by the electronic device 100 in the embodiment of the present application is introduced. Among them, after the screen of the electronic device 100 is turned off, the display screen of the electronic device 100 is in the off state and does not display any interface. After the screen of the electronic device 100 is turned on, the electronic device 100 can display the user interface through the display screen. Among them, the user interface may include but is not limited to a non-task interface, a task interface, and a mural interface.

[0103] The task interface can be used to play multimedia files (e.g., video, audio, etc.). For example, the task interface can include but is not limited to a video playback interface, a music playback interface, a game interface, etc. Users can watch videos, listen to audio, and participate in games through the task interface.

[0104] Among them, the mural interface can be used to display images such as paintings and photos. When the electronic device 100 displays the mural interface, the electronic device 100 can be in a standby state. The mural interface can also be called wallpaper, screen saver, etc.

[0105] Among them, for the sake of convenience of explanation, the interfaces other than the task interface and the mural interface can be referred to as "non-task interfaces". For example, the non-task interface may include but is not limited to the desktop (also known as the main interface), the setting interface, the channel selection interface, etc. Exemplarily, the non-task interface may include one or more function controls, and the one or more function controls may include but are not limited to setting controls, application controls and / or video preview controls, etc. For example, the setting control can be used to adjust the signal source of the electronic device 100, adjust the screen brightness of the electronic device 100, pause the video, adjust the playback progress of the video, adjust the playback speed of the video, etc. The application control can be used to trigger the electronic device 100 to display the interface of the application. For example, the application control may include a video application control, a music application control, a game application control, etc. Among them, the video application control can be used to trigger the electronic device 100 to display the main interface of the video application. Among them, the video preview control can be used to trigger the electronic device 100 to play the video corresponding to the video preview control.

[0106] It should be noted that when the electronic device 100 displays the mural interface, the electronic device 100 may display the main interface in response to the control signal after receiving the control signal for displaying the main interface sent by the remote control device 200. For example, the remote control device 200 may send the control signal to the electronic device 100 after receiving the user's input for the power button (such as a press input). Similarly, when the electronic device 100 displays the task interface, the electronic device 100 may display the non-task interface in response to the control information after receiving the control signal for exiting the task interface sent by the remote control device 200. For example, the remote control device 200 may send the control signal to the electronic device 100 after receiving the user's input for the return button (such as a press input).

[0107] In some examples, the electronic device 100 can set two states for a designated area, including an unoccupied state and an occupied state. When the electronic device 100 sets the designated area to an unoccupied state and the screen is off, upon detecting a user entering the designated area, the electronic device 100 can switch the designated area's state from unoccupied to occupied, simultaneously lighting up the screen and displaying the mural interface. When the electronic device 100 sets the designated area to an occupied state and the mural interface is displayed, upon detecting a user leaving the designated area and the duration of absence from the designated area reaches a preset absence time, the electronic device 100 can switch the designated area's state from occupied to unoccupied and turn off the screen. The designated area can be any area that the electronic device 100 can detect. For example, the designated area can be located in front of the display screen of the electronic device 100, for example, directly in front of or diagonally in front of the display screen of the electronic device 100. In this way, the electronic device 100 can not only display the mural interface when detecting a user in the designated area, improving the aesthetics of the scene, but also turn off the screen after detecting the user leaving the designated area, saving power consumption of the electronic device 100.

[0108] It should be noted that the description of setting the status of the designated area in the embodiment of the present application is only an example. The electronic device 100 does not need to set the status of the designated area. It only needs to detect whether the user enters the designated area and whether the user has left the designated area for a preset departure time. The screen can be turned off or the mural interface can be displayed based on the detection result. The embodiment of the present application does not limit this.

[0109] An embodiment of the present application provides a display method. The electronic device 100 turns off the screen. After the electronic device 100 detects that the user enters a designated area, detects that the user enters the designated area and the length of time the user stays in a designated sub-area of ​​the designated area reaches a preset stay time (for example, 5 seconds), the electronic device 100 turns on the screen and displays a mural interface. The electronic device 100 displays the wallpaper interface. After the electronic device 100 detects that the user leaves the designated area and the length of time the user has left the designated area reaches a preset leave time, the electronic device 100 turns off the screen. The designated area can be located in front of the display screen of the electronic device 100. In this way, when the user is going to the destination, the user tends to rush to the destination during this process and does not pay attention to whether the electronic device 100 displays the mural interface. Therefore, after the electronic device 100 detects that the user appears in the designated area, since the length of time the user stays in the designated sub-area does not reach the preset stay time, the electronic device 100 remains in the off state until the electronic device 100 determines that the user has stayed in the designated sub-area for a period of time, and then displays the mural interface. This avoids the electronic device 100 frequently lighting up the screen when the user passes by, interfering with the user's actions, and saves power consumption of the electronic device 100.

[0110] It should be noted that when the electronic device 100 remains off, it detects that a user has entered a designated area. If the electronic device 100 detects that the user has remained in the designated area for a preset duration and in a designated sub-area for a preset duration, the electronic device 100 switches the display screen from off to on and displays the mural interface on the display screen. If the electronic device 100 detects that the user has remained in the designated area for a preset duration but has not remained in a designated sub-area for a preset duration, the electronic device 100 remains off.

[0111] Exemplarily, the electronic device 100 can set three states for the designated area, including an unmanned state, a occupied non-stop state, and an occupied and stopped state. Alternatively, the electronic device 100 can also set these three states for the user, which is not limited in the embodiments of the present application. The electronic device 100 can determine whether to display the mural interface based on the state of the designated area after the interface displayed by the electronic device 100 is switched. In some examples, the electronic device 100 can implement the state switching operation of the electronic device 100 on the designated area by setting a finite state machine.

[0112] In some examples, the electronic device 100 can switch between the three states through steps 1 to 4 shown in FIG2 . The specific switching process is as follows:

[0113] 1. If the electronic device 100 sets the designated area to be in an unmanned state. When the electronic device 100 detects that a user enters the designated area, the state of the designated area is switched from the unmanned state to the occupied non-stop state.

[0114] 2. If the electronic device 100 sets the designated area to the occupied, non-stop state. When the electronic device 100 detects that the user has stayed in the designated sub-area for a preset duration 21 (e.g., 5 seconds), the designated area can be set to switch from the occupied, non-stop state to the occupied, stop state. The designated area includes the designated sub-area.

[0115] 3. If the electronic device 100 sets the designated area to be in the occupied non-staying state: When the electronic device 100 detects that the user has left the designated area for a preset time period 22, the designated area can be set to switch from the occupied non-staying state to the unoccupied state.

[0116] 4. If the electronic device 100 sets the designated area to be in the occupied and staying state: When the electronic device 100 detects that the user moves in the designated area, the designated area can be set to switch from the occupied and staying state to the occupied non-staying state.

[0117] The movement of the user in the designated area may be understood as the user leaving a designated sub-area in the designated area.

[0118] In some examples, the designated sub-area is the same as the designated area. The electronic device 100 detecting that the user is staying in the designated sub-area can be interpreted as the electronic device 100 detecting that the user is within the designated area. Thus, upon detecting that the user is staying in the designated sub-area, the electronic device 100 can display a mural interface to the user, thereby enhancing the aesthetics of the space.

[0119] In other examples, the designated sub-area is smaller than the designated area and all or part of the designated sub-area belongs to the designated area. Among them, the electronic device 100 detecting that the user is staying in the designated sub-area can be that the electronic device 100 detects that the user is staying in the designated area and staying in the designated sub-area. For example, the designated sub-area may include an area whose center is the user's position at the starting time of the preset stay duration and whose radius is a preset radius (for example, 0.3 meters, 0.5 meters, etc.). Among them, the electronic device 100 detecting that the user is moving in the designated area can be understood as the electronic device 100 detecting that the user has left the designated sub-area, and the electronic device 100 detecting that the user has not left the designated area. In this way, when the electronic device 100 detects that the user has not stayed in the designated sub-area and walks in the designated area (for example, the user sweeps or mops the floor in the designated area), the electronic device 100 can remain in the off state. When the electronic device 100 detects that the user is staying in the designated sub-area (for example, the user sits quietly in the designated sub-area, etc.), the electronic device 100 can display the mural interface. This avoids the situation where the user is doing housework in the designated area and prefers the electronic device 100 to keep the screen off while the electronic device 100 displays the mural interface, thereby saving power consumption of the electronic device 100.

[0120] Among them, when the electronic device 100 turns off the screen and sets the status of the designated area to an unmanned state, the screen can be turned on and the mural interface can be displayed after the status of the designated area is switched from an unmanned state to an occupied and stopped state through steps 1 and 2. When the electronic device 100 displays the mural interface and sets the status of the designated area to an occupied and stopped state, the screen can be turned off after the status of the designated area is switched from an occupied and stopped state to an unmanned state through steps 4 and 3. In this way, by setting the occupied non-stop state of the designated area, the electronic device 100 switches to an occupied and stopped state after confirming that the user has stayed in front of the electronic device 100 for a period of time, and then turns on the screen and displays the mural interface, thereby avoiding the situation where the screen is frequently turned on and off.

[0121] In one possible implementation, after the designated area of ​​the electronic device 100 displaying the mural interface switches to an unoccupied state, the electronic device 100 may turn off the screen after detecting that the designated area has been unoccupied for a predetermined duration. This allows the electronic device 100 to maintain the mural interface display after switching to an unoccupied state, allowing the user to temporarily leave the designated area and continue to enjoy the mural interface after returning to the designated area.

[0122] In one possible implementation, the electronic device 100 displays a non-task interface. If the electronic device 100 detects that no user input is received within a preset response time, the electronic device 100 may display a mural interface and set the state of the designated area to a non-resident state.

[0123] In one possible implementation, the electronic device 100 displays a user interface. After receiving the screen-off input from the user, the electronic device 100 can respond to the input by turning off the screen and setting the status of the designated area to an occupied and stopped state. At this time, it can be considered that the user wants to turn off the screen and has no intention of turning on the electronic device's screen and displaying the mural interface. That is, although the status of the designated area is an occupied and stopped state, the electronic device 100 will not turn on the screen and display the mural interface. In this way, when the electronic device 100 receives the screen-off input, even if the user may still be staying in the designated sub-area, the electronic device 100 will not turn on the screen again and display the mural interface.

[0124] In other examples, the electronic device 100 can switch between the three states through steps 1, 2, 3, and 5 shown in FIG2 , wherein the descriptions of steps 1 to 3 can refer to the above embodiment and are not repeated here. The following is step 5:

[0125] 5. If the electronic device 100 sets the designated area to the occupied and stayed state, when the electronic device 100 detects that the user has been away from the designated area for a predetermined time period 23, the designated area can be switched from the occupied and stayed state to the unoccupied state. The predetermined time period 23 and the predetermined time period 22 can be the same or different.

[0126] Among them, when the electronic device 100 turns off the screen and sets the status of the designated area to an unmanned state, the screen can be turned on and the mural interface can be displayed after the status of the designated area is switched from an unmanned state to an occupied and stayed state through steps 1 and 2. When the electronic device 100 displays the mural interface and sets the status of the designated area to an occupied and stayed state, the screen can be turned off after the status of the designated area is switched from an occupied and stayed state to an unmanned state through step 5. Among them, the description of the electronic device 100 detecting that the user is staying in the designated sub-area can be found in the above embodiment and will not be repeated here. In this way, when the status of the electronic device 100 in the designated area is an occupied and stayed state, after the user leaves the designated area, there is no need to first switch the status of the designated area to an occupied non-staying state and then switch to an unmanned state, thereby reducing unnecessary state switching.

[0127] In one possible implementation, the electronic device 100 displays a user interface and, after receiving a screen-off input from the user, the electronic device 100 may, in response to the input, turn off the screen and set the state of the designated area to a occupied and stationary state.

[0128] In this way, after the electronic device 100 turns off the screen, it may still detect that the user is in the designated area of ​​the electronic device 100. Therefore, the electronic device 100 can set the status of the designated area to the occupied and stayed state after receiving the screen-off input. Since the user controls the electronic device 100 to turn off the screen, it indicates that the user tends to control the electronic device 100 to turn off the screen rather than turn on the screen to display the mural interface. Although the electronic device 100 sets the status of the designated area to the occupied and stayed state, the electronic device 100 will remain off until the electronic device 100 detects that the user has left the designated area for a preset time length of 23. After switching the status of the designated area to the unoccupied state, the status of the designated area is switched from the unoccupied state to the occupied and stayed state again, and the electronic device 100 can then display the mural interface. Furthermore, the state of the designated area of ​​the electronic device 100 cannot be switched from an occupied and staying state to an occupied non-staying state. This can also prevent the user from moving within the designated area (for example, changing location within the designated area, going to the designated area to get water and then returning to the designated area for a short period of time), and then the electronic device 100 switches the state of the designated area from an occupied and staying state to an occupied non-staying state, and then from an occupied non-staying state to an occupied and staying state, and then lights up the screen again and displays the mural interface after switching the state of the designated area to an occupied and staying state, which is in line with the user's desire for the electronic device 100 to keep the screen off.

[0129] It should be noted that in the following embodiments of the present application, after the electronic device 100 sets the designated area to the occupied and staying state, the electronic device 100 switches the state of the designated area from the occupied and staying state to the unoccupied state after detecting that the user has left the designated area for a preset time period of 23. In other words, the electronic device 100 does not execute step 4. In this way, the electronic device 100 can reduce the number of switching times, and when the electronic device 100 receives the screen-off input, the electronic device 100 will not turn on the screen again if the user is still within the designated area.

[0130] In one possible implementation, the electronic device 100 displays a non-task interface. If the electronic device 100 does not receive user input within a preset response time, the electronic device 100 may display a mural interface and set the status of the designated area to an occupied, non-stop state. Thus, if the electronic device 100 detects that the user has not operated the electronic device 100 within the preset response time, the electronic device 100 may display a mural interface, displaying paintings or photos, and enhancing the aesthetics of the space where the electronic device 100 is located. The electronic device 100 sets the status of the designated area to an occupied, non-stop state. If the user remains in a designated sub-area of ​​the electronic device 100 for a preset duration of 21 seconds, the electronic device 100 sets the status of the designated area to an occupied and stopped state. In this case, even when the user is not operating the electronic device 100, the electronic device 100 displays the mural interface, providing the user with a better viewing experience. For example, a user can view the mural interface displayed on the electronic device 100 when it is inconvenient to operate the electronic device 100 while on a call with a contact, allowing the user to enjoy the mural interface during the call. If the electronic device 100 detects that the user has left the designated area for a preset time period of 22, the electronic device 100 may switch the state of the designated area to an unmanned state and then perform a screen-off operation to save power consumption of the electronic device 100.

[0131] Next, an exemplary description of the designated area in the embodiments of the present application is provided. The designated area can be any area that can be detected by the electronic device 100. For example, the designated area can be in front of the display screen of the electronic device 100. In this way, a user standing in the designated area can view the content displayed on the display screen of the electronic device 100.

[0132] In some examples, the electronic device 100 can detect whether the user is in a designated area and whether the user's stay in the designated sub-area reaches a preset time length 21 through a camera, an infrared sensor, Wi-Fi human sensing technology, Wi-Fi fingerprint positioning technology, etc. The embodiments of the present application are not limited to this.

[0133] The embodiments of the present application are described by taking the detection of the state of a specified area through an image captured by a camera as an example. In the following embodiments, the camera of the electronic device 100 and the display screen of the electronic device 100 are facing the same direction. The specified area can be the field of view (FOV) area of ​​the camera of the electronic device 100. Among them, the electronic device 100 can capture an image in front of the screen of the electronic device 100 through the camera at a preset interval (for example, 2s), and determine the state of the specified area based on the image captured by the camera. The image captured by the camera can be used to indicate whether the user is in the specified area. Among them, the specified area is a position within the field of view of the camera of the electronic device 100. The image captured by the camera can also be used to indicate whether the user remains still in the specified area.

[0134] Exemplarily, the electronic device 100 may use an image recognition algorithm to identify whether the image captured by the camera includes the user. When the electronic device 100 determines, based on the image captured by the camera, that the image area corresponding to the specified area in the image captured by the camera includes the user, it is determined that the user is located in the specified area. When the electronic device 100 determines, based on the image captured by the camera, that the image area corresponding to the specified area in the image captured by the camera does not include the user, it is determined that the user has left the specified area. The image area corresponding to the specified area may be an area including all or part of the content of the image. The embodiment of the present application is described by taking the example that the image area corresponding to the specified area includes the entire content of the image captured by the camera.

[0135] It can be understood that the electronic device 100 detects that the user stays in the designated area and the length of time the user stays in the designated sub-area reaches the preset duration 21, which includes that the electronic device 100 captures X frames of images through the camera within the preset duration 21, and the electronic device 100 detects that the X frames of images include the user, and that the user is located in the designated sub-area in the X frames of images, wherein the preset duration 21 is equal to the product of X and the preset interval duration, and X is a positive integer.

[0136] The electronic device 100 detecting that the user has left the designated area for a duration of time exceeding the preset duration 22 includes the electronic device 100 capturing Y frames of images via the camera during the preset duration 22, and the electronic device 100 detecting that none of the Y frames of images include the user, wherein the preset duration 22 is equal to the product of Y and the preset interval duration, where Y is a positive integer. Similarly, the electronic device 100 detecting that the user has left the designated area for a duration of time exceeding the preset duration 23 includes the electronic device 100 capturing Z frames of images via the camera during the preset duration 23, and the electronic device 100 detecting that none of the Z frames of images include the user, wherein the preset duration 23 is equal to the product of Z and the preset interval duration, where Z is a positive integer.

[0137] Among them, the image area corresponding to the designated sub-area can be an area with the user's position at the starting time point of the preset duration 21 in the camera's field of view area as the central axis, and the area is horizontally extended to the field of view area by a preset length. For example, the image obtained by the electronic device 100 through the camera is shown in Figure 3A, the image area corresponding to the designated area can be the area shown in Figure 3A, and the image area corresponding to the designated sub-area can be the area 301 obtained by horizontally extending the preset length with the user as the center in Figure 3A. For another example, the image obtained by the electronic device 100 through the camera is shown in Figure 3B, the image area corresponding to the designated area can be the area shown in Figure 3B, and the image area corresponding to the designated sub-area can be the area 302 obtained by horizontally extending the preset length with the user as the center in Figure 3B. It can be understood that the size of the horizontally extended preset length can change with the position of the user in the image area corresponding to the designated area. Exemplarily, the electronic device 100 can determine the preset length of horizontal expansion based on the width of the user in the captured image, thereby determining that the closer the user is to the electronic device 100, the longer the width occupied by the user in the image captured by the electronic device 100, the length of the image area corresponding to the designated sub-area also increases accordingly, and the area occupied by the image area corresponding to the designated sub-area in the image captured by the electronic device 100 also increases accordingly. As shown in Figure 3A, the width of the user is width 1, and the width of the image area corresponding to the designated sub-area is width 2. As shown in Figure 3B, the width of the user is width 3, and the width of the image area corresponding to the designated sub-area is width 4. Among them, the value of width 3 is greater than the value of width 1, and the value of width 4 is greater than the value of width 2. It should be noted that determining the width of the image area corresponding to the designated sub-area according to the width of the user and then determining the image area corresponding to the designated sub-area is only an example. The electronic device 100 can also determine the image area corresponding to the designated sub-area in other ways, and the embodiments of the present application are not limited to this.

[0138] It should also be noted that the electronic device 100 can also determine the designated sub-area where the user is located and judge whether the user has left the designated sub-area based on the image obtained by the camera through an image processing algorithm. This embodiment of the present application is not limited to this.

[0139] In some examples, if the electronic device 100 detects that the user is at the edge of a designated area while the camera orientation remains unchanged, as shown in FIG3C , the designated sub-area should be area 303. However, since the camera of the electronic device 100 cannot capture images beyond the designated area, the designated sub-area in this case may be the intersection of area 303 and the designated area.

[0140] Optionally, the electronic device 100 detects that the user is at the edge of the designated area, as shown in FIG3C . The electronic device 100 can control the camera to rotate toward the direction where the user is located, and determine that the designated sub-area is area 304 shown in FIG3D . After detecting that the user has left area 304, the electronic device 100 can return the camera to its position and detect the positional relationship between the user and the designated area again. When the electronic device 100 detects that the user is at the edge of the designated area, the camera can be rotated toward the direction of the user again to determine the designated sub-area. When the electronic device 100 detects that the user is in the middle of the designated area, the angle of the camera can be maintained to determine the designated sub-area. When the electronic device 100 detects that the user has left the designated area, the electronic device 100 can detect whether the user has entered the designated area at preset intervals.

[0141] Illustratively, after the electronic device 100 determines that the user is located in the designated area, it may also determine, based on images captured by the camera, whether the duration of the user's stay in the designated sub-area has reached a preset duration 21. For example, after the electronic device 100 determines the designated sub-area at the starting time point of the preset duration 21, if the user is located in the designated sub-area in all images captured within the preset duration 21, the electronic device 100 determines that the user's stay in the designated sub-area has reached the preset duration 21. If the electronic device 100 captures a frame of image showing the user outside the designated sub-area within the preset duration 21 after the starting time point, the electronic device 100 may determine that the user's stay in the designated sub-area has not reached the preset duration 21. After determining that the user's stay in the designated sub-area has not reached the preset duration 21, the electronic device 100 may again detect whether the user's stay in the designated sub-area has reached the preset duration 21.

[0142] In some examples, the electronic device 100 can use indoor positioning technology, such as wireless fidelity (Wi-Fi) fingerprint positioning technology, Wi-Fi human body sensing technology, etc., to determine whether a portable electronic device (e.g., a mobile phone, a smartwatch, etc.) is located in the room where the electronic device 100 is located, thereby determining whether the user carrying the portable electronic device is located in the room where the electronic device 100 is located. Only when the electronic device 100 determines that the portable electronic device is located in the room where the electronic device 100 is located does it perform the operations of determining whether the user is located in a designated area based on images captured by the camera and detecting whether the user has stayed in the designated sub-area for a preset duration 21. Optionally, when the electronic device 100 determines that the portable electronic device is located in the room where the electronic device 100 is located, the electronic device 100 can also set the designated area to a non-resident state. In this way, the electronic device 100 only captures images captured by the camera through the camera when it determines that the user is in the same room as the electronic device 100, and determines the state of the designated area based on the images captured by the camera, thereby saving power consumption of the electronic device 100.

[0143] In some examples, the electronic device 100 preset duration 21 is less than the preset duration 22, and the preset duration 21 is less than the preset duration 23. In this way, the electronic device 100 can keep displaying the mural interface as long as possible after displaying the mural interface, reducing the number of times the screen turns off and on.

[0144] Next, a flowchart of the display method provided in an embodiment of the present application is introduced.

[0145] For example, as shown in FIG4 , the process of switching the state and display content of the designated area by the electronic device 100 is as follows:

[0146] 1. The electronic device 100 sets the designated area to an unmanned state, and the electronic device 100 displays the mural interface.

[0147] The designated area set by the electronic device 100 is in an unmanned state, and the electronic device 100 displays the mural interface. When the electronic device 100 detects that a user enters the designated area, it can execute step 2, that is, switch the state of the designated area from an unmanned state to a occupied non-stop state, and keep displaying the mural interface.

[0148] The designated area set by the electronic device 100 is in an unmanned state, and the electronic device 100 displays the mural interface. After detecting that the designated area has been unmanned for a predetermined switching time, the electronic device 100 may execute step 4, i.e., keep the designated area in an unmanned state and turn off the screen.

[0149] In some examples, the electronic device 100 can set a screen-off countdown after switching to an unmanned state. The total duration of the screen-off countdown is the preset switching duration. Before the countdown of the electronic device 100 ends, if the electronic device 100 detects that someone has entered the designated area, the state of the designated area is switched to a non-stop state with someone, and the screen-off countdown is interrupted, and the electronic device 100 continues to display the mural interface. If the electronic device 100 does not detect that someone has entered the designated area before the countdown ends, the electronic device 100 turns off the screen at the end of the countdown. It is understandable that when the countdown value becomes zero, the countdown can be considered to be over.

[0150] In some examples, the electronic device 100 may also display a screen-off countdown on the mural interface. Before the screen-off countdown ends, if the electronic device 100 detects that the designated area remains unoccupied, the electronic device 100 may turn off the screen at the end of the screen-off countdown. Before the screen-off countdown ends, if the electronic device 100 detects that a user has entered the designated area, the electronic device 100 may cancel the display of the screen-off countdown. In some examples, the electronic device 100 may display a pop-up window including the screen-off countdown on the mural interface. In this way, the electronic device 100 can display a screen-off countdown to indicate the time when the electronic device 100 turns off the screen.

[0151] In some examples, the electronic device 100 may set a screen-off countdown 1 when switching from a occupied non-stop state to an unmanned state, and set a screen-off countdown 2 when switching from a occupied and stop state to an unmanned state. The screen-off countdown 1 and the screen-off countdown 2 may be the same or different.

[0152] The designated area set by the electronic device 100 is in an unmanned state, and the electronic device 100 displays the mural interface. After receiving the screen-off input, the electronic device 100 can execute step 6, that is, switch the state of the designated area from an unmanned state to a occupied and stopped state, and turn off the screen.

[0153] 2. The electronic device 100 sets the designated area to a state where people are not staying, and the electronic device 100 displays the mural interface.

[0154] The designated area set by the electronic device 100 is in the occupied non-staying state, and the electronic device 100 displays the mural interface. When the electronic device 100 detects that the user has stayed in the designated sub-area for a preset duration 21, it can execute step 3, that is, switch the state of the designated area from the occupied non-staying state to the occupied and staying state, while maintaining the display of the mural interface.

[0155] The designated area set by the electronic device 100 is in the occupied non-staying state, and the electronic device 100 displays the mural interface. When the electronic device 100 detects that the user has been away from the designated area for a preset time period 22, it can execute step 1, that is, switch the state of the designated area from the occupied non-staying state to the unoccupied state, while maintaining the display of the mural interface.

[0156] The designated area set by the electronic device 100 is in the state of people not staying, and the electronic device 100 displays the mural interface. After receiving the screen-off input, the electronic device 100 can execute step 6, that is, switch the state of the designated area from the state of people not staying to the state of people staying, and turn off the screen.

[0157] 3. The electronic device 100 sets the designated area to a state where people are present and staying, and the electronic device 100 displays the mural interface.

[0158] The designated area set by the electronic device 100 is in the occupied and staying state, and the electronic device 100 displays the mural interface. When the electronic device 100 detects that the user has left the designated area for a preset time period 23, it can execute step 1, that is, switch the state of the designated area from the occupied and staying state to the unoccupied state, while maintaining the display of the mural interface.

[0159] The designated area set by the electronic device 100 is in the state of being occupied and staying, and the electronic device 100 displays the mural interface. After receiving the screen-off input, the electronic device 100 may execute step 6, that is, keep the state of the designated area in the state of being occupied and staying, and turn off the screen.

[0160] 4. The electronic device 100 sets the designated area to an unmanned state, and the screen of the electronic device 100 is turned off.

[0161] The designated area set by the electronic device 100 is in an unmanned state, and the screen of the electronic device 100 is turned off. When the electronic device 100 detects that the user enters the designated area, it can execute step 5, that is, switch the state of the designated area from an unmanned state to a occupied non-stop state, and keep the screen off.

[0162] 5. The electronic device 100 sets the designated area to a state where people are not staying, and the screen of the electronic device 100 is turned off.

[0163] The designated area set by the electronic device 100 is in the occupied non-stop state, and the screen of the electronic device 100 is turned off. When the electronic device 100 detects that the user has stayed in the designated sub-area for a preset time period 21, it can execute step 3, that is, switch the state of the designated area from the occupied non-stop state to the occupied and stopped state, and display the mural interface.

[0164] It should be noted that when the electronic device 100 sets the designated area to the occupied non-staying state, the electronic device 100 may detect that the user has stayed in the designated area for a preset time period of 21 and in the designated sub-area for a preset time period of 21. If the electronic device 100 detects that the user has stayed in the designated area for the preset time period of 21 but has not stayed in the designated sub-area for the preset time period of 21, the electronic device 100 maintains the designated area in the occupied non-staying state and keeps the screen of the electronic device 100 off.

[0165] The designated area set by the electronic device 100 is in the occupied non-stop state, and the screen of the electronic device 100 is turned off. When the electronic device 100 detects that the user has left the designated area for a preset time period of 22, it can execute step 4, that is, switch the state of the designated area from the occupied non-stop state to the unoccupied state, and keep the screen off.

[0166] 6. The electronic device 100 sets the designated area to a state where someone is staying, and the screen of the electronic device 100 is turned off.

[0167] The designated area set by the electronic device 100 is in the occupied and staying state, and the screen of the electronic device 100 is turned off. When the electronic device 100 detects that the user has left the designated area for a preset time period of 23, it can execute step 4, that is, switch the state of the designated area from the occupied and staying state to the unoccupied state, and keep the screen off.

[0168] 7. The electronic device 100 displays a non-task interface.

[0169] The electronic device 100 displays a non-task interface. The electronic device 100 detects that no user input is received within a preset response time, sets the state of the designated area to a non-staying state, and switches to displaying a mural interface.

[0170] The electronic device 100 displays a non-task interface. After receiving the screen-off input, the electronic device 100 may execute step 6, that is, keep the state of the designated area in a occupied and stationary state, and turn off the screen.

[0171] 8. The electronic device 100 displays the task interface.

[0172] The electronic device 100 displays the task interface. After receiving the screen-off input, the electronic device 100 may execute step 6, that is, keep the state of the designated area in a occupied and stationary state, and turn off the screen.

[0173] In summary, the state switching process and the display content switching process of the designated area of ​​the electronic device 100 are shown in Table 1 below:

[0174] Table 1: Table of changes in designated area status and display status of electronic device 100

[0175] As shown in Table 1, when the electronic device 100 is in different initial display states and the initial state of the specified area, if it determines that the switching conditions shown in Table 1 are met, it can switch to the switched display state and the switched state of the specified area shown in Table 1.

[0176] In this way, the electronic device 100 can display the mural interface at the appropriate time according to the status of the displayed interface and the designated area after switching. The mural interface displayed by the electronic device 100 can be used to decorate the room, making the entire space more beautiful and harmonious. The electronic device 100 can also turn off the screen at the appropriate time according to the change of the status of the designated area to save power consumption of the electronic device 100.

[0177] In one possible implementation, the electronic device 100 may no longer perform the operation of switching the state of the designated area from the unmanned state to the unmanned state after switching the state of the designated area from the unmanned state or the unmanned state within a specified time period (e.g., midnight to six o'clock). When the electronic device 100 displays the mural interface and the state of the designated area is switched to the unmanned state, the electronic device 100 may also perform the screen-off operation after the duration of switching the state of the designated area to the unmanned state reaches a preset switching duration (e.g., 10s). The operation of the electronic device 100 no longer performing the operation of switching the state of the designated area from the unmanned state to the unmanned state may be that the electronic device 100 stops detecting whether there is a user in the designated area, or that the electronic device 100 stops performing the operation of displaying the mural interface in response to the state change of the designated area when the initial display state of the electronic device 100 is the screen-off state. In this way, after the electronic device 100 turns off the screen within the specified time period, the display screen will remain in the screen-off state and will not display the mural interface. Since users tend to rest within a specified time period, the electronic device 100 stops switching the display state of the electronic device 100 from off-screen to displaying the mural interface within the specified time period to avoid disturbing the user's nighttime rest. Optionally, the electronic device 100 can provide the user with the function of setting a specified time period. In this way, the user can set the specified time period by himself. In this way, the electronic device 100 can display the mural interface only when appropriate and keep the screen off at other times, which can not only decorate the room where the electronic device 100 is located, but also save the power consumption of the electronic device 100.

[0178] It should be noted that the description of setting the status of the specified area in the embodiment of the present application is only an example. The electronic device 100 may not need to set the status of the specified area, and may also implement the operation of turning off the screen or displaying the mural interface as shown in Figure 4. The embodiment of the present application does not limit this.

[0179] In one possible implementation, when the screen of the electronic device 100 is in the off state, the electronic device 100 can light up the screen and display the mural interface when it detects that the user is looking at the electronic device 100. When the screen of the electronic device 100 displays the mural interface, the electronic device 100 can turn off the screen when it detects that the user is not looking at the electronic device 100. In this way, the electronic device 100 can display the mural interface only when it detects that the user is looking at the electronic device 100 (that is, the user's line of sight falls on the display screen of the electronic device 100). The electronic device 100 can keep the screen in the off state when it detects that the user is not looking at the electronic device 100 (that is, the user's line of sight does not fall on the display screen of the electronic device 100), thereby saving power consumption of the electronic device 100. Moreover, by displaying the mural interface only when the user is looking at the electronic device 100, it can also avoid the situation where the electronic device 100 displays the mural interface when the user lowers his head, thereby disturbing the user.

[0180] For example, the electronic device 100 may determine the user's visual range (also referred to as the user's visual range or visual projection range) based on the image captured by the camera. The electronic device 100 may determine that the user is looking at the electronic device 100 when it is detected that the user's visual range includes the electronic device 100. The electronic device 100 may determine that the user is not looking at the electronic device 100 when it is detected that the user's visual range does not include the electronic device 100.

[0181] In some examples, the electronic device 100 can set two states for the user, which include a gaze state and a non-gaze state. When the electronic device 100 sets the user to the non-gaze state and the electronic device 100 turns off the screen, the electronic device 100 can switch the user's state from the non-gaze state to the gaze state when it detects that the user is looking at the electronic device 100, and at the same time turn on the screen of the electronic device 100 and display the mural interface. When the electronic device 100 sets the user to the gaze state and the electronic device 100 displays the mural interface, the electronic device 100 can switch the user's state from the gaze state to the non-gaze state and turn off the screen when it detects that the user is not looking at the electronic device 100. In this way, the electronic device 100 can not only display the mural interface when it detects that the user is looking at the electronic device 100, thereby improving the aesthetics of the scene, but can also turn off the screen after detecting that the user is not looking at the electronic device 100, thereby saving power consumption of the electronic device 100.

[0182] It should be noted that the description of setting the user's status in the embodiment of the present application is only an example. The electronic device 100 does not need to set the user's status. It only needs to detect whether the user is looking at the electronic device 100 to perform the operation of turning off the screen or displaying the mural interface based on the detection result. The embodiment of the present application does not limit this.

[0183] In other examples, when the electronic device 100 screen is off, the electronic device 100 may display a mural interface upon detecting that the user has been looking at the electronic device 100 for a preset gaze duration. When the electronic device 100 displays the mural interface, the electronic device 100 may turn off the screen upon detecting that the user has been looking at the electronic device 100 for a preset non-gaze duration. This prevents the electronic device 100 from frequently turning the screen off and on, which would increase the power consumption of the electronic device 100.

[0184] In one possible implementation, the electronic device 100 turns off the screen. After detecting that the user has entered a designated area and that the user has been looking at the electronic device 100 for a preset viewing duration (e.g., 5 seconds), the electronic device 100 turns on the screen and displays the mural interface. The electronic device 100 displays the wallpaper interface. After detecting that the user has left the designated area and that the time spent away from the designated area has reached a preset viewing duration, the electronic device 100 turns off the screen. The designated area may be located in front of the display screen of the electronic device 100. In this way, after detecting that the user is in the designated area, the electronic device 100 then detects whether the user is looking at the electronic device 100, which can save power consumption in determining the user's field of view. Furthermore, after detecting that the user has been looking at the electronic device 100 for a preset viewing duration, the electronic device 100 can confirm that the user wants to view the mural interface and provide the mural interface to the user. When the user is in the designated area, the electronic device 100 does not need to determine whether the user is looking at the electronic device 100, thereby reducing power consumption of the electronic device 100.

[0185] Exemplarily, the electronic device 100 can set three states for the designated area, including an unmanned state, a manned non-looking state, and a manned and looking state. Alternatively, the electronic device 100 can also set these three states for the user, which is not limited in the embodiments of the present application. The electronic device 100 can determine whether to display the mural interface based on the state of the designated area after the interface displayed by the electronic device 100 is switched. In some examples, the electronic device 100 can implement the state switching operation of the electronic device 100 on the designated area by setting a finite state machine.

[0186] Specifically, as shown in FIG5A , the unoccupied state shown in FIG5A corresponds to the unoccupied state shown in FIG2 . The occupied, non-attention state shown in FIG5A corresponds to the occupied, non-staying state shown in FIG2 . The occupied and attending state shown in FIG5A corresponds to the occupied and staying state shown in FIG2 . Not limited to the example shown in FIG2 , when the electronic device 100 detects that a user has been gazing at a designated area for a preset duration of 21, the designated area's state is switched from the occupied, non-staying state to the occupied and staying state. The electronic device 100 can also switch the designated area's state from the occupied, non-attention state to the occupied and attending state when it detects that a user has been gazing at the electronic device 100 for a preset duration of 51. When the screen of the electronic device 100 is off while the designated area is in the occupied, non-attention state, the electronic device 100 can also turn on the screen and display the mural interface after switching the designated area's state from the occupied, non-attention state to the occupied and attending state. The process for switching the display state of the electronic device 100 and the process for switching the state of the designated area can be found in the embodiments shown in FIG2 and FIG4 , and will not be further described here. In this way, the electronic device 100 can display the mural interface only when it detects that the user is looking at the screen of the electronic device 100. When the electronic device 100 detects that the user has left the designated area for a preset time length of 23, the screen is turned off, which neither interferes with the user nor can the mural interface be displayed to the user at the appropriate time.

[0187] For example, as shown in FIG5A , the specific process of the electronic device 100 switching between the three states is as follows:

[0188] 1. If the electronic device 100 sets the designated area to an unattended state: When the electronic device 100 detects that a user has entered the designated area, the state of the designated area is switched from an unattended state to a occupied but non-attending state.

[0189] 2. If the electronic device 100 sets the designated area to the occupied, non-attention state: When the electronic device 100 detects that the user has been looking at the electronic device 100 for a preset time period 51 (e.g., 5 seconds), the designated area can be set to switch from the occupied, non-attention state to the occupied and attention state.

[0190] 3. If the electronic device 100 sets the designated area to the occupied non-attention state: When the electronic device 100 detects that the user has left the designated area for a preset time period 52, the designated area can be set to switch from the occupied non-attention state to the unoccupied state.

[0191] 4. If the electronic device 100 sets the designated area to the occupied and watching state. When the electronic device 100 detects that the user has left the designated area for a predetermined time period 53, the designated area can be switched from the occupied and watching state to the unoccupied state. The description of each step in Figure 5A can be found in the embodiments shown in Figures 2 and 4 and will not be repeated here.

[0192] Optionally, not limited to step 4, the electronic device 100 can also switch from the present and watching state to the present and non-watching state by detecting that the time when the user is not looking at the electronic device 100 reaches a preset time 54. This embodiment of the present application is not limited to this.

[0193] For example, as shown in FIG5B , the electronic device 100 detects whether the time period during which the user stares at the electronic device 100 exceeds a preset staring time period as follows:

[0194] S501. The electronic device 100 acquires an image through a camera.

[0195] The screen of the electronic device 100 is in a screen-off state. The electronic device 100 can acquire an image through the camera at a preset interval, and after acquiring the image acquired by the camera, execute step S502.

[0196] S502. The electronic device 100 captures an image of the user's head based on the image acquired by the camera.

[0197] After acquiring the image captured by the camera, the electronic device 100 may use an image recognition algorithm to identify the image of the user's head in the image captured by the camera, and capture the image of the user's head from the image captured by the camera.

[0198] It should be noted that when the electronic device 100 recognizes that the image captured by the camera does not include the image of the user's head, step S501 can be executed. In this way, the electronic device 100 recognizes that the image captured by the camera does not include the image of the user's head, and the electronic device 100 can re-acquire the image captured by the camera.

[0199] S503. The electronic device 100 determines the user's head position and user's head posture based on the user's head image.

[0200] After the electronic device 100 obtains the image of the user's head, it can identify and determine the position and posture of the user's head.

[0201] In some examples, the electronic device 100 may set up a coordinate system O1X1Y1Z1 as shown in Figure 6 . The origin O1 is located at the center of the display screen of the electronic device 100, the Y1O1Z1 plane is parallel to the display screen of the electronic device 100, and the X1 axis is perpendicular to the display screen of the electronic device 100, pointing from the back cover of the electronic device 100 to the display screen of the electronic device 100. The electronic device 100 can determine the position of the user's head in the coordinate system O1X1Y1Z1 (i.e., the user's head position). Based on the user's head position, the electronic device 100 can determine the position of the user's line of sight projection range in the Y1O1Z1 plane and the size of the line of sight projection range. For example, the user's head position can be expressed as (x, y, z). The x value can be used to determine the distance between the user's head and the electronic device 100 along the X1 axis. A smaller x value indicates that the user is closer to the screen of the electronic device 100, and the line of sight projection range is smaller. A larger x value indicates that the user is farther away from the screen of the electronic device 100, and the line of sight projection range is larger. The y value can be used to determine the distance between the user's head and the electronic device 100 along the Y1 axis. The smaller the absolute value of the y value, the closer the user is to the screen of the electronic device 100 on the Y1 axis, and the closer the line of sight projection range is to the electronic device 100 on the Y1 axis. The larger the absolute value of the y value, the farther the user is from the screen of the electronic device 100 on the Y1 axis, and the farther the line of sight projection range is from the electronic device 100 on the Y1 axis. Among them, the z value can be used to determine the distance between the user's head and the electronic device 100 on the Z1 axis, that is, the z value can represent the height of the user's head. The smaller the absolute value of the z value, the closer the user is to the screen of the electronic device 100 on the Z1 axis, and the closer the line of sight projection range is to the electronic device 100 on the Z1 axis. The larger the absolute value of the z value, the farther the user is from the screen of the electronic device 100 on the Z1 axis, and the farther the line of sight projection range is from the electronic device 100 on the Z1 axis. It should be noted that in some scenarios, the line of sight projection range will be blocked by other obstacles (for example, the floor), so the user may move forward, the part of the line of sight projection range blocked by obstacles will decrease, and the line of sight projection range will become larger; the user may move backward, the part of the line of sight projection range blocked by obstacles will increase, and the line of sight projection range will become smaller.

[0202] It should be noted that the above coordinate system O1X1Y1Z1 is only an example. For example, the electronic device 100 can also place the Y1 axis at the intersection of the ground and the plane where the electronic device 100 is located. When the difference between the height of the user's head and the height of the electronic device 100 is smaller, it means that the line of sight projection range is closer to the electronic device 100 on the Y1 axis. This embodiment of the present application is not limited to this.

[0203] In some examples, the electronic device 100 may set a coordinate system O2X2Y2Z2 as shown in Figure 7. The origin O2 is located on the user's head, the Y2O2Z2 plane is parallel to the display screen of the electronic device 100, and the X2 axis points vertically to the display screen of the electronic device 100. The electronic device 100 can determine the pitch angle (pitch), yaw angle (yaw) and roll angle (roll) of the user's head relative to the coordinate system O2X2Y2Z2 through an algorithm for head posture estimation. The pitch angle can be used to represent the angle at which the user's head rotates around the Y2 axis (i.e., the angle at which the user lowers or raises his head). The yaw angle can be used to represent the angle at which the user's head rotates around the Z2 axis (i.e., the angle at which the user turns his head to the left or right). The roll angle can be used to represent the angle at which the user's head rotates around the X2 axis (i.e., the angle at which the user tilts his head to the lower left or right).

[0204] In some examples, when the user's head rotates around the X2 axis, the user's line of sight projection range only moves a specified distance in the Y2O2Z2 plane, and this specified distance does not exceed 10 centimeters. Therefore, in the following embodiments of this application, the impact of the roll angle on the user's line of sight projection range can be ignored, and the user's line of sight projection range can be determined based solely on the user's head position, the user's head pitch angle, and the user's head yaw angle.

[0205] S504. The electronic device 100 determines the user's line of sight direction based on the user's head posture.

[0206] The electronic device 100 may determine the user's line of sight direction based on the user's horizontal viewing direction.

[0207] S505. The electronic device 100 projects the user's line of sight onto the plane where the electronic device 100 is located based on the user's head position, and determines the line of sight projection range.

[0208] The visual projection range may represent the visual field range of the user within the plane where the electronic device 100 is located. The electronic device 100 may determine the visual projection range of the user's visual direction on the plane where the electronic device 100 is located based on the user's head position and head posture.

[0209] S506. The electronic device 100 determines whether the line of sight projection range includes the electronic device 100.

[0210] In some examples, the user's line of sight direction may include, but is not limited to, a left line of sight direction, a right line of sight direction, an upward line of sight direction, and a downward line of sight direction. The horizontal line of sight direction may be a direction perpendicular to the user's face and facing outward. The electronic device 100 may rotate the horizontal line of sight direction by an angle α (e.g., 80 degrees) toward the user's left hand to obtain the left line of sight direction. The electronic device 100 may rotate the horizontal line of sight direction by an angle α toward the user's right hand to obtain the right line of sight direction. The electronic device 100 may rotate the horizontal line of sight direction by a preset angle α toward the top of the user's head (i.e., upward) to obtain the upward line of sight direction. The electronic device 100 may rotate the horizontal line of sight direction by a preset angle α toward the user's feet (i.e., downward) to obtain the downward line of sight direction. The left line of sight direction may represent the user's left field of view. The right line of sight direction may represent the user's right field of view. The upward line of sight direction may represent the user's upper field of view. The downward line of sight direction may represent the user's lower field of view.

[0211] For example, the electronic device 100 can determine the left edge and the right edge of the line of sight projection range based on the yaw angle of the user's head. For example, in the top view shown in Figure 8A, the user's head position is located at position 1 on the plane X1O1Y1, the angle value of the yaw angle of the user's head is zero, the projection of the horizontal direction 20 on the top view is perpendicular to the plane where the electronic device 100 is located, and the right line of sight direction 21 and the left line of sight direction 22 show the user's field of view in the top view. The electronic device 100 can determine that the line of sight projection range is the line of sight range 23 shown in Figure 8A based on the image obtained by the camera. The line of sight range 23 includes the electronic device 100.

[0212] As shown in FIG8A , if the user's head is at position 2, to the right of position 1, the visual range 23 does not include the electronic device 100. If the user's head is at position 3, to the left of position 1, the visual range 23 also does not include the electronic device 100. Therefore, even if the user's head posture remains unchanged, the visual range will change as the user's head position changes along the Y1 axis.

[0213] Similarly, if the user's head position is closer to the electronic device 100 than position 1 along the X1 axis, the user's line of sight projection range is smaller than line of sight range 23. If the user's head position is farther from the electronic device 100 than position 1 along the X1 axis, the user's line of sight projection range is larger than line of sight range 23. However, since the horizontal viewing direction 20 is perpendicular to the electronic device 100, forward or backward movement of the user's head position does not affect the relative position of the electronic device 100 and the horizontal viewing direction 20; the center of the electronic device 100 always remains within line of sight range 23. Therefore, while the user's head posture remains unchanged, the size of the line of sight projection range will change as the user's head position changes along the X1 axis.

[0214] In the top view shown in FIG8B , the user's head is located at position 1 on the plane X1O1Y1. The yaw angle of the user's head is non-zero. The projection of the horizontal direction 24 on the top view is not perpendicular to the plane of the electronic device 100. The right sight line direction 25 and the left sight line direction 26 illustrate the user's field of view in the top view. Based on the image captured by the camera, the electronic device 100 can determine that the projection of the sight line is the sight line range 27 shown in FIG8B . The sight line range 27 does not include the electronic device 100.

[0215] As shown in FIG8B , if the user's head is at position 2, which is to the left of position 1, visual range 27 includes electronic device 100. If the user's head moves to the left from position 2, visual range 27 moves to the other side of electronic device 100 and excludes electronic device 100. If the user's head is to the right of position 1, visual range 27 never excludes electronic device 100. Therefore, even if the user's head posture remains unchanged, the visual range of projection changes as the user's head position changes along the Y1 axis.

[0216] Similarly, if the user's head position is closer to the electronic device 100 than position 1 in the X1-axis direction, the user's line of sight projection range is smaller than the line of sight range 27. However, if the intersection of the horizontal direction 24 and the plane where the electronic device 100 is located falls on the electronic device 100, the user's line of sight projection range includes the electronic device 100. If the user's head position is farther away from the electronic device 100 than position 1 in the X1-axis direction, the user's line of sight projection range is larger than the line of sight range 27. However, the intersection of the horizontal direction 24 and the plane where the electronic device 100 is located is far away from the electronic device 100, and the line of sight range 27 does not include the electronic device 100. Therefore, if the user's head posture remains unchanged and the user's head position is at different positions in the X1-axis direction, the line of sight projection range will also change with the change of the user's head position.

[0217] For example, the electronic device 100 can determine the upper and lower edges of the line of sight projection range based on the pitch angle of the user's head. For example, in the side view shown in FIG8C , the user's head is at position 1 on the plane X1O1Z1, the pitch angle of the user's head is zero, the projection of the horizontal direction 30 on the side view is perpendicular to the plane where the electronic device 100 is located, and the lower line of sight direction 32 and the upper line of sight direction 31 show the user's field of view in the side view. The electronic device 100 can determine that the line of sight projection range is the line of sight range 33 shown in FIG8C based on the image obtained by the camera. The line of sight range 33 includes the electronic device 100.

[0218] As shown in FIG8C , if the user's head is located at position 2, which is above position 1, the electronic device 100 is not included in the visual range 33. Similarly, if the user's head is located at position 3, which is below position 1, the electronic device 100 is not included in the visual range 33. Therefore, even if the user's head posture remains unchanged, the visual range of the projection will change as the user's head position changes along the Z1 axis.

[0219] If the user's head is located at Position 1, which is closer to electronic device 100 than Position 1 in the X1-axis direction, the user's line of sight projection range is smaller than line of sight range 33. If the user's head is located farther from electronic device 100 than Position 1 in the X1-axis direction, the user's line of sight projection range is larger than line of sight range 33. Because horizontal viewing direction 30 is perpendicular to electronic device 100, forward or backward movement of the user's head does not affect the relative position of electronic device 100 and horizontal viewing direction 30; the center of electronic device 100 is always within line of sight range 33.

[0220] In the top view shown in FIG8D , the user's head is at position 1 on plane X1O1Z1. The pitch angle of the user's head is non-zero. The projection of the horizontal direction 34 on the side view is not perpendicular to the plane of the electronic device 100. The lower sight line direction 36 and the upper sight line direction 35 indicate the user's field of view in the side view. Based on the image captured by the camera, the electronic device 100 can determine that the projection of the sight line is the sight line range 37 shown in FIG8D . The sight line range 37 does not include the electronic device 100.

[0221] As shown in FIG8D , if the user's head is located at position 2, which is above position 1, the visual range 37 includes the electronic device 100. It should be noted that if the user's head continues to move upward from position 2, the lower visual direction 36 in the visual range 37 will move above the electronic device 100, and the visual range 37 will not include the electronic device 100. If the user's head is located below position 1, the visual range 37 will never include the electronic device 100.

[0222] It should be noted that because the visual range 37 is blocked by the ground, when the user moves forward, the portion of the visual range 37 blocked by the ground decreases, and the visual range 37 becomes larger. When the user moves backward, the portion of the visual range 37 blocked by the ground increases, and the visual range 37 becomes smaller. If the user's head position is at position 1, which is closer to the electronic device 100 than position 1 in the X1-axis direction, and if the user's upper visual direction 35 falls on the electronic device 100, the user's visual range projection includes the electronic device 100. If the user's head position is at a position farther away from the electronic device 100 than position 1 in the X1-axis direction, the user's visual range projection is blocked by the ground and is smaller than the visual range 33, and the visual range 37 does not include the electronic device 100.

[0223] The electronic device 100 can determine the sight projection range based on the user's head position, the sight range in the top view, and the sight range in the side view. When the sight range in the top view includes the electronic device 100 and the sight range in the side view includes the electronic device 100, the electronic device 100 can determine that the sight projection range includes the electronic device 100. When the sight range in the top view does not include the electronic device 100 or the sight range in the side view does not include the electronic device 100, the electronic device 100 can determine that the sight projection range does not include the electronic device 100.

[0224] It should be noted that the electronic device 100 is not limited to the above-mentioned line of sight projection range. The electronic device 100 can also use the intersection of the horizontal direction and the user's head as the intersection between the user's line of sight and the horizontal direction, and use the direction with a preset angle α with the horizontal direction as the user's line of sight direction. The user's line of sight direction can be fitted into a cone with the horizontal direction as the central axis. Based on the position of the user's head, the electronic device 100 projects the user's line of sight direction onto the plane where the electronic device 100 is located. The shape of the line of sight projection range can be circular or elliptical. The electronic device 100 can determine whether the line of sight projection range includes the electronic device 100 based on the position of the line of sight projection range on the plane where the electronic device 100 is located and the position of the electronic device 100 on the plane.

[0225] When the electronic device 100 determines that the visual projection range includes the electronic device 100, step S507 may be executed. When the electronic device 100 determines that the visual projection range does not include the electronic device 100, step S501 may be executed.

[0226] S507. The electronic device 100 determines whether the time period during which the line of sight projection range includes the electronic device 100 exceeds a preset gaze time period.

[0227] When the electronic device 100 first determines that the gaze projection range includes the electronic device 100 during step S505, it may record the duration of time the gaze projection range includes the electronic device 100. If the electronic device 100 determines that the duration does not exceed the preset gaze duration, the electronic device 100 may execute step S501. If the electronic device 100 determines that the duration exceeds the preset gaze duration, the electronic device 100 may execute step S508.

[0228] It should be noted that, when the electronic device 100 records the duration that the line of sight projection range includes the electronic device 100, when executing step S506, the electronic device 100 determines that the line of sight projection range does not include the electronic device 100, and the electronic device 100 clears the recorded duration.

[0229] S508. The electronic device 100 displays the mural interface.

[0230] When the electronic device 100 determines that the time period during which the visual projection range includes the electronic device 100 exceeds a preset gaze time period, the electronic device 100 may display a mural interface.

[0231] It is understood that the electronic device 100 can obtain images captured by the camera at preset intervals when displaying the mural interface. The electronic device 100 can determine whether the line of sight projection range includes the electronic device 100 based on the image captured by the camera. For details, please refer to the embodiment shown in Figure 5B. The electronic device 100 can perform a screen-off operation when it is determined that the line of sight projection range does not include the electronic device 100 for a period exceeding the preset gaze duration.

[0232] In some examples, the electronic device 100 displays a user interface. After receiving the screen-off input from the user, the electronic device 100 can turn off the screen in response to the input. After turning off the screen, the electronic device 100 can detect that the user has been away from the designated area for a preset departure time, and then detect that the user has re-entered the designated area, and execute step S501 shown in Figure 5B. In this way, the electronic device 100 remains in the screen-off state after the user actively turns off the screen. In this process, since the user actively turns off the screen, it indicates that the user prefers to keep the screen of the electronic device 100 in the screen-off state, and the electronic device 100 does not execute the steps shown in Figure 5B. The electronic device 100 can execute the steps shown in Figure 5B after detecting that the user has left.

[0233] In some examples, the electronic device 100 displays a non-task interface. If the electronic device 100 does not receive any user input within a preset response time, the electronic device 100 may display a mural interface. The electronic device 100 may also obtain images captured by the camera at preset intervals, and determine whether the electronic device 100 performs a screen-off operation based on the images captured by the camera. For details, please refer to the above embodiments and will not be repeated here. In this way, if the electronic device 100 detects that the user has not operated the electronic device 100 within the preset response time, the electronic device 100 may display a mural interface.

[0234] It should be noted that the embodiment shown in FIG. 5B is not limited to detecting whether the user's line of sight falls on the display screen of the electronic device 100. The electronic device 100 may also estimate the user's eye posture through images captured by the camera. The electronic device 100 may determine the user's line of sight based on the user's eye posture to determine whether the user's line of sight falls on the display screen of the electronic device 100. This embodiment of the present application is not limited to this.

[0235] In one possible implementation, electronic device 100 can determine scene atmosphere parameters based on images captured by the camera. The scene atmosphere parameters can represent the decorative style of the space where electronic device 100 is located, ambient light conditions, and so on. Based on the scene atmosphere parameters, electronic device 100 can identify a specific artwork and display a mural interface containing the specified artwork. In this way, electronic device 100 displays artworks in the mural interface that match the style of the environment where electronic device 100 is located, enhancing the user's sense of immersion and surroundings, and improving the user experience.

[0236] For example, as shown in FIG9 , the electronic device 100 may obtain a designated work in the following steps:

[0237] S901. The electronic device 100 acquires an image through a camera.

[0238] The electronic device 100 may acquire an image through the camera every preset switching time (eg, 30 seconds).

[0239] S902. The electronic device 100 determines scene atmosphere parameters based on the image acquired by the camera. The scene atmosphere parameters include the scene decoration style and the scene lighting conditions.

[0240] The electronic device 100 may use an image processing algorithm to determine scene atmosphere parameters of the image captured by the camera. These scene atmosphere parameters may be used to represent the room in which the electronic device 100 is located. These scene atmosphere parameters may include, but are not limited to, the scene decoration style and the scene lighting conditions. The scene decoration style may represent the decoration style of the room in which the electronic device 100 is located. For example, scene decoration styles may include, but are not limited to, Chinese and Western styles. The scene lighting conditions may represent the lighting conditions in the room in which the electronic device 100 is located, such as color temperature. Color temperature may indicate whether the lighting in the room is cool or warm. Cool light is light with a color temperature exceeding 5000 Kelvin, while warm light is light with a color temperature of 3000 Kelvin. Warm light has a reddish color, which can give the user a sense of warmth, while cool light has a bluish color, which can give the user a sense of coolness.

[0241] S903. The electronic device 100 displays a mural interface including a designated work based on the scene atmosphere parameters.

[0242] The electronic device 100 may obtain a designated work corresponding to the scene atmosphere parameter based on the scene atmosphere parameter. The electronic device 100 may determine the designated work from stored works based on the scene atmosphere parameter. Alternatively, the electronic device 100 may obtain the designated work from a server based on the scene atmosphere parameter.

[0243] In some examples, the electronic device 100 can determine the designated work based on the scene decoration style. If the scene decoration style is a Western decoration style, the electronic device 100 can obtain Western-style works (for example, oil paintings, sketches, photos of people wearing Western clothes, photos of Western-style buildings, etc.) as designated works. If the scene decoration style is a Chinese decoration style, the electronic device 100 can obtain Chinese-style works (for example, ink paintings, fine brush paintings, photos of people wearing Chinese clothes, photos of Chinese-style buildings, etc.) as designated works. For example, if the electronic device 100 obtains an image obtained by the camera as shown in Figure 10A, the electronic device 100 can display the mural interface 1001 as shown in Figure 10B. For another example, if the electronic device 100 obtains an image as shown in any frame in Figures 3A-3D through the camera, the electronic device 100 can display the mural interface 1002 as shown in Figure 10C.

[0244] In some examples, the electronic device 100 can determine a specific work based on color temperature. For example, when the electronic device 100 determines that the ambient light is warm, a painting with warm tones can be displayed. When the electronic device 100 determines that the ambient light is cool, a painting with cool tones can be displayed.

[0245] In some examples, the electronic device 100 can determine a designated artwork based on the scene's decor and color temperature. For example, when the electronic device 100 determines that the scene's decor is Western and the ambient light is cool, it displays an oil painting of the sea or starry sky. It should be understood that the designated artworks provided in the embodiments of this application are merely examples and should not constitute a specific limitation on the mural interface displayed by the electronic device 100.

[0246] In some examples, when the number of designated works obtained by the electronic device 100 is greater than one, the electronic device 100 can switch the works displayed in the mural interface every preset carousel duration (e.g., one minute). In this way, the electronic device 100 can rotate multiple works, giving the user a more diverse visual experience.

[0247] In one possible implementation, the electronic device 100 can also collect nearby sounds and, based on the images captured by the camera and the nearby sounds, jointly determine a designated work. In this way, the electronic device 100 can combine the decoration style, ambient light conditions, and ambient sound conditions of the environment in which the electronic device 100 is located to jointly determine a designated work that suits the current scenario and display the designated work. The mural interface displayed by the electronic device 100 is consistent with the current environment style, more closely fitting the current environment, so that the mural interface and the environment are integrated into a whole, giving the user a more immersive experience.

[0248] The ambient sounds collected by the electronic device 100 may include, but are not limited to, wind, insects, birdsong, rain, and so on. For example, if the electronic device 100 determines that the scene's decor is Chinese, the ambient light is warm, and the collected ambient sounds include birdsong, the electronic device 100 may display a detailed painting of birds on the mural interface. In this way, the electronic device 100 can combine the ambient environment and sounds to display the corresponding mural interface, providing the user with a better audio-visual experience.

[0249] In some examples, when the intensity of the ambient sound collected by the electronic device 100 is lower than a preset sound intensity threshold (e.g., 30 decibels), the electronic device 100 may display works suitable for a quiet environment, such as a landscape photo or painting. When the intensity of the ambient sound collected by the electronic device 100 is higher than a preset sound intensity threshold (e.g., 40 decibels), the electronic device 100 may display works suitable for a lively environment, such as a painting or photo with warm colors.

[0250] In some examples, the electronic device 100 can display a mural interface using a specified display effect based on the ambient lighting conditions. For example, the electronic device 100 can determine the specified display effect based on the light intensity. For example, when the electronic device 100 determines that the light intensity is greater than a preset light intensity threshold, the brightness of the display screen of the electronic device 100 can be increased. When the electronic device 100 determines that the light intensity is less than the preset light intensity threshold, the brightness of the display screen of the electronic device 100 can be reduced.

[0251] For another example, the electronic device 100 includes an ambient light. When the electronic device 100 determines that the light intensity is less than a preset light intensity threshold, it can adjust the illumination direction and brightness of the ambient light of the electronic device 100 to achieve a spotlight effect. In this way, the central area of ​​the mural interface displayed by the electronic device 100 is illuminated by the ambient light, while the edge areas of the mural interface are darker, highlighting the mural interface and providing the user with the atmosphere of appreciating paintings in an art gallery. Optionally, the electronic device 100 can obtain light intensity through an ambient light sensor.

[0252] In some examples, the electronic device 100 can adjust the brightness of various areas of the display screen to highlight the details of the artwork in the mural interface. For example, when the electronic device 100 detects that the light intensity is less than a preset light intensity threshold, it can increase the brightness of the center area of ​​the display screen and decrease the brightness of the edge areas of the display screen. In this way, the electronic device 100 can highlight the content displayed in the center of the wallpaper interface.

[0253] In one possible implementation, the electronic device 100 can receive user input and set a specified range of works. The electronic device 100 can display the works within the specified range of works on the mural interface. For example, the specified range of works can be used to indicate the author of the work, the completion time of the work, the type of work (for example, ink painting, gouache painting, oil painting, sketch, photograph, etc.), the subject of the work (for example, architecture, people, scenery, objects, etc.), etc. In some examples, the electronic device 100 can receive user voice input and set a specified range of works. For example, the electronic device 100 can display a sketch of a person as the main body of the work on the mural interface after collecting the user's voice input through the microphone: "Xiaoyi, Xiaoyi, show the person sketch".

[0254] In some examples, electronic device 100 can determine a specific work within a specified range of works based on images captured by the camera and / or ambient sounds. For example, if electronic device 100 sets the specified range of works to be works by a specific artist, and if electronic device 100 determines that the ambient light is warm based on the images captured by the camera, then the warm-toned works of the specific artist can be displayed.

[0255] In some examples, electronic device 100 can collaborate with other electronic devices in the room where electronic device 100 is located to display a mural interface. For example, these other electronic devices may include, but are not limited to, electric curtains, smart lighting sources, and so on. For example, when electronic device 100 displays a work with cool tones, electronic device 100 can notify the smart lighting sources to adjust to cooler light. For another example, when electronic device 100 displays a mural interface with a spotlight effect, electronic device 100 can notify the electric curtains to be closed and notify the smart lighting sources to turn off. In this way, electronic device 100 can collaborate with other electronic devices in the current room to achieve a better display effect.

[0256] In some examples, when the electronic device 100 displays a mural interface, it can play audio related to the content of the mural interface based on the content of the mural interface. For example, when the electronic device 100 displays a photo of the ocean, the electronic device 100 can play the sound of waves. For another example, when the electronic device 100 displays a picture of a ballet dancer, the electronic device 100 can play ballet music. In this way, when the electronic device 100 displays a mural interface, it can play audio related to the content of the mural interface through the speaker, providing the user with a unified and integrated display effect from the user's visual and auditory perspectives.

[0257] In one possible implementation, electronic device 100 displays a mural interface. After receiving user input, electronic device 100 can respond to the user input and output interaction results. These interaction results may include, but are not limited to, displaying dynamic interactive images, displaying relevant information about the mural interface, playing audio, and so on. In this way, the mural interface of electronic device 100 can provide users with interactive functions. Electronic device 100 can sense user interaction and output corresponding interaction results based on the user's interaction behavior, thereby increasing the fun and interactivity of the mural interface.

[0258] In some examples, the electronic device 100 displays a mural interface, and the state of a designated area set by the electronic device 100 can be an unoccupied state, an occupied non-stop state, or an occupied and stopped state. The electronic device 100 can set the state of the designated area to an occupied and stopped state after receiving user input. In this way, if the user interacts with the mural interface and indicates that the user prefers the electronic device 100 to continue displaying the mural interface, the electronic device 100 can directly set the state of the designated area to an occupied and stopped state after receiving user input, thereby extending the time that the electronic device 100 displays the mural interface.

[0259] In other examples, the electronic device 100 displays a mural interface. Upon receiving user input, the electronic device 100 can re-detect whether the user has been away from the designated area for a preset departure time. Optionally, the electronic device 100 can increase the preset departure time. In this way, the electronic device 100 can extend the display time of the mural interface to meet the user's need to view the mural interface.

[0260] Exemplarily, as shown in FIG11 , the process of implementing user interaction by the electronic device 100 includes the following steps:

[0261] S1101. The electronic device 100 displays a mural interface.

[0262] The electronic device 100 can provide the user with an interactive mural interface. The electronic device 100 sets a correspondence between specified inputs and interaction results in the interactive mural interface. Upon receiving the specified input, the electronic device 100 can determine the interaction result corresponding to the specified input and output the interaction result in the interactive mural interface via a display screen and / or a speaker.

[0263] S1102. The electronic device 100 receives a designated input.

[0264] Specifically, designated input may include, but is not limited to, touch input, voice input, motion input, and input from the remote control device 200. The electronic device 100 may receive touch input via a touch screen. It may receive voice input via a microphone. It may receive motion input via a camera. The electronic device 100 may receive input from the remote control device 200 via a wireless communication module. After receiving user input from a key or touchpad, the remote control device 200 may send the designated input to the electronic device 100.

[0265] S1103. The electronic device 100 outputs an interaction result in response to the specified input.

[0266] The electronic device 100 can output the interaction result of the mural interface through the display screen and the speaker in response to the specified input. For example, the interaction result can be playing audio related to the screen content, displaying information related to the screen content, displaying animation of the screen content, etc.

[0267] In some examples, the electronic device 100 can set the designated input for the mural interface to be a touch input, and the interaction result is to display detailed information of the works in the mural interface (e.g., the author's name, the work description, the author's biography, etc.). After receiving the designated input (e.g., touch input) for the mural interface, the electronic device 100 can respond to the designated input and display the author of the work in the mural interface, the work description, etc. In this way, when the user sees a work of interest, they can obtain detailed information about the work from the interaction result of the electronic device 100, making it easier for the user to find the work of interest.

[0268] In one possible implementation, the electronic device 100 can use an image recognition algorithm to identify the subject of the displayed content on the mural interface. After identifying the subject of the displayed content, the electronic device 100 can set a correspondence between a specified input and an interaction result for the subject. For example, the subject of the mural interface displayed content can include, but is not limited to, people, animals, buildings, plants, objects, scenery, and the like. In this way, when the mural interface is displayed, the electronic device 100 can set a correspondence between a specified input and an interaction result for the mural interface, allowing the user to interact with the electronic device 100 and increasing the fun.

[0269] For example, when the electronic device 100 recognizes that the subject is a person, it can set the designated input to the subject as a gesture input for greeting the user (for example, waving) or a voice input for greeting the user (for example, "Hello"), and set the corresponding interaction result for the designated input to play the greeting audio. In this way, the user can greet the person in the mural interface and achieve a voice interaction effect.

[0270] For another example, when the electronic device 100 recognizes that the subject is a plant or an animal, it can set the designated input to be a touch input (e.g., single click, double click, long press, etc.), and set the corresponding interaction result for the designated input to display detailed information of the subject (e.g., name, category, growth environment, etc.). In this way, the user can understand the information of the plants and animals displayed in the mural interface through the electronic device 100.

[0271] For another example, when the electronic device 100 recognizes that the subject is a scene, it can set the designated input to be a touch input (e.g., single click, double click, long press, etc.) for the subject, and set the corresponding interaction result to display detailed information of the scene (e.g., the address of the scene, travel plan, etc.). The travel plan may include, but is not limited to, a recommended travel time, transportation options from the user's current location to the address of the scene, local food recommendations, etc. In this way, when the user sees a beautiful scene, they can determine the address of the scene, making it easier for the user to visit it.

[0272] In some examples, the electronic device 100 can also use image processing algorithms to set interactive animations for the subject in the mural interface. For example, the electronic device 100 can perform operations such as translation, scaling, and rotation on the subject to achieve a dynamic movement effect of the subject. For example, the electronic device 100 can enlarge the subject to achieve the effect of the subject approaching the user.

[0273] In some examples, the electronic device 100 can collect the user's motion input through the camera and output the interaction result on the mural interface in response to the user's motion input. In this way, the electronic device 100 can collect the user's motion input and, based on the user's motion, implement the motion interaction effect on the mural interface.

[0274] For example, the electronic device 100 may display the mural interface 1401 shown in FIG12A . The mural interface 1401 includes a closed window. When the electronic device 100 receives an action input from the user to push the window open, the electronic device 100 may display the mural interface 1402 shown in FIG12B in response to the input.

[0275] As shown in FIG12B , the window in the mural interface 1402 is open, and the mural interface 1402 can also display a landscape in the open window. Here, the electronic device 100 displays a scene of the sky. The electronic device 100 can also display an airplane icon 1403 as shown in FIG12C in response to receiving a user's forward throwing action input. The electronic device 100 can gradually reduce the airplane icon 1403. The electronic device 100 can cancel the display of the airplane icon 1403 after reducing the airplane icon 1403 to a preset size (e.g., 10 pixels). In this way, the electronic device 100 can achieve the effect of an airplane flying away.

[0276] For another example, electronic device 100 displays airplane icon 1403 as shown in FIG12C . Upon receiving a user blowing action input, electronic device 100 can change the direction of movement of airplane icon 1403 in response to the input. Alternatively, electronic device 100 can also play wind sounds through a speaker. In this way, electronic device 100 can create the effect of an airplane being blown away by the wind.

[0277] In some examples, the electronic device 100 can collect the user's voice input through the microphone and output the interaction result on the mural interface in response to the user's voice input. In this way, the electronic device 100 can collect the user's voice input and, based on the user's voice content, implement a voice interaction effect on the mural interface.

[0278] For example, electronic device 100 displays a wall painting interface 1501 as shown in FIG13A . Wall painting interface 1501 includes a vehicle. Upon receiving a voice input requesting detailed information about the subject of wall painting interface 1501 , electronic device 100 may display text information 1502 as shown in FIG13B in response to the voice input. For example, the voice input may be: "Xiaoyi, Xiaoyi, show me the details of this vehicle."

[0279] As shown in Figure 13B, electronic device 100 displays text information 1502 on mural interface 1501. Text information 1502 includes detailed information about the vehicle (e.g., vehicle brand, vehicle series, vehicle price, etc.). Here, text information 1502 may include: "XX brand car," "Vehicle series: XX," and "Price: 9.9w." In this way, electronic device 100 can display detailed information about the mural interface in response to user voice input.

[0280] For another example, when the electronic device 100 displays the mural interface 1501 shown in FIG13A , it may receive a user voice input such as "Hello." In response to this input, a horn sound may be played through the speaker. Alternatively, the electronic device 100 may also zoom in and out of the vehicle in the mural interface 1501 . In this way, the electronic device 100 may provide the user with the effect of greeting the vehicle in the mural interface 1501 .

[0281] In some examples, the electronic device 100 can receive a user's touch input on the touch screen and, in response to the user's touch input, output an interaction result on the mural interface. In this way, the electronic device 100 can collect the user's touch input and implement a touch interaction effect on the mural interface based on the user's touch point on the display screen.

[0282] Exemplarily, the electronic device 100 displays a mural interface 1601 as shown in FIG14A . The mural interface 1601 includes a fish pond, which includes one or more fish. When the electronic device 100 receives a touch input (e.g., a single click) directed to the mural interface 1601, the electronic device 100 can display the mural interface 1601 as shown in FIG14B in response to the input. After receiving the user's touch input, the electronic device 100 can display a fish food icon 1602 at the location where the user's touch input was received on the display screen. The electronic device 100 can also control the one or more fish to move to the location of the fish food icon 1602. Optionally, the electronic device 100 can also play audio of fish food falling into the water and / or audio of fish swimming through a speaker. In this way, the electronic device 100 can achieve a display effect of a user feeding the fish.

[0283] When the electronic device 100 receives a touch input from the user dragging any of the fish shown in FIG. 14A , the electronic device 100 can also respond to the input by displaying a display effect in which the selected fish moves as the user's finger moves on the touch screen. In this way, the electronic device 100 can provide the user with the function of moving objects in the mural interface, allowing the user to adjust the relative positions of various objects in the mural interface.

[0284] In some examples, the electronic device 100 can receive control signals sent by the remote control device 200 through the wireless communication module and output the interaction results on the mural interface in response to the control signals. Specifically, the remote control device 200 can receive user input from the buttons or touchpad of the remote control device 200 and send control signals to the electronic device 100. In this way, the electronic device 100 can receive the input from the remote control device 200 and, based on the input from the remote control device 200, implement the remote control interaction effect on the mural interface.

[0285] For example, the electronic device 100 may display a wall painting interface 1701 as shown in FIG15 . The wall painting interface 1701 includes a cursor 1702. The electronic device 100 may receive input from the remote control device 200 and move the cursor 1702. Specifically, the remote control device 200 may receive input from the user moving the remote control device 200 and send the input to move the cursor 1702 to the electronic device 100. The remote control device 200 may determine the direction of movement of the cursor 1702 based on the direction in which the user moves the remote control device 200 and the distance the user moves the remote control device 200. Alternatively, the remote control device 200 may receive input from the user on the touchpad of the remote control device 200 and send the input to move the cursor 1702 to the electronic device 100. The remote control device 200 may determine the direction of movement of the cursor 1702 based on the direction of movement of the user's finger on the touchpad of the remote control device 200 and the distance the user's finger moves on the touchpad of the remote control device 200.

[0286] Among them, mural interface 1701 also includes a fish pond, which includes one or more fish. Electronic device 100 can receive remote control input from remote control device 200. For example, remote control device 200 can send the remote control input to electronic device 100 after receiving the user's input for confirmation key 1703. In response to the remote control input, electronic device 100 can display a fish food icon at the location of cursor 1702. Electronic device 100 can also control the one or more fish to move to the location of the fish food icon. For details, please refer to the embodiment shown in Figure 14B, which will not be repeated here. In this way, electronic device 100 can provide users with the function of remotely interacting with the mural interface. Users can interact with the mural interface remotely through remote control device 200, and the interaction method is more flexible.

[0287] It should be noted that the display content of the above-mentioned interactive mural interface and the interactive results output by the electronic device 100 are only examples. The electronic device 100 can also provide other interactive mural interfaces to achieve more diverse interactive effects.

[0288] It should be understood that each step in the above method embodiment can be completed by hardware integrated logic circuits in a processor or by software instructions. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0289] The present application also provides an electronic device, which may include a memory and a processor. The memory may be used to store programs, and the processor may be used to call the programs in the memory so that the electronic device executes the method executed by the electronic device 100 in any of the above embodiments.

[0290] The present application also provides a chip system, which includes at least one processor for implementing the functions involved in the method executed by the electronic device 100 in any of the above embodiments.

[0291] In one possible design, the chip system also includes a memory for storing program instructions and data, and the memory is located inside or outside the processor.

[0292] The chip system can be composed of chips, or can include chips and other discrete devices.

[0293] Optionally, there may be one or more processors in the chip system. The processor may be implemented in hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0294] Optionally, the memory in the chip system may be one or more. The memory may be integrated with the processor or may be provided separately from the processor, which is not limited in the embodiments of the present application. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or provided on different chips. The embodiments of the present application do not specifically limit the type of memory or the configuration of the memory and the processor.

[0295] Exemplarily, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0296] The present application also provides a program product, which includes: a program (also referred to as code, or instruction), which, when executed, enables an electronic device to execute any method executed by the electronic device 100 in any of the above embodiments.

[0297] The present application also provides a readable storage medium, which stores a program (also referred to as code or instruction). When the program is executed, the electronic device executes any one of the methods executed by the electronic device 100 in any of the above embodiments.

[0298] It should be understood that the processor in the embodiments of the present application can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above-mentioned method embodiment can be completed by hardware integrated logic circuits in the processor or by software instructions. The above-mentioned processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of the present application can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and, in conjunction with its hardware, completes the steps of the above-mentioned method.

[0299] In addition, embodiments of the present application further provide a device. Specifically, the device may be a component or module, and may include one or more processors and a memory connected together. The memory is used to store a program. When the program is executed by one or more processors, the device performs the methods described in each of the above method embodiments.

[0300] The apparatus, readable storage medium, computer program product, or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0301] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.

[0302] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a program product. The program product includes one or more instructions. When the program instructions are loaded and executed on an electronic device, the process or function according to the present application is generated in whole or in part. The electronic device can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The instruction can be stored in a readable storage medium or transmitted from one readable storage medium to another readable storage medium. For example, the instruction can be transmitted from a website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The readable storage medium can be any available medium that the electronic device can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)).

[0303] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a program instructing related hardware. The program can be stored in a readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0304] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.

Claims

1. A display method, characterized in that: Applied to an electronic device, the electronic device includes a display screen; the method includes: The display screen is turned off; When the display screen remains off, detecting that a user enters a first area; If it is detected that the user stays in the first area for a first time period and in the second area for the first time period, the display screen is switched from off to on and a first interface is displayed on the display screen, and the first area includes the second area; After the first interface is displayed on the display screen, if it is detected that the user has left the first area for a second time period, switching the display screen from displaying the first interface to turning off the screen; If it is detected that the user stays in the first area for the first time period but does not stay in the second area for the first time period, the display screen remains off.

2. The method according to claim 1, characterized in that The method further comprises: In response to the received first input, switching the display screen from an on screen to an off screen; When the display screen is turned off, detecting whether the user leaves the first area; If it is detected that the time duration that the user has been away from the first area reaches a third time duration, it is detected whether the user enters the first area, and the third time duration is less than the second time duration.

3. The method according to claim 1, characterized in that The method further comprises: The display screen displays a second interface, where the second interface is different from the first interface; When the display screen displays the second interface, detecting user input, and if it is detected that the time period for which no user input has been received reaches a fourth time period, displaying the first interface on the display screen; When the first interface is displayed on the display screen, it is detected whether the user leaves the first area. If it is detected that the time duration for which the user has been away from the first area reaches a fifth time duration, the display screen is turned off.

4. The method according to any one of claims 1 to 3, characterized in that After displaying the first interface on the display screen and before switching the display screen from displaying the first interface to turning off the display screen, the method further includes: It is detected that the time when the user leaves the first area reaches a third time, and a first countdown is displayed on the first interface, where the time of the first countdown is equal to a sixth time, and the sixth time is the difference between the second time and the third time; or, It is detected that the time when the user leaves the first area reaches the seventh time period, and a second countdown is displayed on the first interface, the second countdown time is equal to the sixth time period, and the sixth time period is the difference between the fifth time period and the seventh time period.

5. The method according to claim 4, characterized in that After displaying the first countdown on the first interface, the method further includes: Before it is detected that the time duration for which the user has left the first area reaches the second time duration, if it is detected that the user enters the first area, the first countdown is canceled.

6. The method according to any one of claims 1 to 5, characterized in that The electronic device also includes a camera, and the first area is within the field of view FOV of the camera.

7. The method according to any one of claims 1 to 6, characterized in that The first interface is a wallpaper interface.

8. The method according to any one of claims 1 to 7, characterized in that The method may further comprise one or more of the following: In response to detecting that a user enters the first area, switching the unmanned state to the occupied non-staying state; In response to detecting that the user stays in the second area for the first time period, switching the occupied non-staying state to an occupied and staying state; In response to detecting that the time duration for which the user has been away from the first area reaches a third time duration, the occupied and staying state is switched to the unoccupied state.

9. The method according to claim 8, characterized in that After the first interface is displayed on the display screen, if it is detected that the user has left the first area for a second time period, switching the display screen from displaying the first interface to turning off the screen specifically includes: When it is detected that the duration for switching the occupied state to the unoccupied state reaches a sixth duration, the display screen is turned off, and the sixth duration is the difference between the second duration and the third duration.

10. The method according to claim 2, characterized in that The method may further comprise one or more of the following: In response to the first input, setting the state to be occupied and staying; In response to detecting that the time duration for which the user has been away from the first area reaches the third time duration, the occupied and staying state is switched to an unoccupied state.

11. The method according to claim 3, characterized in that The method may further comprise one or more of the following: In response to detecting that the time period during which no input is received reaches the fourth time period, setting the state to a occupied non-staying state; In response to detecting that the time duration for which the user has left the first area reaches a seventh time duration, the occupied non-staying state is switched to the unoccupied state; wherein the seventh time duration is shorter than the fifth time duration.

12. The method according to claim 11, characterized in that If it is detected that the user has been away from the first area for a fifth time period, turning off the display screen specifically includes: When it is detected that the duration for switching the occupied non-stop state to the unoccupied state reaches a sixth duration, the display screen is turned off, and the sixth duration is the difference between the fifth duration and the seventh duration.

13. A display method, characterized in that: Applied to an electronic device, the electronic device includes a display screen; the method includes: The display screen is turned off; When the display screen remains off, detecting that a user enters a first area; After detecting that the user enters the first area, if it is detected that the user has been looking at the display screen for a first time period, switching the display screen from off to on and displaying a first interface on the display screen; After the first interface is displayed on the display screen, if it is detected that the user has left the first area for a second time period, switching the display screen from displaying the first interface to turning off the screen; After detecting that the user enters the first area, if it is detected that the time duration for which the user stares at the display screen does not reach a first time duration, the display screen is kept off.

14. The method according to claim 13, characterized in that The method further comprises: In response to the received first input, turning off the display screen; When the display screen is turned off, detecting whether the user leaves the first area; If it is detected that the time duration that the user has been away from the first area reaches a third time duration, it is detected whether the user enters the first area, and the third time duration is less than the second time duration.

15. The method according to claim 13, characterized in that The method further comprises: The display screen displays a second interface, where the second interface is different from the first interface; When the display screen displays the second interface, detecting user input, and if it is detected that the time period for which no user input has been received reaches a fourth time period, displaying the first interface on the display screen; When the first interface is displayed on the display screen, it is detected whether the user leaves the first area. If it is detected that the time duration for which the user has been away from the first area reaches a fifth time duration, the display screen is turned off.

16. The method according to any one of claims 13 to 15, characterized in that After displaying the first interface on the display screen and before switching the display screen from displaying the first interface to turning off the display screen, the method further includes: It is detected that the time duration when the user leaves the first area reaches a third time duration, and a first countdown is displayed on the first interface, the time duration of the first countdown is equal to a sixth time duration, and the sixth time duration is the difference between the second time duration and the third time duration.

17. The method according to claim 16, characterized in that After displaying the first countdown on the first interface, the method further includes: Before it is detected that the time duration for which the user has left the first area reaches the second time duration, if it is detected that the user enters the first area, the first countdown is canceled.

18. The method according to any one of claims 13 to 17, characterized in that: The electronic device also includes a camera, and the first area is within the field of view FOV of the camera.

19. The method according to any one of claims 13 to 18, characterized in that The first interface is a wallpaper interface.

20. An electronic device, characterized in that: include: a display screen, one or more processors, and one or more memories; The display screen and the one or more memories are coupled to the one or more processors, and the one or more memories are used to store executable programs. When the one or more processors execute the executable programs, the electronic device executes the method described in any one of claims 1-12 or claims 13-19.

21. A readable storage medium storing a program, characterized in that: When the program is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 12 or claims 13 to 19.

Images