Display method and related device

Abstract

The invention discloses a display method and a related device. The display screen of the electronic equipment is turned off. Detecting that a user enters a first area when the display screen is kept off; if it is detected that the user stays in the first area for the first duration and stays in the second area for the first duration, the display screen is switched from the off screen to the on screen, a first interface is displayed on the display screen, and the first area comprises the second area. And after the first interface is displayed on the display screen, if it is detected that the duration for the user to leave the first area reaches a second duration, switching the display screen from displaying the first interface to turning off the screen. If it is detected that the user stays in the first area for the first duration but does not stay in the second area for the first duration, the display screen is kept turned off. Therefore, after the electronic equipment detects that the user enters the first area, the screen is still kept off, and the mural interface is displayed until the situation that the user stays in the second area for the first duration is determined, so that the electronic equipment is prevented from frequently lightening the screen and interfering user actions when the user passes by, and the power consumption is saved.

Description

Technical Field

[0001] The present application relates to the field of terminals, and in particular to a display method and related devices. Background Art

[0002] At present, electronic devices such as televisions can provide users with movie-watching functions. Users can enjoy better viewing effects through large-size screens of electronic devices such as televisions. When users are not watching movies, electronic devices can also display some paintings, photos, etc. Electronic devices can be used as decorations to make the surrounding environment more beautiful.

[0003] However, in order to display paintings, photos and other works, electronic devices keep their screens on for a long time, which consumes a lot of power. Summary of the invention

[0004] The present application provides a display method and related devices, which realize timely display of a mural interface according to the state of the displayed interface and the specified area after switching. The mural interface can be used to decorate the room, making the entire space more beautiful and coordinated. The electronic device can also turn off the screen in time according to the change of the state of the specified area to save the power consumption of the electronic device.

[0005] In a first aspect, the present application provides a display method, which is applied to an electronic device, where the electronic device includes a display screen, and the method includes:

[0006] The display screen turns off; while the display screen remains off, it is detected that the user enters the first area; if it is detected that the user stays in the first area for a first time period and in the second area for a first time period, the display screen is switched from off to on and the first interface is displayed on the display screen, and the first area includes the second area; after the first interface is displayed on the display screen, if it is detected that the user has left the first area for a second time period, the display screen is switched from displaying the first interface to off; if it is detected that the user stays in the first area for a first time period but does not stay in the second area for the first time period, the display screen remains off. In this way, after the electronic device detects that the user appears in the designated area, it remains in the off state until the electronic device determines that the user has stayed in the designated sub-area for the first time period, and then displays the first interface. This avoids the electronic device frequently lighting up the screen when the user passes by, interfering with the user's actions, and saving power consumption of the electronic device.

[0007] In some examples, reaching means being greater than or equal to. The time duration for detecting that the user leaves the first area reaches the second time duration means that the time duration for detecting that the user leaves the first area is greater than or equal to the second time duration.

[0008] In a possible implementation, the method further includes: in response to the received first input, switching the display screen from being on to being off; when the display screen is off, detecting whether the user has left the first area; if it is detected that the user has been away from the first area for a third time period, detecting whether the user has entered the first area, and the third time period is less than the second time period. In this way, when the electronic device receives the first input when the screen is on, it can be considered that the user wants to turn off the screen, and does not intend to turn on the screen of the electronic device and display the first interface, that is, although the user is in the designated area at this time, the electronic device 100 will not turn on the screen and display the first interface.

[0009] In one possible implementation, the method also includes: displaying a second interface on the display screen, the second interface being different from the first interface; when the display screen displays the second interface, detecting user input, and if it is detected that a period of time during which no user input has been received reaches a fourth period of time, displaying the first interface on the display screen; when displaying the first interface on the display screen, detecting whether the user has left the first area, and if it is detected that the user has left the first area reaches a fifth period of time, turning off the display screen.

[0010] The second interface is a non-task interface, that is, an interface other than the first interface and the task interface. The second interface may include a main interface.

[0011] In this way, when the electronic device detects that the user has not operated the electronic device within the fourth time period, the electronic device displays the first interface, showing the painting or photo, thereby improving the aesthetics of the space where the electronic device 100 is located.

[0012] In a possible implementation, after the first interface is displayed on the display screen, before the display screen is switched from displaying the first interface to turning off the screen, the method further includes: detecting that the time the user has been away from the first area reaches a third time length, displaying a first countdown on the first interface, the time length of the first countdown is equal to a sixth time length, and the sixth time length is the difference between the second time length and the third time length; or detecting that the time the user has been away from the first area reaches a seventh time length, displaying a second countdown on the first interface, the time length of the second countdown is equal to a sixth time length, and the sixth time length is the difference between the fifth time length and the seventh time length. In this way, the electronic device displays the first countdown to indicate the time point when the electronic device turns off the screen.

[0013] In a possible implementation, after the first countdown is displayed on the first interface, the method further includes: before the time duration of the user leaving the first area reaches a second time duration, if the user is detected to enter the first area, canceling the display of the first countdown. In this way, before the first countdown ends, if the electronic device detects that someone enters the first area, the first countdown is interrupted and the mural interface is kept displayed.

[0014] In a possible implementation, after the first countdown is displayed on the first interface, the method further includes: before it is detected that the user has left the first area for a fifth time period, if it is detected that the user has entered the first area, canceling the display of the second countdown.

[0015] In some examples, the first countdown is the same as or different from the second countdown.

[0016] In a possible implementation, the electronic device further includes a camera, and the first area is within the field of view FOV of the camera. In this way, the electronic device determines whether the user stays in the designated sub-area through the camera.

[0017] In a possible implementation, the first interface is a wallpaper interface. In this way, the electronic device displays the mural interface in a timely manner based on the display state and the switching condition, which satisfies the user's need to view the mural interface, and turns off the screen when not needed, thereby saving power consumption of the electronic device.

[0018] In a possible implementation, the method also includes one or more of the following: in response to detecting that a user enters the first area, switching the unmanned state to the occupied non-staying state; in response to detecting that the user stays in the second area for a first period of time, switching the occupied non-staying state to the occupied and staying state; in response to detecting that the user leaves the first area for a third period of time, switching the occupied and staying state to the unmanned state.

[0019] In some examples, in response to switching the occupied non-stop state to the occupied and stopped state, the display screen is turned on and the first interface is displayed.

[0020] In one possible implementation, after the first interface is displayed on the display screen, if it is detected that the time when the user leaves the first area reaches a second time period, the display screen is switched from displaying the first interface to turning off the screen, specifically including: when it is detected that the time when the stay state switches to the unmanned state reaches a sixth time period, the display screen is turned off, and the sixth time period is the difference between the second time period and the third time period.

[0021] In some examples, in response to detecting that a person is present and the duration of the stay state switching to the unmanned state reaches a sixth duration, the display screen is turned off.

[0022] In a possible implementation, the method further includes one or more of the following: in response to a first input, setting the state to be occupied and staying; in response to detecting that the time duration for which the user has left the first area reaches a third time duration, switching the state to be occupied and staying to the state to be unoccupied.

[0023] In some examples, in response to being set to an occupied and staying state, the display screen is turned off.

[0024] In a possible implementation, the method further includes one or more of the following: in response to detecting that the time duration of not receiving the input reaches a fourth time duration, setting the state to a occupied non-staying state; in response to detecting that the time duration of the user leaving the first area reaches a seventh time duration, switching the occupied non-staying state to an unoccupied state. The seventh time duration is less than the fifth time duration.

[0025] In some examples, in response to setting the state to an occupied non-staying state, the first interface is displayed.

[0026] In one possible implementation, if it is detected that the time when the user leaves the first area reaches the fifth time period, the display screen is turned off, specifically including: detecting that the time when the occupied non-staying state is switched to the unoccupied state reaches the sixth time period, turning off the display screen, and the sixth time period is the difference between the fifth time period and the seventh time period.

[0027] In a possible implementation, detecting that the user stays in the second area of ​​the first area for a first time period, lighting up the display screen and displaying the first interface on the display screen, specifically includes: capturing M frames of images through a camera for the first time period; detecting that the user is in the second area in the M frames of images, lighting up the display screen and displaying the first interface on the display screen. In this way, the electronic device determines whether the user is in the first area through the acquired images.

[0028] In a possible implementation, when it is detected that the user has left the first area for a second time period, the display screen is turned off, specifically including: collecting N frames of images by a camera for the second time period; and when it is detected that the N frames of images do not include the user, the display screen is turned off. In this way, the electronic device determines whether the user is in the first area through the acquired images.

[0029] In a possible implementation, if the decoration style of the room where the electronic device is located is the first decoration style and the light in the room where the electronic device is located is the first color temperature, the first interface includes the first display content; if the decoration style of the room where the electronic device is located is the first decoration style and the light in the room where the electronic device is located is the second color temperature, the first interface includes the second display content, the first color temperature is different from the second color temperature, and the first display content and the second display content have different tones; if the decoration style of the room where the electronic device is located is the second decoration style and the light in the room where the electronic device is located is the first color temperature, the first interface includes the third display content, the first decoration style is different from the second decoration style, and the first display content and the third display content have different types. In this way, the electronic device displays works that are consistent with the style of the environment where the electronic device is located in the first interface, so that the user's sense of immersion and envelopment is enhanced, and the user experience is improved.

[0030] In a possible implementation, after displaying the first interface, the method further includes: receiving a second input for the first interface; and displaying a first animation effect on the first interface in response to the second input. Receiving a third input of the first interface; and displaying a second animation effect on the first interface in response to the third input, wherein the second input is different from the third input, and the first animation effect is different from the second animation effect. In this way, the first interface provides the user with an interactive function, the electronic device perceives the user's interactive behavior, and outputs a corresponding interactive result based on the user's interactive behavior, thereby increasing the fun and interactivity of the mural interface.

[0031] In the second aspect, the present application provides a display method, which is applied to an electronic device, wherein the electronic device includes a display screen, and the method includes: the display screen is turned off; when the display screen remains turned off, a user is detected to enter a first area; after the user is detected to enter the first area, if it is detected that the user has been staring at the display screen for a first time, the display screen is switched from being turned off to being turned on and a first interface is displayed on the display screen; after the first interface is displayed on the display screen, if it is detected that the user has left the first area for a second time, the display screen is switched from displaying the first interface to being turned off; after the user is detected to enter the first area, if it is detected that the user has been staring at the display screen for less than the first time, the display screen is kept turned off. In this way, after the electronic device detects that the user is in the specified area, it detects whether the user is staring at the electronic device, which can save the power consumption of the electronic device to determine the user's visual range. In addition, the electronic device 100 can confirm that the user wants to view the mural interface after detecting that the user has been staring at the electronic device for a preset staring time, and provide the mural interface to the user. When the user is in the specified area, the electronic device 100 does not need to determine whether the user is staring at the electronic device, thereby reducing the power consumption of the electronic device.

[0032] In some examples, a gaze is a user's gaze directed toward an electronic device.

[0033] In one possible implementation, the method also includes: in response to receiving a first input, turning off the display screen; when the display screen is turned off, detecting whether the user leaves the first area; if it is detected that the time duration when the user leaves the first area reaches a third time duration, detecting whether the user enters the first area, and the third time duration is less than the second time duration.

[0034] In one possible implementation, the method also includes: displaying a second interface on the display screen, the second interface being different from the first interface; when the display screen displays the second interface, detecting user input, and if it is detected that a period of time during which no user input has been received reaches a fourth period of time, displaying the first interface on the display screen; when displaying the first interface on the display screen, detecting whether the user has left the first area, and if it is detected that the user has left the first area reaches a fifth period of time, turning off the display screen.

[0035] In one possible implementation, after displaying the first interface on the display screen and before switching the display screen from displaying the first interface to turning off the screen, the method further includes: detecting that the time duration when the user has been away from the first area reaches a third time duration, displaying a first countdown on the first interface, the time duration of the first countdown is equal to a sixth time duration, and the sixth time duration is the difference between the second time duration and the third time duration; or detecting that the time duration when the user has been away from the first area reaches a seventh time duration, displaying a second countdown on the first interface, the time duration of the second countdown is equal to the sixth time duration, and the sixth time duration is the difference between the fifth time duration and the seventh time duration.

[0036] In a possible implementation, after the first countdown is displayed on the first interface, the method further includes: before it is detected that the user has left the first area for a second time period, if it is detected that the user has entered the first area, canceling the display of the first countdown.

[0037] In a possible implementation, after the first countdown is displayed on the first interface, the method further includes: before it is detected that the user has left the first area for a fifth time period, if it is detected that the user has entered the first area, canceling the display of the second countdown.

[0038] In some examples, the first countdown is the same as or different from the second countdown.

[0039] In a possible implementation, the electronic device further includes a camera, and the first area is within the field of view FOV of the camera. In this way, the electronic device determines whether the user stays in the designated sub-area through the camera.

[0040] In a possible implementation, the first interface is a wallpaper interface. In this way, the electronic device displays the mural interface in a timely manner based on the display state and the switching condition, which satisfies the user's need to view the mural interface, and turns off the screen when not needed, thereby saving power consumption of the electronic device.

[0041] In one possible implementation, the method also includes one or more of the following: in response to detecting that a user enters a first area, switching the unmanned state to an occupied non-staying state; in response to detecting that a user stares at the electronic device for a first period of time, switching the occupied non-staying state to an occupied and staying state; in response to detecting that the user leaves the first area for a third period of time, switching the occupied and staying state to an unmanned state.

[0042] In some examples, in response to switching the occupied non-stop state to the occupied and stopped state, the display screen is turned on and the first interface is displayed.

[0043] In one possible implementation, after the first interface is displayed on the display screen, if it is detected that the time when the user leaves the first area reaches a second time period, the display screen is switched from displaying the first interface to turning off the screen, specifically including: when it is detected that the time when the stay state switches to the unmanned state reaches a sixth time period, the display screen is turned off, and the sixth time period is the difference between the second time period and the third time period.

[0044] In some examples, in response to detecting that a person is present and the duration of the stay state switching to the unmanned state reaches a sixth duration, the display screen is turned off.

[0045] In a possible implementation, the method further includes one or more of the following: in response to a first input, setting the state to be occupied and staying; in response to detecting that the time duration for which the user has left the first area reaches a third time duration, switching the state to be occupied and staying to the state to be unoccupied.

[0046] In some examples, in response to being set to an occupied and staying state, the display screen is turned off.

[0047] In a possible implementation, the method further includes one or more of the following: in response to detecting that the time duration of not receiving the input reaches a fourth time duration, setting the state to a occupied non-staying state; in response to detecting that the time duration of the user leaving the first area reaches a seventh time duration, switching the occupied non-staying state to an unoccupied state. The seventh time duration is less than the fifth time duration.

[0048] In some examples, in response to setting the state to an occupied non-staying state, the first interface is displayed.

[0049] In one possible implementation, if it is detected that the time when the user leaves the first area reaches the fifth time period, the display screen is turned off, specifically including: detecting that the time when the occupied non-staying state is switched to the unoccupied state reaches the sixth time period, turning off the display screen, and the sixth time period is the difference between the fifth time period and the seventh time period.

[0050] In a possible implementation, detecting that the user has been looking at the electronic device for a first time period, lighting up the display screen and displaying the first interface on the display screen, specifically includes: capturing M frames of images through a camera for the first time period; detecting that the user is looking at the electronic device in the M frames of images, lighting up the display screen and displaying the first interface on the display screen. In this way, the electronic device determines whether the user is in the first area through the acquired images.

[0051] In a possible implementation, when it is detected that the user has left the first area for a second time period, the display screen is turned off, specifically including: collecting N frames of images by a camera for the second time period; and when it is detected that the N frames of images do not include the user, the display screen is turned off. In this way, the electronic device determines whether the user is in the first area through the acquired images.

[0052] In a third aspect, the present application provides an electronic device comprising: a display screen, one or more processors and one or more memories, wherein the one or more memories are coupled to multiple processors, and the one or more memories are used to store executable programs. When the one or more processors execute the executable programs, the electronic device executes any possible implementation method as in the first aspect or the second aspect.

[0053] In a fourth aspect, the present application provides a readable storage medium storing a program, which, when executed on a processor of an electronic device, enables the electronic device to execute the method of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 A schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0055] Figure 2 A state switching schematic diagram provided for an embodiment of the present application;

[0056] Figure 3A-3D A set of designated area schematic diagrams provided for embodiments of the present application;

[0057] Figure 4 A schematic diagram of a state switching process provided in an embodiment of the present application;

[0058] Figure 5A Another state switching schematic diagram provided for an embodiment of the present application;

[0059] Figure 5B Another flow chart provided for an embodiment of the present application;

[0060] Figure 6 A schematic diagram of a line of sight projection range provided in an embodiment of the present application;

[0061] Figure 7 A schematic diagram of a coordinate system provided in an embodiment of the present application;

[0062] Figure 8A-8D A schematic diagram of a group of sight line projection ranges provided in an embodiment of the present application;

[0063] Fig. 9 Another flow chart provided for an embodiment of the present application;

[0064] Figure 10A-10C A set of scenario schematic diagrams provided for embodiments of the present application;

[0065] Fig.11 Another flow chart provided for an embodiment of the present application;

[0066] Figure 12A-12CA set of scenario schematic diagrams provided for embodiments of the present application;

[0067] Figure 13A-13B Another set of scenario schematic diagrams provided for embodiments of the present application;

[0068] Figure 14A-14B Another set of scenario schematic diagrams provided for embodiments of the present application;

[0069] Fig.15 Another scene schematic diagram provided for an embodiment of the present application. DETAILED DESCRIPTION

[0070] The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0071] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0072] First, the electronic device 100 provided in the embodiment of the present application is introduced.

[0073] The electronic device 100 may be an electronic device including a display screen. For example, the electronic device 100 may be a television, a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an artificial intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device, and / or a smart city device. In some examples, the electronic device 100 may also be a projection device, and the embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.

[0074] Figure 1 A schematic diagram of the hardware structure of the electronic device 100 is shown.

[0075] The electronic device 100 may include, but is not limited to, a processor 110 , a display screen 120 , an audio module 130 , a camera 140 , a communication module 150 , a memory 160 , a power module 170 , and the like.

[0076] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0077] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0078] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0079] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0080] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, etc. Among them, the HDMI interface is a fully digital video and sound transmission interface that can send uncompressed audio and video signals. In some embodiments, the electronic device 100 can establish a connection with a set-top box through the HDMI interface and obtain video and audio signals through the set-top box. Among them, the USB interface is an interface that complies with the USB standard specification, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface can be used to transmit data between the electronic device 100 and other electronic devices.

[0081] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above-mentioned embodiments, or a combination of multiple interface connection methods. It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above-mentioned embodiments, or a combination of multiple interface connection methods.

[0082] The electronic device 100 implements the display function through a GPU, a display screen 120, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 120 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0083] The display screen 120 is used to display images, videos, etc. The display screen 120 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 120, where N is a positive integer greater than 1.

[0084] The electronic device 100 may also include a pressure sensor, a touch sensor, and the like. Among them, the pressure sensor may be used to sense a pressure signal and convert the pressure signal into an electrical signal. In some examples, the pressure sensor may be disposed on the display screen 120 to detect a pressure signal generated by a user pressing the display screen 120. Among them, the touch sensor is also referred to as a "touch panel". The touch sensor may be disposed on the display screen 120, and a touch screen composed of the touch sensor and the display screen 120 is also referred to as a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor may pass the detected touch operation to an application processor to determine the type of touch event. The electronic device 100 may provide visual output related to the touch operation through the display screen 120. In other embodiments, the touch sensor may also be disposed on the surface of the electronic device 100, which is different from the position where the display screen 120 is located.

[0085] The audio module 130 can be used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. The audio module 130 can also be used to encode and decode audio signals. In some embodiments, the audio module 130 can be arranged in the processor 110, or some functional modules of the audio module 130 can be arranged in the processor 110. The speaker 130A can be used to convert audio electrical signals into sound signals. The electronic device 100 can listen to the dubbing, music of video games, etc., or listen to calls, etc. through the speaker 130A. The microphone 130B can be used to convert sound signals into electrical signals. The electronic device 100 can realize the functions of collecting sound signals, noise reduction, identifying sound sources, recording, etc. through the microphone 130B.

[0086] The electronic device 100 can realize the shooting function through ISP, camera 140, video codec, GPU, display screen 120 and application processor. ISP is used to process the data fed back by camera 140. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise and brightness of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 140.

[0087] The camera 140 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 140, where N is a positive integer greater than 1.

[0088] In the embodiment of the present application, the electronic device 100 can collect images acquired by the camera through the camera 140. The images acquired by the camera can be used by the electronic device 100 to determine whether the user is in a designated area and whether the user's line of sight projection range includes the electronic device 100. The images acquired by the camera can also be used by the electronic device 100 to search and display a mural interface that fits the current scene.

[0089] The communication module 150 can be used for data transmission between the electronic device 100 and other electronic devices. The communication module 150 can provide communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), infrared technology (IR), Bluetooth (BT), frequency modulation (FM), near field communication technology (NFC), etc. applied to the electronic device 100. Among them, the Bluetooth communication solution can include one or more of classic Bluetooth (basic rate / enhanced data rate, BR / EDR) or Bluetooth low energy (BLE).

[0090] In an embodiment of the present application, the electronic device 100 can receive a control signal from the remote control device 200 through the communication module 150. The processor 110 can perform operations such as switching channels, adjusting the volume, turning off the screen, and turning on the screen based on the control signal. For example, the control signal sent by the remote control device 200 can be an infrared signal, a Bluetooth signal, and the like. For example, the remote control device 200 may include a power button, a return button, and the like. Among them, the power button can be used to trigger the remote control device 200 to notify the electronic device 100 to turn off the screen or turn on the screen. Among them, the remote control device 200 can be a remote controller. In this way, the electronic device 100 can process the control signal sent by the remote control device 200, and feed back the processing result to the user through the display screen 120. The user can control the content displayed by the electronic device 100 through the remote control device 200.

[0091] In some examples, the electronic device 100 may display a cursor, and the cursor may be used to prompt the user to point the remote control device 200 to the icon displayed on the electronic device 100. The remote control device 200 may be used to receive input from the user moving the remote control device 200, and send a control signal to the electronic device 100, and the control signal may be used to control the cursor to move on the display screen of the electronic device 100. In this way, the user may move the cursor displayed on the electronic device 100 by moving the remote control device 200 to select the corresponding icon.

[0092] Alternatively, the remote control device 200 may include a touch pad, which may be used to receive a user's touch input and generate a control signal according to the user's finger touch action, and the control signal may be used to control the cursor to move on the display screen of the electronic device 100. In this way, the cursor of the electronic device 100 may move as the user moves on the touch pad of the remote control device 200. The user may control the cursor displayed by the electronic device 100 through the remote control device 200.

[0093] It should be noted that the remote control device 200 is not limited to a remote control, and can also be an electronic device such as a mobile phone or a tablet. The remote control device 200 can be installed with a remote control application, and the remote control application can display controls corresponding to the function keys of the remote control device 200 on the touch screen of the remote control device 200. The user can control the functions of the electronic device 100 through the controls provided by the remote control application.

[0094] The memory 160 may be used to store various software programs and / or multiple sets of instructions, and the processor 110 may implement application functions provided by the electronic device 100 by running the software programs and / or multiple sets of instructions stored in the memory 160. In a specific implementation, the memory 160 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.

[0095] The power module 170 may be configured to receive input of a power source and supply power to various components of the electronic device 100 .

[0096] In some examples, the electronic device may further include an ambient light sensor, which may be used to sense ambient light intensity.

[0097] In some examples, the electronic device 100 may also include one or more buttons, which may include but are not limited to a power button, a volume button, etc.

[0098] In some examples, the electronic device 100 may further include one or more atmosphere lights. When displaying the mural interface, the electronic device 100 may light up the one or more atmosphere lights and control the brightness, color temperature, etc. of the one or more atmosphere lights. In this way, the electronic device 100 may provide the user with a better viewing effect of the mural interface.

[0099] In one possible implementation, the electronic device 100 turns off the screen. If the electronic device 100 detects that the user enters the designated area, the electronic device 100 turns on the screen and displays the mural interface. If the electronic device 100 detects that the user leaves the designated area and the time spent away from the designated area reaches the preset departure time, the electronic device 100 turns off the screen. In this way, the electronic device 100 can display the mural interface when it detects that the user stays in front of the electronic device 100. The electronic device 100 can also perform the screen turning off operation after detecting that the user has left, achieving the effect of turning on the screen when the person is there and turning off the screen when the person leaves.

[0100] In order to better describe the display method provided in the embodiment of the present application. First, the type of user interface displayed by the electronic device 100 in the embodiment of the present application is introduced. Among them, after the screen of the electronic device 100 is turned off, the display screen of the electronic device 100 is in the off state and no interface is displayed. After the screen of the electronic device 100 is turned on, the electronic device 100 can display the user interface through the display screen. Among them, the user interface may include but is not limited to a non-task interface, a task interface, and a mural interface.

[0101] Among them, the task interface can be used to play multimedia files (e.g., video, audio, etc.). For example, the task interface can include but is not limited to a video playback interface, a music playback interface, a game interface, etc. Users can watch videos, listen to audio, and participate in games through the task interface.

[0102] The mural interface can be used to display images such as paintings and photos. When the electronic device 100 displays the mural interface, the electronic device 100 can be in a standby state. The mural interface can also be called a wallpaper, a screen saver, etc.

[0103] For the sake of convenience, the interface other than the task interface and the mural interface may be referred to as a "non-task interface". For example, the non-task interface may include but is not limited to the desktop (also known as the main interface), the setting interface, the channel selection interface, and the like. Exemplarily, the non-task interface may include one or more functional controls, which may include but are not limited to the setting control, the application control and / or the video preview control, and the like. For example, the setting control may be used to adjust the signal source of the electronic device 100, adjust the screen brightness of the electronic device 100, pause the video, adjust the playback progress of the video, adjust the playback speed of the video, and the like. The application control may be used to trigger the electronic device 100 to display the interface of the application, for example, the application control may include a video application control, a music application control, a game application control, and the like. Among them, the video application control may be used to trigger the electronic device 100 to display the main interface of the video application. Among them, the video preview control may be used to trigger the electronic device 100 to play the video corresponding to the video preview control.

[0104] It should be noted that when the electronic device 100 displays the mural interface, the electronic device 100 may display the main interface in response to the control signal after receiving the control signal for displaying the main interface sent by the remote control device 200. For example, the remote control device 200 may send the control signal to the electronic device 100 after receiving the user's input for the power key (e.g., a press input). Similarly, when the electronic device 100 displays the task interface, the electronic device 100 may display the non-task interface in response to the control information after receiving the control signal for exiting the task interface sent by the remote control device 200. For example, the remote control device 200 may send the control signal to the electronic device 100 after receiving the user's input for the return key (e.g., a press input).

[0105] In some examples, the electronic device 100 can set two states for the designated area, and the two states include an unmanned state and a manned state. When the electronic device 100 sets the designated area to an unmanned state and the electronic device 100 turns off the screen, the electronic device 100 can switch the state of the designated area from the unmanned state to the manned state when detecting that the user enters the designated area, and at the same time, the electronic device 100 lights up the screen and displays the mural interface. When the electronic device 100 sets the designated area to the manned state and the electronic device 100 displays the mural interface, the electronic device 100 can detect that the user leaves the designated area and the time of leaving the designated area reaches the preset departure time, and the electronic device 100 switches the state of the designated area from the manned state to the unmanned state, and turns off the screen. Among them, the designated area can be any area that the electronic device 100 can detect. Exemplarily, the designated area can be located in front of the display screen of the electronic device 100, for example, directly in front of the display screen of the electronic device 100 or diagonally in front of the display screen. In this way, the electronic device 100 can not only display the mural interface when detecting that the user is in the designated area, improve the beauty of the scene, but also turn off the screen after detecting that the user leaves the designated area, saving the power consumption of the electronic device 100.

[0106] It should be noted that the description of setting the status of the designated area in the embodiment of the present application is only an example. The electronic device 100 may not need to set the status of the designated area. It only needs to detect that the user enters the designated area and whether the user has been away from the designated area for a preset departure time. The screen can be turned off or the mural interface can be displayed based on the detection result. The embodiment of the present application is not limited to this.

[0107] The embodiment of the present application provides a display method. The electronic device 100 turns off the screen. After the electronic device 100 detects that the user enters the designated area, detects that the user enters the designated area and the length of time the user stays in the designated sub-area of ​​the designated area reaches a preset length of time (for example, 5 seconds), the electronic device 100 turns on the screen and displays the mural interface. The electronic device 100 displays the wallpaper interface, and after the electronic device 100 detects that the user leaves the designated area and the length of time the user leaves the designated area reaches the preset length of time, the electronic device 100 turns off the screen. Among them, the designated area can be located in front of the display screen of the electronic device 100. In this way, when the user is going to the destination, the user tends to rush to the destination during this process and does not pay attention to whether the electronic device 100 displays the mural interface. Therefore, after the electronic device 100 detects that the user appears in the designated area, because the length of time the user stays in the designated sub-area does not reach the preset length of time, the electronic device 100 still remains in the off-screen state until the electronic device 100 determines that the user stays in the designated sub-area for a period of time, and then displays the mural interface. This avoids the electronic device 100 frequently lighting up the screen when the user passes by, thereby interfering with the user's actions and saving power consumption of the electronic device 100.

[0108] It should be noted that when the electronic device 100 remains off, it detects that the user has entered the designated area. If the electronic device 100 detects that the user has stayed in the designated area for a preset duration and in the designated sub-area for a preset duration, the electronic device 100 switches the display screen from off to on and displays the mural interface on the display screen. If the electronic device 100 detects that the user has stayed in the designated area for a preset duration but has not stayed in the designated sub-area for a preset duration, the electronic device 100 remains off.

[0109] Exemplarily, the electronic device 100 can set three states for the designated area, including an unmanned state, a manned non-stop state, and a manned and stop state. Alternatively, the electronic device 100 can also set these three states for the user, which is not limited in the embodiments of the present application. The electronic device 100 can determine whether to display the mural interface based on the state of the designated area after the interface displayed by the electronic device 100 is switched. In some examples, the electronic device 100 can implement the state switching operation of the electronic device 100 on the designated area by setting a finite state machine.

[0110] In some examples, the electronic device 100 may Figure 2 Steps 1 to 4 shown in the figure are used to switch between the three states. The specific switching process is as follows:

[0111] 1. If the electronic device 100 sets the designated area to be in an unmanned state. When the electronic device 100 detects that a user enters the designated area, the state of the designated area is switched from an unmanned state to a manned non-staying state.

[0112] 2. If the electronic device 100 sets the designated area to be in a state where someone is not staying. When the electronic device 100 detects that the user has stayed in the designated sub-area for a preset time 21 (for example, 5 seconds), the designated area can be set to switch from the state where someone is not staying to the state where someone is staying. The designated area includes the designated sub-area.

[0113] 3. If the electronic device 100 sets the designated area to be in a state where people are not staying. When the electronic device 100 detects that the user has been away from the designated area for a preset time period 22, the designated area can be set to switch from the state where people are not staying to the state where no one is.

[0114] 4. If the electronic device 100 sets the designated area to be in the state of someone staying. When the electronic device 100 detects that the user moves in the designated area, the designated area can be set to switch from the state of someone staying to the state of someone not staying.

[0115] The movement of the user in the designated area may be understood as the user leaving the designated sub-area in the designated area.

[0116] In some examples, the designated sub-area is the same as the designated area. The electronic device 100 detecting that the user stays in the designated sub-area can be the electronic device 100 detecting that the user is within the range of the designated area. In this way, when the electronic device 100 detects that the user stays in the designated sub-area, the mural interface can be displayed to the user to improve the aesthetics of the space.

[0117] In other examples, the designated sub-area is smaller than the designated area and all or part of the designated sub-area belongs to the designated area. Among them, the electronic device 100 detects that the user stays in the designated sub-area for the electronic device 100 to detect that the user stays in the designated area and stays in the designated sub-area. For example, the designated sub-area may include an area whose center is the user's position at the starting time point of the preset stay duration and whose radius is a preset radius (for example, 0.3 meters, 0.5 meters, etc.). Among them, the electronic device 100 detects that the user moves in the designated area, which can be understood as the electronic device 100 detecting that the user leaves the designated sub-area, and the electronic device 100 detects that the user does not leave the designated area. In this way, when the electronic device 100 detects that the user does not stay in the designated sub-area and walks in the designated area (for example, the user sweeps or mops the floor in the designated area), the electronic device 100 can keep the screen off. When the electronic device 100 detects that the user stays in the designated sub-area (for example, the user sits quietly in the designated sub-area, etc.), the electronic device 100 can display the mural interface. This avoids the situation where the user is doing housework in the designated area and prefers the electronic device 100 to keep the screen off while the electronic device 100 displays the mural interface, thereby saving power consumption of the electronic device 100.

[0118] Among them, when the electronic device 100 turns off the screen and sets the state of the designated area to an unmanned state, the screen can be turned on and the mural interface can be displayed after the state of the designated area is switched from an unmanned state to an occupied and stopped state through steps 1 and 2. When the electronic device 100 displays the mural interface and sets the state of the designated area to an occupied and stopped state, the screen can be turned off after the state of the designated area is switched from an occupied and stopped state to an unmanned state through steps 4 and 3. In this way, the electronic device 100 sets the occupied and non-stop state of the designated area, so that after confirming that the user has stayed in front of the electronic device 100 for a period of time, the electronic device 100 switches to the occupied and stopped state, and then turns on the screen and displays the mural interface, which can avoid the situation where the screen is frequently turned on and off.

[0119] In a possible implementation, after the state of the designated area of ​​the electronic device 100 displaying the mural interface is switched to an unmanned state, the electronic device 100 can turn off the screen after detecting that the duration of the state of the designated area switching to the unmanned state reaches a preset switching duration. In this way, the electronic device 100 keeps displaying the mural interface after switching to an unmanned state, so that the user can leave the designated area for a short time and continue to enjoy the mural interface after returning to the designated area.

[0120] In a possible implementation, the electronic device 100 displays a non-task interface. When the electronic device 100 detects that no user input is received within a preset response time, the electronic device 100 may display a mural interface and set the state of the designated area to a non-staying state.

[0121] In one possible implementation, the electronic device 100 displays a user interface. After receiving the screen-off input from the user, the electronic device 100 may respond to the input by turning off the screen and setting the state of the designated area to a state where someone is staying. At this point, it can be considered that the user wants to turn off the screen and does not intend to light up the screen of the electronic device and display the mural interface, that is, although the state of the designated area is a state where someone is staying, the electronic device 100 will not light up the screen and display the mural interface. In this way, when the electronic device 100 receives the screen-off input, even if the user may still be staying in the designated sub-area, the electronic device 100 will not light up the screen and display the mural interface again.

[0122] In other examples, the electronic device 100 may Figure 2 Steps 1, 2, 3 and 5 shown in the figure implement switching between the three states, wherein the descriptions of steps 1 to 3 can refer to the above embodiments and will not be repeated here. The following is step 5:

[0123] 5. If the electronic device 100 sets the designated area to be in a state where someone is staying. When the electronic device 100 detects that the user has been away from the designated area for a preset time period 23, the designated area can be set to switch from the state where someone is staying to the state where no one is. The preset time period 23 and the preset time period 22 can be the same or different.

[0124] Among them, when the electronic device 100 turns off the screen and sets the state of the designated area to an unmanned state, the screen can be turned on and the mural interface can be displayed after the state of the designated area is switched from an unmanned state to an occupied and stayed state through steps 1 and 2. When the electronic device 100 displays the mural interface and sets the state of the designated area to an occupied and stayed state, the screen can be turned off after the state of the designated area is switched from an occupied and stayed state to an unmanned state through step 5. Among them, the description of the electronic device 100 detecting that the user is staying in the designated sub-area can be found in the above embodiment, and will not be repeated here. In this way, when the state of the electronic device 100 in the designated area is an occupied and stayed state, after the user leaves the designated area, there is no need to first switch the state of the designated area to an occupied non-staying state, and then switch to an unmanned state, thereby reducing unnecessary state switching.

[0125] In a possible implementation, the electronic device 100 displays a user interface. After receiving a screen-off input from the user, the electronic device 100 may, in response to the input, turn off the screen and set the state of the designated area to a occupied and staying state.

[0126] In this way, after the electronic device 100 turns off the screen, it may still detect that the user is in the designated area of ​​the electronic device 100. Therefore, the electronic device 100 can set the state of the designated area to the occupied and stayed state after receiving the screen-off input. Since the user controls the electronic device 100 to turn off the screen, it indicates that the user tends to control the electronic device 100 to turn off the screen rather than turn on the screen to display the mural interface. Although the electronic device 100 sets the state of the designated area to the occupied and stayed state, the electronic device 100 will remain off until the electronic device 100 detects that the user has left the designated area for a preset time length of 23. After switching the state of the designated area to the unoccupied state, the state of the designated area is switched from the unoccupied state to the occupied and stayed state again, and the electronic device 100 can display the mural interface. Furthermore, the state of the designated area of ​​the electronic device 100 cannot be switched from the occupied and staying state to the occupied non-staying state. This can also prevent the user from moving in the designated area (for example, changing position in the designated area, going to the designated area to get water and then returning to the designated area for a short leave, etc.), and then the electronic device 100 switches the state of the designated area from the occupied and staying state to the occupied non-staying state, and then switches from the occupied non-staying state to the occupied and staying state, and after switching the state of the designated area to the occupied and staying state, the screen turns on again and displays the mural interface, which meets the user's idea of ​​wanting the electronic device 100 to keep the screen off.

[0127] It should be noted that in the following embodiments of the present application, after the electronic device 100 sets the designated area to the state of people staying, the electronic device 100 switches the state of the designated area from the state of people staying to the state of no people after detecting that the time for which the user has left the designated area reaches the preset time 23. In other words, the electronic device 100 will not execute step 4. In this way, the electronic device 100 can reduce the number of switching times, and when the electronic device 100 receives the screen-off input, the user is still within the designated area, and the electronic device 100 will not light up the screen again.

[0128] In a possible implementation, the electronic device 100 displays a non-task interface. If the electronic device 100 does not receive the user's input within the preset response time, the electronic device 100 can display the mural interface and set the state of the designated area to a non-staying state. In this way, if the electronic device 100 detects that the user has not operated the electronic device 100 within the preset response time, the electronic device 100 can display the mural interface, display paintings or photos, and enhance the aesthetics of the space where the electronic device 100 is located. The electronic device 100 sets the state of the designated area to a non-staying state. If the user stays in the designated sub-area of ​​the electronic device 100 and the length of stay reaches the preset time length 21, the electronic device 100 sets the state of the designated area to a state of someone and staying. At this time, even if the user does not operate the electronic device 100, the electronic device 100 displays the mural interface, which can bring a better viewing experience to the user. For example, when the user is talking to a contact and it is inconvenient to operate the electronic device 100, the user can watch the mural interface displayed by the electronic device 100, so that the user can appreciate the mural interface during the call. If the electronic device 100 detects that the user has been away from the designated area for a preset time period of 22, the electronic device 100 may switch the state of the designated area to an unmanned state and then perform a screen-off operation to save power consumption of the electronic device 100.

[0129] Next, the designated area in the embodiment of the present application is exemplarily described. The designated area can be any area that can be detected by the electronic device 100. For example, the designated area can be in front of the display screen of the electronic device 100. In this way, the user standing in the designated area can view the content displayed on the display screen of the electronic device 100.

[0130] In some examples, the electronic device 100 can detect whether the user is in a designated area and whether the user's stay in the designated sub-area reaches a preset time length 21 through a camera, an infrared sensor, Wi-Fi human sensing technology, Wi-Fi fingerprint positioning technology, etc. The embodiments of the present application are not limited to this.

[0131] The embodiments of the present application are described by taking the detection of the state of a specified area through an image captured by a camera as an example. In the following embodiments, the camera of the electronic device 100 is oriented in the same direction as the display screen of the electronic device 100. The specified area may be the field of view (FOV) area of ​​the camera of the electronic device 100. Among them, the electronic device 100 may capture an image in front of the screen of the electronic device 100 through a camera at a preset interval (for example, 2s), and determine the state of the specified area based on the image captured by the camera. The image captured by the camera can be used to indicate whether the user is located in the specified area. Among them, the specified area is a position within the field of view of the camera of the electronic device 100. The image captured by the camera can also be used to indicate whether the user remains still in the specified area.

[0132] Exemplarily, the electronic device 100 may identify whether the image acquired by the camera includes the user through an image recognition algorithm. When the electronic device 100 determines, based on the image acquired by the camera, that the image area corresponding to the specified area in the image acquired by the camera includes the user, it is determined that the user is located in the specified area. When the electronic device 100 determines, based on the image acquired by the camera, that the image area corresponding to the specified area in the image acquired by the camera does not include the user, it is determined that the user has left the specified area. The image area corresponding to the specified area may be an area including all or part of the content of the image. The embodiment of the present application is described by taking the example that the image area corresponding to the specified area includes the entire content of the image acquired by the camera.

[0133] It can be understood that the electronic device 100 detects that the user stays in the designated area and the length of time the user stays in the designated sub-area reaches the preset time length 21, which includes that the electronic device 100 captures X frames of images through the camera within the preset time length 21, and the electronic device 100 detects that the X frames of images include the user, and that the user is located in the designated sub-area in the X frames of images, wherein the preset time length 21 is equal to the product of X and the preset interval time length, and X is a positive integer.

[0134] The electronic device 100 detects that the duration of the user leaving the designated area reaches the preset duration 22, including that the electronic device 100 collects Y frames of images through the camera within the preset duration 22, and the electronic device 100 detects that none of the Y frames of images include the user, wherein the preset duration 22 is equal to the product of Y and the preset interval duration, and Y is a positive integer. Similarly, the electronic device 100 detects that the duration of the user leaving the designated area reaches the preset duration 23, including that the electronic device 100 collects Z frames of images through the camera within the preset duration 23, and the electronic device 100 detects that none of the Z frames of images include the user, wherein the preset duration 23 is equal to the product of Z and the preset interval duration, and Z is a positive integer.

[0135] The image area corresponding to the designated sub-area may be an area with a preset length of the horizontal extension of the field of view area to the user's position at the start time point of the preset duration 21 in the field of view area of ​​the camera as the central axis. Figure 3A As shown, the image area corresponding to the specified area can be Figure 3A The area shown in the figure, the image area corresponding to the specified sub-area can be Figure 3A The area 301 is obtained by horizontally extending the preset length with the user as the center. For another example, the image obtained by the electronic device 100 through the camera is as follows Figure 3B As shown, the image area corresponding to the specified area can be Figure 3B The area shown in the figure, the image area corresponding to the specified sub-area can be Figure 3BThe area 302 is obtained by horizontally expanding the preset length with the user as the center. It can be understood that the size of the preset length of horizontal expansion can change with the position of the user in the image area corresponding to the specified area. Exemplarily, the electronic device 100 can determine the preset length of horizontal expansion based on the width of the user in the captured image, so as to determine that the closer the user is to the electronic device 100, the longer the width occupied by the user in the image captured by the electronic device 100, the length of the image area corresponding to the specified sub-area also increases accordingly, and the area occupied by the image area corresponding to the specified sub-area in the image captured by the electronic device 100 also increases accordingly. Figure 3A As shown in , the user width is width 1, and the width of the image area corresponding to the specified sub-area is width 2. Figure 3B As shown, the width of the user is width 3, and the width of the image area corresponding to the designated sub-area is width 4. The value of width 3 is greater than the value of width 1, and the value of width 4 is greater than the value of width 2. It should be noted that determining the width of the image area corresponding to the designated sub-area according to the width of the user, and then determining the image area corresponding to the designated sub-area is only an example, and the electronic device 100 may also determine the image area corresponding to the designated sub-area in other ways, which is not limited in the embodiments of the present application.

[0136] It should also be noted that the electronic device 100 can also determine the designated sub-area where the user is located and judge whether the user has left the designated sub-area based on the image obtained by the camera through an image processing algorithm, which is not limited to this embodiment of the present application.

[0137] In some examples, when the direction of the camera of the electronic device 100 remains unchanged, if the electronic device 100 detects that the user is at the edge of the specified area, such as Figure 3C The designated sub-region should be region 303, but since the camera of the electronic device 100 cannot obtain an image exceeding the designated region, in this case, the designated sub-region may be the intersection of region 303 and the designated region.

[0138] Optionally, the electronic device 100 detects that the user is at the edge of the designated area, such as Figure 3C The electronic device 100 can control the camera to rotate toward the direction where the user is located, and determine that the designated sub-area is Figure 3DThe area 304 shown. After detecting that the user has left the area 304, the electronic device 100 can return the camera to its position and detect the positional relationship between the user and the designated area again. When the electronic device 100 detects that the user is at the edge of the designated area, the camera can be rotated toward the user's position again to determine the designated sub-area. When the electronic device 100 detects that the user is in the middle of the designated area, the angle of the camera can be maintained to determine the designated sub-area. When the electronic device 100 detects that the user has left the designated area, the electronic device 100 can detect whether the user has entered the designated area at a preset interval.

[0139] Exemplarily, after the electronic device 100 determines that the user is located in the designated area, it can also determine whether the duration of the user's stay in the designated sub-area reaches the preset duration 21 based on the image acquired by the camera. For example, after the electronic device 100 determines the designated sub-area at the starting time point of the preset duration 21, if the user is located in the designated sub-area in the images acquired within the preset duration 21, the electronic device 100 determines that the duration of the user's stay in the designated sub-area reaches the preset duration 21. When the electronic device 100 acquires a frame of image in which the user is located outside the designated sub-area within the preset duration 21 after the starting time point, it can determine that the duration of the user's stay in the designated sub-area does not reach the preset duration 21. After determining that the duration of the user's stay in the designated sub-area does not reach the preset duration 21, the electronic device 100 can perform the operation of detecting whether the duration of the user's stay in the designated sub-area reaches the preset duration 21 again.

[0140] In some examples, the electronic device 100 can determine whether the portable electronic device (e.g., mobile phone, smart watch, etc.) is located in the room where the electronic device 100 is located by indoor positioning technology, such as wireless fidelity (Wi-Fi) fingerprint positioning technology, Wi-Fi human body sensing technology, etc., so as to determine whether the user carrying the portable electronic device is located in the room of the electronic device 100. When the electronic device 100 determines that the portable electronic device is located in the room where the electronic device 100 is located, it performs the operation of determining whether the user is located in the designated area through the image collected by the camera and detecting whether the duration of the user's stay in the designated sub-area reaches the preset duration 21. Optionally, when the electronic device 100 determines that the portable electronic device is located in the room where the electronic device 100 is located, the electronic device 100 can also set the designated area to a non-staying state where someone is. In this way, the electronic device 100 collects the image obtained by the camera through the camera only when it is determined that the user and the electronic device 100 are in the same room, and determines the state of the designated area based on the image obtained by the camera, thereby saving the power consumption of the electronic device 100.

[0141] In some examples, the electronic device 100 preset duration 21 is less than the preset duration 22, and the preset duration 21 is less than the preset duration 23. In this way, the electronic device 100 can keep displaying the mural interface as long as possible after displaying the mural interface, reducing the number of screen off and screen on times.

[0142] Next, a flowchart of the display method provided in an embodiment of the present application is introduced.

[0143] For example, Figure 4 As shown, the switching process of the state of the designated area and the display content of the electronic device 100 is as follows:

[0144] 1. The electronic device 100 sets the designated area to be in an unmanned state, and the electronic device 100 displays the mural interface.

[0145] The designated area set by the electronic device 100 is in an unmanned state, and the electronic device 100 displays the mural interface. When the electronic device 100 detects that the user enters the designated area, it can execute step 2, that is, switch the state of the designated area from an unmanned state to a manned non-staying state, and keep displaying the mural interface.

[0146] The designated area set by the electronic device 100 is in an unmanned state, and the electronic device 100 displays the mural interface. After detecting that the designated area has been in an unmanned state for a preset switching time, the electronic device 100 can perform step 4, that is, keep the designated area in an unmanned state and turn off the screen.

[0147] In some examples, after the electronic device 100 switches to an unmanned state, a screen-off countdown can be set. The total duration of the screen-off countdown is the preset switching duration. Before the countdown of the electronic device 100 ends, if the electronic device 100 detects that someone has entered the designated area, the state of the designated area is switched to a non-staying state, and the screen-off countdown is interrupted, and the electronic device 100 continues to display the mural interface. If the electronic device 100 does not detect that someone has entered the designated area before the countdown ends, the electronic device 100 turns off the screen at the end of the countdown. It can be understood that when the countdown value becomes zero, the countdown can be considered to be over.

[0148] In some examples, the electronic device 100 may also display a screen-off countdown on the mural interface. Before the screen-off countdown ends, the electronic device 100 detects that the state of the designated area remains unmanned, and the electronic device 100 may turn off the screen at the end of the screen-off countdown. Before the screen-off countdown ends, the electronic device 100 detects that the user enters the designated area, and the electronic device 100 cancels the display of the screen-off countdown. In some examples, the electronic device 100 may display a pop-up window including a screen-off countdown on the mural interface. In this way, the electronic device 100 may display a screen-off countdown to indicate the time point when the electronic device 100 turns off the screen.

[0149] In some examples, the electronic device 100 may set a screen-off countdown 1 when switching from a occupied non-stop state to an unmanned state, and set a screen-off countdown 2 when switching from a occupied and stop state to an unmanned state. The screen-off countdown 1 and the screen-off countdown 2 may be the same or different.

[0150] The designated area set by the electronic device 100 is in an unmanned state, and the electronic device 100 displays a mural interface. After receiving the screen-off input, the electronic device 100 can execute step 6, that is, switch the state of the designated area from an unmanned state to a manned and staying state, and turn off the screen.

[0151] 2. The electronic device 100 sets the designated area to a state where people are not staying, and the electronic device 100 displays the mural interface.

[0152] The designated area set by the electronic device 100 is in a state where someone is not staying, and the electronic device 100 displays the mural interface. When the electronic device 100 detects that the user has stayed in the designated sub-area for a preset time length 21, it can execute step 3, that is, switch the state of the designated area from the state where someone is not staying to the state where someone is staying, and keep displaying the mural interface.

[0153] The designated area set by the electronic device 100 is in a state where people are not staying, and the electronic device 100 displays a mural interface. When the electronic device 100 detects that the time the user has left the designated area reaches a preset time 22, it can execute step 1, that is, switch the state of the designated area from the state where people are not staying to the state where no one is, and keep displaying the mural interface.

[0154] The designated area set by the electronic device 100 is in a state where someone is not staying, and the electronic device 100 displays the mural interface. After receiving the screen-off input, the electronic device 100 can execute step 6, that is, switch the state of the designated area from a state where someone is not staying to a state where someone is staying, and turn off the screen.

[0155] 3. The electronic device 100 sets the designated area to be in a state where someone is present and staying, and the electronic device 100 displays the mural interface.

[0156] The designated area set by the electronic device 100 is in a state where someone is staying, and the electronic device 100 displays a mural interface. When the electronic device 100 detects that the time the user has left the designated area reaches a preset time 23, it can execute step 1, that is, switch the state of the designated area from the state where someone is staying to the state where no one is, and keep displaying the mural interface.

[0157] The designated area set by the electronic device 100 is in the occupied and staying state, and the electronic device 100 displays the mural interface. After receiving the screen-off input, the electronic device 100 can perform step 6, that is, keep the state of the designated area in the occupied and staying state, and turn off the screen.

[0158] 4. The electronic device 100 sets the designated area to an unmanned state, and the screen of the electronic device 100 is turned off.

[0159] The designated area set by the electronic device 100 is in an unmanned state, and the screen of the electronic device 100 is turned off. When the electronic device 100 detects that the user enters the designated area, it can execute step 5, that is, switch the state of the designated area from an unmanned state to a manned non-staying state, and keep the screen off.

[0160] 5. The electronic device 100 sets the designated area to a non-resident state, and the screen of the electronic device 100 is turned off.

[0161] The designated area set by the electronic device 100 is in a state where someone is not staying, and the screen of the electronic device 100 is turned off. When the electronic device 100 detects that the user has stayed in the designated sub-area for a preset time length 21, it can execute step 3, that is, switch the state of the designated area from the state where someone is not staying to the state where someone is staying, and display the mural interface.

[0162] It should be noted that when the electronic device 100 sets the designated area to be in a state where someone is not staying, the electronic device 100 can detect that the user has stayed in the designated area for a preset time length 21 and in the designated sub-area for a preset time length 21. If the electronic device 100 detects that the user has stayed in the designated area for a preset time length 21, but has not stayed in the designated sub-area for a preset time length 21, the electronic device 100 keeps the designated area in a state where someone is not staying, and keeps the screen of the electronic device 100 off.

[0163] The designated area set by the electronic device 100 is in a state where someone is not staying, and the screen of the electronic device 100 is turned off. When the electronic device 100 detects that the time when the user leaves the designated area reaches a preset time 22, it can execute step 4, that is, switch the state of the designated area from the state where someone is not staying to the state where no one is, and keep the screen off.

[0164] 6. The electronic device 100 sets the designated area to be in a state where someone is staying, and the screen of the electronic device 100 is turned off.

[0165] The designated area set by the electronic device 100 is in the state of someone staying, and the screen of the electronic device 100 is turned off. When the electronic device 100 detects that the time the user has left the designated area reaches the preset time 23, it can execute step 4, that is, switch the state of the designated area from the state of someone staying to the state of no one, and keep the screen off.

[0166] 7. The electronic device 100 displays a non-task interface.

[0167] The electronic device 100 displays a non-task interface. The electronic device 100 detects that no user input is received within a preset response time, sets the state of the designated area to a non-staying state, and switches to displaying a mural interface.

[0168] The electronic device 100 displays a non-task interface. After receiving the screen-off input, the electronic device 100 may execute step 6, that is, keep the state of the designated area in a occupied and staying state, and turn off the screen.

[0169] 8. The electronic device 100 displays the task interface.

[0170] The electronic device 100 displays the task interface. After receiving the screen-off input, the electronic device 100 may execute step 6, that is, keep the state of the designated area in a occupied and staying state, and turn off the screen.

[0171] In summary, the state switching process and the display content switching process of the designated area of ​​the electronic device 100 are shown in Table 1 below:

[0172] Table 1: Table of changes in the designated area status and display status of the electronic device 100

[0173]

[0174]

[0175] As shown in Table 1, when the electronic device 100 is in different initial display states and initial states of a specified area, if it determines that the switching conditions shown in Table 1 are met, it can switch to the switched display state and the switched state of the specified area shown in Table 1.

[0176] In this way, the electronic device 100 can display the mural interface in time according to the status of the displayed interface and the designated area after switching, and the mural interface displayed by the electronic device 100 can be used to decorate the room, making the entire space more beautiful and coordinated. The electronic device 100 can also turn off the screen in time according to the change of the status of the designated area to save the power consumption of the electronic device 100.

[0177] In a possible implementation, the electronic device 100 may switch the state of the designated area from a state with people but not staying or a state with people and staying to a state without people within a specified time period (e.g., from midnight to six o'clock), and the electronic device 100 no longer performs the related operation of switching the state of the designated area from the state without people to the state without people. Wherein, when the electronic device 100 displays the mural interface and the state of the designated area is switched to the state without people, the electronic device 100 may also perform the screen-off operation after the duration of switching the state of the designated area to the state without people reaches a preset switching duration (e.g., 10s). Wherein, the electronic device 100 no longer performs the related operation of switching the state of the designated area from the state without people to the state without people may be the operation of the electronic device 100 stopping detecting whether there is a user in the designated area, or the operation of the electronic device 100 stopping the operation of displaying the mural interface in response to the state change of the designated area when the initial display state of the electronic device 100 is the screen-off state. In this way, after the electronic device 100 turns off the screen within the specified time period, the display screen will remain in the screen-off state and will not display the mural interface. Since the user tends to rest within the specified time period, the electronic device 100 stops switching the display state of the electronic device 100 from off-screen to displaying the mural interface within the specified time period to avoid disturbing the user's rest at night. Optionally, the electronic device 100 can provide the user with the function of setting a specified time period. In this way, the user can set the specified time period by himself. In this way, the electronic device 100 can display the mural interface only when it is appropriate, and keep the screen off at other times, which can not only decorate the room where the electronic device 100 is located, but also save the power consumption of the electronic device 100.

[0178] It should be noted that the description of setting the state of the designated area in the embodiment of the present application is only an example, and the electronic device 100 may not need to set the state of the designated area, and may also implement Figure 4 The operation of turning off the screen or displaying the mural interface is not limited in the embodiments of the present application.

[0179] In one possible implementation, when the screen of the electronic device 100 is in the off state, the electronic device 100 may light up the screen and display the mural interface when it detects that the user is looking at the electronic device 100. When the screen of the electronic device 100 displays the mural interface, the electronic device 100 may turn off the screen when it detects that the user is not looking at the electronic device 100. In this way, the electronic device 100 may display the mural interface only when it detects that the user is looking at the electronic device 100 (that is, the user's line of sight falls on the display screen of the electronic device 100). The electronic device 100 may keep the screen in the off state when it detects that the user is not looking at the electronic device 100 (that is, the user's line of sight does not fall on the display screen of the electronic device 100), thereby saving power consumption of the electronic device 100. Moreover, by displaying the mural interface only when the user is looking at the electronic device 100, it can also avoid the situation where the electronic device 100 displays the mural interface when the user lowers his head, thereby disturbing the user.

[0180] Exemplarily, the electronic device 100 may determine the user's visual range (also referred to as the user's visual range, visual projection range) based on the image acquired by the camera. The electronic device 100 may determine that the user is looking at the electronic device 100 when it is detected that the user's visual range includes the electronic device 100. The electronic device 100 may determine that the user is not looking at the electronic device 100 when it is detected that the user's visual range does not include the electronic device 100.

[0181] In some examples, the electronic device 100 may set two states for the user, and the two states include a gaze state and a non-gaze state. When the electronic device 100 sets the user to the non-gaze state and the electronic device 100 turns off the screen, the electronic device 100 may switch the user's state from the non-gaze state to the gaze state when detecting that the user is looking at the electronic device 100, and at the same time light up the screen of the electronic device 100 and display the mural interface. When the electronic device 100 sets the user to the gaze state and the electronic device 100 displays the mural interface, the electronic device 100 may switch the user's state from the gaze state to the non-gaze state and turn off the screen when detecting that the user is not looking at the electronic device 100. In this way, the electronic device 100 can not only display the mural interface when detecting that the user is looking at the electronic device 100, thereby improving the aesthetics of the scene, but also turn off the screen after detecting that the user is not looking at the electronic device 100, thereby saving the power consumption of the electronic device 100.

[0182] It should be noted that the description of setting the user's status in the embodiments of the present application is only an example. The electronic device 100 does not need to set the user's status. It only needs to detect whether the user is looking at the electronic device 100 to perform the operation of turning off the screen or displaying the mural interface based on the detection result. The embodiments of the present application are not limited to this.

[0183] In other examples, when the electronic device 100 turns off the screen, the electronic device 100 can display the mural interface when it detects that the user has been looking at the electronic device 100 for a preset looking time. When the electronic device 100 displays the mural interface, the electronic device 100 can turn off the screen when it detects that the user has been looking at the electronic device 100 for a preset non-looking time. In this way, the electronic device 100 will not turn off and on the screen frequently, which will increase the power consumption of the electronic device 100.

[0184] In a possible implementation, the electronic device 100 turns off the screen. After the electronic device 100 detects that the user enters the designated area, it detects that the user has been looking at the electronic device 100 for a preset looking time (for example, 5 seconds), and the electronic device 100 turns on the screen and displays the mural interface. The electronic device 100 displays the wallpaper interface, and after the electronic device 100 detects that the user leaves the designated area and the time spent away from the designated area reaches the preset leaving time, the electronic device 100 turns off the screen. Among them, the designated area can be located in front of the display screen of the electronic device 100. In this way, after the electronic device 100 detects that the user is located in the designated area, it detects whether the user is looking at the electronic device 100, which can save the power consumption of the electronic device 100 to determine the user's visual range. In addition, the electronic device 100 can confirm that the user wants to view the mural interface after detecting that the user has been looking at the electronic device 100 for a preset looking time, and provide the mural interface to the user. When the user is located in the designated area, the electronic device 100 does not need to determine whether the user is looking at the electronic device 100, thereby reducing the power consumption of the electronic device 100.

[0185] Exemplarily, the electronic device 100 can set three states for the designated area, including an unmanned state, a manned non-watching state, and a manned and watching state. Alternatively, the electronic device 100 can also set these three states for the user, which is not limited in the embodiments of the present application. The electronic device 100 can determine whether to display the mural interface based on the state of the designated area after the interface displayed by the electronic device 100 is switched. In some examples, the electronic device 100 can implement the state switching operation of the electronic device 100 on the designated area by setting a finite state machine.

[0186] Specifically, Figure 5A As shown, Figure 5A The unmanned state shown is the same as Figure 2 The displayed state corresponds to the unmanned state. Figure 5A The non-looking state shown is similar to Figure 2 The shown state corresponds to the occupied non-staying state. Figure 5A The person and gaze state shown is the same as Figure 2 The displayed state corresponds to the person and the stay state. Figure 2When the electronic device 100 shown detects that the user has been gazing at the designated area for a preset time period of 21, the state of the designated area is switched from an occupied non-staying state to an occupied and staying state. The electronic device 100 may switch the state of the designated area from an occupied non-looking state to an occupied and looking state when it detects that the user has been gazing at the electronic device 100 for a preset time period of 51. Specifically, when the electronic device 100 with the designated area in the state of an occupied non-looking state turns off the screen, the electronic device 100 may also turn on the screen and display the mural interface after switching the state of the designated area from an occupied non-looking state to an occupied and looking state. Specifically, the switching process of the display state of the electronic device 100 and the state switching process of the designated area can be referred to. Figure 2 and Figure 4 In this way, the electronic device 100 can display the mural interface only when it detects that the user is looking at the screen of the electronic device 100, and when the electronic device 100 detects that the user has left the designated area for a preset time period 23, the screen is turned off, which does not disturb the user and can also display the mural interface to the user at an appropriate time.

[0187] For example, Figure 5A As shown, the specific process of the electronic device 100 switching between the three states is as follows:

[0188] 1. If the electronic device 100 sets the designated area to be in an unattended state. When the electronic device 100 detects that a user enters the designated area, the state of the designated area is switched from an unattended state to a occupied non-attending state.

[0189] 2. If the electronic device 100 sets the designated area in the state of someone not looking. When the electronic device 100 detects that the user looks at the electronic device 100 for a preset time 51 (for example, 5 seconds), the designated area can be set to switch from the state of someone not looking to the state of someone and looking.

[0190] 3. If the electronic device 100 sets the designated area to be in a state where someone is not looking at it. When the electronic device 100 detects that the user has been away from the designated area for a preset time period 52, the designated area can be set to switch from the state where someone is not looking at it to the state where no one is looking at it.

[0191] 4. If the electronic device 100 sets the designated area to be in a state of people and watching. When the electronic device 100 detects that the user has left the designated area for a preset time length 53, the designated area can be set to switch from the state of people and watching to the state of no one. Figure 5A A description of each step can be found in Figure 2 as well as Figure 4 The illustrated embodiments will not be described in detail here.

[0192] Optionally, not limited to step 4, the electronic device 100 can also switch from the attended and attended state to the attended and non-attended state by detecting that the time when the user is not looking at the electronic device 100 reaches a preset time 54. This embodiment of the present application is not limited to this.

[0193] For example, Figure 5B As shown, the electronic device 100 detects whether the time for which the user stares at the electronic device 100 exceeds a preset staring time as follows:

[0194] S501. The electronic device 100 acquires an image through a camera.

[0195] The screen of the electronic device 100 is in the off state. The electronic device 100 can acquire an image through the camera at a preset time interval, and after acquiring the image acquired by the camera, execute step S502.

[0196] S502. The electronic device 100 captures an image of the user's head based on the image acquired by the camera.

[0197] After acquiring the image acquired by the camera, the electronic device 100 can use an image recognition algorithm to identify the image of the user's head in the image acquired by the camera, and capture the image of the user's head from the image acquired by the camera.

[0198] It should be noted that when the electronic device 100 recognizes that the image acquired by the camera does not include the image of the user's head, step S501 can be executed. In this way, the electronic device 100 recognizes that the image acquired by the camera does not include the image of the user's head, and the electronic device 100 can re-acquire the image acquired by the camera.

[0199] S503. The electronic device 100 determines the user's head position and user's head posture based on the user's head image.

[0200] After the electronic device 100 acquires the user's head image, it can identify and determine the user's head position and the user's head posture.

[0201] In some examples, the electronic device 100 may be configured as follows: Figure 6The coordinate system O1X1Y1Z1 shown. Among them, the origin O1 is located at the center of the display screen of the electronic device 100, the Y1O1Z1 plane is parallel to the display screen of the electronic device 100, and the X1 axis is perpendicular to the display screen of the electronic device 100, pointing from the back shell of the electronic device 100 to the display screen of the electronic device 100. The electronic device 100 can determine the position of the user's head in the coordinate system O1X1Y1Z1 (that is, the user's head position). The electronic device 100 can determine the position of the user's line of sight projection range in the Y1O1Z1 plane and the size of the line of sight projection range based on the user's head position. For example, the user's head position can be expressed as (x, y, z). Among them, the x value can be used to determine the distance between the user's head and the electronic device 100 on the X1 axis. The smaller the x value, the closer the user is to the screen of the electronic device 100, and the smaller the line of sight projection range. The larger the x value, the farther the user is from the screen of the electronic device 100, and the larger the line of sight projection range. Among them, the y value can be used to determine the distance between the user's head and the electronic device 100 on the Y1 axis. The smaller the absolute value of the y value, the closer the user is to the screen of the electronic device 100 on the Y1 axis, and the closer the line of sight projection range is to the electronic device 100 on the Y1 axis. The larger the absolute value of the y value, the farther the user is from the screen of the electronic device 100 on the Y1 axis, and the farther the line of sight projection range is from the electronic device 100 on the Y1 axis. Among them, the z value can be used to determine the distance between the user's head and the electronic device 100 on the Z1 axis, that is, the z value can represent the height of the user's head. The smaller the absolute value of the z value, the closer the user is to the screen of the electronic device 100 on the Z1 axis, and the closer the line of sight projection range is to the electronic device 100 on the Z1 axis. The larger the absolute value of the z value, the farther the user is from the screen of the electronic device 100 on the Z1 axis, and the farther the line of sight projection range is from the electronic device 100 on the Z1 axis. It should be noted that in some scenarios, the line of sight projection range will be blocked by other obstacles (for example, the floor), so the user may move forward, the part of the line of sight projection range blocked by obstacles will decrease, and the line of sight projection range will become larger; the user may move backward, the part of the line of sight projection range blocked by obstacles will increase, and the line of sight projection range will become smaller.

[0202] It should be noted that the above coordinate system O1X1Y1Z1 is only an example. For example, the electronic device 100 can also place the Y1 axis at the position where the ground and the plane where the electronic device 100 are located intersect. When the difference between the height of the user's head and the height of the electronic device 100 is smaller, it means that the line of sight projection range is closer to the electronic device 100 on the Y1 axis. The embodiments of the present application are not limited to this.

[0203] In some examples, the electronic device 100 may be configured as follows: Figure 7The coordinate system O2X2Y2Z2 shown. Among them, the origin O2 is located at the user's head, the Y2O2Z2 plane is parallel to the display screen of the electronic device 100, and the X2 axis points vertically to the display screen of the electronic device 100. The electronic device 100 can determine the pitch angle (pitch), yaw angle (yaw) and roll angle (roll) of the user's head relative to the coordinate system O2X2Y2Z2 through the algorithm of head posture estimation. Among them, the pitch angle can be used to represent the angle of rotation of the user's head around the Y2 axis (that is, the angle at which the user lowers or raises his head). The yaw angle can be used to represent the angle of rotation of the user's head around the Z2 axis (that is, the angle at which the user turns his head to the left or right). The roll angle can be used to represent the angle of rotation of the user's head around the X2 axis (that is, the angle at which the user tilts his head to the lower left or lower right).

[0204] In some examples, when the user's head rotates around the X2 axis, the user's line of sight projection range will only move a specified distance in the Y2O2Z2 plane, and the specified distance does not exceed 10 cm. Therefore, in the following embodiments of the present application, the impact of the roll angle on the user's line of sight projection range may not be considered, and the user's line of sight projection range is determined only based on the user's head position, the pitch angle of the user's head, and the yaw angle of the user's head.

[0205] S504. The electronic device 100 determines the user's line of sight direction based on the user's head posture.

[0206] The electronic device 100 may determine the user's line of sight direction according to the user's horizontal viewing direction.

[0207] S505. Based on the position of the user's head, the electronic device 100 projects the user's line of sight onto the plane where the electronic device 100 is located, and determines the line of sight projection range.

[0208] The line of sight projection range may represent the visual field range of the user in which the electronic device 100 is located. The electronic device 100 may determine the line of sight projection range of the user's line of sight in the plane where the electronic device 100 is located according to the user's head position and head posture.

[0209] S506. The electronic device 100 determines whether the line of sight projection range includes the electronic device 100.

[0210] In some examples, the user's line of sight direction may include, but is not limited to, a left line of sight direction, a right line of sight direction, an upper line of sight direction, and a lower line of sight direction. Among them, the horizontal direction may be a direction perpendicular to the user's face and facing outward. The electronic device 100 may rotate the horizontal direction by an angle α (e.g., 80 degrees) toward the user's left hand to obtain the left line of sight direction. The electronic device 100 may rotate the horizontal direction by an angle α toward the user's right hand to obtain the right line of sight direction. The electronic device 100 may rotate the horizontal direction by a preset angle α toward the top of the user's head (i.e., upward) to obtain the upper line of sight direction. The electronic device 100 may rotate the horizontal direction by a preset angle α toward the user's feet (i.e., downward) to obtain the lower line of sight direction. Among them, the left line of sight direction may represent the field of view of the user's left side. The right line of sight direction may represent the field of view of the user's right side. The upper line of sight direction may represent the field of view of the upper side of the user. The lower line of sight direction may represent the field of view of the lower side of the user.

[0211] For example, the electronic device 100 may determine the left edge and the right edge of the line of sight projection range according to the yaw angle of the user's head. Fig. 8A In the top view shown, the user's head is located at position 1 on the plane X1O1Y1, the yaw angle of the user's head is zero, the projection of the horizontal direction 20 on the top view is perpendicular to the plane where the electronic device 100 is located, and the right sight direction 21 and the left sight direction 22 show the user's field of view in the top view. The electronic device 100 can determine the sight projection range based on the image obtained by the camera. Fig. 8A The visual range 23 shown includes the electronic device 100 .

[0212] like Fig. 8A As shown, if the user's head position is at position 2 to the right of position 1, the visual range 23 does not include the electronic device 100. If the user's head position is at position 3 to the left of position 1, the visual range 23 also does not include the electronic device 100. Therefore, when the user's head posture remains unchanged and the user's head position is at different positions along the Y1 axis, the visual projection range will also change with the change of the user's head position.

[0213] Similarly, if the user's head position is closer to the electronic device 100 than position 1 in the X1-axis direction, the user's line of sight projection range is smaller than the line of sight range 23. If the user's head position is farther away from the electronic device 100 than position 1 in the X1-axis direction, the user's line of sight projection range is larger than the line of sight range 23. However, since the horizontal viewing direction 20 points vertically to the electronic device 100, the forward or backward movement of the user's head position will not affect the relative position of the electronic device 100 and the horizontal viewing direction 20, and the center of the electronic device 100 is always located within the line of sight range 23. Therefore, the user's head posture remains unchanged, and when the user's head position is at different positions on the X1-axis, the size of the line of sight projection range will change with the change of the user's head position.

[0214] exist Figure 8B In the top view shown, the user's head is located at position 1 on the plane X1O1Y1, the yaw angle of the user's head is non-zero, the projection of the horizontal direction 24 on the top view is not perpendicular to the plane where the electronic device 100 is located, and the right sight line direction 25 and the left sight line direction 26 show the user's field of view in the top view. The electronic device 100 can determine the sight line projection range based on the image obtained by the camera. Figure 8B The visual range 27 is shown. The visual range 27 does not include the electronic device 100.

[0215] like Figure 8B As shown, if the user's head position is at position 2 to the left of position 1, the visual range 27 includes the electronic device 100. If the user's head position moves to the left from position 2, the visual range 27 will move to the other side of the electronic device 100 and will not include the electronic device 100. If the user's head position is at a position to the right of position 1, the visual range 27 will never include the electronic device 100. Therefore, when the user's head posture remains unchanged and the user's head position is at different positions along the Y1 axis, the visual projection range will also change with the change of the user's head position.

[0216] Similarly, if the user's head position is located at a position closer to the electronic device 100 than position 1 in the X1-axis direction, the user's line of sight projection range is smaller than the line of sight range 27. However, if the intersection of the horizontal direction 24 and the plane where the electronic device 100 is located falls on the electronic device 100, the user's line of sight projection range includes the electronic device 100. If the user's head position is located at a position farther away from the electronic device 100 than position 1 in the X1-axis direction, the user's line of sight projection range is larger than the line of sight range 27. However, the intersection of the horizontal direction 24 and the plane where the electronic device 100 is located is far away from the electronic device 100, and the line of sight range 27 does not include the electronic device 100. Therefore, when the user's head posture remains unchanged and the user's head position is at different positions in the X1-axis direction, the line of sight projection range will also change with the change of the user's head position.

[0217] For example, the electronic device 100 may determine the upper edge and the lower edge of the line of sight projection range according to the pitch angle of the user's head. Figure 8C In the side view shown, the user's head is at position 1 on the plane X1O1Z1, the pitch angle of the user's head is zero, the projection of the horizontal direction 30 on the side view is perpendicular to the plane where the electronic device 100 is located, and the lower sight line direction 32 and the upper sight line direction 31 show the user's field of view in the side view. The electronic device 100 can determine the sight line projection range based on the image obtained by the camera. Figure 8C The visual range 33 is shown. The visual range 33 includes the electronic device 100.

[0218] like Figure 8C As shown, if the user's head position is at position 2 above position 1, the visual range 33 does not include the electronic device 100. Similarly, if the user's head position is at position 3 below position 1, the visual range 33 does not include the electronic device 100. Therefore, when the user's head posture remains unchanged and the user's head position is at different positions along the Z1 axis, the visual projection range will also change with the change of the user's head position.

[0219] If the user's head position is located at position 1, which is closer to the electronic device 100 than position 1 in the X1 axis direction, the user's line of sight projection range is smaller than the line of sight range 33. If the user's head position is located at a position farther away from the electronic device 100 than position 1 in the X1 axis direction, the user's line of sight projection range is larger than the line of sight range 33. Since the horizontal viewing direction 30 is vertically pointed to the electronic device 100, the relative position of the electronic device 100 and the horizontal viewing direction 30 will not be affected when the user's head position moves forward or backward, and the center of the electronic device 100 is always located within the line of sight range 33.

[0220] exist Fig.8D In the top view shown, the user's head is at position 1 on the plane X1O1Z1, the pitch angle of the user's head is non-zero, the projection of the horizontal direction 34 on the side view is not perpendicular to the plane where the electronic device 100 is located, and the lower sight line direction 36 and the upper sight line direction 35 show the user's field of view in the side view. The electronic device 100 can determine the sight line projection range based on the image obtained by the camera. Fig.8D The line of sight 37 is shown. The line of sight 37 does not include the electronic device 100.

[0221] like Fig.8DAs shown, if the user's head position is located at position 2 above position 1, the visual range 37 includes the electronic device 100. It should be noted that if the user's head position continues to move upward from position 2, the lower visual direction 36 in the visual range 37 will move to above the electronic device 100, and the visual range 37 does not include the electronic device 100. If the user's head position is located below position 1, the visual range 37 does not include the electronic device 100 at all times.

[0222] It should be noted that, since the visual range 37 is blocked by the ground, when the user moves forward, the portion of the visual range 37 blocked by the ground decreases, and the visual range 37 becomes larger. When the user moves backward, the portion of the visual range 37 blocked by the ground increases, and the visual range 37 becomes smaller. If the user's head position is located at position 1, which is closer to the electronic device 100 than position 1 in the X1 axis direction, and if the user's upper visual direction 35 falls on the electronic device 100, the user's visual projection range includes the electronic device 100. If the user's head position is located at a position farther away from the electronic device 100 than position 1 in the X1 axis direction, the user's visual projection range is blocked by the ground and is smaller than the visual range 33, and the visual range 37 does not include the electronic device 100.

[0223] The electronic device 100 can determine the sight projection range in combination with the user's head position, the sight range in the top view, and the sight range in the side view. When the sight range in the top view includes the electronic device 100 and the sight range in the side view includes the electronic device 100, the electronic device 100 can determine that the sight projection range includes the electronic device 100. When the sight range in the top view does not include the electronic device 100 or the sight range in the side view does not include the electronic device 100, the electronic device 100 can determine that the sight projection range does not include the electronic device 100.

[0224] It should be noted that, not limited to the above-mentioned line of sight projection range, the electronic device 100 can also use the intersection of the horizontal direction and the user's head as the intersection between the user's line of sight direction and the horizontal direction, and use the direction with a preset angle α with the horizontal direction as the user's line of sight direction. The user's line of sight direction can be fitted into a cone with the horizontal direction as the central axis. Based on the position of the user's head, the electronic device 100 projects the user's line of sight direction to the plane where the electronic device 100 is located, and the shape of the line of sight projection range can be circular or elliptical. The electronic device 100 can determine whether the line of sight projection range includes the electronic device 100 based on the position of the line of sight projection range on the plane where the electronic device 100 is located and the position of the electronic device 100 on the plane.

[0225] When the electronic device 100 determines that the line of sight projection range includes the electronic device 100, step S507 may be executed. When the electronic device 100 determines that the line of sight projection range does not include the electronic device 100, step S501 may be executed.

[0226] S507. The electronic device 100 determines whether the time duration that the line of sight projection range includes the electronic device 100 exceeds a preset gaze time duration.

[0227] When the electronic device 100 performs step S505 and determines for the first time that the sight projection range includes the electronic device 100, the electronic device 100 may record the duration that the sight projection range includes the electronic device 100. When the electronic device 100 determines that the duration does not exceed the preset gaze duration, the electronic device 100 may perform step S501. When the electronic device 100 determines that the duration exceeds the preset gaze duration, the electronic device 100 may perform step S508.

[0228] It should be noted that, when the electronic device 100 records the duration that the line of sight projection range includes the electronic device 100, when the electronic device 100 executes step S506, it determines that the line of sight projection range does not include the electronic device 100, and the electronic device 100 clears the recorded duration.

[0229] S508. The electronic device 100 displays a mural interface.

[0230] When the electronic device 100 determines that the time duration that the line of sight projection range includes the electronic device 100 exceeds a preset gaze time duration, the electronic device 100 may display a mural interface.

[0231] It is understandable that the electronic device 100 can obtain the image obtained by the camera at a preset interval when displaying the mural interface. The electronic device 100 can determine whether the line of sight projection range includes the electronic device 100 based on the image obtained by the camera. For details, see Figure 5B The electronic device 100 can perform a screen-off operation when it is determined that the time duration that the line of sight projection range does not include the electronic device 100 exceeds a preset gaze time duration.

[0232] In some examples, the electronic device 100 displays a user interface. After receiving a screen-off input from the user, the electronic device 100 may turn off the screen in response to the input. After the screen is turned off, the electronic device 100 may detect that the user has been away from the designated area for a preset time, and then detect that the user has re-entered the designated area, and execute the following steps: Figure 5B In this way, the electronic device 100 remains in the off state after the user turns off the screen. In this process, since the user turns off the screen actively, it indicates that the user prefers to keep the screen of the electronic device 100 in the off state, and the electronic device 100 does not execute Figure 5BAfter detecting that the user has left, the electronic device 100 may execute Figure 5B Steps shown.

[0233] In some examples, the electronic device 100 displays a non-task interface. If the electronic device 100 does not receive any input from the user within a preset response time, the electronic device 100 may display a mural interface. The electronic device 100 may also obtain images captured by the camera at preset intervals, and determine whether the electronic device 100 performs a screen-off operation based on the images captured by the camera. For details, please refer to the above embodiments, which will not be repeated here. In this way, if the electronic device 100 detects that the user has not operated the electronic device 100 within the preset response time, the electronic device 100 may display a mural interface.

[0234] It should be noted that it is not limited to Figure 5B The embodiment shown detects whether the user's line of sight falls on the display screen of the electronic device 100. The electronic device 100 can also estimate the posture of the user's eyeball through the image obtained by the camera. The electronic device 100 can determine the user's line of sight based on the posture of the user's eyeball to determine whether the user's line of sight falls on the display screen of the electronic device 100, and the embodiment of the present application is not limited to this.

[0235] In a possible implementation, the electronic device 100 can determine the scene atmosphere parameters based on the image acquired by the camera, and the scene atmosphere parameters can represent the decoration style, ambient light conditions, etc. of the space where the electronic device 100 is located. The electronic device 100 can determine the specified work based on the scene atmosphere parameters, and display a mural interface including the specified work. In this way, the electronic device 100 displays the work that is consistent with the style of the environment where the electronic device 100 is located in the mural interface, so that the user's sense of immersion and envelopment is enhanced, and the user experience is improved.

[0236] For example, Fig. 9 As shown, the steps for the electronic device 100 to obtain the specified work are as follows:

[0237] S901. The electronic device 100 acquires an image through a camera.

[0238] The electronic device 100 can acquire images through the camera every preset switching time (for example, 30 seconds).

[0239] S902. The electronic device 100 determines scene atmosphere parameters based on the image acquired by the camera. The scene atmosphere parameters include scene decoration style and scene lighting conditions.

[0240] Among them, the electronic device 100 can determine the scene atmosphere parameters of the image acquired by the camera through an image processing algorithm. Among them, the scene atmosphere parameters can be used to represent the room where the electronic device 100 is located. The scene atmosphere parameters may include but are not limited to the scene decoration style, the scene lighting conditions, etc. The scene decoration style can be used to represent the decoration style of the room where the electronic device 100 is located. For example, the scene decoration style may include but is not limited to the Chinese decoration style, the Western decoration style, etc. The scene lighting conditions can be used to represent the lighting conditions of the room where the electronic device 100 is located, such as color temperature. Among them, the color temperature can be used to indicate whether the light in the current room is cold light or warm light. Among them, cold light is light with a color temperature exceeding 5000 Kelvin, and warm light can be light with a color temperature of 3000 Kelvin. The light color of warm light is reddish, which can give the user a warm feeling, and the light color of cold light is bluish, which can give the user a cool feeling.

[0241] S903. The electronic device 100 displays a mural interface including a designated work based on the scene atmosphere parameters.

[0242] The electronic device 100 may obtain a designated work corresponding to the scene atmosphere parameter based on the scene atmosphere parameter. The electronic device 100 may determine the designated work from the stored works based on the scene atmosphere parameter. Alternatively, the electronic device 100 may obtain the designated work from the server based on the scene atmosphere parameter.

[0243] In some examples, the electronic device 100 can determine the designated work based on the scene decoration style. If the scene decoration style is a Western decoration style, the electronic device 100 can obtain Western-style works (e.g., oil paintings, sketches, photos of people wearing Western clothes, photos of Western-style buildings, etc.) as designated works. If the scene decoration style is a Chinese decoration style, the electronic device 100 can obtain Chinese-style works (e.g., ink paintings, fine brush paintings, photos of people wearing Chinese clothes, photos of Chinese-style buildings, etc.) as designated works. For example, if the electronic device 100 obtains such Fig. 10A The electronic device 100 can display the image captured by the camera as shown. Fig. 10B The mural interface 1001 shown. For another example, if the electronic device 100 obtains the following through the camera: Figure 3A-3D The electronic device 100 can display the image shown in any frame as follows: Fig. 10C The mural interface 1002 is shown.

[0244] In some examples, the electronic device 100 may determine a designated work based on color temperature. For example, when the electronic device 100 determines that the ambient light is warm, a painting with warm tones may be displayed. When the electronic device 100 determines that the ambient light is cold, a painting with cold tones may be displayed.

[0245] In some examples, the electronic device 100 can jointly determine the designated work based on the scene decoration style and the color temperature. For example, when the electronic device 100 determines that the scene decoration style is a Western style decoration style and the ambient light is cold light, an oil painting including the sea or the starry sky is displayed. It is understandable that the designated work provided in the embodiment of the present application is only an example and should not be specifically limited to the mural interface displayed by the electronic device 100.

[0246] In some examples, when the number of designated works acquired by the electronic device 100 is greater than 1, the electronic device 100 can switch the works displayed in the mural interface every preset carousel time (for example, 1 minute). In this way, the electronic device 100 can rotate multiple works, giving the user a more diverse visual experience.

[0247] In a possible implementation, the electronic device 100 can also collect nearby sounds, and jointly determine the designated work based on the image acquired by the camera and the nearby sounds. In this way, the electronic device 100 can combine the decoration style, ambient light conditions and ambient sounds of the environment in which the electronic device 100 is located to jointly determine the designated work that fits the current scenario and display the designated work. The mural interface displayed by the electronic device 100 is consistent with the current environmental style and is more suitable for the current environment, so that the mural interface and the environment are integrated into a whole, giving the user a more immersive experience.

[0248] The ambient sounds collected by the electronic device 100 may include but are not limited to wind, insects, birds, rain, etc. For example, if the electronic device 100 determines that the scene decoration style is Chinese style, the ambient light is warm light, and the collected ambient sounds include birds, the electronic device 100 can display a detailed painting of birds on the mural interface. In this way, the electronic device 100 can combine the environment and the sound to display the corresponding mural interface, giving the user a better audio-visual experience.

[0249] In some examples, when the sound intensity of the ambient sound collected by the electronic device 100 is lower than a preset sound intensity threshold (e.g., 30 decibels), the electronic device 100 can display works suitable for a quiet environment, such as landscape photos, landscape paintings, etc. When the sound intensity of the ambient sound collected by the electronic device 100 is higher than a preset sound intensity threshold (e.g., 40 decibels), the electronic device 100 can display works suitable for a lively environment, such as paintings or photos with warm colors, etc.

[0250] In some examples, the electronic device 100 may display the mural interface using a specified display effect based on the ambient lighting conditions. For example, the electronic device 100 may determine the specified display effect based on the light intensity. For example, when the electronic device 100 determines that the light intensity is greater than a preset light intensity threshold, the brightness of the display screen of the electronic device 100 may be increased. When the electronic device 100 determines that the light intensity is less than a preset light intensity threshold, the brightness of the display screen of the electronic device 100 may be reduced.

[0251] For another example, the electronic device 100 includes an atmosphere light. When the electronic device 100 determines that the light intensity is less than a preset light intensity threshold, the electronic device 100 can adjust the irradiation direction and irradiation brightness of the atmosphere light of the electronic device 100 to achieve a spotlight effect. In this way, the middle area of ​​the mural interface displayed by the electronic device 100 is illuminated by the atmosphere light, making the edge area of ​​the mural interface darker, highlighting the mural interface, and providing the user with an atmosphere of appreciating paintings in an art gallery. Optionally, the electronic device 100 can obtain the light intensity through an ambient light sensor.

[0252] In some examples, the electronic device 100 can adjust the display brightness of each area of ​​the display screen to highlight the details of the work in the mural interface. For example, when the electronic device 100 detects that the light intensity is less than a preset light intensity threshold, it can increase the brightness of the middle area of ​​the display screen and reduce the brightness of the edge area of ​​the display screen. In this way, the electronic device 100 can highlight the display content in the middle of the wallpaper interface.

[0253] In one possible implementation, the electronic device 100 may receive input from the user and set a specified range of works. The electronic device 100 may display the works within the specified range of works on the mural interface. For example, the specified range of works may be used to indicate the author of the work, the completion time of the work, the type of work (e.g., ink painting, gouache painting, oil painting, sketch, photo, etc.), the subject of the work (e.g., architecture, person, landscape, object, etc.), etc. In some examples, the electronic device 100 may receive voice input from the user and set a specified range of works. For example, the electronic device 100 may display a sketch of a person as the main body of the work on the mural interface after the user's voice input is collected through the microphone: "Xiaoyi, Xiaoyi, show the person sketch".

[0254] In some examples, the electronic device 100 can determine the designated works within the designated works range based on the images and / or ambient sounds captured by the camera. For example, if the designated works range set by the electronic device 100 is the works of a designated painter, when the electronic device 100 determines that the ambient light is warm light based on the images captured by the camera, the warm-toned works among the works of the designated painter can be displayed.

[0255] In some examples, the electronic device 100 can jointly display the mural interface with other electronic devices in the room where the electronic device 100 is located. For example, other electronic devices may include but are not limited to electric curtains, smart light sources, and the like. For example, when the electronic device 100 displays a work in cold tones, the electronic device 100 can notify the smart light source to adjust to cold light. For another example, when the electronic device 100 displays the mural interface with a spotlight effect, the electronic device 100 can notify the electric curtain to be set to the pulled state, and notify the smart light source to turn off. In this way, the electronic device 100 can cooperate with other electronic devices in the current room to achieve a better display effect.

[0256] In some examples, when the electronic device 100 displays a mural interface, it can play audio related to the content of the mural interface based on the content of the mural interface. For example, when the electronic device 100 displays a photo of the sea, the electronic device 100 can play the sound of waves. For another example, when the electronic device 100 displays a dancer dancing ballet, the electronic device 100 can play ballet music. In this way, when the electronic device 100 displays a mural interface, it can play audio related to the content of the mural interface through a speaker, providing the user with a unified and integrated display effect from the user's visual and auditory perspectives.

[0257] In a possible implementation, the electronic device 100 displays a mural interface. After receiving user input, the electronic device 100 can output an interaction result in response to the user input. The interaction result may include but is not limited to displaying a dynamic interactive image, displaying relevant information of the mural interface, playing audio, etc. In this way, the mural interface of the electronic device 100 can provide the user with an interactive function, the electronic device 100 can perceive the user's interactive behavior, and output corresponding interactive results based on the user's interactive behavior, thereby increasing the fun and interactivity of the mural interface.

[0258] In some examples, the electronic device 100 displays a mural interface, and the state of the designated area set by the electronic device 100 can be an unmanned state, a manned non-stop state, or a manned and stopped state. The electronic device 100 can set the state of the designated area to a manned and stopped state after receiving user input. In this way, the user interacts with the mural interface, indicating that the user prefers the electronic device 100 to keep displaying the mural interface. The electronic device 100 can directly set the state of the designated area to a manned and stopped state after receiving user input, so that the time for the electronic device 100 to display the mural interface is extended.

[0259] In other examples, the electronic device 100 displays a mural interface. After receiving the user input, the electronic device 100 can re-detect whether the time the user has been away from the specified area has reached a preset departure time. Optionally, the electronic device 100 can also increase the value of the preset departure time. In this way, the electronic device 100 can extend the time of displaying the mural interface to meet the user's need to view the mural interface.

[0260] For example, Fig.11 As shown, the process of implementing user interaction by the electronic device 100 includes the following steps:

[0261] S1101. The electronic device 100 displays a mural interface.

[0262] The electronic device 100 can provide an interactive mural interface to the user. The electronic device 100 sets a correspondence between a specified input and an interaction result in the interactive mural interface. After receiving the specified input, the electronic device 100 can determine the interaction result corresponding to the specified input, and output the interaction result in the interactive mural interface through a display screen and / or a speaker.

[0263] S1102. The electronic device 100 receives a designated input.

[0264] The designated input may include but is not limited to touch input, voice input, motion input, input of the remote control device 200, etc. The electronic device 100 may receive the touch input through the touch screen. The electronic device 100 may receive the voice input through the microphone. The electronic device 100 may receive the motion input through the camera. The electronic device 100 may receive the input of the remote control device 200 through the wireless communication module. The remote control device 200 may send the designated input to the electronic device 100 after receiving the user's input for the button or touch pad.

[0265] S1103. The electronic device 100 outputs an interaction result in response to the specified input.

[0266] The electronic device 100 can respond to the specified input and output the interaction result of the mural interface through the display screen and the speaker. For example, the interaction result can be playing audio related to the picture content, displaying information related to the picture content, displaying animation of the picture content, etc.

[0267] In some examples, the electronic device 100 may set the designated input for the mural interface as a touch input, and the interaction result is to display detailed information of the works in the mural interface (e.g., the author's name, the work introduction, the author's profile, etc.). After receiving the designated input (e.g., the touch input) for the mural interface, the electronic device 100 may respond to the designated input and display the author of the work in the mural interface, the work introduction, etc. In this way, when the user sees a work of interest, he can obtain detailed information of the work from the interaction result of the electronic device 100, which facilitates the user to find the work of interest.

[0268] In a possible implementation, the electronic device 100 can identify the subject in the display content of the mural interface through an image recognition algorithm. After identifying the subject of the displayed content, the electronic device 100 can set a corresponding relationship between a specified input and an interaction result for the subject. For example, the subject of the mural interface display content can include but is not limited to people, animals, buildings, plants, objects, scenery, etc. In this way, when the electronic device 100 displays the mural interface, the corresponding relationship between the specified input and the interaction result can be set for the mural interface, so that the user can interact with the electronic device 100 to improve the fun.

[0269] For example, when the electronic device 100 recognizes that the subject is a person, it can set the designated input to the subject as a user greeting action input (e.g., waving) or a user greeting voice input (e.g., "hello"), and set the corresponding interaction result to the designated input as playing the greeting audio. In this way, the user can greet the person in the mural interface and achieve the voice interaction effect.

[0270] For another example, when the electronic device 100 recognizes that the subject is a plant or an animal, it can set the designated input to the subject as a touch input (e.g., single click, double click, long press, etc.), and set the corresponding interaction result to display the detailed information of the subject (e.g., name, classification, growth environment, etc.) for the designated input. In this way, the user can understand the information of the plants and animals displayed in the mural interface through the electronic device 100.

[0271] For another example, when the electronic device 100 recognizes that the subject is a scene, it can set the designated input to the subject as a touch input (e.g., single click, double click, long press, etc.), and set the corresponding interaction result to display detailed information of the scene (e.g., the address of the scene, travel plan, etc.). The travel plan may include but is not limited to recommended travel time, transportation plans from the user's current location to the address of the scene, local food recommendations, etc. In this way, when the user sees a beautiful scene, he can determine the address of the scene, which is convenient for the user to visit.

[0272] In some examples, the electronic device 100 can also set interactive animations for the subject in the mural interface through image processing algorithms. For example, the electronic device 100 can perform operations such as translation, scaling, and rotation on the subject to achieve a dynamic movement effect of the subject. For example, the electronic device 100 can enlarge the subject to achieve an effect of the subject approaching the user.

[0273] In some examples, the electronic device 100 can collect the user's motion input through the camera, and output the interaction result on the mural interface in response to the user's motion input. In this way, the electronic device 100 can collect the user's motion input, and according to the user's motion, realize the motion interaction effect on the mural interface.

[0274] For example, the electronic device 100 may display Fig. 12A The mural interface 1401 shown in FIG. 1401 includes a closed window. When the electronic device 100 receives an action input of a user pushing the window open, in response to the input, the mural interface 1401 may display a Fig. 12B Mural interface 1402 is shown.

[0275] like Fig. 12B As shown, the window in the mural interface 1402 is in an open state. The mural interface 1402 can also display scenery in the open window. Here, the electronic device 100 displays a sky scene. The electronic device 100 can also display the following when receiving the user's forward throwing action input in response to the input: Fig. 12C The electronic device 100 may gradually reduce the airplane icon 1403, and after reducing the airplane icon 1403 to a preset size (e.g., 10 pixels), the electronic device 100 may cancel the display of the airplane icon 1403. In this way, the electronic device 100 may achieve the effect of the airplane flying away.

[0276] For another example, the electronic device 100 displays Fig. 12C The electronic device 100 may also change the moving direction of the airplane icon 1403 in response to the input of the blowing action of the user when receiving the blowing action input of the user. Optionally, the electronic device 100 may also play the wind sound through the speaker. In this way, the electronic device 100 may achieve the effect of the airplane being blown away by the wind.

[0277] In some examples, the electronic device 100 can collect the user's voice input through a microphone, and output the interaction result on the mural interface in response to the user's voice input. In this way, the electronic device 100 can collect the user's voice input and, based on the user's voice content, achieve a voice interaction effect on the mural interface.

[0278] For example, the electronic device 100 displays Fig.13AThe mural interface 1501 shown in FIG. 1 includes a vehicle. When the electronic device 100 receives a voice input for inquiring about detailed information of the subject of the mural interface 1501, the electronic device 100 may display a Fig. 13B The text information 1502 shown. For example, the voice input may be: "Xiaoyi, Xiaoyi, show me the details of this car".

[0279] like Fig. 13B As shown, the electronic device 100 displays text information 1502 on the mural interface 1501. The text information 1502 includes detailed information of the vehicle (e.g., vehicle brand, vehicle series, vehicle price, etc.). Here, the text information 1502 may include: "XX brand car", "vehicle series: XX" and "price: 9.9w". In this way, the electronic device 100 can achieve the effect of displaying detailed information of the mural interface in response to the user's voice input.

[0280] For another example, the electronic device 100 displays Fig.13A When the mural interface 1501 is shown, a user's voice input can be received: "Hello", and in response to the input, a horn sound is played through the speaker. Optionally, the electronic device 100 can also zoom in and out the vehicle in the mural interface 1501. In this way, the electronic device 100 can provide the user with the effect of greeting the vehicle in the mural interface 1501.

[0281] In some examples, the electronic device 100 can receive a user's touch input on the touch screen, and output an interaction result on the mural interface in response to the user's touch input. In this way, the electronic device 100 can collect the user's touch input and implement a touch interaction effect on the mural interface according to the user's touch point on the display screen.

[0282] For example, the electronic device 100 displays Fig.14A The mural interface 1601 shown in FIG. 1601 includes a fish pond, which includes one or more fish. When the electronic device 100 receives a touch input (eg, a single click) for the mural interface 1601, in response to the input, the electronic device 100 displays a Fig. 14B The mural interface 1601 is shown. After receiving the user's touch input, the electronic device 100 can display a fish food icon 1602 at the position where the user's touch input is received on the display screen. The electronic device 100 can also control the one or more fish to move to the position where the fish food icon 1602 is located. Optionally, the electronic device 100 can also play the audio of the fish food falling into the water and / or the audio of the fish swimming through the speaker. In this way, the electronic device 100 can achieve the display effect of the user feeding the fish.

[0283] The electronic device 100 can also receive the user drag Fig.14AWhen a touch input is made to any of the fish shown, in response to the input, a display effect is displayed in which the selected fish moves as the user's finger moves on the touch screen. In this way, the electronic device 100 can provide the user with a function of moving objects in the mural interface, so that the user can adjust the relative positions of various objects in the mural interface by himself.

[0284] In some examples, the electronic device 100 can receive a control signal sent by the remote control device 200 through the wireless communication module, and output the interaction result on the mural interface in response to the control signal. The remote control device 200 can receive the user's input to the buttons or touch pad of the remote control device 200, and send the control signal to the electronic device 100. In this way, the electronic device 100 can receive the input of the remote control device 200, and realize the remote control interaction effect on the mural interface according to the input of the remote control device 200.

[0285] For example, the electronic device 100 may display Fig.15 The mural interface 1701 shown. The mural interface 1701 includes a cursor 1702. The electronic device 100 can receive input from the remote control device 200 and move the cursor 1702. The remote control device 200 can receive input from the user to move the remote control device 200, and send the input to move the cursor 1702 to the electronic device 100. The remote control device 200 can determine the moving direction of the cursor 1702 based on the direction in which the user moves the remote control device 200, and determine the moving distance of the cursor 1702 based on the distance the user moves the remote control device 200. Alternatively, the remote control device 200 can receive input from the user on the touch pad of the remote control device 200, and send the input to move the cursor 1702 to the electronic device 100. The remote control device 200 can determine the moving direction of the cursor 1702 based on the moving direction of the user's finger on the touch pad of the remote control device 200, and determine the moving distance of the cursor 1702 based on the moving distance of the user's finger on the touch pad of the remote control device 200.

[0286] Among them, the mural interface 1701 also includes a fish pond, and the fish pond includes one or more fish. The electronic device 100 can receive the remote control input of the remote control device 200. For example, the remote control device 200 can send the remote control input to the electronic device 100 after receiving the user's input for the confirmation key 1703. In response to the remote control input, the electronic device 100 can display a fish food icon at the location of the cursor 1702. The electronic device 100 can also control the one or more fish to move to the location where the fish food icon is located. For details, please refer to Fig. 14B The illustrated embodiment will not be described in detail here. In this way, the electronic device 100 can provide the user with the function of remotely interacting with the mural interface. The user can remotely interact with the mural interface through the remote control device 200, and the interaction method is more flexible.

[0287] It should be noted that the display content of the above-mentioned interactive mural interface and the interactive results output by the electronic device 100 are only examples, and the electronic device 100 can also provide other interactive mural interfaces to achieve more diverse interactive effects.

[0288] It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0289] The present application also provides an electronic device, which may include: a memory and a processor. The memory may be used to store programs; the processor may be used to call the programs in the memory so that the electronic device executes the method executed by the electronic device 100 in any of the above embodiments.

[0290] The present application also provides a chip system, which includes at least one processor for implementing the functions involved in the method executed by the electronic device 100 in any of the above embodiments.

[0291] In one possible design, the chip system also includes a memory, which is used to store program instructions and data, and the memory is located inside or outside the processor.

[0292] The chip system may be composed of the chip, or may include the chip and other discrete devices.

[0293] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0294] Optionally, the memory in the chip system may also be one or more. The memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively. The embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.

[0295] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0296] The present application also provides a program product, which includes: a program (also referred to as code, or instruction), which, when executed, enables an electronic device to execute any method executed by the electronic device 100 in any of the above embodiments.

[0297] The present application also provides a readable storage medium, which stores a program (also referred to as code or instruction). When the program is executed, the electronic device executes any method executed by the electronic device 100 in any of the above embodiments.

[0298] It should be understood that the processor in the embodiment of the present application can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method embodiment can be completed by the hardware integrated logic circuit or software instructions in the processor. The above processor can be a general processor, a digital signal processor (digitalsignal processor, DSP), an application specific integrated circuit (AP 800plication specific integrated circuit, ASIC), a field programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or the hardware and software modules in the decoding processor are combined to perform. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0299] In addition, an embodiment of the present application further provides a device. The device may be a component or a module, and the device may include one or more processors and a memory connected to each other. The memory is used to store a program. When the program is executed by one or more processors, the device executes the method in each of the above method embodiments.

[0300] Among them, the device, readable storage medium, computer program product or chip provided in the embodiments of the present application are used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0301] The various implementation modes of the present application can be combined arbitrarily to achieve different technical effects.

[0302] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a program product. The program product includes one or more instructions. When the program instruction is loaded and executed on an electronic device, the process or function according to the present application is generated in whole or in part. The electronic device can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The instruction can be stored in a readable storage medium, or transmitted from one readable storage medium to another readable storage medium. For example, the instruction can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The readable storage medium can be any available medium that an electronic device can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)), etc.

[0303] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by a program to instruct the relevant hardware, and the program can be stored in a readable storage medium. When the program is executed, it can include the processes of the above-mentioned method embodiments. The aforementioned storage medium includes: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0304] In short, the above description is only an embodiment of the technical solution of the present invention, and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present invention shall be included in the protection scope of the present invention.

Claims

1. A display method, characterized in that: Applied to an electronic device, the electronic device includes a display screen; the method includes: The display screen is turned off; When the display screen remains off, detecting that a user enters a first area; If it is detected that the user stays in the first area for a first time period and in the second area for the first time period, the display screen is switched from off to on and a first interface is displayed on the display screen, and the first area includes the second area; After the first interface is displayed on the display screen, if it is detected that the user has left the first area for a second time period, switching the display screen from displaying the first interface to turning off the screen; If it is detected that the user stays in the first area for the first time period but does not stay in the second area for the first time period, the display screen remains off.

2. The method according to claim 1, characterized in that The method further comprises: In response to the received first input, switching the display screen from an on screen to an off screen; When the display screen is turned off, detecting whether the user leaves the first area; If it is detected that the time duration that the user has been away from the first area reaches a third time duration, it is detected whether the user enters the first area, and the third time duration is less than the second time duration.

3. The method according to claim 1, characterized in that The method further comprises: The display screen displays a second interface, where the second interface is different from the first interface; When the display screen displays the second interface, detecting user input, and if it is detected that the time period for which no user input has been received reaches a fourth time period, displaying the first interface on the display screen; When the first interface is displayed on the display screen, it is detected whether the user leaves the first area. If it is detected that the time duration for which the user has been away from the first area reaches a fifth time duration, the display screen is turned off.

4. The method according to any one of claims 1 to 3, characterized in that After displaying the first interface on the display screen and before switching the display screen from displaying the first interface to turning off the display screen, the method further includes: It is detected that the time when the user leaves the first area reaches a third time, and a first countdown is displayed on the first interface, where the time of the first countdown is equal to a sixth time, and the sixth time is the difference between the second time and the third time; or, It is detected that the time when the user leaves the first area reaches the seventh time period, and a second countdown is displayed on the first interface, the second countdown time is equal to the sixth time period, and the sixth time period is the difference between the fifth time period and the seventh time period.

5. The method according to claim 4, characterized in that After displaying the first countdown on the first interface, the method further includes: Before it is detected that the time duration for which the user has left the first area reaches the second time duration, if it is detected that the user enters the first area, the first countdown is canceled.

6. The method according to any one of claims 1 to 5, characterized in that The electronic device also includes a camera, and the first area is within the field of view FOV of the camera.

7. The method according to any one of claims 1 to 6, characterized in that The first interface is a wallpaper interface.

8. The method according to any one of claims 1 to 7, characterized in that The method may further comprise one or more of the following: In response to detecting that a user enters the first area, switching the unmanned state to the occupied non-staying state; In response to detecting that the user stays in the second area for the first time period, switching the occupied non-staying state to an occupied and staying state; In response to detecting that the time duration for which the user has been away from the first area reaches a third time duration, the occupied and staying state is switched to the unoccupied state.

9. The method according to claim 8, characterized in that After the first interface is displayed on the display screen, if it is detected that the user has left the first area for a second time period, switching the display screen from displaying the first interface to turning off the screen specifically includes: When it is detected that the duration for switching the occupied state to the unoccupied state reaches a sixth duration, the display screen is turned off, and the sixth duration is the difference between the second duration and the third duration.

10. The method according to claim 2, characterized in that The method may further comprise one or more of the following: In response to the first input, setting the state to be occupied and staying; In response to detecting that the time duration for which the user has been away from the first area reaches the third time duration, the occupied and staying state is switched to an unoccupied state.

11. The method according to claim 3, characterized in that The method may further comprise one or more of the following: In response to detecting that the time period during which no input is received reaches the fourth time period, setting the state to a occupied non-staying state; In response to detecting that the time duration for which the user has left the first area reaches a seventh time duration, the occupied non-staying state is switched to the unoccupied state; wherein the seventh time duration is shorter than the fifth time duration.

12. The method according to claim 11, characterized in that If it is detected that the user has been away from the first area for a fifth time period, turning off the display screen specifically includes: When it is detected that the duration for switching the occupied non-stop state to the unoccupied state reaches a sixth duration, the display screen is turned off, and the sixth duration is the difference between the fifth duration and the seventh duration.

13. A display method, characterized in that: Applied to an electronic device, the electronic device includes a display screen; the method includes: The display screen is turned off; When the display screen remains off, detecting that a user enters a first area; After detecting that the user enters the first area, if it is detected that the user has been looking at the display screen for a first time period, switching the display screen from off to on and displaying a first interface on the display screen; After the first interface is displayed on the display screen, if it is detected that the user has left the first area for a second time period, switching the display screen from displaying the first interface to turning off the screen; After detecting that the user enters the first area, if it is detected that the time duration for which the user stares at the display screen does not reach a first time duration, the display screen is kept off.

14. The method according to claim 13, characterized in that The method further comprises: In response to the received first input, turning off the display screen; When the display screen is turned off, detecting whether the user leaves the first area; If it is detected that the time duration that the user has been away from the first area reaches a third time duration, it is detected whether the user enters the first area, and the third time duration is less than the second time duration.

15. The method according to claim 13, characterized in that The method further comprises: The display screen displays a second interface, where the second interface is different from the first interface; When the display screen displays the second interface, detecting user input, and if it is detected that the time period for which no user input has been received reaches a fourth time period, displaying the first interface on the display screen; When the first interface is displayed on the display screen, it is detected whether the user leaves the first area. If it is detected that the time duration for which the user has been away from the first area reaches a fifth time duration, the display screen is turned off.

16. The method according to any one of claims 13 to 15, characterized in that After displaying the first interface on the display screen and before switching the display screen from displaying the first interface to turning off the display screen, the method further includes: It is detected that the time duration when the user leaves the first area reaches a third time duration, and a first countdown is displayed on the first interface, the time duration of the first countdown is equal to a sixth time duration, and the sixth time duration is the difference between the second time duration and the third time duration.

17. The method according to claim 16, characterized in that After displaying the first countdown on the first interface, the method further includes: Before it is detected that the time duration for which the user has left the first area reaches the second time duration, if it is detected that the user enters the first area, the first countdown is canceled.

18. The method according to any one of claims 13 to 17, characterized in that: The electronic device also includes a camera, and the first area is within the field of view FOV of the camera.

19. The method according to any one of claims 13 to 18, characterized in that: The first interface is a wallpaper interface.

20. An electronic device, characterized in that: include: a display screen, one or more processors, and one or more memories; The display screen and the one or more memories are coupled to the one or more processors, and the one or more memories are used to store executable programs. When the one or more processors execute the executable programs, the electronic device executes the method described in any one of claims 1-12 or claims 13-19.

21. A readable storage medium storing a program, characterized in that: When the program is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 12 or claims 13 to 19.

Images