Display method and display equipment

Abstract

The invention provides a display method and display equipment, and relates to the technical field of terminals. In the method, based on an acquired target image comprising at least one face image, the position of a user corresponding to each face image relative to a display device is determined, so that the visual area space where each user is located is further determined. For any visual area space, the scenery picture displayed by the display panel corresponding to the visual area space can be adjusted based on the visual field angle of the user in the visual area space, so that the scenery pictures displayed by the display equipment seen by the users in different visual area spaces are different; and all users watching the display equipment can have a real experience feeling of watching the scenery outside the window.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a display method and a display device. Background Art

[0002] Users will inevitably feel bored if they stay in a room without windows or with a single window view for a long time. Usually, users can install display devices with display functions such as TVs and projectors in their rooms. These display devices can play various landscape images for users, thereby simulating and displaying various landscapes outside the window, which can relieve users' boredom.

[0003] However, the scenery images played by the display device are usually difficult to interact with the user and difficult to give the user a real experience of viewing the scenery outside the window. Summary of the invention

[0004] The embodiments of the present application provide a display method and a display device, which can enable all users who view the display device to have a real experience of viewing the scenery outside the window.

[0005] In order to achieve the above purpose, the embodiment of the present application adopts the following technical solution:

[0006] A first aspect provides a display method, which is applied to a display device, wherein the display device includes at least one display panel, and one display panel corresponds to one viewing area space. In the method, the display device obtains a target image. The target image includes a face image of at least one user around the display device. For any user, the display device determines the viewing area space where the user is located based on the image information of the user's face image. For any viewing area space, the display device adjusts the picture displayed by the display panel corresponding to the viewing area space based on the field of view of the user in the viewing area space.

[0007] In the method of the present application, the display device can determine the position of the user corresponding to each face image relative to the display device based on the acquired target image including at least one face image, thereby further determining the viewing space of each user. For any viewing space, the landscape image displayed by the display panel corresponding to the viewing space can be adjusted based on the viewing angle of the user in the viewing space, so that the images displayed by the display device seen by users in different viewing spaces are different, so that all users viewing the display device can have a real experience of viewing the scenery outside the window.

[0008] In combination with the first aspect, in a possible design, the field of view angle includes a horizontal field of view angle and a vertical field of view angle. For any viewing area space, the display device obtains the horizontal field of view angle and the vertical field of view angle of each user in the viewing area space. Based on the maximum horizontal field of view angle and the maximum vertical field of view angle obtained, the display parameters of the display panel corresponding to the viewing area space are configured. Based on the display parameters of the display panel corresponding to the viewing area space, the picture displayed by the display panel corresponding to the viewing area space is adjusted.

[0009] In this solution, for any viewing area space, the display parameters of the display panel corresponding to the viewing area space can be configured based on the maximum horizontal viewing angle and the maximum vertical viewing angle obtained in the viewing area space, so as to adjust the picture displayed by the display panel corresponding to the viewing area space based on the display parameters. It can ensure that the picture displayed by the corresponding display panel seen by each user can meet the visual field requirements of all users.

[0010] In combination with the first aspect, in a possible design, the display parameter includes a scaling parameter and a display range parameter. The picture displayed by the display panel corresponds to part or all of the area in the original picture. The original picture is a picture corresponding to the data signal received by the display panel. The display range parameter is used to characterize the area of ​​the picture displayed by the display panel corresponding to the original picture. The scaling parameter is used to characterize the ratio of the picture displayed by the display panel to be enlarged or reduced relative to the original picture.

[0011] In this solution, for any display panel, the picture displayed by the display panel can be adjusted based on the scaling parameters and display range parameters configured for the display panel. By adjusting the picture displayed by each display panel, users in different viewing areas can see different pictures, thereby creating a real experience of viewing the scenery outside the window.

[0012] In combination with the first aspect, in a possible design, the face image of the user includes two pupil images, and the image information of the face image includes position information of the image center points of the two pupil images. The display device determines the position of the user based on the position information of the image center points of the two pupil images included in the face image of the user. Based on the position of the user, the visual area space where the user is located is determined.

[0013] In this solution, the location of the user corresponding to the face image can be determined based on the face image included in the target image. Compared with the traditional method of determining the user's location based on a position sensor, this method of determining the location of the user corresponding to the face image based on the face image can reduce the implementation cost.

[0014] In combination with the first aspect, in a possible design, the target image is acquired based on a camera. The display device determines the pupil distance on the user's face image based on the position information of the image center points of the two pupil images included in the user's face image. The distance between the user and the display device is determined based on the pupil distance on the user's face image, the user's pupil distance, and the focal length of the camera. The user's position is determined based on the distance between the user and the display device, the distance between the user and the normal corresponding to the display device, and the orientation of the user relative to the normal corresponding to the display device. The normal corresponding to the display device is a straight line perpendicular to the display screen of the display device and passing through the center of the display screen.

[0015] In this solution, the distance between the user and the display device can be determined based on the interpupillary distance on the user's face image, the interpupillary distance of the user, and the focal length of the camera. The position of the user can be determined based on the distance between the user and the display device, the distance between the user and the normal corresponding to the display device, and the position of the user relative to the normal corresponding to the display device. Compared with the traditional method of determining the user's position based on a position sensor, the implementation cost can be reduced.

[0016] In combination with the first aspect, in one possible design, the distance between the normals corresponding to the user and the display device is determined based on the distance between the user's facial image and the image center point of the target image, the focal length of the camera, and the distance between the user and the display device.

[0017] In this solution, a possible implementation method for determining the distance between the normal line corresponding to the user and the display device is given.

[0018] In combination with the first aspect, in a possible design, the position of the normal corresponding to the user relative to the display device is determined based on the position of the facial image corresponding to the user relative to the image center point of the target image.

[0019] In this solution, a possible implementation method for determining the position of the user relative to the normal corresponding to the display device is given.

[0020] In combination with the first aspect, in a possible design, the display device determines the angle value between the baseline corresponding to the user and the normal corresponding to the display device based on the user's position. The normal corresponding to the display device is a straight line perpendicular to the display screen and passing through the center of the display screen. The baseline corresponding to the user is a line connecting the user's position and the image center point of the target image. The display device determines the viewing area space where the user is located based on the angle value between the baseline corresponding to the user and the normal corresponding to the display device, and the angle value between the boundary of each viewing area space and the normal corresponding to the display device.

[0021] In this solution, the user's viewing zone space can be determined based on the angle value between the reference line corresponding to the user and the normal line corresponding to the display device, and the angle value between the boundary of each viewing zone space and the normal line corresponding to the display device. A possible implementation method for determining the user's viewing zone space is given.

[0022] A second aspect provides a display device. The display device includes at least one display screen, a memory, and one or more processors. The memory and the processor are coupled. The memory is used to store program code, and the program code includes instructions. When the processor executes the instructions, the display device executes the method described in the first aspect and any possible design method thereof.

[0023] The third aspect provides a chip system. The chip system includes one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected through a line, and the interface circuit is used to receive a signal from a memory of a display device and send a signal to the processor, the signal including an instruction stored in the memory, and when the processor executes the instruction, the display device executes the method described in the first aspect and any possible design thereof.

[0024] A fourth aspect provides a readable storage medium, including instructions. When the instructions are executed on a display device, the display device executes the method described in the first aspect and any possible design thereof.

[0025] A fifth aspect provides a program product. When the program product is run on a display device, the display device executes the method described in the first aspect and any possible design thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 A schematic diagram of a display device displaying a picture changing according to the prior art;

[0027] Figure 2 A schematic diagram of the hardware structure of a display device provided in an embodiment of the present application;

[0028] Figure 3 A schematic diagram of a light-emitting state of a display panel provided in an embodiment of the present application;

[0029] Figure 4A A schematic diagram of a corresponding relationship between a display panel and a viewing area space provided in an embodiment of the present application;

[0030] Figure 4B A schematic diagram of a screen displayed by a display panel provided in an embodiment of the present application;

[0031] Figure 5 A flow chart of a display method provided in an embodiment of the present application;

[0032] Figure 6 A schematic diagram of the relationship between a display device and a camera provided in an embodiment of the present application;

[0033] Figure 7 A schematic diagram of a method for determining pupil distance on a face image provided by an embodiment of the present application;

[0034] Fig. 8A A schematic diagram of a method for determining a first distance provided in an embodiment of the present application;

[0035] Figure 8B A schematic diagram of a normal line corresponding to a display device provided in an embodiment of the present application;

[0036] Fig. 9 A schematic diagram of a method for determining a second distance provided in an embodiment of the present application;

[0037] Fig.10 A schematic diagram of a method for determining the orientation of a user relative to a normal corresponding to a display device provided in an embodiment of the present application;

[0038] Fig.11 A schematic diagram of a viewing area space provided in an embodiment of the present application;

[0039] Fig.12 A schematic diagram of a user's field of view provided in an embodiment of the present application;

[0040] Fig.13A A schematic diagram of updating a screen displayed on a display panel based on a display range parameter provided in an embodiment of the present application;

[0041] Fig. 13B A schematic diagram of updating a screen displayed on a display panel based on a scaling parameter provided in an embodiment of the present application;

[0042] Fig.14 A schematic diagram of a picture displayed by a display panel based on display parameters and data signals provided in an embodiment of the present application;

[0043] Fig.15 A schematic diagram of a module structure of a display device provided in an embodiment of the present application;

[0044] Fig.16 A schematic diagram of a display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0045] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0046] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0047] Users will inevitably feel bored if they stay in a room without windows or with a single window view for a long time. Usually, users can install display devices with display functions such as TVs and projectors in their rooms. These display devices can simulate and display various window views by playing various scenery pictures. For example, the display device can play pictures of fixed-point scenery that changes with natural light. Users can feel the changes of the window scenery from the pictures displayed by the display device, thereby alleviating boredom.

[0048] However, when a user faces a real window, as the user's position relative to the window changes, the scenery outside the window that the user sees through the window will also change. For example, the scenery outside the window changes relative to the user's position, and the scenery outside the window becomes larger or smaller. However, the scenery images played by the display device are usually difficult to interact with the user, that is, the scenery images played by the display device usually do not change as the user's position relative to the display device changes, so it is difficult to give the user a real experience of viewing the scenery outside the window.

[0049] In a related technology, a position sensor for detecting a user's position may be configured for a display device, and the display device may display a corresponding picture based on the user's position detected by the position sensor.

[0050] For example, see Figure 1 When the display device detects that the user is at position A, the displayed picture is picture 101. As the user moves from position A to position B, the distance between the user and the display device increases, and the picture displayed by the display device also changes accordingly. When the display device detects that the user reaches position B, the displayed picture is picture 102.

[0051] However, the above method needs to rely on the position sensor configured for the display device, which increases the cost of the display device. In addition, if there are multiple users in front of the display device, the display device will only display the corresponding picture based on the position of one of the users detected by the position sensor, and other users still find it difficult to have a real experience of viewing the scenery outside the window.

[0052] Based on the above problems, the embodiments of the present application provide a display method and a display device, which can determine the position of the user corresponding to each face image relative to the display device based on the acquired target image including at least one face image, thereby further determining the viewing area space of each user. For any viewing area space, the landscape image displayed by the display panel corresponding to the viewing area space can be adjusted based on the viewing angle of the user in the viewing area space, so that the images displayed by the display device seen by users in different viewing areas are different, so that all users viewing the display device can have a real experience of viewing the scenery outside the window.

[0053] Figure 2 1 shows a schematic diagram of the structure of the display device 100. Figure 2 As shown, the display device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a power management module 140, at least one antenna, a wireless communication module 150, an audio module 160, a speaker 160A, a microphone 160B, a button 170, a camera 180, a display screen 190, and the like.

[0054] It is understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the display device 100. In other embodiments of the present application, the display device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0055] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0056] The controller may be the nerve center and command center of the display device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0057] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0058] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0059] The power management module 140 is connected to the processor 110. The power management module 140 can supply power to the processor 110, the internal memory 121, the external memory, the display screen 190, the camera 180, and the wireless communication module 150 based on the input of the power supply. In some other embodiments, the power management module 140 can also be set in the processor 110.

[0060] The wireless communication function of the display device 100 can be implemented through an antenna, a wireless communication module 150, a modem processor, a baseband processor, and the like.

[0061] The antenna is used to transmit and receive electromagnetic wave signals. Each antenna in the display device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, the antenna can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0062] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 160A, etc.), or displays an image or video through the display screen 190. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be arranged in the same device with other functional modules.

[0063] The wireless communication module 150 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the display device 100. The wireless communication module 150 can be one or more devices integrating at least one communication processing module. The wireless communication module 150 receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 150 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0064] In some embodiments, the antenna of the display device 100 is coupled to the wireless communication module 150, so that the display device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0065] The display device 100 implements display functions through a GPU, a display screen 190, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 190 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0066] The display screen 190 is used to display images, videos, etc. The display screen 190 includes at least one display panel. When the display screen 190 includes two or more display panels, each display panel is independent of each other and can display different images.

[0067] The display panel can display a corresponding picture based on the input data signal.

[0068] When the display screen 190 includes two or more display panels, the display panels may be arranged to overlap each other. Furthermore, the light emitting elements on the display panels may be arranged to emit light in different directions, so that when the user is in different positions relative to the display device, the screen displayed by the display device is different.

[0069] In some embodiments, the display device 100 may include 1 or N display screens 190 , where N is a positive integer greater than 1.

[0070] The display device 100 can realize a shooting function through an ISP, a camera 180 , a video codec, a GPU, a display screen 190 , and an application processor.

[0071] The ISP is used to process the data fed back by the camera 180. For example, when taking a photo, the shutter is opened, and light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. In some embodiments, the ISP can be set in the camera 180.

[0072] The camera 180 is used to capture a static image or video. For example, the camera is used to shoot the environment around the display device, thereby capturing a static image or video including the environment around the display device.

[0073] The camera 180 can project the captured static image or video onto the photosensitive element. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the display device 100 may include 1 or N cameras 180, where N is a positive integer greater than 1.

[0074] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the display device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0075] The video codec is used to compress or decompress digital video. The display device 100 may support one or more video codecs. In this way, the display device 100 can play or record videos in multiple encoding formats.

[0076] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of the display device 100 can be realized, such as image recognition, face recognition, etc.

[0077] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the display device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function.

[0078] The internal memory 121 can be used to store executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the display device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as an image playback function, etc.), etc. The data storage area can store data created during the use of the display device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, etc.

[0079] The display device 100 can implement audio functions such as music playback, voice interaction, etc. through the audio module 160, the speaker 160A, the microphone 160B, and the application processor.

[0080] The display device in the embodiment of the present application may include at least one display panel. The display panels are independent of each other and can display the same picture or different pictures.

[0081] In some embodiments, the light emitting elements on each display panel emit light in different directions. Therefore, when each display panel displays a different picture, the pictures displayed by the display device are different when the user is at a different position relative to the display device. Figure 3 , the light emitting direction of the light emitting element on the display panel 301 is direction A. Then the user 302 located in direction A can see the picture displayed on the display panel 301. However, since the light emitted by the light emitting element on the display panel 301 does not pass through direction B which is different from direction A, the user 303 located in direction B cannot see the picture displayed on the display panel 301.

[0082] That is to say, the display panel in the embodiment of the present application can provide corresponding pictures for users in the corresponding physical space. The physical space can also be called a viewing area space. Each display panel corresponds to a viewing area space. Moreover, different display panels correspond to different viewing areas. A user in a certain viewing area space can only see the picture displayed by the display panel corresponding to the viewing area space. That is, the pictures displayed by the display device seen by users in different viewing areas are different.

[0083] For example, see Figure 4A Each display panel corresponds to a viewing area space. Display panel 401 corresponds to viewing area space V1, display panel 402 corresponds to viewing area space V2, ..., display panel 403 corresponds to viewing area space V(m-1), and display panel 404 corresponds to viewing area space Vm. The boundaries of each viewing area space are the planes passing through the midpoint of the display screen of the display device, and the viewing area spaces do not overlap.

[0084] In some embodiments, the angle formed by two boundary surfaces of the same viewing area space may also be referred to as the range angle of the corresponding viewing area space. The range angles corresponding to the viewing areas may be the same or different. Figure 4A , the range angles corresponding to the viewing space V1 and the viewing space Vm are both 20°. The range angles corresponding to the viewing space V2 and the viewing space V(m-1) are both 30°, and so on.

[0085] In some embodiments, if the images displayed by the display panels corresponding to the various viewing spaces are the same, the images displayed by the display devices seen by users in different viewing spaces are also the same. If the images displayed by the display panels corresponding to the various viewing spaces are different, the images displayed by the display devices seen by users in different viewing spaces are also different. However, since the images displayed by the display devices that can be seen by users in the same viewing space are all from the same display panel, the images displayed by the display devices seen by users in the same viewing space are all the same.

[0086] For example, see Figure 4A and Figure 4B , the picture displayed on the display panel 401 is picture 411, the picture displayed on the display panel 402 is picture 412, the picture displayed on the display panel 403 is picture 413, and the picture displayed on the display panel 404 is picture 414. When the user is in the visual space V1, the picture 411 displayed on the display panel 401 can be seen. When the user is in the visual space V2, the picture 412 displayed on the display panel 402 can be seen. When the user is in the visual space V(m-1), the picture 413 displayed on the display panel 403 can be seen. When the user is in the visual space Vm, the picture 414 displayed on the display panel 404 can be seen.

[0087] The display method provided in the embodiment of the present application can be applied to the display device including multiple display panels as described above. Figure 5 As shown, the method may include the following steps S500-S540.

[0088] S500: Acquire a target image including at least one face image.

[0089] The at least one face image corresponds to at least one user located around the display device, and one user corresponds to one face image. The face image corresponding to any user may include two pupil images, namely, a left pupil image corresponding to the left pupil of the user and a right pupil image corresponding to the right pupil of the user.

[0090] In some embodiments, the display device has a built-in camera, or the display device has an external camera. If the display device has a built-in camera, the camera 601 can be as follows: Figure 6 As shown in (a) of FIG. 1 , the camera 103 is embedded in the edge of the display screen of the display device. If the display device is externally connected to a camera, the camera 103 can be as shown in FIG. Figure 1 As shown, the display settings are close to the display device.

[0091] In some embodiments, the number of the camera may be one, and the camera may continuously acquire the environment image around the display device at a fixed frequency and a fixed focal length.

[0092] Optionally, the number of cameras may be multiple. For example, at least one camera may be configured for each viewing area, and each camera may continuously acquire an environment image corresponding to each viewing area at a fixed frequency and a fixed focal length.

[0093] When the image captured by the camera includes at least one face image, the image including at least one face image can be determined as a target image. Any face image included in the target image corresponds to a user located around the display device. For example, continue to refer to Figure 6 In (a), user 610, user 620, and user 630 are all located around the display device. The image captured by the camera is as follows: Figure 6 As shown in (b) , it includes a facial image 611 corresponding to user 610 , a facial image 621 corresponding to user 620 , and a facial image 631 corresponding to user 630 .

[0094] In some embodiments, the image captured by the camera can be input into the first target model for detection to determine the target image including the face image. The first target model can be used to recognize the face image of the input image.

[0095] After the image acquired by the camera is input into the first target model, if the first target model does not recognize that the input image includes a face image, the image that does not recognize that the face image is included may not be output. If the first target model recognizes that the input image includes a face image, the image that recognizes that the face image is included may be output. In this case, the image output by the first target model may be determined as the target image.

[0096] S510: Determine the position of the user corresponding to each face image.

[0097] In some embodiments, for any facial image, the position of the user corresponding to the facial image can be determined based on the image information of the facial image. The image information of the facial image may include the position information of two pupil images (left pupil image and right pupil image) included in the facial image. The position information of the pupil image is used to characterize the position of the image center point of the pupil image.

[0098] In some embodiments, the target image may include a first face image, and the user corresponding to the first face image is the first user. The following takes determining the position of the first user corresponding to the first face image as an example to describe in detail the method for determining the position of the user corresponding to each face image in the embodiment of the present application.

[0099] The image information of the first face image may include position information of two pupil images (left pupil image and right pupil image) included in the first face image. Based on the position information of the two pupil images included in the first face image, the pupil distance on the first face image may be obtained. The pupil distance on the first face image is the distance between the image center points of the two pupil images included in the first face image.

[0100] In some embodiments, the target image may be input into a second target model for detection to obtain the pupil distance on the first face image. The second target model may be the same as the first target model or different from the first target model.

[0101] After the target image is input into the second target model, the second target model can establish a coordinate system on the target image and extract the coordinates of the image center points of the two pupil images included in the first face image in the target image. The second target model can output the pupil distance on the first face image based on the coordinates of the image center points of the two pupil images included in the first face image.

[0102] For example, see Figure 7, the target image includes a face image 701 and a face image 702. After the second target model establishes a coordinate system on the target image, the coordinates of the image center points of the two pupil images on the face image 701 are extracted as (10, 50) and (40, 50), respectively. The coordinates of the image center points of the two pupil images on the face image 702 are extracted as (60, 70) and (95, 70), respectively. The second target model can output the pupil distance on the face image 701 as 30 mm based on the coordinates of the image center points of the two pupil images on the face image 701 (10, 50) and (40, 50), and can output the pupil distance on the face image 702 as 35 mm based on the coordinates of the image center points of the two pupil images on the face image 702 (60, 70) and (95, 70).

[0103] In some embodiments, based on the pupil distance on the first face image, the pupil distance of the first user, and the focal length of the camera, the distance between the first user and the camera (which may also be referred to as the first distance in the embodiment of the present application) can be determined. The first distance is the distance between the center point between the first user's pupils (which may also be referred to as the first center point in the embodiment of the present application) and the focus of the camera. In addition, since the camera is built into the display device, or the camera is set close to the display screen of the display device, the distance between the first user and the display screen of the display device can also be determined as the first distance. That is, the distance between the first user and the display device can be determined as the first distance.

[0104] For example, see Fig. 8A , if r represents the pupil distance on the first face image, R represents the pupil distance of the first user, f represents the focal length of the camera, and d represents the first distance, then the relationship among r, R, f, and d is R / r=d / f. That is, the first distance d=R*f / r.

[0105] In some embodiments, the pupil distance of the first user may be a pre-set standard pupil distance. For example, the standard pupil distance may be set to 70 mm. The first distance may be determined based on the pupil distance on the first face image, the standard pupil distance, and the focal length of the camera.

[0106] In some embodiments, the pupil distance of the first user may be the real pupil distance of the first user. The first distance may be determined based on the pupil distance on the first face image, the real pupil distance of the first user, and the focal length of the camera.

[0107] For example, a family member includes member 1, and the pupil distance of member 1 is 70 mm. A correspondence between the pupil distance of member 1 (70 mm) and the facial image of member 1 can be established. Afterwards, when a target image including a facial image is acquired, the facial image can be matched with the facial image of member 1 to determine whether the facial image is the facial image of member 1.

[0108] The facial image can be matched with the facial image of member 1 based on the third target model. The third target model is used to obtain the position information of the feature points of the input facial image. The third target model can be the same as at least one of the first target model and the second target model, or can be different from both the first target model and the second target model.

[0109] The face image and the face image of member 1 are input into the third target model, and the third target model can output the position information of the feature points of the face image and the position information of the feature points of the face image of member 1. Based on the position information of the feature points of the face image and the position information of the feature points of the face image of member 1, the similarity between the face image and the face image of member 1 can be determined.

[0110] If the similarity between the facial image and the facial image of member 1 is greater than a threshold, it can be determined that the facial image matches the facial image of member 1 successfully, and furthermore, it can be determined that the user corresponding to the facial image is member 1. The pupil distance of member 1, 70 mm, can be determined as the pupil distance of the user corresponding to the facial image, so as to determine the distance between member 1 and the display device based on the pupil distance on the facial image, the pupil distance of member 1, 70 mm, and the focal length of the camera.

[0111] If the similarity between the facial image and the facial image of member 1 is less than or equal to the threshold, it can be determined that the facial image fails to match the facial image of member 1, and further it can be determined that the user corresponding to the facial image is not member 1. In this case, the pre-set standard pupil distance can be determined as the pupil distance of the user corresponding to the facial image, so as to determine the distance between the user corresponding to the facial image and the display device based on the pupil distance on the facial image, the standard pupil distance and the focal length of the camera. The description of the standard pupil distance can be found in the above-mentioned embodiment, and will not be repeated here.

[0112] In some embodiments, the distance between the center point between the two pupil images included in the first face image (also referred to as the second center point in the embodiments of the present application) and the image center point of the target image can be obtained. The distance between the second center point and the image center point of the target image can be obtained based on the coordinates of the two pupil images included in the first face image and the coordinates of the image center point of the target image. The description of obtaining the coordinates of the two pupil images included in the first face image and the coordinates of the image center point of the target image can refer to the description of obtaining the coordinates of the two pupil images included in the first face image based on the second target model in the aforementioned embodiment, which will not be repeated here.

[0113] Based on the distance between the second center point and the image center point of the target image, the focal length of the camera, and the first distance, the distance between the first user and the normal corresponding to the display device (also referred to as the second distance in the embodiment of the present application) can be obtained. Figure 8B The normal line 801 corresponding to the display device is a straight line that is perpendicular to the display screen 802 of the display device and passes through the center of the display screen 802 .

[0114] For example, see Fig. 9 , if x is used to represent the distance between the second center point and the image center point of the target image, f is used to represent the focal length of the camera, d is used to represent the first distance, and y is used to represent the second distance, then the relationship between x, f, d, and y can be obtained as follows: That is, the second distance

[0115] In some embodiments, based on the position of the second center point relative to the image center point of the target image, the position of the first user relative to the normal corresponding to the display device can be determined. The position of the first user relative to the normal corresponding to the display device is the position of the second center point corresponding to the first user relative to the normal corresponding to the display device.

[0116] For example, see Fig.10 The target image includes a face image 1001 and a face image 1002. Among them, the face image 1001 corresponds to the user 1011, and the face image 1002 corresponds to the user 1012. If the second center point A on the face image 1001 is located due west of the image center point O, it can be determined that the user 1011 is located due west of the normal line L corresponding to the display device. If the second center point B on the face image 1002 is located 45° west of the image center point O, it can be determined that the user 1021 is located 45° west of the normal line L corresponding to the display device.

[0117] In some embodiments, based on the first distance, the second distance, and the position of the first user relative to the normal corresponding to the display device, the position of the first center point corresponding to the first user may be determined. That is, the position of the first user is determined.

[0118] For example, if the first distance is 70 cm, the second distance is 20 cm, and the first user is located due west of the normal line L corresponding to the display device. Based on the first distance, the second distance, and the orientation of the first user relative to the normal line L, the position of the first center point corresponding to the first user can be determined, and the position of the first center point corresponding to the first user is determined as the position of the first user. The distance between the position of the first center point corresponding to the first user and the display device is 70 cm, and the distance between the position of the first center point and the normal line L is 20 cm. The position of the first center point corresponding to the first user is located due west of the normal line L.

[0119] In the embodiment of the present application, for any facial image, the method for determining the position of the first user based on the image information of the first facial image in the above embodiment can be referred to, and the position of the user corresponding to the any facial image can be determined based on the image information of the any facial image. Moreover, compared with the traditional method of determining the user position based on a position sensor, this method of determining the position of the user corresponding to the facial image based on a facial image can reduce the implementation cost.

[0120] S520: For any user, based on the position of the user, determine the viewing area space of the user.

[0121] In some embodiments, for any user, the position of the user relative to the normal corresponding to the display device can be determined based on the position of the user. Based on the position of the user relative to the normal corresponding to the display device and the position of the boundaries of each viewing space relative to the normal corresponding to the display device, the viewing space where the user is located can be determined.

[0122] Among them, since the boundary of each viewing area space is a plane passing through the midpoint of the display screen of the display device, and the normal corresponding to the display device is also a straight line passing through the midpoint of the display screen of the display device, there is an angle between the boundary of each viewing area space and the normal corresponding to the display device. For any viewing area space, the boundary of the viewing area space can be determined based on the light-emitting direction of the light-emitting element on the display panel corresponding to the viewing area space, so as to obtain the angle between the boundary of the viewing area space and the normal corresponding to the display device. The position of the boundary of the viewing area space relative to the normal corresponding to the display device can be represented by the angle between the boundary of the viewing area space and the normal corresponding to the display device.

[0123] For example, see Fig.11The display device includes three display panels, namely display panel 1101, display panel 1102 and display panel 1103. Display panel 1101 corresponds to viewing area space V1, display panel 1102 corresponds to viewing area space V2, and display panel 1103 corresponds to viewing area space V3. Based on the light-emitting directions of the light-emitting elements on the display panels 1101, 1102 and 1103, it can be determined that the angle between a boundary 1111 of the viewing zone space V1 and the normal D corresponding to the display device is 90°, and the angle between another boundary 1121 of the viewing zone space V1 and the normal D corresponding to the display device is 30°; the angle between a boundary 1121 of the viewing zone space V2 and the normal D corresponding to the display device is 30°, and the angle between another boundary 1131 of the viewing zone space V2 and the normal D corresponding to the display device is -40°; the angle between a boundary 1131 of the viewing zone space V3 and the normal D corresponding to the display device is -40°, and the angle between another boundary 1141 of the viewing zone space V3 and the normal D corresponding to the display device is -90°.

[0124] It should be noted that the positive or negative value of the angle between the boundary of the viewing zone space and the normal corresponding to the display device is only used to indicate the orientation of the boundary of the viewing zone space relative to the normal corresponding to the display device, and is not used to indicate the size of the angle between the boundary of the viewing zone space and the normal corresponding to the display device. The boundary of the viewing zone space with a positive angle with the normal corresponding to the display device is located on one side of the normal corresponding to the display device. For example, Fig.11 The boundary 1111 and the boundary 1121 in are both located on the left side of the normal D. The boundaries of the viewing area space with a negative angle between the normal corresponding to the display device are all located on the other side of the normal corresponding to the display device. For example, Fig.11 Boundary 1131 and boundary 1141 in FIG. 1 are both located on the right side of normal line D.

[0125] In some embodiments, the line between the position of the user corresponding to the face image and the midpoint of the display screen of the display device can be determined as the reference line corresponding to the user. Since the reference line corresponding to the user and the normal line corresponding to the display device intersect at the midpoint of the display screen of the display device, there is also an angle between the reference line corresponding to the user and the normal line corresponding to the display device. The position of the user relative to the normal line corresponding to the display device can be represented by the angle between the reference line corresponding to the user and the normal line corresponding to the display device.

[0126] For example, if user 1 is located at point K, the line between point K and the midpoint O of the display screen of the display device can be determined as the reference line H1 corresponding to user 1. If the angle between the reference line H1 corresponding to user 1 and the normal line D corresponding to the display device is -25°, the position of user 1 relative to the normal line D corresponding to the display device can be as follows: Fig.11 shown.

[0127] For another example, if user 2 is located at point F, the line between point F and the midpoint O of the display screen of the display device can be determined as the reference line H2 corresponding to user 2. If the angle between the reference line H2 corresponding to user 2 and the normal line D corresponding to the display device is 45°, the position of user 2 relative to the normal line D corresponding to the display device can be as follows: Fig.11 shown.

[0128] It should be noted that, similar to the positive and negative values ​​of the angle between the boundary of the viewing area space and the normal corresponding to the display device used to indicate the orientation of the boundary of the viewing area space relative to the normal corresponding to the display device, the positive and negative values ​​of the angle between the baseline and the normal corresponding to the display device are only used to indicate the orientation of the baseline relative to the normal corresponding to the display device, and are not used to indicate the size of the angle between the baseline and the normal corresponding to the display device. Among them, the baselines with positive angles between the normals corresponding to the display device are all located on one side of the normal corresponding to the display device. For example, the baseline H2 is located on the left side of the normal D. The baselines with negative angles between the normals corresponding to the display device are all located on the other side of the normal corresponding to the display device. For example, the baseline H1 is located on the right side of the normal D.

[0129] Furthermore, the boundary of the viewing zone space whose angles between the normals corresponding to the display device are positive and the reference line whose angles between the normals corresponding to the display device are positive are both located on one side of the normals corresponding to the display device. For example, Fig.11 The boundary 1111, the boundary 1121 and the reference line H2 in the figure are all located on the left side of the normal line D. The boundary of the viewing zone space with a negative angle between the normal lines corresponding to the display device and the reference line with a negative angle between the normal lines corresponding to the display device are both located on the other side of the normal lines corresponding to the display device. For example, Fig.11 The boundary 1131 , the boundary 1141 and the reference line H1 are all located on the right side of the normal line D.

[0130] Based on the position of the user relative to the normal line corresponding to the display device and the position of the boundary of each viewing zone space relative to the normal line corresponding to the display device, an example of determining the viewing zone space where the user is located can be as follows: Fig.11As shown, since the angle between the reference line H1 corresponding to user 1 and the normal line D corresponding to the display device is -25°, the angle between one boundary 1121 of the viewing zone space V2 and the normal line D corresponding to the display device is 30°, and the angle between another boundary 1131 of the viewing zone space V2 and the normal line D corresponding to the display device is -40°. Therefore, it can be determined that user 1 is located in the viewing zone space V2. Since the angle between the reference line H2 corresponding to user 2 and the normal line D corresponding to the display device is 45°, the angle between one boundary 1111 of the viewing zone space V1 and the normal line D corresponding to the display device is 90°, and the angle between another boundary 1121 of the viewing zone space V1 and the normal line D corresponding to the display device is 30°. Therefore, it can be determined that user 2 is located in the viewing zone space V1.

[0131] S530: Obtain the viewing angle of the user in each viewing area space.

[0132] The field of view angle refers to the angle formed by the line connecting the first center point corresponding to the user and the edge of the display screen of the display device. The field of view angle may include a horizontal field of view angle and a vertical field of view angle. For example, the line connecting the first center point G corresponding to the user 1 and the edge of the display screen of the display device is as follows: Fig.12 As shown in the figure, ∠CGD is the horizontal field of view, and ∠AGB is the vertical field of view.

[0133] In some embodiments, for any viewing space, the horizontal viewing angle and the vertical viewing angle of each user in the viewing space can be obtained. Based on the horizontal viewing angle of each user in the viewing space, a set of horizontal viewing angles corresponding to the viewing space can be obtained. Based on the vertical viewing angle of each user in the viewing space, a set of vertical viewing angles corresponding to the viewing space can be obtained.

[0134] If the viewing space of at least one user is called a first viewing space, each first viewing space corresponds to a horizontal viewing angle set and a vertical viewing angle set.

[0135] Exemplarily, if there are two first viewing spaces, namely, first viewing space A and first viewing space B. User 1 and user 2 are both located in first viewing space A. User 3 and user 4 are located in first viewing space B. User 1 has a horizontal field of view of 30° and a vertical field of view of 65°. User 2 has a horizontal field of view of 45° and a vertical field of view of 80°. User 3 has a horizontal field of view of 70° and a vertical field of view of 15°. User 4 has a horizontal field of view of 75° and a vertical field of view of 10°.

[0136] Based on the horizontal field of view of user 1 and user 2, the horizontal field of view set corresponding to the first viewing area space A can be obtained as {30°, 45°}. Based on the vertical field of view of user 1 and user 2, the vertical field of view set corresponding to the first viewing area space A can be obtained as {65°, 80°}. Based on the horizontal field of view of user 3 and user 4, the horizontal field of view set corresponding to the first viewing area space B can be obtained as {70°, 75°}. Based on the vertical field of view of user 3 and user 4, the vertical field of view set corresponding to the first viewing area space A can be obtained as {15°, 10°}.

[0137] S540: For any viewing space, based on the maximum viewing angle obtained in the viewing space, adjust the image displayed by the display panel corresponding to the viewing space.

[0138] In the scenario where the user looks out the window, the scenery seen by the user is different when the user is in different positions relative to the window. For example, the closer the user is to the window, the larger the picture seen, and the smaller the range of the scenery outside the window that can be blocked by the window. The farther the user is from the window, the smaller the picture seen, and the larger the range of the scenery outside the window that can be blocked by the window. When the user walks to one side relative to the window, the range of the scenery outside the window on that side blocked by the window gradually increases, and the range of the scenery outside the window on the other side blocked by the window gradually decreases. When the user walks to the other side relative to the window, the range of the scenery outside the window on the other side blocked by the window gradually increases, and the range of the scenery outside the window on that side blocked by the window gradually decreases.

[0139] Therefore, in order to allow the user to have a real experience of viewing the scenery outside the window when looking at the display screen of the display device, for any viewing space, the display parameters of the display panel corresponding to the viewing space can be configured based on the maximum field of view angle obtained in the viewing space, so that the display panel corresponding to the viewing space can display the corresponding picture based on the display parameters and the received data signal.

[0140] For ease of description, the picture corresponding to the data signal received by the display panel is referred to as the original picture, and the picture displayed by the display panel is referred to as the picture to be displayed, which corresponds to a partial area in the original picture.

[0141] In some embodiments, the display parameters may include a display range parameter and a scaling parameter. The display range parameter is used to characterize the area of ​​the image displayed by the display panel corresponding to the original image. For example, the display range parameter may include the boundary coordinates of the area of ​​the image displayed by the display panel corresponding to the original image. The display device may adjust which part of the original image is displayed by the corresponding display panel based on the display range parameter. For example, see Fig.13AThe display device can change the picture displayed by the corresponding display panel based on the display range parameter, so as to update the picture displayed by the display panel from picture 1301 to picture 1302. The scaling parameter is used to represent the ratio of the picture to be displayed to be enlarged or reduced relative to the original picture. The display device can adjust the size of the picture displayed by the display panel based on the scaling parameter. For example, see Fig. 13B The display device may enlarge the picture displayed by the corresponding display panel based on the scaling parameter to update the picture displayed by the display panel from picture 1303 to picture 1304.

[0142] It should be noted that the display parameters in the embodiment of the present application may include brightness parameters, contrast parameters, resolution parameters, etc. in addition to the scaling parameters and display range parameters, which are not limited in the embodiment of the present application.

[0143] In some embodiments, the closer the user is to the plane where the display screen of the display device is located, the larger the vertical field of view of the user relative to the display device. The closer the user is to the normal corresponding to the display device in the horizontal direction, the larger the horizontal field of view of the user relative to the display device. The closer the user is to the normal corresponding to the display device in the vertical direction perpendicular to the horizontal direction, the larger the horizontal field of view of the user relative to the display device. In addition, in order to ensure that the picture displayed by the corresponding display panel seen by each user can meet the visual field requirements of all users, for any visual area space where there is a user, the maximum horizontal field of view angle can be obtained in the horizontal field of view angle set corresponding to the visual area space, and the maximum vertical field of view angle can be obtained in the vertical field of view angle set corresponding to the visual area space. Based on the maximum horizontal field of view angle and the maximum vertical field of view angle obtained, the display parameters of the display panel corresponding to the visual area space can be configured so that the display panel can display the corresponding picture based on the display parameters and the input data signal. Among them, the description of the horizontal field of view angle set and the vertical field of view angle set corresponding to the visual area space can refer to the description in the aforementioned step S530, which will not be repeated here.

[0144] For example, see Fig.14 , user 1 and user 2 are both users in visual space 1. User 3 is a user in visual space 2. In visual space 1, the vertical field of view of user 1 is greater than that of user 2, and the horizontal field of view of user 2 is greater than that of user 1. That is, the vertical field of view of user 1 is the maximum vertical field of view that can be obtained in visual space 1, and the horizontal field of view of user 2 is the maximum horizontal field of view that can be obtained in visual space 1. In visual space 2, since only user 3 is located in visual space 2, the vertical field of view of user 3 is the maximum vertical field of view that can be obtained in visual space 2, and the horizontal field of view of user 3 is the maximum horizontal field of view that can be obtained in visual space 2.

[0145] If the data signals input to the display panel 1 corresponding to the viewing zone space 1 and the display panel 2 corresponding to the viewing zone space 2 are both data signals corresponding to the picture 1400, then based on the vertical viewing angle of the user 1 and the horizontal viewing angle of the user 2, the display parameters of the display panel 1 corresponding to the viewing zone space 1 can be configured. The display panel 1 can display the picture 1401 based on the display parameters and the input data signal. Based on the horizontal viewing angle of the user 3 and the vertical viewing angle of the user 3, the display parameters of the display panel 2 corresponding to the viewing zone space 2 can be configured. The display panel 2 can display the picture 1402 based on the display parameters and the input data signal.

[0146] It can be seen that both the picture 1401 and the picture 1402 correspond to partial areas in the picture 1400. Among them, the picture 1401 corresponds to the area A in the picture 1400, and the picture 1402 corresponds to the area B in the picture 1400. In addition, since the vertical field of view of the user 1 is greater than the vertical field of view of the user 3, if the picture 1401 displayed by the display panel 1 is enlarged by X times compared with the area A in the picture 1400, the picture 1402 displayed by the display panel 2 is enlarged by less than X times compared with the area B in the picture 1400, or the picture 1402 displayed by the display panel 2 is reduced by Y times compared with the area B in the picture 1400. Among them, X and Y can be the same or different, and the embodiment of the present application is not limited.

[0147] Since the horizontal viewing angle of user 3 is greater than that of user 2, the area B corresponding to picture 1402 in picture 1400 is greater than the area A corresponding to picture 1401 in picture 1400. Since users 1 and 2 are located in viewing zone space 1, and user 3 is located in viewing zone space 2, which is different from viewing zone space 1, the area A corresponding to picture 1401 in picture 1400 and the area B corresponding to picture 1402 in picture 1400 are different.

[0148] In combination with the above-mentioned embodiment, the viewing area space where at least one user exists can be determined as the first viewing area space. And the viewing area space where no user exists can be determined as the second viewing area space. Fig.11 Since user 2 exists in the viewing zone space V1 and user 1 exists in the viewing zone space V2, both viewing zone space V1 and viewing zone space V2 can be determined as the first viewing zone space. Since there is no user in the viewing zone space V3, viewing zone space V3 can be determined as the second viewing zone space.

[0149] Since there is at least one user in the first viewing space and no user in the second viewing space, the display parameters configured in the embodiments of the present application are all display parameters configured for the display panels corresponding to each first viewing space. After configuring the display parameters of the display panels corresponding to each first viewing space, the state of each display panel included in the display device can be detected. Among them, the state includes a working state and a non-working state. A display panel in a working state is a display panel to which an input source input data signal exists. A display panel in a non-working state is a display panel to which no input source input data signal exists. A display panel in a working state can display a corresponding picture based on the data signal input by the input source.

[0150] If it is detected that the display panel corresponding to the first viewing zone space is in a non-working state, a corresponding data signal is input to the display panel to switch the state of the display panel to a working state. Afterwards, the picture displayed by the display panel can be adjusted based on the display parameters configured for the display panel so that the picture displayed by the display panel can meet the visual field requirements of all users in the first viewing zone space corresponding to the display panel.

[0151] If it is detected that the display panels corresponding to each first visual space are in a working state, then for any visual space, the picture displayed by the display panel corresponding to the first visual space can be adjusted based on the display parameters configured for the first visual space, so that the picture displayed by the display panel can meet the field of vision requirements of all users in the first visual space corresponding to the display panel.

[0152] If it is detected that the display panel corresponding to the second viewing area space is in a working state, the corresponding data signal can be stopped from being input to the display panel to switch the state of the display panel to a non-working state, thereby reducing the power consumption of the display device.

[0153] In some schemes, multiple embodiments of the present application can be combined, and the combined scheme can be implemented. Optionally, some operations in the process of each method embodiment are optionally combined, and / or the order of some operations is optionally changed. In addition, the execution order between the steps of each process is only exemplary and does not constitute a restriction on the execution order between the steps. There can also be other execution orders between the steps. It is not intended to indicate that the execution order is the only order in which these operations can be performed. A person of ordinary skill in the art will think of a variety of ways to reorder the operations described herein. In addition, it should be noted that the process details involved in a certain embodiment of this article are also applicable to other embodiments in a similar manner, or different embodiments can be used in combination.

[0154] In addition, some steps in the method embodiment may be equivalently replaced by other possible steps. Alternatively, some steps in the method embodiment may be optional and may be deleted in certain usage scenarios. Alternatively, other possible steps may be added to the method embodiment.

[0155] Furthermore, the various method embodiments may be implemented separately or in combination.

[0156] It is understandable that in order to implement the above functions, the display device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in a hardware or software-driven hardware manner depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0157] In this embodiment, the display device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0158] For example, see Fig.15 The display device provided in the embodiment of the present application may include an acquisition module 1501, an identification module 1502, a control module 1503, a display module 1504 and an input source module 1505.

[0159] The acquisition module 1501 is used to acquire a target image including at least one face image.

[0160] The recognition module 1502 is used to determine the position of the user corresponding to each face image based on the target image including at least one face image acquired by the acquisition module 1501, thereby determining the visual space where each user is located. And, the recognition module is also used to obtain the viewing angle of the user located in the target visual space. The target visual space can be any visual space.

[0161] The control module 1503 is used to determine the maximum field of view angle from the field of view angles corresponding to the target viewing area space obtained by the identification module 1502. And, the control module 1503 is also used to configure the display parameters of the target display panel based on the maximum field of view angle corresponding to the target viewing area space obtained. The target display panel is the display panel corresponding to the target viewing area space. For example, the target display panel is the display panel corresponding to the target viewing area space among display panels 1-display panels n.

[0162] The input source module 1505 is used to input data signals corresponding to the picture to the display module 1504 .

[0163] The display module 1504 controls the target display panel to display the corresponding picture based on the data signal input by the input source module 1505 and the display parameters corresponding to the target display panel configured by the control module 1503 .

[0164] The present application also provides a display device, such as Fig.16 As shown, the display device may include one or more processors 1601 , a memory 1602 , and a communication interface 1603 .

[0165] The memory 1602 and the communication interface 1603 are coupled to the processor 1601. For example, the memory 1602, the communication interface 1603 and the processor 1601 may be coupled together via a bus 1604.

[0166] The communication interface 1603 is used for data transmission with other devices. The memory 1602 stores program codes. The program codes include instructions. When the instructions are executed by the processor 1601, the display device executes the method in the embodiment of the present application.

[0167] Among them, the processor 1601 can be a processor or a controller, for example, it can be a central processing unit (CPU), a general processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the contents of this disclosure. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of DSP and microprocessors, and so on. The processor can be used to support the display device to execute the method steps provided in the above embodiments. For example, the processor can be used to support the display device to execute Figure 5 S500-S540 in.

[0168] The bus 1604 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus 1604 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.16 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0169] An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the chip system implements the method in any of the above method embodiments.

[0170] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0171] Optionally, the memory in the chip system may also be one or more. The memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively. The embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.

[0172] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0173] It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0174] An embodiment of the present application further provides a readable storage medium, in which a program code is stored. When the above-mentioned processor executes the program code, the display device executes the relevant method steps in the above-mentioned method embodiment.

[0175] The embodiment of the present application also provides a program product. When the program product is run on a display device, the display device executes the relevant method steps in the above method embodiment.

[0176] In addition, an embodiment of the present application further provides a device. The device may be a component or a module, and the device may include one or more processors and a memory connected to each other. The memory is used to store a program. When the program is executed by one or more processors, the device performs the scene configuration method in the above-mentioned method embodiments.

[0177] Among them, the device, readable storage medium, program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0178] The steps of the method or algorithm described in conjunction with the disclosed content of the embodiments of the present application can be implemented in hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, read-only compact disks (CD-ROMs) or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC).

[0179] Through the description of the above implementation methods, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed; that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

Claims

1. A display method, characterized in that: Applied to a display device, the display screen of the display device includes at least one display panel, and one display panel corresponds to one viewing area space; the method includes: Acquire a target image, wherein the target image includes a face image of at least one user around the display device; For any user, based on the image information of the face image of the user, determining the viewing area space where the user is located; For any viewing zone space, the picture displayed by the display panel corresponding to the viewing zone space is adjusted based on the viewing angle of the user in the viewing zone space.

2. The method according to claim 1, characterized in that The field of view angle includes a horizontal field of view angle and a vertical field of view angle; and adjusting the picture displayed on the display panel corresponding to the viewing area space based on the field of view angle of the user in the viewing area space includes: Obtaining a horizontal field of view angle and a vertical field of view angle of each user in the viewing area space; Based on the obtained maximum horizontal field of view angle and the maximum vertical field of view angle, configuring display parameters of the display panel corresponding to the viewing area space; Based on the display parameters of the display panel corresponding to the viewing zone space, the picture displayed by the display panel corresponding to the viewing zone space is adjusted.

3. The method according to claim 2, characterized in that The display parameters include display range parameters and scaling ratio parameters; the picture displayed by the display panel corresponds to part or all of the area in the original picture, and the original picture is a picture corresponding to the data signal received by the display panel; the display range parameter is used to characterize the area of ​​the picture displayed by the display panel corresponding to the original picture; the scaling ratio parameter is used to characterize the ratio of the picture displayed by the display panel to be enlarged or reduced relative to the original picture.

4. The method according to any one of claims 1 to 3, characterized in that: The facial image of the user includes two pupil images; the image information of the facial image includes position information of the image center points of the two pupil images; and determining the visual zone space where the user is located based on the image information of the facial image of the user includes: Determining the position of the user based on position information of image center points of two pupil images included in the face image of the user; Based on the position of the user, a viewing area space of the user is determined.

5. The method according to claim 4, characterized in that The target image is acquired based on a camera; and the position of the user is determined based on the position information of the image center points of two pupil images included in the face image of the user, including: Determining the pupil distance on the user's face image based on position information of image center points of two pupil images included in the user's face image; Determining the distance between the user and the display device based on the pupil distance on the user's face image, the pupil distance of the user, and the focal length of the camera; The position of the user is determined based on the distance between the user and the display device, the distance between the user and the normal corresponding to the display device, and the orientation of the user relative to the normal corresponding to the display device; wherein the normal corresponding to the display device is a straight line perpendicular to the display screen and passing through the center of the display screen.

6. The method according to claim 5, characterized in that The distance between the normal lines corresponding to the user and the display device is determined based on the distance between the face image of the user and the image center point of the target image, the focal length of the camera, and the distance between the user and the display device.

7. The method according to claim 5 or 6, characterized in that: The position of the normal corresponding to the user relative to the display device is determined based on the position of the facial image corresponding to the user relative to the image center point of the target image.

8. The method according to any one of claims 4 to 7, characterized in that: The determining, based on the position of the user, a viewing area space where the user is located, includes: Based on the position of the user, determine the angle between the reference line corresponding to the user and the normal line corresponding to the display device; wherein the normal line corresponding to the display device is a straight line perpendicular to the display screen and passing through the center of the display screen; the reference line corresponding to the user is a line between the position of the user and the image center point of the target image; The viewing zone space where the user is located is determined based on the angle value between the reference line corresponding to the user and the normal line corresponding to the display device, and the angle value between the boundary of each viewing zone space and the normal line corresponding to the display device.

9. A display device, characterized in that: include: at least one display screen, a memory, and one or more processors; Wherein, the display screen includes at least one display panel, the display panel is used to display a picture, and one display panel corresponds to one viewing area space; the memory is coupled to the processor; the memory stores program code, and the program code includes instructions. When the instructions are executed by the processor, the display device executes the method described in any one of claims 1-8.

10. A readable storage medium, comprising instructions, characterized in that: When the instruction is executed on the display device, the display device executes the method according to any one of claims 1 to 8.

Images