A display method, device, electronic equipment and storage medium

Abstract

The present disclosure provides a display method, device, electronic equipment and storage medium, the method comprising: acquiring an environment image collected by a camera module; performing human body recognition on the environment image to obtain a human body image; determining head features and body features of a viewing object of a display module based on the human body image, further determining orientation information of the viewing object of the display module, and determining a relative direction of the viewing object relative to the electronic equipment according to the orientation information; determining a display direction of to-be-displayed content based on the relative direction, and controlling the display module to display the to-be-displayed content to the viewing object in the display direction. By applying the method, the existing camera module of the electronic equipment is used to realize direction perception, and then the display direction of the content displayed by the display module is adjusted, thereby improving the viewing experience of the user, saving special perception devices such as gravity sensors, reducing the manufacturing cost of the electronic equipment, and saving the space of the electronic equipment.

Description

Technical Field

[0001] This disclosure relates to the field of electronic devices, and more particularly to a display method, apparatus, electronic device, and storage medium. Background Technology

[0002] Electronic devices use gravity sensors or gyroscopes to determine their orientation and adjust the display direction of their screens. However, these sensors, as independent electronic components, require dedicated physical space within the device, increasing manufacturing costs. Furthermore, when the device is positioned correctly, the sensors may fail to determine its orientation, causing the screen rotation function to malfunction. Summary of the Invention

[0003] This disclosure provides a display method, apparatus, electronic device, and storage medium to at least solve the above-mentioned technical problems existing in the prior art.

[0004] According to a first aspect of this disclosure, a display method is provided, applied to an electronic device including a camera module and a display module. The method includes: acquiring an environmental image captured by the camera module; performing human body recognition on the environmental image to obtain a human body image; determining head features and body features of a viewing object of the display module based on the human body image; determining orientation information of the viewing object of the display module based on the head features and body features, and determining the relative direction of the viewing object relative to the electronic device based on the orientation information; determining a display direction of content to be displayed based on the relative direction, and controlling the display module to display the content to be displayed to the viewing object in the display direction.

[0005] In one embodiment, the head features include at least the center image point of the head of the viewing object, and the body features include at least the shoulder image points of the two shoulders of the viewing object. Determining the orientation information of the viewing object of the display module based on the head features and body features includes: determining a first straight line based on the two shoulder image points; determining a second straight line perpendicular to the first straight line based on the center image point of the head; and determining the direction of the second straight line pointing to one side of the head as the orientation information of the viewing object.

[0006] In one possible implementation, determining the relative orientation of the viewing object with respect to the electronic device based on the orientation information includes: mapping the orientation information to a preset physical coordinate system; and determining the relative orientation of the viewing object of the display module with respect to the electronic device based on the position information of the orientation information in the preset physical coordinate system and the position information of the display module in the preset physical coordinate system.

[0007] In one possible implementation, determining the display direction of the content to be displayed based on the relative direction includes: obtaining a preset display matching strategy; matching the relative direction with the preset display matching strategy to obtain a matching result; and determining the display direction of the content to be displayed based on the matching result.

[0008] In one possible implementation, performing human body recognition on the environmental image to obtain a human body image includes: performing human body detection on the environmental image to determine whether the environmental image contains a human body; in response to the environmental image containing a human body, determining the environmental image as a target image; and performing human body recognition on the target image to obtain a human body image.

[0009] In one embodiment, before acquiring the environmental image captured by the camera module, the method further includes: determining whether the camera module is in a working state; in response to the camera module being in a working state, controlling the camera module to acquire the environmental image in a first pixel mode; in response to the camera module being in a non-working state, controlling the camera module to acquire the environmental image in a second pixel mode; wherein the image pixels in the first pixel mode have better clarity and resolution than the image pixels in the second pixel mode.

[0010] In one possible implementation, controlling the camera module to acquire environmental images in a second pixel mode includes: controlling the camera module to acquire environmental images in an interlaced scanning and / or interlaced column scanning manner.

[0011] According to a second aspect of this disclosure, a display device is provided, applied to an electronic device including a camera module and a display module. The device includes: an acquisition module for acquiring an environmental image captured by the camera module; a recognition module for performing human body recognition on the environmental image to obtain a human body image; a determination module for determining head features and body features of a viewing object of the display module based on the human body image; the determination module is further configured to determine orientation information of the viewing object of the display module based on the head features and body features, and determine the relative direction of the viewing object relative to the electronic device according to the orientation information; and a first control module for determining the display direction of content to be displayed based on the relative direction, and controlling the display module to display the content to be displayed to the viewing object in the display direction.

[0012] In one possible implementation, the head features include at least the center image point of the head of the viewing object, and the body features include at least the shoulder image points of the two shoulders of the viewing object. The determining module is specifically used to determine a first straight line based on the two shoulder image points; determine a second straight line perpendicular to the first straight line based on the center image point of the head; and determine the direction of the second straight line pointing to one side of the head as the orientation information of the viewing object.

[0013] In one possible implementation, the determining module includes: a mapping submodule for mapping the orientation information to a preset physical coordinate system; and a first determining submodule for determining the relative orientation of the viewing object of the display module relative to the electronic device based on the position information of the orientation information in the preset physical coordinate system and the position information of the display module in the preset physical coordinate system.

[0014] In one possible implementation, the first control module includes: an acquisition submodule for acquiring a preset display matching strategy; a matching submodule for matching the relative direction with the preset display matching strategy to obtain a matching result; and a second determination submodule for determining the display direction of the content to be displayed based on the matching result.

[0015] In one possible implementation, the recognition module is specifically used to perform human detection on the environmental image to determine whether the environmental image contains a human body; in response to the environmental image containing a human body, to determine the environmental image as a target image; and to perform human body recognition on the target image to obtain a human body image.

[0016] In one embodiment, the device further includes: a second control module, configured to determine whether the camera module is in a working state; in response to the camera module being in a working state, controlling the camera module to acquire an environmental image in a first pixel mode; and in response to the camera module being in a non-working state, controlling the camera module to acquire an environmental image in a second pixel mode; wherein the image pixels in the first pixel mode have better clarity and resolution than the image pixels in the second pixel mode.

[0017] In one embodiment, the second control module is further configured to control the camera module to acquire environmental images in an interlaced scanning and / or interleaved column scanning manner.

[0018] According to a third aspect of this disclosure, an electronic device is provided, comprising: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the methods described in this disclosure.

[0019] According to a fourth aspect of this disclosure, a non-transitory computer-readable storage medium is provided storing computer instructions for causing a computer to perform the methods described in this disclosure.

[0020] This disclosure discloses a display method, apparatus, electronic device, and storage medium applied to an electronic device including a camera module and a display module. First, the camera module acquires an environmental image, and then performs human recognition on the environmental image to obtain a human image. Based on the obtained human image, the head and body features of the viewer are determined. Based on the head and body features, the orientation information of the viewer is determined, and the relative direction of the viewer with respect to the electronic device is determined according to the orientation information. Finally, the display direction of the content to be displayed is determined based on this relative direction, and the display module is controlled to display the content to be displayed to the viewer in the specified display direction. By applying this method, the existing camera module of the electronic device achieves orientation perception, and the display direction of the content displayed by the display module is adjusted based on the relative relationship between the viewer and the camera module. This improves the user's viewing experience, eliminates reliance on dedicated sensing devices such as gravity sensors, reduces the manufacturing cost of the electronic device, and saves space.

[0021] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0022] The above and other objects, features, and advantages of this disclosure will become readily apparent from the following detailed description of exemplary embodiments, taken in conjunction with the accompanying drawings. Several embodiments of this disclosure are illustrated in the drawings by way of example and not limitation, in which: In the accompanying drawings, the same or corresponding reference numerals indicate the same or corresponding parts.

[0023] Figure 1 A schematic diagram illustrating the implementation flow of a display method according to an embodiment of this application is shown; Figure 2 A schematic diagram illustrating the implementation flow of another display method according to an embodiment of this application is shown; Figure 3 This illustration shows a schematic diagram of determining the orientation information of a viewing object according to an embodiment of this application; Figure 4a and Figure 4b This illustration shows a schematic diagram of determining the display direction of content to be displayed based on relative direction according to an embodiment of this application; Figure 5 A schematic diagram illustrating an environmental image acquisition method according to an embodiment of this application is shown; Figure 6 This invention provides a schematic diagram illustrating the module composition of a display device according to an embodiment of the present application. Figure 7 A schematic diagram of the composition structure of an electronic device according to an embodiment of this application is shown. Detailed Implementation

[0024] To make the objectives, features, and advantages of this disclosure more apparent and understandable, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0025] A first aspect of this application provides a display method, which is performed by an electronic device including a camera module and a display module. The electronic device includes, but is not limited to, electronic devices capable of image capture and analysis such as laptops, tablets, and mobile phones.

[0026] Figure 1 This illustration shows a schematic diagram of the implementation flow of a display method according to an embodiment of the present disclosure, as follows: Figure 1 As shown, the method includes: Step 101: Obtain environmental images captured by the camera module.

[0027] This application acquires environmental images by using the camera module of an electronic device. Since the display direction of the content displayed by the display module is determined by the relative position of the viewing object and the electronic device, the image acquisition needs to be performed in the front-facing mode of the camera module.

[0028] Step 102: Perform human body recognition on the environmental image to obtain a human body image.

[0029] Human body recognition is performed on the acquired environmental images to determine whether a human body is present. The presence of a human body indicates the presence of a viewer for the display module, and the human body image is extracted from the environmental image. For better subsequent results, the human body image should ideally include the shoulders and above. To reduce computational load, non-human body images in the environmental image can be discarded.

[0030] Step 103: Based on the human image, determine the head and body features of the viewing object of the display module.

[0031] After obtaining the human body image, the human body image is identified to determine the object characteristics of the viewing object. Considering that the human torso is more stable and less susceptible to interference from factors such as head swaying of the viewing object, the object characteristics of this application include the head characteristics and body characteristics of the viewing object, such as the outline, facial features, gestures, eye direction of the viewing object, and the characteristics of some special positioning points, such as shoulder image points, head center image points, etc., which are used to subsequently assist in determining the orientation information of the viewing object.

[0032] Step 104: Based on head and body features, determine the orientation information of the viewing object of the display module, and determine the relative direction of the viewing object with respect to the electronic device based on the orientation information.

[0033] Step 105: Determine the display direction of the content to be displayed based on the relative direction, and control the display module to display the content to be displayed to the viewing object in the display direction.

[0034] Based on head and body features identified in human images, the orientation information of the viewing object in the display module is determined. For example, the direction in which the human head points in the human image is determined as the orientation information of the viewing object. This orientation information characterizes the orientation of the viewing object in the human image. Based on this orientation information, the relative orientation of the viewing object with respect to the electronic device, as well as its deflection direction and angle, can be determined. The viewing direction of the user looking at the display module is determined as the display direction of the content to be displayed, and the display module is controlled to display the content to be displayed in this direction for the viewing object to see. For example, if the user's viewing direction is from top to bottom of the display module, the display direction of the content is determined to be from top to bottom of the display module, so as to ensure that the display content on the display screen is matched with the orientation of the viewing object, so that the display content seen by the user is always upright, thus improving the user experience.

[0035] This application discloses a display method that acquires environmental images using a camera module, obtains human images based on the environmental images, determines the head and body features of the viewing object on the display module based on the human images, determines the orientation information of the viewing object based on the head and body features, and determines the relative direction between the viewing object and the electronic device. Based on this relative direction, the method controls the direction in which the display module displays the content to be displayed. By utilizing the existing camera module of the electronic device to achieve orientation perception, the display orientation of the content displayed by the display module is adjusted, improving the user's viewing experience. This method is not limited by the placement of the electronic device and can ensure that the orientation of the content displayed by the display module is consistent with the viewing orientation of the viewing object. It eliminates the need for dedicated gravity sensors and other sensing devices, reduces the manufacturing cost of the electronic device, and saves space.

[0036] In one possible implementation, such as Figure 2As shown, the head features include at least the center image point of the viewer's head, and the body features include at least the shoulder image points of the viewer's two shoulders. Based on human images, determine the orientation information of the viewing object of the display module, including: Step 201: Determine the first straight line based on the two shoulder image points; Step 202: Based on the head center image point, determine the second straight line perpendicular to the first straight line; Step 203: Determine the direction of the second straight line pointing to the side of the head as the orientation information of the viewing object.

[0037] In this embodiment, the head features include at least the center image point of the viewer's head, and the body features include at least the shoulder image points of the viewer's two shoulders. A first straight line is constructed based on the identified shoulder image points. Then, based on the head center image point, a second straight line is drawn perpendicular to the first straight line. The direction pointing towards the head in the second straight line is determined as the viewer's orientation information. This orientation information is used to subsequently determine the display direction of the content to be displayed. For example, a direction representation method such as north at the bottom and south at the top, west on the left and east on the right can be used. If the final orientation information of the viewer is determined to be north, the display module can be controlled to display the content in a north-to-south arrangement to improve the viewing experience for the user.

[0038] Furthermore, determining the orientation information of the viewed object is not limited to using shoulder image points from both shoulders and the center image point of the head; other image points such as ear image points and mouth center image points can also be used. This embodiment primarily considers the higher stability of the human torso, making it less susceptible to interference from factors such as head movements of the viewed object. Therefore, it preferentially uses shoulder image points from both shoulders and the center image point of the head to determine the orientation information of the viewed object, thereby reducing misjudgments and improving the user experience.

[0039] Figure 3 This illustrates a schematic diagram for determining the orientation information of a viewing object, such as... Figure 3 As shown, the shoulder image points of the viewing object's shoulders and the center image point of the head are determined. A first straight line is constructed based on the shoulder image points, and a second straight line perpendicular to the first straight line is constructed based on the center image point of the head. The side of the second straight line pointing towards the head of the viewing object is determined as the orientation information of the viewing object.

[0040] In one possible implementation, determining the relative orientation of the viewing object with respect to the electronic device based on orientation information includes: mapping the orientation information to a preset physical coordinate system; and determining the relative orientation of the viewing object of the display module with respect to the electronic device based on the position information of the orientation information in the preset physical coordinate system and the position information of the display module in the preset physical coordinate system.

[0041] A preset physical coordinate system is constructed, such as a coordinate system with the horizontal direction as the x-axis and the vertical direction as the y-axis in the real world. Then, the orientation information of the viewing object is mapped to the preset physical coordinate system to determine the position information of the viewing object's orientation information in the preset physical coordinate system. The display module of the electronic device is also mapped to the preset physical coordinate system to determine the position information of the display module in the preset physical coordinate system. Finally, based on the position information of the viewing object's orientation information in the preset physical coordinate system and the position information of the display module in the preset physical coordinate system, the relative direction of the viewing object relative to the electronic device is determined. This relative direction can be determined based on the relative distance or relative angle relationship between the position information of the viewing object's orientation information in the preset physical coordinate system and the position information of the display module in the preset physical coordinate system.

[0042] In one possible implementation, the preset physical coordinate system can be constructed using the plane where the display module of the electronic device is located. For example, in a laptop, the location of the camera can be used as the origin, and the long side and wide side of the screen can be used as the x-axis and y-axis, respectively, to construct the preset physical coordinate system. Then, the orientation information of the viewing object is mapped to the preset physical coordinate system. The position information of the orientation information in the preset physical coordinate system is determined based on the angle between the orientation information and the coordinate axes of the preset physical coordinate system and the distance from the coordinate axes. Based on the position information, the relative direction of the viewing object of the display module with respect to the electronic device is determined. For example, if the orientation information is parallel to the x-axis of the preset physical coordinate system and points in the positive direction of the x-axis, the relative direction of the viewing object with respect to the electronic device is that the viewing object is perpendicular to the display module and is viewed along the positive x-axis to the negative x-axis.

[0043] In one possible implementation, determining the display direction of the content to be displayed based on the relative direction includes: obtaining a preset display matching strategy; matching the relative direction with the preset display matching strategy to obtain a matching result; and determining the display direction of the content to be displayed based on the matching result.

[0044] The display orientation of the content to be displayed is determined based on the relative orientation of the viewing object with respect to the electronic device. First, a preset display matching strategy is obtained. The relative orientation is then matched against the preset display matching strategy to obtain a matching result. The display orientation of the content to be displayed is then determined based on the matching result. This preset display matching strategy can be a preset angle range, with each angle range corresponding to a display orientation. By determining which angle range the relative orientation belongs to, the final display orientation of the content to be displayed is determined. For example, in a laptop computer, a coordinate system is constructed with the camera as the origin, the longer side as the x-axis, and the shorter side as the y-axis. This coordinate system is equivalent to establishing a first coordinate system with the center of the captured human image as the origin, the longer side of the human image as the x-axis, and the shorter side as the y-axis. The intersection of the first and second lines determining the orientation information of the viewing object is mapped to the origin of the first coordinate system, determining the angle range of the orientation information in the first coordinate system. This angle range is then matched against the preset display matching strategy to obtain a matching result. Finally, the display orientation of the content to be displayed is determined based on the matching result.

[0045] Figure 4a and Figure 4b A schematic diagram is shown illustrating how the display orientation of content to be displayed is determined based on relative orientation, as shown below. Figure 4a As shown, in the preset first coordinate system, the positive x-axis is defined as 0° (360°), the positive y-axis as 90°, the negative x-axis as 180°, and the negative y-axis as 270°. For example... Figure 4b As shown, when the relative direction is between 45° and 135° (the angle between the upper right threshold, the upward direction, and the upper left threshold), it indicates that the viewer is viewing from the positive y-axis towards the negative y-axis, and the content is set to be displayed from the positive y-axis towards the negative y-axis. When the relative direction is between 135° and 225° (the angle between the upper left threshold, the left direction, and the lower left threshold), it indicates that the viewer is viewing from the negative x-axis towards the positive x-axis, and the content is set to be displayed from the negative x-axis towards the positive x-axis. The diagram illustrates the following: When the relative direction is between 225° and 315° (the angle between the lower left threshold, the downward direction, and the lower right threshold), it indicates that the viewer is viewing from the negative y-axis towards the positive y-axis, and the content is displayed along this direction. When the relative direction is between 315° and 45° (the angle between the lower right threshold, the right direction, and the upper right threshold), it indicates that the viewer is viewing from the positive x-axis towards the negative x-axis, and the content is displayed along this direction. By matching the relative direction with these angle ranges, the angular space to which the relative direction belongs is determined, ultimately determining how the content to be displayed should be displayed.

[0046] Understandably, this application does not impose restrictions on specific angle spaces. In order to improve the user experience, more angle spaces can be divided and more refined display matching strategies can be set.

[0047] In one possible implementation, performing human body recognition on an environmental image to obtain a human body image includes: performing human body detection on the environmental image to determine whether the environmental image contains a human body; in response to the environmental image containing a human body, determining the environmental image as a target image; and performing human body recognition on the target image to obtain a human body image.

[0048] The content to be displayed in this application is intended for the viewer of the display module. Therefore, after acquiring an environmental image through the camera module, the acquired environmental image is first analyzed to determine if the viewer of the display module exists within it. Specifically, human detection is performed on the environmental image to determine if it contains a human body. If no human body is detected, it is determined that no one is viewing the display module, and the environmental image can be discarded. At this point, the display module can be controlled to display the content in any direction, or the display module can maintain its previous display direction. When a human body is detected in the environmental image, it is designated as the target image. Human recognition is then performed on the target image to obtain a human body image. This human body recognition can include outlining the human body in the target image or determining the position, facial features, and other characteristics of the human body in the target image.

[0049] Human recognition of a target image can also involve segmenting human information from background information, and then analyzing only the human information to reduce the amount of data processing. Understandably, after performing human recognition on the target image and obtaining the human image, it's possible to analyze whether the human is viewing the display module. The environmental image containing the human and showing that the human is viewing the display module is identified as the target image, while the environmental image containing the human but not showing that the human is not viewing the display module is discarded.

[0050] In one possible implementation, before acquiring the environmental image captured by the camera module, the method further includes: determining whether the camera module is in a working state; in response to the camera module being in a working state, controlling the camera module to acquire the environmental image in a first pixel mode; in response to the camera module being in a non-working state, controlling the camera module to acquire the environmental image in a second pixel mode; wherein the image pixels in the first pixel mode have better clarity and resolution than the image pixels in the second pixel mode.

[0051] Before acquiring environmental images, the operating status of the camera module is first determined to see if it is being used by other applications on the electronic device. If the camera module is active, it means it is being used by another application to capture images. In this case, the camera module is controlled to acquire environmental images in a first-pixel mode, which can be either full-pixel or high-pixel mode, to ensure that the images captured by the camera module have high clarity and resolution. If the camera module is not active, it means it is not being used by another application to capture images. In this case, the purpose of activating the camera module to capture images is to determine the relative position of the viewed object and the electronic device. Therefore, the camera module can be controlled to acquire environmental images in a second-pixel mode, which is a low-pixel mode. It is only necessary to capture an image that can detect a human body to proceed with subsequent processes; high resolution is not required. This reduces power consumption, decreases the amount of information processed in subsequent image processing, and improves the battery life of the electronic device.

[0052] In one possible implementation, controlling the camera module to acquire environmental images in a second pixel mode includes: controlling the camera module to acquire environmental images in an interlaced scanning and / or interlaced column scanning manner.

[0053] This application can control the camera module to acquire environmental images in an interlaced scanning manner, or in an interlaced scanning manner, or in a combination of interlaced and interlaced scanning, which can significantly reduce power consumption. Figure 5 The image shown is an environmental image captured by the camera module using interlaced scanning.

[0054] Figure 6 A schematic diagram of the module composition of a display device according to an embodiment of this application is shown.

[0055] like Figure 6 As shown, according to a second aspect of this application, a display device is provided, comprising: an acquisition module 601 for acquiring an environmental image captured by a camera module; an identification module 602 for performing human body recognition on the environmental image to obtain a human body image; a determination module 603 for determining, based on the human body image, the head features and body features of the viewing object of the display module; the determination module 603 is further configured to determine, based on the head features and body features, the orientation information of the viewing object of the display module, and determine the relative direction of the viewing object relative to the electronic device according to the orientation information; and a first control module 604 for determining the display direction of the content to be displayed based on the relative direction, and controlling the display module to display the content to be displayed to the viewing object in the display direction.

[0056] In one embodiment, the head features include at least the center image point of the viewer's head, and the body features include at least the shoulder image points of the viewer's two shoulders. The determining module 603 is specifically used to determine a first straight line based on the two shoulder image points; determine a second straight line perpendicular to the first straight line based on the center image point of the head; and determine the direction of the second straight line pointing to one side of the head as the viewer's orientation information.

[0057] In one embodiment, the determining module 603 includes: a mapping submodule 6031, used to map orientation information to a preset physical coordinate system; and a first determining submodule 6032, used to determine the relative orientation of the viewing object of the display module with respect to the electronic device based on the position information of the orientation information in the preset physical coordinate system and the position information of the display module in the preset physical coordinate system.

[0058] In one embodiment, the first control module 604 includes: an acquisition submodule 6041 for acquiring a preset display matching strategy; a matching submodule 6042 for matching the relative direction with the preset display matching strategy to obtain a matching result; and a second determination submodule 6043 for determining the display direction of the content to be displayed based on the matching result.

[0059] In one embodiment, the recognition module 602 is specifically used to perform human detection on the environmental image to determine whether the environmental image contains a human body; in response to the environmental image containing a human body, to determine the environmental image as a target image; and to perform human body recognition on the target image to obtain a human body image.

[0060] In one embodiment, the device further includes: a second control module 605, configured to determine whether the camera module is in a working state; in response to the camera module being in a working state, control the camera module to acquire an environmental image in a first pixel mode; in response to the camera module being in a non-working state, control the camera module to acquire an environmental image in a second pixel mode; wherein the image pixels in the first pixel mode have better clarity and resolution than the image pixels in the second pixel mode.

[0061] In one embodiment, the second control module 605 is further configured to control the camera module to acquire environmental images in an interlaced scanning and / or interlaced column scanning manner.

[0062] According to embodiments of this disclosure, this disclosure also provides an electronic device and a readable storage medium.

[0063] Figure 7A schematic block diagram of an example electronic device 700 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0064] like Figure 7 As shown, device 700 includes a computing unit 701, which can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) 702 or a computer program loaded into random access memory (RAM) 703 from storage unit 708. The RAM 703 may also store various programs and data required for the operation of device 700. The computing unit 701, ROM 702, and RAM 703 are interconnected via bus 704. Input / output (I / O) interface 705 is also connected to bus 704.

[0065] Multiple components in device 700 are connected to I / O interface 705, including: input unit 706, such as keyboard, mouse, etc.; output unit 707, such as various types of monitors, speakers, etc.; storage unit 708, such as disk, optical disk, etc.; and communication unit 709, such as network card, modem, wireless transceiver, etc. Communication unit 709 allows device 700 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0066] The computing unit 701 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 701 performs the various methods and processes described above, such as a display method. For example, in some embodiments, a display method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 708. In some embodiments, part or all of the computer program may be loaded and / or installed on device 700 via ROM 702 and / or communication unit 709. When the computer program is loaded into RAM 703 and executed by the computing unit 701, one or more steps of a display method described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to perform a display method by any other suitable means (e.g., by means of firmware).

[0067] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0068] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0069] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0070] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0071] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0072] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0073] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0074] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this disclosure, "a plurality of" means two or more, unless otherwise explicitly specified.

[0075] The above description is merely a specific embodiment of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this disclosure should be included within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.

Claims

1. A display method, characterized in that, Applied to electronic devices including camera modules and display modules, the method includes: Acquire environmental images captured by the camera module; Human body recognition is performed on the environmental image to obtain a human body image; Based on the human image, determine the head and body features of the viewing object of the display module; Based on the head and body features, the orientation information of the viewing object of the display module is determined, and the relative direction of the viewing object relative to the electronic device is determined according to the orientation information; The display direction of the content to be displayed is determined based on the relative direction, and the display module is controlled to display the content to be displayed to the viewing object in the display direction.

2. The method according to claim 1, characterized in that, The head features include at least the center image point of the viewer's head, and the body features include at least the shoulder image points of the viewer's two shoulders. The process of determining the orientation information of the viewing object of the display module based on the head and body features includes: Determine the first straight line based on the two shoulder image points; Based on the head center image point, a second straight line perpendicular to the first straight line is determined; The direction in which the second straight line points to the side of the head is determined as the orientation information of the viewing object.

3. The method according to claim 2, characterized in that, Determining the relative orientation of the viewing object with respect to the electronic device based on the orientation information includes: Map the orientation information to a preset physical coordinate system; Based on the orientation information and the position information of the display module in the preset physical coordinate system, the relative orientation of the viewing object of the display module with respect to the electronic device is determined.

4. The method according to claim 1, characterized in that, Determining the display orientation of the content to be displayed based on the relative orientation includes: Retrieve the preset display matching strategy; The relative direction is matched with the preset display matching strategy to obtain the matching result; The display orientation of the content to be displayed is determined based on the matching results.

5. The method according to claim 1, characterized in that, The step of performing human body recognition on the environmental image to obtain a human body image includes: Human detection is performed on the environmental image to determine whether the environmental image contains a human body; In response to the presence of a human body in the environmental image, the environmental image is determined to be the target image; Human body recognition is performed on the target image to obtain a human body image.

6. The method according to claim 1, characterized in that, Before acquiring the environmental images captured by the camera module, the method further includes: Determine if the camera module is in working order; In response to the camera module being in a working state, the camera module is controlled to acquire environmental images in a first pixel mode; In response to the camera module being in a non-working state, the camera module is controlled to acquire environmental images in a second pixel mode; The image pixels in the first pixel mode have better clarity and resolution than those in the second pixel mode.

7. The method according to claim 6, characterized in that, The control of the camera module to acquire environmental images in a second pixel mode includes: The camera module is controlled to acquire environmental images in an interlaced scanning and / or interleaved column scanning manner.

8. A display device, characterized in that, Applied to electronic devices including camera modules and display modules, the device includes: The acquisition module is used to acquire environmental images captured by the camera module; The recognition module is used to perform human body recognition on the environmental image to obtain a human body image; The determination module is used to determine the head and body features of the viewing object of the display module based on the human image; The determining module is further configured to determine the orientation information of the viewing object of the display module based on the head features and body features, and determine the relative direction of the viewing object relative to the electronic device based on the orientation information; The control module is used to determine the display direction of the content to be displayed based on the relative direction, and to control the display module to display the content to be displayed to the viewing object in the display direction.

9. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-7.

Images