Display control method, display device, processing method and processing system
By receiving rotation angle information of the display device and user input, adjusting the image direction collected by the camera, and adjusting the display mode according to user behavior, the problem of disordered image direction after rotation of the display device is solved, improving user experience and energy efficiency.
Patent Information
- Application Number
- CN202411152658.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-21
- Publication Date
- 2024-11-15
AI Technical Summary
When the display device rotates, the image direction collected by the camera cannot be automatically adjusted, resulting in disordered display direction and affecting the user experience.
By receiving the rotation angle information of the display device, the image captured by the camera is adjusted so that it remains displayed in a forward direction after rotation, and the display mode of the display device is dynamically adjusted according to the user's face orientation and gesture information to reduce power consumption.
Automatic adjustment of the image direction after the display device rotates, improves the user experience, and reduces power consumption by dynamically adjusting the display mode, and improves the energy efficiency of the device.
Smart Images

Figure CN118972523A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to but is not limited to the field of computer technology, and in particular to a display control method, a display device, a processing method and a processing system. Background Art
[0002] The display device is matched with the camera and is widely used in scenes such as conferences, games, and video calls. In various usage scenarios, the display device is arranged in a horizontal direction, so that the camera arranged on the display device can capture video images in the horizontal direction.
[0003] However, as users place display devices at different angles when using them, for example, rotating the display device 90 degrees clockwise or 90 degrees counterclockwise causes the image captured by the camera set on the display device to rotate accordingly, and thus the image captured by the camera cannot be displayed horizontally. Therefore, when the placement angle of the display device changes, how to adjust the display direction of the image captured by the camera set on the display device becomes an urgent problem to be solved. Summary of the invention
[0004] In view of this, the present application at least provides a display control method, a display device, a processing method and a processing system.
[0005] The technical solution of this application is implemented as follows:
[0006] In one aspect, the present application provides a display control method, the method comprising:
[0007] Receiving a first image captured by a target camera; the target camera is set on a target display device; the target display device is communicatively connected with the electronic device;
[0008] In response to receiving rotation angle information from a target display device, adjusting display information of the first image based on the rotation angle information to obtain a second image; the rotation angle information represents angle change information of the target display device rotating from a first position to a second position;
[0009] The second image is sent to at least one display device communicatively connected to the electronic device.
[0010] In some embodiments, the shooting direction of the target camera in the first position is forward, and the shooting direction of the target camera in the second position is non-forward;
[0011] Adjusting display information of the first image based on the rotation angle information to obtain a second image includes:
[0012] Based on the rotation angle information, the first image is adjusted from a non-positive direction to a positive direction to obtain a second image.
[0013] In some embodiments, the display control method further includes:
[0014] Get target trigger information;
[0015] Based on the target trigger information, a display mode of at least one display device connected to the electronic device is adjusted; wherein the power consumption of the at least one display device is different before and after the display mode is adjusted.
[0016] In some embodiments, the target trigger information includes at least one of the following: facial orientation information of the target user, gesture instruction information of the target user, voice instruction information of the target user, and input device instruction information input by the target user using an input device of the electronic device;
[0017] Adjusting the display mode of at least one display device connected to the electronic device based on the target trigger information includes at least one of the following:
[0018] adjusting a display mode of at least one display device connected to the electronic device based on the facial orientation information of the target user;
[0019] adjusting a display mode of at least one display device connected to the electronic device based on the gesture instruction information of the target user;
[0020] adjusting a display mode of at least one display device connected to the electronic device based on the voice command information of the target user;
[0021] Based on the input device instruction information of the target user, the display mode of at least one display device connected to the electronic device is adjusted.
[0022] In some embodiments, the at least one display device includes a first display device; the facial orientation information of the target user represents an angle between the facial orientation of the target user and the orientation of the first display device;
[0023] Adjusting the display mode of at least one display device connected to the electronic device based on the head orientation information of the target user includes one of the following:
[0024] When the angle is greater than the first angle threshold, and the time duration of maintaining the angle is greater than the time duration threshold, adjusting the first display device from the first display mode to the second display mode;
[0025] When the included angle is less than the second angle threshold, adjusting the first display device from the second display mode to the first display mode;
[0026] The power consumption of the display device corresponding to the first display mode is higher than the power consumption of the display device corresponding to the second display mode.
[0027] On the other hand, the present application also provides a processing method, which is applied to a target display device, comprising:
[0028] The first image captured by the target camera is sent to the electronic device; the target camera is set on the target display device;
[0029] In response to the rotation operation of the target display device, determining rotation angle information; the rotation angle information represents the angle change information of the target display device rotating from the first position to the second position;
[0030] The rotation angle information is sent to the electronic device; the rotation angle information is associated with the first image.
[0031] In some embodiments, the control method further includes:
[0032] receiving a second image from an electronic device;
[0033] Based on the rotation angle information, the display information of the second image is adjusted to obtain a third image; the third image is an image that can be displayed in a forward direction on the target display device;
[0034] The third image is displayed and outputted.
[0035] In some embodiments, the control method further includes:
[0036] receiving display mode adjustment information from the electronic device; the display mode adjustment information is determined by the electronic device based on the target trigger information;
[0037] In a case where the display mode adjustment information indicates adjusting the display mode of the target display device, adjusting the display mode of the target display device based on the display mode adjustment information;
[0038] In the case where the display mode adjustment information represents adjusting the display mode of the second display device, a display mode adjustment instruction is sent to the second display device based on the display mode adjustment information; wherein the second display device is a display device that is communicatively connected to the target display device.
[0039] On the other hand, the present application also provides a display device, comprising:
[0040] A display component capable of outputting images;
[0041] The target camera is used to capture the first image and send the first image to the electronic device through the communication interface;
[0042] The display processor is used to determine the rotation angle information in response to the rotation operation of the display device; the rotation angle information is sent to the electronic device through the communication interface; the rotation angle information represents the angle change information of the display device rotating from the first position to the second position;
[0043] The display processor is also used to receive fourth image information from the electronic device through the communication interface; adjust the display information of the fourth image based on the rotation angle information to obtain the fifth image; and display and output the fifth image through the display component.
[0044] On the other hand, the present application further provides a processing system, comprising: a host device, and a third display device and at least one fourth display device connected to the host device; a target camera is provided on the third display device; wherein,
[0045] A third display device is used to send the first image captured by the target camera to the host device; in response to the rotation operation of the third display device, determine the rotation angle information; and send the rotation angle information to the host device; wherein the rotation angle information represents the angle change information of the third display device rotating from the first position to the second position;
[0046] The host device is used to adjust the display information of the first image based on the rotation angle information to obtain the second image; and send the second image to at least one of the third display device and at least one fourth display device for display output.
[0047] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.
[0049] Figure 1 A schematic diagram of an implementation flow of a display control method provided in this application;
[0050] Figure 2 A schematic diagram of a system control panel of an electronic device in a display control method provided by the present application;
[0051] Figure 3A A schematic diagram of the arrangement of multiple display devices of an electronic device in the display control method provided by the present application;
[0052] Figure 3B A schematic diagram of a placement method of multiple display devices of an electronic device in a display control method provided by the present application;
[0053] Figure 4 A schematic diagram of an implementation flow of a processing method provided in this application;
[0054] Figure 5 A schematic diagram of a display device connection method according to the processing method provided by the present application;
[0055] Figure 6 A hardware entity schematic diagram of a display device provided in this application;
[0056] Figure 7 A structural block diagram of a processing system provided in this application. DETAILED DESCRIPTION
[0057] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions of the present application are further elaborated in detail below in conjunction with the drawings and embodiments. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.
[0058] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0059] The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first / second / third" can be interchanged with a specific order or sequence where permitted so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.
[0060] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing this application and are not intended to limit this application.
[0061] The present application provides a display control method, which can be executed by a processor of an electronic device. The electronic device may refer to a server, a laptop, a tablet computer, a desktop computer, a smart TV, a set-top box, a mobile device (such as a mobile phone, a portable video player, a personal digital assistant, a dedicated messaging device, a portable gaming device) and other devices with control capabilities.
[0062] Figure 1 A schematic diagram of an implementation flow of a display control method provided in this application, such as Figure 1 As shown, the method includes the following steps S101 to S103:
[0063] Step S101, receiving a first image captured by a target camera; the target camera is set on a target display device; the target display device is communicatively connected with an electronic device.
[0064] Here, the target display device refers to a device that is connected to the electronic device for communication and outputting the operating screen of the electronic device.
[0065] In some embodiments, when the electronic device is a host device, the target display device may be a display device connected to the host device via a communication line.
[0066] In some embodiments, when the electronic device is a laptop, a portable computer, a handheld computer, a PDA or a laptop, the target display device can be the display device of the laptop itself, or it can be an extended display device connected to the laptop via a communication line.
[0067] In some embodiments, when the electronic device is an All In One (AIO) computer, the target display device may be a display device integrated in the AIO, or may be an extended display device connected to the AIO via a communication line.
[0068] In some embodiments, the target display device is connected to the electronic device via a Universal Serial Bus (USB) interface.
[0069] In some embodiments, after the target display device is connected to the electronic device via the USB bus, data communication can be performed via the Display Data Channel Command Interface (DDC / CI) protocol.
[0070] In some embodiments, the target camera may be a color (Red / Green / Blue, RGB) camera, an infrared (Infrared Radiatio, IR) camera, a structured light camera, a time of flight (Time of Flight, TOF) camera, or other cameras commonly used in the art.
[0071] In some embodiments, the target camera is set on the target display device, which may mean that the target camera is integrated on the target display device; it may also mean that the target camera is connected to the target device through a communication line, and the captured image is transmitted to the electronic device through the communication line between the target device and the electronic device.
[0072] Here, the first image captured by the target camera refers to the image captured by the target camera when the target application in the electronic device calls the target camera. For example, a video conferencing application in the electronic device calls the image captured by the target camera; for another example, a social application in the electronic device calls the image captured by the target camera; and so on.
[0073] Step S102, in response to receiving rotation angle information from the target display device, adjusting display information of the first image based on the rotation angle information to obtain a second image; the rotation angle information represents angle change information of the target display device rotating from a first position to a second position.
[0074] Here, after the target display rotates from the first position to the second position, the target display may determine a corresponding rotation angle.
[0075] In some embodiments, the target display rotates from the first position to the second position, which may be a rotation action performed by the target display based on a control instruction input by the user through the electronic device, or may be a rotation generated based on a user manually rotating the target display.
[0076] In some embodiments, a gravity sensor (G-sensor) is provided in the target display device, so that a display processor (e.g., a screen scaling controller (Scaler)) in the target display device determines the rotation angle based on the gravity data collected by the G-sensor. For example, the target display device can determine the angle change such as rotating 90 degrees counterclockwise, rotating 90 degrees clockwise, or flipping 90 degrees or 180 degrees based on the gravity data collected by the G-sensor.
[0077] In this way, the display processor of the target display device can adjust the image transmitted by the electronic device to the target display device according to the determined rotation angle, so that the image viewed by the user on the target display device remains in the normal direction. For example, when the target display device is rotated 90 degrees clockwise, the display processor performs a counterclockwise rotation of 90 degrees on the image transmitted by the electronic device, so that the image viewed by the user is a normal image.
[0078] Here, after the target display device rotates, the direction of the first image captured by the target camera set on the target display device also rotates. For example, when the target display device rotates 90 degrees clockwise, the first image captured by the target camera rotates 90 degrees clockwise at the same time. However, since the image signal processor (ISP) of the target camera can only perform image mirroring, flipping, and simultaneous mirroring and flipping, it does not support clockwise and counterclockwise rotation of the image. In this way, after the target display device rotates, the first image sent by the target camera to the electronic device is a rotated image (for example, an image rotated 90 degrees clockwise). If the image is used directly to call the target application of the target camera, the first image displayed in the target application is an image rotated 90 degrees clockwise from the positive direction, which brings a bad user experience.
[0079] Therefore, the electronic device adjusts the display information of the first image in response to the rotation angle information received from the target display device to obtain the second image, so that the second image can be displayed in the forward direction.
[0080] In some embodiments, the rotation angle information may be the angle at which the target display device is physically rotated, for example, the angle information of a 90-degree clockwise rotation. Thus, the electronic device may perform a reverse angle rotation on the first image based on the rotation angle information, for example, a 90-degree counterclockwise rotation, so as to restore the first image to a forward display state.
[0081] In some embodiments, the rotation angle information may be a reverse rotation angle for the first image calculated by a display processor of the target display device based on the angle at which the target device is physically rotated. For example, when the target display device is rotated 90 degrees clockwise, the target display device determines the rotation angle information as a counterclockwise rotation of 90 degrees and sends it to the electronic device, so that the electronic device can directly perform a rotation operation on the first image according to the rotation angle information.
[0082] Step S103: sending the second image to at least one display device communicatively connected to the electronic device.
[0083] Here, the electronic device transmits the second image to at least one display device communicatively connected to the electronic device, so that the second image is displayed by using the at least one display device.
[0084] For example, when the target application that calls the target camera is a video conferencing application, the running interface corresponding to the video conferencing application can be sent to the target display device for display output; the running interface corresponding to the video conferencing application can also be sent to at least one display device other than the target display device that is communicatively connected to the electronic device for display output.
[0085] In the display control method provided by the present application, the electronic device receives a first image captured by a target camera set on the target display device from the target display device; in response to receiving rotation angle information from the target display device, the display information of the first image is adjusted based on the rotation angle information to obtain a second image; and the second image is sent to at least one display device that is communicatively connected to the electronic device. In this way, when the target display device provided with the target camera rotates, the display information of the first image captured by the target camera is adjusted according to the rotation angle information of the target display device to obtain the second image, so that the second image can be displayed in a direction that conforms to the user's viewing habits, thereby expanding the use scenario of the target display device provided with the camera and improving the user's use experience.
[0086] In some embodiments, the shooting direction of the target camera in the first position is forward, and the shooting direction of the target camera in the second position is non-forward.
[0087] Here, the shooting direction is forward, that is, in the first position, the display direction of each object or scene in the image shot by the target camera is the same as that in the real world.
[0088] The shooting direction is non-positive, that is, in the second position, the display direction of each object or scene in the image captured by the target camera is different from that in the real world. For example, when the second position is the position of the target display device after rotating 90 degrees clockwise relative to the first position, the display direction of each object or scene in the image captured by the target camera in the second position is rotated 90 degrees clockwise relative to the direction in the real world.
[0089] In this way, the display information of the first image is adjusted based on the rotation angle information to obtain the second image, that is, the above step S102 can be implemented as the following step S1021:
[0090] Step S1021: Based on the rotation angle information, adjust the first image from a non-positive direction to a positive direction to obtain the second image.
[0091] Here, when the rotation angle information represents the physical rotation angle of the target display device, the first image is adjusted from non-positive to positive, that is, for the first image, the same angle rotation is performed in the opposite direction according to the rotation direction and angle in the rotation angle information so that the second image is a positive image.
[0092] When the rotation angle information represents the angle obtained by the display processor in the target display device performing inverse processing on the physical rotation angle of the target display device, the first image is adjusted from a non-positive direction to a positive direction, that is, the first image is rotated according to the rotation direction and angle in the rotation angle information so that the second image is a positive image.
[0093] In some embodiments, the display control method provided by the present application further includes the following steps S104 to S105:
[0094] Step S104, obtaining target trigger information.
[0095] In some embodiments, the target trigger information may be a control instruction issued by a target user of the electronic device, for example, a display mode control instruction input by the target user through voice, gesture, or input / output device of the electronic device.
[0096] In some embodiments, the target trigger information may be trigger information determined according to the operation state of the target user of the electronic device. For example, the corresponding trigger information is determined according to whether the target user currently focuses on the display device.
[0097] Step S105: adjusting a display mode of at least one display device connected to the electronic device based on the target trigger information; wherein the power consumption of the at least one display device is different before and after the display mode is adjusted.
[0098] Here, adjusting the display mode of at least one display device refers to adjusting the power consumption state of at least one display device. For example, adjusting the brightness of the at least one display device; for a display device using a backlight, adjusting the backlight intensity of the at least one display device; for another example, adjusting the refresh rate of the at least one display device.
[0099] The display mode of at least one display device connected to the electronic device is adjusted based on the target trigger information. For example, when it is detected that the user leaves the acquisition range of the camera of the electronic device, the brightness of all display devices of the electronic device is lowered, or all display devices are controlled to enter the screen-off state. For example, when it is detected that the angle between the user's facial orientation and the orientation of at least one display device is large, the brightness of the at least one display device is lowered, or the at least one display device is controlled to enter the screen-off state.
[0100] In the above embodiment, by acquiring or detecting target trigger information and dynamically adjusting the display mode of at least one display device connected to the electronic device, the power consumption of the electronic device and at least one display device connected thereto for communication can be reduced, thereby achieving energy saving effect.
[0101] In some embodiments, the target trigger information includes at least one of the following: facial orientation information of the target user, gesture command information of the target user, voice command information of the target user, and input device command information input by the target user using an input device of the electronic device.
[0102] Here, the target user may be a current user of the electronic device or a registered user of the electronic device.
[0103] The facial orientation information of the target user may be determined based on an image containing the target user captured by a camera connected to the electronic device. For example, image recognition is performed on an image captured by a camera connected to the electronic device (e.g., a target camera) to determine the facial orientation information of the target user.
[0104] The gesture instruction information of the target user may be determined based on an image containing the target user captured by a camera connected to the electronic device. For example, image recognition is performed on an image captured by a camera connected to the electronic device (e.g., a target camera) to determine the gesture instruction information of the target user.
[0105] The target user's voice command information may be determined based on the target user's audio information collected by an audio collection device connected to the electronic device. For example, the target user's audio information is collected using a microphone or a microphone array connected to the electronic device, and the collected audio information is recognized using a speech recognition algorithm to determine the target user's voice command information.
[0106] The input device instruction information input by the target user using the input device of the electronic device may be the input device instruction information input by the target user using the mouse device, keyboard device and / or touch pad device of the electronic device.
[0107] In this way, adjusting the display mode of at least one display device connected to the electronic device based on the target trigger information, that is, the above step S105, can be implemented as at least one of the following steps S1051 to S1054:
[0108] Step S1051: adjusting a display mode of at least one display device connected to the electronic device based on the facial orientation information of the target user.
[0109] Here, based on the facial orientation information of the target user, the display device that the target user is currently paying attention to is determined, so that the display mode of the display device that the user is currently paying attention to is adjusted to a display mode corresponding to normal power consumption, or adjusted from a display mode with lower power consumption or a screen-off mode to a display mode with higher power consumption; at the same time, the display mode of the display device that is not within the user's attention range is adjusted to a display mode corresponding to low power consumption, or adjusted from a display mode with higher power consumption to a display mode with lower power consumption or a screen-off mode.
[0110] In this way, the current attention direction of the target user is determined according to the detected facial orientation information of the target user, and then the display mode of at least one display device connected to the electronic device is automatically adjusted.
[0111] Step S1052: adjusting a display mode of at least one display device connected to the electronic device based on the gesture instruction information of the target user.
[0112] In some embodiments, mapping relationships between multiple gestures and different display modes of a display device are pre-established to adjust the display mode of at least one display device based on the mapping relationship and user gestures.
[0113] For example, when a first gesture instruction of the target user is obtained (for example, a finger sliding from top to bottom), the display mode of at least one display device is adjusted from a display mode with higher power consumption to a display mode with lower power consumption or a screen-off mode; when a second gesture instruction of the target user is obtained (for example, a finger sliding from bottom to top), the display mode of at least one display device is adjusted from a display mode with lower power consumption or a screen-off mode to a display mode with higher power consumption.
[0114] In some embodiments, the gesture instruction information of the target user also includes the gesture position information of the target user. Thus, based on the gesture position information in the gesture instruction information of the target user, at least one display device corresponding to the gesture instruction can be determined, and then the display mode adjustment operation is performed for the at least one display device.
[0115] In this way, the target user's display mode adjustment instruction for the display device of the electronic device is determined according to the detected gesture instruction information of the target user, and then the display mode of at least one display device is adjusted.
[0116] Step S1053: adjusting a display mode of at least one display device connected to the electronic device based on the voice command information of the target user.
[0117] Here, the target user may input a display mode adjustment instruction for at least one display device to the electronic device in the form of voice.
[0118] For example, the target user may instruct the display device corresponding to the display mode adjustment operation and the display mode to be adjusted through voice.
[0119] Step S1054: adjusting the display mode of at least one display device connected to the electronic device based on the input device instruction information of the target user.
[0120] Here, the target user may input a display mode adjustment instruction for at least one display device of the electronic device through a mouse device, a keyboard device and / or a touch pad device of the electronic device.
[0121] For example, the target user adjusts the display mode of at least one display device of the electronic device through the control panel of the electronic device.
[0122] In the above embodiment, the display mode adjustment for at least one display device of the electronic device is determined by at least one of the target user's facial orientation information, gesture command information, voice command information and input device command information, and the power consumption of at least one display device of the electronic device can be adjusted automatically or according to user instructions, thereby achieving energy saving effect.
[0123] In some embodiments, the at least one display device includes a first display device; and the facial orientation information of the target user represents an angle between the facial orientation of the target user and an orientation of the first display device.
[0124] Here, the target user's facial orientation refers to the direction in which the target user's face is facing.
[0125] The angle between the target user's facial orientation and the orientation of the first display device refers to the angle between the direction in which the target user's face is facing and a straight line perpendicular to the display plane of the first display device.
[0126] In this way, adjusting the display mode of at least one display device connected to the electronic device based on the head orientation information of the target user, that is, the above step S1051, can be implemented as one of the following steps S1055 to S1056:
[0127] Step S1055, when the angle is greater than a first angle threshold, and the time duration for which the angle is maintained is greater than a time duration threshold, adjusting the first display device from the first display mode to the second display mode;
[0128] Step S1056: When the included angle is less than a second angle threshold, the first display device is adjusted from the second display mode to the first display mode.
[0129] Here, it is assumed that when the target user's face is facing the first display device, the angle between the target user's face orientation and the orientation of the first display device is less than the third angle threshold. In some embodiments, the third angle threshold may be between 10 degrees and 30 degrees.
[0130] In this way, when the angle is greater than the first angle threshold and the time duration for which the angle is maintained is greater than the time duration threshold, it indicates that the target user's attention has shifted away from the first display device, and the first display device can be adjusted from the first display mode to the second display mode, wherein the power consumption of the display device corresponding to the first display mode is higher than the power consumption of the display device corresponding to the second display mode.
[0131] When the included angle is less than the second angle threshold, it indicates that the target user's attention is directed to the first display device, or the target user's attention is focused on the display device adjacent to the first display device, and the first display device can be adjusted from the second display mode to the first display mode. In this way, the target user can view the display screen of the first display device, or the target user can view the display screen of the first display device with peripheral vision when viewing the display screen of the display device adjacent to the first display device.
[0132] In some embodiments, a display device connected to an electronic device includes a main device and at least one extended display device.
[0133] Here, the main display device may be a display device directly facing the seat of the target user, a display device provided with a camera, or a display device determined by the target user through a control panel of an electronic device.
[0134] Thus, the display control method provided by the present application further includes the following step S106:
[0135] Step S106: determining the relative position information between the main display device and each extended display device.
[0136] Here, the relative position of the main display device and each extended display device refers to the physical position relationship between the main display device and each extended display device, for example, determining whether the extended display device is set on the left or right side of the main display device.
[0137] In some embodiments, the system location information of the main display device and each extended display device can be determined based on the identification information of the main display device and each extended display device; and the physical relative position of the main display device and each extended display device can be determined based on the determined system location information.
[0138] like Figure 2 As shown, in the system control panel 200 of the electronic device, the system position of the main display device 210 relative to the extended display device 220 is determined based on the identification information of the main display device 210 and the extended display device 220, that is, the extended display device 220 is located on the left side of the main display device 210. In this way, according to the user's operating habits, the physical placement positions of the main display device 210 and the extended display device 220 are the same as the system positions, so the physical position relationship between the main display device 210 and the extended display device 220 is determined as the extended display device 220 is located on the left side of the main display device 210.
[0139] In some embodiments, when the main display device and each extended display device are display devices equipped with cameras, the vendor identification code (Vender ID, VID) and / or product identification code (Product ID, PID) of the cameras corresponding to the main display device and each extended display device are obtained through a video display metafile (VDM), and then the physical position relationship between the main display device and each extended display device is determined based on the VID and / or PID.
[0140] In this way, the method for determining the angle between the facial orientation of the target user and the orientation of at least one display device of the electronic device can be implemented as follows: after determining the physical relative positions between multiple display devices connected to the electronic device, when the target user's face is facing the main device, obtaining the first facial feature information of the target user; while the target user is using the electronic device, obtaining the second facial feature information of the target user in real time; determining the facial rotation angle information of the target user based on the first facial feature information and the second facial feature information, that is, the facial orientation change information of the target user; based on the physical relative position relationship between each display device, and the facial orientation change information of the target user, the angle between the facial orientation of the target user and the orientation of each display device can be determined.
[0141] For example, when the target user's face is facing the main display device, the first facial feature information of the target user is obtained by using the camera set on the main display device, and the first facial feature information is the frontal feature of the target user; when the target user's face is turned to the left and facing the extended display device, the second facial feature information of the user is obtained, and the second facial feature information is the right side face feature of the target user; in this way, based on the frontal face feature and the right side face feature of the user, the angle at which the target user turns his face to the left can be determined, for example, 60 degrees; based on the physical position of the extended display device relative to the main display device, the angle between the facial orientation of the target user and the orientation of the extended display device can be determined.
[0142] In some embodiments, the electronic device pre-stores the correspondence between the target user's facial orientation and the display mode adjustment method. Figure 3A and Figure 3B An embodiment of the correspondence between the user's facial orientation and the display mode adjustment method is described.
[0143] like Figure 3A As shown, display device 301, display device 302 and display device 303 are horizontally placed in sequence and are respectively connected to a host (not shown in the figure) for communication to display the operation interface output by the host.
[0144] When the display device 301 is used as the main display device corresponding to the user's seat and a camera is set on the display device 301, the display device 302 or the display device 303, the following display mode adjustment scheme is preset in the electronic device: when it is detected that the face of the target user is facing the left side of the display device 301, and the angle with the direction of the display device 301 is greater than the first angle threshold, and the duration of the angle is greater than the first duration threshold, the brightness of the display device 301, the display device 302 and the display device 303 are reduced; when it is detected that the face of the target user is facing the display device 301, the brightness of the display device 301 and the display device 302 are adjusted to normal brightness, and the brightness of the display device 303 is reduced; when it is detected that the face of the target user is facing the display device 301, When it is detected that the angle between the target user's facial orientation and the orientation of the display device 302 is less than the second angle threshold, the display device 301, the display device 302 and the display device 303 are all adjusted to normal brightness; when it is detected that the angle between the target user's facial orientation and the orientation of the display device 303 is less than the second angle threshold, the display device 302 and the display device 303 are all adjusted to normal brightness, and the brightness of the display device 301 is reduced; when it is detected that the target user's face is turned to the right, and the angle between it and the display device 303 is greater than the first angle threshold, and the angle is maintained for a duration greater than the first duration threshold, the brightness of the display device 301, the display device 302 and the display device 303 is reduced.
[0145] When display device 302 is used as the main display device corresponding to the user's seat and a camera is set on display device 301, display device 302 or display device 303, the following display mode adjustment scheme is preset in the electronic device: when it is detected that the target user's face is facing the left side of display device 301, and the angle with the direction of display device 301 is greater than the first angle threshold, and the duration of the angle is greater than the first duration threshold, the brightness of display device 301, display device 302 and display device 303 is reduced; when it is detected that the target user's face is turned to the right, and the angle with display device 301 is less than the second angle threshold, the brightness of display device 301 and display device 302 is adjusted to normal brightness, And reduce the brightness of display device 303; when it is detected that the target user's face is facing display device 302, display device 301, display device 302 and display device 303 are all adjusted to normal brightness; when it is detected that the target user's face is turned to the right, and the angle between the face and the display device 303 is less than the second angle threshold, display device 302 and display device 303 are all adjusted to normal brightness, and the brightness of display device 301 is reduced; when it is detected that the target user's face is turned to the right, and the angle between the face and the display device 303 is greater than the first angle threshold, and the angle is maintained for a duration greater than the first duration threshold, the brightness of display device 301, display device 302 and display device 303 is reduced.
[0146] When the display device 302 is used as the main display device corresponding to the user and a camera is set on the display device 301, the display device 302 or the display device 303, the following display mode adjustment scheme is preset in the electronic device: when it is detected that the face of the target user is facing the left side of the display device 301, and the angle between the face and the display device 301 is greater than the first angle threshold, and the duration of the angle is greater than the first duration threshold, the brightness of the display devices 301, 302 and 303 is reduced; when it is detected that the angle between the face of the target user and the display device 301 is less than the second angle threshold, the brightness of the display devices 301, 302 and 303 is adjusted to normal brightness; when it is detected that the face of the target user is turned to the right, and the angle between the face and the display device 303 is greater than the first angle threshold, and the duration of the angle is greater than the first duration threshold, the brightness of the display devices 301, 302 and 303 is reduced.
[0147] In the above Figure 3AIn the scenario shown, when it is detected that the target user's face is turned upward or downward, and the angle between the face and display device 301, display device 302 and display device 303 is greater than the first angle threshold, and the duration of the angle is greater than the first duration threshold, the brightness of display device 301, display device 302 and display device 303 is reduced.
[0148] like Figure 3B As shown, display device 304 and display device 305 are placed up and down, display device 305 and display device 306 are placed horizontally, and display device 304, display device 305 and display device 306 are respectively communicated with a host (not shown in the figure) to display the operating interface of the output host.
[0149] Here, the display device 304 is used as the main display device corresponding to the user's seat, and a camera is set on the display device 304, the display device 305 or the display device 306. The following display mode adjustment scheme is preset in the electronic device: when it is detected that the face of the target user is turned to the left, right or bottom of the display device 304, and the angle with the display device 304 is greater than the first angle threshold, and the angle is maintained for a time longer than the first time threshold, the brightness of the display device 304, the display device 305 and the display device 306 is reduced; when it is detected that the angle between the face of the target user and the display device 304, the display device 305 or the display device 306 is less than the second angle threshold, the display device 304, the display device 305 and the display device 305 are adjusted to normal brightness.
[0150] As can be seen from the above, the display control method provided by the present application adjusts the display direction of the first image captured by the target camera set on the target display by obtaining the rotation angle information of the target display, so that the adjusted second image can be displayed in the forward direction, so that after the user rotates the target display device to any angle, the forward image of the image captured by the target camera can still be obtained; at the same time, the display control method provided by the present application also determines the facial orientation information of the target user based on the image captured by the target camera, and adjusts the display mode of at least one display device connected to the electronic device based on the facial orientation information of the target user, so as to reduce the power consumption of the part of the display device when the face of the target user is not facing the part of the display device, thereby achieving energy saving effect.
[0151] On the other hand, the present application also provides a processing method applied to a target display device, which can be executed by a processor of the target display device.
[0152] In some embodiments, the display processor of the target display device may be implemented as a Scaler.
[0153] Figure 4A schematic diagram of an implementation flow of a processing method applied to a target display device provided in this application is shown in FIG. Figure 4 As shown, the method includes the following steps S401 to S403:
[0154] Step S401, sending a first image captured by a target camera to an electronic device; the target camera is set on the target display device.
[0155] Here, the target camera may be a camera integrated in the target display device, or may be a camera connected to the target display device via a communication line.
[0156] The target display device is one of at least one display device connected to the electronic device.
[0157] The electronic device may include a host device, a laptop device, an AIO, or any other computer device.
[0158] Step S402: determining rotation angle information in response to a rotation operation of the target display device; the rotation angle information represents angle change information of the target display device rotating from a first position to a second position.
[0159] Here, in the case where the rotation operation is an operation performed based on a rotation instruction issued by the target user through the electronic device, the display processor of the target display device may determine the rotation angle information based on the rotation instruction issued by the electronic device.
[0160] In the case where the rotation operation is an operation in which the target user manually rotates the target display device, the display processor of the target display device may determine the rotation angle information based on a G-sensor installed in the target display device.
[0161] Step S403: sending the rotation angle information to the electronic device; the rotation angle information is associated with the first image.
[0162] Here, the display processor of the target display device sends the rotation angle information to the electronic device, so that the electronic device adjusts the display information of the first image based on the rotation angle information, so that the adjusted second image is an image displayed in the forward direction.
[0163] In some embodiments, the target display device is connected to the electronic device via a USB interface, so that the display processor sends the rotation angle information to the electronic device via a USB hub (HUB) in the target display device.
[0164] In the above embodiment, when the target display device rotates, the display processor in the target display device sends the rotation angle information to the electronic device, so that the electronic device can adjust the first image captured by the target camera based on the rotation angle information without affecting the user experience, thereby expanding the use scenario of the target display device equipped with a camera.
[0165] In some embodiments, the processing method provided by the present application further includes the following steps S404 to S406:
[0166] Step S404: receiving the second image from the electronic device.
[0167] Here, the second image may be an image obtained by the electronic device adjusting the first image captured by a camera set on the target display device; the second image may also be an image obtained by the electronic device adjusting the first image captured by a camera set on other display devices connected to the electronic device.
[0168] In some embodiments, the second image is an image displayed in a forward direction.
[0169] Step S405: Based on the rotation angle information, the display information of the second image is adjusted to obtain a third image; the third image is an image that can be displayed in a forward direction on the target display device.
[0170] Here, the display processor of the target display device adjusts the display direction of the second image according to its own rotation angle information to obtain the third image, so as to display the third image in the forward direction on the target display device.
[0171] Step S406: display and output the third image.
[0172] In the above embodiment, after the target display device obtains the second image from the electronic device, it adjusts the display direction of the second image according to the rotation angle information of the target display device to obtain the third image, so that the third image is displayed forward on the target display device.
[0173] In some embodiments, the processing method provided by the present application further includes the following steps S407 to S409:
[0174] Step S407, receiving display mode adjustment information from the electronic device; the display mode adjustment information is determined by the electronic device based on the target trigger information.
[0175] Here, the target trigger information refers to information that triggers the electronic device to adjust the display mode of at least one display device connected to the electronic device.
[0176] The target trigger information includes at least one of the following: facial orientation information of the target user, gesture instruction information of the target user, voice instruction information of the target user, and input device instruction information input by the target user using an input device of the electronic device.
[0177] In some embodiments, the display mode adjustment information includes identification information of a display device whose display mode is to be adjusted and a target display mode to be adjusted.
[0178] Step S408 : When the display mode adjustment information indicates adjusting the display mode of the target display device, the display mode of the target display device is adjusted based on the display mode adjustment information.
[0179] Here, in the case where the display devices whose display modes are to be adjusted in the display mode adjustment information include the target display device, the display processor of the target display device switches its own display mode to the target display mode to be adjusted.
[0180] Step S409, when the display mode adjustment information represents adjusting the display mode of the second display device, based on the display mode adjustment information, sending a display mode adjustment instruction to the second display device; wherein the second display device is a display device that is communicatively connected to the target display device.
[0181] Here, the target display and the second display are used in series, and the target display device is a main display device, which can send control instructions related to the display mode to the second display device.
[0182] In some embodiments, a display port (DP) is provided on the target display device, and the second display can communicate with the target display device by connecting to the DP port. Figure 5 As shown, the display device 510 is a target display device provided with a camera, and the display device 520 is a second display device connected to the DP interface of the display device 510 via a data line.
[0183] In this way, when the display device whose display mode is to be adjusted indicated by the display mode adjustment information is the second display device, the target display device may send a display mode adjustment instruction to the second display device based on the target display mode to be adjusted corresponding to the second display device.
[0184] In the above embodiment, the target display device can receive display mode adjustment information from the electronic device and adjust its own display mode based on the display mode adjustment information, or send a display mode adjustment instruction to the second display device to adjust the display mode of the second display device, thereby achieving energy saving effect.
[0185] It should be noted that the description of the above processing method embodiment corresponds to the description of the above display control method embodiment and has similar beneficial effects. In some embodiments, for technical details not disclosed in the processing method embodiment of this application, please refer to the description of the display control method embodiment of this application for understanding.
[0186] Based on the above embodiments, the present application provides a display device, Figure 6 A hardware entity schematic diagram of a display device provided in this application.
[0187] like Figure 6 As shown, the hardware entity of the display device 600 includes a display component 610, a target camera 620 and a display processor 630; wherein,
[0188] Display component 610, capable of outputting images;
[0189] The target camera 620 is used to capture a first image and send the first image to the electronic device through the communication interface;
[0190] The display processor 630 is used to determine rotation angle information in response to the rotation operation of the display device; send the rotation angle information to the electronic device through the communication interface; the rotation angle information represents the angle change information of the display device rotating from the first position to the second position;
[0191] The display processor 630 is further configured to receive fourth image information from the electronic device via the communication interface; adjust the display information of the fourth image based on the rotation angle information to obtain a fifth image; and display and output the fifth image via the display component.
[0192] In some embodiments, the display device 600 further includes a DP interface.
[0193] In some embodiments, the display device 600 further includes a hub 640. The display processor 630 is communicatively connected to the hub 640 to communicate with the electronic device through the hub 640. The target camera 620 is communicatively connected to the hub 640 to send the collected image information to the electronic device through the hub 640.
[0194] It should be noted that the description of the above display device embodiment corresponds to the description of the above display control method and processing method embodiment, and has similar beneficial effects. In some embodiments, for technical details not disclosed in the display device embodiment of the present application, please refer to the description of the display control method and processing method embodiment of the present application for understanding.
[0195] Based on the above method, the present application also provides a processing system. Figure 7A structural block diagram of a processing system provided in this application.
[0196] like Figure 7 As shown, the processing system 700 includes a host device 710, a third display device 720 and a fourth display device 730; wherein,
[0197] The host device 710 is in communication connection with the third display device 720 and the fourth display device 730; the third display device 720 is provided with a target camera 721; wherein,
[0198] The third display device 720 is used to send the first image captured by the target camera 721 to the host device 710; in response to the rotation operation of the third display device 720, determine the rotation angle information; send the rotation angle information to the host device 710; wherein the rotation angle information represents the angle change information of the third display device 720 rotating from the first position to the second position;
[0199] The host device 710 is used to adjust the display information of the first image based on the rotation angle information to obtain a second image; and send the second image to at least one of the third display device 720 and the at least one fourth display device 730 for display output.
[0200] In some embodiments, the fourth display device 730 is communicatively connected to the third display device 720 via a DP interface.
[0201] It should be noted that the description of the above processing system embodiment corresponds to the description of the above display control method and processing method embodiment, and has similar beneficial effects. In some embodiments, for technical details not disclosed in the processing system embodiment of the present application, please refer to the description of the display control method and processing method embodiment of the present application for understanding.
[0202] It should be noted that in the embodiment of the present application, if the above-mentioned display control method and / or processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software, and firmware.
[0203] An embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.
[0204] The embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, some or all of the steps in the above method are implemented. The computer-readable storage medium can be transient or non-transient.
[0205] An embodiment of the present application provides a computer program, including a computer-readable code. When the computer-readable code is run in a computer device, a processor in the computer device executes some or all of the steps for implementing the above method.
[0206] The embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, some or all of the steps in the above method are implemented. The computer program product can be implemented specifically by hardware, software or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium, and in other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK) and the like.
[0207] It should be noted here that the description of the various embodiments above tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. The description of the above device, storage medium, computer program and computer program product embodiments is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the embodiments of the device, storage medium, computer program and computer program product of this application, please refer to the description of the method embodiment of this application for understanding.
[0208] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the serial number of each step / process mentioned above does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The serial numbers of the embodiments of the present application mentioned above are for description only and do not represent the advantages and disadvantages of the embodiments.
[0209] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.
[0210] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.
[0211] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0212] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.
[0213] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.
[0214] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.
[0215] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.
Claims
1. A display control method, include: Receiving a first image captured by a target camera; The target camera is arranged on the target display device; The target display device is communicatively connected with the electronic device; In response to receiving rotation angle information from the target display device, adjusting display information of the first image based on the rotation angle information to obtain a second image; the rotation angle information represents angle change information of the target display device rotating from a first position to a second position; The second image is transmitted to at least one display device communicatively connected to the electronic device.
2. According to the method of claim 1, the shooting direction of the target camera in the first position is positive, and the shooting direction of the target camera in the second position is non-positive; adjusting the display information of the first image based on the rotation angle information to obtain a second image, include: Based on the rotation angle information, the first image is adjusted from a non-positive direction to a positive direction to obtain the second image.
3. The method according to claim 1 or 2, further comprising: include: Get target trigger information; Based on the target trigger information, a display mode of at least one display device connected to the electronic device is adjusted; wherein the power consumption of the at least one display device is different before and after the display mode is adjusted.
4. The method according to claim 3, wherein the target trigger information comprises at least one of the following: facial orientation information of the target user, gesture instruction information of the target user, voice instruction information of the target user, and input device instruction information input by the target user using an input device of the electronic device; The adjusting, based on the target trigger information, a display mode of at least one display device connected to the electronic device, comprises at least one of the following: adjusting a display mode of at least one display device connected to the electronic device based on the facial orientation information of the target user; adjusting a display mode of at least one display device connected to the electronic device based on the gesture instruction information of the target user; adjusting a display mode of at least one display device connected to the electronic device based on the voice command information of the target user; Based on the input device instruction information of the target user, a display mode of at least one display device connected to the electronic device is adjusted.
5. The method according to claim 4, wherein the at least one display device comprises a first display device; the facial orientation information of the target user represents an angle between the facial orientation of the target user and the orientation of the first display device; The adjusting the display mode of at least one display device connected to the electronic device based on the head orientation information of the target user includes one of the following: When the angle is greater than a first angle threshold, and the time duration for which the angle is maintained is greater than a time duration threshold, adjusting the first display device from the first display mode to the second display mode; When the included angle is less than a second angle threshold, adjusting the first display device from the second display mode to the first display mode; in, The power consumption of the display device corresponding to the first display mode is higher than the power consumption of the display device corresponding to the second display mode.
6. A processing method, applied to a target display device, include: Sending a first image captured by the target camera to an electronic device; The target camera is arranged on the target display device; In response to the rotation operation of the target display device, determining rotation angle information; the rotation angle information represents the angle change information of the target display device rotating from the first position to the second position; The rotation angle information is sent to the electronic device; the rotation angle information is associated with the first image.
7. The method according to claim 6, further comprising: include: receiving the second image from the electronic device; Based on the rotation angle information, adjusting display information of the second image to obtain a third image; The third image is an image that can be displayed in the forward direction on the target display device; The third image is displayed and outputted.
8. The method according to claim 6, further comprising: include: receiving display mode adjustment information from the electronic device; The display mode adjustment information is determined by the electronic device based on the target trigger information; In a case where the display mode adjustment information represents adjusting the display mode of the target display device, adjusting the display mode of the target display device based on the display mode adjustment information; In the case where the display mode adjustment information represents adjusting the display mode of the second display device, a display mode adjustment instruction is sent to the second display device based on the display mode adjustment information; wherein the second display device is a display device that is communicatively connected to the target display device.
9. A display device, include: A display component capable of outputting images; A target camera, used for acquiring a first image and sending the first image to an electronic device through the communication interface; A display processor is used to determine rotation angle information in response to the rotation operation of the display device; and send the rotation angle information to the electronic device through the communication interface; the rotation angle information represents the angle change information of the display device rotating from the first position to the second position; The display processor is further used to receive fourth image information from the electronic device through the communication interface; adjust the display information of the fourth image based on the rotation angle information to obtain a fifth image; and display and output the fifth image through the display component.
10. A processing system, include: A host device, and a third display device and at least one fourth display device connected to the host device; The third display device is provided with a target camera; wherein, The third display device is used to send the first image captured by the target camera to the host device; in response to the rotation operation of the third display device, determine the rotation angle information; send the rotation angle information to the host device; wherein the rotation angle information represents the angle change information of the third display device rotating from the first position to the second position; The host device is used to adjust the display information of the first image based on the rotation angle information to obtain a second image; and send the second image to at least one of the third display device and the at least one fourth display device for display output.
