Display equipment control method and device, display system, electronic equipment and medium

Abstract

The embodiment of the invention provides a control method and device of display equipment, a display system, electronic equipment and a medium. The control method of the display device comprises the steps that a target image including a marker is obtained, and the state of the marker can be adjusted to present different recognition patterns; according to the target image, determining the state of the marker corresponding to the identification pattern presented by the marker; and controlling the display device based on the state of the marker.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of display technologies, and in particular, to a control method, apparatus, display system, electronic device, and medium for a display device. Background Art

[0002] Nowadays, people often use display devices for work or entertainment. Therefore, it is necessary to effectively control display devices. Currently, display devices can generally be controlled by means such as remote control, touch, buttons, handles, gestures, and so on. However, in order to further improve the user experience of using display devices, it is still necessary to design new control schemes to control display devices. Summary of the Invention

[0003] In view of this, embodiments of the present disclosure provide a control method, apparatus, display system, electronic device, and medium for a display device to at least partially solve the above problems.

[0004] According to a first aspect of embodiments of the present disclosure, a control method for a display device is provided, including:

[0005] Obtaining a target image including a marker, wherein the state of the marker can be adjusted to present different recognition patterns;

[0006] Determining, according to the target image, the state of the marker corresponding to the recognition pattern presented by the marker;

[0007] Controlling the display device based on the state of the marker.

[0008] According to a second aspect of embodiments of the present disclosure, a control apparatus for a display device is provided, including:

[0009] An obtaining module, configured to obtain a target image including a marker, wherein the state of the marker can be adjusted to present different recognition patterns;

[0010] A determining module, configured to determine, according to the target image, the state of the marker corresponding to the recognition pattern presented by the marker;

[0011] A control module, configured to control the display device based on the state of the marker.

[0012] According to a third aspect of embodiments of the present disclosure, a display system is provided, including:

[0013] A display device;

[0014] A marker, the state of the marker can be adjusted to present different recognition patterns;

[0015] A control unit is configured to obtain a target image including a marker, determine a state of the marker corresponding to an identification pattern presented by the marker according to the target image, and control a display device based on the state of the marker.

[0016] According to a fourth aspect of the embodiments of the present disclosure, an electronic device is provided, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; the memory is configured to store a computer program; and the processor is configured to execute the method according to any one of the first aspect by running the computer program stored on the memory.

[0017] According to a fifth aspect of the embodiments of the present disclosure, a computer storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the method according to any one of the first aspect is implemented. Description of the Drawings

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments recorded in the embodiments of the present disclosure, and those of ordinary skill in the art can also obtain other drawings based on these drawings.

[0019] Figure 1 It is a flowchart of a control method for an exemplary display device in the embodiments of the present disclosure.

[0020] Figure 2A It is a schematic diagram of the display content of a usage state of an example of the display device in the embodiments of the present disclosure.

[0021] Figure 2B It is a schematic diagram of the display content of a usage state of another example of the display device in the embodiments of the present disclosure.

[0022] Figure 2C It is a schematic diagram of the display content of a usage state of still another example of the display device in the embodiments of the present disclosure.

[0023] Figure 2D It is a schematic diagram of the display content of a usage state of yet another example of the display device in the embodiments of the present disclosure.

[0024] Figure 2E It is a schematic diagram of a marker of an example in the embodiments of the present disclosure.

[0025] Figure 2F It is a schematic diagram of a marker of another example in the embodiments of the present disclosure.

[0026] Figure 2GSchematic diagram of a marker that is another example in the embodiments of the present disclosure.

[0027] Figure 3 Schematic diagram of a control device for an exemplary display device in the embodiments of the present disclosure.

[0028] Figure 4 Schematic diagram of an exemplary display system in the embodiments of the present disclosure.

[0029] Figure 5 Schematic diagram of an exemplary electronic device in the embodiments of the present disclosure. Detailed implementation manners

[0030] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the embodiments of the present disclosure, all other embodiments obtained by those of ordinary skill in the art shall fall within the protection scope of the embodiments of the present disclosure. It should be understood that the steps recorded in the method embodiments of the present disclosure can be executed in different orders and / or executed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard.

[0031] The following further illustrates the specific implementation of the embodiments of the present disclosure with reference to the accompanying drawings in the embodiments of the present disclosure.

[0032] Figure 1 Flowchart of a control method for an exemplary display device in the embodiments of the present disclosure. Refer to Figure 1 As shown, a first aspect of the embodiments of the present disclosure provides a control method for a display device, which includes steps S102, S104, and S106. Specifically:

[0033] S102: Obtain a target image including a marker, where the state of the marker can be adjusted to present different recognition patterns.

[0034] The display device in the embodiments of the present disclosure can be any type of display device, which may include at least one display screen to enable a user to view display content through the display screen. For example, the display device may include, but is not limited to, portable terminal devices such as mobile phones, computers, televisions, head-mounted display devices (including, but not limited to, AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, etc.).

[0035] In the embodiments of the present disclosure, the control method of the display device may be executed by a control unit, and the control unit may include at least one chip capable of data processing (including but not limited to CPU (Central Processing Unit), MCU (Microcontroller Unit), GPU (Graphic Processing Unit), FPGA (Field Programmable Gate Array), etc.). The control unit may be disposed on the display device or on other electronic devices (including but not limited to mobile phones, computers, etc.) electrically connected to the display device.

[0036] In the embodiments of the present disclosure, the target image may be a captured image obtained by a camera capturing a marker. The camera may be disposed at any suitable position. For example, the camera may be disposed on the display device or outside the display device.

[0037] In the embodiments of the present disclosure, the marker may be configured into any structure as long as it can meet the needs of state adjustment. For example, in some alternative embodiments, when obtaining the target image including the marker, the marker may be disposed on a bearing surface (such as, but not limited to, a desktop, a floor, etc.), and then the marker may be adjusted to the required state so that the recognition pattern presented is the required style. After that, the marker may be captured by the camera to obtain the target image for acquisition in step S102. In the embodiments of the present disclosure, the style of the recognition pattern is not limited. For example, it may be a checkerboard pattern, an ArUco pattern, a dot matrix pattern, a star marker pattern, a polygon pattern, etc.

[0038] Optionally, the camera may be a color camera capable of capturing color images. Alternatively, the camera may also be a grayscale camera capable of capturing grayscale images. Its type may be any type of camera. For example, in some embodiments, it may be a SLAM (Simultaneous Localization and Mapping) camera.

[0039] In some alternative embodiments, with reference to Figure 2E 、 Figure 2F 、 Figure 2GAs shown, the marker 304 includes: a first body 3041 and a second body 3042, the second body 3042 is arranged on the first body 3041, and at least one of the position and posture of the second body 3042 relative to the first body 3041 can be changed; wherein, the first body 3041 and the second body 3042 are both provided with patterns, and the patterns set on the first body 3041 and the second body 3042 can be combined into different identification patterns.

[0040] Based on this, in the embodiment of the present disclosure, through the structure of such a marker, different recognition patterns can be flexibly combined by flexibly adjusting at least one of the position and posture of the second body on the first body, so that the marker can form different states, realizing multiple uses of one marker, and thus effectively realizing the control interaction between the user and the display device by adjusting the state of the marker, thereby helping to improve the user's experience of using the display device, and effectively reducing the cost of the marker and effectively improving flexibility.

[0041] In the embodiments of the present disclosure, the first body 3041 can be of any shape and structure as long as it can meet the requirements. For example, the first body 3041 can be in a circular, rectangular (including square), hexagonal (including regular hexagonal) or other shapes. Or it can also be other irregular shapes. The first body 3041 can be block-shaped or plate-shaped. In some embodiments of the present disclosure, the edges of the first body 3041 can be rounded to prevent the user from cutting the palm when holding the first body 3041.

[0042] In the embodiments of the present disclosure, the second body 3042 can be of any shape and structure as long as it can meet the requirements. For example, the second body 3042 can be in a circular, rectangular (including a square), hexagonal (including a regular hexagon) or other shapes. Or it can also be other irregular shapes. The second body 3042 can be block-shaped or plate-shaped. In some embodiments of the present disclosure, the edges of the second body 3042 can be rounded to prevent the user from cutting the palm when holding the second body 3042 or adjusting the position and / or posture of the second body 3042.

[0043] Optionally, the second body 3042 is removably disposed on the first body 3041. This makes it easier to adjust the position and / or posture of the second body relative to the first body, so that different recognition patterns can be flexibly combined to form a plurality of different states of the marking device 100.

[0044] Optionally, the first body 3041 and the second body 3042 are two independent structures, so that the position and / or posture of the second body relative to the first body can be adjusted more conveniently.

[0045] Optionally, refer toFigure 2E , Figure 2F , Figure 2G As shown in Figure 2G , the first main body 3041 is provided with a receiving groove 3043, and the second main body 3042 is disposed in the receiving groove 3043. Adjusting the position and / or posture of the second main body in the receiving groove ensures the accuracy of adjusting the position and / or posture of the second main body, facilitating more conveniently and accurately combining the patterns provided on the second main body and the first main body into different identification patterns.

[0046] The shape of the receiving groove 3043 is not particularly limited in the embodiments of the present disclosure. In an alternative embodiment, the shape of the receiving groove 3043 can be set according to the shape of the second main body 3042. For example, as shown in Figure 2E if the second main body 3042 is circular, the receiving groove 3043 can be formed as a slightly larger or equal-sized circular groove, and the second main body 3042 can be wholly filled into the receiving groove 3043. Another example, as shown in Figure 2F if the second main body 3042 is a rectangle with rounded corners, the receiving groove 3043 can be formed as a rectangle with rounded corners larger than the second main body 3042, and the second main body 3042 can be disposed in a partial area of the receiving groove 3043. Still another example, as shown in Figure 2G if the second main body 3042 is a regular hexagon, the receiving groove 3043 can be formed as a hexagon larger than the second main body 3042, and the second main body 3042 can be disposed in a partial area of the receiving groove 3043, and three sides of the second main body 3042 can be attached to the side walls of the receiving groove 3043 during use. It should be understood that the above examples are not intended as limitations in the embodiments of the present disclosure.

[0047] Optionally, when the second main body 3042 is disposed in the receiving groove 3043, it does not exceed the upper edge of the side wall of the receiving groove 3043. In this way, when the camera captures the marker from any shooting angle, the second main body is not likely to block the pattern on the first main body outside the receiving groove, better ensuring the integrity of the identification pattern and the use effect of the marker. Moreover, since the second main body does not exceed the upper edge of the side wall of the receiving groove and the second main body is wholly located in the receiving groove, the space occupied by the marker can be smaller and the structure can be more compact.

[0048] Optionally, when the second body 3042 is disposed in the receiving groove 3043, it may slightly protrude beyond the upper edge of the side wall of the receiving groove 3043, but the thickness of the portion of the second body 3042 that protrudes beyond the upper edge of the side wall of the receiving groove 3043 is less than or equal to 2 mm. In this way, at least one of the position and posture of the second body can be conveniently adjusted by means of the portion of the second body that protrudes beyond the upper edge of the side wall of the receiving groove; and since the thickness of the portion of the second body that protrudes beyond the upper edge of the side wall of the receiving groove is less than or equal to 2 mm, within such a range, the second body can also less or basically not block the pattern on the first body other than the receiving groove, and can also better ensure the integrity of the recognition pattern and better ensure the use effect of the marker.

[0049] In the embodiments of the present disclosure, at least one of the position and posture of the second body 3042 can be adjusted by any means. For example, optionally, after the second body 3042 is slid, rotated, or repositioned at least one of them, at least one of the position and posture of the second body 3042 relative to the first body 3041 is adjusted. Based on this, the marker can effectively adjust at least one of the position and posture of the second body through a corresponding structure, so as to be able to flexibly combine different recognition patterns and make the marker form multiple different states.

[0050] For example, in an alternative example, referring to Figure 2E as shown, the second body 3042 is circular, and the receiving groove 3043 of the first body 3041 is a slightly larger or equal-sized circular groove. The second body 3042 is entirely located in the receiving groove 3043. The second body 3042 can be rotated within the receiving groove 3043 to adjust its posture, so that the pattern on the second body 3042 rotates accordingly and combines with the pattern on the first body 3041 to form different recognition patterns; or the second body 3042 can also be taken out of the receiving groove 3043, repositioned at another angle, and then placed back in the receiving groove 3043 to adjust its posture. (For the convenience of citation below, this marker structure can be denoted as "optional structure A")

[0051] Another example, in another alternative example, referring to Figure 2FAs shown, the second body 3042 is a rectangle with rounded corners, and the receiving groove of the first body 3041 can be a rectangular groove with rounded corners larger than the second body. The second body 3042 is disposed within the receiving groove 3043. The second body 3042 can be slid or pushed along the receiving groove 3043 to adjust its position, so that the pattern on the second body 3042 moves accordingly and combines with the pattern on the first body 3041 to form different identification patterns; or the second body 3042 can also be taken out of the receiving groove 3043, placed at a different angle and then re-placed within the receiving groove 3043, thereby adjusting at least one of the position and posture. (For the convenience of citation below, this marker structure can be denoted as "optional structure B")

[0052] For another example, in yet another alternative example, referring to Figure 2G As shown, the second body 3042 is a hexagon, and the receiving groove 3043 of the first body 3041 can be a hexagonal groove larger than the second body 3042. The second body 3042 is disposed within the receiving groove 3043. By sliding or pushing the second body 3042 to move to different positions within the receiving groove 3043, at least one of its position and posture can be adjusted, so that the pattern on the second body 3042 moves accordingly and combines with the pattern on the first body 3041 to form different identification patterns; or the second body 3042 can also be taken out of the receiving groove 3043, placed at a different angle and then re-placed within the receiving groove 3043, and at least one of the position and posture can also be adjusted. (For the convenience of citation below, this marker structure can be denoted as "optional structure C")

[0053] It should be understood that the above examples are only some optional examples and do not limit the embodiments of the present disclosure.

[0054] Optionally, the pattern provided on the first body 3041 can include a rotationally asymmetric pattern. Through the rotationally asymmetric pattern, direction information and rotation information can be provided for the identification pattern formed by the marker, so as to facilitate identification.

[0055] S104: Determine the state of the marker corresponding to the identification pattern presented by the marker according to the target image.

[0056] In the embodiments of the present disclosure, by identifying the identification pattern in the target image, the state of the marker corresponding to the target pattern is determined. In the embodiments of the present disclosure, the above step S104 can be implemented in any manner. For example, it can include, but is not limited to, inputting the target image into a trained neural network model, and through the model algorithm, to determine the state of the marker corresponding to the identification pattern presented by the marker.

[0057] In some alternative embodiments, a first pattern is provided on the first body 3041, and a second pattern is provided on the second body 3042. Step S104 includes the following sub-steps S1041 and S1042, specifically:

[0058] S1041: Identify the relative position between the first pattern and the second pattern in the target image.

[0059] S1042: Determine the state of the marker corresponding to the recognition pattern presented by the marker according to the relative position.

[0060] In the embodiments of the present disclosure, since the relative position between the first pattern on the first body and the second pattern on the second body is different in different states of the marker, the patterns on the first body and the second body form different recognition patterns. Therefore, the state of the marker corresponding to the recognition pattern presented by the marker can be uniquely determined by identifying the relative position between the first pattern and the second pattern in the target image, and the accuracy of the determination result of the state of the marker can be effectively guaranteed, so as to facilitate the subsequent steps to accurately control the display device.

[0061] Optionally, the first pattern is a rotationally asymmetric pattern. In this way, direction information and rotation information can be provided for the recognition pattern formed by the marker, so as to facilitate accurately identifying the relative position between the first pattern and the second pattern.

[0062] For example, as shown in Figure 2E , the first pattern may be a rotationally asymmetric pattern composed of a plurality of irregularly arranged black and white patterns (for example, it can form an arc shape). Another example, as shown in Figure 2F , Figure 2G , the first pattern may be a plurality of irregular patterns respectively arranged at different positions on the first body, and each irregular pattern includes irregularly arranged black and white patterns, thus forming a rotationally asymmetric pattern. It should be understood that these examples are not limitations in the embodiments of the present disclosure.

[0063] Optionally, the second pattern may be a rotationally asymmetric pattern or a rotationally symmetric pattern, which can be selected as needed.

[0064] S106: Control the display device based on the state of the marker.

[0065] In the embodiments of the present disclosure, each state of the marker can correspond to a control method for the display device. Therefore, the display device can be effectively controlled through the state of the marker.

[0066] Based on the optional implementation manner including the above steps S102 to S106, on the one hand, since a target image including the marker can be obtained, wherein the state of the marker can be adjusted to present different recognition patterns, and then according to the target image, the state of the marker corresponding to the recognition pattern presented by the marker is determined, and then based on the state of the marker, the display device is controlled, so the control of the display device can be effectively realized, and the control interaction between the user and the display device can be effectively realized by adjusting the state of the marker, which is beneficial to improving the user experience of using the display device; on the other hand, since the state of the marker can be adjusted to present different recognition patterns, when in use, only by adjusting the state of the marker can different controls of the display device be realized. Compared with designing multiple markers with different fixed carried patterns to realize different controls, the cost can be effectively reduced and the flexibility can be effectively improved, thereby further improving the user experience of using the display device.

[0067] In the embodiments of the present disclosure, the specific implementation of step S106 is not limited. For example, in some optional embodiments, step S106 may include at least one of the following: turning on and off the display screen; adjusting the size of the display picture; adjusting the ratio of the display picture; adjusting the position of the display picture; adjusting the brightness of the display picture; switching between 2D and 3D display modes; locking and unlocking the display screen; adjusting the sound; adjusting the light effect; connecting and disconnecting the network; switching users; switching working modes.

[0068] Based on this, in the embodiments of the present disclosure, through the above various control methods for the display device, various different types of control of the display device can be effectively realized, and the diversity of the control interaction between the user and the display device realized by adjusting the state of the marker can be effectively improved, which is more beneficial to improving the user experience of using the display device.

[0069] Optionally, turning on and off the display screen may refer to controlling the turning on and off of at least one display screen included in the display device. For example, the display screen may be turned on when it is determined according to the recognition pattern that the marker is in state 1, and the display screen may be turned off when it is determined according to the recognition pattern that the marker is in state 2 different from state 1.

[0070] Optionally, adjusting the size of the display picture may refer to scaling and adjusting the size of the display picture in at least one display screen included in the display device. For example, the display picture may be adjusted to the size of a*b when it is determined according to the recognition pattern that the marker is in state 1, and the display picture may be adjusted to the size of 2a*2b when it is determined according to the recognition pattern that the marker is in state 2 different from state 1.

[0071] Optionally, the adjustment of the aspect ratio of the display screen may refer to the adjustment of the aspect ratio of the display screen in at least one display screen included in the display device. For example, when it is determined according to the recognition pattern that the marker is in state 1, the aspect ratio of the display screen may be adjusted to 4:3, and when it is determined according to the recognition pattern that the marker is in state 2 different from state 1, the aspect ratio of the display screen may be adjusted to 16:9.

[0072] Optionally, the adjustment of the position of the display screen may refer to the adjustment of the position of the display screen in at least one display screen included in the display device within the display screen. For example, when it is determined according to the recognition pattern that the marker is in state 1, the display screen may be placed in the middle area of the display screen, and when it is determined according to the recognition pattern that the marker is in state 2 different from state 1, the display screen may be placed in the lower area of the display screen.

[0073] Optionally, the adjustment of the brightness of the display screen may refer to the adjustment of the brightness level of the display screen in at least one display screen included in the display device. For example, when it is determined according to the recognition pattern that the marker is in state 1, the brightness level of the display screen may be adjusted to a brightness level, and when it is determined according to the recognition pattern that the marker is in state 2 different from state 1, the brightness level of the display screen may be adjusted to 2a brightness level.

[0074] It can be understood that the above adjustments of the size, aspect ratio, and position of the display screen include but are not limited to the adjustments in two states.

[0075] Optionally, the 2D and 3D display mode switching may refer to the switching between the 2D display mode and the 3D display mode of the display device. It should be understood that this applies to the case where the display device has both the 2D display mode and the 3D display mode. For example, when it is determined according to the recognition pattern that the marker is in state 1, the display device may be controlled to switch to the 2D display mode, and when it is determined according to the recognition pattern that the marker is in state 2 different from state 1, the display device may be controlled to switch to the 3D display mode.

[0076] Optionally, the locking and unlocking of the display screen may refer to the locking operation and unlocking operation of at least one display screen included in the display device. For example, when it is determined according to the recognition pattern that the marker is in state 1, the display screen may be controlled to lock so that it cannot enter the display desktop, and when it is determined according to the recognition pattern that the marker is in state 2 different from state 1, the display screen may be controlled to unlock so that it can enter the display desktop.

[0077] Optionally, the adjustment of sound may refer to adjusting at least one of the volume of the speaker included in the display device, the sound effect mode, the sound on and off, the music being played, etc. It should be understood that this applies to the case where the display device has a speaker. For example, for the volume, when it is determined according to the recognition pattern that the marker is in state 1, the volume of the speaker of the display device can be adjusted to a, and when it is determined according to the recognition pattern that the marker is in state 2 different from state 1, the volume of the speaker of the display device can be adjusted to 2a. Another example is that for the music being played, when it is determined according to the recognition pattern that the marker is in state 1, the music played by the speaker of the display device can be adjusted to music 1, and when it is determined according to the recognition pattern that the marker is in state 2 different from state 1, the music played by the speaker of the display device can be adjusted to music 2. It can be understood that the above adjustment of sound includes but is not limited to the adjustment of two states.

[0078] Optionally, the adjustment of the light effect may be to adjust the light effect of the indicator light included in the display device. It should be understood that this applies to the case where the display device has an indicator light. For example, when it is determined according to the recognition pattern that the marker is in state 1, the light effect of the indicator light of the display device can be adjusted to a flashing light effect, when it is determined according to the recognition pattern that the marker is in state 2, the light effect of the indicator light of the display device can be adjusted to a breathing light effect, and when it is determined according to the recognition pattern that the marker is in state 3, the light effect of the indicator light of the display device can be adjusted to a flowing water light effect. It can be understood that the above adjustment of the light effect includes but is not limited to the adjustment of two states.

[0079] Optionally, the connection and disconnection of the network may refer to controlling the connection and disconnection of at least one network connection method of the display device. The network connection methods may include but are not limited to at least one of WIFI connection, cellular network connection, Bluetooth connection, etc. For example, when it is determined according to the recognition pattern that the marker is in state 1, the WIFI connection method of the display device can be controlled to enter the connection state, when it is determined according to the recognition pattern that the marker is in state 2, the WIFI connection method can be controlled to enter the disconnection state, and when it is determined according to the recognition pattern that the marker is in state 3, the Bluetooth connection method of the display device can be controlled to enter the connection state, and so on.

[0080] Optionally, the switching of the user may refer to switching the user using the display device. What can be switched here includes but is not limited to at least one of switching the accounts and user names of different users. For example, when it is determined according to the recognition pattern that the marker is in state 1, the account of the user using the display device can be switched to the account of user 1, and when it is determined according to the recognition pattern that the marker is in state 2 different from state 1, the account of the user using the display device can be switched to the account of user 2. It can be understood that the above switching of the user includes but is not limited to the switching between two users.

[0081] Optionally, the switching of the working mode may refer to the switching of the display device between: a dark mode and a light mode, a day mode and a night mode, a normal mode and a power-saving mode, a normal mode and a do-not-disturb mode, etc. For example, taking the switching between the normal mode and the power-saving mode as an example, when it is determined according to the recognition pattern that the marker is in state 1, the display device can be switched to the normal mode, and when it is determined according to the recognition pattern that the marker is in state 2, the display device can be switched to the power-saving mode. It can be understood that the above switching of the working mode includes but is not limited to the switching between two working modes.

[0082] It should be understood that the examples given in the above description are all examples for easy understanding and do not constitute any limitation to the embodiments of the present disclosure.

[0083] In some alternative embodiments, if the display device is a head-mounted display device, step S106 may also include at least one of the following: switching between at least two of the 0-degree-of-freedom mode, 3-degree-of-freedom mode, and 6-degree-of-freedom mode; switching between the augmented reality mode and the virtual reality mode; adjusting the intensity of the ambient light in the augmented reality mode; adjusting the distance of the display screen.

[0084] Based on this, in the embodiments of the present disclosure, through the above various control methods for the head-mounted display device, it is possible to effectively implement various different types of control of the head-mounted display device, effectively improve the diversity of the control interaction between the user and the head-mounted display device by adjusting the state of the marker, and thus be more conducive to improving the user experience of using the head-mounted display device.

[0085] Optionally, the 0-degree-of-freedom mode may refer to the 0DOF (Degree of Freedom) rendering mode of the head-mounted display device, the 3-degree-of-freedom mode may refer to the 3DOF rendering mode of the head-mounted display device, and the 6-degree-of-freedom mode may refer to the 6DOF rendering mode of the head-mounted display device. The 0, 3, and 6-degree-of-freedom modes are common rendering modes of head-mounted display devices (including but not limited to AR glasses, VR glasses, etc.). By controlling the switching of at least two of these three, the user's need for adjusting the rendering mode of the head-mounted display device can be met. For example, assuming that the head-mounted display device includes the above three degrees-of-freedom modes, when it is determined according to the recognition pattern that the marker is in state 1, the head-mounted display device can be switched to the 0-degree-of-freedom mode, when it is determined according to the recognition pattern that the marker is in state 2, the head-mounted display device can be switched to the 3-degree-of-freedom mode, and when it is determined according to the recognition pattern that the marker is in state 3, the head-mounted display device can be switched to the 6-degree-of-freedom mode.

[0086] Optionally, the switching between the augmented reality mode and the virtual reality mode can be used for a head-mounted display device that has both augmented reality and virtual reality functions. After switching to the augmented reality mode, the head-mounted display device can be used as an AR device; after switching to the virtual reality mode, the head-mounted display device can be used as a VR device. For example, when it is determined according to the recognition pattern that the marker is in state 1, the head-mounted display device can be switched to the augmented reality mode, and when it is determined according to the recognition pattern that the marker is in state 2, the head-mounted display device can be switched to the virtual reality mode.

[0087] Optionally, in some head-mounted display devices including electrochromic lenses, the intensity of ambient light in the augmented reality mode can be adjusted by changing the transparency of the electrochromic lenses. The higher the transparency of the electrochromic lenses, the higher the intensity of ambient light. For example, when it is determined according to the recognition pattern that the marker is in state 1, the transparency of the electrochromic lenses of the head-mounted display device can be increased, so that the intensity of ambient light in the augmented reality mode increases, and when it is determined according to the recognition pattern that the marker is in state 2, the transparency of the electrochromic lenses of the head-mounted display device can be decreased, so that the intensity of ambient light in the augmented reality mode decreases.

[0088] Optionally, the adjustment of the distance of the display screen can refer to adjusting the distance between the display screen of the head-mounted display device and the user. For example, when it is determined according to the recognition pattern that the marker is in state 1, the distance of the display screen of the head-mounted display device can be adjusted to a relatively close distance a, and when it is determined according to the recognition pattern that the marker is in state 2, the distance of the display screen of the head-mounted display device can be adjusted to a relatively far distance 2a.

[0089] It can be understood that the above adjustments to the intensity of ambient light and the distance of the display screen include but are not limited to the adjustments of two states.

[0090] It should be understood that the examples given in the above description are all examples for easy understanding and do not constitute any limitation to the embodiments of the present disclosure.

[0091] In some alternative embodiments, step S106 further includes: adjusting the state of the virtual marker corresponding to the marker in the display screen of the display device.

[0092] In the embodiments of the present disclosure, by adjusting the state of the virtual marker corresponding to the marker in the display screen of the display device, for example, making the state of the virtual marker correspond to the state of the actual current marker, so that when using the display device, the state of the current marker can be more intuitively determined through the state of the virtual marker, so as to better realize different controls of the display device by adjusting the marker, and to better improve the user experience of using the display device.

[0093] In the embodiments of the present disclosure, after a marker is recognized, a virtual marker corresponding to the marker can be first displayed on the display screen of the display device. The virtual marker can include, but is not limited to, a virtual image. The shape of the virtual marker can be similar to the shape of the marker and can be located near the marker (for example, above the marker). For example, in combination with Figures 2A - 2D it can be understood that a schematic diagram showing the marker and its corresponding virtual marker is shown, and a schematic diagram showing the adjustment of the state of the virtual marker is shown, where Figure 2A and Figure 2B show an example of adjusting the state of the virtual marker corresponding to the marker on the left side of the figure, while Figure 2B , Figure 2C and Figure 2D show an example of adjusting the state of the virtual marker corresponding to the marker on the right side of the figure.

[0094] In some optional embodiments, step S106 includes: controlling the display content of the display device based on the state of the marker, and it includes at least one of the following control methods A1, A2, A3, and A4:

[0095] Control method A1: Controlling the display device to display a display desktop corresponding to the state of the marker.

[0096] Optionally, based on different states of the marker, the display screen of the display device can be controlled to display a display desktop corresponding to the state of the marker, so that the display desktop of the display device presents different styles to meet different usage requirements of the user for the display device.

[0097] For example, assuming that there are 2 display desktops in total, namely display desktop 1 and display desktop 2, when it is determined according to the recognition pattern that the marker is in state 1, the display device can be controlled to display the corresponding display desktop 1, and when it is determined according to the recognition pattern that the marker is in state 2, the display device can be controlled to display the corresponding display desktop 2.

[0098] Control method A2: Controlling the display device to display the interface of an application program corresponding to the state of the marker.

[0099] Optionally, in control mode 2, an alternative implementation may be to control the display device to display, in the display screen, the interfaces of multiple different applications corresponding to the states of the marker (simply understood, that is, to switch the display of the interfaces of application 1 and application 2). Another alternative implementation may be to control the display device to switch and display, in the display screen, different interfaces of the same application corresponding to the states of the marker (simply understood, that is, to switch the display of interface 1 of application 1 to interface 2 of application 1). In this way, the interfaces of the applications displayed by the display device are adjusted to meet different usage requirements of the user for the display device.

[0100] For example, taking the latter implementation described above as an example, when it is determined according to the recognition pattern that the marker is in state 1, the display device may be controlled to display interface 1 of application 1 corresponding thereto in the display screen, and when it is determined according to the recognition pattern that the marker is in state 2, the display device may be controlled to display interface 2 of application 1 corresponding thereto in the display screen.

[0101] Control mode A3: Control the display device to display at least one object corresponding to the state of the marker.

[0102] Specifically, based on different states of the marker, the display device may be controlled to display at least one object corresponding to the state of the marker in the display screen. The object may include but is not limited to digital virtual objects (such as digital virtual objects including but not limited to images of people, animals, geometric bodies, buildings, etc.), images, videos, icons, option buttons, playback windows, etc. The object may be a 2D or 3D virtual object. In this way, the content displayed by the display device is adjusted to meet different usage requirements of the user for the display device.

[0103] For example, taking the object as a digital virtual object as an example (for example, taking the digital virtual object in the image of a cartoon character as an example, denoted as cartoon character 1 and cartoon character 2 respectively), when it is determined according to the recognition pattern that the marker is in state 1, the display device may be controlled to display the digital virtual object in the image of cartoon character 1 corresponding thereto in the display screen, and when it is determined according to the recognition pattern that the marker is in state 2, the display device may be controlled to display the digital virtual object in the image of cartoon character 2 corresponding thereto in the display screen.

[0104] In some alternative embodiments, before control mode A3, the control method of the display device according to the embodiments of the present disclosure further includes: determining at least one of the position and pose of the marker according to the target image; determining the position to be displayed of the object based on at least one of the position and pose of the marker. On this basis, control mode A3 may be implemented as at least one of the following control mode A31 and control mode A32, specifically:

[0105] Control mode A31: At the position to be displayed, at least one object corresponding to the state of the marker is displayed.

[0106] Based on the above control mode A31, in the embodiments of the present disclosure, by determining at least one of the position and attitude of the marker, the position to be displayed of the object in the display screen can be reasonably determined, and at least one object corresponding to the state of the marker is displayed at the position to be displayed, so that when the display device displays the object, it can cooperate with at least one of the actual position and attitude of the marker, achieving a virtual-real combined display effect, which is beneficial to improving the user experience of using the display device.

[0107] For control mode A31, for example, taking the display screen of the display device that can include 3 positions to be displayed from left to right (denoted as the positions to be displayed 1, 2, and 3 respectively) and the object being a digital virtual object in the form of a cartoon character as an example, the position to be displayed of the object can be determined to be the position to be displayed 2 according to at least one of the position and attitude of the marker, and then the object corresponding to the state of the marker can be displayed at the position to be displayed 2. It should be understood that this is only an example for easy understanding and is not a limitation on the embodiments of the present disclosure.

[0108] Control mode A32: At the position to be displayed, at least one object corresponding to the state of the marker and the position to be displayed is displayed.

[0109] Based on the above control mode A32, in the embodiments of the present disclosure, by determining at least one of the position and attitude of the marker, the position to be displayed of the object in the display screen can be reasonably determined, and at least one of the state of the marker and the position to be displayed is used as a condition to display the object corresponding to both at the position to be displayed, so that when the display device displays the object, it can cooperate with at least one of the actual position and attitude of the marker, and take into account the actual situation of the position to be displayed in the display screen, achieving a virtual-real combined display effect, which is beneficial to improving the user experience of using the display device.

[0110] For control mode A32, for example, taking the display screen of the display device that can include 3 positions to be displayed from left to right (denoted as the positions to be displayed 1, 2, and 3 respectively), the object being a digital virtual object in the form of a cartoon character (for example, there are 2 in total, denoted as cartoon character 1 and 2), and the attributes of the object including clothing (for example, including clothing 1 and clothing 2) as an example, the position to be displayed of the object can be determined to be the position to be displayed 2 according to at least one of the position and attitude of the marker, the object corresponding to the state of the marker is the object of cartoon character 1, and the clothing corresponding to the position to be displayed 2 is clothing 1, then the object of cartoon character 1 wearing clothing 1 is displayed at the position to be displayed 2. It should be understood that this is only an example for easy understanding and is not a limitation on the embodiments of the present disclosure.

[0111] Control method A4: Control the display device to adjust the attributes of at least one object, and the attributes of at least one object correspond to the state of the marker.

[0112] Specifically, based on different states of the marker, the display device can be controlled to adjust the attributes of at least one object, so that the objects displayed in the display screen are presented in the required styles, thereby meeting different usage requirements of users for the display device.

[0113] In some optional embodiments, the attributes of the object include at least one of the following: position, attitude, motion state, background, style, and size. By appropriately adjusting such attributes, various different types of control over the objects displayed on the display device can be effectively achieved, so that the objects displayed in the display screen are presented in the required styles, effectively improving the diversity of the control interaction between the user and the display device by adjusting the state of the marker, which is beneficial to meeting different usage requirements of users for the display device and improving the user experience of using the display device.

[0114] Optionally, adjusting the position of the object may refer to adjusting the position of the object in the display screen. For example, the object can be adjusted to the middle area, upper part, lower part, upper left corner, lower right corner, etc. of the display screen.

[0115] Optionally, adjusting the attitude of the object may refer to adjusting the attitude of the object in the display screen, which can be achieved by adjusting the angle of the object in the display screen. For a 2D object, when adjusting the attitude, the object can be rotated as a whole by a certain angle (for example, taking a 2D cartoon character pattern as an object, rotating the whole pattern 180° from the state with the head facing up to the state with the head facing down). For a 3D object, when adjusting the attitude, it can be at least one of rotating the object as a whole by a certain angle and rotating the object itself by a certain angle (for example, taking a digital virtual object of a 3D cartoon character image as an object, it can be rotated 180° as a whole from the state with the head facing up to the state with the head facing down, or the state with the chest facing forward of the cartoon character image can be rotated 180° by itself to the state with the back facing forward, or it can be rotated 180° as a whole and rotated 180° by itself simultaneously in the aforementioned manner).

[0116] Optionally, adjusting the motion state of the object may refer to adjusting the actions of the object in the display screen. For example, the motion state may include but is not limited to actions such as stationary, running, waving, jumping, dancing, etc.

[0117] Optionally, the background of the object can be adjusted by adjusting the virtual environment style (i.e., the background) in which the object is located in the display screen. For example, the background can include, but is not limited to, various solid-color backgrounds and various themed backgrounds (such as adjusting to virtual environment styles like a dreamy castle, a sunny beach, a starry night, etc.). When adjusting the background, place the object in the corresponding virtual environment.

[0118] Optionally, the style of the object can be adjusted by changing the color scheme and accessories of the object. In this way, the object presents different styles in different occasions to meet the different usage needs of users. For example, taking a digital virtual object with a cartoon character image as an example, its clothing type, clothing color, hairstyle, hair color, and other color-matching accessories can be adjusted.

[0119] Optionally, the size of the object can be adjusted by enlarging or reducing the object. In this way, the object presents different sizes as needed to meet the different needs of users.

[0120] It should be understood that the examples given in the above description are all examples for easy understanding and do not serve as any limitation to the embodiments of the present disclosure.

[0121] Based on the optional control methods A1, A2, A3, and A4 above, various different types of control of the display device can be effectively achieved, effectively improving the diversity of the control interaction between the user and the display device by adjusting the state of the marker, thereby being more conducive to improving the user experience of using the display device.

[0122] In some optional embodiments, the marker at least includes a first marker and a second marker, and the identification patterns presented by the first marker and the second marker are different; step S106 includes: based on the state of the first marker, correspondingly performing a first control on the display device; based on the second marker, correspondingly performing a second control on the display device.

[0123] Based on this, in the embodiments of the present disclosure, different controls are performed on the display device through at least two markers presenting different identification patterns. Through such combined use, different controls on the display device can be more conveniently and effectively achieved, and diverse control interactions between the user and the display device are effectively realized by adjusting the states of multiple markers, thereby further being conducive to improving the user experience of using the display device.

[0124] It should be understood that both the first marker and the second marker can be constructed into the aforementioned structure of "including a first body and a second body", and their overall shapes can be the same or different, as long as they can present different identification patterns to meet the usage requirements, and the embodiments of the present disclosure do not make any limitations thereto.

[0125] For example, in an optional example, the control method A1 can be implemented based on the state of the first marker, and at least one of the control methods A2, A3, and A4 can be implemented based on the state of the second marker.

[0126] For example, the following combination Figures 2A - 2D The following is a schematic diagram of the display content of multiple examples of the use status of the display device, and the control scheme of the display device in some embodiments of the present disclosure is explained to facilitate understanding. Figures 2A - 2D Substitute it into the application scenario where the display device is AR glasses to understand it. Figures 2A - 2D As shown, there are two markers on the desktop (for ease of understanding, Figures 2A - 2D The left marker in the figure is considered as the first marker, and the right marker is considered as the second marker). The desktop and the marker are real objects, and each object and virtual marker are virtual and are displayed on the display screen of the display device. Figure 2A and Figure 2B As shown, when the state of the marker on the left changes, the display desktop of the display device is controlled to change. Specifically, Figure 2A There are 4 objects on the desktop, namely object a1, object a2, object a3 and object a4. Figure 2B There are three objects on the display desktop, namely object b1, object b2 and object a3. The user adjusts the left marker. Figure 2A The status and Figure 2B Switching between the states shown can switch the display desktop of the display device. Figure 2B As described above, the marker on the right is in the first state, and the display device is controlled to display the first application interface (the first application interface includes objects b1, b2 and b3); refer to Figure 2C As shown, the state of the marker on the right is adjusted to the second state, and the display device is controlled to display the second application interface (the second application interface includes objects c1, c2, c3 and c4); refer to Figure 2D As shown, the state of the marker on the right is adjusted to the third state again, and the display device is adjusted to display the third application interface (the third application interface includes objects d1, d2, d3 and d4). It should be noted that the above objects can be digital virtual objects, images, videos, icons, option buttons, play windows, etc. It should be understood that Figures 2A - 2D The schematic diagrams and related explanations are only used to facilitate the understanding of the embodiments of the present disclosure, and are not intended to limit the embodiments of the present disclosure.

[0127] Optionally, the marker may further include a third marker, which is different from the recognition patterns presented by the first marker and the second marker. Step S106 further includes: correspondingly performing third control on the display device based on the state of the third marker.

[0128] For example, in an optional example, the above control method A1 can be implemented based on the state of the first marker, the above control method A2 can be implemented based on the state of the second marker, and the above control method A4 can be implemented based on the state of the third marker.

[0129] Optionally, any one or more implementation manners in the control scheme of the display device according to the embodiments of the present disclosure can be implemented by using an SDK (Software Development Kit), so as to improve the stability and security of controlling the display device, and can improve the development efficiency.

[0130] Next, an optional scenario example of the control scheme of the display device according to the embodiments of the present disclosure will be described. It should be noted that in this scenario example, the display device is a head-mounted display device, an AR glasses, and the markers include a first marker, a second marker, and a third marker. Among them, the first marker adopts the aforementioned "optional structure B" and can form at least 2 states of the markers; the second marker adopts "optional structure C" and can form at least 3 different states of the markers; the third marker adopts the above "optional structure A" and can form at least 6 different states of the markers. It should be understood that this is only an example here, and all three can adopt the required structures as needed. Refer to the following content to understand the working process:

[0131] Working process 1 (global control of the display device): After each marker is placed on the desktop and the user wears the AR glasses, the camera on the AR glasses captures a target image including each marker. Then, the control unit (the control unit can be set on the display device or on other electronic devices electrically connected to the display device) identifies the recognition pattern formed by the markers in the target image through an algorithm to determine the state of the markers. After recognizing the state of the first marker, the display screen of the AR glasses can be controlled to display a display desktop corresponding to the state of the first marker. When the user adjusts the position of the second body of the first marker on the first body and changes the state of the first marker, the AR glasses can be controlled to switch to another display desktop. Based on this, global control of the display device can be realized. For example, if the first marker can form at least 2 different states of the markers, at least 2 display desktop switches can be performed.

[0132] Working process 2 (partial control of the display state of the display device): After entering the corresponding display desktop through the state of the first marker, the control unit identifies the recognition pattern formed by the second marker in the target image through an algorithm to determine the state of the second marker. After identifying the state of the second marker, the AR glasses can be controlled to enter the corresponding application program, so that the display screen presents the corresponding content of the application program. After the user adjusts the position of the second body of the second marker on the first body and changes the state of the second marker, the AR glasses can be controlled to switch to another application program. For example, if the second marker can form at least 3 different states of the marker, at least 3 display state switches can be made.

[0133] Working process 3 (adjustment of the attributes of the displayed object): The user adjusts the rotation angle of the second body of the third marker on the first body (for example, the second pattern set on the second body can be in the form of an arrow, and the second body can be rotated to adjust the position of the arrow (the angle of the arrow can be an acute angle greater than 30°, and can also be combined with Figure 2E understanding) pointing to the position of the first pattern on the first body to form different recognition patterns). The control unit identifies the recognition pattern formed by the third marker in the target image through an algorithm to determine the state of the third marker. After identifying the state of the third marker, the AR glasses can be controlled to adjust the attributes of the object displayed in the display screen. For example, adjust one of the position, posture, and other attributes (such as motion state, background, style, size) of the object. For example, if the third marker can form at least 6 different states of the marker, at least 6 switches can be made.

[0134] Working process 4 (adjusting the pose of the marker to control the displayed object): The control unit identifies the recognition pattern of any marker (taking the first marker as an example) in the target image to determine the state of the marker. After the state of the marker is determined, the position to be displayed is determined in the display screen, and an object corresponding to the state of the marker is displayed at the position to be displayed. And at least one of the position and posture of the object can be changed by adjusting at least one of the position and posture of the marker.

[0135] Working process 5 (displaying the virtual marker of the marker): When the control unit identifies any marker (the first marker, the second marker, the third marker), the virtual marker of the corresponding marker is displayed on the display screen of the AR glasses, and after the recognition pattern of the marker is changed, the state of the virtual marker corresponding to the marker is adjusted to adapt to the changed recognition pattern.

[0136] It should be understood that the above description of the scenario examples and working processes is only for facilitating the understanding of the embodiments of the present disclosure and does not constitute any limitation to the embodiments of the present disclosure.

[0137] In summary, the control solution of the display device according to the embodiments of the present disclosure can effectively control the display device, and effectively realize the control interaction between the user and the display device by adjusting the state of the marker, thereby facilitating the improvement of the user experience of using the display device. And since during use, only the state of the marker needs to be adjusted to achieve different controls of the display device, compared with designing multiple markers with different carried fixed patterns to achieve different controls, it can effectively reduce costs and effectively improve flexibility, thereby further improving the user experience of using the display device.

[0138] According to the second aspect of the application embodiment, a control device for a display device is provided. Referring to Figure 3 as shown, the control device 200 of the display device includes:

[0139] An acquisition module 202, configured to acquire a target image including a marker, wherein the state of the marker can be adjusted to present different recognition patterns;

[0140] A determination module 204, configured to determine the state of the marker corresponding to the recognition pattern presented by the marker according to the target image;

[0141] A control module 206, configured to control the display device based on the state of the marker.

[0142] In some optional embodiments, the control module 206 is specifically configured to: control the display content of the display device based on the state of the marker, and is specifically used for at least one of the following: controlling the display device to display a display desktop corresponding to the state of the marker; controlling the display device to display an interface of an application program corresponding to the state of the marker; controlling the display device to display at least one object corresponding to the state of the marker; controlling the display device to adjust the attributes of at least one object, and the attributes of at least one object correspond to the state of the marker.

[0143] In some optional embodiments, the control device 200 of the display device is further configured to: determine at least one of the position and attitude of the marker according to the target image; determine the position to be displayed of the object based on at least one of the position and attitude of the marker; the control module 206 is specifically configured to perform at least one of the following: display at least one object corresponding to the state of the marker at the position to be displayed; display at least one object corresponding to the state of the marker and the position to be displayed at the position to be displayed.

[0144] In some optional embodiments, the attributes of the object include at least one of: position, attitude, motion state, background, style, size.

[0145] In some alternative embodiments, the marker at least includes a first marker and a second marker, and the recognition patterns presented by the first marker and the second marker are different; the control module 206 is specifically configured to: perform a first control on the display device based on the state of the first marker; and perform a second control on the display device based on the second marker.

[0146] In some alternative embodiments, the marker includes: a first body and a second body, the second body is disposed on the first body, and at least one of the position and posture of the second body relative to the first body is variable; wherein, both the first body and the second body are provided with patterns, and the patterns provided on the first body and the second body can be combined into different recognition patterns.

[0147] In some alternative embodiments, the second body is removably disposed on the first body, and after the second body is subjected to at least one of sliding, rotating, and repositioning, at least one of the position and posture of the second body relative to the first body is adjusted.

[0148] In some alternative embodiments, a first pattern is provided on the first body, and a second pattern is provided on the second body; the determination module 204 is specifically configured to: identify the relative position between the first pattern and the second pattern in the target image; and determine the state of the marker corresponding to the recognition pattern presented by the marker according to the relative position.

[0149] In some alternative embodiments, the control module 206 is further configured to: adjust the state of the virtual marker corresponding to the marker in the display screen of the display device.

[0150] In some alternative embodiments, the control module 206 is specifically configured to perform at least one of the following: turning on and off the display screen; adjusting the size of the display screen; adjusting the ratio of the display screen; adjusting the position of the display screen; adjusting the brightness of the display screen; switching between 2D and 3D display modes; locking and unlocking the display screen; adjusting the sound; adjusting the light effect; connecting and disconnecting the network; switching users; and switching working modes.

[0151] In some alternative embodiments, the display device is a head-mounted display device; the control module 206 is specifically configured to perform at least one of the following: switching between at least two of the 0-degree-of-freedom mode, 3-degree-of-freedom mode, and 6-degree-of-freedom mode; switching between the augmented reality mode and the virtual reality mode; adjusting the intensity of the ambient light in the augmented reality mode; and adjusting the distance of the display screen.

[0152] The solution provided in the embodiments of the present disclosure can effectively control a display device, and effectively realize the control interaction between the user and the display device by adjusting the state of the marker, thereby facilitating the improvement of the user experience of using the display device. Moreover, when in use, different controls of the display device can be realized only by adjusting the state of the marker. Compared with designing multiple markers with different fixed patterns to achieve different controls, the cost can be effectively reduced and the flexibility can be effectively improved, thereby further improving the user experience of using the display device.

[0153] The control device 200 of the display device provided in the second aspect of the embodiments of the present disclosure is based on the same inventive concept as the control method of the display device provided in the first aspect above, corresponds to the control method of the display device in the corresponding multiple method embodiments, and has the beneficial effects of the corresponding embodiments of the control method of the display device. Therefore, it will not be elaborated here. In addition, the implementation of each module in the control device 200 of the display device in the embodiments of the present disclosure can be referred to the description of the corresponding part in the embodiments of the control method of the display device above, and will not be elaborated here either.

[0154] According to the third aspect of the embodiments of the present disclosure, a display system is provided. Referring to Figure 4 As shown, the display system 300 includes: a display device 302, a marker 304, and a control unit 306; the state of the marker 304 can be adjusted to present different identification patterns; the control unit 306 is configured to obtain a target image including the marker 304, determine the state of the marker corresponding to the identification pattern presented by the marker 304 according to the target image, and control the display device 302 based on the state of the marker 304.

[0155] In some optional embodiments, the control unit 306 is specifically configured to: control the display content of the display device based on the state of the marker, and specifically be used for at least one of the following: controlling the display device to display a display desktop corresponding to the state of the marker; controlling the display device to display an interface of an application program corresponding to the state of the marker; controlling the display device to display at least one object corresponding to the state of the marker; controlling the display device to adjust the attributes of at least one object, and the attributes of at least one object correspond to the state of the marker.

[0156] In some optional embodiments, the control unit 306 is further configured to: determine at least one of the position and posture of the marker according to the target image; determine the position to be displayed of the object based on at least one of the position and posture of the marker; and the control unit is specifically configured to perform at least one of the following: displaying at least one object corresponding to the state of the marker at the position to be displayed; displaying at least one object corresponding to the state of the marker and the position to be displayed at the position to be displayed.

[0157] In some alternative embodiments, the attributes of the object include at least one of the following: position, attitude, motion state, background, style, and size.

[0158] In some alternative embodiments, the markers at least include a first marker and a second marker, and the recognition patterns presented by the first marker and the second marker are different; the control unit is specifically configured to: perform a first control on the display device based on the state of the first marker; perform a second control on the display device based on the second marker.

[0159] In some alternative embodiments, the marker 304 includes: a first body and a second body, the second body is disposed on the first body, and at least one of the position and attitude of the second body relative to the first body is variable; wherein, both the first body and the second body are provided with patterns, and the patterns provided on the first body and the second body can be combined into different recognition patterns.

[0160] In some alternative embodiments, the second body is removably disposed on the first body, and after the second body is subjected to at least one of sliding, rotating, and repositioning, at least one of the position and attitude of the second body relative to the first body is adjusted.

[0161] In some alternative embodiments, a first pattern is provided on the first body, and a second pattern is provided on the second body; the control unit 306 is specifically configured to: identify the relative position between the first pattern and the second pattern in the target image; determine the state of the marker corresponding to the recognition pattern presented by the marker according to the relative position.

[0162] In some alternative embodiments, the control unit 306 is further configured to: adjust the state of the virtual marker corresponding to the marker in the display screen of the display device.

[0163] In some alternative embodiments, the control unit 306 is specifically configured to perform at least one of the following: turning on and off the display screen; adjusting the size of the display screen; adjusting the ratio of the display screen; adjusting the position of the display screen; adjusting the brightness of the display screen; switching between 2D and 3D display modes; locking and unlocking the display screen; adjusting the sound; adjusting the light effect; connecting and disconnecting the network; switching users; switching working modes.

[0164] In some alternative embodiments, the display device is a head-mounted display device; the control unit 306 is specifically configured to perform at least one of the following: switching between at least two of the 0-degree-of-freedom mode, 3-degree-of-freedom mode, and 6-degree-of-freedom mode; switching between the augmented reality mode and the virtual reality mode; adjusting the intensity of the ambient light in the augmented reality mode; adjusting the distance of the display screen.

[0165] The display system provided in the third aspect in the embodiments of the present disclosure and the control method of the display device provided in the first aspect in the foregoing are based on the same inventive concept, corresponding to the control method of the corresponding display device in the foregoing multiple method embodiments, and having the beneficial effects of the embodiments of the control method of the corresponding display device. Therefore, they will not be elaborated herein.

[0166] According to a fourth aspect of the embodiments of the present disclosure, there is provided an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory complete communication with each other through the communication bus; the memory is used for storing a computer program; the processor is used for executing the method according to any one of the first aspect by running the computer program stored on the memory. Referring to Figure 5 , a schematic structural diagram of an electronic device according to an embodiment of the present disclosure is shown. The specific embodiments of the present disclosure do not limit the specific implementation of the electronic device.

[0167] As Figure 5 shown, the electronic device 400 may include: a processor 402, a communication interface 404, a memory 406, and a communication bus 408.

[0168] Wherein:

[0169] The processor 402, the communication interface 404, and the memory 406 complete communication with each other through the communication bus 408.

[0170] The communication interface 404 is used for communicating with other electronic devices or servers.

[0171] The processor 402 is used for executing the computer program 410, and specifically may execute the relevant steps in the foregoing embodiments of the control method of the display device.

[0172] Specifically, the computer program 410 may include program codes, and the program codes include computer operation instructions.

[0173] The processor 402 may be a CPU, or a GPU (Graphic Processing Unit), or an application specific integrated circuit ASIC, or one or more integrated circuits configured to implement the embodiments of the present disclosure. One or more processors included in the intelligent device may be of the same type of processor, such as one or more CPUs; or may be of different types of processors, such as one or more CPUs and one or more ASICs.

[0174] A memory 406 for storing a computer program 410. The memory 406 may include high-speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

[0175] The computer program 410 may include multiple computer instructions. Specifically, the computer program 410 may cause the processor 402 to perform operations corresponding to the control method of the display device described in any one of the foregoing method embodiments through the multiple computer instructions.

[0176] For the specific implementation of each step in the computer program 410, reference may be made to the corresponding descriptions in the corresponding steps and units in the foregoing method embodiments, and they have corresponding beneficial effects, which will not be elaborated here. Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the devices and modules described above can refer to the corresponding process descriptions in the foregoing method embodiments and will not be elaborated here.

[0177] According to a fifth aspect of the embodiments of the present disclosure, the embodiments of the present disclosure further provide a computer storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the control method of the display device described in any one of the multiple method embodiments provided in the foregoing first aspect. The computer storage medium includes but is not limited to: Compact Disc Read-Only Memory (CD-ROM), Random Access Memory (RAM), floppy disk, hard disk, magneto-optical disk, etc.

[0178] According to a sixth aspect of the embodiments of the present disclosure, the embodiments of the present disclosure further provide a computer program product, including computer instructions, and the computer instructions direct a computing device to perform operations corresponding to any one of the control methods of the display device provided in the foregoing first aspect.

[0179] The embodiments of the control device 200 / display system 300 / electronic device 400 / computer storage medium / computer program product of the display device in the embodiments of the present disclosure have been described in detail in the foregoing embodiments of the control method of the display device. Therefore, the relevant content and beneficial effects thereof can be understood by referring to the foregoing method embodiments and will not be elaborated here.

[0180] In addition, it should be noted that the information related to users (including but not limited to user device information, user personal information, etc.) and data (including but not limited to sample data for training the model, data for analysis, stored data, displayed data, etc.) involved in the embodiments of the present disclosure are all information and data authorized by the users or fully authorized by all parties. Moreover, the collection, use, and processing of the relevant data need to comply with the relevant laws, regulations, and standards of the relevant countries and regions, and corresponding operation entrances are provided for users to choose to authorize or reject.

[0181] It should be pointed out that according to the needs of implementation, the various components / steps described in the embodiments of the present disclosure can be split into more components / steps, or two or more components / steps or partial operations of the components / steps can be combined into new components / steps to achieve the objectives of the embodiments of the present disclosure. It should be understood that the various technical features in the technical solutions of the embodiments of the present disclosure can be combined in any suitable manner.

[0182] The methods according to the embodiments of the present disclosure described above can be implemented in hardware, firmware, or be implemented as software or computer code that can be stored in a recording medium (such as a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or be implemented as computer code originally stored in a remote recording medium or a non-transitory machine-readable medium and downloaded through a network and to be stored in a local recording medium, so that the methods described herein can be stored on such a recording medium for software processing using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA)). It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component (such as a Random Access Memory (RAM), a Read-Only Memory (ROM), a flash memory, etc.) that can store or receive software or computer code, and when the software or computer code is accessed and executed by the computer, the processor, or the hardware, the methods described herein are implemented. In addition, when a general-purpose computer accesses the code for implementing the methods shown herein, the execution of the code converts the general-purpose computer into a dedicated computer for executing the methods shown herein.

[0183] Those of ordinary skill in the art can realize that the units and method steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. A professional technician can use different methods to implement the described functions for a specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present disclosure.

[0184] The above embodiments are only used to illustrate the embodiments of the present disclosure, rather than limiting the embodiments of the present disclosure. Those of ordinary skill in the relevant technical field can also make various changes and modifications without departing from the spirit and scope of the embodiments of the present disclosure. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present disclosure. The patent protection scope of the embodiments of the present disclosure should be defined by the claims.

[0185] The term "including" and its variations used herein are open-ended, that is, "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". It should be noted that the concepts such as "first" and "second" mentioned in the embodiments of the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence relationship of the functions performed by these devices, modules or units. It should be noted that the modifications of "one" and "multiple" mentioned in the embodiments of the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless clearly stated otherwise in the context, it should be understood as "one or more".

[0186] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present disclosure, rather than limiting them; although the embodiments of the present disclosure have been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure.

Claims

1. A control method for a display device, comprising: Obtaining a target image including a marker, wherein the state of the marker can be adjusted to present different recognition patterns; Determining, according to the target image, the state of the marker corresponding to the recognition pattern presented by the marker; Controlling the display device based on the state of the marker.

2. The method according to claim 1, wherein, The controlling the display device based on the state of the marker includes: controlling the display content of the display device based on the state of the marker, and including at least one of the following: Controlling the display device to display a display desktop corresponding to the state of the marker; Controlling the display device to display an interface of an application program corresponding to the state of the marker; Controlling the display device to display at least one object corresponding to the state of the marker; Controlling the display device to adjust the attributes of at least one object, where the attributes of the at least one object correspond to the state of the marker.

3. The method according to claim 2, wherein Before the controlling the display device to display at least one object corresponding to the state of the marker, the method further includes: determining at least one of the position and pose of the marker according to the target image; determining the position to be displayed of the object based on at least one of the position and pose of the marker; The controlling the display device to display at least one object corresponding to the state of the marker includes at least one of the following: Displaying at least one object corresponding to the state of the marker at the position to be displayed; Displaying at least one object corresponding to the state of the marker and the position to be displayed at the position to be displayed.

4. The method according to claim 2, wherein The attributes of the object include at least one of: position, pose, motion state, background, style, size.

5. The method according to any one of claims 1-4, wherein, The marker includes at least a first marker and a second marker, and the recognition patterns presented by the first marker and the second marker are different; The controlling the display device based on the state of the target marker includes: correspondingly performing a first control on the display device based on the state of the first marker; Correspondingly performing a second control on the display device based on the second marker.

6. The method according to any one of claims 1-5, wherein, The marker includes: a first body and a second body, the second body is disposed on the first body, and at least one of the position and pose of the second body relative to the first body is variable; wherein, both the first body and the second body are provided with patterns, and the patterns provided on the first body and the second body can be combined into the different recognition patterns.

7. The method according to claim 6, wherein, The second body is removably disposed on the first body, and after the second body is subjected to at least one of sliding, rotating, and repositioning, at least one of the position and pose of the second body relative to the first body is adjusted.

8. The method according to claim 6, wherein A first pattern is provided on the first body, and a second pattern is provided on the second body; The determining, according to the target image, the state of the marker corresponding to the recognition pattern presented by the marker includes: Identifying the relative position between the first pattern and the second pattern in the target image; Determine the state of the marker corresponding to the recognition pattern presented by the marker according to the relative position.

9. The method according to any one of claims 1-8, wherein The controlling the display device based on the state of the marker further includes: Adjust the state of the virtual marker corresponding to the marker in the display screen of the display device.

10. The method according to any one of claims 1-9, wherein, The controlling the display device based on the state of the marker includes at least one of the following: Turning on and off the display screen; Adjusting the size of the display screen; Adjusting the ratio of the display screen; Adjusting the position of the display screen; Adjusting the brightness of the display screen; Switching between 2D and 3D display modes; Locking and unlocking the display screen; Adjusting the sound; Adjusting the light effect; Connecting and disconnecting the network; Switching users; Switching working modes.

11. The method according to any one of claims 1-10, wherein, The display device is a head-mounted display device; the controlling the display device based on the state of the marker includes at least one of the following: Switching between at least two of 0-degree-of-freedom mode, 3-degree-of-freedom mode, and 6-degree-of-freedom mode; Switching between augmented reality mode and virtual reality mode; Adjusting the intensity of ambient light in augmented reality mode; Adjusting the distance of the display screen.

12. A control device for a display device, comprising: An acquisition module, configured to acquire a target image including a marker, wherein the state of the marker can be adjusted to present different recognition patterns; A determination module, configured to determine the state of the marker corresponding to the recognition pattern presented by the marker according to the target image; A control module, configured to control the display device based on the state of the marker.

13. A display system, comprising: A display device; A marker, the state of the marker can be adjusted to present different recognition patterns; A control unit, configured to acquire a target image including the marker, determine the state of the marker corresponding to the recognition pattern presented by the marker according to the target image, and control the display device based on the state of the marker.

14. An electronic device, comprising: A processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory complete communication with each other through the communication bus; The memory is configured to store a computer program; The processor is configured to execute the method according to any one of claims 1-11 by running the computer program stored on the memory.

15. A computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method according to any one of claims 1-11 is implemented.

Images