Method, apparatus, electronic device and storage medium for controlling a display device

Abstract

The method for controlling a display device provided by the embodiments of the present disclosure comprises: receiving a control instruction, wherein the control instruction is used to control at least two display units included in the display device; in response to the control instruction satisfying a first preset condition, sending a selection signal to each display unit to select each display unit to enter a communication state, wherein the selection signal is used to control the communication state of the display unit; and sending the control instruction to each display unit to enable each display unit to synchronously execute the received control instruction.

Description

Technical Field

[0001] This disclosure relates to the field of display technology, and more particularly to a method, apparatus, electronic device, and storage medium for controlling a display device. Background Technology

[0002] A display device may include multiple display units, which can transmit text and images to the display units for display. As an example, the display device may be a head-mounted display, which typically includes two display units corresponding to the user's left and right eyes. A control unit included in the display device communicates with each of the two display units to control their on / off states.

[0003] It is understandable that, depending on the scenario and usage requirements of the display device, the various display units of the display device can cooperate with each other to achieve specific display effects. Therefore, how to improve the display effect of different display units of a display device in different scenarios has become a concern in this field. Summary of the Invention

[0004] This disclosure provides a method, apparatus, electronic device, and storage medium for controlling a display device.

[0005] According to a first aspect of the present disclosure, a method for controlling a display device is provided, the display device including at least two display units, the method comprising: receiving a control instruction, wherein the control instruction is used to control the display units; in response to the control instruction satisfying the first preset condition, sending a selection signal to each of the display units to select each of the display units to enter a communication state, wherein the selection signal is used to control the communication state of the display units; and sending the control instruction to each of the display units to cause each of the display units to synchronously execute the received control instruction.

[0006] According to a second aspect of the present disclosure, a method for controlling a head-mounted display device is provided, the head-mounted display device including at least two display units, the method comprising: determining a left display screen and a right display screen included in the at least two display units; and controlling the left display screen and the right display screen of the head-mounted display device using the method described in the first aspect above.

[0007] According to a third aspect of the present disclosure, an apparatus for controlling a display device is provided, the display device including at least two display units, the apparatus comprising: a receiving module for receiving a control command, wherein the control command is used to control the display units; a first sending module for sending a selection signal to each of the display units in response to the control command satisfying a first preset condition, to select each of the display units to enter a communication state, wherein the selection signal is used to control the communication state of the display units; and a second sending module for sending the control command to each of the display units, so that each of the display units synchronously executes the received control command.

[0008] According to a fourth aspect of the present disclosure, an electronic device is provided, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory is used to store a computer program; and the processor is used to execute the method described in the first or second aspect by running the computer program stored in the memory.

[0009] According to a fifth aspect of the present disclosure, a computer storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the method for controlling a display device described in the first or second aspect above.

[0010] According to a sixth aspect of the present disclosure, a computer program product is provided, including computer instructions that instruct a computing device to perform a method for controlling a display device as described in the first or second aspect above. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings.

[0012] Figure 1 This is a schematic diagram illustrating the display unit refresh process of some optional embodiments of this disclosure;

[0013] Figure 2 This is a schematic diagram illustrating the display unit shutdown process of some optional embodiments of this disclosure;

[0014] Figure 3 This is a schematic diagram illustrating the display unit shutdown process of some other optional embodiments of this disclosure;

[0015] Figure 4This is a schematic diagram illustrating the display unit opening process of some optional embodiments of this disclosure;

[0016] Figure 5 This is a schematic diagram illustrating the display unit opening process of some other optional embodiments of this disclosure;

[0017] Figure 6 This is a schematic diagram of a display device according to some optional embodiments of this disclosure;

[0018] Figure 7 This is a schematic diagram illustrating the display device opening process of some optional embodiments of this disclosure;

[0019] Figure 8 This is a schematic diagram illustrating the display device shutdown process of some optional embodiments of this disclosure;

[0020] Figure 9 This is a flowchart of a method for controlling a display device according to some optional embodiments of this disclosure;

[0021] Figure 10 This is a schematic diagram illustrating the display device opening process of some other optional embodiments of this disclosure;

[0022] Figure 11 This is a schematic diagram illustrating the display device shutdown process of some other optional embodiments of this disclosure;

[0023] Figure 12 This is a schematic diagram illustrating the display device opening process of some optional embodiments of this disclosure;

[0024] Figure 13 This is a flowchart of a method for controlling a display device according to some other optional embodiments of this disclosure;

[0025] Figure 14 This is a schematic diagram of an apparatus for controlling a display device according to some optional embodiments of this disclosure;

[0026] Figure 15 This is a schematic diagram of an electronic device according to some optional embodiments of this disclosure. Detailed Implementation

[0027] To enable those skilled in the art to better understand the technical solutions in the embodiments of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure should fall within the protection scope of this disclosure. It should be understood that the various steps described in the method implementation of this disclosure can be performed in different orders and / or in parallel. Furthermore, the method implementation may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0028] Typically, the refresh rate of a display unit (such as a screen) is the rate at which the screen is refreshed, measured in frames or Hertz (Hz). A display unit shows static images frame by frame. Continuously refreshing multiple static images at a certain refresh rate (usually greater than 24 FPS) creates a dynamic image as perceived by the human eye. In one example, if the display unit's refresh rate is 60 FPS (frames per second), it will refresh the image 60 times per second, or one frame every 1 / 60th of a second.

[0029] In some optional embodiments, the display unit has a brief check period before each refresh. During this check period, the display unit can self-check its switch status register and determine whether to turn the display unit on / off for the next frame based on the value of the switch status register. Figure 1 The diagram shown illustrates the refresh process of the display unit. The display unit checks the refresh time T. N-1 Check the value of the switch status register. Based on the value of the switch status register, determine that it does not need to be turned off and then display the (N-1)th frame of the image. The display unit checks the value during the check time T. N Check the value of the switch status register, and based on the value of the switch status register, determine whether the Nth frame of the image does not need to be turned off before displaying it. The display unit checks the value at time T. N+1 Check the value of the switch status register. Based on the value of the switch status register, determine if it is not necessary to turn off the switch and then display the N+1th frame of the image.

[0030] In some optional embodiments, the value of the switch status register can be written by a control unit, such as the main control chip, via a screen-off command. Therefore, when the control unit, such as the main control chip, updates the display status of the display unit, such as on / off, there is a certain probability that the display status of different display units of the same device will be out of sync.

[0031] As an example, the on / off status of the display unit typically presents the following four scenarios:

[0032] Case 1: such as Figure 2The diagram shown illustrates the process of the display unit turning off. The display unit is in the on state, and the display unit is in the check time T. N Previously, the main control chip issued a screen-off command, and the display unit checked the time T. N When checking the switch status register, it will be found that the switch status register is set to off, and the display unit will immediately turn off, that is, the display unit stops refreshing from the Nth frame.

[0033] Scenario 2: such as Figure 3 The diagram shown illustrates the process of the display unit turning off. The display unit is in the on state, and the display unit is in the check time T. N Afterwards, the main control chip issued a screen-off command, and the display unit checked the time T. N When checking the switch status register, it will be found that the switch status register is set to on. The display unit will not turn off immediately, but will display the Nth frame image normally until the Nth frame. That is, the display unit stops refreshing from the N+1th frame.

[0034] Scenario 3: such as Figure 4 The diagram shown illustrates the process of turning on the display unit. The display unit is in a closed state, and the display unit is in a check time T. N Previously, the display unit received the screen-on command from the main control chip, and during the check time T... N When checking the switch status register, it will be found that the switch status register is set to on, and the display unit will turn on immediately, that is, the display unit will start refreshing from the Nth frame.

[0035] Case 4: Figure 5 The diagram shown illustrates the process of turning on the display unit. The display unit is in a closed state, and the display unit is in a check time T. N After receiving the screen-on command from the main control chip, the display unit checks for time T. N When checking the switch status register, it will be found that the switch status register is set to off, and the display unit will not turn on immediately. The display unit will turn on at frame N+1, that is, the display unit will start refreshing from frame N+1.

[0036] In some applications, display devices may include multiple display units; for example, AR glasses and VR glasses may include two display units. Here, we will take an example where the display device includes two display units. Figure 6 A schematic diagram of a display device according to an embodiment of the present disclosure is shown, such as Figure 6As shown, the display device includes a main control chip 61, a display unit 62, and a display unit 63. The main control chip 61 can communicate with the display units 62 and 63 via a Serial Peripheral Interface (SPI). The main control chip 61 is the master device, and the display units 62 and 63 can be slave devices of the main control chip 61. Optionally, the main control chip 61 can determine the display unit currently being communicated with by pulling down the chip-select (CS) pin of the slave device. The MOSI (Master Output Slave Input) pin of the main control chip 61 can be connected to the MISO (Master Input Slave Output) pins of the display units 62 and 63, respectively. The MISO pin of the main control chip 61 is connected to the MOSI pins of the display units 62 and 63, respectively. The main control chip 61 can send commands to the display units 62 and 63 through the MOSI pins, and can also receive information sent by the display units 62 and 63 through the MISO pins.

[0037] In the scenario of turning the display device on / off, the main control chip 61 can first pull down the CS_0 pin of the display unit 62 to start communication with the display unit 62, and after sending a command to the display unit 62, pull up the CS_0 pin of the display unit 62 to end the communication with the display unit 62. Then, the main control chip 61 can pull down the CS_1 pin of the display unit 63 to start communication with the display unit 63, and after sending a command to the display unit 63, pull up the CS_1 pin of the display unit 63 to end the communication with the display unit 63.

[0038] Therefore, when different display units execute control commands, there may be situations where the display units cannot receive the control commands synchronously, resulting in a certain probability of asynchronous display. Here, we take the example of the main control chip 61 controlling the opening / closing of display units 62 and 63 to illustrate the display situation of each display unit. In this example, display unit 63 usually receives the command later than display unit 62, and there is a probability that display units 62 and 63 will be asynchronous in opening / closing, resulting in the following anomaly:

[0039] Anomaly 1: such as Figure 7 The diagram shows the process of turning on the display device. When the display device turns on from off, if display unit 62 is in situation 3 above and display unit 63 is in situation 4 above, then the screen opening of display unit 62 and display unit 63 is not synchronized, and display unit 63 turns on one frame slower than display unit 62.

[0040] Anomaly 2: such as Figure 8The diagram shows the process of turning off the display device. When the display device turns off, if display unit 62 is in situation 1 and display unit 63 is in situation 2, then the screen turning off of display unit 62 and display unit 63 is not synchronized, and display unit 63 turns off one frame slower than display unit 62.

[0041] To address issues such as the aforementioned anomalies 1 and 2 in display devices, embodiments of this disclosure provide a scheme for controlling display devices that can at least partially resolve this problem.

[0042] The following describes in detail, with reference to the accompanying drawings, the method, apparatus, electronic device, and storage medium for controlling a display device provided in the embodiments of this disclosure.

[0043] Figure 9 A flowchart illustrating a method for controlling a display device according to an embodiment of this disclosure is shown. The display device includes at least two display units. Figure 9 As shown, the method for controlling a display device includes the following steps:

[0044] Step 902: Receive control commands.

[0045] In some optional embodiments, the execution entity of the method for controlling the display device (e.g., the main control chip 61 in the aforementioned embodiments) can send control commands from any suitable module in the display device, such as a processor (e.g., CPU) or a power supply chip. It is understood that the control commands can also be sent by devices or systems outside the display device; there is no single limitation. The control commands can be commands for controlling the display unit, such as a screen-on command or a screen-off command for the display device. Here, the screen-on command is used to control the display device to turn on to start displaying the image, and the screen-off command is used to control the display device to turn off to stop displaying the image.

[0046] Step 904: In response to the control command satisfying the first preset condition, a selection signal is sent to each display unit to select each display unit to enter the communication state.

[0047] In some optional embodiments, after receiving a control command, it can be verified whether the control command meets a first preset condition. If the control command meets the first preset condition, a selection signal can be sent to each display unit to select each display unit, causing each display unit to enter a communication state. After entering the communication state, the display unit can respond to the received command. The aforementioned first preset condition can be used to filter control commands that require parallel communication between display units.

[0048] In one example, if a control command requires synchronous execution across all display units, then the control command is considered to meet the first preset condition. If a command requires asynchronous execution across all display units, then the control command is considered not to meet the first preset condition. It is understandable that the synchronous communication requirements of the display units vary depending on the operating state of the display device. For example, when the display device turns the screen on / off, all display units need to execute the screen-on / screen-off command synchronously. However, when focusing, for example, in a head-mounted display device, the display areas of each screen need to be adjusted asynchronously.

[0049] Optionally, the selection signal can control the state of the chip select pin on the display unit, and the communication state of the display unit can be determined by the state of the chip select pin. For example, when the chip select pin is in the first state, the display unit is in a communication state; when the chip select pin is in the second state, the display unit is in a non-communication state. For instance, the first state of the chip select pin can be a low-level state, and the second state of the chip select pin can be a high-level state. The selection signal can switch the chip select pin of the display unit from the second state to the first state.

[0050] In one example, such as Figure 6 As shown, the default state of chip select pins CS_0 and CS_1 is high. When chip select pins CS_0 and CS_1 are high, display units 62 and 63 are in a non-communication state and will not respond to control commands sent by the main control chip 61. After determining that the control command meets the first preset condition, the main control chip 61 can pull chip select pins CS_0 and CS_1 low. At this time, display units 62 and 63 can enter the communication state from the non-communication state, so that display units 62 and 63 can respond to subsequent control commands sent by the main control chip 61.

[0051] Optionally, when sending selection signals to each display unit, the aforementioned execution entity can simultaneously send selection signals to each display unit, thereby selecting each display unit to enter the communication state simultaneously. This method allows each display unit to receive control commands simultaneously, resulting in higher communication efficiency. Optionally, the aforementioned execution entity can also sequentially send selection signals to each display unit, causing each display unit to enter the communication state; in this case, it is only necessary to ensure that each display unit simultaneously receives control commands.

[0052] Step 906: Send control commands to each display unit so that each display unit executes the received control commands synchronously.

[0053] In some optional embodiments, after sending a selection signal to each display unit in step 904 to put each display unit into a communication state, each display unit can receive the instruction. Therefore, control instructions can be sent to each display unit synchronously so that each display unit can execute the received control instructions synchronously.

[0054] In one example, the display device described above can be a head-mounted display device, which may include two display units. The power-on process of the head-mounted display device is as follows: Figure 10 As shown, when the head-mounted display device turns from off to on, after receiving the screen-on command, the main control chip 61 can pull down the CS_0 pin of display unit 62 and the CS_1 pin of display unit 63, so that both display units 62 and 63 enter the communication state; then the main control chip 61 can synchronously send the screen-on command to display units 62 and 63, ensuring that both display units 62 and 63 can be in the screen inspection time T. N Having received the screen-on command, display units 62 and 63 can both begin displaying the image in the same frame, ensuring synchronized screen-on. This solution avoids the situation where display units 62 and 63 receive the screen-on command in different frame periods, which could occur if they enter communication states one by one. In other words, it prevents the screen-on time of the two display units from differing by one frame, ensuring synchronized screen-on for all display units.

[0055] In another example, the aforementioned display device can be a head-mounted display device, which may include two display units. The power-off process of the head-mounted display device is as follows: Figure 11 As shown, when the display device turns from on to off, after receiving the screen-off command, the main control chip 61 can pull down the CS_0 pin of display unit 62 and the CS_1 pin of display unit 63, so that both display units 62 and 63 enter the communication state; then the main control chip 61 can synchronously send the screen-off command to display units 62 and 63, and both display units 62 and 63 can be in the screen check time T. N Having received the screen-off command, both display units 62 and 63 stop displaying the image at the beginning of the same frame, ensuring synchronized screen-off of display units 62 and 63. This scheme avoids the situation where display units 62 and 63 receive the screen-off command at different frame times, which could occur if they enter the communication state one by one. In other words, it avoids the situation where the screen-off time of the two display units differs by one frame, ensuring that all display units turn off the screen synchronously.

[0056] In this embodiment, if the received control command meets the first preset condition, a selection signal can be sent to each display unit included in the display device to enable each display unit to enter a communication state. Then, a control command is sent to each display unit so that each display unit executes the received control command synchronously. For control commands such as screen-on commands and screen-off commands that require synchronous execution by each display unit, each display unit can first enter a communication state, and then the control command can be sent to each display unit synchronously. This allows each display unit to execute the control command synchronously, thereby enabling each display unit to synchronously execute control commands such as opening or closing, ensuring a good user experience for the display device.

[0057] Optionally, if the control command meets the first preset condition, after sending the selection signal to each display unit, only one control command needs to be sent, and each display unit can receive the control command. This scheme greatly shortens the communication process between different units, reduces the time for each display unit to execute the control command, and enables faster control command response. At the hardware level, the implementation of this scheme does not affect the SPI design architecture, and synchronous control of multiple display units can be achieved without modifying the chip select pin.

[0058] In some possible implementations, if the received control command does not meet the first preset condition, it can be verified whether the control command meets the second preset condition. If the control command meets the second preset condition, selection signals can be sent to each display unit in sequence to select each display unit sequentially, causing each display unit to enter the communication state in sequence. After a display unit enters the communication state, a control command can be sent to that display unit to cause it to execute the received control command.

[0059] Understandably, if a control instruction requires each display unit to execute it sequentially, meaning each display unit needs to execute the control instruction asynchronously, then the control instruction can be considered to satisfy the second preset condition. For example, when performing pixel offset calibration on a display screen, the distance and direction of the display area movement can differ between the two screens during calibration. In this case, each display screen needs to execute the pixel offset calibration instruction separately, so the pixel offset calibration instruction is a control instruction that satisfies the second preset condition.

[0060] In one example, such as Figure 6As shown, after receiving a control command that meets the second preset condition, the main control chip 61 first pulls the chip select pin CS_0 low to a low level, causing the display unit 62 to enter the communication state while the display unit 63 remains in the non-communication state. Then, the main control chip 61 sends a control command, which is only responded to by the display unit 62. The display unit 62 then executes the received control command, and the main control chip 61 pulls the chip select pin CS_0 high to complete the control of the display unit 62. After completing the control of the display unit 62, the main control chip 61 pulls the chip select pin CS_1 low to a low level, causing the display unit 63 to enter the communication state while the display unit 62 remains in the non-communication state. Then, the main control chip 61 sends another control command, which is only responded to by the display unit 63. The display unit 63 then executes the received control command, and the main control chip 61 pulls the chip select pin CS_1 high to complete the control of the display unit 63.

[0061] In this embodiment, if the control command meets a first preset condition, causing each display unit to enter a communication state, the control command is synchronously sent to each display unit, enabling each display unit to execute the control command synchronously. If the control command meets a second preset condition, causing each display unit to sequentially enter a communication state, the control command is sent to that display unit after it enters the communication state, enabling each display unit to execute the control command asynchronously. Therefore, this solution can satisfy both scenarios where different display units execute control commands synchronously and scenarios where different display units execute control commands asynchronously, thus meeting the needs of different display scenarios for display devices.

[0062] In some possible implementations, the aforementioned execution entity can receive multiple control instructions for controlling different display units, and each control instruction can be different. After sending a selection signal to a display unit to put it into a communication state, the control instruction for controlling that display unit can be determined from the received multiple control instructions, and then the determined control instruction is sent to the display unit so that the display unit can execute the received control instruction. Optionally, when multiple control instructions for controlling different display units are received, if the multiple control instructions meet a second preset condition, then these multiple control instructions are sent to the corresponding display devices in a certain order so that each display device executes the corresponding control instruction in sequence. When multiple control instructions are received, the data to be sent for the control instructions can be determined according to the corresponding display unit. For example, the control instruction for display unit 62 can be sent first, followed by the control instruction for display unit 63, or the control instructions can be sent in a random order. This embodiment of the present disclosure does not limit the order in which the control instructions are sent when multiple control instructions are received.

[0063] In one example, such as Figure 6As shown, control command 1 and control command 2 can be received simultaneously. Control command 1 can be used to control display unit 62, and control command 2 can be used to control display unit 63. When control command 1 and control command 2 meet the second preset condition, the main control chip 61 can pull the chip select pin CS_0 low to a low level, causing display unit 62 to enter the communication state, while display unit 63 is in the non-communication state. Then, the main control chip 61 sends control command 1. Control command 1 will only be responded to by display unit 62, while display unit 63 will not respond to control command 1. Accordingly, display unit 62 will execute control command 1, while display unit 63 will not execute control command 1. After sending control command 1, the main control chip 61 pulls the chip select pin CS_0 high to a high level. After completing the sending of control command 1, the main control chip 61 can pull the chip select pin CS_1 low to a low level, causing display unit 63 to enter the communication state, while display unit 62 is in the non-communication state. Then, the main control chip 61 can issue control command 2. Control command 2 will only be responded to by display unit 63, while display unit 62 will not respond to control command 2. Accordingly, display unit 63 will execute control command 2, while display unit 62 will not execute control command 2. After issuing control command 2, the main control chip 61 pulls the chip select pin CS_1 high. Display units 62 and 63 then complete the execution of the corresponding commands.

[0064] In some possible implementations, the aforementioned execution entity can receive a control command that meets a second preset condition, and then sequentially send selection signals to each display unit, selecting each display unit to enter the communication state. For any display unit in the communication state, the aforementioned execution entity can send a command to that display unit to be executed. It is understood that after each display unit sequentially enters the communication state and receives the control command to be executed, it can execute the received control command accordingly.

[0065] As an example, the aforementioned display device can be a head-mounted display device, which may include two displays. When the executing entity receives an interpupillary distance adjustment control command from the head-mounted display device that meets the second preset condition, it can send a selection signal to the display unit corresponding to the left eye to put it into a communication state, and then send a control command to the display unit corresponding to the left eye, for example, to move the display area to the right by x pixels, so that the display unit corresponding to the left eye can execute the control command; then, it can put the display unit corresponding to the right eye into a communication state, and send a control command to the display unit corresponding to the right eye, for example, to move the display area to the right by y pixels, so that the display unit corresponding to the right eye can execute the control command. After sequentially controlling the display units corresponding to the left and right eyes of the head-mounted display device to adjust their respective effective display areas, the interpupillary distance adjustment of the head-mounted display device can be achieved.

[0066] In the scheme disclosed in the embodiment, when a control command that meets the second preset condition is received, the display unit corresponding to each control command can be determined sequentially, and then each control command can be sent to the corresponding display unit in sequence. This ensures that each control command can be accurately sent to the corresponding display unit and executed by the corresponding display unit, and will not be executed by other non-corresponding display units, thereby ensuring the reliability of the control of the display device. It is understood that the scheme disclosed in this embodiment allows each display unit to execute the corresponding command synchronously or asynchronously under different types of control commands, meeting the display needs of the display device in different scenarios, and further improving the display effect of the display device.

[0067] In some possible implementations, a control command can be sent to the display unit, causing the display unit to execute the received control command. In response to the display unit completing the execution of the received control command, the display unit can be controlled to terminate the communication.

[0068] Optionally, after the display unit executes the received control command, a deselect signal can be sent to the display unit to cause it to enter a non-communication state, i.e., exit the communication state. In the non-communication state, the display unit does not respond to control commands issued by the main control chip.

[0069] Understandably, just as the select signal controls the state of the chip select pin on the display unit, the deselect signal can also control the state of the chip select pin on the display unit. The select signal can switch the state of the chip select pin from the second state to the first state, and the deselect signal can switch the state of the chip select pin from the first state to the second state. For example, the select signal can pull the chip select pin from a high level to a low level, and the deselect signal can pull the chip select pin from a low level to a high level. When the chip select pin is low, the display unit is in communication mode; when the chip select pin is high, the display unit is in non-communication mode.

[0070] In one example, such as Figure 6 As shown, the default state of the chip select pins CS_0 and CS_1 is high. When the chip select pins CS_0 and CS_1 are high, the display unit 62 and the display unit 63 can be in a non-communication state and will not respond to the instructions sent by the main control chip 61.

[0071] If the main control chip 61 needs to send a control command to the display unit 62 independently, the main control chip 61 pulls the chip select pin CS_0 low (while the chip select pin CS_1 is high), and then sends the control command to the display unit 62. After the display unit 62 executes the received control command, the main control chip 61 can pull the chip select pin CS_0 high.

[0072] If the main control chip 61 needs to send a control command to the display unit 63 independently, the main control chip 61 pulls the chip select pin CS_1 low (while the chip select pin CS_0 is high), and then sends the control command to the display unit 63. After the display unit 63 executes the received control command, the main control chip 61 pulls the chip select pin CS_1 high.

[0073] If the main control chip 61 needs to send control commands to display units 62 and 63 synchronously, the main control chip 61 pulls both chip select pins CS_0 and CS_1 low to a low level before issuing control commands to display units 62 and 63. After display units 62 and 63 execute the received control commands, the main control chip 61 pulls both chip select pins CS_0 and CS_1 high to a high level.

[0074] In this embodiment, after sending the control commands to be executed by each display unit to the corresponding display unit, the display unit can be controlled to terminate communication. For any display unit, each time a control command needs to be sent to that display unit, that display unit must first be put into a communication state, while other display units are in a non-communication state. This avoids the situation where a display unit erroneously responds to control commands sent to other display units, ensuring the accuracy of control over the display device. At the same time, it allows each display unit to asynchronously execute control commands, ensuring that the display units can achieve flexible application scenarios.

[0075] In some possible implementations, if the received control command meets the first preset condition, the time for each display unit to receive the control command can be estimated. If the estimated times for any two display units are within different frame time periods, a selection signal can be sent to each display unit to select each display unit to enter the communication state.

[0076] The estimated time for each display unit to receive control commands can refer to the estimated time when each display unit receives the control command if it is sent asynchronously. This estimation can be based on factors such as the operating status of the display unit, the available bandwidth of the bus used to send control commands, and the amount of data in the control command.

[0077] Optionally, after estimating the time when each display unit receives the control command, if the estimated times for any two display units fall within different frame time periods of the display units, a selection signal can be sent to each display unit first to put them into a communication state. Then, control commands can be sent to each display unit synchronously to ensure that each display unit can execute the control commands synchronously. This implementation method enables each display unit to execute the corresponding control commands synchronously.

[0078] Optionally, if the estimated time for each display unit falls within the same image frame time period of the display unit, it is not necessary to send selection signals to each display unit for synchronous display first. Instead, selection signals and control commands can be sent sequentially to one display unit before sending selection signals and control commands to the next display unit. Therefore, even in asynchronous situations, each display unit can still control the same display to complete the same control command within the same image frame time range, ensuring the consistency of display across all display units while reducing the frequency of synchronous and asynchronous switching.

[0079] In one example, the screen-on command meets a first preset condition. This is achieved by estimating the time it takes for display units 62 and 63 to receive the screen-on command. Figure 7 As shown, the display unit 62 is determined to be in the inspection time T. N Previously, a screen-on command was received, and display unit 63 checked the time T. N Subsequently, a screen-on command is received, indicating that the estimated times for display units 62 and 63 fall within two different frame periods. Therefore, a selection signal needs to be sent to display units 62 and 63 first to put them into communication mode, and then a screen-on command is sent synchronously to display units 62 and 63 to enable them to turn on their screens simultaneously. The specific process is as follows: Figure 10 As shown.

[0080] In another example, the screen-on command meets the first preset condition, and the time when display unit 62 and display unit 63 receive the screen-on command is estimated, such as... Figure 12 As shown, it is determined that both display unit 62 and display unit 63 are within the inspection time T. N If a screen-on command is received previously, meaning that the estimated times for display unit 62 and display unit 63 are within the same frame period, then a selection signal and a screen-on command can be sent to display unit 62 in sequence first, and then a selection signal and a screen-on command can be sent to display unit 63 in sequence, which can also make display unit 62 and display unit 63 turn on the screen synchronously.

[0081] In this embodiment, when the control command meets the first preset condition, the time for each display unit to receive the control command can be estimated. If the estimated times for any two display units are within different frame time periods, a selection signal is first sent to each display unit, and then the control command is sent synchronously to each display unit to ensure that each display unit can execute the control command synchronously. If the estimated times for each display unit are within the same frame time period, it is not necessary to send a selection signal to each display unit first. The control command can be sent to each display unit sequentially in an asynchronous manner. While ensuring that each display unit can execute the control command synchronously, the control logic for the display units can be simplified by sending the control command asynchronously.

[0082] Figure 13 A flowchart illustrating a method for controlling a display device according to another embodiment of this disclosure is shown. This method can be executed by a main control chip in a head-mounted display device, which includes a left display screen and a right display screen. (Refer to...) Figure 6 The display device shown may have a left display screen (display unit 62) and a right display screen (display unit 63). It is understood that the main control chip in the head-mounted display device can act as the execution entity to perform the display control methods disclosed in the above embodiments. Figure 13 As shown, the method for controlling a display device includes the following steps:

[0083] Step 1302: Receive control commands for the left and right display screens;

[0084] Step 1304: In response to the control command satisfying the first preset condition, send chip select signals to the left display screen and the right display screen to enable the left display screen and the right display screen to enter the communication state, wherein the chip select signal is used to control the communication state of the left display screen and the right display screen.

[0085] Step 1306: Send control commands to the left and right displays to cause them to execute the received control commands.

[0086] In this embodiment, if the received control command meets the first preset condition, a chip select signal can be sent to the left and right displays to put them into a communication state. Then, a control command is sent to the left and right displays to ensure they execute the received control command synchronously. For control commands such as screen-on or screen-off commands that require synchronous execution by the left and right displays, both displays can first enter a communication state, and then the control command can be sent synchronously to both displays. This allows the left and right displays to execute the control command synchronously, achieving synchronous opening or closing of the displays and ensuring a better user experience for the head-mounted display device. When the control command meets the first preset condition, after sending the selection signal to the left and right displays, only one control command needs to be sent, and both displays can receive the command. This reduces unnecessary communication processes and the execution time of the control command, resulting in faster response times. At the hardware level, the SPI design architecture is not affected, and no hardware modifications to the chip select pins are required to achieve synchronous control of the left and right displays.

[0087] It should be noted that the method for controlling a head-mounted display device in this embodiment is based on the method for controlling a display device in the foregoing embodiments. Therefore, the method for controlling a head-mounted display device in this embodiment is a specific application of the method for controlling a display device in the foregoing embodiments. The chip select signal in this embodiment can be the same as the selection signal in the foregoing embodiments. The method for controlling a head-mounted display device in this embodiment can be referred to the description of the method for controlling a display device in the foregoing embodiments, and will not be repeated here.

[0088] Figure 14 This is a schematic diagram of an apparatus for controlling a display device according to an embodiment of the present disclosure. The display device includes at least two display units. Figure 14 As shown, the device 140 for controlling the display device includes:

[0089] The receiving module 141 is used to receive control commands, wherein the control commands are used to control the display unit;

[0090] The first sending module 142 is used to send a selection signal to each display unit in response to the control command meeting the first preset condition, so as to select each display unit to enter the communication state, wherein the selection signal is used to control the communication state of the display unit;

[0091] The second sending module 143 is used to send control commands to each display unit so that each display unit executes the received control commands synchronously.

[0092] In this embodiment, after receiving the control command, if the control command meets the first preset condition, the first sending module 142 can send a selection signal to each display unit included in the display device, causing each display unit to enter a communication state. Then, the second sending module 143 can send the control command to each display unit so that each display unit can synchronously execute the received control command. For control commands such as screen-on commands and screen-off commands that require synchronous execution by each display unit, each display unit can first enter a communication state, and then the control command can be synchronously sent to each display unit so that each display unit can synchronously execute the control command. This allows each display unit to synchronously execute control commands such as opening or closing, ensuring a good user experience for the display device.

[0093] In one possible implementation, the first sending module 142 may, in response to the control command satisfying the second preset condition, sequentially send selection signals to at least two display units to sequentially select each display unit to enter the communication state. The second sending module 143 may, after the display unit enters the communication state, send a control command to the display unit so that the display unit executes the received control command.

[0094] In one possible implementation, the receiving module 141 can receive at least two control instructions for controlling each display unit, and the second sending module 143 can determine the control instruction for controlling the display unit from the at least two control instructions and send the determined control instruction to the display unit so that the display unit executes the received control instruction.

[0095] In one possible implementation, the first sending module 141 may send control instructions to each display unit via the second sending module 143, so that each display unit executes the received control instructions, and then, for at least two display units, control the display unit to terminate communication in response to determining that the display unit has completed executing the control instructions.

[0096] In one possible implementation, the first sending module 141 may, in response to the control command satisfying a first preset condition, estimate the time for any two of the at least two display units to receive the control command sequentially; if the two estimated times are located in different frame time periods of the display units, send a selection signal to each display unit to select each display unit to enter the communication state.

[0097] It should be noted that the apparatus 140 for controlling a display device provided in this disclosure is based on the same inventive concept as the method for controlling a display device provided in the foregoing embodiments. It corresponds to the respective method for controlling a display device in the foregoing multiple method embodiments and has the beneficial effects of the corresponding method embodiments for controlling a display device; therefore, it will not be described again here. Furthermore, the implementation of each module in the apparatus 140 for controlling a display device provided in this disclosure can refer to the description of the corresponding part in the foregoing method embodiments for controlling a display device, and will not be described again here.

[0098] Figure 15 This is a schematic block diagram of an electronic device provided in an embodiment of this disclosure. Specific embodiments of this disclosure do not limit the specific implementation of the electronic device. Figure 15 As shown, the electronic device may include: a processor 1502, a communications interface 1504, a memory 1506, and a communications bus 1508. Wherein:

[0099] The processor 1502, communication interface 1504, and memory 1506 communicate with each other via communication bus 1508.

[0100] Communication interface 1504 is used to communicate with other electronic devices or servers.

[0101] The processor 1502 is used to execute program 1510, specifically to perform the relevant steps in any of the aforementioned method embodiments for controlling the display device.

[0102] Specifically, program 1510 may include program code that includes computer operation instructions.

[0103] The processor 1502 may be a CPU, an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of this disclosure. The smart device may include one or more processors of the same type, such as one or more CPUs; or it may include processors of different types, such as one or more CPUs and one or more ASICs.

[0104] RISC-V is an open-source instruction set architecture based on the Reduced Instruction Set Computing (RISC) principle. It can be applied to various aspects of microcontrollers and FPGA chips, specifically in areas such as IoT security, industrial control, mobile phones, and personal computers. Because its design considers small size, speed, and low power consumption, it is particularly suitable for modern computing devices such as warehouse-scale cloud computers, high-end mobile phones, and tiny embedded systems. With the rise of AIoT (Artificial Intelligence of Things), the RISC-V instruction set architecture is receiving increasing attention and support and is expected to become the next generation of widely used CPU architecture.

[0105] The computer operation instructions in this embodiment can be computer operation instructions based on the RISC-V instruction set architecture. Correspondingly, the processor 1502 can be designed based on the RISC-V instruction set. Specifically, the processor chip in the electronic device provided in this embodiment can be a chip designed using the RISC-V instruction set. This chip can execute executable code based on the configured instructions, thereby implementing the method for controlling the display device in the above embodiment.

[0106] Memory 1506 is used to store program 1510. Memory 1506 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0107] Specifically, program 1510 can be used to cause processor 1502 to execute the method for controlling a display device in any of the foregoing embodiments.

[0108] The specific implementation of each step in program 1510 can be found in the corresponding steps and modules described in any of the foregoing method embodiments for controlling a display device, and will not be repeated here. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the devices and modules described above can be referred to the corresponding process descriptions in the foregoing method embodiments, and will not be repeated here.

[0109] In the electronic device of this disclosure embodiment, if the received control command meets the first preset condition, a selection signal can be sent to each display unit included in the display device to enable each display unit to enter a communication state. Then, a control command is sent to each display unit so that each display unit synchronously executes the received control command. For control commands such as screen-on commands and screen-off commands that require synchronous execution by each display unit, each display unit can first enter a communication state, and then the control command can be sent to each display unit synchronously so that each display unit can synchronously execute the control command. This allows each display unit to synchronously execute control commands such as opening or closing, ensuring a good user experience for the display device.

[0110] This disclosure also provides a computer-readable storage medium storing instructions for causing a machine to perform the methods for controlling a display device as described herein. Specifically, a system or apparatus equipped with a storage medium storing software program code that implements the functions of any of the embodiments described above, and enabling the computer (or CPU or MPU) of the system or apparatus to read and execute the program code stored in the storage medium.

[0111] In this case, the program code read from the storage medium can itself implement the function of any of the above embodiments, and therefore the program code and the storage medium storing the program code constitute a part of this disclosure.

[0112] Examples of storage media used to provide program code include floppy disks, hard disks, magneto-optical disks, optical disks (such as CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD+RW), magnetic tapes, non-volatile memory cards, and ROMs. Alternatively, program code can be downloaded from a server computer via a communication network.

[0113] This disclosure also provides a computer program product, including computer instructions that instruct a computing device to perform any corresponding operation in the above-described plurality of method embodiments.

[0114] It should be noted that, depending on the implementation needs, the various components / steps described in the embodiments of this disclosure can be broken down into more components / steps, or two or more components / steps or parts of the operation of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of this disclosure.

[0115] The methods described above according to embodiments of this disclosure can be implemented in hardware, firmware, or as software or computer code that can be stored in a recording medium (such as a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code originally stored on a remote recording medium or a non-transitory machine-readable medium and subsequently stored on a local recording medium, downloaded over a network. Thus, the methods described herein can be processed by software stored on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an ASIC or FPGA). It is understood that the computer, processor, microprocessor controller, or programmable hardware includes storage components (e.g., RAM, ROM, flash memory, etc.) capable of storing or receiving software or computer code that, when accessed and executed by the computer, processor, or hardware, implements the methods described herein. Furthermore, when a general-purpose computer accesses code used to implement the methods shown herein, the execution of the code transforms the general-purpose computer into a dedicated computer for executing the methods shown herein.

[0116] It should be noted that the user-related information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to sample data used for training the model, data used for analysis, stored data, displayed data, etc.) involved in the embodiments of this disclosure are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0117] Those skilled in the art will recognize that the units and method steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for specific applications, but such implementations should not be considered beyond the scope of the embodiments disclosed herein.

[0118] The above embodiments are only used to illustrate the embodiments of this disclosure, and are not intended to limit the embodiments of this disclosure. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of this disclosure. Therefore, all equivalent technical solutions also fall within the scope of the embodiments of this disclosure, and the patent protection scope of the embodiments of this disclosure should be defined by the claims.

Claims

1. A method for controlling a display device, the display device comprising at least two display units, the method comprising: Receive control instructions, wherein the control instructions are used to control the display unit; In response to the control command satisfying a first preset condition, a selection signal is sent to each of the display units to select each of the display units to enter a communication state, wherein the selection signal is used to control the communication state of the display unit; The control command is sent to each of the display units so that each of the display units executes the received control command synchronously.

2. The method according to claim 1, wherein, The method further includes: In response to the control command satisfying the second preset condition, the selection signal is sent sequentially to the at least two display units to select each display unit in turn to enter the communication state. After the display unit enters the communication state, the control command is sent to the display unit so that the display unit executes the received control command.

3. The method according to claim 2, wherein, The receiving control instructions include: receiving at least two control instructions for controlling each of the display units; Sending the control command to the display unit to cause the display unit to execute the received control command includes: determining a control command for controlling the display unit from the at least two control commands, and sending the determined control command to the display unit to cause the display unit to execute the received control command.

4. The method according to claim 1, wherein, After sending the control command to each of the display units to cause each of the display units to execute the received control command, the method further includes: For one of the at least two display units, in response to determining that the display unit has completed executing the control command, the display unit is controlled to terminate communication.

5. The method according to any one of claims 1-4, wherein, The step of responding to the control command satisfying a first preset condition by sending a selection signal to each of the display units to select each of the display units to enter a communication state includes: In response to the control command satisfying a first preset condition, the time for the two display units to receive the control command sequentially is estimated for any two of the at least two display units. If the two estimated times are located within different frame periods of the display unit, the selection signal is sent to each of the display units to select each of the display units to enter the communication state.

6. A method for controlling a head-mounted display device, the head-mounted display device comprising at least two display units, the method comprising: It is determined that the at least two display units include a left display screen and a right display screen; The left and right displays of the head-mounted display device are controlled using the method described in any one of claims 1-5.

7. An apparatus for controlling a display device, the display device comprising at least two display units, the apparatus comprising: A receiving module is used to receive control commands, wherein the control commands are used to control the display unit; The first sending module is configured to send a selection signal to each of the display units in response to the control command satisfying a first preset condition, so as to select each of the display units to enter the communication state, wherein the selection signal is used to control the communication state of the display units; The second sending module is used to send the control command to each of the display units so that each of the display units executes the received control command synchronously.

8. An electronic device, comprising: The processor, the communication interface, the memory, and the communication bus are provided, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus. The memory is used to store computer programs; The processor is configured to perform the method of any one of claims 1-6 by running the computer program stored in the memory.

9. A computer storage medium having a computer program stored thereon, which, when executed by a processor, implements the method as described in any one of claims 1-6.

10. A computer program product having a computer program stored thereon, which, when executed by a processor, implements the method as described in any one of claims 1-6.

Images