Information display control method and device, near-to-eye display equipment and storage medium

Abstract

The embodiment of the invention provides an information display control method and device, near-to-eye display equipment and a storage medium, and the method comprises the steps: obtaining first information displayed by terminal equipment connected with the near-to-eye display equipment, and displaying second information in the near-to-eye display equipment according to the first information; and in response to the detected control instruction for controlling the second information, sending the control instruction to the terminal equipment, so that the terminal equipment controls the first information according to the control instruction. The information displayed by the terminal equipment is controlled through the near-eye display equipment, the problem that in some scenes, if a user is too far away from the terminal equipment, the content displayed by the terminal equipment is inconvenient to control is solved, the flexibility of cross-equipment control between the near-eye display equipment and the terminal equipment is improved, and the user experience is improved. The flexibility of cross-device control of the terminal device through the near-to-eye display device is improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to an information display control method, device, near-eye display device and storage medium. Background Art

[0002] At present, the interaction between near-eye display devices (such as AR glasses, VR glasses, etc.) and terminal devices is relatively simple. For example, when a near-eye display device is connected to a mobile phone, you can answer calls on the mobile phone or play music on the mobile phone. However, for the information displayed by the terminal device, no solution has been found that can be flexibly controlled by the near-eye display device, that is, for the information displayed by the terminal device, the flexibility of cross-device control between the near-eye display device and the terminal device is low. Summary of the invention

[0003] Embodiments of the present invention provide an information display control method, apparatus, near-eye display device, and storage medium, aiming to improve the flexibility of cross-device control of terminal devices through near-eye display devices.

[0004] In a first aspect, an embodiment of the present invention provides an information display control method, the method being applied to a near-eye display device, the method comprising:

[0005] Acquire first information displayed by a terminal device connected to the near-eye display device, and display second information in the near-eye display device according to the first information;

[0006] In response to detecting a control instruction for controlling the second information, the control instruction is sent to the terminal device, so that the terminal device controls the first information according to the control instruction.

[0007] In a second aspect, an embodiment of the present invention provides an information display control method, which is applied to a near-eye display device, and the method includes:

[0008] An information acquisition module, used to acquire first information displayed by a terminal device connected to the near-eye display device;

[0009] an information display module, configured to display second information in the near-eye display device according to the first information;

[0010] The instruction sending module is used for sending the control instruction to the terminal device in response to detecting the control instruction for controlling the second information, so that the terminal device controls the first information according to the control instruction.

[0011] In the third aspect, an embodiment of the invention further provides a near-eye display device, comprising a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for realizing connection and communication between the processor and the memory, wherein when the computer program is executed by the processor, the information display control method as described in the first aspect is implemented.

[0012] In a fourth aspect, an embodiment of the present invention further provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the information display control method as described in the first aspect.

[0013] Embodiments of the present invention provide an information display control method, apparatus, near-eye display device and storage medium. The embodiments of the present application obtain first information displayed by a terminal device connected to the near-eye display device, and display second information in the near-eye display device according to the first information; in response to detecting a control instruction for controlling the second information, the control instruction is sent to the terminal device, so that the terminal device controls the first information according to the control instruction, thereby realizing the control of the information displayed by the terminal device through the near-eye display device, solving the problem that in certain scenarios, such as when the user is too far away from the terminal device and it is inconvenient to control the content displayed by the terminal device, and improving the flexibility of cross-device control between the near-eye display device and the terminal device, that is, improving the flexibility of cross-device control of the terminal device through the near-eye display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0015] Figure 1 is a schematic block diagram of the structure of a near-eye display device provided by an embodiment of the present invention;

[0016] Figure 2 is a flow chart of an information display control method provided by an embodiment of the present invention;

[0017] Figure 3 is another flow chart of an information display control method provided by an embodiment of the present invention;

[0018] Figure 4 It is a schematic block diagram of the structure of an information display control device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0019] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0021] It should be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0022] The embodiments of the present invention provide an information display control method, device, near-eye display device and storage medium. The embodiments of the present invention provide a technical solution.

[0023] In an embodiment of the present invention, the near-eye display device may be AR (Augmented Reality) glasses, an AR helmet, VR (Virtual Reality) glasses, or the like.

[0024] Some embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0025] Figure 1 It is a schematic block diagram of the structure of a near-eye display device provided by an embodiment of the present invention.

[0026] like Figure 1 As shown, the near-eye display device 100 includes a processor 101 and a memory 102 , and the processor 101 and the memory 102 are connected via a bus 103 , such as an I2C (Inter-integrated Circuit) bus.

[0027] Specifically, the processor 101 is used to provide computing and control capabilities to support the operation of the entire near-eye display device 100. The processor 101 may be a central processing unit (CPU), and the processor 101 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0028] Specifically, the memory 102 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.

[0029] Those skilled in the art will understand that Figure 1 The structure shown in the figure is merely a block diagram of a partial structure related to the embodiment of the present invention, and does not constitute a limitation on the near-eye display device to which the embodiment of the present invention is applied. The specific near-eye display device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0030] The processor 101 is used to run a computer program stored in the memory 102. The computer program can be set in a near-eye display device. When the near-eye display device executes the computer program, it implements any one of the information display control methods provided in the embodiments of the present invention.

[0031] In one embodiment, the processor is used to run a computer program stored in the memory, and implements the following steps when executing the computer program:

[0032] Acquire first information displayed by a terminal device connected to the near-eye display device, and display second information in the near-eye display device according to the first information;

[0033] In response to detecting a control instruction for controlling the second information, the control instruction is sent to the terminal device, so that the terminal device controls the first information according to the control instruction.

[0034] In one embodiment, if the control instruction is a scaling instruction, the step of sending the control instruction to the terminal device in response to detecting the control instruction for controlling the second information, so that the terminal device controls the first information according to the control instruction, includes:

[0035] In response to detecting a scaling instruction for scaling the second information, determining an instruction type corresponding to the scaling instruction and first position information corresponding to the scaling instruction;

[0036] The instruction type and the first position information are sent to the terminal device, so that the terminal device can scale the first information based on the instruction type and the first position information.

[0037] In one embodiment, if the control instruction is an interface switching instruction, the step of sending the control instruction to the terminal device in response to detecting the control instruction for controlling the second information, so that the terminal device controls the first information according to the control instruction, includes:

[0038] In response to detecting an interface switching instruction to switch the second information, determining whether the second information includes all of the first information;

[0039] If the second information includes all the first information, the interface switching instruction is sent to the terminal device, so that the terminal device switches the display interface of the first information according to the interface switching instruction.

[0040] In one embodiment, the processor is further configured to implement the following steps when executing the computer program:

[0041] If the second information only includes part of the first information, then when the display information on the display interface of the near-eye display device meets the preset conditions, the display interface of the second information is switched according to the interface switching instruction to display other first information to be displayed in the display interface of the near-eye display device, wherein the first information displayed by the terminal device remains unchanged.

[0042] In one embodiment, in response to detecting a control instruction for controlling the second information, the step of sending the control instruction to the terminal device so that the terminal device controls the first information according to the control instruction includes:

[0043] In response to detecting a control instruction for controlling the second information, determining whether there are at least two display windows in a current display interface of the near-eye display device;

[0044] If there are at least two display windows, determining whether the control instruction is an instruction to control all display windows or part of the display windows;

[0045] If the control instruction is an instruction for controlling part of the display window, determining that the control instruction corresponds to a target display window to be controlled, and determining whether the target display window exists in the display interface of the terminal device;

[0046] If the target display window exists in the display interface of the terminal device, the control instruction is sent to the terminal device, so that the terminal device controls the first information displayed in the target display window according to the control instruction.

[0047] In one embodiment, before the step of acquiring first information displayed by a terminal device connected to the near-eye display device and displaying second information in the near-eye display device according to the first information, the processor is further configured to implement the following steps when executing the computer program:

[0048] Determining a scene in which the near-eye display device is currently located;

[0049] If the scene is a preset scene, the step of acquiring the first information displayed by the terminal device connected to the near-eye display device and displaying the second information in the near-eye display device according to the first information is performed.

[0050] In one embodiment, after the step of acquiring first information displayed by a terminal device connected to the near-eye display device, and displaying second information in the near-eye display device according to the first information, the processor is further configured to implement the following steps when executing the computer program:

[0051] In response to receiving a parameter adjustment instruction for adjusting the display parameters of the second information, the display parameters of the second information are adjusted according to the parameter adjustment instruction to obtain the adjusted display parameters, and the second information is controlled according to the adjusted display parameters, wherein the display parameters of the first information displayed by the terminal device remain unchanged.

[0052] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the near-eye display device described above can refer to the corresponding process in the following information display control method embodiment, and will not be repeated here.

[0053] The following will be combined Figure 1 The information display control method provided by the embodiment of the present invention is described in detail in the near-eye display device. It should be noted that Figure 1 The near-eye display device is only used to explain the information display control method provided by the embodiment of the present invention, but does not constitute a limitation on the application scenario of the information display control method provided by the embodiment of the present invention.

[0054] See also Figure 2 , Figure 2 It is a flow chart of an information display control method provided by an embodiment of the present invention.

[0055] like Figure 2 As shown, the information display control method is applied to a near-eye display device, and the information display control method includes step S101 and step S102.

[0056] Step S101: Acquire first information displayed by a terminal device connected to the near-eye display device, and display second information in the near-eye display device according to the first information.

[0057] In this embodiment, the terminal device may be a mobile phone, a personal computer, a projector or other device. The terminal device may establish a communication connection with the near-eye display device through Bluetooth, WiFi or the like. After the near-eye display device and the terminal device establish a communication connection, the near-eye display device may actively or passively obtain the first information displayed on the display interface of the terminal device. Among them, the first information may be information such as text, pictures and / or videos displayed on the display interface of the terminal device. When the near-eye display device actively obtains the first information, the near-eye display device will send an information acquisition instruction to the terminal device, and when the terminal device receives the information acquisition instruction, it will send the first information displayed on its display interface to the near-eye display device; when the near-eye display device passively obtains the first information, after the near-eye display device is connected to the terminal device, the terminal device will actively send the first information displayed on its display interface to the near-eye display device.

[0058] In one embodiment, the display interface of the terminal device may also be anchored in the near-eye display device, so that the near-eye display device can obtain the first information.

[0059] When the near-eye display device obtains the first information, the near-eye display device will display the second information in its display interface according to the first information. It can be understood that the first information is the content displayed on the display interface of the terminal device, and the second information is the content displayed on the display interface of the near-eye display device. Among them, the first information and the second information may be exactly the same or not exactly the same, and the second information includes at least part of the first information. The amount of data contained in the second information may be equal to the amount of data contained in the first information, or it may be less than the amount of data contained in the first information, or it may be greater than the amount of data contained in the first information, that is, the second information may include non-first information in addition to the first information.

[0060] What the second information includes depends on the display parameters of the display interface of the near-eye display device and the display content currently displayed on its display interface, wherein the display parameters are the length and width of the display interface, as well as the display size, paragraphs, character spacing, etc. of the characters. The display parameters can be used to determine the amount of data that can be displayed on the current display interface of the near-eye display device. For example, when the display interface of the near-eye display device currently does not display other content, and based on its display parameters, it is determined that all the first information can be displayed on its display interface, the content of the second information and the first information are exactly the same. When the display interface of the near-eye display device currently does not display other content, but based on the display parameters, it is determined that only part of the first information can be displayed on its display interface, the content of the second information and the first information is not exactly the same, and the second information only contains part of the first information. When the display interface of the near-eye display device currently displays other content, but based on the display parameters, it is determined that the remaining display space of its display interface can display all the first information, the second information contains all the first information; when the display interface of the near-eye display device currently displays other content, but based on the display parameters, it is determined that the remaining display space of its display interface cannot display all the first information, the second information contains part of the first information. It can be understood that since the second information displayed on the display interface of the near-eye display device includes at least part of the first information, after the near-eye display device obtains the first information, if there is no display space to display the first information on the display interface of the near-eye display device, the near-eye display device will hide at least part of the displayed content so that at least part of the first information can be displayed on the display interface of the near-eye display device.

[0061] Step S102: In response to detecting a control instruction for controlling the second information, sending the control instruction to the terminal device, so that the terminal device controls the first information according to the control instruction.

[0062] After the near-eye display device displays the second information, the near-eye display device detects whether a control instruction for controlling the second information is received. Among them, the control instruction in the action dimension may be a voice instruction, a gesture instruction, or a control instruction triggered by a user through a button on the near-eye display device. The control instruction in the functional dimension may be a zoom instruction, a switching instruction, a close instruction, an editing instruction, etc. It can be understood that a complete control instruction includes an action dimension and a functional dimension. When the near-eye display device receives a control instruction for controlling the second information, it controls the second information according to the control instruction and sends the control instruction to the terminal device. When the terminal device receives the control instruction, it controls the first information according to the control instruction. When the near-eye display device does not receive the control instruction, the near-eye display device will detect whether the control instruction for controlling the second information is received periodically or in real time.

[0063] In one embodiment, priorities can be set for control instructions of different action dimensions, such as the priority of voice instructions is higher than the priority of gesture instructions, and the priority of gesture instructions is higher than the priority of control instructions triggered by key instructions. Therefore, when the near-eye display device receives voice instructions and gesture instructions at the same time, it will respond to the voice instructions first.

[0064] In one embodiment, if the control instruction is a zoom instruction, step S102 includes:

[0065] In response to detecting a scaling instruction for scaling the second information, determining an instruction type corresponding to the scaling instruction and first position information corresponding to the scaling instruction;

[0066] The instruction type and the first position information are sent to the terminal device, so that the terminal device can scale the first information based on the instruction type and the first position information.

[0067] When the control instruction is a zoom instruction, that is, the near-eye display device detects a zoom instruction for zooming the second information, the near-eye display device determines the instruction type corresponding to the zoom instruction and determines the first position information corresponding to the zoom instruction. In this embodiment, the zoom instruction can be a zoom gesture instruction, or a zoom voice instruction, etc. The instruction type includes a zoom-in type and a zoom-out type. The first position information corresponding to the zoom instruction is used to determine the zoom content corresponding to the zoom instruction.

[0068] When the zoom instruction is a zoom gesture instruction, the near-eye display device can recognize the user's zoom gesture instruction through its camera, obtain the gesture key points of the zoom gesture instruction, and determine the corresponding first position information based on the gesture key points. For example, when the zoom gesture instruction is that the distance between the thumb and the index finger becomes smaller and smaller until the distance between the thumb and the index finger is 0, that is, the thumb and the index finger change from a released state to a pinched state, the zoom gesture instruction is a zoom-out gesture instruction at this time, and when it is determined that the thumb and the index finger are in a pinched state, the coordinates of the positions corresponding to the fingertip key points of the thumb and the index finger determine the first position information corresponding to the zoom instruction; when the zoom gesture instruction is that the distance between the thumb and the index finger starts to increase from 0, that is, the thumb and the index finger change from a pinched state to a released state, the zoom gesture instruction is a zoom-in gesture instruction, and when it is determined that the thumb and the index finger are in a pinched state, the coordinates of the positions corresponding to the fingertip key points of the thumb and the index finger are determined as the first position information corresponding to the zoom instruction.

[0069] When the zoom instruction is a zoom voice instruction, the near-eye display device can determine the instruction type and the first position information according to the content of the zoom voice instruction. For example, when the zoom voice instruction is "zoom in the map window", the instruction type can be determined to be a zoom-in type, and the first position information is the coordinates corresponding to the map window. When the zoom voice instruction is "zoom out the WeChat chat window", the instruction type can be determined to be a zoom-out type, and the first position information is the coordinates corresponding to the WeChat chat window. At this time, the zoom-in or zoom-out ratio can be preset.

[0070] After the near-eye display device determines the instruction type and the first position information corresponding to the scaling instruction, the near-eye display sends the instruction type and the first position information to the terminal device. After the terminal device receives the instruction type and the first position information, the terminal device scales the first information according to the instruction type and the first position information. It is understandable that the size of the display interface of the near-eye display device and the display interface of the terminal device are not necessarily the same. Therefore, after receiving the first position information, the terminal device will determine the specific scaling position of the scaling instruction in the display interface of the terminal device based on the mapping relationship between the display interface of the near-eye display device and the display interface of the terminal device. For example, when the display interface of the near-eye display device is twice as large as the display interface of the terminal device, after receiving the first position information (coordinates), the terminal device will reduce the corresponding coordinate value by half, thereby accurately determining the specific scaling position of the scaling instruction in the display interface of the terminal device.

[0071] It is understandable that when the second information only contains part of the first information, if the zoom content corresponding to the zoom instruction is the entire second information, the terminal device can zoom all of the first information according to the zoom instruction, or zoom the part of the first information that is the same as the second information according to the zoom instruction, that is, the zoom instruction in this embodiment can be a global zoom instruction (zooming all information on the display interface) or a local zoom instruction (zooming part of the display interface). The user can choose to trigger the global zoom instruction or the local zoom instruction as needed. When the user chooses to trigger the global zoom instruction, the corresponding first position information defaults to the coordinates of the center point of the display interface.

[0072] The disclosed embodiment obtains first information displayed by a terminal device connected to a near-eye display device, and displays second information in the near-eye display device according to the first information; in response to detecting a control instruction for controlling the second information, the control instruction is sent to the terminal device, so that the terminal device controls the first information according to the control instruction, thereby realizing the control of the information displayed by the terminal device through the near-eye display device, solving the problem in certain scenarios, such as when the user is too far away from the terminal device and it is inconvenient to control the content displayed by the terminal device, and improving the flexibility of cross-device control between the near-eye display device and the terminal device, that is, improving the flexibility of cross-device control of the terminal device through the near-eye display device.

[0073] In one embodiment, if the control instruction is an interface switching instruction, step S102 includes:

[0074] In response to detecting an interface switching instruction to switch the second information, determining whether the second information includes all of the first information;

[0075] If the second information includes all the first information, the interface switching instruction is sent to the terminal device, so that the terminal device switches the display interface of the first information according to the interface switching instruction.

[0076] When the near-eye display device detects an interface switching instruction for switching the second information, that is, the control instruction is an interface switching instruction, the near-eye display device determines whether the second information includes all the first information. In the present invention, when the near-eye display device determines that the second information includes all the first information, the near-eye display device sends the interface switching instruction to the terminal device. When the terminal device receives the interface switching instruction, the terminal device switches the display interface of the first information according to the interface switching instruction, that is, switches to the next display interface corresponding to the first information according to the interface switching instruction, or switches to the previous display interface corresponding to the first information. It can be understood that when the terminal device switches the display interface of the first information according to the interface switching instruction, the near-eye display device will also switch the display interface of the second information according to the interface switching instruction, thereby realizing the synchronous change of the second information and the first information, and improving the coordination of the control of the terminal device through the cross-device control of the near-eye display device.

[0077] In one embodiment, the method further comprises:

[0078] If the second information only includes part of the first information, then when the display information on the display interface of the near-eye display device meets the preset conditions, the display interface of the second information is switched according to the interface switching instruction to display other first information in the display interface of the near-eye display device, wherein the first information displayed by the terminal device remains unchanged.

[0079] If the near-eye display device determines that the second information only includes part of the first information, the near-eye display device determines the switching type of the interface switching instruction. When the switching type is switching to the next display interface, the display information of the display interface of the near-eye display device meets the preset conditions in the following cases: the second information displayed by the near-eye display device is not the last content of the first information, that is, there is still part of the first information to be displayed; when the switching type is switching to the previous display interface, the display information of the display interface of the near-eye display device meets the preset conditions in the following cases: the near-eye display device has displayed part of the first information in the display interface before detecting the page switching instruction. When the near-eye display device determines that the second information only includes part of the first information, and the display information of the display interface of the near-eye display device meets the preset conditions, the near-eye display device will switch the display interface of the second information according to the interface switching instruction. At this time, the near-eye display device will not send the interface switching instruction to the terminal device, and the first information displayed by the terminal device remains unchanged.

[0080] When the near-eye display device determines that the second information only includes part of the information in the first information, and the display information of the display interface of the near-eye display device does not meet the preset conditions, the near-eye display device will send an interface switching instruction to the terminal device, so that the terminal device switches the display interface of the first information according to the interface switching instruction. It can be understood that when the terminal device switches the display interface of the first information according to the interface switching instruction, the near-eye display device will also switch the display interface of the second information according to the interface switching instruction. When the switching type is switching to the next display interface, the display information of the display interface of the near-eye display device does not meet the preset conditions in the case that the near-eye display device does not have the first information to be displayed, that is, the content included in the current second information that is the same as the first information is the last content of the first information. When the switching type is switching to the previous display interface, the display information of the display interface of the near-eye display device does not meet the preset conditions in the case that the near-eye display device has not displayed content related to the first information before detecting the page switching instruction.

[0081] When determining that the control instruction is an interface switching instruction, the embodiment of the present disclosure decides whether to send the interface switching instruction to the terminal device according to the specific situation, thereby further improving the flexibility of controlling the terminal device across devices through the near-eye display device.

[0082] In one embodiment, step S102 includes:

[0083] In response to detecting a control instruction for controlling the second information, determining whether there are at least two display windows in a current display interface of the near-eye display device;

[0084] If there are at least two display windows, determining whether the control instruction is an instruction to control all display windows or part of the display windows;

[0085] If the control instruction is an instruction for controlling part of the display window, determining that the control instruction corresponds to a target display window to be controlled, and determining whether the target display window exists in the display interface of the terminal device;

[0086] If the target display window exists in the display interface of the terminal device, the control instruction is sent to the terminal device, so that the terminal device controls the first information displayed in the target display window according to the control instruction.

[0087] In this embodiment, when the near-eye display device detects a control instruction for controlling the second information, the near-eye display device determines whether there are at least two display windows in its current display interface. If there are at least two display windows in the current display interface of the near-eye display device, the near-eye display device determines whether the control instruction is an instruction for controlling all display windows or an instruction for controlling some display windows. In this embodiment, for ease of distinction, the control instruction for controlling all display windows is determined as the first control instruction, and the control instruction for controlling some display windows is determined as the second control instruction. It can be understood that the triggering methods of the first control instruction and the second control instruction are different.

[0088] If the control instruction is a second control instruction for controlling part of the display window, the near-eye display device determines the target display window to be controlled corresponding to the second control instruction, and determines whether the target display window exists in the display interface of the terminal device. It can be understood that when the display content of at least one display window in the display interface of the terminal device is the same as the content displayed by the target display window, it indicates that the target display window exists in the display interface of the terminal device. When the near-eye display device determines that there is a target display window in the display interface of the terminal device, the near-eye display device sends the second control instruction to the terminal device. After the terminal device receives the second control instruction, the terminal device controls the first information in the target display window in its display interface according to the second control instruction. The near-eye display device also controls the second information in the target display window according to the second control instruction. Among them, the number of target display windows controlled by the near-eye display device according to the second control instruction is greater than or equal to the number of target display windows controlled by the terminal device according to the second control instruction. If there is no target display window in the display interface of the terminal device, the near-eye display device will not send the second control instruction to the terminal device.

[0089] For example, when the second control instruction is to control the three display windows A1, A2 and A3 in the display interface of the near-eye display device, but there are only A2 and A3 display windows in the display interface of the terminal device, and there is no A1 display window, that is, the information displayed in the A2 and A3 display windows of the near-eye display device is the information of the display interface of the terminal device, and the information displayed in the A1 display window is the information of the near-eye display device itself. At this time, the near-eye display device will control the information displayed in the three display windows A1, A2 and A3 according to the second control instruction, and the terminal device will control the information displayed in the two display windows A2 and A3 according to the second control instruction.

[0090] In one embodiment, if there is only one display window in the current display interface of the near-eye display device, the near-eye display device controls the second information according to the control instruction, and sends the control instruction to the terminal device, so that the terminal device controls the first information according to the control instruction. If there are at least two display windows in the current display interface of the near-eye display device, but the control instruction is a first instruction for controlling all display windows, the near-eye display device controls the second information according to the control instruction, and sends the control instruction to the terminal device, so that the terminal device controls the first information according to the control instruction.

[0091] After the near-eye display device of the embodiment of the present disclosure receives the control instruction for controlling the second information, it decides whether to send the control instruction to the terminal device based on the number of display windows on its current display interface and whether the control instruction is an instruction to control all display windows or part of the display windows, thereby improving the intelligence of cross-device control of terminal devices through the near-eye display device.

[0092] In one embodiment, the method further comprises:

[0093] Determining a scene in which the near-eye display device is currently located;

[0094] If the scene is a preset scene, execute step S101

[0095] The near-eye display device determines the scene it is currently in, and determines whether the current scene is a preset scene. If the current scene is a preset scene, the first information displayed by the terminal device connected to the near-eye display device is obtained, and the second information is displayed in its display interface according to the first information; in response to detecting a control instruction for controlling the second information, the control instruction is sent to the terminal device, so that the terminal device controls the first information according to the control instruction. Among them, the preset scene can be a projection scene, a screen projection scene, or a long-distance control scene. For example, when the terminal device connected to the near-eye display device is a projector, it can be determined that the current scene is a projection scene; when the terminal device connected to the near-eye display device is in a screen projection state, it can be determined that the current scene is a screen projection scene; when the distance between the near-eye display device and the connected terminal device is greater than the preset distance, it can be determined that the current scene is a long-distance control scene. It can be understood that in the preset scenario, since the near-eye display device is worn on the user's head, even if the user is far away from the terminal device, there is no need to worry that the user cannot see the information displayed on the terminal device clearly, or it avoids the situation where the user is far away from the terminal device and cannot control the information displayed on the terminal in time, thereby improving the visibility of the information displayed by the terminal device and improving the efficiency of controlling the information displayed by the terminal device.

[0096] In one embodiment, referring to Figure 3 , the method further comprises:

[0097] Step S103, in response to receiving a parameter adjustment instruction for adjusting the display parameters of the second information, adjusting the display parameters of the second information according to the parameter adjustment instruction to obtain the adjusted display parameters, and controlling the second information according to the adjusted display parameters, wherein the display parameters of the first information displayed by the terminal device remain unchanged.

[0098] In this embodiment, when the near-eye display device and the terminal device establish a communication connection, in order to realize the separate control of the near-eye display device, the user can trigger a parameter adjustment instruction for adjusting the display parameters of the second information in the near-eye display device. In this embodiment, the user can trigger the parameter adjustment instruction by voice or gesture. When the near-eye display device receives the parameter adjustment instruction for adjusting the display parameters of the second information, the near-eye display device adjusts the display parameters of the second information according to the parameter adjustment instruction, obtains the adjusted display parameters, and controls the second information according to the adjusted display parameters. At this time, the display parameters of the first information displayed by the terminal device remain unchanged.

[0099] Among them, step S103 can be executed before step S102, can be executed after step S102, or can be executed at the same time as step S102.

[0100] In this embodiment, a control scheme for independent control of the near-eye display device is set up on the basis of establishing a communication connection between the near-eye display device and the terminal device, so as to avoid the terminal device adjusting the second information as long as the near-eye display device adjusts it. This improves the flexibility of cross-device control between the near-eye display device and the terminal device, and ensures the independence of the control of the near-eye display device.

[0101] See also Figure 4 , Figure 4 It is a schematic block diagram of the structure of an information display control device provided by an embodiment of the present invention.

[0102] like Figure 4 As shown, the information display control device 400 is applied to a near-eye display device, and the information display control device 400 includes:

[0103] An information acquisition module 410 is used to acquire first information displayed by a terminal device connected to the near-eye display device;

[0104] An information display module 420, configured to display second information in the near-eye display device according to the first information;

[0105] The instruction sending module 430 is used to send the control instruction to the terminal device in response to detecting the control instruction for controlling the second information, so that the terminal device controls the first information according to the control instruction.

[0106] In one embodiment, if the control instruction is a scaling instruction, the instruction sending module 430 further includes:

[0107] A first information determining unit, configured to, in response to detecting a scaling instruction for scaling the second information, determine an instruction type corresponding to the scaling instruction and first position information corresponding to the scaling instruction;

[0108] An information sending unit is used to send the instruction type and the first position information to the terminal device, so that the terminal device can scale the first information based on the instruction type and the first position information.

[0109] In one embodiment, if the control instruction is an interface switching instruction, the instruction sending module 430 further includes:

[0110] a second information determining unit, configured to determine whether the second information includes all of the first information in response to detecting an interface switching instruction for switching the second information;

[0111] The first instruction sending unit is used to send the interface switching instruction to the terminal device if the second information includes all the first information, so that the terminal device switches the display interface of the first information according to the interface switching instruction.

[0112] In one embodiment, the information display control device 400 further includes:

[0113] An interface switching module is used to switch the display interface of the second information according to the interface switching instruction if the second information only includes part of the information in the first information, when the display information of the display interface of the near-eye display device meets a preset condition, so as to display other first information to be displayed in the display interface of the near-eye display device, wherein the first information displayed by the terminal device remains unchanged.

[0114] In one embodiment, the instruction sending module 430 further includes:

[0115] A display window determining unit, configured to determine whether there are at least two display windows in a current display interface of the near-eye display device in response to detecting a control instruction for controlling the second information;

[0116] an instruction determination unit, configured to determine whether the control instruction is an instruction for controlling all display windows or some display windows if there are at least two display windows; and if the control instruction is an instruction for controlling some display windows, determine whether the control instruction corresponds to a target display window to be controlled;

[0117] The display window determination unit is further configured to determine whether the target display window exists in the display interface of the terminal device;

[0118] The second instruction sending unit is used to send the control instruction to the terminal device if the target display window exists in the display interface of the terminal device, so that the terminal device controls the first information displayed in the target display window according to the control instruction.

[0119] In one embodiment, the information display control device 400 further includes:

[0120] A scene determination module, used to determine the scene in which the near-eye display device is currently located;

[0121] A step execution module is used to execute the step of obtaining the first information displayed by the terminal device connected to the near-eye display device and displaying the second information in the near-eye display device according to the first information if the scene is a preset scene.

[0122] In one embodiment, the information display control device 400 further includes:

[0123] A parameter adjustment module is used to respond to receiving a parameter adjustment instruction for adjusting the display parameters of the second information, adjust the display parameters of the second information according to the parameter adjustment instruction, obtain the adjusted display parameters, and control the second information according to the adjusted display parameters, wherein the display parameters of the first information displayed by the terminal device remain unchanged.

[0124] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the information display control device described above can refer to the corresponding process in the aforementioned information display control method embodiment, and will not be repeated here.

[0125] An embodiment of the present invention further provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any information display control method provided in the description of the embodiment of the present invention.

[0126] The storage medium may be an internal storage unit of the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the near-eye display device. The storage medium may also be an external storage device of the near-eye display device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the near-eye display device.

[0127] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware embodiment, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those of ordinary skill in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0128] It should be understood that the term "and / or" used in the present specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system including the element.

[0129] The serial numbers of the embodiments of the present invention are only for description and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. An information display control method, characterized in that: The method is applied to a near-eye display device, and the method comprises: Acquire first information displayed by a terminal device connected to the near-eye display device, and display second information in the near-eye display device according to the first information; In response to detecting a control instruction for controlling the second information, the control instruction is sent to the terminal device, so that the terminal device controls the first information according to the control instruction.

2. The information display control method according to claim 1, characterized in that: If the control instruction is a scaling instruction, the step of sending the control instruction to the terminal device in response to detecting the control instruction for controlling the second information, so that the terminal device controls the first information according to the control instruction, includes: In response to detecting a scaling instruction for scaling the second information, determining an instruction type corresponding to the scaling instruction and first position information corresponding to the scaling instruction; The instruction type and the first position information are sent to the terminal device, so that the terminal device can scale the first information based on the instruction type and the first position information.

3. The information display control method according to claim 1, characterized in that: If the control instruction is an interface switching instruction, the step of sending the control instruction to the terminal device in response to detecting the control instruction for controlling the second information, so that the terminal device controls the first information according to the control instruction, includes: In response to detecting an interface switching instruction to switch the second information, determining whether the second information includes all of the first information; If the second information includes all the first information, the interface switching instruction is sent to the terminal device, so that the terminal device switches the display interface of the first information according to the interface switching instruction.

4. The information display control method according to claim 3, characterized in that: The method further comprises: If the second information only includes part of the first information, then when the display information on the display interface of the near-eye display device meets the preset conditions, the display interface of the second information is switched according to the interface switching instruction to display other first information to be displayed in the display interface of the near-eye display device, wherein the first information displayed by the terminal device remains unchanged.

5. The information display control method according to claim 1, characterized in that: The step of sending the control instruction to the terminal device in response to detecting the control instruction for controlling the second information so that the terminal device controls the first information according to the control instruction comprises: In response to detecting a control instruction for controlling the second information, determining whether there are at least two display windows in a current display interface of the near-eye display device; If there are at least two display windows, determining whether the control instruction is an instruction to control all display windows or part of the display windows; If the control instruction is an instruction for controlling part of the display window, determining that the control instruction corresponds to a target display window to be controlled, and determining whether the target display window exists in the display interface of the terminal device; If the target display window exists in the display interface of the terminal device, the control instruction is sent to the terminal device, so that the terminal device controls the first information displayed in the target display window according to the control instruction.

6. The information display control method according to claim 1, characterized in that: Before the step of acquiring the first information displayed by the terminal device connected to the near-eye display device and displaying the second information in the near-eye display device according to the first information, the step further includes: Determining a scene in which the near-eye display device is currently located; If the scene is a preset scene, the step of acquiring the first information displayed by the terminal device connected to the near-eye display device and displaying the second information in the near-eye display device according to the first information is performed.

7. The information display control method according to any one of claims 1 to 6, characterized in that: After the step of acquiring first information displayed by a terminal device connected to the near-eye display device, and displaying second information in the near-eye display device according to the first information, the method further includes: In response to receiving a parameter adjustment instruction for adjusting the display parameters of the second information, the display parameters of the second information are adjusted according to the parameter adjustment instruction to obtain the adjusted display parameters, and the second information is controlled according to the adjusted display parameters, wherein the display parameters of the first information displayed by the terminal device remain unchanged.

8. An information display control device, characterized in that: The information display control device is applied to a near-eye display device, and the information display control device comprises: An information acquisition module, used to acquire first information displayed by a terminal device connected to the near-eye display device; an information display module, configured to display second information in the near-eye display device according to the first information; The instruction sending module is used for sending the control instruction to the terminal device in response to detecting the control instruction for controlling the second information, so that the terminal device controls the first information according to the control instruction.

9. A near-eye display device, characterized in that: The near-eye display device includes a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for realizing connection and communication between the processor and the memory, wherein when the computer program is executed by the processor, the information display control method as described in any one of claims 1 to 7 is implemented.

10. A storage medium for computer-readable storage, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the information display control method according to any one of claims 1 to 7.

Images