Equipment control method and device, head-mounted display equipment and storage medium

Abstract

The embodiment of the invention provides an equipment control method and device, head-mounted display equipment and a storage medium, and belongs to the field of equipment display. The method comprises the following steps: acquiring posture data of the head-mounted display equipment; determining a current head action of the user wearing the head-mounted display device according to the posture data; and determining a target display page of the head-mounted display device according to the current head action and a current display page of the head-mounted display device, and switching the current display page into the target display page. According to the method, the control convenience of the head-mounted display equipment is improved.

Description

Technical Field

[0001] The present invention relates to the field of device display technology, and in particular to a device control method, device, head-mounted display device and storage medium. Background Art

[0002] At present, head-mounted display devices can realize functions such as virtual reality (VR), augmented reality (AR) or mixed reality (MR), which can bring users a better visual experience. However, the display content of head-mounted display devices generally requires users to manually control the display content using physical buttons, touch bars or external remote controls on the head-mounted display devices. The convenience of users controlling head-mounted display devices is low, and the user experience is not good. Summary of the invention

[0003] Embodiments of the present invention provide a device control method, an apparatus, a head-mounted display device, and a storage medium, aiming to improve the control convenience of the head-mounted display device.

[0004] In a first aspect, an embodiment of the present invention provides a device control method, which is applied to a head mounted display device, and the method includes:

[0005] Acquiring posture data of the head mounted display device;

[0006] determining a current head movement of a user wearing the head mounted display device according to the posture data;

[0007] A target display page of the head mounted display device is determined according to the current head movement and the current display page of the head mounted display device, and the current display page is switched to the target display page.

[0008] In a second aspect, an embodiment of the present invention further provides a device control apparatus, the device control apparatus comprising:

[0009] A data acquisition module, configured to acquire posture data of a head mounted display device;

[0010] an action determination module, configured to determine a current head action of a user wearing the head mounted display device according to the posture data;

[0011] a page determination module, configured to determine a target display page of the head mounted display device according to the current head movement and the current display page of the head mounted display device;

[0012] The page switching module is configured to switch the current display page to the target display page.

[0013] In a third aspect, an embodiment of the present invention further provides a head-mounted display device, comprising a display device, a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for realizing connection and communication between the display device, the processor and the memory, wherein when the computer program is executed by the processor, the device control method as described in the first aspect is implemented.

[0014] In a fourth aspect, an embodiment of the present invention further provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the device control method as described in the first aspect.

[0015] The embodiments of the present invention provide a device control method, apparatus, head-mounted display device and storage medium. The embodiments of the present invention determine the current head movement of a user wearing the head-mounted display device through the posture data of the head-mounted display device, and determine the target display page that the head-mounted display device needs to display subsequently based on the current head movement and the current display page of the head-mounted display device, and switch the current display page of the head-mounted display device to the target display page. The whole process does not require manual control by the user, and the user's hands can be freed to do other things, which greatly improves the control efficiency and convenience of the display content of the head-mounted display device and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0017] Figure 1 This is a schematic diagram of a scenario for implementing the device control method provided by an embodiment of the present invention;

[0018] Figure 2 It is a flow chart of a device control method provided by an embodiment of the present invention;

[0019] Figure 3 is a schematic diagram of a three-dimensional coordinate system in an embodiment of the present invention;

[0020] Figure 4 yes Figure 2 A schematic diagram of a sub-step flow chart of a device control method in FIG.

[0021] Figure 5 is a flow chart of another device control method provided by an embodiment of the present invention;

[0022] Figure 6 is a flow chart of another device control method provided by an embodiment of the present invention;

[0023] Figure 7 is a flow chart of another device control method provided by an embodiment of the present invention;

[0024] Figure 8 is a schematic block diagram of the structure of a device control device provided by an embodiment of the present invention;

[0025] Fig. 9 The present invention is a schematic block diagram of a head mounted display device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0028] It should be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0029] At present, head-mounted display devices can realize functions such as virtual reality (VR), augmented reality (AR) or mixed reality (MR), which can bring users a better visual experience. However, the display content of head-mounted display devices generally requires users to manually control it using physical buttons, touch bars or external remote controls on the head-mounted display devices, which has low efficiency and convenience in controlling the display content and poor user experience.

[0030] To solve the above problems, the embodiments of the present invention provide a device control method, apparatus, head-mounted display device and storage medium. The method determines the current head movement of the user wearing the head-mounted display device through the posture data of the head-mounted display device, and determines the target display page that the head-mounted display device needs to display later based on the current head movement and the current display page of the head-mounted display device, and switches the current display page of the head-mounted display device to the target display page. The whole process does not require manual control by the user, and the user's hands can be freed to do other things, which greatly improves the control efficiency and convenience of the display content of the head-mounted display device and improves the user experience.

[0031] Some embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0032] See also Figure 1 , Figure 1 It is a schematic diagram of a scenario for implementing the device control method provided by an embodiment of the present invention.

[0033] like Figure 1 As shown, the head mounted display device 100 is connected to the terminal device 200 for communication, and the head mounted display device 100 is worn on the user's head 101. The head mounted display device 100 and the terminal device 200 can establish a communication connection through Bluetooth or mobile wireless interconnection (wireless fidelity, wifi) and the like, and the head mounted display device 100 may include augmented reality (AR) glasses, AR helmets, mixed reality (MR) glasses and MR helmets. The terminal device 200 may include a mobile phone, a tablet computer, a laptop computer, a desktop computer, a personal digital assistant, a television, and the like.

[0034] When executing the device control method provided by the embodiment of the present invention, the terminal device 200 can synchronize the display page to the head-mounted display device 100 for display. The head-mounted display device 100 obtains its own posture data and determines the user's current head movement (the current movement of the user's head 101) based on the posture data. Then, based on the user's current head movement and the current display page of the head-mounted display device 100, the target display page of the head-mounted display device 100 is determined, and the current display page displayed by the head-mounted display device 100 is switched to the target display page.

[0035] It should be noted that the current display page or target display page of the head mounted display device 100 may not be the display page synchronized from the terminal device 200, but may be the desktop display page of the head mounted display device 100 itself, or may be the application display page of the application installed in the head mounted display device 100 itself, and the embodiment of the present invention does not specifically limit this. For example, the current display page of the head mounted display device 100 is the desktop display page of the head mounted display device 100 itself, and for another example, the current display page of the head mounted display device 100 is the homepage of the music player installed in the head mounted display device 100 itself.

[0036] In some embodiments, the head mounted display device 100 includes a sensor ( Figure 1 (not shown). For example, the sensor for collecting the posture data of the head mounted display device 100 may include an inertial measurement unit (IMU), and the inertial measurement unit may include an accelerometer, a gyroscope and / or a magnetometer. For example, the inertial measurement unit includes a three-axis accelerometer, a three-axis gyroscope and a three-axis magnetometer.

[0037] The following will be combined Figure 1 The device control method provided by the embodiment of the present invention is described in detail in the scenario in FIG. Figure 1 The scenarios are only used to explain the device control method provided in the embodiment of the present invention, but do not constitute a limitation on the application scenarios of the device control method provided in the embodiment of the present invention.

[0038] See also Figure 2 , Figure 2 The present invention provides a flow chart of a device control method provided by an embodiment of the present invention. The device control method can be applied to a head mounted display device to improve the control efficiency and convenience of display content of the head mounted display device.

[0039] like Figure 1 As shown, the device control method includes steps S101 to S103.

[0040] Step S101: Acquire posture data of a head mounted display device.

[0041] In this embodiment, the posture data of the head mounted display device can be collected by the inertial measurement unit of the head mounted display device itself. The posture data of the head mounted display device may include the acceleration, angular velocity and orientation information of the head mounted display device. For example, Figure 3As shown, a three-axis coordinate system is constructed with the user's head 101 as the coordinate origin, and the three-axis coordinate system takes the positive direction of the Y axis directly in front of the user's head 101, the positive direction of the Z axis directly above the user's head 101, and the positive direction of the X axis directly to the right of the user's head 101. The acceleration of the head-mounted display device 100 may include the acceleration of the head-mounted display device 100 in the X-axis direction, the acceleration in the Y-axis direction, and / or the acceleration in the Z-axis direction, and the angular velocity of the head-mounted display device 100 may include the angular velocity of the head-mounted display device 100 around the X-axis, Y-axis, and / or Z-axis.

[0042] Step S102: Determine the current head movement of the user wearing the head mounted display device according to the posture data.

[0043] In this embodiment, the current head movement of the user wearing the head-mounted display device may include any one of turning the head to the left, turning the head to the right, turning the head and returning, shaking the head, raising the head, and nodding. Turning the head and returning may include any one of turning the head to the left and returning, turning the head to the right and returning, raising the head and returning, and nodding and returning.

[0044] In some embodiments, the posture data of the head-mounted display device includes a first angular velocity of the head-mounted display device, and determining the current head movement of the user wearing the head-mounted display device according to the posture data may include: when the absolute value and / or modulus of the first angular velocity is greater than or equal to a preset first threshold, performing Euler integration on the first angular velocity to obtain a first rotation angle of the user's head; and determining the current head movement of the user according to the first rotation angle of the user's head. Wherein, when the first angular velocity is less than the first threshold, the first angular velocity is discarded, and the first threshold can be set based on actual conditions, and the embodiment of the present invention does not specifically limit this. This embodiment can reduce user misoperation and improve control accuracy by identifying the user's current head movement only when the first angular velocity of the head-mounted display device is greater than or equal to a set value, and discarding the first angular velocity when the first angular velocity is less than the first threshold.

[0045] In some embodiments, according to the first rotation angle of the user's head, determining the user's current head movement may include: when the first rotation angle of the user's head is the rotation angle of the user's head around the Z axis, if the first rotation angle is greater than zero, then determining the user's current head movement is to turn right, if the first rotation angle is less than zero, then determining the user's current head movement is to turn left. Or when the first rotation angle of the user's head is the rotation angle of the user's head around the X axis, if the first rotation angle is greater than zero, then determining the user's current head movement is to raise the head, if the first rotation angle is less than zero, then determining the user's current head movement is to nod.

[0046] In some embodiments, the posture data of the head mounted display device includes a first angular velocity and a second angular velocity of the head mounted display device, the first angular velocity is in opposite directions to the second angular velocity, and determining the current head movement of the user wearing the head mounted display device according to the posture data may include: when the absolute value and / or modulus of the first angular velocity and the second angular velocity are both greater than or equal to a preset first threshold, performing Euler integration on the first angular velocity to obtain a first rotation angle of the user's head; when the absolute value of the first rotation angle is greater than a preset second threshold or is within a preset numerical range, performing Euler integration on the second angular velocity to obtain a second rotation angle of the user's head; when the absolute value of the difference between the first rotation angle and the second rotation angle is less than a preset third threshold, according to the first rotation angle and the second rotation angle, determining that the current head movement of the user wearing the head mounted display device is a head turn and return. Among them, the second threshold, the third threshold and the preset numerical range can be set based on actual conditions, and the embodiment of the present invention does not specifically limit this. The head movement determination method provided by this embodiment can reduce user misoperation and improve control accuracy.

[0047] In some embodiments, determining, based on the first rotation angle and the second rotation angle, that the current head movement of the user wearing the head-mounted display device is turning the head and returning may include: if the first rotation angle and the second rotation angle are both rotation angles of the user's head around the Z-axis, then when the first rotation angle is less than zero and the second rotation angle is greater than zero, determining that the current head movement of the user wearing the head-mounted display device is turning the head to the left and returning; when the first rotation angle is greater than zero and the second rotation angle is less than zero, determining that the current head movement of the user wearing the head-mounted display device is turning the head to the right and returning; if the first rotation angle and the second rotation angle are both rotation angles of the user's head around the X-axis, then when the first rotation angle is less than zero and the second rotation angle is greater than zero, determining that the current head movement of the user wearing the head-mounted display device is nodding and returning; when the first rotation angle is greater than zero and the second rotation angle is less than zero, determining that the current head movement of the user wearing the head-mounted display device is raising the head and returning.

[0048] Step S103: Determine a target display page of the head mounted display device according to the current head movement and the current display page of the head mounted display device, and switch the current display page to the target display page.

[0049] In this embodiment, the current head movement of the user wearing the head-mounted display device is determined through the posture data of the head-mounted display device, and based on the current head movement and the current display page of the head-mounted display device, the target display page that the head-mounted display device needs to display subsequently is determined, and the current display page of the head-mounted display device is switched to the target display page. The entire process does not require manual control by the user, and the user's hands can be freed to do other things, which greatly improves the control efficiency and convenience of the display content of the head-mounted display device and improves the user experience.

[0050] In one embodiment, if Figure 4 As shown, step S103 includes: sub-step S1031 to sub-step S1032.

[0051] Sub-step S1031, obtaining a head motion mapping table that matches the current display page of the head mounted display device.

[0052] In this embodiment, the head action mapping table is used to describe the mapping relationship between the head action and the page identification information. Among them, different head action mapping tables can be configured in advance for different display pages according to actual conditions. For example, a head action mapping table as shown in Table 1 can be configured for a desktop display homepage, and a head action mapping table as shown in Table 2 can be configured for a music playback homepage.

[0053] Table 1

[0054] Head movements Page identification information Turn left Page identification information of the music playback homepage Turn right Page identification information of the message notification page nod Page identification information of the status bar page Shake your head Page identification information of convenient function pages

[0055] Table 2

[0056] Head movements Page identification information Turn left Page identification information of the music configuration page Turn right The desktop displays the page identification information of the home page nod Page identification information of the status bar page Shake your head Page identification information of the convenient function page

[0057] Sub-step S1032: acquiring page identification information corresponding to the current head action from the head action mapping table as target identification information, and determining a target display page according to the target identification information.

[0058] For example, if the currently displayed page is the desktop display homepage and the current head movement is turning left, the "page identification information of the music playback homepage" corresponding to "turning left" can be obtained from the head movement mapping table shown in Table 1 as the target identification information. In this way, based on the target identification information, the music playback homepage can be determined as the target display page, and then the head-mounted display device switches the currently displayed page from the desktop display homepage to the music playback homepage.

[0059] For another example, if the currently displayed page is a desktop display homepage and the current head action is turning right, then the "page identification information of the message notification page" corresponding to "turning right" can be obtained from the head action mapping table shown in Table 1 as the target identification information. In this way, based on the target identification information, the message notification page can be determined as the target display page, and then the head-mounted display device switches the currently displayed page from the desktop display homepage to the message notification page.

[0060] For another example, if the currently displayed page is the music playback homepage and the current head movement is turning right, then the "page identification information of the desktop display homepage" corresponding to "turning right" can be obtained from the head movement mapping table shown in Table 2 as the target identification information. In this way, based on the target identification information, the desktop display homepage can be determined as the target display page, and then the head-mounted display device switches the currently displayed page from the message notification page to the desktop display homepage.

[0061] In some embodiments, according to the target identification information, determining the target display page may include: when the type identifier included in the page identification information is a first type identifier, obtaining a desktop display page corresponding to the page identifier included in the page identification information, and determining the desktop display page as the target display page; or when the type identifier included in the page identification information is a second type identifier, obtaining an application display page corresponding to the application identifier and the page identifier included in the page identification information, and determining the application display page as the target display page. The first type identifier is used to indicate that the page is a desktop display page, and the second type identifier is used to indicate that the page is an application display page. The desktop display page may be a desktop display homepage or a desktop display subpage. The desktop display homepage is different from the desktop display subpage, and there may be one or more desktop display subpages. The application display page may be a homepage or a subpage of any application.

[0062] In some embodiments, Figure 5 As shown, after step S102, the following steps are also included:

[0063] Step S104: Acquire a control mode identifier of the head mounted display device, and determine an interactive control mode of the head mounted display device according to the control mode identifier.

[0064] In this embodiment, the control mode identifier is used to describe the interactive control mode of the head-mounted display device. The interactive control mode of the head-mounted display device can be a first head-movement control mode, a second head-movement control mode, or a manual control mode. In the first head-movement control mode, the page displayed by the head-mounted display device can change with the change of the user's head movement. In the second head-movement control mode, the content of the current display page of the head-mounted display device can change with the change of the user's head movement. In the manual control mode, the display page of the head-mounted display device is prohibited from changing with the change of the user's head movement, and the display page of the head-mounted display device will change with the user's operation of the physical buttons on the head-mounted display device.

[0065] When the interactive control mode is the first head movement control mode, step S103 is performed, that is, according to the current head movement and the current display page of the head mounted display device, the target display page of the head mounted display device is determined, and the current display page is switched to the target display page. In this embodiment, after determining the current head movement of the user, when the head mounted display device is in the first head movement control mode, the current display page of the head mounted display device is switched to the target display page in response to the current head movement of the user, thereby avoiding user's misoperation.

[0066] In some embodiments, when the control mode identifier of the head-mounted display device is a preset first mode identifier, the interactive control mode of the head-mounted display device is determined to be a first head-motion control mode, when the control mode identifier of the head-mounted display device is a preset second mode identifier, the interactive control mode of the head-mounted display device is determined to be a second head-motion control mode, and when the control mode identifier of the head-mounted display device is a preset third mode identifier, the interactive control mode of the head-mounted display device is determined to be a manual control mode. Among them, the first mode identifier, the second mode identifier, and the third mode identifier are different, and the first mode identifier, the second mode identifier, and the third mode identifier can be set based on actual conditions, and the embodiments of the present invention do not specifically limit this.

[0067] In some embodiments, Figure 6 As shown, after step S104, the following steps are also included:

[0068] Step S105: When the interactive control mode is the first head movement control mode, determine whether the current head movement is a preset first head movement or a preset second head movement.

[0069] In this embodiment, the first head movement is different from the second head movement, and the first head movement and the second head movement can be set based on actual conditions, and the embodiment of the present invention does not specifically limit this. For example, the first head movement is raising the head, and the second head movement is nodding. Or the first head movement is nodding, and the second head movement is raising the head. Or the first head movement is raising the head, and the second head movement is shaking the head twice in a row, and shaking the head twice in a row means that the interval between the two shaking heads of the user is less than or equal to the preset time, and the preset time can be 1 second or 2 seconds.

[0070] In some embodiments, when the current head movement is neither the first head movement nor the second head movement, step S103 is executed, that is, the target display page of the head-mounted display device is determined according to the current head movement and the current display page of the head-mounted display device, and the current display page is switched to the target display page.

[0071] Step S106: If the current head movement is the first head movement, the interactive control mode of the head mounted display device is switched from the first head movement control mode to the manual control mode.

[0072] In this embodiment, the interactive control mode of the head-mounted display device can be switched from the first head-motion control mode to the manual control mode through the user's head movement, thereby improving the convenience of switching the interactive control mode. In addition, in the manual control mode, the display page of the head-mounted display device is prohibited from changing with the change of the user's head movement, so as to avoid the user's head movement affecting the display page of the head-mounted display device. For example, when the head-mounted display device is playing a movie or TV series, the user does not need to adjust the display page for a period of time. If the head-mounted display device is always in the head-motion control mode, it will bring a bad experience to the user. Therefore, the user can use the head movement to switch the interactive control mode of the head-mounted display device to the manual control mode, freeing the user's head and improving the user experience.

[0073] Step S107: If the current head movement is the second head movement, switching the interactive control mode of the head mounted display device from the first head movement control mode to the second head movement control mode.

[0074] This embodiment can switch the interactive control mode of the head mounted display device from the first head movement control mode to the second head movement control mode through the user's head movement, thereby improving the convenience of switching the interactive control mode. In addition, in the second head movement control mode, the content of the current display page of the head mounted display device can change with the change of the user's head movement, which can facilitate the user to adjust the content of the current display page of the head mounted display device, thereby improving the convenience of the user to control the head mounted display device.

[0075] In some embodiments, when the interactive control mode of the head mounted display device is the manual control mode, it is determined whether the current head movement is a preset first head movement or a preset second head movement; if the current head movement is the preset first head movement, the interactive control mode of the head mounted display device is switched from the manual control mode to the first head movement control mode; if the current head movement is the preset second head movement, the interactive control mode of the head mounted display device is switched from the manual control mode to the second head movement control mode. The first head movement is different from the third head movement, for example, the first head movement is to raise the head, and the third head movement is to turn the head to the left.

[0076] In some embodiments, when the interactive control mode of the head-mounted display device is the second head movement control mode, it is determined whether the current head movement is the preset first head movement or the preset second head movement; if the current head movement is the preset first head movement, the interactive control mode of the head-mounted display device is switched from the second head movement control mode to the first head movement control mode; if the current head movement is the preset second head movement, the interactive control mode of the head-mounted display device is switched from the second head movement control mode to the manual control mode.

[0077] In some embodiments, Figure 7 As shown, after step S104, the following steps are also included:

[0078] Step S108: When the interactive control mode is the second head-movement control mode, obtain a control instruction mapping table that matches the current display page of the head-mounted display device.

[0079] In this embodiment, the control instruction mapping table is used for the mapping relationship between the head movement and the preset control instruction. It is understandable that different control instruction mapping tables can be configured for different display pages in advance according to actual conditions. For example, the control instruction mapping table shown in Table 3 is configured for the music playback homepage.

[0080] Table 3

[0081] Head movements Control instructions Turn left Switch the song to the previous one Turn right Switch the song to the next control command nod Control instructions for playing the currently paused song Shake your head Pause the currently playing song

[0082] Step S109: acquiring a preset control instruction corresponding to the current head movement from the control instruction mapping table as a target control instruction, and executing the target control instruction in response to the current head movement.

[0083] For example, if the current display page is the music playback homepage, and the current head movement is turning left, then the "control instruction to switch the song to the previous song" corresponding to "turning left" can be obtained from the control instruction mapping table shown in Table 3 as the target control instruction, and in response to the "turning left" action, the song currently playing on the music playback homepage is switched to the previous song. For another example, if the current head movement is shaking head, then the "control instruction to pause the currently playing song" corresponding to "shaking head" can be obtained from the control instruction mapping table shown in Table 3 as the target control instruction, and in response to the "shaking head" action, the song currently playing on the music playback homepage is paused.

[0084] See also Figure 8 , Figure 8 The present invention provides a device control device according to an embodiment of the present invention. The device control device is applied to a head mounted display device.

[0085] like Figure 8 As shown, the device control apparatus 300 includes:

[0086] The data acquisition module 310 is configured to acquire the posture data of the head mounted display device;

[0087] The action determination module 320 is configured to determine a current head action of a user wearing the head mounted display device according to the posture data;

[0088] A page determination module 330 is configured to determine a target display page of the head mounted display device according to the current head movement and the current display page of the head mounted display device;

[0089] The page switching module 340 is configured to switch the current display page to the target display page.

[0090] In some embodiments, the page determination module 330 is further configured to:

[0091] Acquire a head action mapping table that matches a current display page of the head mounted display device, wherein the head action mapping table is used to describe a mapping relationship between head actions and page identification information;

[0092] The page identification information corresponding to the current head action is obtained from the head action mapping table as the target identification information, and the target display page is determined according to the target identification information.

[0093] In some embodiments, the page determination module 330 is further configured to:

[0094] When the type identifier included in the page identification information is a first type identifier, obtaining a desktop display page corresponding to the page identifier included in the page identification information, and determining the desktop display page as the target display page;

[0095] Alternatively, when the type identifier included in the page identification information is a second type identifier, an application display page corresponding to the application identifier and the page identifier included in the page identification information is obtained, and the application display page is determined as the target display page.

[0096] In some embodiments, the device control apparatus 300 further includes:

[0097] a mode determination module, configured to obtain a control mode identifier of the head mounted display device, and determine an interactive control mode of the head mounted display device according to the control mode identifier;

[0098] The page determination module 330 is further configured to determine a target display page of the head mounted display device according to the current head movement and the current display page of the head mounted display device when the interactive control mode is the first head movement control mode;

[0099] The page switching module 340 is configured to switch the current display page to the target display page.

[0100] In some embodiments, the device control apparatus 300 further includes:

[0101] an action judgment module, configured to, when the interactive control mode is the first head movement control mode, determine whether the current head movement is a preset first head movement or a preset second head movement, the first head movement being different from the second head movement;

[0102] The mode switching module is configured to switch the interactive control mode of the head-mounted display device from the first head movement control mode to the manual control mode if the current head movement is the first head movement. In the manual control mode, the display page of the head-mounted display device is prohibited from changing with the change of the user's head movement.

[0103] In some embodiments, the mode switching module is further configured to:

[0104] If the current head movement is the second head movement, the interactive control mode of the head-mounted display device is switched from the first head movement control mode to the second head movement control mode. In the second head movement control mode, the content in the current display page of the head-mounted display device can change with the change of the user's head movement.

[0105] In some embodiments, the device control apparatus 300 further includes:

[0106] an instruction acquisition module, configured to, when the interactive control mode is the second head movement control mode, acquire a control instruction mapping table matching a current display page of the head mounted display device, and acquire a preset control instruction corresponding to the current head movement from the control instruction mapping table as a target control instruction, wherein the control instruction mapping table is used to describe a mapping relationship between the head movement and the preset control instruction;

[0107] The instruction execution module is configured to execute the target control instruction in response to the current head movement.

[0108] In some embodiments, the posture data includes a first angular velocity and a second angular velocity of the head mounted display device, the first angular velocity is opposite to the second angular velocity, and the action determination module 320 is further configured to:

[0109] When the absolute value and / or modulus of the first angular velocity and the absolute value and / or modulus of the second angular velocity are both greater than or equal to a preset first threshold, performing Euler integration on the first angular velocity to obtain a first rotation angle of the user's head;

[0110] When the absolute value of the first rotation angle is greater than a preset second threshold or is within a preset value range, performing Euler integration on the second angular velocity to obtain a second rotation angle of the user's head;

[0111] When the absolute value of the difference between the first rotation angle and the second rotation angle is smaller than a preset third threshold, it is determined that the current head movement of the user is turning the head and returning according to the first rotation angle and the second rotation angle.

[0112] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the equipment control device described above can refer to the corresponding process in the aforementioned equipment control method embodiment, and will not be repeated here.

[0113] See also Fig. 9 , Fig. 9 It is a schematic block diagram of the structure of a head mounted display device provided by an embodiment of the present invention.

[0114] like Fig. 9 As shown, the head mounted display device 100 includes a display device 110, a processor 120 and a memory 130, and the display device 110, the processor 120 and the memory 130 are connected via a bus 140, which is, for example, an I2C (Inter-integrated Circuit) bus.

[0115] Specifically, the processor 120 is used to provide computing and control capabilities to support the operation of the entire head-mounted display device. The processor 120 can be a central processing unit (CPU), and the processor 120 can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0116] Specifically, the memory 130 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.

[0117] Those skilled in the art will understand that Fig. 9 The structure shown in the figure is only a block diagram of a partial structure related to the embodiment of the present invention, and does not constitute a limitation on the head-mounted display device to which the embodiment of the present invention is applied. The specific head-mounted display device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0118] The processor 120 is used to run the computer program stored in the memory 130, and implement any one of the device control methods provided by the embodiments of the present invention when executing the computer program.

[0119] In one embodiment, the processor 120 is used to run a computer program stored in the memory, and implement the following steps when executing the computer program:

[0120] Acquiring posture data of the head mounted display device;

[0121] determining a current head movement of a user wearing the head mounted display device according to the posture data;

[0122] According to the current head movement and the current display page of the head mounted display device, a target display page of the head mounted display device is determined, and the current display page is switched to the target display page.

[0123] In some embodiments, when determining the target display page of the head mounted display device according to the current head movement and the current display page of the head mounted display device, the processor 120 is configured to implement:

[0124] Acquire a head action mapping table that matches a current display page of the head mounted display device, wherein the head action mapping table is used to describe a mapping relationship between head actions and page identification information;

[0125] The page identification information corresponding to the current head action is obtained from the head action mapping table as the target identification information, and the target display page is determined according to the target identification information.

[0126] In some embodiments, when determining the target display page according to the target identification information, the processor 120 is used to implement:

[0127] When the type identifier included in the page identification information is a first type identifier, obtaining a desktop display page corresponding to the page identifier included in the page identification information, and determining the desktop display page as the target display page;

[0128] Alternatively, when the type identifier included in the page identification information is a second type identifier, an application display page corresponding to the application identifier and the page identifier included in the page identification information is obtained, and the application display page is determined as the target display page.

[0129] In some embodiments, after determining the current head movement of the user wearing the head mounted display device according to the posture data, the processor 120 is further configured to implement:

[0130] Acquire a control mode identifier of the head mounted display device, and determine an interactive control mode of the head mounted display device according to the control mode identifier;

[0131] When the interactive control mode is the first head movement control mode, the steps of determining a target display page of the head mounted display device according to the current head movement and the current display page of the head mounted display device, and switching the current display page to the target display page are performed.

[0132] In some embodiments, after acquiring the control mode identifier of the head mounted display device and determining the interactive control mode of the head mounted display device according to the control mode identifier, the processor 120 is further configured to implement:

[0133] When the interactive control mode is the first head movement control mode, determining whether the current head movement is a preset first head movement or a preset second head movement, the first head movement being different from the second head movement;

[0134] If the current head movement is the first head movement, the interactive control mode of the head-mounted display device is switched from the first head movement control mode to a manual control mode. In the manual control mode, the display page of the head-mounted display device is prohibited from changing with the change of the user's head movement.

[0135] In some embodiments, after determining whether the current head movement is a preset first head movement or a preset second head movement, the processor 120 is further configured to implement:

[0136] If the current head movement is the second head movement, the interactive control mode of the head-mounted display device is switched from the first head movement control mode to the second head movement control mode. In the second head movement control mode, the content in the current display page of the head-mounted display device can change with the change of the user's head movement.

[0137] In some embodiments, after acquiring the control mode identifier of the head mounted display device and determining the interactive control mode of the head mounted display device according to the control mode identifier, the processor 120 is further configured to implement:

[0138] When the interactive control mode is the second head movement control mode, obtaining a control instruction mapping table matching a current display page of the head mounted display device, wherein the control instruction mapping table is used to describe a mapping relationship between head movements and preset control instructions;

[0139] A preset control instruction corresponding to the current head movement is obtained from the control instruction mapping table as a target control instruction, and the target control instruction is executed in response to the current head movement.

[0140] In some embodiments, the posture data includes a first angular velocity and a second angular velocity of the head mounted display device, the first angular velocity is opposite to the second angular velocity, and the processor 120, when determining a current head movement of a user wearing the head mounted display device according to the posture data, is used to implement:

[0141] When the absolute value and / or modulus of the first angular velocity and the absolute value and / or modulus of the second angular velocity are both greater than or equal to a preset first threshold, performing Euler integration on the first angular velocity to obtain a first rotation angle of the user's head;

[0142] When the absolute value of the first rotation angle is greater than a preset second threshold or is within a preset value range, performing Euler integration on the second angular velocity to obtain a second rotation angle of the user's head;

[0143] When the absolute value of the difference between the first rotation angle and the second rotation angle is smaller than a preset third threshold, it is determined that the current head movement of the user is turning the head and returning according to the first rotation angle and the second rotation angle.

[0144] It should be noted that technicians in the relevant field can clearly understand that for the convenience and brevity of description, the specific working process of the head-mounted display device described above can refer to the corresponding process in the aforementioned device control method embodiment, and will not be repeated here.

[0145] An embodiment of the present invention further provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any device control method provided in the description of the embodiment of the present invention.

[0146] The storage medium may be an internal storage unit of the head mounted display device described in the foregoing embodiment, such as a hard disk or memory of the head mounted display device. The storage medium may also be an external storage device of the head mounted display device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., provided on the head mounted display device.

[0147] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware embodiment, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those of ordinary skill in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0148] It should be understood that the term "and / or" used in the present specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system including the element.

[0149] The serial numbers of the embodiments of the present invention are only for description and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A device control method, characterized in that: Applied to a head mounted display device, the method comprises: Acquiring posture data of the head mounted display device; determining a current head movement of a user wearing the head mounted display device according to the posture data; According to the current head movement and the current display page of the head mounted display device, a target display page of the head mounted display device is determined, and the current display page is switched to the target display page.

2. The device control method according to claim 1, characterized in that: The step of determining a target display page of the head mounted display device according to the current head movement and the current display page of the head mounted display device comprises: Acquire a head action mapping table that matches a current display page of the head mounted display device, wherein the head action mapping table is used to describe a mapping relationship between head actions and page identification information; The page identification information corresponding to the current head action is obtained from the head action mapping table as the target identification information, and the target display page is determined according to the target identification information.

3. The device control method according to claim 2, characterized in that: The step of determining the target display page according to the target identification information includes: When the type identifier included in the page identification information is a first type identifier, obtaining a desktop display page corresponding to the page identifier included in the page identification information, and determining the desktop display page as the target display page; Alternatively, when the type identifier included in the page identification information is a second type identifier, an application display page corresponding to the application identifier and the page identifier included in the page identification information is obtained, and the application display page is determined as the target display page.

4. The device control method according to any one of claims 1 to 3, characterized in that: After determining the current head movement of the user wearing the head mounted display device according to the posture data, the method further includes: Acquire a control mode identifier of the head mounted display device, and determine an interactive control mode of the head mounted display device according to the control mode identifier; When the interactive control mode is the first head movement control mode, the steps of determining a target display page of the head mounted display device according to the current head movement and the current display page of the head mounted display device, and switching the current display page to the target display page are performed.

5. The device control method according to claim 4, characterized in that: After obtaining the control mode identifier of the head mounted display device and determining the interactive control mode of the head mounted display device according to the control mode identifier, the method further includes: When the interactive control mode is the first head movement control mode, determining whether the current head movement is a preset first head movement or a preset second head movement, the first head movement being different from the second head movement; If the current head movement is the first head movement, the interactive control mode of the head-mounted display device is switched from the first head movement control mode to a manual control mode. In the manual control mode, the display page of the head-mounted display device is prohibited from changing with the change of the user's head movement.

6. The device control method according to claim 5, characterized in that: After determining whether the current head movement is a preset first head movement or a preset second head movement, the method further includes: If the current head movement is the second head movement, the interactive control mode of the head-mounted display device is switched from the first head movement control mode to the second head movement control mode. In the second head movement control mode, the content in the current display page of the head-mounted display device can change with the change of the user's head movement.

7. The device control method according to any one of claims 1 to 3, characterized in that: The posture data includes a first angular velocity and a second angular velocity of the head mounted display device, where the first angular velocity is opposite to the second angular velocity, and determining a current head motion of a user wearing the head mounted display device according to the posture data includes: When the absolute value and / or modulus of the first angular velocity and the absolute value and / or modulus of the second angular velocity are both greater than or equal to a preset first threshold, performing Euler integration on the first angular velocity to obtain a first rotation angle of the user's head; When the absolute value of the first rotation angle is greater than a preset second threshold or is within a preset value range, performing Euler integration on the second angular velocity to obtain a second rotation angle of the user's head; When the absolute value of the difference between the first rotation angle and the second rotation angle is smaller than a preset third threshold, it is determined that the current head movement of the user is turning the head and returning according to the first rotation angle and the second rotation angle.

8. A device control device, characterized in that: The equipment control device comprises: A data acquisition module, configured to acquire posture data of a head mounted display device; an action determination module, configured to determine a current head action of a user wearing the head mounted display device according to the posture data; a page determination module, configured to determine a target display page of the head mounted display device according to the current head movement and the current display page of the head mounted display device; The page switching module is configured to switch the current display page to the target display page.

9. A head mounted display device, characterized in that: The head-mounted display device includes a display device, a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for realizing connection and communication between the display device, the processor and the memory, wherein when the computer program is executed by the processor, the device control method according to any one of claims 1 to 7 is realized.

10. A storage medium for computer-readable storage, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the device control method according to any one of claims 1 to 7.

Images