Head-mounted display device control method, apparatus, device, and readable storage medium
By setting up multiple vibrators in the head-mounted display device and controlling their vibration direction and intensity according to scene data, the problem of immersive experience in the tactile aspect of VR products is solved, realizing an immersive experience that combines tactile and visual sensations.
Patent Information
- Application Number
- CN202210593383.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-27
- Publication Date
- 2026-01-23
- Estimated Expiration
- 2042-05-27
AI Technical Summary
Existing VR products cannot enhance the immersive experience in terms of haptic feedback.
By setting multiple vibrators in a head-mounted display device, the action type, direction, and intensity of the operation are determined based on scene data of a preset scenario. The vibrators are then controlled to vibrate in a specific direction and intensity to simulate the tactile sensation of operation in a real scenario.
It achieves an immersive tactile experience for head-mounted displays, combined with visual effects, to provide a more immersive user experience.
Smart Images

Figure CN115268625B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of virtual reality device technology, and more specifically, to a control method, apparatus, device, and readable storage medium for a head-mounted display device. Background Technology
[0002] With the rapid development of Virtual Reality (VR) technology, VR products are being used more and more widely, and people are placing higher demands on their performance. For example, the immersive experience offered by VR products.
[0003] In related technologies, VR products equipped with 4K or Micro LED displays can effectively avoid pixelation and mesh-like effects, enabling users to experience a truly immersive visual experience. However, current technological improvements only enhance the visual immersive experience of VR products, failing to improve it through tactile feedback.
[0004] Therefore, it is necessary to provide a new control method for head-mounted display devices. Summary of the Invention
[0005] The purpose of this disclosure is to provide a control method, apparatus, device, and readable storage medium for a head-mounted display device, in order to solve the problem that the prior art cannot improve the immersive experience of VR products from the perspective of touch.
[0006] According to a first aspect of the present disclosure, a control method for a head-mounted display device is provided, the head-mounted display device including a plurality of vibrators, each vibrator capable of vibrating along a preset direction, the method comprising:
[0007] When the head-mounted display device is running a preset scene, based on the scene data of the preset scene, action information of the operation action performed by the second object on the first object is determined, and the action information includes action type, action direction and action intensity;
[0008] Based on the direction of motion, a target vibrator is determined from the plurality of vibrators;
[0009] Based on the control method corresponding to the action type, the target vibrator is controlled to work according to the action direction and the action intensity;
[0010] The first object is a virtual object corresponding to the wearer of the head-mounted display device in the preset scenario, and the second object is different from the first object.
[0011] Optionally, the control method based on the action type, controlling the target vibrator to operate according to the action direction and the action intensity, includes:
[0012] The direction of vibration is determined based on the direction of the action.
[0013] The vibration intensity is determined based on the intensity of the action.
[0014] Based on the control method corresponding to the action type, the target vibrator is controlled to vibrate along the vibration direction with the vibration intensity.
[0015] Optionally, the plurality of vibrators includes at least two target vibrators. When the action type is the first type, controlling the target vibrator to vibrate along the vibration direction with the vibration intensity based on the control method corresponding to the action type includes:
[0016] The first target vibrator and the second target vibrator are sequentially triggered to vibrate along the vibration direction at the specified vibration intensity.
[0017] Wherein, the first target vibrator is the target vibrator closer to the second object among the at least two target vibrators, and the second target vibrator is the target vibrator away from the second object among the at least two target vibrators.
[0018] Optionally, the step of sequentially triggering the first target vibrator and the second target vibrator to vibrate along the vibration direction at the vibration intensity includes:
[0019] At the first moment, the first target vibrator is triggered to vibrate along the vibration direction at the vibration intensity;
[0020] At the second moment, the second target vibrator is triggered to vibrate along the vibration direction at the vibration intensity;
[0021] Wherein, the second moment is later than the first moment, and the time interval between the second moment and the first moment is the first delay duration.
[0022] Optionally, the plurality of vibrators includes at least two target vibrators. When the action type is the second type, controlling the target vibrator to vibrate along the vibration direction with the vibration intensity based on the control method corresponding to the action type includes:
[0023] Simultaneously trigger the first target vibrator and the second target vibrator to vibrate along the vibration direction at the vibration intensity;
[0024] Wherein, the first target vibrator is the target vibrator closer to the second object among the at least two target vibrators, and the second target vibrator is the target vibrator away from the second object among the at least two target vibrators.
[0025] Optionally, determining the target vibrator from the plurality of vibrators based on the direction of motion includes:
[0026] When the direction of action is the first direction, the vibrator located in the first direction among the plurality of vibrators is identified as the target vibrator;
[0027] When the direction of action is the second direction, the vibrator corresponding to the second direction among the plurality of vibrators is identified as the target vibrator;
[0028] Wherein, the first direction is the vibration direction generated by any one of the plurality of vibrators, and the second direction is different from the first direction.
[0029] Optionally, the head-mounted display device includes two first vibrators arranged opposite each other along a first preset direction and two second vibrators arranged opposite each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction; determining the target vibrator from the plurality of vibrators according to the direction of motion includes:
[0030] When the direction of motion is the first preset direction, the two first vibrators are determined as target vibrators, wherein the first target vibrator is the vibrator that is closer to the second object among the two first vibrators, and the second target vibrator is the vibrator that is away from the second object among the two first vibrators;
[0031] When the direction of motion is the second preset direction, the two second vibrators are identified as target vibrators, wherein the first target vibrator is the vibrator closer to the second object among the two second vibrators, and the second target vibrator is the vibrator away from the second object among the two second vibrators.
[0032] Optionally, the head-mounted display device includes two first vibrators arranged opposite each other along a first preset direction and two second vibrators arranged opposite each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction; determining the target vibrator from the plurality of vibrators according to the direction of motion includes:
[0033] When the direction of motion is inconsistent with both the first and second preset directions, both the first and second vibrators are identified as target vibrators.
[0034] The first target vibrator includes the vibrator closer to the second object among the two first vibrators and the vibrator closer to the second object among the two second vibrators;
[0035] The second target vibrator includes the vibrator that is away from the second object among the two first vibrators and the vibrator that is away from the second object among the two second vibrators.
[0036] Optionally, determining the vibration direction based on the direction of the action includes:
[0037] The vibration direction is determined based on the angle between the direction of the action and the set direction;
[0038] The set direction is the vibration direction generated by any one of the plurality of vibrators.
[0039] Optionally, determining the vibration intensity based on the action intensity includes:
[0040] The vibration intensity is determined based on the intensity of the action and the angle between the direction of the action and the set direction.
[0041] The set direction is the vibration direction generated by any one of the plurality of vibrators.
[0042] According to a second aspect of the present disclosure, a control device for a head-mounted display device is provided, the head-mounted display device including a plurality of vibrators, each vibrator capable of vibrating along a preset direction, the device comprising:
[0043] The first determining module is used to determine, based on scene data of the preset scene, the action information of the operation performed by the second object on the first object when the head-mounted display device is running a preset scene. The action information includes action type, action direction and action intensity.
[0044] The second determining module is used to determine the target vibrator from the plurality of vibrators according to the direction of the action;
[0045] The control module is used to control the target vibrator to work based on the control method corresponding to the action type, according to the action direction and the action intensity;
[0046] The first object is a virtual object corresponding to the wearer of the head-mounted display device in the preset scenario, and the second object is different from the first object.
[0047] According to a third aspect of the present disclosure, a head-mounted display device is provided, comprising:
[0048] Memory is used to store executable computer instructions;
[0049] A processor is configured to execute, under the control of the executable computer instructions, a control method for a head-mounted display device as described in the first aspect of the present disclosure.
[0050] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided having computer instructions stored thereon, which, when executed by a processor, perform the control method for a head-mounted display device as described in the first aspect of the present disclosure.
[0051] According to embodiments of this disclosure, when a head-mounted display device operates in a preset scenario, the action type, direction, and intensity of the operation performed by the second object on the first object are determined based on the scenario data. Based on the action direction, a target vibrator is selected from multiple vibrators. The target vibrator is then controlled to operate according to the action type and the direction and intensity of the action, using a control method corresponding to the action type. In this way, the control method of the vibrator can be determined based on the action type, allowing the target vibrator among multiple vibrators to operate according to the corresponding control method. This enables precise control of the head-mounted display device to generate directional tactile feedback and simulates the tactile feedback brought about by operations in a real-world scenario. Therefore, combined with the application scenario of the head-mounted device, it can provide users with an immersive experience. Furthermore, this embodiment has a simple structure and low cost.
[0052] Other features and advantages of the embodiments of the present disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description
[0053] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings used in the embodiments will be briefly described below. It should be understood that the following drawings only show some embodiments of this disclosure and should not be considered as limiting the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0054] Figure 1 This is a schematic diagram of the structure of a head-mounted display device according to one embodiment;
[0055] Figure 2 This is a schematic diagram of a vibrator in a folded-off state according to one embodiment;
[0056] Figure 3 This is one of the schematic diagrams of a vibrator in a vibrating state according to one embodiment;
[0057] Figure 4This is a second schematic diagram of a vibrator in a vibrating state according to one embodiment;
[0058] Figure 5 This is one of the schematic diagrams illustrating a use case of a head-mounted display device according to one embodiment;
[0059] Figure 6 This is a second schematic diagram illustrating a usage scenario of a head-mounted display device according to one embodiment;
[0060] Figure 7 This is a flowchart illustrating a control method for a head-mounted display device according to one embodiment;
[0061] Figure 8 This is a schematic block diagram of a control device for a head-mounted display device according to one embodiment;
[0062] Figure 9 This is a schematic block diagram of a head-mounted display device according to one embodiment. Detailed Implementation
[0063] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values of the components and steps set forth in these embodiments do not limit the scope of the embodiments of the present disclosure.
[0064] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit this disclosure or its application or use.
[0065] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.
[0066] In all the examples shown and discussed herein, any specific values should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.
[0067] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.
[0068] Hereinafter, various embodiments and examples according to the present disclosure will be described with reference to the accompanying drawings.
[0069] This disclosure provides a control method for a head-mounted display device. The control method is implemented by the head-mounted display device. The head-mounted display device used to implement the control method is described below.
[0070] Please see Figure 1The head-mounted display device 10 includes a device body 11 and a vibrator 12. The vibrator 12 is disposed in the device body and can vibrate in a preset direction.
[0071] In this embodiment, the vibrator 12 can be a bidirectional linear vibrator. The working principle of the vibrator will be explained using a bidirectional linear vibrator as an example. Figure 2 As shown, when the vibrator is not powered on, it is in the neutral state, meaning it is in the middle position; as... Figure 3 As shown, a positive voltage is input to the vibrator, causing the vibrator to move to the right; as Figure 4 As shown, a reverse voltage is input to the vibrator, causing it to move to the left. Based on this, the operation of vibrator 12 can be controlled by adjusting the direction and magnitude of the voltage input to the vibrator.
[0072] In this embodiment, the head-mounted display device 10 may be equipped with multiple vibrators 12, which may vibrate in different directions. The number of vibrators 12 may be set by those skilled in the art according to actual needs, such as 4, 6, etc.
[0073] For example, such as Figure 1 As shown, the head-mounted display device 11 contains four vibrators: vibrators 12a, 12b, 12c, and 12d. Vibrators 12a and 12b are positioned along the N-axis and can vibrate along the N-axis. Vibrators 12c and 12d are positioned along the M-axis and can vibrate along the M-axis. In other words, when a user uses the head-mounted display device, vibrators 12a and 12b are located on the front and back sides of the wearer, respectively, and can vibrate in the front-back direction. Vibrators 12c and 12d are located on the left and right sides of the wearer, respectively, and can vibrate in the left-right direction. By controlling the operation of vibrators 12a, 12b, 12c, and 12d, an immersive tactile experience can be provided to the user.
[0074] For example, the head-mounted display device body 11 is provided with six vibrators, namely vibrator 12a, vibrator 12b, vibrator 12c, vibrator 12d, vibrator 12e, and vibrator 12d. Vibrator 12a and vibrator 12b are arranged along the N-axis (see [reference]). Figure 1 Furthermore, vibrators 12a and 12b can vibrate along the N-axis, while vibrators 12c and 12d are arranged along the M-axis (see [reference]). Figure 1Furthermore, vibrators 12c and 12d can vibrate along the M-axis, and vibrators 12e and 12f are arranged along the Z-axis (not shown in the figure), and vibrators 12e and 12f can vibrate along the Z-axis, wherein the Z-axis is a plane perpendicular to the N-axis and the M-axis.
[0075] The following uses a shooting game scenario as an example to illustrate the working process of the head-mounted display device provided in this embodiment.
[0076] Please see Figure 5 When a user is shooting a game using a head-mounted display device, if the user is shot from the front (directly below the screen) in the shooting game scene, and the shot is penetrating, vibrator 12a is triggered to vibrate behind the user (i.e., above the screen). After a preset delay, vibrator 12b is triggered to vibrate behind the user (i.e., above the screen). If the shot is not penetrating, both vibrators 12a and 12b are triggered to vibrate behind the user (i.e., above the screen) simultaneously.
[0077] Please see Figure 6 When a user is shooting a game using a head-mounted display device, if the user is shot from the right front (lower left of the screen) in the shooting game scene, and the shot is penetrating, vibrator 12a is triggered to vibrate behind the user (i.e., above the screen), and vibrator 12d is triggered to vibrate to the user's left (i.e., right side of the screen). After a preset delay, vibrator 12b is triggered to vibrate behind the user (i.e., above the screen), and vibrator 12c is triggered to vibrate to the user's left (i.e., right side of the screen). If the shot is not penetrating, vibrators 12a and 12d are triggered to vibrate behind the user (i.e., above the screen), and vibrators 12b and 12c are triggered to vibrate to the user's left (i.e., right side of the screen).
[0078] According to an embodiment of this disclosure, the head-mounted display device includes a device body and a vibrator. The vibrator is disposed within the device body and can vibrate in a preset direction. When the head-mounted display device is running a preset scene, based on scene data of the preset scene, the action type, direction, and intensity of the operation performed by the second object on the first object are determined. Based on the action direction, a target vibrator is determined from multiple vibrators. The target vibrator is then controlled to operate according to the control method corresponding to the action type, based on the action direction and intensity. In this way, the control method of the vibrator can be determined according to the action type of the operation, and the target vibrator among multiple vibrators can be controlled to operate according to the corresponding control method. This allows for precise control of the head-mounted display device to generate directional tactile feedback, and can simulate the tactile feedback brought about by operation actions in a real scene. Therefore, combined with the application scenario of the head-mounted device, it can provide users with an immersive experience. In addition, this embodiment has a simple structure and low cost.
[0079] <Method Implementation>
[0080] Figure 7 A flowchart illustrating a control method for a head-mounted display device according to an embodiment of this disclosure is shown. This control method is applied to the head-mounted display device described in the above embodiment. The head-mounted display device includes multiple vibrators, each capable of vibrating in a preset direction. Figure 7 As shown, the control method for the head-mounted display device provided in this embodiment may include the following steps S7100 to S7300.
[0081] Step S7100: When the head-mounted display device is running a preset scene, determine the action information of the operation action performed by the second object on the first object based on the scene data of the preset scene. The action information includes the action type, action direction and action intensity.
[0082] In this embodiment, the preset scenario can be a shooting game scenario, a boxing game scenario, etc. For example, a first-person shooting game (FPS) scenario.
[0083] The first object is a virtual object corresponding to the wearer (user) of the head-mounted display device in a preset scenario. The second object is different from the first object. The second object is a virtual object in the preset scenario other than the first object. The second object can be a subject of a different type from the first object. For example, the second object could be other characters in a shooting game scenario. The operation performed by the second object on the first object can be an operation issued by the second object to the first object. For example, in a shooting game scenario, the operation performed by the second object on the first object could be a shooting action by the second object on the first object; for example, in a boxing game scenario, the operation performed by the second object on the first object could be a punching action by the second object on the first object.
[0084] The action information of the operation performed by the second object on the first object can include the action type, action direction, and action intensity. Taking a shooting game scenario as an example, the action type can be divided into a first type and a second type. The first type is a penetrating type, meaning the bullet penetrates the first object's head, and the second type is a non-penetrating type, meaning the bullet does not penetrate the first object's head. The action direction can be the shooting direction, such as a frontal direction or a non-frontal direction. The action intensity can be, for example, the intensity of a shooting action or the force of a punching action.
[0085] The scene data for the preset scenario can include attribute information of the first object and action data of the operation performed by the second object on the first object. Taking shooting as an example, the attribute information of the first object may include its health points, and the action data may include aiming data and weapon data. Based on the aiming data of the shooting action, the direction of the action can be determined. Based on the health points and weapon data of the first object, the action type and intensity can be determined.
[0086] Step S7200: Determine the target vibrator from the plurality of vibrators according to the direction of motion.
[0087] The target vibrator is one of multiple vibrators that can vibrate along the direction of action. There can be one or more target vibrators. In specific implementation, after determining the direction of the operation performed by the second object on the first object, the vibration direction that each of the multiple vibrators can produce can be compared with the direction of action, and the vibrator that can vibrate along the direction of action can be designated as the target vibrator. A specific embodiment will be described below.
[0088] In one embodiment, determining the target vibrator from the plurality of vibrators according to the direction of motion may further include: when the direction of motion is a first direction, determining the vibrator located in the first direction among the plurality of vibrators as the target vibrator; wherein, the first direction is the vibration direction generated by any one of the plurality of vibrators.
[0089] In this embodiment, the first direction refers to the vibration direction generated by any one of the multiple vibrators. When the direction of the operation performed by the second object on the first object is the first direction, it means that the vibration direction generated by any one or more of the multiple vibrators is consistent with the direction of the operation performed by the second object on the first object. Therefore, the vibrator whose direction of operation is consistent with the first object's operation can be used as the target vibrator. For example, the first direction could mean that the second object shoots the first object from the front, from directly behind the first object, or from the side of the first object.
[0090] In an optional embodiment, the head-mounted display device includes two first vibrators disposed opposite each other along a first preset direction and two second vibrators disposed opposite each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction; the step of determining a target vibrator from the plurality of vibrators according to the direction of motion may further include: when the direction of motion is the first preset direction, determining the two first vibrators as target vibrators, wherein the first target vibrator is the vibrator closer to the second object among the two first vibrators, and the second target vibrator is the vibrator away from the second object among the two first vibrators; and when the direction of motion is the second preset direction, determining the two second vibrators as target vibrators, wherein the first target vibrator is the vibrator closer to the second object among the two second vibrators, and the second target vibrator is the vibrator away from the second object among the two second vibrators.
[0091] For example, please see Figure 5 This is a top view of a shooting game scene provided in an embodiment of this disclosure. Specifically, as shown... Figure 5As shown, the head-mounted display device includes four vibrators: vibrator 12a, vibrator 12b, vibrator 12c, and vibrator 12d. Vibrators 12a and 12b are positioned opposite each other along a first preset direction (N-axis) and can vibrate back and forth along the first preset direction (N-axis). Vibrators 12c and 12d are positioned opposite each other along a second preset direction (M-axis) and can vibrate left and right along the second preset direction (M-axis). The operation performed by the second object on the first object is a shooting action, with the shooting direction (as shown by the arrow in the figure) directly in front of the first object (the wearer of the head-mounted display device). Based on this shooting direction, vibrators 12a and 12b can be used as target vibrators. The first target vibrator is vibrator 12a, which is closer to the second object, and the second target vibrator is vibrator 12b, which is closer to the second object.
[0092] In one embodiment, determining the target vibrator from the plurality of vibrators according to the direction of motion may further include: when the direction of motion is a second direction, determining the vibrator from the plurality of vibrators that corresponds to the second direction as the target vibrator; wherein the second direction is different from the first direction.
[0093] In this embodiment, the second direction is different from the first direction; that is, none of the multiple vibrators has a direction of motion consistent with the operation performed by the second object on the first object. The case where the operation direction is the second direction refers to any situation other than the first direction. For example, the second object shoots the first object from a non-frontal angle. When the operation performed by the second object on the first object has a second direction of motion, the target vibrator can be determined based on the angle between the operation direction and the vibration direction that each of the multiple vibrators can produce.
[0094] In another optional embodiment, the head-mounted display device includes two first vibrators disposed opposite each other along a first preset direction and two second vibrators disposed opposite each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction; the step of determining the target vibrator from the plurality of vibrators according to the direction of motion may further include: when the direction of motion is inconsistent with both the first and second preset directions, determining both the two first vibrators and the two second vibrators as target vibrators; wherein the first target vibrator includes the vibrator closer to the second object among the two first vibrators and the vibrator closer to the second object among the two second vibrators; the second target vibrator includes the vibrator away from the second object among the two first vibrators and the vibrator away from the second object among the two second vibrators.
[0095] For example, please see Figure 6 This is a top view of a shooting game scene provided in an embodiment of this disclosure. Specifically, as shown... Figure 6 As shown, the head-mounted display device is equipped with four vibrators: vibrator 12a, vibrator 12b, vibrator 12c, and vibrator 12d. Vibrator 12a and vibrator 12b are arranged opposite each other along a first preset direction (N-axis) and can vibrate back and forth along the first preset direction (N-axis). Vibrator 12c and vibrator 12d are arranged opposite each other along a second preset direction (M-axis) and can vibrate back and forth along the second preset direction (M-axis). The operation performed by the second object on the first object is a shooting action. The shooting position is in front right of the first object (the wearer of the head-mounted display device) (lower left side of the screen), and the shooting direction (as shown by the arrow in the figure) is towards the rear left of the first object (the wearer of the head-mounted display device) (upper right side of the screen). Since the angle between the firing direction and the N-axis is not 90°, and the angle between the firing direction and the M-axis is also not 90°, vibrators 12a, 12b, 12c, and 12d are all target vibrators. Specifically, the first target vibrator includes vibrators 12a and 12d located near the second target, and the second target vibrator includes vibrators 12b and 12c located near the second target.
[0096] Taking a head-mounted display device comprising six vibrators as an example, the head-mounted display device is equipped with six vibrators, namely vibrator 12a, vibrator 12b, vibrator 12c, vibrator 12d, vibrator 12e, and vibrator 12d. Vibrators 12a and 12b are arranged along the N-axis (see...). Figure 1 Furthermore, vibrators 12a and 12b can vibrate along the N-axis, while vibrators 12c and 12d are arranged along the M-axis (see [reference]). Figure 1 Furthermore, vibrators 12c and 12d can vibrate along the M-axis, and vibrators 12e and 12f are arranged along the Z-axis (not shown in the figure), where the Z-axis is a plane perpendicular to the N-axis and the M-axis. Assuming the operation performed by the second object on the first object is a punching motion, for example, the second object punches the first object (the wearer of the head-mounted display device) from the lower right, since the angle between the striking direction and the N-axis is not 90°, the angle between the striking direction and the M-axis is not 90°, and the angle between the striking direction and the Z-axis is not 90°, vibrators 12a, 12b, 12c, 12d, 12e, and 12f are all target vibrators.
[0097] In this embodiment, a target vibrator is determined from multiple vibrators based on the direction of motion. By controlling the target vibrator, the head-mounted display device can be driven to vibrate in the corresponding direction, thereby providing the user with an immersive experience.
[0098] After step 7200, step S7300 is executed, which controls the target vibrator to work based on the control method corresponding to the action type, according to the action direction and the action intensity.
[0099] In one embodiment, controlling the target vibrator to operate based on the control method corresponding to the action type, according to the action direction and the action intensity, may further include: determining the vibration direction based on the action direction; determining the vibration intensity based on the action intensity; and controlling the target vibrator to vibrate along the vibration direction at the vibration intensity based on the control method corresponding to the action type.
[0100] In one embodiment, determining the vibration direction based on the direction of motion may further include: determining the vibration direction based on the angle between the direction of motion and a set direction; wherein the set direction is the vibration direction generated by any one of the plurality of vibrators.
[0101] The set direction can be the direction in which the vibrator generates vibration. Based on the angle between the action direction and the set direction, the component of the action direction in the set direction can be determined, thereby determining the vibration direction of the vibrator.
[0102] In a head-mounted display device equipped with multiple vibrators capable of vibrating in different directions, the direction setting can include the direction in which each vibrator can generate vibration. For example, such as... Figure 1 As shown, the head-mounted display device includes four vibrators: vibrator 12a, vibrator 12b, vibrator 12c, and vibrator 12d. Vibrators 12a and 12b vibrate along the N-axis, while vibrators 12c and 12d vibrate along the M-axis. The set direction can include both the N-axis extension direction and the M-axis extension direction. The vibration direction of the target vibrator can be determined based on the angle between the action direction and the set direction, i.e., the angle between the action direction and the N-axis and the angle between the action direction and the M-axis.
[0103] by Figure 6 Taking the shooting scenario shown as an example, the vector f0 in the figure represents the direction of the operation action. The angle between the vector f0 and the N-axis is α, and the angle between the vector f0 and the M-axis is β. Based on the angle α, the vibration directions of vibrators 12a and 12b can be determined. Based on the angle β, the vibration directions of vibrators 12c and 12d can be determined.
[0104] In this embodiment, the vibration direction of the target vibrator is determined based on the angle between the action direction and the set direction, where the set direction is the vibration direction generated by any one of the multiple vibrators. This allows for accurate determination of the vibration direction, enabling control of the corresponding target vibrator and precise control of the head-mounted display device to generate directional vibrations, thus providing the user with an immersive experience.
[0105] In one embodiment, determining the vibration intensity based on the action intensity may further include: determining the vibration intensity based on the action intensity and the angle between the action direction and a set direction; wherein the set direction is the vibration direction generated by any one of the plurality of vibrators.
[0106] Action intensity can be, for example, the intensity of a shooting action or the force of a boxing action. Taking shooting as an example, the action intensity can be determined based on the target's health and weapon data.
[0107] The smaller the angle between the direction of motion and the set direction, the larger the component of the direction of motion in the set direction, and the greater the vibration intensity of the target vibrator in that set direction. Conversely, the larger the angle between the direction of motion and the set direction, the smaller the component of the direction of motion in the set direction, and the smaller the vibration intensity of the target vibrator in that set direction. Therefore, based on the angle between the direction of motion and the set direction, the component of the direction of motion in the set direction can be determined. And based on the component of the direction of motion in the set direction and the motion intensity, the vibration intensity of the target vibrator can be determined.
[0108] Continue with Figure 6 Taking the shooting scenario shown as an example, the vector f0 in the figure represents the direction of the operation action. The angle between the vector f0 and the N-axis is α, and the angle between the vector f0 and the M-axis is β. Based on the angle α, the vibration direction and intensity of vibrators 12a and 12b can be determined. Based on the angle β, the vibration direction and intensity of vibrators 12c and 12d can be determined. Specifically, the vibration intensity of vibrators 12a and 12b is determined based on the angle α, that is, f... n =f0*cosα; Determine the vibration intensity of vibrator 12c and vibrator 12d based on the included angle β, that is, f m =f0*cosβ, where f0 is the intensity of the operating action. It should be noted that the vibration direction and intensity of the target vibrator can be controlled by adjusting the direction and magnitude of the input voltage.
[0109] In this embodiment, the vibration intensity is determined based on the angle between the action intensity, the action direction, and the set direction; wherein, the set direction is the vibration direction generated by any one of the multiple vibrators. This allows for accurate determination of the vibration intensity to control the operation of the corresponding vibration unit, thereby precisely controlling the directional vibration generated by the head-mounted display device, resulting in a better user experience.
[0110] In this embodiment, the action types of the operation include a first type and a second type. Taking a shooting action as an example, the first type is a penetration type, that is, the bullet penetrates the head of the first target, and the second type is a non-penetration type, that is, the bullet does not penetrate the head of the first target. The action type of the shooting action can be determined based on the first target's health and the weapon's data. Depending on the action type of the operation, the target vibrator can be controlled to vibrate in a corresponding way to simulate different types of operation actions, thereby providing the user with an immersive experience. A specific embodiment will be described below.
[0111] In one embodiment, the plurality of vibrators includes at least two target vibrators. When the action type is a first type, controlling the target vibrator to vibrate along the vibration direction with the vibration intensity based on the control method corresponding to the action type includes: sequentially triggering the first target vibrator and the second target vibrator to vibrate along the vibration direction with the vibration intensity.
[0112] The first target vibrator is the one closest to the second object among at least two target vibrators. The second target vibrator is the one furthest from the second object among at least two target vibrators.
[0113] Continue with Figure 5 Taking the shooting scenario shown as an example, the operation performed by the second object on the first object is a shooting action, and the shooting direction (as shown by the arrow in the figure) is directly in front of the first object (the wearer of the head-mounted display device). For this purpose, the target vibrator includes vibrator 12a and vibrator 12b, where vibrator 12a is the first target vibrator and vibrator 12b is the second target vibrator.
[0114] Continue with Figure 6 Taking the shooting scenario shown as an example, the action performed by the second object on the first object is a shooting action. The shooting position is in front of the right side of the first object (the wearer of the head-mounted display device, lower left side of the screen), and the shooting direction (as shown by the arrow in the figure) is towards the left rear side of the first object (the wearer of the head-mounted display device, upper right side of the screen). For this purpose, the target vibrators include vibrators 12a, 12b, 12c, and 12d, where vibrators 12a and 12d are the first target vibrators, and vibrators 12b and 12c are the second target vibrators.
[0115] In a more specific example, the step of sequentially triggering the first target vibrator and the second target vibrator to vibrate along the vibration direction at the vibration intensity may further include: triggering the first target vibrator to vibrate along the vibration direction at the vibration intensity at a first moment; and triggering the second target vibrator to vibrate along the vibration direction at the vibration intensity at a second moment; wherein the second moment is later than the first moment, and the time interval between the second moment and the first moment is a first delay duration.
[0116] The first moment is the moment when the operation is detected. Alternatively, the first moment can also be a moment delayed by a predetermined period after the moment when the operation is detected.
[0117] In specific implementation, when an operation action performed by the second object on the first object is detected, a target vibrator is determined based on the direction of the operation action. The first target vibrator, which is closer to the second object, is controlled to vibrate along the vibration direction. Timing begins at the moment the first target vibrator is triggered to operate. At the second moment, the second target vibrator, which is farther from the second object, is controlled to vibrate along the vibration direction. It should be noted that the first delay duration can be set based on practical experience; for example, the first delay duration is 1 ms. This embodiment does not limit this setting.
[0118] Continue with Figure 5 Taking the shooting scenario shown as an example, when the action type of the operation performed by the second object on the first object is type one, when the operation is detected, a positive voltage is input to the vibrator 12a to trigger the vibrator 12a to vibrate along the N-axis behind the first object. After a first delay, that is, at the second moment, a positive voltage is input to the vibrator 12b to trigger the vibrator 12b to vibrate along the N-axis behind the first object. In this way, the effect of a bullet penetrating the head can be simulated.
[0119] Continue with Figure 6Taking the shooting scenario shown as an example, when the operation action performed by the second object on the first object is of type 1, upon detecting the operation action, i.e., at the first moment, a positive voltage is input to vibrator 12a to trigger vibrator 12a to vibrate along the N-axis behind the first object (upper part of the figure), and simultaneously a positive voltage is input to vibrator 12d to trigger vibrator 12d to vibrate along the M-axis to the left side of the first object (right side of the figure); at the second moment, i.e., after a first delay, a positive voltage is input to vibrator 12b to trigger vibrator 12b to vibrate along the N-axis behind the first object (upper part of the figure), and simultaneously a positive voltage is input to vibrator 12c to trigger vibrator 12c to vibrate along the M-axis to the left side of the first object (right side of the figure). It should be noted that the vibration direction and intensity of the target vibrator can be controlled by controlling the direction and magnitude of the input voltage to the target vibrator.
[0120] In this embodiment, when the action type is the first type, the first target vibrator is triggered to vibrate along the vibration direction with vibration intensity at the first moment, and the second target vibrator is triggered to vibrate along the vibration direction with vibration intensity at the second moment. In this way, the vibrator can be triggered to vibrate according to the action type of the operation action in the preset scenario, which can realistically simulate the tactile sensation brought by the operation action in the actual scenario, thereby bringing the user an immersive experience.
[0121] In another, more specific example, the plurality of vibrators includes at least two target vibrators. When the action type is the second type, controlling the target vibrator to vibrate along the vibration direction with the vibration intensity based on the control method corresponding to the action type may further include: simultaneously triggering the first target vibrator and the second target vibrator to vibrate along the vibration direction with the vibration intensity; wherein, the first target vibrator is the target vibrator closer to the second object among the at least two target vibrators, and the second target vibrator is the target vibrator away from the second object among the at least two target vibrators.
[0122] In specific implementation, when an operation action performed by the second object on the first object is detected, the target vibrator is determined according to the direction of the operation action, and the first target vibrator close to the second object and the second target vibrator away from the second object are triggered to vibrate along the vibration direction.
[0123] Continue with Figure 5 Taking the shooting scenario shown as an example, when the action type of the operation performed by the second object on the first object is the second type, when the operation action is detected, vibrators 12a and 12b are simultaneously triggered to vibrate along the N-axis behind the first object, so as to simulate the effect of a bullet penetrating the head.
[0124] Continue with Figure 6 Taking the shooting scenario shown as an example, when the operation action performed by the second object on the first object is of the second type, when the operation action is detected, vibrators 12a and 12b are simultaneously triggered to vibrate along the N-axis behind the first object (upper part of the figure), and vibrators 12c and 12d are triggered to vibrate along the M-axis to the left side of the first object (right side of the figure). In this way, the effect of a bullet penetrating the head can be simulated.
[0125] In this embodiment, when the action type is the second type, the first target vibrator and the second target vibrator are simultaneously triggered to vibrate along the vibration direction with vibration intensity. In this way, the vibrator can be triggered to vibrate according to the action type of the operation action in the preset scenario, which can realistically simulate the tactile sensation brought by the operation action in the actual scenario, thereby bringing the user an immersive experience.
[0126] According to embodiments of this disclosure, when a head-mounted display device operates in a preset scenario, the action type, direction, and intensity of the operation performed by the second object on the first object are determined based on the scenario data. Based on the action direction, a target vibrator is selected from multiple vibrators. The target vibrator is then controlled to operate according to the action type and the direction and intensity of the action, using a control method corresponding to the action type. In this way, the control method of the vibrator can be determined based on the action type, allowing the target vibrator among multiple vibrators to operate according to the corresponding control method. This enables precise control of the head-mounted display device to generate directional tactile feedback and simulates the tactile feedback brought about by operations in a real-world scenario. Therefore, combined with the application scenario of the head-mounted device, it can provide users with an immersive experience. Furthermore, this embodiment has a simple structure and low cost.
[0127] <Device Embodiment>
[0128] This disclosure provides a control device for a head-mounted display device. This control device is applied to the head-mounted display device described in the above embodiments. The head-mounted display device includes multiple vibrators, each of which can vibrate along a preset direction. Figure 8 As shown, the control device 800 of the head-mounted display device may include a first determining module 810, a second determining module 820, and a control module 830.
[0129] The first determining module 810 is used to determine, based on scene data of the preset scene, the action information of the operation performed by the second object on the first object when the head-mounted display device is running a preset scene. The action information includes action type, action direction and action intensity.
[0130] The second determining module 820 is used to determine the target vibrator from the plurality of vibrators according to the direction of motion;
[0131] The control module 830 is used to control the target vibrator to work based on the control method corresponding to the action type, according to the action direction and the action intensity;
[0132] Wherein, the first object is a virtual object in the preset scene corresponding to the wearer of the head-mounted display device, and the second object is a virtual object in the preset scene other than the first object.
[0133] In one embodiment, the control module 830 includes:
[0134] The first determining unit is used to determine the vibration direction based on the direction of the action;
[0135] The second determining unit is used to determine the vibration intensity based on the action intensity;
[0136] The control unit is used to control the target vibrator to vibrate along the vibration direction with the vibration intensity based on the control mode corresponding to the action type.
[0137] In one embodiment, the plurality of vibrators includes at least two target vibrators. When the action type is a first type, the control unit is specifically configured to: sequentially trigger the first target vibrator and the second target vibrator to vibrate along the vibration direction at the vibration intensity; wherein, the first target vibrator is the target vibrator closer to the second object among the at least two target vibrators, and the second target vibrator is the target vibrator away from the second object among the at least two target vibrators.
[0138] In one embodiment, sequentially triggering the first target vibrator and the second target vibrator to vibrate along the vibration direction at the vibration intensity includes:
[0139] At the first moment, the first target vibrator is triggered to vibrate along the vibration direction at the vibration intensity;
[0140] At the second moment, the second target vibrator is triggered to vibrate along the vibration direction at the vibration intensity;
[0141] Wherein, the second moment is later than the first moment, and the time interval between the second moment and the first moment is the first delay duration.
[0142] In one embodiment, the plurality of vibrators includes at least two target vibrators. When the action type is the second type, the control unit is specifically configured to: simultaneously trigger the first target vibrator and the second target vibrator to vibrate along the vibration direction at the vibration intensity; wherein the first target vibrator is the target vibrator closer to the second object among the at least two target vibrators, and the second target vibrator is the target vibrator away from the second object among the at least two target vibrators.
[0143] In one embodiment, the second determining module 820 includes:
[0144] The third determining unit is used to determine the vibrator located in the first direction among the plurality of vibrators as the target vibrator when the direction of action is the first direction.
[0145] The fourth determining unit is used to determine the vibrator corresponding to the second direction among the plurality of vibrators as the target vibrator when the direction of action is the second direction;
[0146] Wherein, the first direction is the vibration direction generated by any one of the plurality of vibrators, and the second direction is different from the first direction.
[0147] In one embodiment, the head-mounted display device includes two first vibrators arranged opposite each other along a first preset direction and two second vibrators arranged opposite each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction; the second determining module 820 is specifically used for:
[0148] When the direction of motion is the first preset direction, the two first vibrators are determined as target vibrators, wherein the first target vibrator is the vibrator that is closer to the second object among the two first vibrators, and the second target vibrator is the vibrator that is away from the second object among the two first vibrators;
[0149] When the direction of motion is the second preset direction, the two second vibrators are identified as target vibrators, wherein the first target vibrator is the vibrator closer to the second object among the two second vibrators, and the second target vibrator is the vibrator away from the second object among the two second vibrators.
[0150] In one embodiment, the head-mounted display device includes two first vibrators arranged opposite each other along a first preset direction and two second vibrators arranged opposite each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction; the second determining module 820 is specifically used for:
[0151] When the direction of motion is inconsistent with both the first and second preset directions, both the first and second vibrators are identified as target vibrators.
[0152] The first target vibrator includes the vibrator closer to the second object among the two first vibrators and the vibrator closer to the second object among the two second vibrators;
[0153] The second target vibrator includes the vibrator that is away from the second object among the two first vibrators and the vibrator that is away from the second object among the two second vibrators.
[0154] In one embodiment, the first determining unit is specifically used to: determine the vibration direction based on the angle between the action direction and the set direction; wherein the set direction is the vibration direction generated by any one of the plurality of vibrators.
[0155] In one embodiment, the second determining unit is specifically used to: determine the vibration intensity based on the action intensity and the angle between the action direction and the set direction; wherein the set direction is the vibration direction generated by any one of the plurality of vibrators.
[0156] This disclosure also provides a head-mounted display device, such as... Figure 9 As shown, the head-mounted display device 900 may include a memory 910 and a processor 920.
[0157] The memory 910 can be used to store executable computer instructions.
[0158] The processor 920 can be used to execute the control method of the head-mounted display device according to the method embodiments of this disclosure, under the control of the executable computer instructions.
[0159] In one embodiment, each module of the control device 800 of the head-mounted display device can be implemented by the processor 920 running computer instructions stored in the memory 910.
[0160] According to embodiments of this disclosure, when a head-mounted display device operates in a preset scenario, the action type, direction, and intensity of the operation performed by the second object on the first object are determined based on the scenario data. Based on the action direction, a target vibrator is selected from multiple vibrators. The target vibrator is then controlled to operate according to the action type and the direction and intensity of the action, using a control method corresponding to the action type. In this way, the control method of the vibrator can be determined based on the action type, allowing the target vibrator among multiple vibrators to operate according to the corresponding control method. This enables precise control of the head-mounted display device to generate directional tactile feedback and simulates the tactile feedback brought about by operations in a real-world scenario. Therefore, combined with the application scenario of the head-mounted device, it can provide users with an immersive experience. Furthermore, this embodiment has a simple structure and low cost.
[0161] Computer-readable storage media
[0162] This disclosure also provides a computer-readable storage medium storing computer instructions thereon, which, when executed by a processor, perform the control method for the head-mounted display device provided in this disclosure.
[0163] Embodiments of this disclosure may be systems, methods, and / or computer program products. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the embodiments of this disclosure.
[0164] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.
[0165] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.
[0166] Computer program instructions used to perform the operations of embodiments of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on a user's computer, partially on a user's computer, as a standalone software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing state information from the computer-readable program instructions. This electronic circuitry can execute the computer-readable program instructions to implement various aspects of embodiments of this disclosure.
[0167] Various aspects of embodiments of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.
[0168] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0169] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.
[0170] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation in hardware, implementation in software, and implementation using a combination of software and hardware are equivalent.
[0171] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. The scope of the embodiments of this disclosure is defined by the appended claims.
Claims
1. A control method for a head-mounted display device, characterized in that, The head-mounted display device includes multiple vibrators, each of which can vibrate in a preset direction; the method includes: When the head-mounted display device is running a preset scene, based on the scene data of the preset scene, action information of the operation action performed by the second object on the first object is determined, and the action information includes action type, action direction and action intensity; Based on the direction of motion, a target vibrator is determined from the plurality of vibrators; Based on the control method corresponding to the action type, the target vibrator is controlled to work according to the action direction and the action intensity; Wherein, the first object is a virtual object corresponding to the wearer of the head-mounted display device in the preset scenario, and the second object is different from the first object; The control method based on the action type, which controls the target vibrator to operate according to the action direction and the action intensity, includes: The direction of vibration is determined based on the direction of the action. The vibration intensity is determined based on the intensity of the action. Based on the control method corresponding to the action type, the target vibrator is controlled to vibrate along the vibration direction with the vibration intensity, so as to control the head-mounted display device to generate directional vibration. Determining the vibration direction based on the direction of the action includes: The vibration direction is determined based on the angle between the direction of the action and the set direction; The set direction is the vibration direction generated by any one of the plurality of vibrators.
2. The method according to claim 1, characterized in that, The plurality of vibrators includes at least two target vibrators. When the action type is type one, controlling the target vibrators to vibrate along the vibration direction with the vibration intensity based on the control method corresponding to the action type includes: The first target vibrator and the second target vibrator are sequentially triggered to vibrate along the vibration direction at the specified vibration intensity. Wherein, the first target vibrator is the target vibrator closer to the second object among the at least two target vibrators, and the second target vibrator is the target vibrator away from the second object among the at least two target vibrators.
3. The method according to claim 2, characterized in that, The sequential triggering of the first target vibrator and the second target vibrator to vibrate along the vibration direction at the vibration intensity includes: At the first moment, the first target vibrator is triggered to vibrate along the vibration direction at the vibration intensity; At the second moment, the second target vibrator is triggered to vibrate along the vibration direction at the vibration intensity; Wherein, the second moment is later than the first moment, and the time interval between the second moment and the first moment is the first delay duration.
4. The method according to claim 1, characterized in that, The plurality of vibrators includes at least two target vibrators. When the action type is the second type, controlling the target vibrators to vibrate along the vibration direction with the vibration intensity based on the control method corresponding to the action type includes: Simultaneously trigger the first target vibrator and the second target vibrator to vibrate along the vibration direction at the vibration intensity; Wherein, the first target vibrator is the target vibrator closer to the second object among the at least two target vibrators, and the second target vibrator is the target vibrator away from the second object among the at least two target vibrators.
5. The method according to claim 1, characterized in that, The step of determining the target vibrator from the plurality of vibrators based on the direction of motion includes: When the direction of action is the first direction, the vibrator located in the first direction among the plurality of vibrators is identified as the target vibrator; When the direction of action is the second direction, the vibrator corresponding to the second direction among the plurality of vibrators is identified as the target vibrator; Wherein, the first direction is the vibration direction generated by any one of the plurality of vibrators, and the second direction is different from the first direction.
6. The method according to any one of claims 2-4, characterized in that, The head-mounted display device includes two first vibrators arranged opposite each other along a first preset direction and two second vibrators arranged opposite each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction; determining the target vibrator from the plurality of vibrators according to the direction of motion includes: When the direction of motion is the first preset direction, the two first vibrators are determined as target vibrators, wherein the first target vibrator is the vibrator that is closer to the second object among the two first vibrators, and the second target vibrator is the vibrator that is away from the second object among the two first vibrators; When the direction of motion is the second preset direction, the two second vibrators are identified as target vibrators, wherein the first target vibrator is the vibrator closer to the second object among the two second vibrators, and the second target vibrator is the vibrator away from the second object among the two second vibrators.
7. The method according to any one of claims 2-4, characterized in that, The head-mounted display device includes two first vibrators arranged opposite each other along a first preset direction and two second vibrators arranged opposite each other along a second preset direction, wherein the first preset direction is perpendicular to the second preset direction; determining the target vibrator from the plurality of vibrators according to the direction of motion includes: When the direction of motion is inconsistent with both the first and second preset directions, both the first and second vibrators are identified as target vibrators. The first target vibrator includes the vibrator closer to the second object among the two first vibrators and the vibrator closer to the second object among the two second vibrators; The second target vibrator includes the vibrator that is away from the second object among the two first vibrators and the vibrator that is away from the second object among the two second vibrators.
8. The method according to claim 1, characterized in that, Determining the vibration intensity based on the action intensity includes: The vibration intensity is determined based on the intensity of the action and the angle between the direction of the action and the set direction. The set direction is the vibration direction generated by any one of the plurality of vibrators.
9. A control device for a head-mounted display device, characterized in that, The head-mounted display device includes multiple vibrators, each of which can vibrate in a preset direction. The device includes: The first determining module is used to determine, based on scene data of the preset scene, the action information of the operation performed by the second object on the first object when the head-mounted display device is running a preset scene. The action information includes action type, action direction and action intensity. The second determining module is used to determine the target vibrator from the plurality of vibrators according to the direction of the action; The control module is used to determine the vibration direction based on the angle between the action direction and the set direction; to determine the vibration intensity based on the action intensity; and to control the target vibrator to vibrate along the vibration direction with the vibration intensity based on the control method corresponding to the action type, so as to control the head-mounted display device to generate directional vibration. Wherein, the set direction is the vibration direction generated by any one of the plurality of vibrators; The first object is a virtual object corresponding to the wearer of the head-mounted display device in the preset scenario, and the second object is different from the first object.
10. A head-mounted display device, characterized in that, include: Memory is used to store executable computer instructions; A processor, configured to execute a control method for a head-mounted display device according to any one of claims 1-8, under the control of the executable computer instructions.
11. A computer-readable storage medium having stored thereon computer instructions, which, when executed by a processor, perform a control method for a head-mounted display device according to any one of claims 1-8.
Citation Information
Patent Citations
Methods and systems for user interaction within virtual or augmented reality scene using head mounted display
CN107111340A
VR system
CN109364471A
Mobile terminal control method, mobile terminal and storage medium
CN110850980A
Wearable intelligence device and intelligent system
CN206312069U