An information processing method, apparatus and electronic device

CN116301370BActive Publication Date: 2026-08-18LENOVO (BEIJING) LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202310262104.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-03-14
Publication Date
2026-08-18
Estimated Expiration
2043-03-14

AI Technical Summary

Technical Problem

[0003]若用户的视角看到虚拟对象的互动操作区域是倾斜角度,而并非是正前方时,用户想要该互动操作区域进行操作时,需要从所在位置移动至该互动操作区域的正前方,以保证能够对于操作区域进行准确操作,该过程导致操作不够便捷

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116301370B_ABST
    Figure CN116301370B_ABST
Patent Text Reader

Abstract

The application provides an information processing method and device and electronic equipment, including: obtaining first operation information, the first operation information is generated based on a target object performing a first operation on a target virtual object through a virtual device; determining that the first operation information corresponds to a target area of the target virtual object, the target area is at least a partial area of the target virtual object; based on the initial display mode of the target content in the target area meeting the preset display mode, based on the perspective parameter of the target object, the target content is controlled to be displayed in a first direction perpendicular to the perspective of the target object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of information technology, and more specifically, to an information processing method, apparatus, and electronic device. Background Technology

[0002] When interacting with VR (Virtual Reality) devices, because the various virtual objects in the VR environment are relatively large, the user's perspective is not only directly in front of the virtual object, but also from various angles of the virtual object.

[0003] If the user sees the interactive area of ​​the virtual object at an angle instead of directly in front of it, the user needs to move from their current position to be directly in front of the interactive area in order to operate it accurately. This process makes the operation inconvenient. Summary of the Invention

[0004] In view of the above, this application provides an information processing method, apparatus, and electronic device, as follows:

[0005] An information processing method, comprising:

[0006] First operation information is obtained, which is generated based on a first operation performed on the target virtual object by the target object through a virtual device.

[0007] The first operation information is determined to correspond to a target region of the target virtual object, wherein the target region is at least a portion of the target virtual object;

[0008] Based on the initial display mode of the target content in the target area satisfying the preset display mode, and based on the viewpoint parameters of the target object, the target content is controlled to be displayed in a first direction perpendicular to the viewpoint of the target object.

[0009] Optionally, in the above method, obtaining the first operation information includes:

[0010] Obtain at least two operation information pieces, wherein the operation information is generated by at least two operation objects performing operations on a target virtual object through at least two virtual devices respectively;

[0011] Based on the identity identifier carried in the operation information, the first operation information corresponding to the target object is determined. The first operation information is generated by the target object performing a first operation on the target area of ​​the target virtual object.

[0012] Optionally, in the above method, determining that the first operation information corresponds to the target region of the target virtual object includes:

[0013] Determine the operation area corresponding to the first operation information in the virtual scene;

[0014] Based on the operation area, at least a portion of the target virtual object is determined as the target area.

[0015] Optionally, in the above method, determining at least a portion of the target virtual object as the target region based on the operation region includes at least one of the following:

[0016] Determine the target virtual object corresponding to the operation area, and define the area where the target virtual object is located as the target area; or

[0017] Determine the preset operation area corresponding to the operation area in the target virtual object, and define the preset operation area as the target area. The preset operation area contains at least two preset operation sub-areas; or

[0018] Determine the preset sub-region of operation corresponding to the operation area in the preset operation area, and define the preset sub-region of operation as the target area.

[0019] Optionally, the above method, in determining whether the initial display mode of the target content in the target area meets the preset display mode, includes:

[0020] Determine the first coordinate system to which the target content belongs and the visual coordinate system corresponding to the target object;

[0021] Determine the angle between the first target coordinate axis in the first coordinate system and the second target coordinate axis in the visual coordinate system, wherein the first target coordinate axis and the second target coordinate axis are axes of the same type;

[0022] If the included angle is greater than a preset included angle threshold, it is determined that the initial display mode of the target content satisfies the preset display mode.

[0023] Optionally, the above method, after the display method of the target content in the target area satisfies the preset display method, further includes:

[0024] Acquire motion information of the target object obtained by preset sensors;

[0025] Based on the motion information satisfying the preset action conditions, the step of controlling the target content to be displayed in a first direction perpendicular to the viewpoint of the target object is executed based on the viewpoint parameters of the target object.

[0026] Optionally, the above method, after controlling the target content to be displayed in a first direction perpendicular to the viewpoint of the target object based on the viewpoint parameters of the target object, further includes:

[0027] Obtain second operation information, which is generated based on a second operation performed by the target object on the target sub-content of the target content of the target virtual object through a virtual device;

[0028] The display area of ​​the target sub-content is adjusted from the first area to the second area, where the second area is larger than the first area.

[0029] Optionally, the above method, after controlling the target content to be displayed in a first direction perpendicular to the viewpoint of the target object based on the viewpoint parameters of the target object, further includes:

[0030] Based on the first operation information, stop and adjust the display mode of the target content back to the initial display mode.

[0031] An information processing apparatus, comprising:

[0032] The acquisition module is used to acquire first operation information, which is generated based on a first operation performed by the target object on the target virtual object through a virtual device.

[0033] A determining module is configured to determine that the first operation information corresponds to a target region of the target virtual object, wherein the target region is at least a portion of the target virtual object;

[0034] The control module is used to control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object, based on the initial display mode of the target content in the target area satisfying the preset display mode and the viewpoint parameters of the target object.

[0035] An electronic device, comprising:

[0036] Memory, processor;

[0037] The memory stores the processing program;

[0038] The processor is used to load and execute the processing program stored in the memory to implement the steps of the information processing method as described in any of the preceding claims. Attached Figure Description

[0039] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0040] Figure 1 This is a flowchart of an embodiment 1 of an information processing method provided in this application;

[0041] Figure 2 This is a schematic diagram illustrating the display method of target content in the target area in Embodiment 1 of an information processing method provided in this application;

[0042] Figure 3 This is a flowchart of an embodiment 2 of an information processing method provided in this application;

[0043] Figure 4 This is a schematic diagram of a scenario in Embodiment 2 of an information processing method provided in this application;

[0044] Figure 5 This is a flowchart of an embodiment 3 of an information processing method provided in this application;

[0045] Figure 6 This is a schematic diagram of the target area in Embodiment 3 of an information processing method provided in this application;

[0046] Figure 7 This is another schematic diagram of the target area in Embodiment 3 of an information processing method provided in this application;

[0047] Figure 8 This is another schematic diagram of the target area in Embodiment 3 of the information processing method provided in this application;

[0048] Figure 9 This is a flowchart of embodiment 4 of the information processing method provided in this application;

[0049] Figure 10 This is a schematic diagram of the coordinate axis relationship in Embodiment 4 of an information processing method provided in this application;

[0050] Figure 11 This is a flowchart of embodiment 5 of the information processing method provided in this application;

[0051] Figure 12 This is a flowchart of an embodiment 6 of an information processing method provided in this application;

[0052] Figure 13 This is a schematic diagram of the display area of ​​the target sub-content in Embodiment 6 of an information processing method provided in this application;

[0053] Figure 14 This is a flowchart of embodiment 7 of an information processing method provided in this application;

[0054] Figure 15 This is a schematic diagram of an embodiment of an information processing device provided in this application. Detailed Implementation

[0055] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0056] like Figure 1 The diagram shown is a flowchart of an embodiment 1 of an information processing method provided in this application. The method is applied to an electronic device and includes the following steps:

[0057] Step S101: Obtain the first operation information;

[0058] The first operation information is generated based on the first operation performed by the target object on the target virtual object through the virtual device.

[0059] It should be noted that the electronic device using this method can be a virtual device, a control device that controls the virtual device, or a cloud platform that processes the data information in the virtual device.

[0060] Specifically, the target object operates the virtual device, which performs operations on the target virtual object in the virtual scene through the virtual device.

[0061] The virtual object can be a controller or VR (Virtual Reality) glasses. The user operates the controller to emit ray casting, which is used to manipulate virtual objects in the virtual scene. The user can also manipulate virtual objects in the virtual scene through VR glasses by rotating their eyes or gazing.

[0062] Step S102: Determine that the first operation information corresponds to the target area of ​​the target virtual object;

[0063] The target region is at least a portion of the target virtual object.

[0064] Specifically, based on the range corresponding to the first operation information in the virtual scene, the target virtual object corresponding to it in the virtual scene is determined, and then the target area in the target virtual object corresponding to the first operation information is determined.

[0065] The target area can be the entirety of the target virtual object or a portion thereof.

[0066] It should be noted that the target virtual object can be a three-dimensional structure or a two-dimensional structure in a virtual scene. This application does not limit the specific structural form of the target virtual object.

[0067] The process will be described in detail in subsequent embodiments, but will not be described in detail in this embodiment.

[0068] Step S103: Based on the fact that the initial display mode of the target content in the target area meets the preset display mode, and based on the viewpoint parameters of the target object, control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object.

[0069] The default display mode displays the target object from a direction that is not perpendicular to its viewing angle.

[0070] After determining the target area, the target content to be displayed in that target area is determined, and the display method for that target content is determined.

[0071] Specifically, the initial display method of the target content in the target area is the display method when the target object performs the first operation on the target area.

[0072] The initial display mode satisfies the preset display mode, which means that the target content in the target area is displayed in a direction that is not perpendicular to the viewpoint of the target object. Therefore, if the initial display mode of the target content in the target area satisfies the preset display mode, the target object cannot perform accurate operations on the target content. Therefore, it is necessary to adjust the display mode of the target content.

[0073] Specifically, the preset display method can be that the display direction of the target content forms a small angle with the viewing angle of the target object, so that the target content is displayed at a tilted angle from the perspective of the target object.

[0074] It should be noted that subsequent embodiments will provide a detailed explanation of the specific process for determining whether the initial display direction of the target content meets the preset display method, which will not be detailed in this embodiment.

[0075] Specifically, based on the viewpoint parameters of the target object, the display method of the target content is adjusted, that is, the target content is controlled to be displayed in a first direction perpendicular to the viewpoint of the target object.

[0076] It should be noted that the target content is viewed from a direction perpendicular to the target object, which is the direction directly facing the target object.

[0077] like Figure 2The diagram illustrates how target content is displayed within a target area, presented from the perspective of the target object. In this diagram, dashed boxes represent the target object's field of view. In the left image, target content 201 is displayed at an angle, while in the right image, target content 201 is displayed in a first direction perpendicular to the target object's viewpoint.

[0078] In summary, the information processing method provided in this embodiment includes: a target object performing a first operation on a target virtual object in a virtual scene through a virtual device, obtaining first operation information generated based on the first operation, determining that the first operation information corresponds to a target area of ​​the target virtual object, the target area being at least a portion of the target virtual object, and if the initial display mode of the target content in the target area satisfies a preset display mode, controlling the target content to be displayed in a first direction perpendicular to the target object's viewpoint based on the viewpoint parameters of the target object. This achieves the adjustment of a portion of the content in a virtual scene where the virtual object is tilted relative to the user's viewpoint to face the user directly, without requiring the user to move in front of the content, thus improving the convenience of operation.

[0079] like Figure 3 The diagram shown is a flowchart of an embodiment 2 of an information processing method provided in this application. The method includes the following steps:

[0080] Step S301: Obtain at least two operation information pieces;

[0081] The operation information is generated by at least two operation objects performing operations on the target virtual object through at least two virtual devices.

[0082] In this embodiment, the information processing method can be a control device that controls multiple virtual devices, or a cloud-based system that processes data information from virtual devices.

[0083] Both the control device and the cloud can obtain data information collected by various virtual devices.

[0084] Specifically, multiple virtual devices in operation collect operation information of their respective objects and upload this operation information to the cloud or control device. In addition, the identification information of the virtual device is uploaded together with the upload.

[0085] For example, when the virtual device is VR glasses and a matching controller, the user holds the controller and moves it to manipulate virtual objects in the virtual scene. The controller can transmit movement information to the VR glasses, which then uploads the movement information and the corresponding virtual scene range information to the cloud as operation information. Alternatively, the controller can directly upload the movement information to the cloud, and the VR glasses upload the corresponding virtual scene range information to the cloud. Based on the identifiers carried in the movement information and virtual scene range information, the cloud determines the pairing relationship between the controller and the VR glasses and processes the movement information and virtual scene range information as combined operation information.

[0086] Step S302: Based on the identity identifier carried in the operation information, determine the first operation information corresponding to the target object;

[0087] The first operation information is generated when the target object performs a first operation on the target region of the target virtual object.

[0088] Among these steps, the information carried in the obtained operation information is analyzed to obtain the carried identity identifier. The cloud or control device then uses this identifier to determine which virtual device uploaded the operation information.

[0089] In subsequent steps, the virtual scene corresponding to the virtual device is rendered so that the rendering effect of the target content is displayed in a direction perpendicular to the viewpoint of the target object using the virtual device.

[0090] like Figure 4 The diagram illustrates a scenario including a cloud platform (401), three VR devices (402-404), and a controller (405) for each VR device (402). VR devices 402-404 are connected to the cloud and upload information there. Movement information from the controller (405) is sent to the VR glasses (402), which then uploads this information to the cloud. The cloud uses the identifier carried in the received information to determine the source virtual device for each piece of information.

[0091] Step S303: Determine that the first operation information corresponds to the target area of ​​the target virtual object;

[0092] Step S304: Based on the fact that the initial display mode of the target content in the target area meets the preset display mode, and based on the viewpoint parameters of the target object, control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object.

[0093] Steps S303-304 are consistent with the corresponding steps in Example 1, and will not be repeated in this example.

[0094] In summary, this embodiment provides an information processing method comprising: obtaining at least two operation information items, wherein the operation information items are generated by at least two operation objects performing operations on a target virtual object through at least two virtual devices respectively; and determining first operation information corresponding to a target object based on the identity identifier carried in the operation information, wherein the first operation information is generated by the target object performing a first operation on a target area of ​​the target virtual object. Each virtual device uploads the obtained operation information to the cloud or a unified control device. The cloud or control device determines the target virtual device corresponding to the operation information based on the identity identifier carried in the operation information, thereby identifying the target object corresponding to the operation information. Subsequently, in subsequent steps, the display direction of the target content is adjusted based on the viewpoint parameters of the target object. This reduces the information processing burden on virtual devices by having the cloud or control device, which requires a large data processing load, perform the information processing process on the cloud or control device with stronger processing capabilities.

[0095] like Figure 5 The diagram shown is a flowchart of an embodiment 3 of an information processing method provided in this application. The method includes the following steps:

[0096] Step S501: Obtain the first operation information;

[0097] Step S501 is the same as the corresponding step in Example 1, and will not be described again in this example.

[0098] Step S502: Determine the operation area corresponding to the first operation information in the virtual scene;

[0099] The first operation information is generated based on the first operation performed by the target object on the target virtual object in the virtual scene through the virtual device.

[0100] Specifically, after obtaining the first operation information, the first operation information is analyzed in conjunction with the virtual scene to determine the operation area corresponding to the first operation information in the virtual scene.

[0101] The first operation information is the operation information generated by the target object through VR glasses using its line of sight. The first operation is analyzed to obtain the range corresponding to the line of sight in the virtual scene, and this range is used as the operation area.

[0102] The first operation information is based on the movement of the projected light emitted by the controller in the virtual scene. The movement information of the projected light is used as the first operation information. The projected light is analyzed to obtain the position of the projected light in the virtual scene, and the position of the projected light is used as the operation area.

[0103] Step S503: Determine at least a portion of the target virtual object as the target area based on the operation area;

[0104] The operation area at least partially overlaps with the target virtual object, and the target area is determined based on the overlapping portion of the operation area and the target virtual object.

[0105] The operation area is the area that the target object wants to operate on, and it includes the area that can be operated on.

[0106] Specifically, step S503 includes at least one of the following:

[0107] Determine the target virtual object corresponding to the operation area, and define the area where the target virtual object is located as the target area; or

[0108] Determine the preset operation area corresponding to the operation area in the target virtual object, and define the preset operation area as the target area. The preset operation area contains at least two preset operation sub-areas; or

[0109] Determine the preset sub-region of operation corresponding to the operation area in the preset operation area, and define the preset sub-region of operation as the target area.

[0110] Among them, based on the target virtual object corresponding to the operation area in the virtual scene, the overall area where the target virtual object is located can be determined as the target area, the preset operation area of ​​the operation area in the target virtual object can be determined as the target area, and the preset operation sub-area of ​​the operation area in the target virtual object can be determined as the target area.

[0111] The preset operation sub-area can be an area corresponding to an operation button / icon, or the preset operation area can be an area where multiple operation buttons are arranged.

[0112] Specifically, in this preset operation area, multiple operation buttons / icons can be arranged in a single row / column or in a matrix.

[0113] Figure 6 The diagram shows a target area. In this diagram, a dashed box represents the field of view of the target object. This target area is the region where the target virtual object 601 is located. The content within this target area is all the content of the target virtual object. The target virtual object has a preset operation area 602, which contains multiple virtual buttons 603. In the left image, all the content of the target virtual object is displayed at an angle, while in the right image, all the content of the target virtual object is displayed in a first direction perpendicular to the target object's viewing angle.

[0114] Figure 7The diagram shows another schematic of the target area. In this schematic, a dashed box represents the field of view of the target object. This target area is the area where the preset operation area 702 of the target virtual object 701 is located. The content of this target area is all the content of the preset operation area, which is equipped with multiple virtual buttons 703. In the left image, all the content of the target virtual object is displayed at an angle. In the right image, the preset operation area 702 of the target virtual object is displayed in a first direction perpendicular to the viewpoint of the target object.

[0115] Figure 8 The diagram shows another schematic of the target area. In this schematic, a dashed box represents the field of view of the target object. This target area is the area where the preset operation sub-area 803 is located within the preset operation area 802 of the target virtual object 801. The content of this target area is the content of the preset operation sub-area 803. This preset operation area is equipped with multiple virtual buttons, and this target area is the area where virtual button A is located. In the left image, all the content in the target virtual object is displayed at an angle. In the right image, virtual button A is displayed in a first direction perpendicular to the viewpoint of the target object.

[0116] Step S504: Based on the fact that the initial display mode of the target content in the target area meets the preset display mode, and based on the viewpoint parameters of the target object, control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object.

[0117] Step S504 is the same as the corresponding step in Example 1, and will not be described again in this example.

[0118] In summary, this embodiment provides an information processing method comprising: determining the operation area corresponding to the first operation information in a virtual scene; and determining at least a portion of a target virtual object as a target area based on the operation area. By determining the operation area corresponding to the first operation information in the virtual scene, and determining a portion or all of the target virtual object as the target area based on the overlap between the operation area and the target virtual object, the method achieves the determination of the target area based on the first operation information.

[0119] like Figure 9 The diagram shown is a flowchart of an embodiment 4 of an information processing method provided in this application. The method includes the following steps:

[0120] Step S901: Obtain the first operation information;

[0121] Step S902: Determine that the first operation information corresponds to the target area of ​​the target virtual object;

[0122] Steps S901-902 are consistent with the corresponding steps in Example 1, and will not be repeated in this example.

[0123] Step S903: Determine the first coordinate system to which the target content belongs and the visual coordinate system corresponding to the target object;

[0124] In this virtual scene, each virtual object is set based on its own three-dimensional object coordinate system, and each VR device has a three-dimensional visual coordinate system.

[0125] In this embodiment, the three-dimensional object coordinate system of the virtual object is the first coordinate system, and the position coordinates of any position in the virtual object can be determined using the first coordinate system.

[0126] Specifically, the target content within the target area of ​​the target virtual object can also be located using this first coordinate system.

[0127] Specifically, the vision of the target object operating the VR device can be represented using a visual coordinate system.

[0128] Specifically, this first coordinate system is based on the left-right direction of the target virtual object's position as the X-axis, the up-down direction as the Y-axis, and the near-far direction as the Z-axis.

[0129] Specifically, this visual coordinate system uses the left-right direction as the X-axis, the up-down direction as the Y-axis, and the near-far direction as the Z-axis within the VR device's field of view.

[0130] Step S904: Determine the angle between the first target coordinate axis in the first coordinate system and the second target coordinate axis in the visual coordinate system;

[0131] Wherein, the first coordinate axis and the second coordinate axis are axes of the same type;

[0132] Among them, whether the coordinate axes of the same type are parallel / in the same direction can determine whether the display direction of the target content is suitable for the target object.

[0133] Specifically, if the Z-axis in the first coordinate system and the visual coordinate system are not parallel, it means that the line of sight between the target content and the target object is not perpendicular. In the visual perception of the target object, the target content is displayed at an angle. The target object is on one side of the target content, the part of the target content closer to the target object is larger, and the part of the target content farther away from the target object is smaller, forming a visual effect of things appearing larger when closer and smaller when farther away.

[0134] It should be noted that if the target content is displayed at an angle in the visual perception of the target object, its actual operable range relative to the target object will be smaller. Therefore, when the target object selects the target content through visual control or a handle, it is easy to make the wrong selection. Thus, the display angle of the target content needs to be adjusted.

[0135] Specifically, the angle between the first target coordinate axis and the second target coordinate axis is used to determine whether the two are parallel.

[0136] If the included angle is 0°, it means that the line of sight of the target object is perpendicular to the target content. If the included angle is 90°, it means that the line of sight of the target object coincides with a plane formed by the XY axes in the first coordinate system of the target content, and the target content cannot be seen at all.

[0137] Therefore, a preset angle threshold is set to distinguish whether the initial display mode of the target content is suitable for the line of sight of the target object, and to determine whether the display mode of the target content meets the preset display mode.

[0138] If the angle between the first target coordinate axis and the second target coordinate axis is greater than a preset angle threshold, the target content will be displayed at a tilted angle in the visual perception of the target object.

[0139] For example, the preset included angle threshold can be set to 45°, 60°, etc. This application does not restrict the value of the preset included angle threshold, and the value can be set according to the actual situation.

[0140] like Figure 10 The diagram shows a coordinate axis relationship. The diagram includes a first coordinate system 1001 corresponding to the target content and a visual coordinate system 1002 for the target object. The target content is a preset operation area. The XYZ axes of the first coordinate system are parallel to the XYZ axes of the visual coordinate system. From the visual angle of the target object, the target content corresponding to the first coordinate system is directly in front of the target object.

[0141] Step S905: If the included angle is greater than a preset included angle threshold, determine that the initial display mode of the target content meets the preset display mode, and based on the viewpoint parameters of the target object, control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object.

[0142] Step S905 is the same as the corresponding step in Example 1, and will not be described again in this example.

[0143] In summary, the information processing method provided in this embodiment includes: determining the angle between the first target coordinate axis and the second target coordinate axis of the same type in the two coordinate systems based on the first coordinate system to which the target content belongs and the visual coordinate system corresponding to the target object; determining that the initial display mode of the target content satisfies the preset display mode based on the angle being greater than a preset angle threshold; and displaying the target content at a tilted angle in the visual perception of the target object. Since the target content is displayed at a tilted angle, its actual operable range relative to the target object will be smaller. Therefore, when the target object selects the target content through visual control or a handle, the problem of incorrect selection is likely to occur.

[0144] like Figure 11 The flowchart shown is a 5th embodiment of an information processing method provided in this application. The method includes the following steps:

[0145] Step S1101: Obtain the first operation information;

[0146] Step S1102: Determine that the first operation information corresponds to the target area of ​​the target virtual object;

[0147] Steps S1101-1102 are consistent with the corresponding steps in Example 1, and will not be repeated in this example.

[0148] Step S1103: Based on the initial display mode of the target content in the target area satisfying the preset display mode, obtain the motion information of the target object collected by the preset sensor;

[0149] The preset sensor can be a sensor installed on the virtual device to detect the motion information of the target object wearing the virtual device.

[0150] Specifically, the preset sensor is a sensor installed on the VR glasses, which can collect motion information such as head movement of the target object wearing the VR glasses.

[0151] Specifically, the preset sensor can also be a sensor installed on the handle, which can collect operational information such as the hand movement of the target object holding the handle.

[0152] In this process, the motion information collected by the preset sensor can be analyzed to obtain the action of the target object.

[0153] Specifically, the judgment can be made based on whether the motion information meets the preset action conditions. Specifically, it can be a process of analyzing the motion information to determine the corresponding action, and then determining whether the corresponding action is a preset action; or the preset action condition is the motion information corresponding to the preset action, and the collected motion information is compared with the motion information corresponding to the preset action to determine whether it belongs to the motion information corresponding to the preset action.

[0154] Among them, the motion information determines whether the target object's action is to turn its face to the side in the direction of the target area, lean forward, or move the handle to a large extent in the direction of the target area.

[0155] If the motion information of the target object meets the preset action conditions, it indicates that the target object cannot see the target content in the tilted target area or cannot accurately operate on the target content in the tilted target area. Therefore, it is necessary to adjust the display direction of the target content so that the target object can see the target content or can accurately operate on the target content.

[0156] If the motion information of the target object does not meet the preset action conditions, it means that the target object can see the target content in the tilted target area or can directly operate on the target content in the tilted target area. Therefore, it is not necessary to adjust the display direction of the target content.

[0157] Step S1104: Based on the motion information satisfying the preset action conditions, and based on the viewpoint parameters of the target object, control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object.

[0158] Step S1104 is the same as the corresponding step in Example 1, and will not be described again in this example.

[0159] In summary, the information processing method provided in this embodiment further includes: acquiring motion information of a target object collected by a preset sensor; based on the motion information satisfying preset action conditions, and based on the viewpoint parameters of the target object, controlling the target content to be displayed in a first direction perpendicular to the viewpoint of the target object. Combining the motion information of the target object, it is further determined whether the initial display mode of the target content in the target area satisfies the preset display mode and whether it affects the operation of the target object. If the motion information satisfies the preset action conditions, indicating that it affects the operation of the target object, then the display direction of the target content is adjusted.

[0160] like Figure 12 The flowchart shown is a sample of embodiment 6 of an information processing method provided in this application. The method includes the following steps:

[0161] Step S1201: Obtain the first operation information;

[0162] Step S1202: Determine that the first operation information corresponds to the target region of the target virtual object;

[0163] Step S1203: Based on the fact that the initial display mode of the target content in the target area meets the preset display mode, and based on the viewpoint parameters of the target object, control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object;

[0164] Steps S1201-1202 are consistent with the corresponding steps in Example 1, and will not be repeated in this example.

[0165] Step S1204: Obtain the second operation information;

[0166] The second operation information is generated based on the second operation performed by the target object on the target sub-content of the target content of the target virtual object through a virtual device.

[0167] The target content includes the target virtual object, the preset operation area or the preset operation sub-area in the target virtual object.

[0168] In order to improve the accuracy of the target object's operation on the target sub-contents after adjusting the display direction of the target content, the display area of ​​the target sub-contents is adjusted.

[0169] In this process, after adjusting the display orientation of the target content, if the target object performs a second operation on a preset operation sub-region of the target content of the target virtual object through a virtual device, second operation information generated based on the second operation is obtained.

[0170] Specifically, the second operation includes the operation trajectory passing through a preset operation sub-region and selecting a preset operation sub-region.

[0171] Specifically, the operation trajectory includes the movement trajectory of the projected light controlled by the controller, and the sliding trajectory of the target object on the corresponding virtual object through VR glasses by eye rotation, gazing, etc.

[0172] Step S1205: Adjust the display area of ​​the target sub-content from the first area to the second area.

[0173] The second region is larger than the first region.

[0174] Specifically, after determining that the second operation information corresponds to the target sub-content in the adjusted target content, the display area of ​​the target sub-content is increased.

[0175] The target sub-content can be enlarged by using a preset adjustment ratio, such as 120% or 150%.

[0176] Specifically, if the target sub-content is close to its adjacent sub-content, the display area of ​​the target sub-content can be increased by covering part of the adjacent sub-content;

[0177] Figure 13 The diagram shows the display area of ​​the target sub-content. In this diagram, the target content is three icons A, B, and C in the preset operation area 1301. The target sub-content is icon B. The left diagram shows the target sub-content before the display area is adjusted, and the display area of ​​the three icons is the same size. The right diagram shows the display area of ​​icon B after it has been enlarged. The display area of ​​icon B is larger than that of icons A and C.

[0178] In summary, the information processing method provided in this embodiment further includes: obtaining second operation information, which is generated based on a second operation performed by a target object on a target sub-content within the target content of the target virtual object via a virtual device; and adjusting the display area of ​​the target sub-content from a first area to a second area, wherein the second area is larger than the first area. After adjusting the display method of the target content, the target content is displayed directly in front of the target object. Based on the second operation information of the target object's operation on the target sub-content within the target content, the display area of ​​the target sub-content is enlarged to improve the accuracy of the target object's operation on the target sub-content within the target content.

[0179] like Figure 14 The flowchart shown is a 7th embodiment of an information processing method provided in this application. The method includes the following steps:

[0180] Step S1401: Obtain the first operation information;

[0181] Step S1402: Determine that the first operation information corresponds to the target region of the target virtual object;

[0182] Step S1403: Based on the fact that the initial display mode of the target content in the target area meets the preset display mode, and based on the viewpoint parameters of the target object, control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object;

[0183] Steps S1401-1403 are the same as the corresponding steps in Example 1, and will not be repeated in this example.

[0184] Step S1404: Based on the first operation information, stop and adjust the display mode of the target content back to the initial display mode.

[0185] If the first operation information corresponding to the target area stops, it indicates that the first operation has stopped, or the operation has moved to another area of ​​the target virtual object, or the operation has moved to another virtual object.

[0186] Correspondingly, if the first operation information stops, indicating that the target object is no longer performing the first operation on the target virtual object through the virtual device, the display mode of the target content is restored.

[0187] Specifically, the display mode of the target content is adjusted from being displayed in a first direction perpendicular to the viewpoint of the target object to the initial display mode, restoring the display of the target content in the target area of ​​the target virtual object.

[0188] In summary, the information processing method provided in this embodiment further includes: adjusting the display mode of the target content back to the initial display mode based on the first operation information stopping; and controlling the display mode of the target content to be adjusted from displaying in a first direction perpendicular to the viewpoint of the target object to the initial display mode based on the first operation for the target area ending, so that the display of the target virtual object is consistent with the initial display.

[0189] Corresponding to the above-described embodiment of an information processing method provided in this application, this application also provides an embodiment of an apparatus for applying the information processing method.

[0190] like Figure 15 The diagram shown is a structural schematic of an embodiment of an information processing device provided in this application. The device includes the following structure: an acquisition module 1501, a determination module 1502, and a control module 1503.

[0191] The obtaining module 1501 is used to obtain first operation information, which is generated based on the first operation performed by the target object on the target virtual object through the virtual device.

[0192] The determining module 1502 is used to determine that the first operation information corresponds to a target area of ​​the target virtual object, wherein the target area is at least a portion of the target virtual object;

[0193] The control module 1503 is used to control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object, based on the initial display mode of the target content in the target area satisfying the preset display mode and the viewpoint parameters of the target object.

[0194] Optionally, the obtaining module includes:

[0195] The obtaining unit is configured to obtain at least two operation information pieces, wherein the operation information pieces are generated by at least two operation objects performing operations on a target virtual object through at least two virtual devices respectively;

[0196] The first determining unit is used to determine the first operation information corresponding to the target object based on the identity identifier carried in the operation information. The first operation information is generated by the target object performing a first operation on the target area of ​​the target virtual object.

[0197] Optionally, the determining module includes:

[0198] The second determining unit is used to determine the operation area corresponding to the first operation information in the virtual scene;

[0199] The third determining unit is used to determine at least a portion of the target virtual object as the target area based on the operation area.

[0200] Optionally, the third determining unit is specifically configured to perform at least one of the following:

[0201] Determine the target virtual object corresponding to the operation area, and define the area where the target virtual object is located as the target area; or

[0202] Determine the preset operation area corresponding to the operation area in the target virtual object, and define the preset operation area as the target area. The preset operation area contains at least two preset operation sub-areas; or

[0203] Determine the preset sub-region of operation corresponding to the operation area in the preset operation area, and define the preset sub-region of operation as the target area.

[0204] Optional, also includes:

[0205] The first judgment module is used to determine whether the initial display mode of the target content in the target area meets the preset display mode;

[0206] The first judgment module includes:

[0207] The fourth determining unit is used to determine the first coordinate system to which the target content belongs and the visual coordinate system corresponding to the target object;

[0208] The fifth determining unit is used to determine the angle between the first target coordinate axis in the first coordinate system and the second target coordinate axis in the visual coordinate system, wherein the first target coordinate axis and the second target coordinate axis are axes of the same type;

[0209] The judgment unit is used to determine that if the included angle is greater than a preset included angle threshold, the initial display mode of the target content satisfies the preset display mode.

[0210] Optional, also includes:

[0211] The acquisition module is used to acquire the motion information of the target object collected by the preset sensor after the display mode of the target content in the target area meets the preset display mode;

[0212] The second judgment module is used to determine whether the motion information meets the preset action conditions, and to trigger the control module based on whether the motion information meets the preset action conditions.

[0213] Optional, also includes:

[0214] The second obtaining module is used to control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object based on the viewpoint parameters of the target object, and then obtain second operation information. The second operation information is generated based on the second operation performed by the target object on the target sub-content of the target content of the target virtual object through the virtual device.

[0215] An adjustment module is used to adjust the display area of ​​the target sub-content from a first area to a second area, wherein the second area is larger than the first area.

[0216] Optionally, the control module is further configured to:

[0217] Based on the perspective parameters of the target object, after controlling the target content to be displayed in a first direction perpendicular to the perspective of the target object, stop based on the first operation information and adjust the display mode of the target content back to the initial display mode.

[0218] It should be noted that the explanation of the various structural functions in the information processing device provided in this embodiment is the same as that in the foregoing method embodiments, and will not be repeated in this embodiment.

[0219] In summary, the information processing device provided in this embodiment includes: a target object performing a first operation on a target virtual object in a virtual scene through a virtual device, obtaining first operation information generated based on the first operation, determining that the first operation information corresponds to a target area of ​​the target virtual object, the target area being at least a portion of the target virtual object, and if the initial display mode of the target content in the target area satisfies a preset display mode, controlling the target content to be displayed in a first direction perpendicular to the target object's viewpoint based on the viewpoint parameters of the target object. This achieves the adjustment of a portion of the content in a virtual scene that is tilted relative to the user's viewpoint to face the user directly, without requiring the user to move in front of the content, thus improving the convenience of operation.

[0220] Corresponding to the above-described embodiment of an information processing method provided in this application, this application also provides an electronic device and a readable storage medium corresponding to the information processing method.

[0221] The electronic device includes: a memory and a processor;

[0222] The memory stores the processing program;

[0223] The processor is used to load and execute the processing program stored in the memory to implement the steps of the information processing method as described in any of the preceding claims.

[0224] For details on the specific information processing method implemented in this electronic device, please refer to the aforementioned information processing method embodiments.

[0225] The readable storage medium stores a computer program that is invoked and executed by a processor to implement the steps of the information processing method as described in any of the preceding claims.

[0226] For details on the specific implementation of the information processing method by executing the computer program stored in the readable storage medium, please refer to the aforementioned information processing method embodiments.

[0227] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. The apparatus provided in the embodiments is described simply because it corresponds to the method provided in the embodiments; relevant parts can be found in the method section.

[0228] The above description of the provided embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features provided herein.

Claims

1. An information processing method, comprising: First operation information is obtained, which is generated based on a first operation performed on the target virtual object by the target object through a virtual device. The first operation information is determined to correspond to a target region of the target virtual object, wherein the target region is at least a portion of the target virtual object; Based on the initial display mode of the target content in the target area satisfying the preset display mode, and based on the viewpoint parameters of the target object, the target content is controlled to be displayed in a first direction perpendicular to the viewpoint of the target object; The determination of whether the initial display mode of the target content in the target area meets the preset display mode includes: Determine the first coordinate system to which the target content belongs and the visual coordinate system corresponding to the target object; Determine the angle between the first target coordinate axis in the first coordinate system and the second target coordinate axis in the visual coordinate system, wherein the first target coordinate axis and the second target coordinate axis are axes of the same type; If the included angle is greater than a preset included angle threshold, it is determined that the initial display mode of the target content satisfies the preset display mode.

2. The method according to claim 1, wherein obtaining the first operation information includes: Obtain at least two operation information pieces, wherein the operation information is generated by at least two operation objects performing operations on a target virtual object through at least two virtual devices respectively; Based on the identity identifier carried in the operation information, the first operation information corresponding to the target object is determined. The first operation information is generated by the target object performing a first operation on the target area of ​​the target virtual object.

3. The method according to claim 1, wherein determining that the first operation information corresponds to the target region of the target virtual object includes: Determine the operation area corresponding to the first operation information in the virtual scene; Based on the operation area, at least a portion of the target virtual object is determined as the target area.

4. The method according to claim 3, wherein determining at least a portion of the target virtual object as the target region based on the operation region includes at least one of the following: Determine the target virtual object corresponding to the operation area, and define the area where the target virtual object is located as the target area; or Determine the preset operation area corresponding to the operation area in the target virtual object, and define the preset operation area as the target area. The preset operation area is provided with at least two preset operation sub-areas. or Determine the preset sub-region of operation corresponding to the operation area in the preset operation area, and define the preset sub-region of operation as the target area.

5. The method according to claim 1, further comprising, after the display method of the target content in the target area satisfies the preset display method: Acquire motion information of the target object obtained by preset sensors; Based on the motion information satisfying the preset action conditions, the step of controlling the target content to be displayed in a first direction perpendicular to the viewpoint of the target object is executed based on the viewpoint parameters of the target object.

6. The method according to claim 1, after controlling the target content to be displayed in a first direction perpendicular to the viewpoint of the target object based on the viewpoint parameters of the target object, further comprising: Obtain second operation information, which is generated based on a second operation performed by the target object on the target sub-content of the target content of the target virtual object through a virtual device; The display area of ​​the target sub-content is adjusted from the first area to the second area, where the second area is larger than the first area.

7. The method according to claim 1, further comprising, after controlling the target content to be displayed in a first direction perpendicular to the viewpoint of the target object based on the viewpoint parameters of the target object: Based on the first operation information, stop and adjust the display mode of the target content back to the initial display mode.

8. An information processing apparatus, comprising: The acquisition module is used to acquire first operation information, which is generated based on a first operation performed by the target object on the target virtual object through a virtual device. A determining module is configured to determine that the first operation information corresponds to a target region of the target virtual object, wherein the target region is at least a portion of the target virtual object; The control module is used to control the target content to be displayed in a first direction perpendicular to the viewpoint of the target object, based on the initial display mode of the target content in the target area satisfying the preset display mode and the viewpoint parameters of the target object. The determination of whether the initial display mode of the target content in the target area meets the preset display mode includes: Determine the first coordinate system to which the target content belongs and the visual coordinate system corresponding to the target object; Determine the angle between the first target coordinate axis in the first coordinate system and the second target coordinate axis in the visual coordinate system, wherein the first target coordinate axis and the second target coordinate axis are axes of the same type; If the included angle is greater than a preset included angle threshold, it is determined that the initial display mode of the target content satisfies the preset display mode.

9. An electronic device, comprising: Memory, processor; The memory stores the processing program; The processor is used to load and execute the processing program stored in the memory to implement the steps of the information processing method as described in any one of claims 1-7.

Citation Information

Patent Citations

  • Interactive method and system in virtual reality and terminal device

    CN106527722A