A control method and apparatus

Abstract

The application provides a control method, comprising: receiving a first instruction from a first object in real space; controlling a second object and a third object in virtual space to touch based on the first instruction; outputting haptic feedback information for the second object touching the third object based on touch volume parameters of the second object and the third object; and controlling the first object to move with corresponding movement parameters based on the haptic feedback information. The application also provides an electronic device.

Description

Technical Field

[0001] This application relates to a control method and device. Background Technology

[0002] In virtual spaces, when a finger touches an object, the lack of tactile feedback makes it difficult for users to determine whether their finger has touched the object, the depth of contact, or even penetrated it. Furthermore, the occlusion between virtual objects in virtual spaces increases the difficulty for users to rely on visual observation. Existing methods often require users to adjust their viewing angle, which is not only time-consuming but also easily leads to fatigue. Summary of the Invention

[0003] The technical solution of this application is implemented as follows:

[0004] According to one aspect of this application, a control method is provided, comprising:

[0005] Receive the first instruction from the first object in the real space;

[0006] Based on the first instruction, control the touching of the second and third objects in the virtual space;

[0007] Based on the touch volume parameters of the second object and the third object, output tactile feedback information for the second object touching the third object;

[0008] Based on the tactile feedback information, the first object is controlled to move with corresponding movement parameters.

[0009] In the above scheme, the step of outputting tactile feedback information for the second object touching the third object based on the touch volume parameters of the second object and the third object includes:

[0010] Determine the first volume parameters of the second object and the third object in the virtual space; and determine the second volume parameters of the fourth object generated from the second object and the third object in the virtual space;

[0011] Based on the first volume parameter and the second volume parameter, the touch volume parameters of the second object and the third object in the virtual space are determined.

[0012] In the above scheme, determining the touch volume parameters of the second object and the third object in the virtual space based on the first volume parameter and the second volume parameter includes:

[0013] The total volume parameters of the second object and the third object are determined based on the two first volume parameters;

[0014] The touch volume parameters of the second object and the third object in the virtual space are determined based on the volume difference between the second volume parameter and the total volume parameter.

[0015] In the above scheme, determining the first volume parameters of the second object and the third object in the virtual space, and determining the second volume parameters of the fourth object generated by the second object and the third object in the virtual space, includes:

[0016] Determine the model bounding boxes corresponding to the second object, the third object, and the fourth object respectively;

[0017] The total number of pixels within the bounding box of the model is determined based on the three-dimensional coordinates of the bounding box.

[0018] Determine the target pixel parameters located in the corresponding second object, third object, or fourth object from the total pixel parameters;

[0019] Based on the ratio of the target pixel parameters to the corresponding total pixel parameters, the first volume parameters and the second volume parameters of the corresponding second object, the third object, and the fourth object in the virtual space are determined.

[0020] In the above scheme, determining the target pixel parameters located in the second object, the third object, or the fourth object from the total pixel parameters includes:

[0021] A ray is emitted from any pixel corresponding to the total pixel parameters in any direction to determine the number of intersections between the arbitrary pixel and the surface of the corresponding second object, third object, or fourth object.

[0022] The pixels with an odd number of intersection points are identified as target pixels located in the corresponding second object, third object, or fourth object;

[0023] The total number of target pixels is determined as the target pixel parameter located in the second object, the third object, or the fourth object from the total pixel parameter.

[0024] In the above scheme, the step of outputting tactile feedback information for the second object touching the third object based on the touch volume parameters of the second object and the third object includes:

[0025] A fifth object is created within a preset range of the second object, wherein the fifth object is associated with the first object and / or the second object; the fifth object is controlled to be displayed with corresponding display parameters based on the touch volume parameters;

[0026] Alternatively, the second object can be controlled to be displayed with corresponding display parameters based on the touch volume parameters;

[0027] The display parameters vary depending on the touch volume parameters; different display parameters represent at least one of the following: different touch force between the second object and the third object, different touch direction, and different rotation angle of the second object.

[0028] In the above scheme, controlling the fifth object or the second object to be displayed with corresponding display parameters based on the touch volume parameters includes:

[0029] Based on the touch volume parameters, the fifth object or the second object is rendered within the rendering range of the fifth object or the second object using corresponding light source parameters to display the rendered fifth object or the second object; wherein, the rendering effect of the fifth object or the second object varies depending on the touch volume parameters; different rendering effects represent at least one of the following: different touch force when the second object touches the third object, different touch direction, and different rotation angle of the second object.

[0030] In the above scheme, controlling the first object to move with corresponding movement parameters based on the tactile feedback information includes:

[0031] Receive a second instruction sent by the first object based on the tactile feedback information, wherein the second instruction carries movement parameters for moving the second object;

[0032] The second object is controlled to move according to the movement parameters.

[0033] In the above scheme, the second object includes, but is not limited to, at least one of a hand model and one or more finger models.

[0034] According to another aspect of this application, an electronic device is provided, the electronic device comprising:

[0035] The receiving unit is used to receive the first instruction from the first object in the real space.

[0036] A control unit is used to control the touch of a second and a third object in the virtual space based on the first instruction.

[0037] The output unit is used to output tactile feedback information for the second object touching the third object based on the touch volume parameters of the second object and the third object;

[0038] The control unit is further configured to control the first object to move according to the corresponding movement parameters based on the tactile feedback information.

[0039] According to a third aspect of this application, an electronic device is provided, comprising: a processor and a memory for storing a computer program capable of running on the processor.

[0040] When the processor runs the computer program, it executes any one of the method steps in the above data processing method.

[0041] According to a fourth aspect of this application, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, performs any of the method steps of the above-described data method.

[0042] The control method and device provided in this application are a scheme that controls the touch of a second and third object in a virtual space by using a first object in a real space. Based on the touch volume parameters, it outputs tactile feedback information regarding the touch of the second object against the third object. This tactile feedback information allows the user to intuitively perceive the magnitude of the applied force. Thus, users can easily adjust the magnitude or angle of force applied to virtual objects in the virtual space in real time based on the tactile feedback information, improving the user experience in the virtual scene. Attached Figure Description

[0043] Figure 1 This is a schematic diagram illustrating the flow implementation of the control method in this application;

[0044] Figure 2 This is a schematic diagram of the structural composition of the electronic device in this application. Figure 1 ;

[0045] Figure 3 This is a schematic diagram of the structural composition of the electronic device in this application. Figure 2 . Detailed Implementation

[0046] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application. Unless otherwise specified, the embodiments and features in the embodiments of this application can be arbitrarily combined with each other. The steps shown in the flowcharts can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowcharts, in some cases, the steps shown or described may be performed in a different order than that shown here.

[0047] The technical solution of this application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0048] Figure 1 This is a schematic diagram illustrating the flow implementation of the control method in this application. This method can be applied to electronic devices, such as augmented reality (AR) devices, virtual reality (VR) devices, or other near-eye display devices. The method includes:

[0049] Step 101: Receive the first instruction from the first object in the real space;

[0050] In this application, the first object includes, but is not limited to, the user's upper and lower limbs in real space. For example, the first object can be at least one of one or more fingers, palms, fists, arms, feet, or knees in real space. The first object in real space can send a first command to the electronic device through virtual buttons, physical buttons, or a touchscreen. After receiving the first command, the electronic device can control the movement of the second object in virtual space based on the first command.

[0051] Here, the second object can be a virtual model corresponding to the first object. For example, if the first object is a user's finger, the second object can be a finger model that matches the user's finger. Or, if the first object is a user's palm, the second object can be a palm model that matches the user's palm.

[0052] Here, the first instruction sent by the first object to the electronic device can be a click instruction, a swipe instruction, a touch instruction, a gesture instruction, etc. There are no restrictions here, as long as it can control the second object to move based on the first instruction.

[0053] Step 102: Based on the first instruction, control the second and third objects in the virtual space to touch;

[0054] In this application, the third object can be an object that the user wants to move in a virtual space. When the electronic device receives a first instruction from a first object in the real space, the first instruction may carry movement parameters, and the electronic device can control a second object in the virtual space to touch the third object based on the movement parameters.

[0055] Here, the movement parameters include, but are not limited to, touch force, touch direction, touch angle, etc.

[0056] For example, the first object is the user's real finger, the second object is the finger model corresponding to the user's finger in virtual space, and the third object is the box in virtual space. When the user's finger touches the box in virtual space in real space, the electronic device can match the corresponding finger model to the user's finger and control the finger model to follow the movement of the user's finger to touch the box in virtual space.

[0057] Step 103: Based on the touch volume parameters of the second object and the third object, output tactile feedback information for the second object touching the third object;

[0058] In this application, the electronic device can determine the first volume parameters of the second object and the third object in the virtual space when the second object touches the third object; and determine the second volume parameter of the fourth object generated by the second object and the third object (that is, the second object and the third object as a whole) in the virtual space; and determine the touch volume parameters of the second object and the third object in the virtual space based on the first volume parameter and the second volume parameter.

[0059] In this application, when the electronic device determines the touch volume parameters of the second object and the third object in the virtual space based on the first volume parameter and the second volume parameter, it can specifically determine the total volume parameter of the second object and the third object based on the two first volume parameters corresponding to the second object and the third object, and determine the touch volume parameters of the second object and the third object in the virtual space based on the volume difference between the second volume parameter and the total volume parameter.

[0060] Here, when the second and third objects are irregular models, the electronic device, in determining the first volume parameters of the second and third objects in the virtual space, and the second volume parameters of the fourth object generated from the second and third objects in the virtual space, can also determine the model bounding boxes corresponding to the second, third, and fourth objects respectively; determine the total pixel parameters within the corresponding model bounding boxes based on the three-dimensional coordinate values ​​of the model bounding boxes; determine the target pixel parameters located in the corresponding second, third, or fourth object from the total pixel parameters; and determine the first and second volume parameters of the corresponding second, third, and fourth objects in the virtual space based on the ratio of the target pixel parameters to the corresponding total pixel parameters.

[0061] Here, when determining the target pixel parameters located in the second object, the third object, or the fourth object from the total pixel parameters, the electronic device can emit a ray from any pixel corresponding to the total pixel parameters in any direction to determine the number of intersections between the arbitrary pixel and the surface of the corresponding second object, the third object, or the fourth object; the pixels with an odd number of intersections are determined as target pixels located in the corresponding second object, the third object, or the fourth object; and the total number of target pixels is determined as the target pixel parameters located in the second object, the third object, or the fourth object from the total pixel parameters.

[0062] For example, the first object is the user's finger in real space, and the second object is the finger model corresponding to the user's finger in virtual space. Since the finger model is an irregular cuboid structure, a cuboid bounding box (e.g., an AABB bounding box) corresponding to the finger model can be determined first to enclose the finger model. This bounding box is a hexahedron (cube). Then, the maximum and minimum x, y, z coordinates of the corresponding object model inside the bounding box are determined, and two vertices of the bounding box (x_max, y_max, z_max) and (x_min, y_min, z_min) are constructed so that all points of the object model are inside the bounding box. Then, the pixels in the bounding box are enumerated (depending on the sampling interval X, bounding box side length ÷ X, for example, 1 unit pixel or less). Then, rays are emitted from this point in any direction, and the intersection points with the object mesh surface are determined. If the number of intersection points is even (0, 2), the pixel is determined to be outside the object model; if the number of intersection points is odd (1), the pixel is determined to be inside the object model.

[0063] Here, the method for calculating the intersection of a ray and the surface of an object mesh can be achieved by enumerating all triangles on the mesh surface, calculating the intersection of the ray and the plane of the triangle, and checking whether the intersection point is inside the triangle.

[0064] Then, the electronic device calculates the ratio of the pixels inside the object model to all pixels in the bounding box, multiplies it by the volume of the bounding box, and obtains the volume of the object model.

[0065] In this application, when the second object and the third object are regular models, the electronic device can directly determine the first volume parameters corresponding to the second object and the third object respectively based on the three-dimensional spatial coordinates of the second object and the third object in the virtual space, and determine the second volume parameters of the fourth object generated by the second object and the third object in the virtual space.

[0066] For example, if the third object is a cube, then the volume of the third object can be determined directly based on the length, width, and height of the cube.

[0067] In this application, when the electronic device outputs tactile feedback information for the second object touching the third object based on the touch volume parameters of the second object and the third object, it can also create a fifth object within a preset range of the second object, wherein the fifth object is associated with the first object and / or the second object; based on the touch volume parameters, the fifth object can be controlled to be displayed with corresponding display parameters.

[0068] For example, the second object is a finger model, and the fifth object is an indicator ball located around the finger model. The indicator ball can display different colors depending on the amount of pressure exerted by the first object on the third object in the virtual space. For example, the greater the pressure exerted by the first object on the third object, the darker the color of the indicator ball; the less pressure exerted by the first object on the third object, the lighter the color of the indicator ball.

[0069] Here, when a user applies pressure to a third object in the virtual space in the real space, it can be done through a second object in the virtual space that corresponds to the first object. The second object can move along with the first object in the real space.

[0070] In this application, when the electronic device outputs tactile feedback information for the second object touching the third object based on the touch volume parameters of the second object and the third object, it can also control the second object to be displayed with corresponding display parameters based on the touch volume parameters.

[0071] Here, when the electronic device controls the second or fifth object to be displayed with corresponding display parameters based on the touch volume parameters, the display parameters can be different depending on the touch volume parameters; and the different display parameters represent at least one of the following: different touch force between the second object and the third object, different touch direction, and different rotation angle of the second object.

[0072] For example, the first object is the user's finger in real space, the second object is a finger model matching the user's finger in virtual space, and the third object is a box in virtual space. When the first object applies force to the third object, the second object will move towards the third object, touching it. The greater the force applied by the first object, the larger the contact volume between the second object and the third object, and the darker the color of the second object; conversely, the smaller the contact volume between the second object and the third object, the lighter the color of the second object. Thus, controlling the color of the second object by the size of its contact with the third object provides intuitive tactile feedback to the user, allowing them to control the application of appropriate force from the first object to the third object in virtual space to achieve their desired effect.

[0073] In this application, when the electronic device controls the fifth object or the second object to be displayed with corresponding display parameters based on the touch volume parameters between the second object and the third object, it can also render the fifth object or the second object with corresponding light source parameters within the rendering range of the fifth object or the second object based on the touch volume parameters, so as to display the rendered fifth object or the second object; wherein, the rendering effect of the fifth object or the second object is different according to the different touch volume parameters; different rendering effects represent at least one of the following: different touch force of the second object touching the third object, different touch direction, and different rotation angle of the second object.

[0074] For example, a larger touch volume parameter results in a darker red color for the second or fifth object, while a smaller touch volume parameter results in a lighter red color. In this way, users can intuitively perceive the amount of pressure they are applying in real space based on the color intensity of the second or fifth object.

[0075] Step 104: Based on the tactile feedback information, control the first object to move with the corresponding movement parameters.

[0076] In this application, when the electronic device controls the second object or the fifth object to output tactile feedback information for the second object touching the third object, it can also receive a second instruction sent by the first object based on the tactile feedback information, the second instruction carrying movement parameters for moving the second object; and control the second object to move according to the movement parameters.

[0077] Here, the movement parameters include, but are not limited to, force parameters, movement direction parameters, rotation angle parameters, etc.

[0078] The control method provided in this application calculates the volume ratio of the second and third objects in the virtual space and presents it to the user with different colors or color intensities based on the different volume ratios. This allows the user to intuitively feel the touch force, thereby controlling the magnitude or angle of force applied to the virtual objects in the virtual space in the real space, so as to better control the target objects in the virtual space.

[0079] Figure 2 This is a schematic diagram of the structural composition of the electronic device in this application. Figure 1 ,like Figure 2 As shown, the electronic device includes:

[0080] The receiving unit 201 is used to receive a first instruction from a first object in real space;

[0081] Control unit 202 is used to control the touch of the second and third objects in the virtual space based on the first instruction;

[0082] Output unit 203 is used to output tactile feedback information for the second object touching the third object based on the touch volume parameters of the second object and the third object;

[0083] The control unit 202 is also used to control the first object to move according to the corresponding movement parameters based on the tactile feedback information.

[0084] In a preferred embodiment, the electronic device further includes: a determining unit 204;

[0085] Specifically, the determining unit 204 is used to determine the first volume parameters of the second object and the third object in the virtual space; and to determine the second volume parameters of the fourth object generated by the second object and the third object in the virtual space; and to determine the touch volume parameters of the second object and the third object in the virtual space based on the first volume parameters and the second volume parameters.

[0086] In a preferred embodiment, the determining unit 204 is further configured to determine the total volume parameter of the second object and the third object based on the two first volume parameters; and to determine the touch volume parameter of the second object and the third object in the virtual space based on the volume difference between the second volume parameter and the total volume parameter.

[0087] In a preferred embodiment, the determining unit 204 is further configured to: determine the model bounding boxes corresponding to the second object, the third object, and the fourth object respectively; determine the total pixel parameters within the corresponding model bounding boxes based on the three-dimensional coordinate values ​​of the model bounding boxes; determine the target pixel parameters located in the corresponding second object, the third object, or the fourth object from the total pixel parameters; and determine the first volume parameter and the second volume parameter of the corresponding second object, the third object, and the fourth object in the virtual space based on the ratio of the target pixel parameters to the corresponding total pixel parameters.

[0088] In a preferred embodiment, the determining unit 204 is further configured to emit a ray from any pixel corresponding to the total pixel parameters in any direction to determine the number of intersections between the arbitrary pixel and the surface of the corresponding second object, third object, or fourth object; determine the pixels with an odd number of intersections as target pixels located in the corresponding second object, third object, or fourth object; and determine the total number of target pixels as the target pixel parameters located in the second object, third object, or fourth object from the total pixel parameters.

[0089] In a preferred embodiment, the electronic device further includes: a creation unit 205, configured to create a fifth object within a preset range of the second object, wherein the fifth object is associated with the first object and / or the second object;

[0090] The control unit 202 is specifically used to control the fifth object to be displayed with corresponding display parameters based on the touch volume parameters. Alternatively, it is used to control the second object to be displayed with corresponding display parameters based on the touch volume parameters.

[0091] The display parameters vary depending on the touch volume parameters; different display parameters represent at least one of the following: different touch force between the second object and the third object, different touch direction, and different rotation angle of the second object.

[0092] In a preferred embodiment, the electronic device also includes

[0093] Processing unit 206 is used to render the fifth object or the second object within the rendering range of the fifth object or the second object based on the touch volume parameters and with corresponding light source parameters;

[0094] Display unit 207 is used to display the rendered fifth object or the second object; wherein the rendering effect of the fifth object or the second object is different according to the different touch volume parameters; different rendering effects represent at least one of the following: different touch force when the second object touches the third object, different touch direction, and different rotation angle of the second object.

[0095] In a preferred embodiment, the receiving unit 201 is further configured to receive a second instruction sent by the first object based on the tactile feedback information, wherein the second instruction carries movement parameters for moving the second object;

[0096] The control unit 202 is used to control the second object to move according to the movement parameters.

[0097] The second object includes, but is not limited to, at least one of a hand model and one or more finger models.

[0098] It should be noted that the electronic device provided in the above embodiments is only illustrated by the division of the above program modules. In practical applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the device can be divided into different program modules to complete all or part of the processing described above. In addition, the electronic device provided in the above embodiments and the processing method embodiments provided above belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0099] This application also provides an electronic device, which includes: a processor and a memory for storing a computer program capable of running on the processor.

[0100] When the processor is used to run the computer program, it executes any one of the method steps in the above processing method.

[0101] Figure 3 This is a schematic diagram of the structural composition of the electronic device in this application. Figure 2 Electronic device 300 can be AR device, VR device, or other devices that enable interaction between real and virtual spaces. Figure 3The illustrated electronic device 300 includes at least one processor 301, a memory 302, at least one network interface 304, and a user interface 303. The various components in the electronic device 300 are coupled together via a bus system 305. It is understood that the bus system 305 is used to implement communication between these components. In addition to a data bus, the bus system 305 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 3 The general designated all buses as Bus System 305.

[0102] The user interface 303 may include a monitor, keyboard, mouse, trackball, click wheel, buttons, touchpad, or touch screen.

[0103] It is understood that memory 302 can be volatile memory or non-volatile memory, or both. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), ferromagnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM); magnetic surface memory can be disk storage or magnetic tape storage. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The memory 302 described in the embodiments of this application is intended to include, but is not limited to, these and any other suitable types of memory.

[0104] In this embodiment, the memory 302 is used to store various types of data to support the operation of the electronic device 300. Examples of such data include: any computer program used to operate on the electronic device 300, such as the operating system 3021 and application program 3022; contact data; phonebook data; messages; pictures; audio, etc. The operating system 3021 includes various system programs, such as the framework layer, core library layer, driver layer, etc., used to implement various basic services and handle hardware-based tasks. The application program 3022 may include various applications, such as a media player, browser, etc., used to implement various application services. Programs implementing the methods of this embodiment may be included in the application program 3022.

[0105] The methods disclosed in the embodiments of this application can be applied to or implemented by the processor 301. The processor 301 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in the processor 301 or by instructions in the form of software. The processor 301 may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The processor 301 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium, which is located in the memory 302. The processor 301 reads the information in the memory 302 and combines its hardware to complete the steps of the aforementioned method.

[0106] In an exemplary embodiment, the electronic device 300 may be implemented by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components to perform the aforementioned method.

[0107] In an exemplary embodiment, this application also provides a computer-readable storage medium, such as a memory 302 including a computer program, which can be executed by a processor 301 of an electronic device 300 to complete the steps described in the aforementioned method. The computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disc, or CD-ROM; it may also be various devices including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0108] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, performs any of the method steps in the above-described processing method.

[0109] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or units can be electrical, mechanical, or other forms.

[0110] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.

[0111] The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0112] The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0113] The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.

[0114] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A control method, comprising: Receive the first instruction from the first object in the real space; Based on the first instruction, control the touching of the second and third objects in the virtual space; Based on the touch volume parameters of the second object and the third object, output tactile feedback information for the second object touching the third object; Based on the tactile feedback information, the first object is controlled to move with corresponding movement parameters; The step of outputting tactile feedback information for the second object touching the third object based on the touch volume parameters of the second object and the third object includes: The total volume parameters of the second object and the third object are determined based on two first volume parameters; the two first volume parameters are the respective volumes of the second object and the third object in the virtual space. The touch volume parameters of the second object and the third object in the virtual space are determined based on the volume difference between the second volume parameter and the total volume parameter; the second volume parameter is the volume of the fourth object; the fourth object is the whole formed by the second object and the third object after they touch in the virtual space.

2. The method of claim 1, wherein, Determining the two first volume parameters and the second volume parameter includes: Determine the model bounding boxes corresponding to the second object, the third object, and the fourth object respectively; The total number of pixels within the bounding box of the model is determined based on the three-dimensional coordinates of the bounding box. Determine the target pixel parameters located in the corresponding second object, third object, or fourth object from the total pixel parameters; Based on the ratio of the target pixel parameters to the corresponding total pixel parameters, the first volume parameters and the second volume parameters of the corresponding second object, the third object, and the fourth object in the virtual space are determined.

3. The method according to claim 2, wherein, Determining the target pixel parameters located in the corresponding second object, third object, or fourth object from the total pixel parameters includes: A ray is emitted from any pixel corresponding to the total pixel parameters in any direction to determine the number of intersections between the arbitrary pixel and the surface of the corresponding second object, third object, or fourth object. The pixels with an odd number of intersection points are identified as target pixels located in the corresponding second object, third object, or fourth object; The total number of target pixels is determined as the target pixel parameter located in the second object, the third object, or the fourth object from the total pixel parameter.

4. The method according to claim 1, wherein, The step of outputting tactile feedback information for the second object touching the third object based on the touch volume parameters of the second object and the third object includes: A fifth object is created within a preset range of the second object, wherein the fifth object is associated with the first object and / or the second object; the fifth object is controlled to be displayed with corresponding display parameters based on the touch volume parameters; Alternatively, the second object can be controlled to be displayed with corresponding display parameters based on the touch volume parameters; The display parameters vary depending on the touch volume parameters; different display parameters represent at least one of the following: different touch force between the second object and the third object, different touch direction, and different rotation angle of the second object.

5. The method according to claim 4, wherein, Controlling the display of the fifth object or the second object with corresponding display parameters based on the touch volume parameters includes: Based on the touch volume parameters, the fifth object or the second object is rendered within the rendering range of the fifth object or the second object using corresponding light source parameters to display the rendered fifth object or the second object; wherein, the rendering effect of the fifth object or the second object varies depending on the touch volume parameters; different rendering effects represent at least one of the following: different touch force when the second object touches the third object, different touch direction, and different rotation angle of the second object.

6. The method according to claim 1, wherein, The step of controlling the first object to move with corresponding movement parameters based on the tactile feedback information includes: Receive a second instruction sent by the first object based on the tactile feedback information, wherein the second instruction carries movement parameters for moving the second object; The second object is controlled to move according to the movement parameters.

7. The method according to claim 1, wherein, The second object includes, but is not limited to, at least one of a hand model and one or more finger models.

8. An electronic device, the electronic device comprising: The receiving unit is used to receive the first instruction from the first object in the real space. A control unit is used to control the touch of a second and a third object in the virtual space based on the first instruction. The output unit is used to output tactile feedback information for the second object touching the third object based on the touch volume parameters of the second object and the third object; The control unit is also configured to control the first object to move according to the corresponding movement parameters based on the tactile feedback information; A determining unit is configured to determine the total volume parameters of the second object and the third object based on two first volume parameters; the two first volume parameters being the respective volumes of the second object and the third object in the virtual space; and to determine the touch volume parameters of the second object and the third object in the virtual space based on the volume difference between the second volume parameters and the total volume parameters. The second volume parameter is the volume of the fourth object; the fourth object is the whole formed by the second object and the third object touching each other in the virtual space.

Images