Augmented reality-based tactile sensation generation method, device and storage medium

Abstract

The present disclosure discloses a method, device and storage medium for generating tactile sensation based on augmented reality. The method comprises: obtaining a virtual scene picture by photographing a target object through an augmented reality device, wherein the display content in the virtual scene picture at least comprises: a target virtual model; responding to a touch instruction for the target virtual model, calculating the tactile force corresponding to the target virtual model according to the appearance parameters of the target virtual model and the current shooting angle of the target object; outputting the tactile force through a wearable device, wherein the wearable device is used in conjunction with the augmented reality device. The present disclosure solves the technical problem in the prior art that wearable devices require cooperation from external entities to obtain a sense of touch.

Description

Technical Field

[0001] The present disclosure relates to the field of augmented reality, and in particular, to a method, device and storage medium for generating tactile sensation based on augmented reality. Background Art

[0002] With the rapid development of science and technology, people's entertainment methods have become more three-dimensional and closer to real life. The use of augmented reality technology combined with related equipment allows players to feel what is in front of them in the game.

[0003] In existing virtual games developed based on augmented reality, virtual scene images are provided by combining real environments and virtual objects, but the three-dimensional feeling is not well utilized or combined with physical touch. On the one hand, players need to combine with the real environment to obtain the three-dimensional touch feeling. For example, in some AR games, the virtual firearms in the virtual scene need to be coordinated with external physical firearms equipment to obtain the tactile game experience. On the other hand, the external physical firearms equipment provided by the game is usually single and fixed, and for different types of virtual firearms, the same external physical firearms equipment cannot restore the real touch of different types of firearms. For example, for virtual submachine guns and virtual pistols, if the same physical external firearms equipment is used for simulation, the holding experience is poor.

[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0005] The embodiments of the present disclosure provide a method, device and storage medium for generating tactile sensation based on augmented reality, so as to at least solve the technical problem in the prior art that wearable devices require cooperation from external entities to obtain tactile sensation.

[0006] According to one aspect of an embodiment of the present disclosure, a tactile generation method based on augmented reality is provided, comprising: photographing a target object through an augmented reality device to obtain a virtual scene picture, wherein the display content in the above virtual scene picture includes at least: a target virtual model; responding to a touch instruction for the above target virtual model, calculating the tactile force corresponding to the above target virtual model according to the appearance parameters of the above target virtual model and the current shooting angle of the above target object; outputting the above tactile force through a wearable device, wherein the above wearable device is used in conjunction with the above augmented reality device.

[0007] According to another aspect of an embodiment of the present disclosure, a tactile generation device based on augmented reality is also provided, including: a shooting module, used to obtain a virtual scene picture by shooting a target object through an augmented reality device, wherein the display content in the above virtual scene picture includes at least: a target virtual model; a calculation module, used to respond to a touch instruction for the above target virtual model, and calculate the tactile force corresponding to the above target virtual model according to the appearance parameters of the above target virtual model and the current shooting angle of the above target object; an output module, used to output the above tactile force through a wearable device, wherein the above wearable device is used in conjunction with the above augmented reality device.

[0008] According to another aspect of an embodiment of the present disclosure, a computer-readable storage medium is further provided, including: the above-mentioned computer-readable storage medium includes a stored program, wherein when the above-mentioned program is run, the device where the above-mentioned computer-readable storage medium is located is controlled to execute any one of the above-mentioned augmented reality-based tactile generation methods.

[0009] According to another aspect of an embodiment of the present disclosure, an electronic device is provided, including: a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute any one of the above-mentioned augmented reality-based tactile generation methods.

[0010] According to another aspect of an embodiment of the present disclosure, a processor is further provided, and the processor is used to run a program, wherein the program is configured to execute any one of the above-mentioned augmented reality-based tactile generation methods when running.

[0011] In an embodiment of the present disclosure, a virtual scene screen is obtained by photographing a target object through an augmented reality device, wherein the display content in the above virtual scene screen at least includes: a target virtual model; in response to a touch instruction for the above target virtual model, calculating the tactile force corresponding to the above target virtual model according to the appearance parameters of the above target virtual model and the current shooting angle of the above target object; the tactile force is output through a wearable device, wherein the above wearable device is used in conjunction with the above augmented reality device, so as to achieve the purpose of the wearable device being able to obtain the sense of touch in the virtual reality scene without the cooperation of an external entity, thereby realizing the technical effect of enabling players to obtain a more realistic gaming experience in the game scene, thereby solving the technical problem in the prior art that the wearable device requires the cooperation of an external entity to obtain the sense of touch. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The drawings described herein are used to provide a further understanding of the present disclosure and constitute a part of the present application. The illustrative embodiments of the present disclosure and their descriptions are used to explain the present disclosure and do not constitute an improper limitation on the present disclosure. In the drawings:

[0013] Figure 1 is a flow chart of a method for generating tactile sensation based on augmented reality according to an embodiment of the present disclosure;

[0014] Figure 2 is a schematic diagram of an optional target virtual model generation process according to an embodiment of the present disclosure;

[0015] Figure 3 is a schematic diagram of an optional process of acquiring a virtual three-dimensional model of a target firearm according to an embodiment of the present disclosure;

[0016] Figure 4 is a schematic diagram of an optional method for generating appearance parameters of a target virtual model according to an embodiment of the present disclosure;

[0017] Figure 5 is a schematic diagram of an optional method for calculating the appearance parameters of a virtual firearm according to an embodiment of the present disclosure;

[0018] Figure 6 is a schematic diagram of an optional target virtual model data editing according to an embodiment of the present disclosure;

[0019] Figure 7 is a schematic diagram of generating tactile force by an optional wearable device according to an embodiment of the present disclosure;

[0020] Figure 8a is a schematic diagram of a firearm in a side view observed at an optional side view shooting angle according to an embodiment of the present disclosure;

[0021] Figure 8b is a schematic diagram of a firearm in a top view observed at an optional top view shooting angle according to an embodiment of the present disclosure;

[0022] Fig. 9 It is a structural schematic diagram of a tactile sensation generating device based on augmented reality according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the scheme of the present disclosure, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without creative work should fall within the scope of protection of the present disclosure.

[0024] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0025] According to an embodiment of the present disclosure, an embodiment of a method for generating tactile sensation based on augmented reality is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0026] The technical solution of the embodiment of the method can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, the mobile terminal can be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a PDA, and a mobile Internet device (Mobile Internet Devices, referred to as MID), a PAD and other terminal devices. The mobile terminal may include one or more processors (the processor may include but is not limited to a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP) chip, a microprocessor (MCU), a programmable logic device (FPGA), a neural network processor (NPU), a tensor processor (TPU), an artificial intelligence (AI) type processor, etc.) and a memory for storing data. Optionally, the mobile terminal may also include a transmission device, an input and output device, and a display device for communication functions. It can be understood by those of ordinary skill in the art that the above structural description is only illustrative and does not limit the structure of the above mobile terminal. For example, the mobile terminal may also include more or fewer components than the above structural description, or have a configuration different from the above structural description.

[0027] The memory can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the tactile generation method based on augmented reality in the embodiment of the present disclosure. The processor executes various functional applications and data processing by running the computer program stored in the memory, that is, realizing the above-mentioned tactile generation method based on augmented reality. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories can be connected to the mobile terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0028] The transmission device is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device can be a radio frequency (Radio Frequency, referred to as RF) module, which is used to communicate with the Internet wirelessly. The technical solution of the embodiment of the method can be applied to various communication systems, such as: Global System of Mobile communication (GSM) system, Code Division Multiple Access (CDMA) system, Wideband Code Division Multiple Access (WCDMA) system, General Packet Radio Service (GPRS), Long Term Evolution (LTE) system, LTE Frequency Division Duplex (FDD) system, LTE Time Division Duplex (TDD), Universal Mobile Telecommunication System (UMTS), Worldwide Interoperability for Microwave Access (WiMAX) communication system or 5G system. Optionally, multiple mobile terminals can perform device-to-device (D2D) communication. Optionally, the 5G system or 5G network is also called the New Radio (NR) system or NR network.

[0029] The display device may be, for example, a touch screen type liquid crystal display (LCD) and a touch display (also referred to as a "touch screen" or "touch display screen"). The LCD display may enable a player to interact with a player interface of the mobile terminal. In some embodiments, the mobile terminal has a graphical user interface (GUI), and the player may interact with the GUI by finger contact and / or gestures on the touch-sensitive surface, wherein the human-computer interaction functions here may optionally include the following interactions: creating web pages, drawing, word processing, making electronic documents, games, video conferencing, instant messaging, sending and receiving emails, call interfaces, playing digital videos, playing digital music and / or web browsing, etc. The executable instructions for executing the above human-computer interaction functions are configured / stored in a computer program product executable by one or more processors or a readable computer-readable storage medium.

[0030] In one embodiment of the present disclosure, the tactile sensation generation method based on augmented reality can be run on a terminal device or a server. The terminal device can be a local terminal device, and the server can be a cloud server, a server of a distributed system, or a server combined with a blockchain. When the tactile sensation generation method based on augmented reality is run on a server, the method can be implemented and executed based on a cloud interaction system, wherein the cloud interaction system includes a server and a client device.

[0031] In an optional embodiment, various cloud applications can be run under the cloud interaction system, such as cloud games. Taking cloud games as an example, cloud games refer to a game mode based on cloud computing. In the operation mode of cloud games, the operating body of the game program and the main body of the game screen presentation are separated. The storage and operation of the tactile generation method based on augmented reality are completed on the cloud game server. The role of the client device is used for receiving and sending data and presenting the game screen. For example, the client device can be a display device with data transmission function close to the player side, such as a mobile terminal, a TV, a computer, a handheld computer, etc.; but the terminal device for information processing is a cloud game server in the cloud. When playing the game, the player operates the client device to send an operation instruction to the cloud game server. The cloud game server runs the game according to the operation instruction, encodes and compresses the game screen and other data, and returns it to the client device through the network. Finally, the client device decodes and outputs the game screen.

[0032] In an optional embodiment, the terminal device may be a local terminal device. Taking a game as an example, the local terminal device stores a game program and is used to present a game screen. The local terminal device is used to interact with the player through a graphical user interface, that is, the game program is downloaded and installed by an electronic device and run conventionally. The local terminal device may provide the graphical user interface to the player in a variety of ways, for example, it may be rendered and displayed on a display screen of the terminal, or provided to the player through a holographic projection. For example, the local terminal device may include a display screen and a processor, the display screen is used to present a graphical user interface, the graphical user interface includes a game screen, and the processor is used to run the game, generate a graphical user interface, and control the display of the graphical user interface on the display screen.

[0033] In the technical solution disclosed herein, the acquisition, storage and application of players' personal information are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0034] In a possible implementation, an embodiment of the present disclosure provides a method for generating tactile sensations based on augmented reality, providing a graphical user interface through a terminal device, wherein the terminal device may be the local terminal device mentioned above, or may be a client device in the cloud interaction system mentioned above.

[0035] Figure 1 is a flow chart of a method for generating tactile sensation based on augmented reality according to an embodiment of the present disclosure, such as Figure 1 As shown, the method comprises the following steps:

[0036] Step S102, photographing the target object through an augmented reality device to obtain a virtual scene image, wherein the display content in the virtual scene image at least includes: a target virtual model;

[0037] Step S104, responding to the touch instruction for the target virtual model, calculating the tactile force corresponding to the target virtual model according to the appearance parameters of the target virtual model and the current shooting angle of the target object;

[0038] Step S106: outputting the tactile force via a wearable device, wherein the wearable device is used in conjunction with the augmented reality device.

[0039] In an embodiment of the present disclosure, a virtual scene screen is obtained by photographing a target object through an augmented reality device, wherein the display content in the above virtual scene screen at least includes: a target virtual model; in response to a touch instruction for the above target virtual model, calculating the tactile force corresponding to the above target virtual model according to the appearance parameters of the above target virtual model and the current shooting angle of the above target object; and outputting the above tactile force through a wearable device, wherein the above wearable device is used in conjunction with the above augmented reality device.

[0040] It should be noted that the above-mentioned target virtual model is not limited to the specific target object type, and can be a physical object such as a water cup, a table, a brick, etc. in reality. The above-mentioned target virtual model is obtained by photographing the above-mentioned physical object with the above-mentioned augmented reality device; according to the appearance parameters of the above-mentioned target virtual model, such as: length, width, height, etc., and the current shooting angle of the above-mentioned target object, such as: front view, top view, side view, etc., the corresponding relevant data values ​​of each angle of the above-mentioned target virtual model are calculated; based on the relevant data values ​​of the above-mentioned target object, the tactile force corresponding to the above-mentioned target virtual model can be obtained; in conjunction with the above-mentioned wearable device, such as: a chip on a finger or a pressure glove, based on the acquired tactile force corresponding to the above-mentioned target virtual model, the tactile force corresponding to the above-mentioned target virtual model is applied to the touch medium of the wearable device.

[0041] In the embodiments of the present disclosure, Figure 2 The schematic diagram of the target virtual model generation process shown is that the depth information photo of the target object is taken by the above-mentioned reality device, and the shape of the object is identified to obtain the target virtual model of the above-mentioned target object. For example, the target virtual model can be cylindrical, rectangular, and auxiliary objects composed of various shapes, etc. The above-mentioned virtual three-dimensional model is selected from the preset virtual three-dimensional model set based on the above-mentioned target virtual model. For example: if you want to obtain the three-dimensional model of a virtual firearm, first take a depth information photo of the target firearm through the reality device, and the photo contains multi-directional and angular depth images of the target firearm; by analyzing the image, roughly determine the three-dimensional model of the virtual firearm, select the virtual three-dimensional model corresponding to the physical firearm that meets the shape of the virtual firearm from the virtual three-dimensional model set, and obtain the virtual three-dimensional model of the virtual firearm in the game scene. The obtained virtual three-dimensional model of the virtual firearm is as shown in FIG. Figure 3 shown.

[0042] It should be noted that the above-mentioned recognition of the object shape requires determining the basic shape of the object, such as a sphere, a cylinder, a cuboid, etc.; the above-mentioned preset virtual three-dimensional model set includes at least a plurality of virtual three-dimensional models of different sizes.

[0043] Therefore, through the above embodiments, the purpose of combining augmented reality technology with related equipment can be achieved, so that players can feel the things in front of them in the game, thereby achieving the technical effect of enabling players to obtain a more realistic gaming experience in the game scene, and further solving the technical problem in the prior art that wearable devices require external entity cooperation to obtain tactile perception.

[0044] In an optional embodiment, the target virtual model is a virtual model corresponding to the target object.

[0045] For example, the target virtual model may be a virtual three-dimensional model obtained by referring to the outer contour of the target object. In this case, the target virtual model and the target object both represent the same object.

[0046] In an optional embodiment, the target virtual model is a virtual model determined by a preset association mapping table, wherein the association mapping table is used to record one or more target virtual models associated with the target object.

[0047] The target virtual model and the target object can represent different objects respectively. For example, the target object is a table, and the target virtual model is a virtual three-dimensional model of a virtual weapon. The association mapping table can be a table configured by the game planner according to different game experience requirements. For example, multiple physical objects such as cups and books can be set as target objects, and the target objects can be associated with virtual weapons. When the target object is identified in the game, the corresponding target virtual model of the virtual weapon will be rendered according to the association mapping table. Optionally, when there are multiple target virtual models associated with the target object recorded in the above association mapping table, one of the target virtual models can be determined as the virtual model to be rendered according to multiple weights preset for the multiple target virtual models.

[0048] In an optional embodiment, the display content in the above-mentioned virtual scene screen also includes: a virtual object, and the above-mentioned wearable device is used to control the movement of the above-mentioned virtual object in the above-mentioned virtual scene screen.

[0049] It should be noted that the above-mentioned virtual objects can be virtual objects that move in response to the player's control in the virtual scene, and in the disclosed embodiment, they are hand models, etc.; players can wear gloves to feel the real touch when touching or picking up the target virtual model in the virtual scene. For example: in the game scene, the object picked up is a virtual gun, and the wearable device (gloves) feedback the tactile force according to the specific numerical value of the target gun, so that the player can feel the touch of picking up a real gun.

[0050] In an optional embodiment, the above method includes:

[0051] Step S302, based on the movement of the wearable device, controlling the virtual object to move accordingly in the virtual scene screen;

[0052] Step S304: when it is detected that the virtual object moves to the target virtual model, the touch instruction is generated.

[0053] In the embodiment of the present disclosure, according to the movement of the wearable device, the virtual object is controlled to move accordingly in the virtual scene screen; since the virtual object refers to the following Figure 6 Or the hand model in 7, after the player wears the gloves, the movement of the player's hand will be associated with the movement of the hand model, and the movement of the virtual object to the above-mentioned target virtual model is detected. It can be understood that if the hand model collides with the firearm, the area overlaps, etc., the above-mentioned touch instruction is generated.

[0054] In an optional embodiment, the above method further includes:

[0055] Step S402, determining a target geometric body corresponding to the target object through the corresponding relationship, wherein the target object is any entity object among the multiple entity objects;

[0056] Step S404, generating the target virtual model according to the target geometric body;

[0057] Step S406: Calculate the appearance parameters of the target virtual model based on the preset parameters of the virtual reference object model.

[0058] In the disclosed embodiment, the target geometric body corresponding to the target object is determined through the corresponding relationship, and the target virtual model is generated according to the target geometric body; the shape parameters of the target virtual model are calculated based on the preset parameters of the virtual reference object model.

[0059] It should be noted that if Figure 4 The schematic diagram of the method for generating the appearance parameters of the target virtual model is shown, wherein the target object is any entity object among the multiple entity objects, and the target object may also be an entity object composed of multiple geometric figures; the virtual reference object model is a reference object model preset in the virtual scene, and the virtual reference object model has clear values, such as: length, width, height, weight, color, etc. of the reference object; the appearance parameters of the target virtual model, such as length, width, and height, are calculated according to the position and size relationship between the target virtual model and the virtual reference object model.

[0060] As an optional embodiment, Figure 3As shown, when it is necessary to obtain relevant data of the virtual firearm in the figure, first take a depth information photo through a real device; by analyzing the depth information photo, the external contour information of the three-dimensional model of the above-mentioned virtual firearm is obtained, and a virtual model that conforms to the shape of the virtual firearm is selected from the virtual three-dimensional model set to obtain the virtual three-dimensional model of the virtual firearm, and the specific shape of the above-mentioned virtual firearm is obtained by precise matching based on the preset parameters of the virtual reference model; correction processing is performed according to the tactile value information of the virtual firearm combined with information such as the placement angle, and the tactile force of the above-mentioned virtual firearm is calculated.

[0061] It should be noted that the above-mentioned relevant data include basic shape data of the object, such as length, width, height, etc.; the size of the target virtual model can be referenced according to the data of the above-mentioned virtual reference object model in combination with actual conditions.

[0062] In an optional embodiment, calculating the shape parameters of the target virtual model based on the shape parameters of the virtual reference object model includes:

[0063] Step S502, using the first orientation of the virtual reference object model and the second orientation of the target virtual model, calculating the angle between the first orientation and the second orientation;

[0064] Step S504, establishing a three-dimensional rectangular coordinate system with the center of the virtual reference model as the origin;

[0065] Step S506: In the three-dimensional rectangular coordinate system, the shape parameters of the target virtual model are calculated by using the included angle and the preset parameters.

[0066] In the embodiment of the present disclosure, the angle between the first orientation and the second orientation is calculated using the first orientation of the virtual reference object model and the second orientation of the target virtual model; a three-dimensional rectangular coordinate system is established with the center of the virtual reference object model as the origin; in the three-dimensional rectangular coordinate system, the shape parameters of the target virtual model are calculated using the angle and the preset parameters.

[0067] In the embodiment of the present disclosure, in the virtual game scene, the angle between the virtual box and the virtual gun is calculated according to the orientation information of the virtual reference object model (e.g., a rectangular box) in the virtual scene and the orientation information of the target virtual model (e.g., a virtual gun) in the virtual scene, such as Figure 5The schematic diagram of the specific calculation method of the appearance parameters of the virtual firearm shown in the figure is that a three-dimensional rectangular coordinate system (X, Y, Z) is established at the center point of the above-mentioned virtual box, and at the same time, a three-dimensional rectangular coordinate system (x, y, z) is established at the center position of the above-mentioned virtual firearm. According to the angle information α in the two three-dimensional rectangular coordinate systems and the specific values ​​of the above-mentioned virtual box, the appearance parameters of the above-mentioned virtual firearm are calculated.

[0068] It should be noted that, in the embodiments of the present disclosure, Figure 6 As shown, the data of the target virtual model can also be edited according to the player's preference to change its shape and size. After the shape and size of the target virtual model are adjusted, the corresponding tactile force also changes accordingly. For example, when the virtual reference model is at its original size, the diameter of the handle of the virtual firearm is 5 cm. At this time, the player can feel the cylinder with a diameter of 5 cm fed back by the wearable device; when the player adjusts the diameter of the handle of the virtual firearm to 8 cm, the player can feel the cylinder with a diameter of 8 cm fed back by the wearable device.

[0069] In the embodiments of the present disclosure, Figure 7 The schematic diagram of the wearable device generating tactile force shown is that the wearable device generates the tactile force based on the second data. The wearable device can be a built-in chip of the wearable device or an external shell of the wearable device. The wearable device generates the tactile force after receiving the tactile force data.

[0070] Through the method of the disclosed embodiment, in a virtual game, the player, with the assistance of a small number of external objects (gloves, microchips), obtains virtual images captured by an augmented reality device, calculates according to the values ​​and angles of the virtual reference object model, obtains the appearance parameters of the above-mentioned target virtual model and the corresponding data of the tactile force, and generates physical stimulation such as pressure change or current stimulation on the gloves or chip according to the above-mentioned data, thereby achieving a technical effect of obtaining a large number of relatively accurate feelings of the real object by using only photos and pictures, and can restore the real touch of different types of firearms, so that players can get the best holding experience.

[0071] In an optional embodiment, calculating the tactile force corresponding to the target virtual model according to the appearance parameters of the target virtual model and the current shooting angle of the target object includes:

[0072] Step S602, obtaining a plurality of shape parameters of the target object corresponding to a plurality of different shooting angles;

[0073] Step S604, determining a target shape parameter corresponding to the current shooting angle from the multiple shape parameters;

[0074] Step S606: Calculate the tactile force corresponding to the target virtual model at the current shooting angle according to the target appearance parameters.

[0075] like Figure 8a and Figure 8b Shown are firearms (target objects) observed at different shooting angles, for example, Figure 8a Shown is a side view of the firearm and Figure 8b Shown is a firearm viewed from a top-down angle.

[0076] As an optional embodiment, since the multiple appearance parameters of the firearms corresponding to the multiple different shooting angles, that is, the appearance parameters of the firearms at different shooting angles are different, for example, the appearance parameters such as length, width, and height are not the same, therefore, during the game, according to the change of the shooting angle at which the target object is presented in the screen, the player determines the target appearance parameters corresponding to the current shooting angle from the above multiple appearance parameters, and calculates the tactile force corresponding to the virtual three-dimensional model of the firearm at the current shooting angle according to the above target appearance parameters, that is, correspondingly generates different tactile sensations of the virtual three-dimensional model at the current shooting angle, for example, the player controls the virtual hand to touch the Figure 8a The firearm is shown in side view and Figure 8b When the player touches the firearm in the top view shown, the tactile sensation fed back to the player's gloves is different, because the touch sensation is different at different shooting angles. Through this example embodiment, the player can be provided with the tactile sensation of the target virtual model corresponding to the current shooting angle, so that the tactile sensation of the target virtual model at different shooting angles is no longer a single fixed mode, the experience is more realistic, and a better grip feeling is provided. According to the embodiment of the present disclosure, a device embodiment for implementing the above-mentioned tactile sensation generation method based on augmented reality is also provided, Fig. 9 is a structural schematic diagram of a tactile sensation generating device based on augmented reality according to an embodiment of the present disclosure, such as Fig. 9 As shown, the above-mentioned tactile sensation generating device based on augmented reality includes: a shooting module 80, a calculation module 82 and an output module 84, wherein:

[0077] A shooting module 80 is used to obtain a virtual scene image by shooting a target object through an augmented reality device, wherein the display content in the above virtual scene image at least includes: a target virtual model; a calculation module 82 is used to respond to a touch instruction for the above target virtual model, and calculate the tactile force corresponding to the above target virtual model according to the appearance parameters of the above target virtual model and the current shooting angle of the above target object; an output module 84 is used to output the above tactile force through a wearable device, wherein the above wearable device is used in conjunction with the above augmented reality device.

[0078] It should be noted that the above modules can be implemented by software or hardware. For example, for the latter, it can be implemented in the following ways: the above modules can be located in the same processor; or the above modules can be located in different processors in any combination.

[0079] It should be noted that the shooting module 80, the calculation module 82 and the output module 84 in the above-mentioned tactile sensation generating device based on augmented reality correspond to steps S102 to S106 in the method embodiment, and the examples and application scenarios implemented by the above-mentioned modules and the corresponding steps are the same, but are not limited to the contents disclosed in the above-mentioned method embodiment. It should be noted that the above-mentioned modules can be run in a computer terminal as part of the device.

[0080] It should be noted that the optional or preferred implementation modes of this embodiment can refer to the relevant description in the method embodiment, which will not be repeated here.

[0081] The above-mentioned tactile sensation generating device based on augmented reality may further include a processor and a memory. The above-mentioned tactile sensation generating device based on augmented reality and the like are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to implement corresponding functions.

[0082] The processor includes a kernel, which retrieves the corresponding program unit from the memory. The kernel may be one or more. The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. The memory includes at least one memory chip.

[0083] According to an embodiment of the present application, a computer-readable storage medium embodiment is also provided. Optionally, in this embodiment, the computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute any of the above-mentioned methods for generating tactile sensations based on augmented reality.

[0084] Optionally, in this embodiment, the computer-readable storage medium may be located in any one of the computer terminals in a computer terminal group in a computer network, or in any one of the mobile terminals in a mobile terminal group, and the computer-readable storage medium includes a stored program.

[0085] Optionally, when the program is running, the device where the computer-readable storage medium is located is controlled to perform the following functions: obtain a virtual scene picture by photographing the target object through an augmented reality device, wherein the display content in the above virtual scene picture at least includes: a target virtual model; responding to a touch instruction for the above target virtual model, calculating the tactile force corresponding to the above target virtual model according to the appearance parameters of the above target virtual model and the current shooting angle of the above target object; outputting the above tactile force through a wearable device, wherein the above wearable device is used in conjunction with the above augmented reality device.

[0086] Optionally, when the program is running, the device where the computer-readable storage medium is located is controlled to perform the following functions: based on the movement of the above-mentioned wearable device, the above-mentioned virtual object is controlled to move accordingly in the above-mentioned virtual scene screen; when it is detected that the above-mentioned virtual object moves to the above-mentioned target virtual model, the above-mentioned touch instruction is generated.

[0087] Optionally, when the program is running, the device where the computer-readable storage medium is located is controlled to perform the following functions: determine the target geometry corresponding to the target object through the above-mentioned correspondence, wherein the target object is any entity object among the above-mentioned multiple entity objects; generate the target virtual model according to the above-mentioned target geometry; and calculate the shape parameters of the target virtual model based on the preset parameters of the virtual reference object model.

[0088] Optionally, when the program is running, the device where the computer-readable storage medium is located is controlled to perform the following functions: using the first orientation of the above-mentioned virtual reference object model and the second orientation of the above-mentioned target virtual model, calculate the angle between the above-mentioned first orientation and the above-mentioned second orientation; establish a three-dimensional rectangular coordinate system with the center of the above-mentioned virtual reference object model as the origin; in the above-mentioned three-dimensional rectangular coordinate system, calculate the appearance parameters of the above-mentioned target virtual model through the above-mentioned angle and the above-mentioned preset parameters.

[0089] Optionally, when the program is running, the device where the computer-readable storage medium is located is controlled to perform the following functions: according to the appearance parameters of the above-mentioned target virtual model and the current shooting angle of view of the above-mentioned target object, the tactile force corresponding to the above-mentioned target virtual model is calculated, including: obtaining multiple appearance parameters corresponding to the above-mentioned target object under multiple different shooting angles; determining the target appearance parameters corresponding to the above-mentioned current shooting angle from the above-mentioned multiple appearance parameters; and calculating the tactile force corresponding to the above-mentioned target virtual model under the above-mentioned current shooting angle according to the above-mentioned target appearance parameters.

[0090] According to an embodiment of the present application, a processor embodiment is also provided. Optionally, in this embodiment, the processor is used to run a program, wherein when the program is run, any one of the tactile sensation generation methods based on augmented reality is executed.

[0091] An embodiment of the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute any one of the above-mentioned augmented reality-based tactile generation methods.

[0092] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing a program that is initialized with the following method steps: obtaining a virtual scene screen by photographing a target object through an augmented reality device, wherein the display content in the above virtual scene screen includes at least: a target virtual model; responding to a touch instruction for the above target virtual model, calculating the tactile force corresponding to the above target virtual model according to the appearance parameters of the above target virtual model and the current shooting angle of the above target object; outputting the above tactile force through a wearable device, wherein the above wearable device is used in conjunction with the above augmented reality device.

[0093] Optionally, when executed on a data processing device, it is suitable for executing a program that initializes the following method steps: based on the movement of the above-mentioned wearable device, controlling the above-mentioned virtual object to make corresponding movements in the above-mentioned virtual scene screen; when it is detected that the above-mentioned virtual object moves to the above-mentioned target virtual model, generating the above-mentioned touch instruction.

[0094] Optionally, when executed on a data processing device, it is suitable for executing a program initialized with the following method steps: determining the target geometry corresponding to the target object through the above-mentioned correspondence, wherein the target object is any entity object among the above-mentioned multiple entity objects; generating the target virtual model according to the above-mentioned target geometry; and calculating the shape parameters of the target virtual model based on the preset parameters of the virtual reference object model.

[0095] Optionally, when executed on a data processing device, the program is suitable for executing initialization having the following method steps: using the first orientation of the above-mentioned virtual reference object model and the second orientation of the above-mentioned target virtual model, calculating the angle between the above-mentioned first orientation and the above-mentioned second orientation; establishing a three-dimensional rectangular coordinate system with the center of the above-mentioned virtual reference object model as the origin; in the above-mentioned three-dimensional rectangular coordinate system, calculating the shape parameters of the above-mentioned target virtual model through the above-mentioned angle and the above-mentioned preset parameters.

[0096] The serial numbers of the above-mentioned embodiments of the present disclosure are only for description and do not represent the advantages or disadvantages of the embodiments.

[0097] In the above embodiments of the present disclosure, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0098] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the above-mentioned units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0099] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0100] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0101] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable computer-readable storage medium. Based on such an understanding, the technical solution of the present disclosure is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a computer-readable storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the above-mentioned methods of each embodiment of the present disclosure. The aforementioned computer-readable storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0102] The above are only preferred embodiments of the present disclosure. It should be pointed out that, for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present disclosure. These improvements and modifications should also be regarded as the protection scope of the present disclosure.

Claims

1. A method for generating tactile sensation based on augmented reality, characterized in that: include: The target object is photographed by an augmented reality device to obtain a virtual scene picture, wherein the display content in the virtual scene picture at least includes: a target virtual model; In response to a touch instruction for the target virtual model, the tactile force corresponding to the target virtual model is calculated according to the appearance parameters of the target virtual model and the current shooting angle of the target object, wherein the appearance parameters are determined based on preset parameters of the virtual reference object model; Outputting the tactile force through a wearable device, wherein the wearable device is used in conjunction with the augmented reality device; Among them, the tactile force corresponding to the target virtual model is calculated according to the appearance parameters of the target virtual model and the current shooting angle of view for shooting the target object, including: obtaining the target appearance parameters corresponding to the current shooting angle of view, and calculating the tactile force corresponding to the target virtual model at the current shooting angle of view according to the target appearance parameters.

2. The method according to claim 1, characterized in that The display content in the virtual scene screen also includes: a virtual object, and the wearable device is used to control the movement of the virtual object in the virtual scene screen.

3. The method according to claim 2, characterized in that The method further comprises: Based on the movement of the wearable device, controlling the virtual object to move accordingly in the virtual scene screen; When it is detected that the virtual object moves to the target virtual model, the touch instruction is generated.

4. The method according to claim 1, characterized in that: The method further comprises: Using the contour information of the plurality of entity objects, selecting a corresponding geometric body for each entity object in the plurality of entity objects; A correspondence is established between each solid object and the corresponding geometry.

5. The method according to claim 4, characterized in that The method further comprises: Determining a target geometric body corresponding to the target object through the corresponding relationship, wherein the target object is any entity object among the multiple entity objects; Generate the target virtual model according to the target geometry; The appearance parameters of the target virtual model are calculated based on the preset parameters of the virtual reference object model.

6. The method according to claim 5, characterized in that The shape parameters of the target virtual model are calculated based on the shape parameters of the virtual reference object model, including: Calculate an angle between the first orientation and the second orientation by using the first orientation of the virtual reference object model and the second orientation of the target virtual model; Establishing a three-dimensional rectangular coordinate system with the center of the virtual reference object model as the origin; In the three-dimensional rectangular coordinate system, the appearance parameters of the target virtual model are calculated by using the included angle and the preset parameters.

7. The method according to claim 1, characterized in that Acquiring the target shape parameters corresponding to the current shooting angle of view, including: Acquire multiple appearance parameters of the target object corresponding to multiple shooting angles; A target shape parameter corresponding to the current shooting angle of view is determined from the multiple shape parameters.

8. A tactile sensation generating device based on augmented reality, characterized in that: include: A shooting module, used for shooting a target object through an augmented reality device to obtain a virtual scene picture, wherein the display content in the virtual scene picture at least includes: a target virtual model; a calculation module, configured to respond to a touch instruction directed to the target virtual model, and calculate a tactile force corresponding to the target virtual model according to an appearance parameter of the target virtual model and a current shooting angle of view for shooting the target object, wherein the appearance parameter is determined based on preset parameters of a virtual reference object model; An output module, configured to output the tactile force through a wearable device, wherein the wearable device is used in conjunction with the augmented reality device; Among them, the calculation module calculates the tactile force corresponding to the target virtual model according to the appearance parameters of the target virtual model and the current shooting angle of view of the target object through the following steps: obtaining the target appearance parameters corresponding to the current shooting angle of view, and calculating the tactile force corresponding to the target virtual model at the current shooting angle of view according to the target appearance parameters.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method for generating tactile sensation based on augmented reality according to any one of claims 1 to 7.

10. An electronic device comprising a memory and a processor, characterized in that: The memory stores a computer program, and the processor is configured to run the computer program to execute the method for generating tactile sensation based on augmented reality according to any one of claims 1 to 7.

Images