A method for implementing a curling virtual reality competition

Through force feedback and motion capture technology, the virtual reality competition of curling sports is realized, solving the problem of limited popularity of curling sports, breaking time and space restrictions, and improving the entertainment and Universality.

CN116650940BActive Publication Date: 2024-11-15HARBIN INST OF TECH +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310521043.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-15
Estimated Expiration
2043-05-10

AI Technical Summary

Technical Problem

The popularity of curling sports is limited by the small number of curling venues, and the existing technology is difficult to achieve efficient multi-person/human-computer interactive virtual reality competitions.

Method used

Based on force feedback and motion capture technology, a model between curling throwing action and initial state of curling ball movement is established. Combined with friction model and multi-body collision model, the curling ball movement status is estimated and displayed in real time, and ice is realized through VR glasses platform Virtual reality interaction during the pot competition process.

Benefits of technology

Break the limitations of time and space, realize multi-person/human-computer interactive curling competitions, improve the entertainment and universality of curling sports, and provide effective means for the promotion of curling sports.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116650940B_ABST
    Figure CN116650940B_ABST
Patent Text Reader

Abstract

The present invention proposes a method for realizing a curling virtual reality competition. The present invention establishes a model of the relationship between the curling throwing action and the initial state of the curling ball based on force feedback and motion capture technology, estimates and displays the curling ball movement state in real time based on the friction model in the virtual space, and simultaneously establishes a model between the ice wiping action and the change of the curling ball movement state by the ice brushing movement in the virtual space, predicts the position distribution of the curling ball based on the multi-body collision model, and finally interactively displays the curling competition process through the VR glasses virtual reality platform to realize the curling competition confrontation. The method can estimate the curling ball movement state and landing point distribution in real time by modeling the curling sport and building a curling competition virtual reality system software and hardware platform, realize multi-person / human-computer interactive curling competition in the virtual reality environment, and provide conditions for the popularization of curling.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of artificial intelligence virtual reality technology, and in particular relates to a method for realizing a curling virtual reality competition. The method realizes a multi-person / human-computer interactive virtual reality competition through curling sport modeling. Background Art

[0002] Curling usually requires a lot of practice to master the curling throwing and ice wiping techniques. Due to the small number of curling venues in my country, curling is difficult to popularize. Based on virtual reality technology, online multi-person / human-computer interactive curling competitions can be realized, which plays a vital role in the popularization of curling. In the curling virtual reality competition, the core technical difficulties are the mathematical model of curling ball movement, the mathematical model of collision, the estimation of the initial state of curling throwing action and curling ball movement, and the mathematical model of ice wiping process. Summary of the invention

[0003] The present invention aims to solve the problems in the prior art and proposes a method for realizing a curling virtual reality competition. The method can realize a multi-person / human-machine curling competition process, break the time and space restrictions on the public's participation in curling, and has strong entertainment and universality.

[0004] The present invention establishes a model of the relationship between the curling throwing action and the initial state of the curling ball based on force feedback and motion capture technology, estimates and displays the motion state of the curling ball in real time in the virtual space based on the friction model, and simultaneously establishes a model of the effect of the ice wiping action and the ice brushing movement in the virtual space on the change of the motion state of the curling ball, predicts the position distribution of the curling ball based on the multi-body collision model, and finally interactively displays the curling game process through a VR glasses virtual reality platform to realize curling sports competition confrontation.

[0005] The present invention is implemented by the following technical scheme. The present invention proposes a method for implementing a curling sports virtual reality competition, and the method comprises the following steps:

[0006] Step 1: Establish a model between the curling throwing action and the initial state of the curling ball based on force feedback and motion capture technology;

[0007] Step 2: According to the initial state of the curling ball obtained in step 1, the curling ball competition venue is divided into a free skating area, an ice-rubbing area and a camping area in the virtual space, and the real-time motion state of the curling ball is estimated and displayed based on the friction force models of different areas;

[0008] Step 3: Predict the position distribution of the curling ball based on the multi-body collision model, and finally interactively display the curling game process through the virtual reality glasses platform, give the game score in real time, and realize the curling virtual reality competition confrontation.

[0009] Furthermore, in step one, a curling sport virtual reality hardware platform is built, the hardware platform includes a kicker with a force feedback device, a wearable somatosensory device and virtual reality glasses; the virtual reality curling throwing environment is triggered by pedaling the kicker with a force feedback device, and the real-time reverse thrust and pedal-off time are obtained; the squatting action is obtained by the wearable somatosensory device to trigger the start of virtual gliding, and the pedal-off time is used as the gliding time, and the virtual grip time, arm yaw angle and wrist rotation angular velocity are obtained according to the wearable somatosensory device of the hand; the virtual reality glasses observe the entire curling ball throwing and movement process by loading the virtual reality curling hall venue and facilities, digital curling athletes and simulation engine.

[0010] Furthermore, in step 1, the human motion information when throwing the curling ball is obtained: the center of the contact plane between the pedal and the ground is defined as the origin of the coordinate system, the direction of the human body stepping out of the pedal is the positive direction of the x-axis, the direction perpendicular to the ground and upward is the positive direction of the y-axis, and the z-axis direction is perpendicular to the xy plane and satisfies the right-hand screw rule; first, the virtual throw is triggered by the force feedback device of the pedal, and the real-time reverse thrust F is obtained. x (t) and the moment t1 when the pedal is released, the sliding time is estimated; then the wearable somatosensory device is used to obtain the time t2 when the human hand holds the virtual ball handle after the human pedals off, and the arm yaw angle and the wrist rotation angular velocity ω1.

[0011] Furthermore, in step 1, the initial state of the curling ball when it is thrown is estimated: assuming that the friction coefficient of the virtual ice surface is μ0, the mass of the curling ball is m, and the acceleration of gravity is g, the estimated initial state of the curling ball when it is thrown includes: initial velocity v0, initial angular velocity ω0 and initial centerline offset s0; the estimated calculation formula is:

[0012]

[0013] ω0=ω1 (2)

[0014]

[0015] Wherein, M is the human body mass which can be preset.

[0016] Furthermore, in step 2, the motion state of the curling ball in the free skating area is estimated: the front half area between the two forward throwing lines of the curling field is defined as the free skating area of ​​the curling ball. In the free skating area, the front half of the curling ball slides on the rough ice surface with a friction coefficient of μ1, and the back half of the curling ball slides on the smooth ice surface with a friction coefficient of μ2. The curling ball moves in a straight line under the friction force generated by μ1 and μ2.

[0017] Furthermore, in step 2, the motion state of the curling ball in the ice-rubbing area is estimated: the second half of the area between the two front throwing lines of the curling field is defined as the ice-rubbing area of ​​the curling ball, and the frequency f of the ice-rubbing action of the human arm is obtained through the wearable somatosensory device. The friction force F generated by the ice-rubbing action in the z-axis direction z , frequency f and friction F z The curling ball is proportional to the friction F z It moves along a parabola under the action of.

[0018] Furthermore, the motion state of the curling ball in the camp area is estimated: the area after the curling ball passes through the second throwing lines is defined as the camp area, and a curling ball landing position prediction model is established through a deep learning algorithm based on a convolutional neural network. The initial velocity v0, initial angular velocity ω0, initial center line offset s0 and ice-wiping action frequency f are used as input to estimate the landing position and running trajectory of the curling ball.

[0019] Furthermore, in step three,

[0020] Design curling ball collision model: The curling ball collision model is divided into four categories: frontal collision model, side collision model, double-click collision model, and pass-through collision model. The collision model is classified according to the velocity direction of the thrown curling ball at the moment of collision and the angle between the center of mass of the two curling balls to determine the collision model to be used;

[0021] Predict the position distribution of the curling ball: According to the law of conservation of momentum, the velocity direction and magnitude of the curling ball after the four types of collision models are realized are obtained. Then, according to the law of conservation of angular momentum, the angular velocity direction and magnitude of the curling ball after the four types of collision models are realized are obtained. Then, according to step 2, the landing point and running trajectory of each curling ball are estimated.

[0022] Real-time virtual reality game scores: The movement status information of the curling ball is transmitted to the virtual reality glasses platform, the curling game process is interactively displayed, and the distance from the center point of the base camp is calculated based on the landing position coordinates of each curling ball, and the game scores are given in real time to realize the virtual reality curling competition.

[0023] The present invention proposes an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of a method for implementing a curling virtual reality competition when executing the computer program.

[0024] The present invention provides a computer-readable storage medium for storing computer instructions, which, when executed by a processor, implement the steps of a method for implementing a curling virtual reality competition.

[0025] Compared with the prior art, the beneficial effects of the present invention are as follows: the method for realizing a curling virtual reality competition described in the present invention utilizes virtual reality technology, and by modeling the curling sport to build a software and hardware platform for a curling competition virtual reality system, it is possible to estimate the movement state and landing point distribution of the curling ball in real time, realize a multi-person / human-computer interactive curling competition in a virtual reality environment, and provide conditions for the popularization of curling sport. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0027] Figure 1 This is a framework flow chart of a method for implementing a curling virtual reality competition according to the present invention. DETAILED DESCRIPTION

[0028] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] The objective of the present invention is achieved through the following technical scheme: first, a model between the curling throwing action and the initial state of the curling ball is established based on force feedback and motion capture technology, and then the motion state of the curling ball is estimated and displayed in real time in the virtual space based on the friction model, and then a model between the ice wiping action and the change of the motion state of the curling ball caused by the ice brushing movement in the virtual space is established, and the position distribution of the curling ball is predicted based on the multi-body collision model, and finally the curling game process is interactively displayed through the VR glasses virtual reality platform to realize the curling sports competition confrontation.

[0030] Combination Figure 1 The present invention proposes a method for implementing a curling sports virtual reality competition, the method comprising the following steps:

[0031] Step 1: Establish a model between the curling throwing action and the initial state of the curling ball based on force feedback and motion capture technology.

[0032] The first step is to build a virtual reality hardware platform for curling. It includes a kicker with a force feedback device, a wearable somatosensory device, and virtual reality glasses. The virtual reality curling throwing environment is triggered by pedaling the kicker with a force feedback device, and the real-time reverse thrust and pedal release time are obtained; the squatting action is obtained through the wearable somatosensory device to trigger the start of virtual gliding, and the pedal release time is used as the gliding time. At the same time, the virtual grip time, arm yaw angle, and wrist rotation angular velocity are obtained according to the wearable somatosensory device on the hand; the virtual reality glasses observe the entire curling ball throwing and movement process by loading the virtual reality curling hall venue and facilities, digital curling athletes, and simulation engines.

[0033] The second step is to obtain the human motion information when throwing the curling ball. Define the center of the contact plane between the pedal and the ground as the origin of the coordinate system, the direction of the human body stepping out of the pedal is the positive direction of the x-axis, the direction perpendicular to the ground and upward is the positive direction of the y-axis, and the z-axis direction is perpendicular to the xy plane and satisfies the right-hand screw rule. First, trigger the virtual throw through the force feedback device of the pedal and obtain the real-time reverse thrust F x (t) and the moment t1 when the pedal is released, the sliding time is estimated; then the wearable posture sensing device is used to obtain the time t2 when the human body holds the virtual ball handle after pedaling off, and the arm yaw angle The wrist rotation angular velocity is ω1.

[0034] Step 3: Estimate the initial state of the curling ball when it is thrown. Assume that the friction coefficient of the virtual ice surface is μ0, the mass of the curling ball is m, and the acceleration of gravity is g. The estimated initial state of the curling ball when it is thrown includes: initial velocity v0, initial angular velocity ω0, and initial centerline offset s0. The estimated calculation formula is:

[0035]

[0036] ω0=ω1 (2)

[0037]

[0038] Wherein, M is the human body mass which can be preset.

[0039] Step 2: Based on the initial state of the curling ball obtained in the third step, the curling competition venue is divided into a free skating area, an ice-rubbing area, and a camping area in the virtual space, and the real-time motion state of the curling ball is estimated and displayed based on the friction models of different areas.

[0040] Step 1: Estimate the motion state of the curling ball in the free skating zone. Define the first half of the area between the two front throw lines of the curling field as the free skating zone of the curling ball. In the free skating zone, the front half of the curling ball slides on the rough ice surface with a friction coefficient of μ1, and the back half of the curling ball slides on the smooth ice surface with a friction coefficient of μ2. The curling ball moves in a straight line under the friction force generated by μ1 and μ2.

[0041] Step 2: Estimate the motion state of the curling ball in the ice-rubbing area. Define the second half of the area between the two front throw lines of the curling field as the ice-rubbing area of ​​the curling ball. Use the wearable posture sensing device to obtain the frequency f of the human arm's ice-rubbing action. The ice-rubbing action generates a friction force F in the z-axis direction. z , frequency f and friction F z The curling ball is proportional to the friction F z It moves along a parabola under the action of.

[0042] Step 3: Estimate the motion state of the curling ball in the camp area. Define the area after the curling ball passes through the second throwing line as the camp area, and establish a curling ball landing position prediction model through a deep learning algorithm based on a convolutional neural network. Take the initial velocity v0, initial angular velocity ω0, initial centerline offset s0 and ice-wiping action frequency f as input to estimate the landing position and running trajectory of the curling ball.

[0043] Step 3: Predict the position distribution of the curling ball based on the multi-body collision model, and finally interactively display the curling game process through the virtual reality glasses platform, give the game score in real time, and realize the curling virtual reality competition confrontation.

[0044] 1. Design a curling ball collision model. The curling ball collision model is divided into four categories: frontal collision model, side collision model, double-hit collision model, and pass-hit collision model. The collision model is classified according to the velocity direction of the thrown curling ball at the moment of collision and the angle between the center of mass of the two curling balls to determine the collision model to be used.

[0045] 2. Predict the position distribution of the curling ball. According to the law of conservation of momentum, the velocity direction and magnitude of the curling ball after the four types of collision models are realized. According to the law of conservation of angular momentum, the angular velocity direction and magnitude of the curling ball after the four types of collision models are realized are obtained. Then, according to step 3, the landing point and trajectory of each curling ball are estimated.

[0046] 3. Real-time virtual reality game scores. The motion status information of the curling ball is transmitted to the virtual reality glasses platform, the curling game process is interactively displayed, and the distance from the center point of the base camp is calculated based on the coordinates of the landing point of each curling ball, and the game score is given in real time to realize the virtual reality curling competition.

[0047] The present invention proposes an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of a method for implementing a curling virtual reality competition when executing the computer program.

[0048] The present invention provides a computer-readable storage medium for storing computer instructions, which, when executed by a processor, implement the steps of a method for implementing a curling virtual reality competition.

[0049] The memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DRRAM). It should be noted that the memory of the method described in the present invention is intended to include, but is not limited to, these and any other suitable types of memory.

[0050] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a high-density digital video disc (DVD)), or a semiconductor medium (eg, a solid state disc (SSD)).

[0051] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in a processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

[0052] It should be noted that the processor in the embodiment of the present application can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method embodiment can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or the hardware and software modules in the decoding processor can be combined and performed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0053] The above is a detailed introduction to a method for realizing a curling virtual reality competition proposed by the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for implementing a curling sport virtual reality competition, characterized in that: The method comprises the following steps: Step 1: Establish a model between the curling throwing action and the initial state of the curling ball based on force feedback and motion capture technology; Step 2: According to the initial state of the curling ball obtained in step 1, the curling ball competition venue is divided into a free skating area, an ice-rubbing area and a camping area in the virtual space, and the real-time motion state of the curling ball is estimated and displayed based on the friction force models of different areas; Step 3: Predict the position distribution of the curling ball based on the multi-body collision model, and finally interactively display the curling game process through the virtual reality glasses platform, give the game score in real time, and realize the curling sports virtual reality competition confrontation; wherein, the collision model of the curling ball is divided into 4 categories: frontal collision model, side collision model, double-click collision model, and pass-and-hit collision model. The collision model is classified according to the speed direction of the thrown curling ball at the moment of collision and the angle between the center of mass of the two curling balls, and the collision model to be used is determined; In step one, a curling virtual reality hardware platform is built, the hardware platform includes a kicker with a force feedback device, a wearable somatosensory device and virtual reality glasses; the virtual reality curling throwing environment is triggered by pedaling the kicker with a force feedback device, and the real-time reverse thrust and pedal release time are obtained; the squatting action is obtained by the wearable somatosensory device to trigger the start of virtual gliding, and the pedal release time is used as the gliding time, and the virtual grip time, arm yaw angle and wrist rotation angular velocity are obtained according to the wearable somatosensory device of the hand; the virtual reality glasses observe the entire curling ball throwing and movement process by loading the virtual reality curling hall venue and facilities, digital curling athletes and simulation engine; In step 1, the human motion information when throwing the curling ball is obtained: the center of the contact plane between the pedal and the ground is defined as the origin of the coordinate system, the direction of the human body stepping out of the pedal is the positive direction of the x-axis, the direction perpendicular to the ground and upward is the positive direction of the y-axis, and the z-axis direction is perpendicular to the xy plane and satisfies the right-hand screw rule; first, the virtual throw is triggered through the force feedback device of the pedal, and the real-time reverse thrust F is obtained. x (t) and the moment t1 when the pedal is released, the sliding time is estimated; then the wearable somatosensory device is used to obtain the time t2 when the human hand holds the virtual ball handle after the human pedals off, and the arm yaw angle and wrist rotation angular velocity ω1; In step 1, the initial state of the curling ball when thrown is estimated: assuming that the friction coefficient of the virtual ice surface is μ0, the mass of the curling ball is m, and the acceleration of gravity is g, the estimated initial state of the curling ball when thrown includes: initial velocity v0, initial angular velocity ω0 and initial centerline offset s0; the estimated calculation formula is: ω0=ω1 (2) Wherein, M is the human body mass which can be preset.

2. The method according to claim 1, characterized in that: In step 2, the motion state of the curling ball in the free skating area is estimated: the front half area between the two front throwing lines of the curling field is defined as the free skating area of ​​the curling ball. In the free skating area, the front half of the curling ball slides on the rough ice surface with a friction coefficient of μ1, and the back half of the curling ball slides on the smooth ice surface with a friction coefficient of μ2. The curling ball moves in a straight line under the friction force generated by μ1 and μ2.

3. The method according to claim 2, characterized in that: In step 2, the motion state of the curling ball in the ice-rubbing area is estimated: the second half of the area between the two front throwing lines of the curling field is defined as the ice-rubbing area of ​​the curling ball, and the frequency f of the ice-rubbing action of the human arm is obtained through the wearable somatosensory device. The friction force F generated by the ice-rubbing action in the z-axis direction z , frequency f and friction F z The curling ball is proportional to the friction F z It moves along a parabola under the action of.

4. The method according to claim 3, characterized in that: Estimate the motion state of the curling ball in the camp area: define the area after the curling ball passes through the second throwing line as the camp area, and establish a curling ball landing position prediction model through a deep learning algorithm based on a convolutional neural network. Taking the initial velocity v0, initial angular velocity ω0, initial centerline offset s0 and ice-wiping action frequency f as input, estimate the landing position and running trajectory of the curling ball.

5. The method according to claim 1, characterized in that: In step three, Predict the position distribution of the curling ball: According to the law of conservation of momentum, the velocity direction and magnitude of the curling ball after the four types of collision models are realized are obtained. Then, according to the law of conservation of angular momentum, the angular velocity direction and magnitude of the curling ball after the four types of collision models are realized are obtained. Then, according to step 2, the landing point and running trajectory of each curling ball are estimated. Real-time virtual reality game scores: The movement status information of the curling ball is transmitted to the virtual reality glasses platform, the curling game process is interactively displayed, and the distance from the center point of the base camp is calculated based on the landing position coordinates of each curling ball, and the game scores are given in real time to realize the virtual reality curling competition.

6. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 5 are implemented.

7. A computer-readable storage medium for storing computer instructions, characterized in that: When the computer instructions are executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.