Object-object interaction method and device based on virtual reality, equipment, medium and product

Abstract

The invention discloses an object-object interaction method, device and equipment based on virtual reality, a medium and a product. The method comprises the steps that object information of a current object in a virtual reality space environment is determined, and the sight height of a user watching the current object is determined; according to the object information and the sight height of the user, generating an object movement interactive point location; according to the object information and the sight height of the user, an object zooming interactive point location is generated; and displaying the object moving interactive point location and the object zooming interactive point location, so that a user can carry out self position movement based on the object moving interactive point location and carry out object size zooming based on the object zooming interactive point location. According to the technical scheme provided by the embodiment of the invention, the interaction difficulty between the user and the object based on virtual reality is reduced, and the interaction experience feeling in the practical operation process of the user is enhanced.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a method, device, equipment, medium and product for object interaction based on virtual reality. Background Art

[0002] With the continuous development of virtual reality technology, object interaction technology based on virtual display is applied in various scenarios in various fields. For example, taking the display of collections in real museums as an example, in order to protect the collections from damage while allowing visitors to see the collections, professionals usually realize the interaction between visitors and collections based on virtual reality poles, thereby improving the user experience.

[0003] However, in the existing object interaction process based on virtual reality, users need to select, move, rotate and zoom to complete a comprehensive view of the object. This method requires users to understand the operation rules and strictly follow the operation rules to complete a series of actions on the object, which increases the user's operation difficulty and interaction experience to a certain extent. Summary of the invention

[0004] The present invention provides a method, device, equipment, medium and product for object interaction based on virtual reality, so as to reduce the difficulty of interaction between a user and an object based on virtual reality and enhance the interactive experience of the user during actual operation.

[0005] According to one aspect of the present invention, a method for object interaction based on virtual reality is provided, the method comprising:

[0006] Determining object information of a current object in a virtual reality space environment, and determining a user's sight height for viewing the current object;

[0007] Generate an interactive point for object movement according to the object information and the user's sight height; and

[0008] Generate interactive points for object scaling according to the object information and the user's sight height;

[0009] The object movement interactive points and the object scaling interactive points are displayed, so that the user can move his own position based on the object movement interactive points, and scale the object size based on the object scaling interactive points.

[0010] According to another aspect of the present invention, there is provided a device for object interaction based on virtual reality, the device comprising:

[0011] An object information determination module, used to determine object information of a current object in a virtual reality space environment, and to determine a user's sight height when viewing the current object;

[0012] A mobile interactive point generation module, used to generate an object mobile interactive point according to the object information and the user's sight height; and

[0013] A zoom interaction point generation module, used to generate object zoom interaction points according to the object information and the user's sight height;

[0014] The interactive point display module is used to display the interactive points for object movement and the interactive points for object scaling, so that the user can move his own position based on the interactive points for object movement, and scale the object size based on the interactive points for object scaling.

[0015] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0016] at least one processor; and

[0017] a memory communicatively connected to the at least one processor; wherein,

[0018] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the object interaction method based on virtual reality as described in any embodiment of the present invention.

[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the object interaction method based on virtual reality as described in any embodiment of the present invention when executed.

[0020] According to another aspect of the present invention, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, the object interaction method based on virtual reality according to any embodiment of the present invention is implemented.

[0021] The technical solution of the embodiment of the present invention determines the object information of the current object in the virtual reality space environment, and determines the height of the user's line of sight viewing the current object; generates interactive points for object movement according to the object information and the height of the user's line of sight; and generates interactive points for object scaling according to the object information and the height of the user's line of sight; displays the interactive points for object movement and the interactive points for object scaling, so that the user can move their own position based on the interactive points for object movement, and scale the object size based on the interactive points for object scaling. The above technical solution can automatically generate a suitable object viewing position and a suitable handheld object size without the user having to adjust the object size and distance based on the corresponding rules, thereby reducing the difficulty of interaction between users and objects based on virtual reality, providing users with an interactive experience with strong visibility and low operation requirements to the greatest extent, and enhancing the user's interactive experience during actual operation.

[0022] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0024] Figure 1 is a flow chart of a method for object interaction based on virtual reality provided according to Embodiment 1 of the present invention;

[0025] Figure 2 is a flow chart of a method for object interaction based on virtual reality provided according to Embodiment 2 of the present invention;

[0026] Figure 3 is a structural schematic diagram of an object interaction device based on virtual reality provided according to Embodiment 3 of the present invention;

[0027] Figure 4 It is a structural schematic diagram of an electronic device for implementing the object interaction method based on virtual reality according to an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0030] Embodiment 1

[0031] Figure 1 A flowchart of an object-to-object interaction method based on virtual reality is provided in Embodiment 1 of the present invention. This embodiment is applicable to the situation of virtual interaction of objects in a virtual reality scene. The method can be executed by an object-to-object interaction device based on virtual reality. The object-to-object interaction device based on virtual reality can be implemented in the form of hardware and / or software. The object-to-object interaction device based on virtual reality can be configured in an electronic device.

[0032] The embodiments of the present invention may be executed by a host device in an object interaction system based on virtual reality technology, for example, a VR (Virtual Reality) helmet. Figure 1 As shown, the method includes:

[0033] S110: Determine object information of a current object in a virtual reality space environment, and determine a sight height of a user viewing the current object.

[0034] S120: Generate interactive points for object movement based on object information and user sight height.

[0035] S130: Generate interactive points for object scaling according to the object information and the user's sight height.

[0036] S140, displaying interactive points for object movement and interactive points for object scaling, so that the user can move the user's position based on the interactive points for object movement, and scale the object size based on the interactive points for object scaling.

[0037] Among them, in the object-to-object interaction system implemented based on virtual reality technology, the object information of all object objects in the current virtual environment space can be pre-stored in the object-to-object interaction system. For example, in the object-to-object interaction system in a museum scene, the object information of all collections in the museum can be pre-stored in the object-to-object interaction. When the user scans the collection object (current object) to be interacted with based on the image acquisition unit of the host device, the object information of the current object is obtained from the storage unit of the VR host device.

[0038] Among them, the user's line of sight height when the user operating the VR host device views the current object can be determined by the VR host device according to the height of its own device from the ground.

[0039] The object information may include object width, object height, object depth, the number of object edge pixels, and object grayscale gradient.

[0040] It is understandable that the object information of the object can be pre-stored in the storage unit in a pre-generated manner, and the object information of the corresponding object can be loaded when the corresponding object is scanned. Alternatively, the object information of the object can also be generated in real time when the corresponding object is scanned. Specifically, the object can be imaged by the image acquisition unit, and the image information acquired can be analyzed to obtain the object information. The specific method of determining the object information is described in detail in the following steps.

[0041] Among them, the object interactive points can be control points for users to click and interact. Users can use methods such as handles, gestures, and eye tracking to click, pinch, or stay on the object interactive points. The object interactive points are automatically generated coordinate points where users can clear and observe the object at an appropriate distance.

[0042] In an optional embodiment, generating an interactive point for object movement according to object information and user sight height includes:

[0043] Step a1: Determine the object placement height based on the object information and the user's line of sight height.

[0044] Optionally, the object information includes the height of the object; accordingly, determining the height of the object according to the object information and the height of the user's line of sight includes: determining the height of the object according to the height of the object and the height of the user's line of sight.

[0045] Object placement height Hset The specific determination method can be as follows:

[0046] H set =α1*h sig -α2*h obj +α3;

[0047] Among them, h sig Indicates the user's line of sight height (cm); h obj represents the height of the object (cm); α1, α2 and α3 are coefficients. The specific parameter values ​​of α1, α2 and α3 are obtained by relevant technicians based on a large number of experiments.

[0048] Specifically, a large number of standard object placement heights and corresponding standard object heights and standard user sight heights in historical periods are obtained, and parameter fitting is performed on the standard object placement heights and corresponding standard object heights and standard user sight heights to obtain the coefficients α1, α2, and α3 with the best fitting effect. Among them, α1 is preferably set to 0.557; α2 is preferably set to 0.41; and α3 is preferably set to 31.972 (cm).

[0049] Step a2: Determine the recommended viewing distance based on the object information, the user's line of sight height, and the object placement height.

[0050] Optionally, determining the recommended viewing distance based on the object information, the user's line of sight height and the object placement height includes: determining the recommended viewing distance based on the object height, the user's line of sight height and the object placement height.

[0051] Recommended viewing distance S opt The specific determination method can be as follows:

[0052] S opt =β1*h sig +β2*h obj -β3*H set +β4;

[0053] Among them, h sig Indicates the user's line of sight height (cm); h obj Indicates the height of the object (cm); H set Indicates the height at which the object is placed. The specific parameter values ​​of β1, β2 and β3 are obtained by relevant technicians based on a large number of experiments.

[0054] Specifically, a large number of standard recommended viewing distances and corresponding standard object heights, standard user sight heights, and standard object placement heights under historical periods are obtained, and parameter fitting is performed on the standard recommended viewing distances and corresponding standard object heights, standard user sight heights, and standard object placement heights to obtain the coefficients β1, β2, β3, and β4 with the best fitting effect. Among them, β1 is preferably set to 0.627; β2 is preferably set to 0.556; β3 is preferably set to 0.786; and β4 is preferably set to 106.075 (cm).

[0055] Step a3: Generate interactive points for object movement based on the recommended viewing distance.

[0056] According to the recommended viewing distance, that is, the location of the interactive device itself, the appropriate observation distance is determined, and the object movement interactive point is generated at the appropriate observation distance.

[0057] This embodiment adopts a method of automatically determining the distance between the user and the object and automatically generating a movable interactive point, without the user having to perform operations such as moving based on specifications. By clicking on the automatically generated movable interactive point of the object, the user can locate the appropriate object observation distance with one click, providing convenience for the user.

[0058] Among them, the interactive points for object scaling can be control points for users to click and scale objects. Users can use methods such as handles, gestures, and eye tracking to click, pinch, or stay on the interactive points of the object to scale the object with their eyes. When the interactive points for object scaling are clicked by the user, they automatically generate a suitable size for the user to view, without the need for the user to manually adjust the size of the object to a suitable size based on the corresponding operation specifications.

[0059] In an optional embodiment, generating an object zooming interactive point according to the object information and the user's sight height includes:

[0060] Step b1: Determine the optimal size of the handheld object based on the object information and the user's line of sight.

[0061] Optionally, the object information includes object height, object width, object depth, the number of pixel points on the object edge and the object grayscale gradient; accordingly, the optimal size of the handheld object is determined based on the object information and the user's line of sight height, including: determining the optimal size of the handheld object based on the object height, object width, object depth, the number of pixel points on the object edge, the object grayscale gradient and the user's line of sight height.

[0062] The height, width and depth of the object can be obtained by scanning the 3D model of the object using a 3D scanner deployed on the host device, and then the height, width and depth of the object can be determined by analyzing the 3D model. Alternatively, the object size can be determined by collecting an image of the object using a line of sight analysis method and analyzing the image based on edge detection and contour extraction technology.

[0063] Among them, the number of edge pixels of the object can be obtained by collecting the image of the object and performing edge detection based on a preset edge detection algorithm, using the image after edge detection to extract the contour, and counting the number of pixels contained in each contour to obtain the number of edge pixels of the object.

[0064] The grayscale gradient of the object can be obtained by performing grayscale conversion on the acquired object image to obtain a grayscale image; using a gradient operator to extract the horizontal and vertical edges of the image; and calculating the magnitude and direction of the gradient through the horizontal and vertical edge gradients.

[0065] Specifically, the optimal object depth D in the optimal size of the handheld object size The specific determination method can be as follows:

[0066] D size =γ1*h sig -γ2*h obj -γ3*w obj +γ4*d obj +γ5*n obj -γ6*g obj ;

[0067] Among them, h sig Indicates the user's line of sight height (cm); h obj Indicates the height of the object (cm); w obj Indicates the width of the object; d obj Indicates the depth of the object; n obj Indicates the number of edge pixels of the object; g obj Represents the grayscale gradient of the object. The specific parameter values ​​of γ1, γ2, γ3, γ4, γ5 and γ6 are obtained by relevant technicians based on a large number of experiments.

[0068] Specifically, the standard optimal object depth of the standard handheld object size under a large number of historical periods and the corresponding standard user sight height, standard object height, standard object width, standard object depth, number of standard object edge pixels and standard object grayscale gradient are obtained, and parameter fitting is performed to obtain the coefficients γ1, γ2, γ3, γ4, γ5 and γ6 with the best fitting effect. Among them, γ1 is preferably set to 0.119; γ2 is preferably set to 0.105; γ3 is preferably set to 0.342; γ4 is preferably set to 0.752; γ5 is preferably set to 0.164; γ6 is preferably set to 6.18.

[0069] Based on the optimal object depth D size , determine the optimal object width and the optimal object height in proportion, and determine the optimal object depth, the optimal object width and the optimal object height as the optimal size of the handheld object.

[0070] Step b2: Generate interactive points for object scaling based on the optimal size of the handheld object.

[0071] The current object is scaled proportionally to the optimal size of the mobile phone object, and interactive points for object scaling are generated. When the user clicks on the interactive point for object scaling, the host device automatically adjusts the current object size to a suitable size so that the user can hold the current object in his hand to view or operate it in the virtual space without having to adjust it based on rules.

[0072] The technical solution of the embodiment of the present invention determines the object information of the current object in the virtual reality space environment, and determines the height of the user's line of sight viewing the current object; generates interactive points for object movement according to the object information and the height of the user's line of sight; and generates interactive points for object scaling according to the object information and the height of the user's line of sight; displays the interactive points for object movement and the interactive points for object scaling, so that the user can move their own position based on the interactive points for object movement, and scale the object size based on the interactive points for object scaling. The above technical solution can automatically generate a suitable object viewing position and a suitable handheld object size without the user having to adjust the object size and distance based on the corresponding rules, thereby reducing the difficulty of interaction between users and objects based on virtual reality, providing users with an interactive experience with strong visibility and low operation requirements to the greatest extent, and enhancing the user's interactive experience during actual operation.

[0073] Embodiment 2

[0074] Figure 2 This is a flow chart of a method for object interaction based on virtual reality provided in the second embodiment of the present invention. This embodiment provides a preferred example based on the above embodiment.

[0075] like Figure 2As shown, the method comprises the following specific steps:

[0076] S21. Determine object information of a current object in a virtual reality space environment, and determine a user's sight height for viewing the current object; the object information includes object height, object width, object depth, the number of pixel points at the edge of the object, and the grayscale gradient of the object.

[0077] S22. Determine the placement height of the object according to the height of the object and the user's sight height.

[0078] Specifically, the object is placed at a height H set The specific determination method can be as follows:

[0079] H set =0.557*h sig -0.41*h obj +31.972;

[0080] Among them, h sig Indicates the user's line of sight height (cm); h obj Indicates the height of the object (cm).

[0081] S23. Determine a recommended viewing distance according to the height of the object, the user's sight height, and the object placement height.

[0082] Specifically, the recommended viewing distance is S opt The specific determination method can be as follows:

[0083] S opt =0.627*h sig +0.556*h obj -0.786*H set +106.075;

[0084] Among them, h sig Indicates the user's line of sight height (cm); h obj Indicates the height of the object (cm); H set Indicates the height at which the object is placed.

[0085] S24. Generate interactive points for object movement according to the recommended viewing distance.

[0086] S25. Determine the optimal size of the handheld object according to the object height, object width, object depth, the number of pixel points at the edge of the object, the grayscale gradient of the object, and the user's sight height.

[0087] Specifically, the optimal object depth D in the optimal size of the handheld object size The specific determination method can be as follows:

[0088] D size =0.119*hsig -0.105*h obj -0.342*w obj +0.752*d obj +0.164*n obj -6.18*g obj ;

[0089] Among them, h sig Indicates the user's line of sight height (cm); h obj Indicates the height of the object (cm); w obj Indicates the width of the object; d obj Indicates the depth of the object; n obj Indicates the number of edge pixels of the object; g obj Represents the grayscale gradient of an object.

[0090] Based on the optimal object depth D size , determine the optimal object width and the optimal object height in proportion, and determine the optimal object depth, the optimal object width and the optimal object height as the optimal size of the handheld object.

[0091] S26. Generate interactive points for object scaling according to the optimal size of the handheld object.

[0092] S27, displaying the interactive points for object movement and the interactive points for object scaling, so that the user can move the user's position based on the interactive points for object movement, and scale the object size based on the interactive points for object scaling.

[0093] Embodiment 3

[0094] Figure 3 The present invention provides a structure diagram of a virtual reality-based object interaction device. The present invention provides a virtual reality-based object interaction device, which can be used for virtual interaction of objects in a virtual reality scene. The virtual reality-based object interaction device can be implemented in the form of hardware and / or software, such as Figure 3 As shown, the device specifically includes: an object information determination module 301, a mobile interaction point generation module 302, a zoom interaction point generation module 303 and an interaction point display module 304.

[0095] in,

[0096] The object information determination module 301 is used to determine the object information of the current object in the virtual reality space environment, and determine the sight height of the user viewing the current object;

[0097] A mobile interactive point generation module 302 is used to generate an object mobile interactive point according to the object information and the user's sight height; and

[0098] A zoom interaction point generation module 303 is used to generate an object zoom interaction point according to the object information and the user's sight height;

[0099] The interactive point display module 304 is used to display the interactive points for object movement and the interactive points for object scaling, so that the user can move his own position based on the interactive points for object movement and scale the object size based on the interactive points for object scaling.

[0100] The technical solution of the embodiment of the present invention determines the object information of the current object in the virtual reality space environment, and determines the height of the user's line of sight viewing the current object; generates interactive points for object movement according to the object information and the height of the user's line of sight; and generates interactive points for object scaling according to the object information and the height of the user's line of sight; displays the interactive points for object movement and the interactive points for object scaling, so that the user can move their own position based on the interactive points for object movement, and scale the object size based on the interactive points for object scaling. The above technical solution can automatically generate a suitable object viewing position and a suitable handheld object size without the user having to adjust the object size and distance based on the corresponding rules, thereby reducing the difficulty of interaction between users and objects based on virtual reality, providing users with an interactive experience with strong visibility and low operation requirements to the greatest extent, and enhancing the user's interactive experience during actual operation.

[0101] Optionally, the mobile interaction point generation module 302 includes:

[0102] A placement height determination unit, used to determine the placement height of the object according to the object information and the user's sight height;

[0103] A viewing distance determination unit, configured to determine a recommended viewing distance according to the object information, the user's sight height, and the object placement height;

[0104] The mobile interactive point generation unit is used to generate the object's mobile interactive point according to the recommended viewing distance.

[0105] Optionally, the object information includes the height of the object; accordingly, the placement height determination unit is specifically used to:

[0106] The object placement height is determined according to the object height and the user's line of sight height.

[0107] Optionally, the viewing distance determination unit is specifically used to:

[0108] The recommended viewing distance is determined according to the height of the object, the height of the user's line of sight and the height at which the object is placed.

[0109] Optionally, the zoom interaction point generation module 303 includes:

[0110] An optimal size determination unit, used to determine the optimal size of the handheld object according to the object information and the user's sight height;

[0111] The zoom interaction point generation unit is used to generate object zoom interactive points according to the optimal size of the handheld object.

[0112] Optionally, the object information includes object height, object width, object depth, the number of object edge pixels and object grayscale gradient;

[0113] Accordingly, the optimal size determination unit is specifically used for:

[0114] The optimal size of the handheld object is determined according to the height of the object, the width of the object, the depth of the object, the number of edge pixels of the object, the grayscale gradient of the object and the height of the user's line of sight.

[0115] The object-to-object interaction device based on virtual reality provided in the embodiment of the present invention can execute the object-to-object interaction method based on virtual reality provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0116] Embodiment 4

[0117] Figure 4 A schematic diagram of the structure of an electronic device 40 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0118] like Figure 4As shown, the electronic device 40 includes at least one processor 41, and a memory connected to the at least one processor 41, such as a read-only memory (ROM) 42, a random access memory (RAM) 43, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 41 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 42 or the computer program loaded from the storage unit 48 to the random access memory (RAM) 43. In the RAM 43, various programs and data required for the operation of the electronic device 40 can also be stored. The processor 41, the ROM 42, and the RAM 43 are connected to each other through a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0119] A number of components in the electronic device 40 are connected to the I / O interface 45, including: an input unit 46, such as a keyboard, a mouse, etc.; an output unit 47, such as various types of displays, speakers, etc.; a storage unit 48, such as a disk, an optical disk, etc.; and a communication unit 49, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 49 allows the electronic device 40 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0120] The processor 41 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 41 executes the various methods and processes described above, such as a virtual reality-based object interaction method.

[0121] In some embodiments, the object-object interaction method based on virtual reality may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 48. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 40 via the ROM 42 and / or the communication unit 49. When the computer program is loaded into the RAM 43 and executed by the processor 41, one or more steps of the object-object interaction method based on virtual reality described above may be performed. Alternatively, in other embodiments, the processor 41 may be configured to execute the object-object interaction method based on virtual reality in any other appropriate manner (e.g., by means of firmware).

[0122] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0123] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0124] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0125] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0126] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0127] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0128] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0129] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for object interaction based on virtual reality, characterized in that: include: Determining object information of a current object in a virtual reality space environment, and determining a user's sight height for viewing the current object; Generate interactive points for object movement according to the object information and the user's sight height; as well as, Generate interactive points for object scaling according to the object information and the user's sight height; The object movement interactive points and the object scaling interactive points are displayed, so that the user can move his own position based on the object movement interactive points, and scale the object size based on the object scaling interactive points.

2. The method according to claim 1, characterized in that The generating the object movement interactive point according to the object information and the user's sight height includes: Determine the placement height of the object according to the object information and the user's sight height; Determine a recommended viewing distance according to the object information, the user's sight height, and the object placement height; According to the recommended viewing distance, interactive points for object movement are generated.

3. The method according to claim 2, characterized in that The object information includes the height of the object; accordingly, determining the placement height of the object according to the object information and the user's sight height includes: The object placement height is determined according to the object height and the user's line of sight height.

4. The method according to claim 3, characterized in that The determining the recommended viewing distance according to the object information, the user's sight height, and the object placement height includes: The recommended viewing distance is determined according to the height of the object, the height of the user's line of sight and the height at which the object is placed.

5. The method according to claim 1, characterized in that The generating the object zooming interactive point according to the object information and the user's sight height includes: Determining the optimal size of the handheld object according to the object information and the user's sight height; According to the optimal size of the handheld object, interactive points for object scaling are generated.

6. The method according to claim 5, characterized in that The object information includes object height, object width, object depth, number of object edge pixels and object grayscale gradient; Accordingly, determining the optimal size of the handheld object according to the object information and the user's sight height includes: The optimal size of the handheld object is determined according to the height of the object, the width of the object, the depth of the object, the number of edge pixels of the object, the grayscale gradient of the object and the height of the user's line of sight.

7. An object interaction device based on virtual reality, characterized in that: include: An object information determination module, used to determine object information of a current object in a virtual reality space environment, and to determine a user's sight height when viewing the current object; A mobile interactive point generation module, used to generate an object mobile interactive point according to the object information and the user's sight height; as well as, A zoom interaction point generation module, used to generate object zoom interaction points according to the object information and the user's sight height; The interactive point display module is used to display the interactive points for object movement and the interactive points for object scaling, so that the user can move his own position based on the interactive points for object movement, and scale the object size based on the interactive points for object scaling.

8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the object interaction method based on virtual reality according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the virtual reality-based object interaction method according to any one of claims 1 to 6 when executed.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the object interaction method based on virtual reality according to any one of claims 1 to 6.

Images