Method, system and equipment for switching 3D mouse based on remote control scene

Abstract

The invention relates to a method, a system and equipment for switching a 3D mouse based on a remote control scene. The first controlled remote equipment notifies the first master control terminal equipment in a network communication mode, and the first master control terminal equipment receives the notification and switches to simulate a 3D mouse; when a related user operates the first master control terminal equipment by using the switching simulation 3D mouse, calculating a rotation angle and a rotation normal vector according to the relative position; and the first controlled far-end equipment calculates the rotation angle and the normal vector of the rotation by using the relative position to carry out corresponding movement, rolling and rotation operations. It can be understood that according to the technical scheme provided by the invention, in a remote control scene, three-dimensional design software or a 3D game can be used for switching a 3D mouse to carry out three-dimensional interaction operation, and for users in the three-dimensional design industry or the 3D game industry, visual rotation can be freely and visually carried out to carry out three-dimensional operation.

Description

Technical Field

[0001] The present application relates to the fields of computer technology, human-computer interaction technology and remote control technology, and in particular to a method, system and device for switching a 3D mouse based on a remote control scenario. Background Art

[0002] In the remote control scenario, users need to control the remote device through the terminal device to achieve operation and interaction. At present, the remote control method usually uses the mouse simulation operation method, but the traditional mouse is two-dimensional, and the position of the cursor on the plane is controlled by the X-axis and Y-axis. For users in the three-dimensional design industry or the 3D game industry, it is impossible to freely and intuitively rotate the vision and perform three-dimensional stereoscopic operations, so this method has limitations. Summary of the invention

[0003] In view of this, the purpose of the present invention is to provide a method, system and device for switching a 3D mouse based on a remote control scene, so as to solve the problem that the traditional mouse in the prior art is two-dimensional and controls the position of the cursor on the plane through the X-axis and Y-axis. For users in the three-dimensional design industry or the 3D game industry, it is impossible to freely and intuitively rotate the vision and perform three-dimensional stereoscopic operations, so this method has limitations.

[0004] According to a first aspect of an embodiment of the present invention, there is provided a method for switching a 3D mouse based on a remote control scene, comprising:

[0005] Obtain a first master terminal device and a first controlled remote device;

[0006] The first master terminal device sends a first connection request, and the first controlled remote device receives the first connection request sent by the first master terminal device, establishes a remote connection, and obtains relevant image data of the first controlled remote device;

[0007] Using the relevant image data of the first controlled remote device, when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through a network communication method, and the first master terminal device receives the notification and switches to simulate a 3D mouse;

[0008] When the relevant user uses the switched simulated 3D mouse to control the first main control terminal device, the rotation angle and the rotation normal vector are calculated according to the relative position;

[0009] The first controlled remote device uses the relative position to calculate the rotation angle and the rotation normal vector to perform corresponding movement, rolling, and rotation operations.

[0010] Further, the using of the relevant image data of the first controlled remote device, when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through a network communication method, the first master terminal device receives the notification, and switches to simulate a 3D mouse, including:

[0011] Using the relevant image data of the first controlled remote device, the first controlled remote device notifies the first master terminal device through a preset network communication method when switching between 2D and 3D scenes;

[0012] When the first controlled remote device opens a preset 2D scene, the 3D mouse is hidden;

[0013] When the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through network communication and switches to simulate a 3D mouse.

[0014] Furthermore, the step of switching to simulate a 3D mouse includes:

[0015] Operation event information when a finger operates in a 3D mouse area is acquired, and the operation event information is sent to the first controlled remote device, and the first controlled remote device responds to the operation event information.

[0016] Furthermore, the method further comprises:

[0017] When an event of touching the border of the 3D mouse is obtained, the move time is continuously sent to the first controlled remote device.

[0018] Furthermore, the operation event information includes:

[0019] down, move, up events.

[0020] Furthermore, when the relevant user uses the switched simulated 3D mouse to control the first main control terminal device, the rotation angle and the rotation normal vector are calculated according to the relative position, including:

[0021] When the relevant user uses the switched simulated 3D mouse to control the first master control terminal device, the movement offset obtained by moving the first master control terminal device on the 3D mouse is sent to the first controlled remote device;

[0022] The first controlled remote device receives the movement offset, and uses the movement offset as radians to calculate a rotation angle and a rotation normal vector.

[0023] According to a second aspect of an embodiment of the present invention, a system for switching a 3D mouse based on a remote control scene is provided, which is applied to any of the above methods for switching a 3D mouse based on a remote control scene, comprising:

[0024] An acquisition module, used to obtain a first master control terminal device and a first controlled remote device;

[0025] A first processing module, configured for the first master terminal device to send a first connection request, the first controlled remote device to receive the first connection request sent by the first master terminal device, to establish a remote connection, and to obtain relevant image data of the first controlled remote device;

[0026] A second processing module is used for utilizing the relevant image data of the first controlled remote device, and when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through a network communication method, and the first master terminal device receives the notification and switches to simulate a 3D mouse;

[0027] A third processing module is used to calculate the rotation angle and the rotation normal vector according to the relative position when the relevant user uses the switched simulated 3D mouse to control the first main control terminal device;

[0028] The fourth processing module is used for the first controlled remote device to calculate the rotation angle and the rotation normal vector using the relative position to perform corresponding movement, rolling and rotation operations.

[0029] According to a third aspect of an embodiment of the present invention, there is provided a device for switching a 3D mouse based on a remote control scene, comprising:

[0030] a memory having an executable program stored therein;

[0031] A processor is used to execute the executable program in the memory to implement the steps of any one of the above methods.

[0032] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:

[0033] It can be understood that the technical solution provided by the present invention is to obtain a first master terminal device and a first controlled remote device; the first master terminal device sends a first connection request, the first controlled remote device receives the first connection request sent by the first master terminal device, establishes a remote connection, and obtains relevant image data of the first controlled remote device; then, using the relevant image data of the first controlled remote device, when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through network communication, the first master terminal device receives the notification, and switches to simulate a 3D mouse; finally, when the relevant user uses the switched simulated 3D mouse to control the first master terminal device, the rotation angle and the rotation normal vector are calculated according to the relative position; the first controlled remote device uses the relative position to calculate the rotation angle and the rotation normal vector to perform corresponding movement, scrolling, and rotation operations. It can be understood that the technical solution provided by the present invention can use the 3D design software or 3D game to switch the 3D mouse to perform three-dimensional interactive operations in a remote control scenario, and use the 3D mouse to control the position of the cursor on the three-dimensional plane through the X-axis, Y-axis and Z-axis. For users in the three-dimensional design industry or the 3D game industry, they can freely and intuitively rotate the vision and perform three-dimensional stereoscopic operations.

[0034] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0036] Figure 1 is a schematic diagram of steps of a method for switching a 3D mouse based on a remote control scene according to an exemplary embodiment;

[0037] Figure 2 is a schematic diagram showing the composition of a system for switching 3D mouse based on remote control scenes according to an exemplary embodiment;

[0038] Figure 3 The figure is a schematic diagram showing the composition of a device for switching a 3D mouse based on a remote control scenario according to an exemplary embodiment. DETAILED DESCRIPTION

[0039] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0040] Embodiment 1

[0041] See also Figure 1 , Figure 1 The present invention is a schematic diagram showing steps of a method for switching a 3D mouse based on a remote control scene according to an exemplary embodiment, the method comprising:

[0042] S1. Get the first master terminal device and the first controlled remote device;

[0043] S2. The first master terminal device sends a first connection request, and the first controlled remote device receives the first connection request sent by the first master terminal device, establishes a remote connection, and obtains relevant image data of the first controlled remote device;

[0044] S3. Using the relevant image data of the first controlled remote device, when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through network communication, and the first master terminal device receives the notification and switches to simulate a 3D mouse;

[0045] S4. When the relevant user uses the switching simulated 3D mouse to control the first master terminal device, the rotation angle and the rotation normal vector are calculated according to the relative position;

[0046] S5. The first controlled remote device uses the relative position to calculate the rotation angle and the rotation normal vector to perform corresponding movement, rolling, and rotation operations.

[0047] In the specific implementation, as described in steps S1-S2, it includes: obtaining a first master terminal device and a first controlled remote device; wherein the first master terminal device is used to use a preset 3D mouse to control the three-dimensional design and 3D game software in a preset 3D scene on the first controlled remote device to interact.

[0048] In specific implementation, as described in step S3, using the relevant image data of the first controlled remote device, the first controlled remote device will notify the first master terminal device through a preset network communication method when switching between 2D and 3D scenes;

[0049] When the first controlled remote device opens a preset 2D scene, the 3D mouse is hidden;

[0050] When the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through network communication and switches to simulate a 3D mouse.

[0051] Furthermore, the step of switching to simulate a 3D mouse includes:

[0052] Operation event information when a finger operates in a 3D mouse area is acquired, and the operation event information is sent to the first controlled remote device, and the first controlled remote device responds to the operation event information.

[0053] Furthermore, the method further comprises:

[0054] When an event of touching the border of the 3D mouse is obtained, the move time is continuously sent to the first controlled remote device.

[0055] Furthermore, the operation event information includes:

[0056] down, move, up events.

[0057] In specific implementation, when the remote device opens the 3D design or 3D game software, the remote system notifies the terminal device through network communication, and when receiving the notification, the terminal device mouse switches to simulate a 3D mouse, including:

[0058] The controlled device (the first controlled remote device) will notify the master device when switching between 2D and 3D scenes;

[0059] In 2D mode, the 3D mouse of the master control (first master control terminal device) is hidden.

[0060] In 3D mode, the master 3D mouse is displayed. When the finger operates in the 3D mouse area, the down, move, and up events are sent to the slave, and the slave responds to the corresponding events. The coordinates of the finger in the circular area are converted into relative coordinates and sent to the slave. The display on the slave, such as the direction of the person, will change with the direction of the finger movement.

[0061] When the 3D mouse boundary is touched, move events are continuously sent, and in controlled performance, the human perspective will continue to move.

[0062] Specifically, as described in step S4, when the relevant user uses the switched simulated 3D mouse to control the first main control terminal device, the rotation angle and the rotation normal vector are calculated according to the relative position, including:

[0063] When the relevant user uses the switched simulated 3D mouse to control the first master control terminal device, the movement offset obtained by moving the first master control terminal device on the 3D mouse is sent to the first controlled remote device;

[0064] The first controlled remote device receives the movement offset, and uses the movement offset as radians to calculate a rotation angle and a rotation normal vector.

[0065] In one embodiment, as described in step S5, the first controlled remote device uses the relative position to calculate the rotation angle and the rotation normal vector to perform corresponding movement, scrolling, and rotation operations, including: for example, when the main control moves upward by a distance of m, the controlled screen moves upward by an angle of m*(180 / π); when the main control moves left by n, the controlled screen moves left by an angle of n*(180 / π). Other directions are analogous.

[0066] In specific implementation, the technical solution provided by the present invention is to obtain a first master terminal device and a first controlled remote device; the first master terminal device sends a first connection request, the first controlled remote device receives the first connection request sent by the first master terminal device, establishes a remote connection, and obtains relevant image data of the first controlled remote device; then, using the relevant image data of the first controlled remote device, when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through a network communication method, the first master terminal device receives the notification, and switches to simulate a 3D mouse; finally, when the relevant user uses the switched simulated 3D mouse to control the first master terminal device, the rotation angle and the rotation normal vector are calculated according to the relative position; the first controlled remote device uses the relative position to calculate the rotation angle and the rotation normal vector to perform corresponding movement, scrolling, and rotation operations. It can be understood that the technical solution provided by the present invention can use the 3D design software or 3D game to switch the 3D mouse to perform three-dimensional interactive operations in a remote control scenario, and use the 3D mouse to control the position of the cursor on the three-dimensional plane through the X-axis, Y-axis and Z-axis. For users in the three-dimensional design industry or the 3D game industry, they can freely and intuitively rotate the vision and perform three-dimensional stereoscopic operations.

[0067] See also Figure 2 , Figure 2 The present invention is a schematic diagram showing a system composition of a 3D mouse based on remote control scene switching according to an exemplary embodiment, wherein the system comprises:

[0068] An acquisition module 20 is used to obtain a first master control terminal device and a first controlled remote device;

[0069] The first processing module 21 is configured for the first master terminal device to send a first connection request, the first controlled remote device to receive the first connection request sent by the first master terminal device, to establish a remote connection, and to obtain relevant image data of the first controlled remote device;

[0070] The second processing module 22 is used to use the relevant image data of the first controlled remote device, and when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through a network communication method, and the first master terminal device receives the notification and switches to simulate a 3D mouse;

[0071] The third processing module 23 is used to calculate the rotation angle and the rotation normal vector according to the relative position when the relevant user uses the switched simulated 3D mouse to control the first main control terminal device;

[0072] The fourth processing module 24 is used for the first controlled remote device to calculate the rotation angle and the rotation normal vector using the relative position to perform corresponding movement, rolling and rotation operations.

[0073] See also Figure 3 , Figure 3 The present invention is a schematic diagram showing a device composition of a 3D mouse based on remote control scene switching according to an exemplary embodiment, wherein the device comprises:

[0074] A memory 31 on which an executable program is stored;

[0075] The processor 32 is used to execute the executable program in the memory 31 to implement the steps of any one of the above methods.

[0076] It can be understood that the same or similar parts of the above embodiments can be referenced to each other, and the contents not described in detail in some embodiments can refer to the same or similar contents in other embodiments.

[0077] It should be noted that, in the description of the present invention, the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, the meaning of "plurality" refers to at least two.

[0078] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present invention belong.

[0079] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0080] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0081] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0082] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

[0083] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0084] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A method for switching a 3D mouse based on a remote control scene, characterized in that: The method comprises: Obtain a first master terminal device and a first controlled remote device; The first master terminal device sends a first connection request, and the first controlled remote device receives the first connection request sent by the first master terminal device, establishes a remote connection, and obtains relevant image data of the first controlled remote device; Using the relevant image data of the first controlled remote device, when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through a network communication method, and the first master terminal device receives the notification and switches to simulate a 3D mouse; When the relevant user uses the switched simulated 3D mouse to control the first main control terminal device, the rotation angle and the rotation normal vector are calculated according to the relative position; The first controlled remote device uses the relative position to calculate the rotation angle and the rotation normal vector to perform corresponding movement, rolling, and rotation operations.

2. The method according to claim 1, characterized in that The method of using the relevant image data of the first controlled remote device, when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through a network communication method, and the first master terminal device receives the notification and switches to simulate a 3D mouse, including: Using the relevant image data of the first controlled remote device, the first controlled remote device notifies the first master terminal device through a preset network communication method when switching between 2D and 3D scenes; When the first controlled remote device opens a preset 2D scene, the 3D mouse is hidden; When the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through network communication and switches to simulate a 3D mouse.

3. The method according to claim 2, characterized in that The steps of switching to simulate a 3D mouse include: Operation event information when a finger operates in a 3D mouse area is acquired, and the operation event information is sent to the first controlled remote device, and the first controlled remote device responds to the operation event information.

4. The method according to claim 3, characterized in that The method further comprises: When an event of touching the border of the 3D mouse is obtained, the move time is continuously sent to the first controlled remote device.

5. The method according to claim 3, characterized in that: The operation event information includes: down, move, up events.

6. The method according to claim 1, characterized in that When the relevant user uses the switched simulated 3D mouse to control the first main control terminal device, the rotation angle and the rotation normal vector are calculated according to the relative position, including: When the relevant user uses the switched simulated 3D mouse to control the first master control terminal device, the movement offset obtained by moving the first master control terminal device on the 3D mouse is sent to the first controlled remote device; The first controlled remote device receives the movement offset, and uses the movement offset as radians to calculate a rotation angle and a rotation normal vector.

7. A system for switching 3D mouse based on remote control scenes, characterized in that: The method for switching a 3D mouse based on a remote control scene as described in any one of claims 1 to 6 above, the method comprising: An acquisition module, used to obtain a first master control terminal device and a first controlled remote device; A first processing module, configured for the first master terminal device to send a first connection request, the first controlled remote device to receive the first connection request sent by the first master terminal device, to establish a remote connection, and to obtain relevant image data of the first controlled remote device; A second processing module is used for utilizing the relevant image data of the first controlled remote device, and when the first controlled remote device opens a preset 3D scene, the first controlled remote device notifies the first master terminal device through a network communication method, and the first master terminal device receives the notification and switches to simulate a 3D mouse; A third processing module is used to calculate the rotation angle and the rotation normal vector according to the relative position when the relevant user uses the switched simulated 3D mouse to control the first main control terminal device; The fourth processing module is used for the first controlled remote device to calculate the rotation angle and the rotation normal vector using the relative position to perform corresponding movement, rolling and rotation operations.

8. A device for switching 3D mouse based on remote control scene, characterized in that: include: A memory having an executable program stored therein; A processor, configured to execute the executable program in the memory to implement the steps of the method according to any one of claims 1 to 6.

Images