Key interaction method and system of remote control equipment in virtual scene and storage medium

Abstract

The invention discloses a key interaction method and system of remote control equipment in a virtual scene and a storage medium, and belongs to the technical field of virtuality and reality, and the method comprises the following steps: generating a mapping table corresponding to remote control end keys; receiving a touch message of the key sent by the remote control end; detecting the number of key IDs in the touch message: if the number of the key IDs is a single key ID, entering a single key mode, generating a single key icon corresponding to the key ID, and displaying the single key icon on a virtual scene interface; if the key IDs are multiple key IDs, entering a multi-key mode, setting an execution sequence for the multiple key IDs, generating key icons corresponding to the multiple key IDs one by one, and displaying the key icons on the virtual scene interface; receiving a key instruction message sent by the remote control end, and if the mode is a single-key mode, executing a key function corresponding to the key ID; and if the mode is the multi-key mode, selecting the key ID which is executed at the first position in the execution sequence to execute the key function. According to the invention, the user can use the method conveniently by displaying the key icons.

Description

Technical Field

[0001] The present invention relates to the field of virtual and reality technology, and in particular to a key interaction method, system and storage medium of a remote control device in a virtual scene. Background Art

[0002] Virtual reality technology (English name: Virtual Reality, abbreviated as VR) encompasses computers, electronic information, and simulation technologies. Its basic implementation method is based on computer technology, utilizing and integrating the latest developments in three-dimensional graphics technology, multimedia technology, simulation technology, display technology, servo technology, and other high-tech technologies. With the help of computers and other equipment, it creates a realistic three-dimensional virtual world with multiple sensory experiences such as vision, touch, and smell, thereby giving people in the virtual world an immersive feeling.

[0003] When interacting in virtual scenes, peripherals are usually used to assist in the interaction. Taking remote control devices as an example, the buttons on the remote control devices can correspond to opening corresponding functions in the virtual scene. For example, some function display and closing, content switching and other operations can be quickly operated through the remote control device. However, in actual use, in order to ensure that the user can accurately press the target button, it is necessary to frequently observe the position of the button. Especially in a dim demonstration environment, the button display of the remote control device needs to be more eye-catching in order to find the target button. This method of use has high requirements on the user. Traditional solutions to this problem mostly use backlit buttons to facilitate users to clearly view the target buttons, or add additional function auxiliary buttons such as language control. These solutions not only increase the use cost of the remote control device, but also cannot fundamentally solve the problem of the inconvenience of blind operation of the remote control device. Summary of the invention

[0004] The purpose of the present invention is to solve the problem that it is inconvenient to accurately click the buttons in the blind operation when using a remote control device to interact with a virtual scene, and to propose a button interaction method, system and storage medium for a remote control device in a virtual scene. The method has the advantages of using an icon display method to facilitate intuitive understanding of the currently touched buttons, facilitate blind operation of the remote control device, and accurately click the target button.

[0005] In a first aspect, the present invention achieves the above-mentioned purpose through the following technical solutions: a key interaction method of a remote control device in a virtual scene, applied to a scene end, the method comprising the following steps: Generate a mapping table corresponding to the remote control terminal buttons, the mapping table including function mapping corresponding to the button ID and layout mapping of the buttons on the remote control terminal; Receiving a touch message of the key sent by the remote control end, wherein the touch message is a key ID recorded when the user touches the current key; Detect the number of button IDs in the touch message: If it is a single button ID, it enters the single button mode and generates a single button icon corresponding to the button ID and displays it on the virtual scene interface; If there are multiple button IDs, enter the multi-button mode, set the execution order for the multiple button IDs, generate button icons corresponding to the multiple button IDs and display them on the virtual scene interface; Receive the command message of the button sent by the remote control end, and detect the current mode state: If it is single button mode, the button function corresponding to the button ID is executed; If it is a multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed.

[0006] Preferably, the method for setting the execution order for multiple key IDs is: While receiving the button ID, obtain the data of the touch surface range of each button touched by the user; Sorting multiple button IDs according to the order of touch surface range from large to small; Select the first button ID as the first button ID to be executed.

[0007] Preferably, the method for generating a plurality of button icons corresponding to the button IDs and displaying them on the virtual scene interface is: Select the icon display position on the virtual scene interface; Generate a key icon corresponding to the first executed key ID, set it as the first key icon, and display the first key icon at the icon display position; Get other key IDs in the touch message and generate corresponding other key icons; Finding corresponding positional relationships between other button icons and the first button icon according to the layout mapping in the mapping table; The other button icons are displayed around the first button icon according to the positional relationship.

[0008] Preferably, the method further comprises synchronizing the cursor position of the mouse on the virtual scene interface to the icon display position, and replacing the cursor shape of the mouse with a button icon.

[0009] Preferably, the method further comprises setting a switching instruction for the execution sequence, wherein the switching instruction is used to replace each key ID in the touch message with the key ID to be executed first in the execution sequence in sequence after receiving the switching message sent by the remote control end.

[0010] In a second aspect, the present invention achieves the above-mentioned purpose through the following technical solutions: a key interaction method of a remote control device in a virtual scene, applied to a remote control end, the method comprising the following steps: Establishing a mapping connection with the scene end, the mapping connection is used by the scene end to generate a mapping table corresponding to the remote control end buttons, the mapping table including function mapping corresponding to the button ID and layout mapping of the buttons on the remote control end; After detecting that the user touches a key, a touch message is sent to the scene end, and the touch message is used by the scene end to obtain the key ID in the touch message and perform a display operation according to the number of the key IDs, and the display operation includes: If it is a single button ID, it enters the single button mode and generates a single button icon corresponding to the button ID and displays it on the virtual scene interface; If there are multiple button IDs, enter the multi-button mode, set the execution order for the multiple button IDs, generate button icons corresponding to the multiple button IDs and display them on the virtual scene interface; After detecting that the user presses a button, a command message is sent to the scene end, and the command message is used for the scene end to execute the button function. The method for the scene end to execute the button function is: Detect the current mode status: If it is single button mode, the button function corresponding to the button ID is executed; If it is a multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed.

[0011] Preferably, the method also includes setting a switch button, detecting that a user presses the switch button and sending a switch message to the scene end, wherein the switch message is used by the scene end to execute the switch instruction, and the scene end sequentially replaces each key ID in the touch message with the key ID executed first in the execution order.

[0012] In a third aspect, the present invention achieves the above-mentioned purpose through the following technical solutions: a key interaction system for a remote control device in a virtual scene, the system comprising: A remote control terminal, the remote control terminal comprising: A communication connection module is used to establish a mapping connection with the scene end; A button touch detection module, used to send a touch message to the scene end after detecting that a user touches a button; A key command detection module, used to send a command message to the scene end after detecting that a user presses a key; It also includes a scene end, which includes: A mapping unit, configured to generate a mapping table corresponding to the buttons of the remote control terminal after establishing a mapping connection with the remote control terminal, wherein the mapping table includes a function mapping corresponding to the button ID and a layout mapping of the button on the remote control terminal; The icon display unit is used to detect the number of button IDs in the touch message after receiving the touch message sent by the remote control end: If it is a single button ID, it enters the single button mode and generates a single button icon corresponding to the button ID and displays it on the virtual scene interface; If there are multiple button IDs, enter the multi-button mode, set the execution order for the multiple button IDs, generate button icons corresponding to the multiple button IDs and display them on the virtual scene interface; The key function execution unit is used to detect the current mode state after receiving the command message sent by the remote control end: If it is single button mode, the button function corresponding to the button ID is executed; If it is a multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed.

[0013] Preferably, the remote control terminal further comprises a switch button, which is used to detect that a user presses the switch button and sends a switch message to the scene terminal; The scene end also includes a switching unit, which is used to execute the switching instruction and replace each key ID in the touch message with the key ID that is executed first in the execution order.

[0014] In a fourth aspect, the present invention achieves the above-mentioned purpose through the following technical scheme: a storage medium having a computer program stored thereon, which, when the computer program is executed by a processor, implements the key interaction method of a remote control device in a virtual scene as described in the first aspect or the second aspect.

[0015] Compared with the prior art, the present invention has the following beneficial effects: By mapping the button layout of the remote control end to the virtual field end, adding touch detection before pressing the button operation to the remote control end, obtaining the current button touched by the user, and displaying the button icon on the virtual scene interface, the user can know the button currently touched by the finger without lowering his head to check the remote control end. It is suitable for users to use blindly and also improves the user's usage efficiency and accuracy. The present invention also enters a multiple button mode on the scene end when the user touches multiple buttons. In the multi-button mode, the buttons and button functions of the remote control end are no longer one-to-one corresponding. The user only needs to determine the button function to be executed according to the first button icon displayed in the scene. Even if any button on the remote control end is pressed, only the button function corresponding to the first button icon executed can be implemented, which effectively solves the problem of accidentally touching multiple buttons. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 The present invention is a flow chart of the key interaction method of the remote control device in the virtual scene.

[0017] Figure 2 The mapping representation scheme generated for the scene end of the present invention.

[0018] Figure 3 It is a schematic diagram of displaying button icons when a user touches multiple buttons with his / her fingers according to the present invention.

[0019] Figure 4 It is a schematic diagram of a key interaction system of a remote control device in a virtual scene of the present invention. DETAILED DESCRIPTION

[0020] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0021] Example 1 like Figure 1 As shown, a key interaction method of a remote control device in a virtual scene is used for key interaction between a scene end and a remote control end, and the method includes the following steps: A mapping connection is established between the remote control end and the scene end, so that the scene end can generate a mapping table corresponding to the remote control end buttons according to the mapping connection. The mapping table includes the function mapping corresponding to the button ID and the layout mapping of the button on the remote control end. In the mapping table, one button ID corresponds to one button function, so that when the user presses the button on the remote control end, the virtual scene can display the corresponding function, and the layout mapping in the mapping table is also beneficial for the scene end to obtain the positional relationship between the buttons, especially in the subsequent display of button icons. It can provide the user with an intuitive button position distribution view, which is convenient for deepening the user's understanding of the button layout.

[0022] The remote control end has the touch detection function of the button. After detecting that the user touches the button, it sends a touch message to the scene end. The scene end determines the number of touched buttons based on the touch message. If a single button is touched, it enters the single button mode, generates a single button icon corresponding to the button ID and displays it on the virtual scene interface. In this step, it can be known that a single button is touched. The scene end only needs to display the button icon corresponding to the single button to let the user know which button is currently touched. However, in actual use, users often touch by mistake. For example, a finger touches multiple buttons at one time, then it is necessary to judge multiple buttons. As described below, if multiple buttons are touched, it enters the multi-button mode, sets the execution order for multiple button IDs, generates button icons corresponding to multiple button IDs and displays them on the virtual scene interface. When multiple buttons are touched, the same principle is used as that of displaying a single button icon, except that there are more button icons in the display. The button icons corresponding to all the touched buttons will be displayed on the virtual scene interface. Since the scene end cannot execute multiple button functions at the same time, even if multiple button icons are displayed, they can only be used in sequence in the execution of the corresponding functions. Therefore, it is also necessary to set an execution order for the button ID, which is the order in which the button functions are used. This step only reduces the display of button icons, and the use of button functions is described in detail in the following steps.

[0023] The remote control end has the function of detecting whether a button is pressed. After detecting that the user has pressed a button, it will send a command message to the scene end. The command message is used to execute the function of the button. Similarly, the scene end also needs to consider how to execute the functions in single-button mode and multi-button mode. Specifically: in single-button mode, execute the button function corresponding to the button ID. This is consistent with the use of traditional remote control ends to control functions in virtual scenes. The scene end can execute the corresponding function according to the mapping table.

[0024] In the multi-key mode, since the key functions cannot be executed at the same time, each time a key is pressed, only one key function can be used. Therefore, in the multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed. The previous step mentioned that the key IDs need to be sorted in the execution order in the multi-key mode. In this step, the instruction message is only used to execute the key function corresponding to the key ID that is executed first. Therefore, no matter whether the key pressed by the user on the remote control end corresponds to the key ID that is executed first, it will not affect the scene end to execute the key function that is executed first. This effectively solves the problem that the scene end cannot judge the user's intention when the user touches multiple keys during blind operation. In addition, using this method, since the user can see the displayed key icon, even if the corresponding key is not pressed, it will not affect the use of the corresponding function, and the difficulty of operation is greatly reduced.

[0025] The entire solution is used for interaction between the scene end and the remote control end. Now the two interaction ends are described separately. When applied to the scene end, the method includes the following steps: Generate a mapping table corresponding to the remote control terminal buttons, the mapping table includes the function mapping corresponding to the button ID and the layout mapping of the button on the remote control terminal, the mapping table is as follows Figure 2 As shown, a virtual remote control terminal is generated in the background of the scene terminal. Each of the buttons A1, A2, A3, A4, A5, and A6 on the remote control terminal has its corresponding button ID: XXXXXXX0X, and the button IDs correspond to the event X of the virtual scene. Then, when any button on the remote control terminal is pressed, the scene terminal triggers the corresponding event by obtaining the corresponding button ID, so that the corresponding function can be executed in the virtual scene. By using the above mapping table, it can be ensured that the buttons on the remote control terminal correspond to the functions executed by the scene terminal.

[0026] Receive a touch message of the button sent by the remote control end, wherein the touch message is the button ID recorded when the user touches the current button. The touch message is not the user pressing the button of the remote control end. Therefore, after the scene end receives the touch message, it does not need to execute the function of the button immediately, but first obtains the ID of the button. Two data can be obtained through the button ID, one is the button pressed by the user, and the other is the function corresponding to the button. Different from the traditional remote control device interactive virtual scene, in this method, when the user touches the button of the remote control end, the scene end has already obtained the required data, and these data are used to facilitate the following steps.

[0027] Detect the number of button IDs in the touch message: If it is a single button ID, it enters the single button mode and generates a single button icon corresponding to the button ID and displays it on the virtual scene interface; If there are multiple button IDs, enter the multi-button mode, set the execution order for the multiple button IDs, generate button icons corresponding to the multiple button IDs and display them on the virtual scene interface. According to the button layout on the virtual remote control end in the mapping table, the scene end can generate button icons. The button icons are consistent with the icon style of the physical buttons on the remote control end. The button icons can be pre-entered on the scene end to prevent the button icon file from being found when the mapping table is made. In the single button mode, only one button icon needs to be displayed. In the multiple button mode, multiple button icons need to be displayed. Displaying the button icon is only used as a feedback effect for the user, so that the user knows which button is currently touched when operating the remote control end. The user can also know the corresponding function of the button based on the style of the button icon. This feedback effect of button icon display is more convenient for users than the traditional non-feedback method.

[0028] As mentioned above, when a user touches a button, it does not mean that the function corresponding to the button needs to be executed by the scene end. The scene end will execute the function only after receiving the command message of the button sent by the remote control end. Before executing the function, it is also necessary to detect the current mode state: If it is single button mode, the button function corresponding to the button ID is executed. In this mode, the scene end can trigger the corresponding event according to the button ID to complete the use of the function.

[0029] If it is a multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed. After the key IDs are sorted, the event corresponding to the key ID that is ranked first in the execution order is triggered, and other key IDs are judged as invalid key IDs and will not trigger events on the scene side. This is also the advantage of using trigger events to execute key functions, which is that the function execution is controllable. When multiple keys are touched, although the user presses a key, he cannot be sure whether the key he presses is the function he wants to use if he does not look down at the key. Therefore, the scene side does not need to trigger the event according to the virtual remote control end key in the mapping table, but selects the key ID to trigger the event. Because the sorted key ID only has the first key ID, it will only trigger the event corresponding to the first key ID. In this way, even if the key pressed by the user is not the corresponding first key ID, it will not affect the final function usage.

[0030] In the above method, the first button ID in the execution order determines whether the event that should be triggered by the scene end is the function that the user wants to use in the multi-button mode. Therefore, the setting of the execution order should be reasonable and reliable. The method for setting the execution order for multiple button IDs is: While receiving the button ID, the data of the touch surface range of each button touched by the user is obtained. The remote control end needs to have a button touch detection function. There are various ways to detect button touch in the prior art. For example, a capacitive button can be used to determine the size of the contact surface between the user's finger and the button by receiving the size of the voltage, or a button with a light sensor can be used to determine the touch surface range by determining the area of ​​light blocked. Since the touch detection schemes are diverse and not based on a one-to-one distance, the touch surface range can be used as a criterion for determining whether the user wants to press the button. Under normal circumstances, the larger the button touched by the user's finger, the more likely it is that the button is the target button.

[0031] Sort multiple button IDs according to the touch surface range from large to small. Using the touch surface range as the execution order can be more accurate and convenient. Select the first button ID as the first button ID to be executed.

[0032] The execution order is not the only basis for triggering events on the scene side. When displaying button icons, the execution order can also be used as a reference for the display position. The method for generating button icons corresponding to multiple button IDs and displaying them on the virtual scene interface is as follows: Select the icon display position on the virtual scene interface; set a position for displaying the button icon on the virtual scene interface in advance, and ensure that it will not affect other contents on the scene interface when setting the position; Generate a key icon corresponding to the first executed key ID, set it as the first key icon, and display the first key icon at the icon display position; Get other key IDs in the touch message and generate corresponding other key icons; Finding corresponding positional relationships between other button icons and the first button icon according to the layout mapping in the mapping table; The other button icons are displayed around the first button icon according to the positional relationship.

[0033] like Figure 3 As shown, the circular frame is a pre-set button icon display area. The finger touches the A4 button in a large area and partially touches the A6 button. According to the above execution order sorting method, the A4 button is the first button to be executed, so the A4 button is displayed in the display area, and the A6 button is displayed directly below the A4 button according to the layout in the mapping table. According to the display content, the user can intuitively see what button function will be executed after pressing the button, and for the display of the accidentally touched button, it can also increase the effect of the user remembering the distribution of other button positions.

[0034] In order to avoid the button icon display area from blocking other contents of the scene interface, the display area cannot be set larger. However, in order to facilitate users to quickly see the contents of the display area, the method also includes synchronizing the mouse cursor position on the virtual scene interface to the icon display position, and replacing the mouse cursor shape with a button icon. Replacing the mouse cursor with a button icon makes it more eye-catching, and also allows the displayed button icon to move with the user when moving the cursor, and always be in the focus of the user's field of vision.

[0035] The above-mentioned execution order is only for normal touch button situations. When encountering extreme situations, since it cannot be guaranteed that the button touched in a large range each time is the button you want to use, the method also includes setting a switching instruction for the execution order. The switching instruction is used to replace each button ID in the touch message with the first button ID executed in the execution order in turn after receiving the switching message sent by the remote control end. By setting the switching instruction, the execution order can be manually intervened. Automatic switching can be selected during switching. For example, after receiving the switching message, the button icon at the icon display position can be cyclically switched to the currently touched buttons, or manually switched. Each time a switching message is received, the button icon at the icon display position changes once. Regardless of which method is used, the purpose is to allow all touched buttons to have the opportunity to be the first button ID executed, which also reduces the user's operation difficulty. In extreme situations, the button function you want to execute can be replaced by switching.

[0036] The above method is applied to the scene end, and when applied to the remote control end, the method includes the following steps: Establishing a mapping connection with the scene end, the mapping connection is used by the scene end to generate a mapping table corresponding to the remote control end buttons, the mapping table including function mapping corresponding to the button ID and layout mapping of the buttons on the remote control end; After detecting that the user touches a key, a touch message is sent to the scene end, and the touch message is used by the scene end to obtain the key ID in the touch message and perform a display operation according to the number of the key IDs, and the display operation includes: If it is a single button ID, it enters the single button mode and generates a single button icon corresponding to the button ID and displays it on the virtual scene interface; If there are multiple button IDs, enter the multi-button mode, set the execution order for the multiple button IDs, generate button icons corresponding to the multiple button IDs and display them on the virtual scene interface; After detecting that the user presses a button, a command message is sent to the scene end, and the command message is used for the scene end to execute the button function. The method for the scene end to execute the button function is: Detect the current mode status: If it is single button mode, the button function corresponding to the button ID is executed; If it is a multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed.

[0037] The remote control terminal is a signal output device that is in direct contact with the user. By obtaining different operations of the user on the buttons, different messages are sent to the scene terminal. The buttons on the remote control terminal can be set as capacitive buttons to facilitate touch detection. The relationship between the area of ​​contact between the finger and the button and the voltage intensity can be used to provide the scene terminal with data for sorting the execution order of each button ID. The larger the finger contact area, the greater the voltage. After feedback to the scene terminal, the scene terminal can obtain the sorting of the range of contact between the finger and the button. The method also includes setting a switch button, detecting that the user presses the switch button to send a switch message to the scene terminal, and the switch message is used for the scene terminal to execute the switch instruction. The scene terminal sequentially replaces each button ID in the touch message with the button ID that is executed first in the execution order. Setting the switch button on the remote control terminal is also convenient for the user's operation.

[0038] Regardless of whether it is applied on the scene end or the remote control end, the purpose achieved is the same, so the details of the method when applied on the remote control end are not repeated.

[0039] Example 2 like Figure 4 As shown, a key interaction system for a remote control device in a virtual scene, the system comprising: A remote control terminal, the remote control terminal comprising: A communication connection module is used to establish a mapping connection with the scene end; A button touch detection module, used to send a touch message to the scene end after detecting that a user touches a button; A key command detection module, used to send a command message to the scene end after detecting that a user presses a key; It also includes a scene end, which includes: A mapping unit, configured to generate a mapping table corresponding to the buttons of the remote control terminal after establishing a mapping connection with the remote control terminal, wherein the mapping table includes a function mapping corresponding to the button ID and a layout mapping of the button on the remote control terminal; The icon display unit is used to detect the number of button IDs in the touch message after receiving the touch message sent by the remote control end: If it is a single button ID, it enters the single button mode and generates a single button icon corresponding to the button ID and displays it on the virtual scene interface; If there are multiple button IDs, enter the multi-button mode, set the execution order for the multiple button IDs, generate button icons corresponding to the multiple button IDs and display them on the virtual scene interface; The key function execution unit is used to detect the current mode state after receiving the command message sent by the remote control end: If it is single button mode, the button function corresponding to the button ID is executed; If it is a multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed.

[0040] The remote control terminal also includes a switch button, which is used to detect that a user presses the switch button to send a switch message to the scene terminal; The scene end also includes a switching unit, which is used to execute the switching instruction and replace each key ID in the touch message with the key ID that is executed first in the execution order.

[0041] The method for setting the execution order of multiple key IDs is: While receiving the button ID, obtain the data of the touch surface range of each button touched by the user; Sorting multiple button IDs according to the order of touch surface range from large to small; Select the first button ID as the first button ID to be executed.

[0042] The method for generating a plurality of button icons corresponding to the button IDs and displaying them on the virtual scene interface is as follows: Select the icon display position on the virtual scene interface; Generate a key icon corresponding to the first executed key ID, set it as the first key icon, and display the first key icon at the icon display position; Get other key IDs in the touch message and generate corresponding other key icons; Finding corresponding positional relationships between other button icons and the first button icon according to the layout mapping in the mapping table; The other button icons are displayed around the first button icon according to the positional relationship.

[0043] The system also includes the scene end synchronizing the cursor position of the mouse on the virtual scene interface to the icon display position, and replacing the cursor shape of the mouse with a button icon Embodiment 2 is essentially the same as Embodiment 1, so the specific working principles of each unit will not be described in detail.

[0044] Example 3 This embodiment proposes a storage medium, which includes a program storage area and a data storage area, wherein the program storage area can store an operating system and programs required for running an instant messaging function, etc.; the data storage area can store various instant messaging information and operation instruction sets, etc. The computer program is stored in the program storage area, and when the computer program is executed by the processor, the key interaction method of the remote control device in the virtual scene as described in Example 1 is implemented. The processor may include one or more central processing units, or a digital processing unit, etc.

[0045] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above and that the present invention can be implemented in other specific forms without departing from the spirit or essential features of the present invention. Therefore, the embodiments should be considered exemplary and non-restrictive in all respects, and the scope of the present invention is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims be included in the present invention.

[0046] In addition, it should be understood that although the present specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

Claims

1. A key interaction method for a remote control device in a virtual scene, applied to a scene end, characterized in that: The method comprises the following steps: Generate a mapping table corresponding to the remote control terminal buttons, the mapping table including function mapping corresponding to the button ID and layout mapping of the buttons on the remote control terminal; Receiving a touch message of the key sent by the remote control end, wherein the touch message is a key ID recorded when the user touches the current key; Detect the number of button IDs in the touch message: If it is a single button ID, it enters the single button mode and generates a single button icon corresponding to the button ID and displays it on the virtual scene interface; If there are multiple button IDs, enter the multi-button mode, set the execution order for the multiple button IDs, generate button icons corresponding to the multiple button IDs and display them on the virtual scene interface; Receive the command message of the button sent by the remote control end, and detect the current mode state: If it is single button mode, the button function corresponding to the button ID is executed; If it is a multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed.

2. The key interaction method of a remote control device in a virtual scene according to claim 1, characterized in that: The method for setting the execution order of multiple key IDs is: While receiving the button ID, obtain the data of the touch surface range of each button touched by the user; Sorting multiple button IDs according to the order of touch surface range from large to small; Select the first button ID as the first button ID to be executed.

3. The key interaction method of a remote control device in a virtual scene according to claim 2, characterized in that: The method for generating a plurality of button icons corresponding to the button IDs and displaying them on the virtual scene interface is as follows: Select the icon display position on the virtual scene interface; Generate a key icon corresponding to the first executed key ID, set it as the first key icon, and display the first key icon at the icon display position; Get other key IDs in the touch message and generate corresponding other key icons; Finding corresponding positional relationships between other button icons and the first button icon according to the layout mapping in the mapping table; The other button icons are displayed around the first button icon according to the positional relationship.

4. The key interaction method of a remote control device in a virtual scene according to claim 3, characterized in that: The method also includes synchronizing the cursor position of the mouse on the virtual scene interface to the icon display position, and replacing the cursor shape of the mouse with a button icon.

5. The key interaction method of a remote control device in a virtual scene according to claim 1, characterized in that: The method also includes setting a switching instruction for the execution sequence, wherein the switching instruction is used to replace each key ID in the touch message with the key ID executed first in the execution sequence in sequence after receiving the switching message sent by the remote control end.

6. A key interaction method for a remote control device in a virtual scene, applied to a remote control terminal, characterized in that: The method comprises the following steps: Establishing a mapping connection with the scene end, the mapping connection is used by the scene end to generate a mapping table corresponding to the remote control end buttons, the mapping table including function mapping corresponding to the button ID and layout mapping of the buttons on the remote control end; After detecting that the user touches a key, a touch message is sent to the scene end, and the touch message is used by the scene end to obtain the key ID in the touch message and perform a display operation according to the number of the key IDs, and the display operation includes: If it is a single button ID, it enters the single button mode and generates a single button icon corresponding to the button ID and displays it on the virtual scene interface; If there are multiple button IDs, enter the multi-button mode, set the execution order for the multiple button IDs, generate button icons corresponding to the multiple button IDs and display them on the virtual scene interface; After detecting that the user presses a button, a command message is sent to the scene end, and the command message is used for the scene end to execute the button function. The method for the scene end to execute the button function is: Detect the current mode status: If it is single button mode, the button function corresponding to the button ID is executed; If it is a multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed.

7. The key interaction method of a remote control device in a virtual scene according to claim 6, characterized in that: The method also includes setting a switch button, detecting that a user presses the switch button and sending a switch message to the scene end, wherein the switch message is used by the scene end to execute the switch instruction, and the scene end sequentially replaces each key ID in the touch message with the key ID that is executed first in the execution order.

8. A key interaction system for a remote control device in a virtual scene, characterized in that: The system includes: A remote control terminal, the remote control terminal comprising: A communication connection module is used to establish a mapping connection with the scene end; A button touch detection module, used to send a touch message to the scene end after detecting that a user touches a button; A key command detection module, used to send a command message to the scene end after detecting that a user presses a key; It also includes a scene end, which includes: A mapping unit, configured to generate a mapping table corresponding to the buttons of the remote control terminal after establishing a mapping connection with the remote control terminal, wherein the mapping table includes a function mapping corresponding to the button ID and a layout mapping of the button on the remote control terminal; The icon display unit is used to detect the number of button IDs in the touch message after receiving the touch message sent by the remote control end: If it is a single button ID, it enters the single button mode and generates a single button icon corresponding to the button ID and displays it on the virtual scene interface; If there are multiple button IDs, enter the multi-button mode, set the execution order for the multiple button IDs, generate button icons corresponding to the multiple button IDs and display them on the virtual scene interface; The key function execution unit is used to detect the current mode state after receiving the command message sent by the remote control end: If it is single button mode, the button function corresponding to the button ID is executed; If it is a multi-key mode, the key ID that is executed first in the execution order is selected, and the key function corresponding to the key ID is executed.

9. The key interaction system of a remote control device in a virtual scene according to claim 8, characterized in that: The remote control terminal also includes a switch button, which is used to detect that a user presses the switch button to send a switch message to the scene terminal; The scene end also includes a switching unit, which is used to execute the switching instruction and replace each key ID in the touch message with the key ID that is executed first in the execution order.

10. A storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, the key interaction method of a remote control device in a virtual scene as described in any one of claims 1-5 or 6-7 is implemented.

Images