Control method and device, electronic equipment and medium

Abstract

The invention discloses a control method and device, electronic equipment and a medium, the control method and device are applied to a 3D controller, the 3D controller and display equipment carry out interaction control, the control method comprises the steps that a Bluetooth man-machine interface equipment standard protocol is adopted to be connected with the display equipment, and the Bluetooth man-machine interface equipment standard protocol comprises an air mouse mode; entering the air mouse mode, starting a target 3D application program, and obtaining a private protocol feature field in a human-machine interface equipment standard protocol of the Bluetooth, the private protocol feature field comprising attitude associated information of a 3D controller; and using a control model corresponding to the attitude association information to realize 3D interaction control of the display device. According to the embodiment of the invention, the rotation of the operation object in each direction in the three-dimensional space can be realized without developing an independent Bluetooth private protocol, and the interaction control of the two-dimensional space and the three-dimensional space can be realized at the same time.

Description

Technical Field

[0001] Embodiments of the present application relate to the field of interactive control technologies, and particularly to a control method, device, electronic device, and medium. Background Art

[0002] With the development of 3D technologies and the trends of miniaturization and wearability of interactive tools, it has become increasingly common to control objects in three-dimensional space through interactive tools such as bracelets or rings. Compared with traditional devices that can only perform two-dimensional space control (such as air mice, mice), 3D interactive tools not only need to implement operations on interactive objects in two-dimensional space, such as dragging up and down, but also need to achieve rotation of the operation object in all directions in three-dimensional space.

[0003] Therefore, how to simultaneously achieve two-dimensional and three-dimensional interactive control through interactive tools such as bracelets or rings has become a technical problem to be urgently solved. Summary of the Invention

[0004] In view of this, embodiments of the present application provide a control method, device, electronic device, and medium to at least partially solve the above problems.

[0005] According to a first aspect of embodiments of the present application, a control method is provided, which is applied to a 3D controller. The 3D controller interacts with a display device for control. The control method includes: connecting to the display device using the human interface device standard protocol of Bluetooth, and the human interface device standard protocol of Bluetooth includes: air mouse mode; entering the air mouse mode, starting a target 3D application program, and obtaining a private protocol feature field in the human interface device standard protocol of Bluetooth. The private protocol feature field includes pose association information of the 3D controller; using a manipulation model corresponding to the pose association information to implement 3D interactive control of the display device.

[0006] According to a second aspect of embodiments of the present application, an image information and inertial navigation data fusion device is provided, which is applied to a 3D controller. The 3D controller interacts with a display device for control. The device includes: a connection module for connecting to the display device using the human interface device standard protocol of Bluetooth, and the human interface device standard protocol of Bluetooth includes: air mouse mode; a start module for entering the air mouse mode, starting a target 3D application program, and obtaining a private protocol feature field in the human interface device standard protocol of Bluetooth. The private protocol feature field includes pose association information of the 3D controller; a transmission module for using a manipulation model corresponding to the pose association information to implement 3D interactive control of the display device.

[0007] According to a third aspect of the embodiments of the present application, an electronic device is provided, including: a processor, a memory, a communication interface, and a communication bus. The processor, the memory, and the communication interface complete communication with each other through the communication bus; the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to perform operations corresponding to the method described in the first aspect.

[0008] According to a fourth aspect of the embodiments of the present application, a computer storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, it implements the method described in the first aspect.

[0009] In the solution of the embodiments of the present application, a 3D controller applied to interactively control a display device is connected to the display device by using the standard protocol of a Bluetooth human interface device, and after entering the air mouse mode, a target 3D application program is started, and the private protocol feature field in the standard protocol of the Bluetooth human interface device is obtained and used to obtain a control model corresponding to the pose association information, so as to implement 3D interactive control of the display device. The embodiments of the present application can achieve rotation in all directions of an operation object in a three-dimensional space without developing a separate Bluetooth private protocol, can simultaneously implement interactive control in a two-dimensional space and a three-dimensional space, and do not need to switch between an air mouse and an interactive tool such as a bracelet or a ring, thus solving the problems of protocol mutual switching and adaptation compatibility. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments recorded in the embodiments of the present application, and those of ordinary skill in the art can also obtain other drawings based on these drawings.

[0011] Figure 1 Schematic diagram of a system to which a control method according to an embodiment of the present application is applied.

[0012] Figure 2 Flowchart of steps of a control method according to an embodiment of the present application.

[0013] Figure 3 Flowchart of step S2 of a control method according to an embodiment of the present application.

[0014] Figure 4 Coordinate schematic diagram of a quaternion of a control method according to an embodiment of the present application.

[0015] Figure 5 Schematic block diagram of a control device according to an embodiment of the present application.

[0016] Figure 6 Schematic structural diagram of an electronic device according to an embodiment of the present application. Detailed implementation manners

[0017] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and detailedly described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art shall fall within the scope protected by the embodiments of the present application.

[0018] It should be understood that the terms "first", "second", "third", etc. in the claims, the description, and the drawings of the present disclosure are used to distinguish different objects, rather than to describe a specific order. The terms "comprising" and "including" used in the description and claims of the present disclosure indicate the presence of the described features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or their combinations.

[0019] It should also be understood that the terms used in the description of the present disclosure herein are only for the purpose of describing specific embodiments, and are not intended to limit the present disclosure. As used in the description and claims of the present disclosure, unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" are intended to include the plural forms. It should be further understood that the term "and / or" used in the description and claims of the present disclosure refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0020] Interactive devices such as finger rings or rings need to collect the user's actions to form corresponding data instructions. After being parsed by a display device (such as a VR all-in-one machine, an AR device, a 3D interactive screen, etc.), corresponding control instructions are formed to perform corresponding actions. Then, a communication connection needs to be established first between the display device to be controlled and the interactive device such as a finger ring or a ring, such as the standard Bluetooth protocol.

[0021] Conventional air mice use the standard Bluetooth protocol. The air mouse is connected to a display device using the standard Bluetooth protocol to achieve interactive control. However, the air mouse can only achieve two-dimensional plane interaction, and can control Windows applications, such as opening a player, etc., but cannot complete the rotation of the operation object in all directions in three-dimensional space.

[0022] In summary, interactive devices such as finger rings or rings, and air mice can all be connected to a display device through the standard Bluetooth protocol. However, an air mouse cannot achieve the rotation of an operation object in all directions in three-dimensional space, while interactive devices such as finger rings or rings use a developed Bluetooth private protocol to achieve the rotation control of an operation object in all directions in three-dimensional space. Moreover, in addition to using the Bluetooth private protocol to connect between an interactive device such as a finger ring or a ring and a display device, a separate upper-layer application also needs to be developed for adaptation to achieve data communication. Both the Bluetooth private protocol and the separate development of the upper-layer application will consume more development costs, and the switching of communication protocols will also affect interactive control.

[0023] To solve the above problems, in the solution of the embodiment of the present application, a 3D controller applied to interactive control with a display device is connected to the display device using the human interface device standard protocol of Bluetooth. After entering the air mouse mode, the target 3D application program is started, and the private protocol feature field in the human interface device standard protocol of Bluetooth is obtained and used to obtain a manipulation model corresponding to the pose association information, so as to achieve 3D interactive control of the display device. The embodiment of the present application can achieve the rotation of an operation object in all directions in three-dimensional space without developing a separate Bluetooth private protocol, can simultaneously achieve interactive control in two-dimensional space and three-dimensional space, and does not require switching between an air mouse and an interactive tool such as a bracelet or a ring, thus solving the problems of protocol switching and adaptation compatibility.

[0024] Figure 1 Fig. shows a control method according to an embodiment of the present application, which is applied to a 3D controller. The 3D controller can be set in an interactive device such as a finger ring or a ring, or can be the finger ring or the ring itself, to achieve interactive control with a display device.

[0025] The finger ring or the ring in the embodiment of the present application generally includes a finger ring body, a touchpad is arranged on the surface, and a small button, and components such as a processor, a memory, a Bluetooth module, and an IMU are arranged inside. It can collect data such as acceleration, perform a certain degree of data processing, and can be connected to an external device through Bluetooth and then perform data transmission.

[0026] See Figure 2 , the control method includes:

[0027] Step S1: Connect to the display device using the human interface device standard protocol of Bluetooth. The human interface device standard protocol of Bluetooth includes: air mouse mode.

[0028] In some specific implementations of the embodiment of the present application, the human interface device standard protocol of Bluetooth further includes: keyboard mode.

[0029] Specifically, the 3D controller establishes a connection with the display device through the Human Interface Device standard protocol of Bluetooth, without the need to develop a separate private protocol.

[0030] In the embodiments of the present application, custom actions are used to simulate the pointer sliding, left and right key pressing, scroll wheel sliding in the air mouse mode, and the key value pressing and releasing actions in the keyboard mode.

[0031] Exemplarily, interaction devices such as finger rings or rings use cases to simulate scroll wheel sliding, etc.

[0032] In the embodiments of the present application, interaction devices such as finger rings or rings are used to simulate the air mouse and the keyboard. The air mouse mode and the keyboard mode can be implemented through the Human Interface Device standard protocol of Bluetooth, thereby realizing the interactive control in the two-dimensional space.

[0033] Step S2: Enter the air mouse mode, start the target 3D application, and obtain the private protocol feature field in the Human Interface Device standard protocol of Bluetooth. The private protocol feature field includes attitude association information.

[0034] Specifically, the target 3D application is the application displayed on the display device, and it is necessary to start the target 3D application to realize the corresponding functions by rotating the operation object in all directions.

[0035] In some specific implementations of the embodiments of the present application, the attitude association information is a quaternion.

[0036] See Figure 3 , a quaternion is an extended complex number composed of a real part and an imaginary part. A quaternion can be expressed as q = w + xi + yj + zk, where w is the real part and (x, y, z) are the components on the rotation axis corresponding to the imaginary part. For example, a common quaternion is expressed as q = 1 + 2i + 3j + 4k. This quaternion represents a rotation about the axis (2, 3, 4) by an angle of 2cos-1(1 / √30). The real part w represents the cosine value of the rotation angle, and the imaginary part (x, y, z) represents the product of the sine value of the rotation angle and the rotation axis. For example, in the quaternion q = cos(θ / 2) + u*sin(θ / 2), w = cos(θ / 2) represents the cosine value of the rotation angle, and (u*sin(θ / 2)) represents the product of the sine value of the rotation angle and the rotation axis.

[0037] In the embodiments of the present application, a quaternion is used to represent the rotation situation in space. By setting the quaternion in the private protocol feature field of the Human Interface Device standard protocol of Bluetooth, the rotation control of the operation object in all directions is realized. The embodiments of the present application can conveniently and accurately represent the rotation control of the operation object in all directions.

[0038] In some specific implementations of the embodiments of the present application, the attitude correlation information is the original sensor data used to calculate the attitude data.

[0039] In the embodiments of the present application, the controller obtains the original sensor data for calculating the attitude data, and then calculates the attitude data according to the original data.

[0040] In some specific implementations of the embodiments of the present application, refer to Figure 4 , step S2 includes:

[0041] Step S21: Start the target 3D application.

[0042] Step S22: Receive the start instruction sent by the target 3D application, and start the communication of the data stream corresponding to the private protocol feature field according to the start instruction.

[0043] In the embodiments of the present application, the communication of the data stream corresponding to the private protocol feature field is started through the start instruction, without using the Bluetooth private protocol, nor switching between the Bluetooth Human Interface Device Standard Protocol and the Bluetooth private protocol.

[0044] Specifically, the private protocol feature field includes: the feature field selected from the costom field range in the Bluetooth Human Interface Device Standard Protocol. The feature field selected from the costom field range is a reserved field of the Bluetooth Human Interface Device Standard Protocol, and specific functions can be implemented through customization. In the embodiments of the present application, the attitude correlation information is set using the costom field in the private protocol feature field, so that the rotation control of the operation object in each direction can be realized using the attitude correlation information.

[0045] Refer to Table 1. The pseudo-definition format of the private protocol feature field includes: packet byte number, data type, data description.

[0046]

[0047]

[0048] In some specific implementations of the embodiments of the present application, step S22 is specifically:

[0049] If the target 3D application determines that the 3D controller supports the private protocol feature field, receive the start instruction sent by the target 3D application, and start the communication of the data stream corresponding to the private protocol feature field according to the start instruction.

[0050] In the embodiment of the present application, the display device determines whether the connected device is a 3D controller through a 3D application. If it is a 3D controller, it determines whether the 3D controller supports the private protocol feature field. If the 3D controller supports the private protocol feature field, it receives the opening instruction sent by the target 3D application and enables the communication of the data stream corresponding to the private protocol feature field according to the opening instruction.

[0051] The embodiment of the present application avoids the frequent connection of non-3D controllers and 3D controllers that do not support the private protocol feature field to the display device, improving the user experience.

[0052] Step S3: Use the manipulation model corresponding to the pose association information to implement 3D interaction control of the display device.

[0053] Through the pose data obtained by the inertial sensor (IMU) in the present application, using the manipulation model corresponding to the quaternion information, the 3D interaction control of the display device can be simply implemented.

[0054] In the embodiment of the present application, the 3D controller can directly use the manipulation model corresponding to the pose association information in the target 3D application to implement the 3D interaction control manipulation model of the display device. It does not involve the switching of communication protocols, can implement the interaction control of the 2D air mouse mode and the keyboard mode, can also implement the 3D rotation interaction control, and does not require the target 3D application to be adapted to the private protocol.

[0055] In the Windows large screen usage scenario of the display device, when implementing the target 3D application of the teaching type and using the 3D controller of the embodiment of the present application, there is no need to frequently switch operations between the air mouse and traditional 3D interaction devices.

[0056] In the embodiment of the present application, the target 3D application does not need to consider the connection problem anymore. The target 3D application can use the private protocol feature field including the pose association information to implement the interaction control in the three-dimensional space.

[0057] The embodiment of the present application can realize the rotation of the operation object in all directions in the three-dimensional space without developing a separate Bluetooth private protocol, can simultaneously implement the interaction control in the two-dimensional space and the three-dimensional space, and does not require the switching of interaction tools such as the air mouse and the bracelet or ring, solving the problems of protocol switching and adaptation compatibility.

[0058] Corresponding to the above method, the present application also provides a control device, which is applied to a 3D controller, and the 3D controller performs interaction control with a display device. Refer to Figure 5 and the device includes:

[0059] A connection module 501 is used to connect to a display device using the Human Interface Device standard protocol of Bluetooth. The Human Interface Device standard protocol of Bluetooth includes: an air mouse mode.

[0060] A start module 502 is used to enter the air mouse mode, start a target 3D application, and obtain a private protocol feature field in the Human Interface Device standard protocol of Bluetooth. The private protocol feature field includes pose association information of a 3D controller.

[0061] A transmission module 503 is used to use a manipulation model corresponding to the pose association information to implement 3D interactive control of the display device.

[0062] In the embodiment of the present application, it is not necessary to develop a separate Bluetooth private protocol to realize the rotation of an operation object in all directions in a three-dimensional space. It can simultaneously realize the interactive control in a two-dimensional space and a three-dimensional space, and there is no need to switch between an air mouse and an interactive tool such as a bracelet or a ring, solving the problems of protocol mutual switching and adaptation compatibility.

[0063] Refer to Figure 6 , which shows a schematic structural diagram of an electronic device according to another embodiment of the present application. The specific implementation of the electronic device in the specific embodiment of the present application is not limited.

[0064] As Figure 6 shown, the electronic device may include: a processor 602, a communication interface 604, a memory 606 storing a program 610, and a communication bus 608.

[0065] The processor, the communication interface, and the memory complete mutual communication through the communication bus. The communication interface is used to communicate with other electronic devices or servers. The processor is used to execute the program, and specifically can execute the relevant steps in the above method embodiment. Specifically, the program may include program code, and the program code includes computer operation instructions.

[0066] The processor may be a processor CPU, or a specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiment of the present application. One or more processors included in the electronic device may be of the same type of processor, such as one or more CPUs; or may be of different types of processors, such as one or more CPUs and one or more ASICs.

[0067] A memory for storing programs. The memory may include high-speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

[0068] Specifically, the program can be used to enable the processor to perform operations: connect to the display device using the standard protocol of a Bluetooth human interface device, where the standard protocol of the Bluetooth human interface device includes: an air mouse mode; enter the air mouse mode, start a target 3D application, and obtain a private protocol feature field in the standard protocol of the Bluetooth human interface device, where the private protocol feature field includes attitude association information of a 3D controller; use a manipulation model corresponding to the attitude association information to implement 3D interaction control of the display device.

[0069] The above embodiments are only used to illustrate the embodiments of the present application and are not limitations on the embodiments of the present application. Those of ordinary skill in the relevant technical field can also make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present application. The patent protection scope of the embodiments of the present application should be defined by the claims. The systems, devices, modules, or units illustrated in the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions.

[0070] For convenience of description, when describing the above device, it is described by dividing it into various units according to functions. Of course, when implementing the present application, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0071] The embodiments of the present application also provide a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the above method is implemented.

[0072] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memories, CD-ROMs, optical memories, etc.) containing computer-usable program code.

[0073] This application is described with reference to the flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and combinations of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processors of general-purpose computers, special-purpose computers, embedded processors, or other programmable data processing devices to produce a machine, such that the instructions executed by the processors of the computer or other programmable data processing devices generate means for implementing the functions specified in one flow Figure 1 one flow or multiple flows and / or blocks Figure 1 or means for implementing the functions specified in multiple blocks.

[0074] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufactured article including instruction means that implement the functions specified in one flow Figure 1 one flow or multiple flows and / or blocks Figure 1 or means for implementing the functions specified in multiple blocks.

[0075] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one flow Figure 1 one flow or multiple flows and / or blocks Figure 1 or means for implementing the functions specified in multiple blocks.

[0076] In a typical configuration, a computing device includes one or more processors (CPUs), an input / output interface, a network interface, and memory. The memory may include non-permanent memory in the form of computer-readable media, random access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0077] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0078] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0079] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0080] The present application may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific transactions or implement specific abstract data types. The present application may also be practiced in distributed computing environments where transactions are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0081] Each embodiment in this specification is described in a progressive manner. For the identical or similar parts among the embodiments, reference can be made to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for the relevant parts, reference can be made to the partial description of the method embodiments.

Claims

1. A control method is applied to a 3D controller which can interact with a display device for control. The method is characterized in that The control method includes: Connecting to the display device using the standard protocol of a Bluetooth human interface device, where the standard protocol of the Bluetooth human interface device includes: an air mouse mode; Entering the air mouse mode, starting a target 3D application, and obtaining a private protocol feature field in the standard protocol of the Bluetooth human interface device, where the private protocol feature field includes attitude association information of a 3D controller; Using a control model corresponding to the attitude association information to achieve 3D interactive control of the display device.

2. The method according to claim 1, characterized in that The attitude association information is a quaternion.

3. The method according to claim 1, characterized in that The attitude association information is raw sensor data used to calculate attitude data.

4. The method according to claim 1, characterized in that The entering the air mouse mode, starting the target 3D application, and obtaining the private protocol feature field in the standard protocol of the Bluetooth human interface device includes: In the air mouse mode, starting the target 3D application; Receiving an enabling instruction sent by the target 3D application and enabling communication of a data stream corresponding to the private protocol feature field according to the enabling instruction.

5. The method according to claim 4, characterized in that Receiving an enabling instruction sent by the target 3D application and enabling communication of a data stream corresponding to the private protocol feature field according to the enabling instruction, specifically: If the target 3D application determines that the 3D controller supports the private protocol feature field, receiving the enabling instruction sent by the target 3D application and enabling communication of the data stream corresponding to the private protocol feature field according to the enabling instruction.

6. The method according to claim 5, characterized in that The private protocol feature field includes: a feature field selected from a costom field range in the standard protocol of the Bluetooth human interface device.

7. The method according to claim 6, characterized in that The pseudo-definition format of the private protocol feature field includes: data packet byte number, data type, data description.

8. An image information and inertial navigation data fusion device is applied to a 3D controller which interacts with a display device for control. The device is characterized in that The device includes: A connection module for connecting to the display device using the standard protocol of a Bluetooth human interface device, where the standard protocol of the Bluetooth human interface device includes: an air mouse mode; A start module for entering the air mouse mode, starting a target 3D application, and obtaining a private protocol feature field in the standard protocol of the Bluetooth human interface device, where the private protocol feature field includes attitude association information of a 3D controller; A transmission module for using a control model corresponding to the attitude association information to achieve 3D interactive control of the display device.

9. An electronic device, comprising: A processor, a memory, a communication interface, and a communication bus, where the processor, the memory, and the communication interface complete communication with each other through the communication bus; The memory is used to store at least one executable instruction, and the executable instruction causes the processor to perform operations corresponding to the method according to any one of claims 1-7.

10. A computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the method described in any one of claims 1-7 is implemented.

Images