Interaction control method, device and equipment and computer storage medium

Abstract

The embodiment of the invention provides an interaction control method, device and equipment and a computer storage medium, and the method comprises the steps: receiving an operation instruction sent by second equipment, and the operation instruction comprises the posture information of the second equipment; acquiring position information of the second equipment relative to the first equipment, wherein the position information comprises a target distance between the second equipment and the first equipment; according to the target distance and the attitude information, determining a target position corresponding to the second device on a display screen of the first device; and according to the operation instruction, operating a target object displayed at the target position. According to the embodiment, the high-precision positioning function of the equipment can be realized, so that the application range of the virtual remote controller is expanded.

Description

Technical Field

[0001] The present invention belongs to the field of virtual reality technology, and in particular relates to an interactive control method, device, equipment and computer storage medium. Background Art

[0002] In recent years, with the implementation of 5G, the virtual reality (VR) industry has been further developed, and VR-related products have also shown explosive growth, involving application areas including real estate, home decoration, cultural tourism, games, education, and medical care. However, VR application services are still mainly for B-end users, and there is a lack of TV VR applications for home scenes in the market. The main reason is that the interaction between people and TVs is still mainly based on traditional button remote controls, resulting in poor human-computer interaction of VR content such as VR videos and VR games on the TV side, affecting user experience and other problems. Especially for VR games, professional game controllers are also needed to deeply experience the immersive feeling brought by VR games.

[0003] In order to solve the above problems, a VR TV virtual remote control has been developed in the prior art. The virtual remote control is carried by a mobile phone and controls the TV through the mobile phone, so that users can experience VR content more smoothly. However, the VR TV virtual remote control currently developed lacks high-precision positioning function, which leads to the problem of limited use of VR TV virtual remote control. Summary of the invention

[0004] The embodiments of the present application provide an interactive control method, apparatus, device and computer storage medium to solve the problem that the use range of a virtual remote control for a VR TV is limited due to the lack of a high-precision positioning function of the virtual remote control.

[0005] In a first aspect, an embodiment of the present application provides an interactive control method, which is applied to a first device, and the method includes:

[0006] receiving an operation instruction sent by a second device, wherein the operation instruction includes posture information of the second device;

[0007] Acquire location information of the second device relative to the first device, where the location information includes a target distance between the second device and the first device;

[0008] Determining a target position corresponding to the second device on the display screen of the first device according to the target distance and the posture information;

[0009] According to the operation instruction, an operation is performed on the target object displayed at the target position.

[0010] In a second aspect, an embodiment of the present application provides an interactive control device, including:

[0011] A receiving module, configured to receive an operation instruction sent by a second device, wherein the operation instruction includes posture information of the second device;

[0012] an acquisition module, configured to acquire location information of the second device relative to the first device, wherein the location information includes a target distance between the second device and the first device;

[0013] A determination module, configured to determine a target position of the second device corresponding to the display screen of the first device according to the target distance and the posture information;

[0014] The operating module is used to operate the target object displayed at the target position according to the operating instruction.

[0015] In a third aspect, an embodiment of the present application provides a terminal device, the device comprising: a processor and a memory storing computer program instructions;

[0016] When the processor executes the computer program instructions, the interactive control method of the first aspect is implemented.

[0017] In a fourth aspect, an embodiment of the present application provides a computer storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the interactive control method of the first aspect is implemented.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, characterized in that when instructions in the computer program product are executed by a processor of an electronic device, the electronic device executes the interactive control method of the first aspect.

[0019] The interactive control method, apparatus, device and computer storage medium of the embodiments of the present invention can determine the target position of the second device on the display screen of the first device based on the position information and posture information of the second device, thereby realizing the positioning of the second device relative to the first device and realizing the solution of the relative position between the first device and the second device. At the same time, the first device responds to the instructions sent by the second device to realize the interaction between the two, thereby realizing the high-precision control of the first device by the second device. It not only gets rid of the problems of the single function and poor user experience of the traditional remote control, but also enriches the functions of the traditional remote control. Users can realize more and more complex interactive operations through the second device, especially in the application of VR TV content. Users do not need to purchase game controllers separately, and can deeply experience VR games only through the second device, which improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0021] Figure 1 is a flowchart of an interactive control method provided in an embodiment of the present application;

[0022] Figure 2 is a schematic diagram of a spatial coordinate system provided by an embodiment of the present application;

[0023] Figure 3 It is a schematic diagram of the overall control flow provided by the embodiment of the present application;

[0024] Figure 4 is a schematic diagram of an interactive control device provided in an embodiment of the present application;

[0025] Figure 5 It is a schematic diagram of the structure of the terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0027] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0028] In the existing VR TV virtual remote control technology, in order to realize the control of the TV by the mobile phone, it is necessary to rely on positioning technology. The positioning methods proposed in the currently disclosed positioning solutions mainly include two categories. One category is based on the existing GPS signals, base stations, Bluetooth, wifi, etc. for positioning. The advantage of this type of method is that the whole system solution has a simple structure and does not require additional equipment costs, which can effectively reduce the promotion and use threshold of the technology. However, the biggest disadvantage of this type of technical solution is that the positioning accuracy is low, which is only suitable for outdoor positioning or indoor positioning with low positioning accuracy requirements. Another type of positioning solution is to achieve high-precision positioning by configuring equipment in the positioning space, such as ultra-wideband positioning, infrared positioning, ultrasonic positioning, etc. This type of solution usually requires the addition of additional transmitting or receiving devices such as positioning base stations and cameras to realize the solution of the positioning tag position, and is often used for indoor positioning with high positioning accuracy requirements. Compared with the first type of solution, the advantage of this type of solution is high positioning accuracy, some of which can reach the centimeter level, but the disadvantage is that the cost of environment construction is high and the promotion is difficult. In summary, the existing positioning solutions are not suitable for VR usage scenarios in the home, that is, the VR TV virtual remote control that has been developed currently lacks high-precision positioning function, which limits the scope of use of VR TV virtual remote control.

[0029] In order to solve the problems of the prior art, the embodiments of the present application provide an interactive control method, device, equipment and computer storage medium. The following first describes an example of the interactive control method provided by the embodiments of the present application.

[0030] Figure 1 FIG. 1 is a flow chart of an interactive control method provided by an embodiment of the present application. Figure 1 As shown, the method includes:

[0031] Step 101, receiving an operation instruction sent by a second device, wherein the operation instruction includes posture information of the second device;

[0032] Step 102, obtaining location information of the second device relative to the first device, wherein the location information includes a target distance between the second device and the first device;

[0033] Step 103, determining a target position corresponding to the second device on the display screen of the first device according to the target distance and the posture information;

[0034] Step 104: perform an operation on the target object displayed at the target position according to the operation instruction.

[0035] In step 101, an operation instruction sent by a second device is received, wherein the operation instruction includes posture information of the second device;

[0036] The second device can be a mobile phone, a tablet computer or other electronic device that can connect to the Internet; the first device can be a TV, or an electronic device with a display function, etc. The application scenario of the present invention can be to interact with the TV through a mobile phone, so as to achieve the purpose of controlling the VR scene in the TV through the mobile phone, and specifically, it can be applied to VR games.

[0037] It should be noted that the first device may also be a combination of a set-top box and a display, wherein the set-top box is used to implement the interaction logic with the second device, and the display is used to display the screen requested to be presented by the set-top box. For ease of understanding, the following embodiments are described by taking the first device as a television and the second device as a mobile phone as an example.

[0038] In step 102, the location information of the second device relative to the first device is obtained, where the location information includes a target distance between the second device and the first device;

[0039] In one embodiment, the step 102 further includes:

[0040] Acquire a time difference between when the second device sends the operation instruction and when the first device receives the operation instruction;

[0041] Based on the time difference, the target distance between the second device and the first device is determined.

[0042] In this embodiment, the above time difference can be determined by the timestamp carried in the operation instruction. Specifically, when the second device sends the operation instruction, the operation instruction carries a first timestamp t1 of the sending time. When the first device receives the operation instruction, it records a second timestamp t2 of the receiving time, and the difference between the second timestamp and the first timestamp is the above time difference Δt.

[0043] In one embodiment, determining the target distance between the second device and the first device based on the time difference includes:

[0044] Based on a preset initial time, a preset initial distance and the time difference, the target distance between the second device and the first device is determined, wherein the initial time is the time required for the second device to send the operation instruction and the first device to receive the operation instruction when the second device is at the initial distance from the first device.

[0045] In this embodiment, the initial distance L0 between the TV and the mobile phone and the initial time t0 required for the mobile phone to send an operation instruction and be received by the TV set-top box at this distance are configured in the TV, wherein the initial distance and the initial time are tested and configured in advance by the developer and saved in the TV.

[0046] Specifically, the calculation expression of the target distance L is:

[0047]

[0048] Among them, L0 is the initial distance, t0 is the initial time, and Δt is the time difference.

[0049] In step 103, the target position corresponding to the second device on the display screen of the first device is determined according to the target distance and the posture information.

[0050] The above-mentioned posture information includes the azimuth of the second device in the spatial coordinate system And a pitch angle θ, wherein the spatial coordinate system refers to a three-dimensional coordinate system established with the first device as the origin, and the posture information can be obtained by a gyroscope in the second device.

[0051] Since the application scenario of the present invention is a VR scene displayed on a TV controlled by a mobile phone, the scene displayed on the TV is a three-dimensional scene. When the mobile phone moves in the spatial coordinate system, it corresponds to an object in the three-dimensional scene, and the object is the target position.

[0052] In one embodiment, the step 103 further includes:

[0053] Acquire coordinate information of the second device in the space coordinate system according to the distance, the azimuth angle and the pitch angle;

[0054] Determine a target position corresponding to the coordinate information on the display screen of the first device.

[0055] See also Figure 2 , Figure 2 It is a schematic diagram showing that the second device is in a spatial coordinate system established with the first device as the origin.

[0056] The coordinate information of the second device (x t ,y t , z t ) is calculated as:

[0057] x t =L×Cos(θ)*Cos(φ)

[0058] y t =L×cos(θ)*sin(φ)

[0059] z t =L×sin(θ)

[0060] Where L is the target distance, θ is the pitch angle, is the azimuth.

[0061] In one embodiment, determining a target position corresponding to the coordinate information on a display screen of the first device includes:

[0062] Based on a preset mapping relationship between the coordinate information and the object displayed on the display screen, a target position corresponding to the coordinate information on the display screen of the first device is determined.

[0063] In this embodiment, since the spatial coordinate system is established with the first device as the origin, each coordinate point in the spatial coordinate system has a corresponding position in the three-dimensional scene on the TV. In other words, each coordinate point in the spatial coordinate system corresponds one-to-one to an object in the three-dimensional scene displayed on the TV, and has a mapping relationship. This is tested and configured in advance by the developer. For example, the coordinate point is (1, 1, 1), and the corresponding position on the display screen of the first device is a book; the coordinate point is (2, 2, 2), and the corresponding position on the display screen of the first device is a pen, etc. Therefore, in this embodiment, the corresponding target position on the display screen of the first device can be determined by the coordinate information.

[0064] In this embodiment, the target position of the display screen of the second device on the first device is determined by coordinate information, so that the first device can further achieve accurate control of the second device.

[0065] In step 104, an operation is performed on the target object displayed at the target position according to the operation instruction.

[0066] In this embodiment, the operation instruction may be an instruction to operate the target object displayed at the target position, such as rotation, click, and movement. For example, when the first device detects that the posture of the second device is rotation, the target object is controlled to rotate as well, thereby realizing interactive control between the second device and the first device.

[0067] In this embodiment, by determining the target position of the second device on the display screen of the first device based on the position information and posture information of the second device, the second device can be positioned relative to the first device, and the relative position between the first device and the second device can be solved. At the same time, the first device responds to the instructions sent by the second device to achieve interaction between the two, thereby achieving high-precision control of the first device by the second device. It not only gets rid of the problems of single function and poor user experience of traditional remote controls, but also enriches the functions of traditional remote controls. Users can achieve more and more complex interactive operations through the second device, especially in the application of VR TV content. Users do not need to purchase additional game controllers, and can deeply experience VR games only through the second device, which improves the user experience.

[0068] In an embodiment of the present application, before operating the target object displayed at the target position according to the operation instruction, the method further includes:

[0069] displaying a virtual cursor at the target location;

[0070] The step of operating the target object displayed at the target position according to the operation instruction includes:

[0071] The virtual cursor is controlled to move according to the operation instruction, so that the target object follows the movement of the virtual cursor.

[0072] In this embodiment, the virtual cursor may be represented in the form of an arrow. After the target position is determined, the virtual cursor is displayed at the target position. The virtual cursor may follow the movement of the second device. At this time, the second device can not only act as a common remote controller, but the first device can also perceive the posture of the second device, such as translation, rotation and other operations. By displaying the virtual cursor on the display screen, the user can be provided with a visualized operation position, thereby improving the user experience.

[0073] In an embodiment of the present application, after receiving the operation instruction sent by the second device, the method further includes:

[0074] Determine a target position corresponding to the key information on the display screen of the first device;

[0075] An operation is performed on the target object displayed at the target position according to the key information.

[0076] In this embodiment, the operation instruction also includes key information of the second device. The key information may include operations such as click and translation. After receiving the key information, after determining the controlled target position and target object based on the key information, the target object is directly controlled based on the key information to perform the operation corresponding to the key information, such as translation and click.

[0077] In this embodiment, the TV is operated through key information to realize multiple control modes of the three-dimensional scene, thereby improving the user's interactive control experience.

[0078] See also Figure 3 , Figure 3 It is a schematic diagram of the overall control flow of the present invention. It should be noted that before step 101, the method further includes:

[0079] Install VR applications; (i.e. S1 and S2)

[0080] When the virtual reality application is installed, a communication connection with the second device is established; (i.e., S3)

[0081] Get the initial distance and initial time; (ie S4)

[0082] Receiving operation mode information sent by the second device based on the communication connection, and switching the working mode to an operation mode corresponding to the operation mode information, wherein the operation mode includes a key mode and a gyroscope mode; (ie, S5)

[0083] When the operation mode is the gyroscope mode, an operation instruction sent by the second device is received. (ie, S6)

[0084] In this embodiment, by installing a virtual reality application on the first device and the second device, interactive control between the first device and the second device can be achieved, and the mobile phone can be used as a remote control of the TV to control the TV without purchasing additional VR devices. This improves the user experience and expands the application scope of the virtual reality remote control.

[0085] In addition, Figure 3 In the embodiment, step S71 is step 101 in the above embodiment; S72 is the process of obtaining the first timestamp and the second timestamp in the above embodiment; S73 is the process of storing the posture information of the second device; S74 is the process of calculating the time difference in the above embodiment; S75 is the process of obtaining the target distance in the above embodiment; S76 is the process of determining the target position in the above embodiment; S8 is the virtual cursor display in the above embodiment; S9 is the process of obtaining the key information in the above embodiment.

[0086] The present invention has the following beneficial effects:

[0087] 1. Compared with existing high-precision positioning technologies, such as ultrasonic, infrared, and ultra-wideband positioning, the present invention does not require additional signal transmitting / receiving sensors. It can calculate the position coordinates of the mobile phone in three-dimensional space in real time through the initial distance-to-time ratio and the gyroscope attitude angle. Therefore, it has the advantages of low cost, simple structure, and easy implementation.

[0088] 2. Compared with the existing mature positioning technologies on the market such as GPS, Bluetooth, and WiFi, whose accuracy is within the meter range, the present invention uses high-precision sensors to obtain the time delay from the sender to the receiver and the mobile phone posture parameters, so it can achieve centimeter-level positioning accuracy.

[0089] 3. Currently, the market lacks VR virtual remote control applications. The present invention can help users get rid of the constraints of traditional remote controls and achieve more and more complex human-computer interaction operations through mobile phones, greatly improving the product experience of large-screen TV VR products.

[0090] like Figure 4 As shown, the embodiment of the present application further provides an interactive control device 400, and the interactive control device 800 includes:

[0091] A receiving module 401 is used to receive an operation instruction sent by a second device, where the operation instruction includes posture information of the second device;

[0092] An acquisition module 402 is used to acquire location information of the second device relative to the first device, where the location information includes a target distance between the second device and the first device;

[0093] A first determination module 403, configured to determine a target position corresponding to the second device on the display screen of the first device according to the target distance and the posture information;

[0094] The operation module 404 is used to operate the target object displayed at the target position according to the operation instruction.

[0095] Optionally, the acquisition module 402 includes:

[0096] A first acquisition submodule, used to acquire a time difference between when the second device sends the operation instruction and when the first device receives the operation instruction;

[0097] The first determining submodule is configured to determine the target distance between the second device and the first device based on the time difference.

[0098] Optionally, the first determining submodule is specifically configured to:

[0099] Based on a preset initial time, a preset initial distance and the time difference, the target distance between the second device and the first device is determined, wherein the initial time is the time required for the second device to send the operation instruction and the first device to receive the operation instruction when the second device is at the initial distance from the first device.

[0100] Optionally, the first determining module 403 further includes:

[0101] A second acquisition submodule, configured to acquire coordinate information of the second device in the space coordinate system according to the distance, the azimuth angle and the pitch angle;

[0102] The second determination submodule is used to determine the target position corresponding to the coordinate information on the display screen of the first device.

[0103] Optionally, the first determining module 403 is specifically configured to:

[0104] Based on a preset mapping relationship between the coordinate information and the object displayed on the display screen, a target position corresponding to the coordinate information on the display screen of the first device is determined.

[0105] Optionally, the interactive control device 400 further includes:

[0106] A display module, configured to display a virtual cursor at the target position;

[0107] The first operating module 404 is specifically configured to:

[0108] The virtual cursor is controlled to move according to the operation instruction, so that the target object follows the movement of the virtual cursor.

[0109] Optionally, the interactive control device 400 further includes:

[0110] A second determination module, used to determine a target position corresponding to the key information on the display screen of the first device;

[0111] The second operating module is used to operate the target object displayed at the target position according to the key information.

[0112] Figure 5 A schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present application is shown.

[0113] The terminal device may include a processor 501 and a memory 502 storing computer program instructions.

[0114] Specifically, the processor 501 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0115] The memory 502 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 502 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 502 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 502 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 502 is a non-volatile solid-state memory.

[0116] In certain embodiments, the memory 502 may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage medium device, an optical storage medium device, a flash memory device, an electrical, optical or other physical / tangible memory storage device. Thus, in general, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.

[0117] The processor 501 implements any one of the interactive control methods in the above embodiments by reading and executing computer program instructions stored in the memory 502 .

[0118] In one example, the terminal device may further include a communication interface 503 and a bus 55. Figure 5 As shown, the processor 501, the memory 502, and the communication interface 503 are connected via a bus 55 and communicate with each other.

[0119] The communication interface 503 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0120] Bus 55 includes hardware, software or both, and the components of online data flow billing equipment are coupled to each other. For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front-end bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, first video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 55 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the present application considers any suitable bus or interconnection.

[0121] In addition, in combination with the interactive control method in the above embodiment, the embodiment of the present application can provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by a processor, any one of the interactive control methods in the above embodiment is implemented.

[0122] It should be clear that the present application is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present application.

[0123] The functional blocks shown in the above block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0124] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.

[0125] Aspects of the present disclosure are described above with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable interactive control device to produce a machine so that these instructions executed by the processor of the computer or other programmable interactive control device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs a specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0126] The above are only specific implementation methods of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.

Claims

1. An interactive control method, applied to a first device, characterized in that: Methods include: receiving an operation instruction sent by a second device, wherein the operation instruction includes posture information of the second device; Acquire location information of the second device relative to the first device, where the location information includes a target distance between the second device and the first device; Determining a target position corresponding to the second device on the display screen of the first device according to the target distance and the posture information; According to the operation instruction, an operation is performed on the target object displayed at the target position.

2. The interactive control method according to claim 1, characterized in that: The acquiring the location information of the second device relative to the first device includes: Acquire a time difference between when the second device sends the operation instruction and when the first device receives the operation instruction; Based on the time difference, the target distance between the second device and the first device is determined.

3. The interactive control method according to claim 2, characterized in that: The determining the target distance between the second device and the first device based on the time difference includes: Based on a preset initial time, a preset initial distance and the time difference, the target distance between the second device and the first device is determined, wherein the initial time is the time required for the second device to send the operation instruction and the first device to receive the operation instruction when the second device is at the initial distance from the first device.

4. The interactive control method according to claim 1, characterized in that: The posture information includes an azimuth and a pitch angle of the second device in the spatial coordinate system, where the spatial coordinate system is a three-dimensional coordinate system established with the first device as the origin; The determining, according to the target distance and the posture information, a target position corresponding to the second device on the display screen of the first device includes: Acquire coordinate information of the second device in the space coordinate system according to the distance, the azimuth angle and the pitch angle; Determine a target position corresponding to the coordinate information on the display screen of the first device.

5. The interactive control method according to claim 1, characterized in that: The determining a target position corresponding to the coordinate information on the display screen of the first device includes: Based on a preset mapping relationship between the coordinate information and the object displayed on the display screen, a target position corresponding to the coordinate information on the display screen of the first device is determined.

6. The interactive control method according to claim 1, characterized in that: Before operating the target object displayed at the target position according to the operation instruction, the method further includes: displaying a virtual cursor at the target location; The step of operating the target object displayed at the target position according to the operation instruction includes: The virtual cursor is controlled to move according to the operation instruction, so that the target object follows the movement of the virtual cursor.

7. The interactive control method according to claim 1, characterized in that: The operation instruction includes key information of the second device; After receiving the operation instruction sent by the second device, the method further includes: Determine a target position corresponding to the key information on the display screen of the first device; An operation is performed on the target object displayed at the target position according to the key information.

8. An interactive control device, characterized in that: include: A receiving module, configured to receive an operation instruction sent by a second device, wherein the operation instruction includes posture information of the second device; an acquisition module, configured to acquire location information of the second device relative to the first device, wherein the location information includes a target distance between the second device and the first device; A determination module, configured to determine a target position of the second device corresponding to the display screen of the first device according to the target distance and the posture information; The operating module is used to operate the target object displayed at the target position according to the operating instruction.

9. A terminal device, characterized in that: The device comprises: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, the interactive control method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the interactive control method according to any one of claims 1 to 7 is implemented.

Images