Method and device for determining operation position in display interface, terminal and non-transitory storage medium

Abstract

The present disclosure provides a method and device for determining an operation position in a display interface, a terminal and a non-transitory storage medium. The method comprises: obtaining image information of a wireless remote control device; obtaining posture information of the wireless remote control device; obtaining a distance between the wireless remote control device and a display device and a deflection angle according to the image information; and determining the operation position according to the posture information, the distance and the deflection angle; wherein the operation position is located in a display interface of the display device. The method for determining an operation position in a display interface can position an operation position of a display device controlled by a wireless remote control device.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of computer, and particularly relates to a method and device for determining an operation position in a display interface, a terminal and a non-transitory storage medium. BACKGROUND

[0002] With the development of technology, more and more somatosensory devices appear in the market, and the somatosensory devices often need to calibrate somatosensory sensors. However, the calibration has the problem of accuracy. For example, the somatosensory mouse inevitably has position drift as the use time becomes longer, and the position needs to be repeatedly manually reset. SUMMARY

[0003] To solve the existing problems, the present disclosure provides a method and device for determining an operation position in a display interface, a terminal and a non-transitory storage medium.

[0004] The present disclosure adopts the following technical solutions.

[0005] In some embodiments, the present disclosure provides a method for determining an operation position in a display interface, for a display device, comprising:

[0006] obtaining image information of a wireless remote control device;

[0007] obtaining posture information of the wireless remote control device;

[0008] obtaining a distance and a deflection angle between the wireless remote control device and the display device according to the image information; and

[0009] determining the operation position according to the posture information, the distance and the deflection angle;

[0010] The operation position is located in a display interface of the display device.

[0011] In some embodiments, the present disclosure provides a device for determining an operation position in a display interface, for a display device, comprising:

[0012] an obtaining module, configured to obtain image information of a wireless remote control device, obtain posture information of the wireless remote control device, and obtain a distance and a deflection angle between the wireless remote control device and the display device according to the image information; and

[0013] a determining module, configured to determine the operation position according to the posture information, the distance and the deflection angle;

[0014] The operation position is located in a display interface of the display device.

[0015] In some embodiments, the present disclosure provides a terminal, comprising: at least one memory and at least one processor;

[0016] The at least one memory is configured to store program code, and the at least one processor is configured to invoke the program code stored in the memory to execute the method described above.

[0017] In some embodiments, the present disclosure provides a non-transitory storage medium, which is configured to store program code, and the program code is configured to execute the method described above.

[0018] The scheme for determining the operation position in the display interface provided by the present disclosure positions the operation position of the wireless remote control device corresponding to the display device by the distance and angle information obtained. BRIEF DESCRIPTION OF DRAWINGS

[0019] The above and other features, advantages, and aspects of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings, in which like reference numerals denote like elements or components, wherein: the drawings are schematic and not necessarily to scale, and:

[0020] Figure 1 is a schematic diagram of the present embodiment of the present disclosure for acquiring positioning in the first direction.

[0021] Figure 2 is a schematic diagram of the present embodiment of the present disclosure for acquiring positioning in the second direction.

[0022] Figure 3 is a flowchart of the method for determining the operation position in the display interface according to the present embodiment of the present disclosure.

[0023] Figure 4 is a schematic diagram of the relationship between the image acquisition element and the wireless remote control device according to the present embodiment of the present disclosure.

[0024] Figure 5 is a schematic diagram of the relationship between the operation position and the wireless remote control device according to the present embodiment of the present disclosure.

[0025] Figure 6 is a schematic diagram of the calculation of the coordinates of the operation position according to the present embodiment of the present disclosure.

[0026] Figure 7 is a schematic diagram of the structure of the device for determining the operation position in the display interface according to the present embodiment of the present disclosure.

[0027] Figure 8 is a schematic diagram of the structure of the electronic device according to the present embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein, but rather, these embodiments are provided so as to more completely and thoroughly understand the present disclosure. It is understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0029] It should be understood that each of the steps recited in the method embodiments of the present disclosure can be performed in series and / or in parallel. In addition, the method embodiments can include additional steps and / or omit the performance of the steps shown. The scope of the present disclosure is not limited in this respect.

[0030] The term "comprising" and variations thereof as used herein are open-ended, that is "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Related definitions will be given in the description below.

[0031] It should be noted that the terms "first", "second", and the like in the present disclosure are merely used to distinguish different devices, modules or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules or units.

[0032] It should be noted that the modification "one" mentioned in the present disclosure is illustrative and not restrictive, and those skilled in the art should understand that unless otherwise explicitly indicated in the context, it should be understood as "one or more".

[0033] The names of the messages or information exchanged between the plurality of devices in the embodiments of the present disclosure are only for illustrative purposes, and are not intended to limit the scope of the messages or information.

[0034] To solve the problem of inaccurate positioning, the present disclosure proposes that the image of the flying mouse / body sensing remote controller can be collected by a camera, the shape distortion of the object in the three-dimensional space under a fixed observation angle is obtained, the offset of the gyroscope is supplemented, the distance and position of the remote controller relative to the camera at this time are calculated, and the unique horizontal and vertical point coordinates in the two-dimensional plane pointed to by the flying mouse / body sensing remote controller can be calculated according to the offset angle of the gyroscope. Please refer to Figure 1 and Figure 2 , Figure 1 is a schematic diagram of acquiring positioning in a first direction according to an embodiment of the present disclosure, Figure 2 is a schematic diagram of acquiring positioning in a second direction according to an embodiment of the present disclosure. The first direction can be a horizontal direction, and the second direction can be a vertical direction; Figure 1The top view of the screen, which can be considered as including a camera for example, Figure 2 The side view of the screen, which can be considered as including a camera for example. The transmitting section of the wireless remote control device is generally a certain distance, see Figure 1 and Figure 2 The length of the two dashed lines from the camera to the transmitting section of the remote sensing device is different in the figure. However, since the transmitting section is usually not too large, the length difference of the two dashed lines is very small, and in the embodiment of the present disclosure, the center line of the transmitting section is taken as the equivalent of the two lines, that is, the remote sensing device can also be regarded as a point. As referred to the camera, the point on the screen corresponding to the remote sensing device can be located by the distance between the camera and the remote sensing device in the horizontal and vertical directions. Using this coordinate as the pointer position in the operating system, a strong hand-following and accurate position control experience can be achieved.

[0035] The scheme provided by the embodiment of the present application will be described in detail below with reference to the drawings.

[0036] As shown in Figure 3 , Figure 3 is a flowchart of the method for determining the operating position in the display interface according to the embodiment of the present disclosure, including the following steps.

[0037] S100, acquiring image information of a wireless remote control device.

[0038] The display device includes an image acquisition element. Specifically, the embodiment of the present disclosure can include acquiring the image of the wireless remote control device through the image acquisition element; identifying the wireless remote control device in the image; and acquiring the position information and shape information of the wireless remote control device in the image. The position information can include the size information of the wireless remote control device, and the shape information can include the distortion information of the wireless remote control device.

[0039] The remote sensing device in the embodiment of the present disclosure can include an air mouse or a motion remote control device equipped with a gyroscope; and the display device includes an image acquisition element, such as a display or a television including a camera. The gyroscope is an angular motion detection device that uses the momentum moment of a high-speed rotating body to sense the relative motion of the shell to the inertial space around one or two axes orthogonal to the rotation axis. The gyroscope sensor is a positioning and control system based on free space movement and gestures; for example, waving the mouse on the imaginary plane, the cursor on the screen will follow the movement, and can be linked to draw a circle and click the keys. Therefore, when using the wireless remote control device such as an air mouse, the cursor or pointer of the display device corresponding to the wireless remote control device will be displayed on the screen.

[0040] S200, acquiring attitude information of the wireless remote control device.

[0041] Specifically, the embodiments of the present disclosure can include receiving a pointing angle of the wireless remote control device sent from the wireless remote control device; wherein the pointing angle includes a first pointing angle of the wireless remote control device in a first direction, a second pointing angle of the wireless remote control device in a second direction, and a third pointing angle of the wireless remote control device in a third direction. Wherein the first direction can be a horizontal direction, and the second direction can be a vertical direction.

[0042] More specifically, the wireless remote control device such as a gyroscope of the embodiments of the present disclosure can obtain its own pointing direction through sensors, such as various angles in three-dimensional space, etc.

[0043] S300, obtaining a distance and a deflection angle between the wireless remote control device and the display device according to the image information.

[0044] Specifically, the embodiments of the present disclosure can include obtaining a mapping table; and obtaining the distance and the deflection angle between the wireless remote control device and the display device according to the mapping table and the image information; wherein the mapping table includes a first ratio between a size of the wireless remote control device in the image and a distance, and a second ratio between a distortion of the wireless remote control device in the image and a deflection angle.

[0045] More specifically, according to the different distances of the object from the image acquisition element, the size of the object in the image after taking a picture will also be different in a certain rule, and the first ratio expressing the size of the wireless remote control device in the image and the distance between the wireless remote control device and the image acquisition element can be obtained, so that after obtaining the size of the wireless remote control device in the image, the distance between the wireless remote control device and the image acquisition element can be obtained according to the corresponding first ratio. Similarly, according to the different distortion of the object in the three-dimensional space under different observation angles, the second ratio expressing the distortion degree of the wireless remote control device in the image and the angle between the wireless remote control device and the image acquisition element can be obtained, so that after obtaining the distortion degree of the wireless remote control device in the image, the angle between the wireless remote control device and the image acquisition element can be obtained according to the corresponding second ratio. Wherein the angle can include angles in the first direction, the second direction and the third direction, respectively.

[0046] S400, determining the operation position according to the posture information, the distance and the deflection angle.

[0047] Specifically, the embodiments of the present disclosure can comprise establishing a coordinate system on the display interface with the image acquisition element as the origin; wherein the coordinate system comprises an x-axis and a y-axis; determining a vertical projection position of the wireless remote control device on the display interface; determining a first auxiliary position of the vertical projection position perpendicular to the x-axis; determining a second auxiliary position of the operation position perpendicular to the x-axis; and obtaining the coordinates of the operation position on the x-axis and the y-axis respectively according to the first auxiliary position and the second auxiliary position. More specifically, the embodiments of the present disclosure can comprise obtaining a first distance between the image acquisition element and the first auxiliary position and a second distance between the vertical projection position and the first auxiliary position according to the distance and the deflection angle; obtaining a third distance between the wireless remote control device and the vertical projection position according to the deflection angle and the distance; and obtaining the coordinates of the operation position on the x-axis and the y-axis respectively according to the first distance, the second distance, the third distance and the attitude information.

[0048] Please refer to Figure 4 , Figure 4 is a schematic diagram of the relationship between the image acquisition element and the wireless remote control device in the embodiments of the present disclosure. In Figure 4 , R represents the wireless remote control device, and C represents the image acquisition element. The first direction is the x-axis direction, the second direction is the y-axis direction, and the third direction is the z-axis direction, i.e. the normal direction of the display interface; wherein the first direction and the third direction can be horizontal directions, and the second direction can be a vertical direction. Since the display or television is usually placed vertically, it can be set to be located in the vertical plane determined by the first direction and the second direction, which is the xy plane in Figure 4 . Therefore, the first angle is angle RCx, the second angle is RCy, and the third angle is RCz.

[0049] Please refer to Figure 5 , Figure 5 is a schematic diagram of the relationship between the operation position and the wireless remote control device in the embodiments of the present disclosure. In Figure 5 , R still represents the remote sensing device, and A represents the operation position, such as being displayed in the form of a cursor or indicator on the screen. Wherein, RA represents the pointing direction of the wireless remote control device. In the embodiments of the present disclosure, the x-axis, y-axis and z-axis are set the same as before, which will not be repeated here. Wherein, the attitude information obtained by the sensor of the wireless remote control device, such as the first pointing angle, is angle ARx, the second pointing angle is angle ARy, and the third pointing angle is angle ARz.

[0050] Please refer to Figure 6 , Figure 6 is a schematic diagram of calculating the coordinates of the operation position in the embodiments of the present disclosure. In Figure 6In some embodiments, the rectangular frame is a screen, for example, and the image acquisition element is a camera C, which can be located at the center point above the screen. Of course, the camera position in the embodiments of the present disclosure is not limited to this. Figure 6 In some embodiments, the rectangular frame is a screen, for example, and the image acquisition element is a camera C, which can be located at the center point above the screen. Of course, the camera position in the embodiments of the present disclosure is not limited to this. Figure 4 In some embodiments, the rectangular frame is a screen, for example, and the image acquisition element is a camera C, which can be located at the center point above the screen. Of course, the camera position in the embodiments of the present disclosure is not limited to this. Figure 5 In some embodiments, the rectangular frame is a screen, for example, and the image acquisition element is a camera C, which can be located at the center point above the screen. Of course, the camera position in the embodiments of the present disclosure is not limited to this. Figure 4 In some embodiments, the rectangular frame is a screen, for example, and the image acquisition element is a camera C, which can be located at the center point above the screen. Of course, the camera position in the embodiments of the present disclosure is not limited to this. Figure 5 In some embodiments, the rectangular frame is a screen, for example, and the image acquisition element is a camera C, which can be located at the center point above the screen. Of course, the camera position in the embodiments of the present disclosure is not limited to this.

[0051] The method for determining the operation position in the display interface provided by the embodiments of the present disclosure can be used to identify, for example, a handheld mouse or other somatosensory remote controller with obvious markers by using a machine vision method with a single camera, and the position and distance of the mouse or somatosensory remote controller relative to the camera can be calculated, thereby greatly improving the accuracy of the mouse and somatosensory remote controller and eliminating the cost of manual calibration and improving the user experience.

[0052] As shown in Figure 7 As shown in Figure 7is a structural schematic diagram of determining an operation position in a display interface by an apparatus according to an embodiment of the present disclosure. The apparatus 10 can include an obtaining module 13 and a determining module 15. The obtaining module 13 can be configured to obtain image information of a wireless remote control apparatus, obtain posture information of the wireless remote control apparatus, and obtain a distance between the wireless remote control apparatus and the display apparatus and a deflection angle according to the image information and the posture information. The determining module 15 can be configured to determine the operation position according to the posture information, the distance and the deflection angle, wherein the operation position is located in a display interface of the display apparatus.

[0053] For the embodiments of the apparatus, since they basically correspond to the embodiments of the method, the relevant parts are described in the part of the embodiments of the method. The above-described apparatus embodiments are merely illustrative, and the modules described as separate modules can or can not be separate. Part or all of the modules can be selected according to actual needs to achieve the purpose of the embodiments. Those skilled in the art can understand and implement without creative labor.

[0054] The above describes the method and apparatus for determining an operation position in a display interface according to embodiments and application examples. In addition, the present disclosure also provides a terminal and a non-transitory storage medium, which are described below.

[0055] The following refers to Figure 8 which shows a structural schematic diagram of an electronic device (e.g., a terminal or a server) 800 suitable for implementing embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure can include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Personal Computers), PMPs (Portable Multimedia Players), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), and the like, as well as fixed terminals such as digital TVs, desktop computers, and the like. Figure 8 The electronic device shown is only an example and should not impose any limitation on the functions and use range of the embodiments of the present disclosure.

[0056] As shown in Figure 8 , the electronic device 800 can include a processing apparatus (e.g., a central processor, a graphics processor, etc.) 801, which can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 802 or loaded into a random access memory (RAM) 803 from a storage apparatus 808. In the RAM 803, various programs and data required for the operation of the electronic device 800 are also stored. The processing apparatus 801, the ROM 802, and the RAM 803 are connected to each other through a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0057] Generally, the following devices can be connected to the I / O interface 805: input devices 806, including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, and the like; output devices 807, including, for example, a liquid crystal display (LCD), a speaker, a vibrator, and the like; storage devices 808, including, for example, a magnetic tape, a hard disk, and the like; and communication devices 809. The communication devices 809 can allow the electronic device 800 to communicate wirelessly or wired with other devices to exchange data. Although Figure 8 The electronic device 800 is shown with various devices, but it is understood that all of the shown devices are not required to be implemented or present. More or less devices can alternatively be implemented or present.

[0058] In particular, the processes described above with reference to the flowcharts can be implemented as a computer software program according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing program code for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication devices 809, or installed from the storage devices 808, or installed from the ROM 802. When the computer program is executed by the processing devices 801, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are performed.

[0059] It should be noted that the computer-readable medium described above can be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium, for example, can be, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination of the foregoing. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program used by or in connection with an instruction execution system, apparatus or device. In the disclosure, the computer-readable signal medium can include a data signal propagated in baseband or propagated as a carrier wave in a propagated data signal, in which the computer-readable program code is contained. Such a propagated data signal can take many forms, including but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the foregoing. The computer-readable signal medium can also be any computer-readable medium that can send, propagate or transfer the program for use by or in connection with an instruction execution system, apparatus or device. The program code contained in the computer-readable medium can be transmitted by any suitable medium, including but not limited to, wire, cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

[0060] In some embodiments, the client, server, or both can communicate using any current known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any current known or future developed networks.

[0061] The computer-readable medium described above can be included in the electronic device described above; or can exist separately from the electronic device, and can not be assembled in the electronic device.

[0062] The computer-readable medium described above carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the method of the disclosure described above.

[0063] Computer program code for carrying out operations of the present disclosure can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0064] The computer program instructions can also be loaded onto a computer or other programmable information processing apparatus to cause a series of operations to be performed on the computer or other programmable information processing apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable information processing apparatus implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0065] The units described in the embodiments of the present disclosure can be implemented by hardware, software, or a combination of hardware and software. In some cases, the names of the units do not constitute a limitation on the units themselves.

[0066] The functions described in this specification can be implemented in part or in whole through one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0067] In the context of this disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0068] According to one or more embodiments of the present disclosure, a method for determining an operation position in a display interface for a display device is provided, comprising:

[0069] obtaining image information of a wireless remote control device;

[0070] obtaining posture information of the wireless remote control device;

[0071] obtaining a distance and a deflection angle between the wireless remote control device and the display device according to the image information; and

[0072] determining the operation position according to the posture information, the distance, and the deflection angle;

[0073] wherein the operation position is located within a display interface of the display device.

[0074] According to one or more embodiments of the present disclosure, a method is provided, characterized in that the display device comprises an image acquisition element;

[0075] wherein the obtaining image information of a wireless remote control device comprises:

[0076] acquiring an image of the wireless remote control device through the image acquisition element;

[0077] recognizing the wireless remote control device in the image; and

[0078] obtaining position information and shape information of the wireless remote control device in the image.

[0079] According to one or more embodiments of the present disclosure, a method is provided, characterized in that the obtaining a distance and a deflection angle between the wireless remote control device and the display device according to the image information comprises:

[0080] obtaining a mapping table; and

[0081] obtaining the distance and the deflection angle between the wireless remote control device and the display device according to the mapping table and the image information;

[0082] wherein the mapping table comprises a first ratio between a size of the wireless remote control device in the image and the distance and a second ratio between a distortion of the wireless remote control device in the image and the deflection angle.

[0083] According to one or more embodiments of the present disclosure, a method is provided, characterized in that the determining the operation position according to the posture information, the distance and the deflection angle comprises:

[0084] establishing a coordinate system on the display interface with the image acquisition element as the origin; wherein the coordinate system comprises an x-axis and a y-axis;

[0085] determining a vertical projection position of the wireless remote control device on the display interface;

[0086] determining a first auxiliary position of the vertical projection position perpendicular to the x-axis;

[0087] determining a second auxiliary position of the operation position perpendicular to the x-axis; and

[0088] obtaining coordinates of the operation position on the x-axis and the y-axis respectively according to the first auxiliary position and the second auxiliary position.

[0089] According to one or more embodiments of the present disclosure, a method is provided, characterized in that the determining the operation position according to the posture information, the distance and the deflection angle further comprises:

[0090] obtaining a first distance between the image acquisition element and the first auxiliary position and a second distance between the vertical projection position and the first auxiliary position according to the distance and the deflection angle;

[0091] obtaining a third distance between the wireless remote control device and the vertical projection position according to the posture information and the distance; and

[0092] obtaining coordinates of the operation position on the x-axis and the y-axis respectively according to the first distance, the second distance, the third distance and the posture information.

[0093] According to one or more embodiments of the present disclosure, a method is provided, characterized in that the obtaining the posture information of the wireless remote control device comprises:

[0094] receiving a pointing angle of the wireless remote control device transmitted from the wireless remote control device;

[0095] The pointing angle includes a first pointing angle of the wireless remote control device in a first direction, a second pointing angle in a second direction, and a third pointing angle in a third direction.

[0096] According to one or more embodiments of the present disclosure, the first direction is the direction of the x-axis, the second direction is the direction of the y-axis, and the third direction is the normal direction of the display interface.

[0097] According to one or more embodiments of the present disclosure, a device for determining an operation position in a display interface is provided, comprising:

[0098] The acquisition module is configured to acquire image information of a wireless remote control device, acquire posture information of the wireless remote control device, and acquire a distance between the wireless remote control device and the display device and a deflection angle according to the image information; and

[0099] The determination module is configured to determine the operation position according to the posture information, the distance, and the deflection angle.

[0100] The operation position is located in a display interface of the display device.

[0101] According to one or more embodiments of the present disclosure, a terminal is provided, comprising at least one memory and at least one processor.

[0102] The at least one memory is configured to store program code, and the at least one processor is configured to invoke the program code stored in the at least one memory to execute the method of any one of the above.

[0103] According to one or more embodiments of the present disclosure, a non-transitory storage medium is provided, the non-transitory storage medium being configured to store program code, the program code being configured to execute the method described above.

[0104] The above description is only the preferred embodiments of the present disclosure and the explanation of the applied technical principles. Those skilled in the art should understand that the disclosure range involved in the present disclosure is not limited to the technical solutions formed by the specific combinations of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features disclosed in the present disclosure (but not limited to) having similar functions to form technical solutions.

[0105] Moreover, while operations are depicted in a particular order, this should not be understood as requiring such an order nor infringing on the scope of the disclosure. Certain of the operations described in the discussion are combinable into a single operation, and certain operations can be separated into several operations. In some embodiments, the operations described in the discussion can be performed in an order different than presented in the discussion. In some embodiments, the operations described in the discussion can be performed concurrently. Also, while several specific implementation details are discussed in the discussion, these should not be interpreted as limiting the scope of the disclosure. Rather, certain features described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable sub-combination.

[0106] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A method for determining an operation position in a display interface, used in a display device, the display device including an image acquisition element, comprising: Acquiring image information of a wireless remote control device includes: acquiring an image of the wireless remote control device through the image acquisition element; Obtain the attitude information of the wireless remote control device; Based on the image information, the distance and deflection angle between the wireless remote control device and the image acquisition element of the display device are obtained; and The operation position is determined based on the posture information, the distance, and the deflection angle; The operation position is located within the display interface of the display device; The step of determining the operation position based on the attitude information, the distance, and the deflection angle includes: A coordinate system is established on the display interface with the image acquisition element as the origin; wherein the coordinate system includes an x-axis and a y-axis; Determine the vertical projection position of the wireless remote control device on the display interface; Determine a first auxiliary position where the vertical projection position is perpendicular to the x-axis; Determine a second auxiliary position perpendicular to the x-axis; and The first distance between the image acquisition element and the first auxiliary position and the second distance between the vertical projection position and the first auxiliary position are obtained based on the distance and the deflection angle. A third distance between the wireless remote control device and the vertical projection position is obtained based on the deflection angle and the distance; and The coordinates of the operation position on the x-axis and y-axis are obtained based on the first distance, the second distance, the third distance, and the attitude information.

2. The method according to claim 1, characterized in that, The acquisition of image information from the wireless remote control device also includes: Identify the wireless remote control device in the image; and The position and shape information of the wireless remote control device in the image are obtained.

3. The method according to claim 2, characterized in that, The step of obtaining the distance and deflection angle between the wireless remote control device and the image acquisition element of the display device based on the image information includes: Get the mapping table; and The distance and the deflection angle between the wireless remote control device and the image acquisition element of the display device are obtained according to the mapping table and the image information. The mapping table includes a first ratio between the size and distance of the wireless remote control device in the image and a second ratio between the distortion and deflection angle of the wireless remote control device in the image.

4. The method according to claim 1, characterized in that, The process of obtaining the attitude information of the wireless remote control device includes: Receive the pointing angle of the wireless remote control device transmitted from the wireless remote control device; The pointing angle includes a first pointing angle of the wireless remote control device in a first direction, a second pointing angle in a second direction, and a third pointing angle in a third direction.

5. The method according to claim 4, characterized in that, The first direction is the direction of the x-axis, the second direction is the direction of the y-axis, and the third direction is the normal direction of the display interface.

6. A device for determining an operation position in a display interface, used in a display device, the display device including an image acquisition element, comprising: An acquisition module is configured to acquire image information of a wireless remote control device, including: acquiring an image of the wireless remote control device through the image acquisition element; the acquisition module is further configured to acquire attitude information of the wireless remote control device, and acquire the distance and deflection angle between the wireless remote control device and the image acquisition element of the display device based on the image information; and A determination module is used to determine the operation position based on the attitude information, the distance, and the deflection angle; The operation position is located within the display interface of the display device; The step of determining the operation position based on the attitude information, the distance, and the deflection angle includes: A coordinate system is established on the display interface with the image acquisition element as the origin; wherein the coordinate system includes an x-axis and a y-axis; Determine the vertical projection position of the wireless remote control device on the display interface; Determine a first auxiliary position where the vertical projection position is perpendicular to the x-axis; Determine a second auxiliary position perpendicular to the x-axis; and The first distance between the image acquisition element and the first auxiliary position and the second distance between the vertical projection position and the first auxiliary position are obtained based on the distance and the deflection angle. A third distance between the wireless remote control device and the vertical projection position is obtained based on the deflection angle and the distance; and The coordinates of the operation position on the x-axis and y-axis are obtained based on the first distance, the second distance, the third distance, and the attitude information.

7. A terminal, comprising: At least one memory and at least one processor; The at least one memory is used to store program code, and the at least one processor is used to call the program code stored in the at least one memory to execute the method of any one of claims 1 to 5.

8. A non-transitory storage medium for storing program code for performing the method of any one of claims 1 to 5.

Images