Equipment positioning method and equipment

Abstract

The invention provides an equipment positioning method and equipment. A user can perform operations such as writing and clicking on a television screen of a non-touch screen. The method comprises the following steps: a first device sends a first signal, wherein the first signal is used for determining a first position where the first device is located; a first sub-feature is determined based on a first feature of a first area on a screen of a second device where the first position is located, the area of the first sub-feature and the first area have a non-empty intersection and are smaller than that of the first area, and the first area is an area displayed on the second device based on the first position; the first area is smaller than a display screen of second equipment; the first sub-feature, the first feature and the first position are used for determining a second position, and the second position is a position with high accuracy relative to the first position.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of communication, and in particular to a device positioning method and device. BACKGROUND

[0002] The screen of a traditional TV usually uses a non-touch screen, and cannot directly perform clicking, writing and other operations on the TV screen, but only uses a remote controller. This is not very convenient for people to use various applications commonly provided by current TVs.

[0003] Therefore, how to provide a solution for efficiently writing on a TV screen becomes a problem to be solved. SUMMARY

[0004] Embodiments of the present application provide a device positioning method and device, which can position the position of a writing device on a display screen of a non-touch screen, so as to achieve the purpose of flexible writing and clicking on a non-touch screen.

[0005] To achieve the above purpose, the present application adopts the following technical solutions:

[0006] In a first aspect, a device positioning method is provided. The device positioning method comprises: sending a first signal, the first signal being used to determine a first position;

[0007] determining a first sub-feature based on a first feature of a first region where the first position is located, wherein the first sub-feature has a non-empty intersection with the first region and is smaller than the first region, the first region being a region displayed on a second device based on the first position, and the first region being smaller than a display screen of the second device;

[0008] The first sub-feature and the first feature, and the first position, are used to determine a second position, the second position being a position with higher accuracy than the first position.

[0009] In the present application, the preliminary positioning of the writing device can be achieved by the above method, and on this basis, a watermark is generated in a region near the preliminary positioning position. The writing device further determines a local watermark at the position where the writing device contacts the screen, and by comparing the local watermark and the overall watermark, the position where the writing device contacts the screen can be determined, which has higher accuracy than the preliminary positioning position.

[0010] In a possible design, the first device periodically sends the first signal, which is used to periodically determine at least one of the first position, the first region, the first feature, the first sub-feature or the second position.

[0011] In a possible design, the first device sends first movement data, the first movement data being used to update the first region together with the first position.

[0012] In one possible design, the first device sends a first signal based on determining that it is in contact with or near the second device.

[0013] In one possible design, determining that the first device is in contact with or near the second device includes:

[0014] Based on the startup of the first mode, the first module is invoked, which is used to determine contact with the second device.

[0015] In one possible design, the first mode is a handwriting function, and activating the handwriting function includes calling up drawing, entering the electronic whiteboard, and / or manually switching via a button.

[0016] In one possible design, the first region is a circle centered on the first position, or a polygon centered on the first position. The size of the first region is related to the accuracy of the first signal. When the first position is at the edge of the display screen of the second device, the first region is a portion of the circle or polygon that can be displayed.

[0017] In one possible design, the first sub-feature is obtained by the first device capturing the first feature of the first region.

[0018] In one possible design, according to the method provided by the first aspect, the first sub-feature and the first position are used to determine the second position, including: determining a first relative position based on the first sub-feature and the first feature; and determining the second position based on the first position and the first relative position.

[0019] In one possible design, according to the method provided in the first aspect, determining the first relative position includes:

[0020] The first sub-feature is compared with the first feature pre-stored or received from the second device to determine the first relative position; or, the first sub-feature is sent to the second device for the second device to compare the first sub-feature and the first feature and determine the first relative position.

[0021] In one possible design, the first signal is an ultrasonic wave, received by a microphone and transmitted through a speaker. This allows the method of this application to be implemented at a lower cost by utilizing existing television equipment.

[0022] In one possible design, the first feature and the first sub-feature are watermark patterns.

[0023] In a possible design, the method provided in the first aspect includes the following steps.

[0024] The sending module of the first device sends the first signal.

[0025] The first signal arrival time set is composed of arrival times of N+1 first signals received by the receiving module of the first device, wherein N first signals are first signals sent by N sending modules of the second device, N is a positive integer greater than 1, and 1 first signal is sent by the sending module of the first device.

[0026] The first position is determined based on the first signal arrival time set and a second signal arrival time set, wherein the second signal arrival time set is obtained by receiving the N+1 first signals by M receiving modules of the second device, and M is a positive integer.

[0027] In a possible design, the method provided in the first aspect includes determining the first position based on layouts of the sending module and the receiving module of the first device, and / or layouts of the sending module and the receiving module of the second device.

[0028] In a possible design, the method provided in the first aspect includes the following steps.

[0029] The first signal and a second signal are received, and the second signal is a radio frequency signal.

[0030] The first position is determined based on the first signal and the second signal.

[0031] In a possible design, M time differences between a sending time of the first signal and arrival times of the first signal at M receiving modules of the second device are determined based on the second signal.

[0032] M distances from the first device to the M receiving modules of the second device are determined based on the M time differences.

[0033] The first position is determined based on the M distances, and M is a positive integer.

[0034] In a possible design, the method provided in the first aspect includes the following steps.

[0035] The first position of the first device is determined based on the M distances and layouts of the M receiving modules.

[0036] In a second aspect, a device positioning method is provided. The device positioning method includes the following steps.

[0037] displaying a first feature on a first area of a display screen of a second device, the first area being determined based on the first position and being smaller than the display screen of the second device;

[0038] receiving, by the second device, information of a first sub-feature sent by the first device, determining a second position of the first device based on the first sub-feature, the first feature and the first position, wherein the first sub-feature has a non-empty intersection with the first area and is smaller than the first area, and the second position has a higher accuracy relative to the first position.

[0039] In the second aspect, the method achieves the same effects as the first aspect, and thus repeated description is omitted.

[0040] In a possible design, the method provided by the second aspect further includes,

[0041] The first signal is periodic, and the periodic first signal is used to determine at least one of the first position, the first area, the first feature or the second position.

[0042] In a possible design, the method provided by the second aspect further includes receiving first movement data, the first movement data being sent when the first device is located outside the first area.

[0043] The first area is updated based on the first movement data and the first position.

[0044] In a possible design, the first area is a circle with the first position as a center or a polygon with the first position as a center, and the size of the first area is related to the accuracy of the first signal, wherein when the first position is at an edge of the display screen of the second device, the first area is a part of the circle or the polygon that can be displayed.

[0045] In a possible design, the first sub-feature is obtained by the first device capturing the first feature at the position of the first device.

[0046] In a possible design, the method provided by the second aspect includes determining the second position of the first device based on the first sub-feature and the first position.

[0047] determining a first relative position based on the first sub-feature and the first feature;

[0048] determining the second position based on the first position and the first relative position.

[0049] In a possible design, the determining the first relative position according to the first sub-feature and the first feature comprises:

[0050] The first device stores the first feature, compares and determines the first relative position; or,

[0051] The first device sends the first sub-feature to the second device, and the second device compares the first feature and the first sub-feature, and determines the first relative position.

[0052] In a possible design, the first signal is an ultrasonic wave, which is received by a microphone and sent by a loudspeaker.

[0053] In a possible design, the first feature and the first sub-feature are watermark patterns.

[0054] In a possible design, the method provided in the second aspect comprises:

[0055] The sending module of the first device sends a first signal;

[0056] The receiving module of the first device receives a first signal arrival time set, which is composed of arrival times obtained by receiving N+1 first signals, wherein N first signals are sent by N sending modules of the second device, N is a positive integer greater than 1, and 1 first signal is sent by the sending module of the first device.

[0057] The first position is determined based on the first signal arrival time set and a second signal arrival time set, wherein the second signal arrival time set is obtained by receiving the N+1 first signals by M receiving modules of the second device, and M is a positive integer.

[0058] In a possible design, the method provided in the second aspect comprises determining the first position based on a layout of the sending module and the receiving module of the first device, and / or a layout of the sending module and the receiving module of the second device.

[0059] In a possible design, the method provided in the second aspect comprises:

[0060] The receiving module of the first device receives a first signal and a second signal, and the second signal is a radio frequency signal.

[0061] The first position is determined based on the first signal and the second signal.

[0062] In a possible design, the first position is determined based on M time differences between a sending time of the first signal and arrival times of the first signal at the M receiving modules of the second device.

[0063] determine M distances from the first device to M receiving modules of the second device based on the M time differences;

[0064] determine the first position based on the M distances, wherein M is a positive integer.

[0065] In a possible design, the method provided in the second aspect comprises the following steps.

[0066] determine the first position of the first device based on the M distances and a layout of the M receiving modules.

[0067] In a third aspect, an apparatus is provided. The apparatus is configured to perform the device positioning method in any possible implementation of the first aspect or the second aspect.

[0068] In this application, the apparatus in the third aspect can be the first device in the first aspect, or can be a chip (system) or other component or assembly arranged in the first device, or can be an apparatus containing the first device. Or the apparatus in the third aspect can be the second device in the second aspect, or can be a chip (system) or other component or assembly arranged in the second device, or can be an apparatus containing the second device.

[0069] It should be understood that the apparatus in the third aspect includes modules, units, or means corresponding to the device positioning method in any of the first aspect to the second aspect, which can be implemented by hardware, software, or by hardware executing corresponding software. The hardware or software includes one or more modules or units for performing functions involved in the device positioning method.

[0070] In a fourth aspect, an apparatus is provided. The apparatus comprises a processor configured to perform the device positioning method in any possible implementation of the first aspect or the second aspect.

[0071] In a possible design, the apparatus in the fourth aspect can further include a transceiver. The transceiver can be a transceiver circuit or an interface circuit. The transceiver can be configured for the apparatus in the fourth aspect to communicate with other apparatuses.

[0072] In a possible design, the apparatus in the fourth aspect can further include a memory. The memory can be integrated with the processor, or can be separately arranged. The memory can be configured to store a computer program and / or data related to the device positioning method in any of the first aspect to the second aspect.

[0073] In the present application, the apparatus of the fourth aspect can be the first device of the first aspect, or can be a chip (system) or other components or assemblies arranged in the first device, or can be an apparatus containing the first device. Or the apparatus of the fourth aspect can be the second device of the second aspect, or can be a chip (system) or other components or assemblies arranged in the second device, or can be an apparatus containing the second device.

[0074] In the fifth aspect, an apparatus is provided. The apparatus includes a processor coupled with a memory, and the processor is configured to execute a computer program stored in the memory, so that the apparatus performs the device positioning method of any possible implementation of the first aspect to the second aspect.

[0075] In a possible design, the apparatus of the fifth aspect further includes a transceiver. The transceiver can be a transceiver circuit or an interface circuit. The transceiver can be configured to enable the apparatus of the fifth aspect to communicate with other devices.

[0076] In the present application, the apparatus of the fifth aspect can be the first device of the first aspect, or can be a chip (system) or other components or assemblies arranged in the first device, or can be an apparatus containing the first device. Or the apparatus of the fifth aspect can be the second device of the second aspect, or can be a chip (system) or other components or assemblies arranged in the second device, or can be an apparatus containing the second device.

[0077] In the sixth aspect, an apparatus is provided, including a processor and a memory, and the memory is configured to store a computer program, and when the processor executes the computer program, the apparatus performs the device positioning method of any implementation of the first aspect to the second aspect.

[0078] In a possible design, the apparatus of the sixth aspect further includes a transceiver. The transceiver can be a transceiver circuit or an interface circuit. The transceiver can be configured to enable the apparatus of the sixth aspect to communicate with other devices.

[0079] In the present application, the apparatus of the sixth aspect can be the first device of the first aspect, or can be a chip (system) or other components or assemblies arranged in the first device, or can be an apparatus containing the first device. Or the apparatus of the sixth aspect can be the second device of the second aspect, or can be a chip (system) or other components or assemblies arranged in the second device, or can be an apparatus containing the second device.

[0080] In a seventh aspect, an apparatus is provided, including: a processor; the processor is configured to couple with a memory, and after reading a computer program in the memory, execute the device positioning method according to any one of the implementation manners of the first aspect to the second aspect.

[0081] In a possible design, the apparatus of the seventh aspect can further include a transceiver. The transceiver can be a transceiver circuit or an interface circuit. The transceiver can be configured to enable the apparatus of the seventh aspect to communicate with other apparatuses.

[0082] In this application, the apparatus of the seventh aspect can be the first device of the first aspect, or can be a chip (system) or other component or assembly arranged in the first device, or can be an apparatus including the first device. Alternatively, the apparatus of the seventh aspect can be the second device of the second aspect, or can be a chip (system) or other component or assembly arranged in the second device, or can be an apparatus including the second device.

[0083] In an eighth aspect, a device is provided, including a processor and a transceiver. The transceiver is configured to enable the device to exchange information with other devices. The processor is configured to execute program instructions, so that the device executes the device positioning method according to any one of the first aspect or the second aspect.

[0084] In a ninth aspect, a processor is provided. The processor is configured to execute the device positioning method according to any one of the implementation manners of the first aspect to the second aspect.

[0085] In a tenth aspect, a communication system is provided. The communication system includes a second device and a first device.

[0086] The first device can be configured to execute the method according to any one of the first aspect, and the second device can execute the method according to the second aspect.

[0087] In an eleventh aspect, a computer readable storage medium is provided, including: a computer program or instructions; when the computer program or instructions are run on a computer, the computer program or instructions enable the computer to execute the device positioning method according to any one of the implementation manners of the first aspect to the second aspect.

[0088] In a twelfth aspect, a computer program product is provided, including a computer program or instructions; when the computer program or instructions are run on a computer, the computer program or instructions enable the computer to execute the device positioning method according to any one of the implementation manners of the first aspect to the second aspect.

[0089] In addition, the technical effects of the third aspect to the twelfth aspect described above can refer to the technical effects of the device positioning method of the first aspect to the second aspect, which will not be described here. BRIEF DESCRIPTION OF DRAWINGS

[0090] Figure 1 An architecture diagram of a communication system provided for an embodiment of the present application is shown in the following figure.

[0091] Figure 2 An architecture diagram of a device provided for an embodiment of the present application is shown in the following figure.

[0092] Figure 3 An application scenario diagram of a device positioning method provided for an embodiment of the present application is shown in the following figure.

[0093] Figure 4 A flow diagram of a device positioning method provided for an embodiment of the present application is shown in the following figure.

[0094] Figure 5 Another flow diagram of a device positioning method provided for an embodiment of the present application is shown in the following figure.

[0095] Figure 6 Another application scenario diagram of a device positioning method provided for an embodiment of the present application is shown in the following figure.

[0096] Figure 7 A structure diagram of a device provided for an embodiment of the present application is shown in the following figure. DETAILED DESCRIPTION

[0097] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments of the present application.

[0098] The terms “include” and “have” and any variations thereof in the description of the embodiments of the present application are intended to cover the non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but optionally further includes other steps or units not listed, or optionally further includes other steps or units inherent to the process, method, product or device.

[0099] Hereinafter, the terms “first”, “second”, etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with “first”, “second”, etc. can explicitly or implicitly include one or more of the features. In the description of the present application, unless otherwise specified, the meaning of “a plurality of” is two or more.

[0100] In the embodiments of the present application, the word "exemplarily" or "for example" is used to represent an example, illustration, or description. Any embodiment or design scheme described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design schemes. In fact, the word "exemplarily" or "for example" is intended to present the relevant concept in a specific manner.

[0101] In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise specified. "And / or" in this paper is only a description of the association between the associated objects, which means that there are three relationships, for example, A and / or B, which means that there are three cases: A exists alone, A and B exist together, and B exists alone.

[0102] The traditional TV screen is different from the handheld device such as mobile phone, tablet computer and the like frequently used in life. The non-touch screen is usually used, so the input cannot be realized on the TV screen to achieve writing, clicking, drawing and the like. This is because the cost of the large-size touch screen is high. If the touch screen is applied to the household TV, the total price will be too high for the large-size screen of 65-100 inches selected by most household TVs at present, so the touch screen scheme is not suitable for the household TV at present. However, the projection and the projection curtain, another household display screen scheme, cannot realize the handwriting function by using the touch screen. However, the application scene of the large-screen TV involves many clicking operation requirements. The remote controller used by the ordinary TV cannot meet the daily use of people. If it is extended to the conference scene, the writing function is urgently needed for the TV screen at present.

[0103] In order to solve the above problems, the embodiments of the present application provide a device positioning method. In the device positioning method, a first device sends a first signal to perform preliminary positioning, and a second device determines a first position based on the first signal. Then, the second device displays a first feature in a first area, and the first device determines the relationship between the current position and the first area by comparing the first sub-feature of the current position with the first feature, so as to determine a more detailed second current position.

[0104] The architecture and business scenario described in the embodiments of the present application are used to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art can know that, with the evolution of network architecture and the appearance of new business scenarios, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.

[0105] In order to facilitate the understanding of the present application, first, the communication system shown in Figure 1 The communication system suitable for the embodiments of the present application is described in detail taking the communication system shown in the accompanying drawings as an example. Exemplarily,Figure 1 A schematic diagram of an architecture of a communication system to which a device positioning method provided by embodiments of the present application can be applied.

[0106] As shown in Figure 1 , the communication system includes a first device 101 and a second device 102.

[0107] The first device 101 and the second device 102 can transmit acoustic signals, which include ultrasonic waves, and can establish a communication connection based on radio frequency signals, such as a Bluetooth connection, a wireless fidelity (WiFi) connection, and the like. That is, the first device 101 and the second device 102 can establish a communication link to transmit signals.

[0108] The first device 101 is a device that accesses the above communication system and has acoustic wave receiving and transmitting functions, or a chip or chip system that can be provided in the device. Meanwhile, the first device 101 also has a camera for a shooting function. In addition, there is a sensor, in particular, a motion sensor, for detecting the posture and motion state of the first device 101. Exemplarily, the first device 101 can be a stylus, a touch pen, an electronic pen, a mobile phone, a remote controller, and the like.

[0109] The second device 102 is a device that accesses the above communication system and has acoustic wave receiving and / or transmitting functions, or a chip or chip system that can be provided in the device. Exemplarily, the second device 102 can be a smart television, a large-screen display, a projector screen, and the like, which have a non-touch display screen.

[0110] It can be understood that the first device 101 and the second device 102 both have acoustic wave receiving functions, and the device other than the device having the acoustic wave receiving function in the first device 101 and the second device 102 has an acoustic wave transmitting function. For example, if the first device 101 has an acoustic wave receiving function, the second device 102 has an acoustic wave transmitting function. For another example, if the second device 102 has an acoustic wave receiving function, the first device 101 has an acoustic wave transmitting function. For another example, if the first device 101 has an acoustic wave receiving function and an acoustic wave transmitting function, the second device 102 can have an acoustic wave receiving function and / or an acoustic wave transmitting function.

[0111] In some possible design schemes, the first device 101 can also have wireless transceiving functions, such as Bluetooth signal transceiving, WiFi signal transceiving, and the like.

[0112] In some possible design schemes, the second device 102 can also have wireless transceiving functions, such as Bluetooth signal transceiving, WiFi signal transceiving, and the like.

[0113] It should be understood thatFigure 1 The communication system can further include a network device and / or other devices for the sake of convenience of understanding. Figure 1 The network device and other devices are not shown in the figure.

[0114] For the sake of convenience of understanding, the structures of the first device 101 and the second device 102 related in the embodiments of the present application are exemplarily illustrated as follows. Figure 2 As shown in the figure, the device structure schematic diagram provided by the embodiments of the present application is shown.

[0115] The device 200 can include a processor 210, an internal memory 220, an antenna 201, a wireless communication module 230, an audio module 240, a loudspeaker 240A, a microphone 240B, a touch sensor 250, a display screen 260, and the like.

[0116] It can be understood that the structures exemplified in the embodiments of the present application do not constitute a specific limitation on the device 200. In some other embodiments of the present application, the device 200 can include more or fewer components than those shown in the figure, or combine some components, or split some components, or different arrangement of components. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware.

[0117] The processor 210 can include one or more processing units, for example: the processor 210 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a memory, a digital signal processor (DSP), and a baseband processor. Different processing units can be independent devices, or can be integrated into one or more processors.

[0118] The processor 210 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory can save instructions or data that the processor 210 has just used or repeatedly uses. If the processor 210 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 210, thereby improving the efficiency of the system.

[0119] It can be understood that the interface connection relationship between the modules exemplified in the embodiments of the present application is only illustrative, and does not constitute a structural limitation on the device 200. In some other embodiments of the present application, the device 200 can also use different interface connection modes in the above embodiments, or a combination of multiple interface connection modes.

[0120] The radio frequency communication function of device 200 can be implemented through antenna 201, wireless communication module 230, modem processor and baseband processor, etc.

[0121] Antenna 201 is used to transmit and receive radio frequency signals, also known as radio frequency signals.

[0122] The wireless communication module 230 can provide solutions for wireless communication applications on the device 200, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), frequency modulation (FM), near field communication (NFC), UWB, and infrared (IR) technologies. The wireless communication module 230 can be one or more devices integrating at least one communication processing module. The wireless communication module 230 receives radio frequency (RF) signals via antenna 201, performs frequency modulation and filtering of the RF signals, and sends the processed signal to processor 210. The wireless communication module 230 can also receive signals to be transmitted from processor 210, perform frequency modulation and amplification, and convert them into RF signals for radiation via antenna 201. In other words, the device 200 can receive and / or transmit RF signals through the wireless communication module 230. In this embodiment, the device 200 can transmit RF signals for other devices to determine signal strength and distance information for azimuth measurement. Alternatively, device 200 can receive radio frequency signals from other devices and, through processor 210, determine the signal strength and distance for measuring the azimuth based on the received radio frequency signals. Furthermore, device 200 can also receive and / or transmit information about the acoustic frequency band used to indicate the measuring azimuth via wireless communication module 230.

[0123] Display screen 260 is used to display images, videos, etc. For example, display screen 260 can be used to display information. Display screen 260 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, device 200 may include one or N displays 260, where N is a positive integer greater than 1.

[0124] Internal memory 220 can be used to store computer executable program code, which includes instructions. Processor 210 executes various functional applications and data processing of device 200 by running the instructions stored in internal memory 220. Internal memory 220 may include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc. The data storage area may store data created during the use of device 200 (such as audio data, phone book, etc.). In addition, internal memory 220 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0125] The device 200 can receive and transmit sound signals through an audio module 240, a speaker 240A, a microphone 240B, and an application processor.

[0126] The audio module 240 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 240 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 240 may be located in the processor 210, or some functional modules of the audio module 240 may be located in the processor 210.

[0127] The loudspeaker 240A, also known as a "speaker," is used to convert audio electrical signals into sound signals, i.e., sound wave signals. In other words, the loudspeaker 240A can be used to transmit sound wave signals. For example, the loudspeaker 240A can transmit sound wave signals used for measuring direction. Furthermore, the device 200 can also transmit information about the sound wave frequency band used to indicate the measured direction via the loudspeaker 240A.

[0128] Microphone 240B, also known as a "microphone" or "voice transducer," is used to convert sound wave signals into electrical signals. When measuring position, microphone 240B can receive sound wave signals from the environment, such as those from a display, and convert the received sound wave signals into electrical signals. For example, microphone 240B can receive sound wave signals used to measure position. Furthermore, device 200 can also receive information about the sound wave frequency band used to indicate the measurement position via microphone 240B. There can be one or more microphones 240B.

[0129] In some possible design schemes, the speaker 240A and microphone 240B can be integrated with the audio module 240.

[0130] Touch sensor 250, also known as a "touch panel," is used to detect touch operations applied to or near it. Touch sensor 250 can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 260. In some embodiments, touch sensor 250 may be disposed on the surface of device 200, in a different location than display screen 260. In other embodiments, touch sensor 250 may be disposed on display screen 260, and the touch sensor 250 and display screen 260 together form a touchscreen, also known as a "touchscreen."

[0131] The camera 270 has functions such as taking photos and videos, and is used to record image information of the surroundings.

[0132] When implementing the relevant methods provided in the embodiments of this application, the first device and the second device may include structures similar to those of device 200. It is worth noting that when the structure of device 200 is applied to the relevant functions of the second device, the display screen 260 also has the function of generating a watermark.

[0133] It should be noted that the solutions in the embodiments of this application can also be applied to other communication systems, and the corresponding names can be replaced by the names of the corresponding functions in other communication systems.

[0134] The positioning method provided in the embodiments of this application will be described in detail below with reference to the illustrations.

[0135] When the first device and the second device form a system to implement the method of the embodiments of this application, as follows: Figure 3 As shown in the figure, the first device 301 is located on the display screen 311 of the second device 302, and the first device 301 and the display screen 311 are in contact with each other. The second device 302 has at least one microphone 312 and at least one speaker 313 at the edge of the display screen 311. The speaker 311 can transmit ultrasonic signals, and the microphone 312 can receive ultrasonic signals. The display screen 311 has the function of generating a watermark 321. The watermark 321 can be of various shapes and is smaller than the area of ​​the display screen 311.

[0136] The general flow of the system is as follows: Figure 4 As shown,

[0137] First, 401, the first device initiates the handwriting trigger process. Then, 402, preliminary positioning is achieved using ultrasound to determine the approximate location of the first device. Next, 403, the second device determines the area for displaying the watermark based on this approximate location. Finally, 404, precise positioning is performed based on the watermark. With precise positioning of the first terminal, a good writing experience can be provided.

[0138] Specifically, Figure 5 This is a flowchart illustrating the positioning method provided in an embodiment of this application. This positioning method can be applied to... Figure 1 The first device and the second device interact to locate the position of the first device.

[0139] S501, the first device starts the handwriting function.

[0140] In one possible scenario, the first device determines and activates the handwriting function based on the collected information.

[0141] For example, when a user enters an electronic whiteboard, drawing mode, or launches an application with such functionality, or when a sensor detects contact between the first and second devices.

[0142] S502, Obtain the approximate first location of the first device.

[0143] For example, the first device initiates ultrasonic positioning with the second device. Ultrasonic waves are emitted using a speaker and received by a microphone. A first position is calculated using an algorithm.

[0144] In one possible scenario, there is no clock synchronization mechanism between the first and second devices. The first device activates its microphone to start recording, activates its speaker to start playback, and notifies the second device to activate its microphone and speaker. Then, the first device's speaker and the second device's two speakers, acting as ultrasonic transmitting modules, respectively send ultrasonic signals. The first device's microphone, acting as an ultrasonic receiving module, receives these three ultrasonic signals, thus obtaining the arrival time t of the ultrasonic wave emitted by the first device's speaker. 11 The arrival time t of the ultrasonic waves emitted by the two speakers of the second device 12 ,t 13 And send them to a second device, or use the time difference t 12 -t 11 ,t 13 -t 11 The signals are sent to the second device. The microphone of the second device also receives these three ultrasonic signals and obtains the arrival time t of the ultrasonic waves emitted by the speaker of the first device. 21 The arrival time t of the ultrasonic waves emitted by the two speakers of the second device 22 ,t 23 This example uses a single microphone for both the first and second devices. However, multiple microphones are possible, resulting in multiple times the arrival time values, which can lead to more accurate position calculations. The second device can then calculate the first device's position based on these arrival times. Figure 6 As shown, let d1 and d2 be the distances from the left and right speakers of the second device to the microphone of the second device, respectively, and d3 be the distance from the speaker of the first device to the microphone of the first device (not shown in the figure). Based on the measured ultrasonic arrival time, we can obtain:

[0145] D1+D3=(t 12 -t 11 )v+(t 21 -t 22 )v+d1+d3

[0146] D2+D3=(t 13 -t 11 )v+(t 21 -t 23 )v+d2+d3

[0147] Where D1 and D2 are the distances from the second device's speaker to the first device, D3 is the distance from the second device's microphone to the first device, and v is the speed of ultrasonic wave propagation. Since the coordinates of the microphone and speaker of the second device are fixed and known, the approximate coordinates of the first device on the second device's display, i.e., its first position, can be calculated using the above formula. This method is also known as two-way ranging positioning.

[0148] In one possible scenario, the first and second devices have a clock synchronization mechanism, such as through radio frequency (RF) signals (cellular wireless signals, Bluetooth, UWB, or even infrared signals). Based on this clock synchronization, the first device simultaneously sends an ultrasonic signal and notifies the second device via RF signal. Since RF signals propagate at the speed of light, the propagation time is negligible, and the second device can be assumed to know the transmission time of the ultrasonic signal. Therefore, the second device can calculate the distances between the first device and each microphone based on the time difference between the arrival and transmission times of the ultrasonic wave. Using these distances, it can determine the approximate coordinates of the first device on the second device's display, i.e., its initial position. This method is also known as one-way ranging and positioning.

[0149] S503, the second device generates a watermark centered on the first position.

[0150] For example, after obtaining the approximate coordinates of the first device, i.e., the first position, the second device generates a watermark pattern centered on the first position. The watermark pattern can be circular or polygonal. The radius of the circle or the side length of the polygon is a preset value or set according to the accuracy of the ultrasonic positioning. For example, when the accuracy is 5cm, the second device generates a 5cm circular watermark.

[0151] For example, watermarks are invisible to the human eye and enhance the user experience.

[0152] In one possible scenario, when the first position is near the edge of the second device's display screen, the circle or polygon generated by the second device may be incomplete.

[0153] S504, determine the precise second position of the first device based on the relative position of the first device on the watermark.

[0154] For example, the relative position of the first device to the watermark is determined by capturing a partial pattern of the watermark at the point of contact between the first device and the second device using the camera of the first device. The relative position (x, y) of the first device to the watermark is then determined by comparing this partial pattern with the watermark itself. r ,y r Because of the first position (x) u ,y u In this relative coordinate system, the origin (0,0) is used, thus allowing us to obtain the precise second position coordinates (x, y) of the first device. p ,y p )=(x u ,y u )+(x r ,y rAnd perform display or interactive actions at a second position on the display screen of the second device, such as leaving continuous ink patterns at a continuously changing second position as the first device continues to move, or considering a click operation as the user briefly touches and then leaves.

[0155] In one possible scenario, the first device stores a watermark pattern generated by the second device based on the first location. After the image is captured, the relative position (x) can be directly compared and calculated locally on the first device. r ,y r The first device then sends the relative position to the second device.

[0156] In one possible scenario, the first device sends the captured partial watermark pattern to the second device, which then compares and determines the relative position (x). r ,y r ).

[0157] For example, in addition to using a camera to capture a partial pattern, the first device can also use internal sensors to detect the movement of the first device on the display screen of the second device. The first device transmits the movement data collected by the sensors to the second device in real time, and the second device can then calculate and display the written ink pattern based on the first device's initial position and the real-time movement data. Here, the sensors only collect movement data in the horizontal direction relative to the display screen of the second device.

[0158] In one possible scenario, ultrasonic positioning might be time-consuming, such as when the user moves rapidly and over a large area, or moves out of the screen's range. In this case, the first device might move beyond the watermark's area, and without periodic ultrasonic positioning to refresh the watermark position, it's impossible to determine the location by capturing a partial watermark pattern. To address this, the first device's internal sensors can collect real-time movement data, identifying and recording its movement on the screen's plane. This allows the second device to refresh the watermark position in real-time based on this movement data. Because the watermark is refreshed on the screen plane, the real-time movement data doesn't need to consider movement perpendicular to the screen. This method ensures continuous tracking of the first device.

[0159] Furthermore, considering the speed of user handwriting, the first device periodically performs positioning, and the second device periodically refreshes the watermark position accordingly. This ensures continuous and accurate positioning by the first device, allowing the second device to smoothly process the writing, resulting in a better writing experience.

[0160] Regarding the specific methods for controlling the device between the various functional modules described in the above embodiments, it is understood that the functions implemented by each functional module are similar to those in the embodiments of this application, that is, they fall within the scope of the claims of this application and their equivalents.

[0161] like Figure 7 As shown, this application discloses a device, which can be the first device in the above embodiments, such as a stylus or a mobile phone. It can also be the second device in the above embodiments, such as a television, a display screen, or a projector screen. Specifically, the device may include: an audio module 701; one or more processors 702; a memory 703; a communication module 706; one or more apps (not shown); one or more computer programs 704; and may also include a display module 707. All of the above devices can be connected via one or more communication buses 705. The one or more computer programs 704 are stored in the memory 703 and configured to be executed by the one or more processors 702. The one or more computer programs 704 include instructions that can be used to execute relevant steps performed by the first device in the above embodiments, or to execute relevant steps performed by the second device in the above embodiments.

[0162] This application also provides a computer-readable storage medium, which includes a computer program (also referred to as computer instructions). When the computer program is run on a computer, it causes the computer to perform actions such as... Figure 5 The functions or steps performed by the mobile phone in the device positioning method shown.

[0163] Furthermore, embodiments of this application may also provide a computer program product, comprising: a computer program that, when run on a computer, causes the computer to perform actions such as... Figure 5 The functions or steps performed by the mobile phone in the device positioning method shown.

[0164] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0165] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0166] In the embodiments of this application, the functional units can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0167] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as flash memory, portable hard disk, read-only memory, random access memory, magnetic disk, or optical disk.

[0168] The above description is merely a specific implementation of the embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the embodiments of this application should be covered within the protection scope of the embodiments of this application. Therefore, the protection scope of the embodiments of this application should be determined by the protection scope of the claims.

Claims

1. A device positioning method characterized by, The method comprises: sending a first signal, the first signal being used to determine a first position; determining a first sub-feature based on a first feature of a first region in which the first position is located, wherein the first sub-feature has a non-empty intersection with the first region and is smaller than the first region, the first region being a region displayed on a second device based on the first position, the first region being smaller than a display screen of the second device; the first sub-feature and the first feature, and the first position, are used to determine a second position, the second position being a position with higher accuracy relative to the first position.

2. The method of claim 1, wherein, The method further comprises, periodically sending the first signal, for periodically determining at least one of the first position, the first region, the first feature, the first sub-feature, or the second position.

3. The method of claim 1, wherein, The method further comprises: sending first movement data, the first movement data being used to update the first region in combination with the first position.

4. The method of claim 1, wherein, The sending of the first signal is based on determining that the first device is in contact with or close to the second device.

5. The method of claim 4, wherein, The determination that the first device is in contact with or close to the second device comprises: based on starting a first mode, calling a first module, the first module being used to determine that the first device is in contact with the second device.

6. The method of claim 5, wherein the first mode is a handwriting function, and starting the handwriting function comprises calling a drawing function, entering an electronic whiteboard, and / or manually switching through a key.

7. The method of claim 1, wherein the first region is a circle with the first position as the center, or a polygon with the first position as the center, the size of the first region being related to the accuracy of the first signal, and wherein when the first position is at the edge of the display screen of the second device, the first region is a part of the circle or the polygon that can be displayed.

8. The method of claim 1, wherein, the first sub-feature is obtained by photographing the first feature of the first region.

9. The method of claim 1, wherein the first sub-feature, and the first position, are used to determine a second position, comprising: determining a first relative position based on the first sub-feature and the first feature; determining the second position based on the first position and the first relative position.

10. The method of claim 9, wherein the determination of the first relative position comprises: comparing the first sub-feature with the first feature that is pre-stored or received from the second device to determine the first relative position; or sending the first sub-feature to the second device, for the second device to compare the first sub-feature with the first feature and determine the first relative position.

11. The method of claim 1, wherein the first signal is an ultrasonic wave, received by a microphone and sent by a speaker.

12. The method of claim 1, wherein the first feature and the first sub-feature are a watermark pattern.

13. A device positioning method characterized by, The method comprises: receiving a first signal, and determining a first position of a first device based on the first signal; displaying a first feature in a first region, the first region being determined based on the first position and being smaller than a display screen of the second device; receiving information of a first sub-feature, determining a second position of the first device based on the first sub-feature, the first feature, and the first position, wherein the first sub-feature has a non-empty intersection with the first region and is smaller than the first region, and the second position is more accurate than the first position.

14. The method of claim 13, wherein, the method further comprises, the first signal is periodic, and the first position, the first region, the first feature, or the second position is determined based on a periodicity of the first signal.

15. The method of claim 13, wherein, the method further comprises: receiving first movement data, the first movement data being sent when the first device is in a position beyond the first region; updating the first region based on the first movement data and the first position.

16. The method of claim 13, wherein the first region is a circle with the first position as a center, or a polygon with the first position as a center, and a size of the first region is related to an accuracy of the first signal, and when the first position is at an edge of the display screen of the second device, the first region is a part of the circle or the polygon that can be displayed.

17. The method of claim 13, wherein the first sub-feature is taken by the first device in a position.

18. The method of claim 13, wherein determining the second position of the first device based on the first sub-feature and the first position comprises: determining a first relative position based on the first sub-feature and the first feature; determining the second position based on the first position and the first relative position.

19. The method of claim 18, wherein determining the first relative position based on the first sub-feature and the first feature comprises: the first device stores the first feature and compares and determines the first relative position; or the first device sends the first sub-feature to the second device, and the second device compares the first feature and the first sub-feature and determines the first relative position.

20. The method of claim 13, wherein the first signal is an ultrasonic wave, and the first signal is received by a microphone and sent by a speaker.

21. The method of claim 13, wherein the first feature and the first sub-feature are a watermark pattern.

22. An apparatus comprising: comprising: a processor coupled to a memory; the processor is configured to execute computer instructions stored in the memory to cause the apparatus to perform the method of claims 1-12 or the device positioning method of any of claims 13-21.

23. An apparatus, comprising: The device comprises a processor and a transceiver for information interaction between the device and other devices, the processor executes program instructions, so that the device executes the device positioning method as claimed in claims 1-12 or executes the device positioning method as claimed in any one of claims 13-21.

24. A communication system, characterized by The communication system comprises a second device and a first device; The first device is configured to execute the method as claimed in any one of claims 1-12, and the second device is configured to execute the method as claimed in any one of claims 13-21.

25. A computer readable storage medium, characterized in that, The computer readable storage medium comprises a computer program or instructions, which, when executed on a computer, cause the computer to execute the device positioning method as claimed in claims 1-12 or execute the device positioning method as claimed in any one of claims 13-21.

26. A computer program product, characterised in that, The computer program product comprises a computer program or instructions, which, when executed on a computer, cause the computer to execute the device positioning method as claimed in claims 1-12 or execute the device positioning method as claimed in any one of claims 13-21.

Images