A display apparatus and a control method of a display apparatus

By receiving and mapping the movement trajectory of the control device in the rectangular space to the display screen in the display device, the problems of limited remote control commands and high cost of the touch system are solved, and richer control operations are achieved.

CN116055774BActive Publication Date: 2025-10-17HISENSE VISUAL TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111261141.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-28
Publication Date
2025-10-17
Estimated Expiration
2041-10-28

AI Technical Summary

Technical Problem

Existing remote control methods for display devices have few control instructions, and the cost of configuring a touch system and a touch screen is high.

Method used

The movement trajectory of the control device in the rectangular space in the space where the display device is located is received through the Bluetooth component, and the mapping relationship is used to project it onto the display screen to execute the control instructions, thereby realizing a touch-like operation.

Benefits of technology

Without increasing costs, it provides more control command options, improving user experience and operational convenience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116055774B_ABST
    Figure CN116055774B_ABST
Patent Text Reader

Abstract

The application provides a display device and a control method of the display device, to solve the problem of less control instructions that can be realized by remote control of the display device in the related art. The display device comprises a Bluetooth component, a processor and a display screen; the Bluetooth component is configured to continuously receive a Bluetooth signal sent by a control device; the processor is configured to determine a first moving track of the control device in a configured cuboid space according to the continuously received Bluetooth signal; the cuboid space is formed by setting rules based on a first face configured by a user, the first face being one of the outer surfaces of the cuboid space, and the position of the first face in a configured space coordinate system having a mapping relationship with the position of each pixel included in the display screen in the space coordinate system; the processor is further configured to project the first moving track to the area of the display screen in the space coordinate system according to the mapping relationship to obtain a second moving track; and the control instructions corresponding to the second moving track are executed for the display interface of the display screen.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the field of Bluetooth technology, and particularly relates to a display device and a control method of the display device. BACKGROUND

[0002] Currently, the control method of the display device includes remote control and touch control. The remote control method is to realize the remote control of the display device by pressing the keys on the remote controller and the predefined indication commands of the keys. The control instructions that can be realized by the remote control method are relatively few, and only simple channel switching or volume adjustment can be performed. The touch control operation needs to configure a touch control system for the display device, and the display screen of the display device also needs to be configured as a touch screen, thereby increasing the cost of the display device. SUMMARY

[0003] Embodiments of the present application provide a display device and a control method of the display device to solve the problem that the control instructions that can be realized by the remote control of the display device are relatively few.

[0004] In a first aspect, embodiments of the present application provide a display device, comprising a Bluetooth component, a processor and a display screen.

[0005] The Bluetooth component is configured to continuously receive a Bluetooth signal sent by a control device.

[0006] The processor is configured to determine a first movement track of the control device in a configured cuboid space according to the continuously received Bluetooth signal.

[0007] The cuboid space is formed by setting rules based on a first face configured by a user, the first face is one of the outer surfaces of the cuboid space, and the position of the first face in a configured space coordinate system has a mapping relationship with the position of each pixel included in the display screen in the space coordinate system.

[0008] The first movement track is projected to the area of the display screen in the space coordinate system according to the mapping relationship to obtain a second movement track, and the control instructions corresponding to the second movement track are executed for the display interface of the display screen.

[0009] In the related art, the control instructions that can be realized by the remote control of the display device are relatively few, and the touch control of the display device needs to configure a touch control system and a touch screen for the display device, which is high in cost. The present application proposes a control method similar to touch control, obtains the movement track of the control device in a cuboid space included in the space where the display device is located, maps the movement track to the display screen of the display device according to the preconfigured mapping relationship, and determines the control instructions to be executed according to the mapping relationship between the mapped track and the control instructions, thereby realizing the control of the display device.

[0010] In some embodiments, the display screen is further configured to display the spatial coordinate system, wherein an origin of the spatial coordinate system is a reference point of the display device.

[0011] The Bluetooth component is further configured to receive a selection command sent by the control device, wherein the selection command is used to indicate at least three points selected by a user in the spatial coordinate system.

[0012] The processor is further configured to determine the first face according to the at least three points.

[0013] Based on the above scheme, the embodiments of the present application provide a method for configuring a first face of a cuboid space, which is determined based on at least three points selected by a user through a control device, i.e., the user can configure the first face according to his / her own use habits. The method for configuring the first face can meet the needs of different users.

[0014] In some embodiments, the size of the first face is in a proportional relationship with the size of the display screen.

[0015] Based on the above scheme, a movement track formed by the user on the first face through the control device can be proportionally mapped to the display screen according to a mapping relationship.

[0016] In some embodiments, when determining the first movement track of the control device in the configured cuboid space according to the continuously received Bluetooth signals, the processor is specifically configured to:

[0017] determine a plurality of position points of the control device in the cuboid space according to the continuously received Bluetooth signals;

[0018] calculate a centroid coordinate of the plurality of position points, and delete N position points farthest from the centroid coordinate among the plurality of position points;

[0019] determine the first movement track of the control device in the cuboid space according to the position points remaining after the deletion of the N position points; wherein N≥0.

[0020] In some embodiments, before determining the first movement track of the control device in the configured cuboid space according to the continuously received Bluetooth signals, the processor is further configured to:

[0021] determine that the position of the control device in the spatial coordinate system is located in an identification space, wherein the identification space shares a second face with the cuboid space, and the distance from the geometric center of the second face to the plane where the display screen is located is less than the distance from the geometric center of other outer surfaces of the identification space to the plane where the display screen is located.

[0022] Based on the above scheme, the display device can execute the corresponding control instruction according to the movement track of the control device in the cuboid space only after determining that the control device enters the cuboid space through the identification space. Compared with the cuboid space, the identification space is closer to the user, and setting the identification space can prevent the user from making a mistake.

[0023] In some embodiments, the processor, after determining that the position of the control device in the space coordinate system is located in the identification space, is further configured to:

[0024] determine a first point on the first face to which the position of the control device in the space coordinate system is projected;

[0025] The processor is further configured to determine a projection position of the first point projected to the area of the display screen in the space coordinate system according to the mapping relationship, and prompt the projection position on the display screen.

[0026] Based on the above scheme, the display device can display the position of the control device in the display screen after determining that the control device is located in the identification space, so that the user can more intuitively see the position of the control device.

[0027] In a second aspect, the embodiments of the present application provide a control method of a display device, comprising:

[0028] continuously receiving a Bluetooth signal sent by a control device;

[0029] determining a first movement track of the control device in a configured cuboid space according to the continuously received Bluetooth signal;

[0030] The cuboid space is formed by setting a rule based on a first face configured by a user, the first face is one of the outer surfaces of the cuboid space, and the position of the first face in a configured space coordinate system has a mapping relationship with the positions of each pixel included in the display screen in the space coordinate system.

[0031] projecting the first movement track to the area of the display screen in the space coordinate system according to the mapping relationship to obtain a second movement track; and executing a control instruction corresponding to the second movement track on a display interface of the display screen.

[0032] In some embodiments, the method further comprises:

[0033] displaying the space coordinate system; and the origin of the space coordinate system is a reference point of the display device.

[0034] receiving a selection command sent by the control device; the selection command is used to indicate at least three points selected by the user in the space coordinate system.

[0035] determining the first face according to the at least three points.

[0036] In some embodiments, the size of the first face is in a proportional relationship with the size of the display screen.

[0037] In some embodiments, before determining the first moving track of the control device in the configured cuboid space according to the continuously received Bluetooth signals, the method further comprises:

[0038] determining that the position of the control device in the space coordinate system is located in an identified space; the identified space shares a second face with the cuboid space, and the geometric center of the second face to the plane where the display screen is located is less than the geometric center of other outer surfaces of the identified space to the plane where the display screen is located.

[0039] In some embodiments, after determining that the position of the control device in the space coordinate system is located in an identified space, the method further comprises:

[0040] determining a first point on the first face projected by the position of the control device in the space coordinate system;

[0041] determining a projection position of the first point projected to the area of the display screen in the space coordinate system according to the mapping relationship, and prompting the projection position on the display screen.

[0042] In a third aspect, the embodiments of the present application provide a device for implementing a control method of a display device, comprising:

[0043] a transceiving unit configured to continuously receive Bluetooth signals sent by a control device;

[0044] a processing unit configured to determine a first moving track of the control device in a configured cuboid space according to the continuously received Bluetooth signals;

[0045] wherein the cuboid space is formed by setting rules based on a first face configured by a user, the first face is one of the outer surfaces of the cuboid space, and the position of the first face in a configured space coordinate system has a mapping relationship with the position of each pixel included in a display unit in the space coordinate system.

[0046] The processing unit is further configured to project the first moving track to an area of the display unit in the space coordinate system to obtain a second moving track according to the mapping relationship, and execute a control instruction corresponding to the second moving track on a display interface of the display unit.

[0047] In a fourth aspect, the embodiments of the present application further provide a computer storage medium, which stores computer program instructions. When the instructions are run on a computer, the computer is caused to execute the method as recorded in the second aspect.

[0048] The technical effects brought by any one of the implementation manners of the second aspect to the fourth aspect can refer to the technical effects brought by the corresponding implementation manners of the first aspect, which will not be described here. BRIEF DESCRIPTION OF DRAWINGS

[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0050] Figure 1 A use scenario of a display device provided by the embodiments of the present application;

[0051] Figure 2A A hardware configuration block diagram of a control device provided by the embodiments of the present application;

[0052] Figure 2B A hardware configuration block diagram of a display device provided by the embodiments of the present application;

[0053] Figure 3 A control method flow chart of a display device provided by the embodiments of the present application;

[0054] Figure 4 A schematic diagram of a first face after segmentation provided by the embodiments of the present application;

[0055] Figure 5A A display interface diagram for displaying a spatial coordinate system provided by the embodiments of the present application;

[0056] Figure 5B Another display interface diagram for displaying a spatial coordinate system provided by the embodiments of the present application;

[0057] Figure 5C A display interface diagram for displaying a first reference point provided by the embodiments of the present application;

[0058] Figure 5D A display interface diagram for determining a second reference point provided by the embodiments of the present application;

[0059] Figure 5E A display interface diagram for displaying a second reference point provided by the embodiments of the present application;

[0060] Figure 5F A schematic diagram for indicating a range of a third reference point provided for an embodiment of the present application;

[0061] Figure 5G A display interface diagram for displaying a third reference point provided for an embodiment of the present application;

[0062] Figure 5H A schematic diagram for indicating a position of a third reference point provided for an embodiment of the present application;

[0063] Figure 5I A display interface diagram for displaying a first face provided for an embodiment of the present application;

[0064] Figure 5J A schematic diagram of a cuboid space provided for an embodiment of the present application;

[0065] Figure 6A A schematic diagram of a space provided for an embodiment of the present application;

[0066] Figure 6B An interface schematic diagram for displaying a second point provided for an embodiment of the present application;

[0067] Figure 7A A display interface schematic diagram in a video playing process provided for an embodiment of the present application;

[0068] Figure 7B A display interface schematic diagram for displaying a moving track provided for an embodiment of the present application;

[0069] Figure 8 A structural schematic diagram of a device for implementing a display device control method provided for an embodiment of the present application;

[0070] Figure 9 A structural schematic diagram of a display device provided for an embodiment of the present application. DETAILED DESCRIPTION

[0071] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0072] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and in the above drawings are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0073] Figure 1 is a schematic diagram of a use scenario of the display device in embodiments. As shown in Figure 1 The display device 200 also communicates data with the server 400, and the user can control the display device 200 through the smart device 300 or the control device 100 by establishing a Bluetooth connection with the display device 200.

[0074] In some embodiments, the control device 100 can be a remote controller, and the communication between the remote controller and the display device 200 includes at least one of infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, to control the display device 200 in a wireless or wired manner. The user can control the display device 200 by at least one of a button on the remote controller, voice input, control panel input, etc.

[0075] In some embodiments, the smart device 300 can include any one of a mobile terminal, a tablet computer, a computer, a notebook computer, an augmented reality (AR) or virtual reality (VR) device, etc. In some embodiments, the smart device 300 can also be used to control the display device 200. For example, an application running on the smart device is used to control the display device 200.

[0076] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300, for example, the display device 200 can also directly receive voice instructions from the user through a voice instruction acquisition module configured inside the display device 200, or through a voice control device arranged outside the display device 200.

[0077] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 can be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various content and interaction to the display device 200. The server 400 can be a cluster, or multiple clusters, and can include one or more types of servers.

[0078] Figure 2AAn exemplary configuration block diagram of the control device 100 according to an exemplary embodiment is shown. As shown in the figure, the control device 100 includes a processor 110, a communication interface 130, a user input / output interface 140, a memory, a power supply. The control device 100 can receive the input operation instruction of the user, and convert the operation instruction into an instruction that can be recognized and responded by the display device 200, and play a role of an intermediary in the interaction between the user and the display device 200. Figure 2A

[0079] In some embodiments, the communication interface 130 is used for external communication, including at least one of a WIFI chip, a Bluetooth component, an NFC or an alternative module. The Bluetooth component includes an antenna for sending and receiving Bluetooth signals, and can also include a Bluetooth controller for receiving instructions sent by the processor 110, and the Bluetooth component can be used to send Bluetooth signals outward or receive external Bluetooth signals under the control of the processor 110. In some embodiments, the user input / output interface 140 includes at least one of a microphone, a touchpad, a sensor, a button or an alternative module.

[0080] For the convenience of description, the control device 100 will be referred to as the control device hereinafter.

[0081] Figure 2B An exemplary hardware structure schematic diagram of the display device 200 is shown. In some embodiments, the display device 200 includes: radio frequency (RF) circuit 110, memory 120, display unit 130, camera 140, sensor 150, audio circuit 160, Wireless Fidelity (Wi-Fi) module 170, processor 180, Bluetooth component 181, and power supply 190, etc.

[0082] The RF circuit 110 can be used for receiving and sending signals in the process of information transmission or call, and can receive the downlink data of the base station and hand over to the processor 180 for processing.

[0083] The memory 120 can be used to store software programs and data. The processor 180 executes various functions and data processing of the display device 200 by running the software programs or data stored in the memory 120. The memory 120 stores an operating system that enables the display device 200 to run. In this application, the memory 120 can store the operating system and various application programs, and can also store the code for executing the method of the embodiment of the application.

[0084] ​The display unit 130 can be used to receive inputted digital or character information, generate signal input related to user settings and function control of the display device 200, and specifically, the display unit 130 can include a touch screen 131 disposed on the front of the display device 200, which can collect touch operations of the user thereon or nearby, such as clicking buttons, dragging scroll boxes, etc. The display unit 130 can also be used to display information inputted by the user or provided to the user and a graphical user interface (GUI) of various menus of the display device 200. Specifically, the display unit 130 can include a display screen 132 disposed on the front of the display device 200. Among them, the display screen 132 can be configured in the form of a liquid crystal display, a light-emitting diode, etc. The display unit 130 can be used to display various graphical user interfaces in the present application.

[0085] The camera 140 can be used to capture still images or videos. Objects project optical images through a lens to a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to the processor 180 to convert into a digital image signal.

[0086] The display device 200 can also include at least one sensor 150, such as an acceleration sensor 151, a distance sensor 152, a fingerprint sensor 153, a temperature sensor 154. The display device 200 can also be configured with a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, a light sensor, a motion sensor, and other sensors.

[0087] Wi-Fi belongs to short-range wireless transmission technology, and the display device 200 can help users send and receive emails, browse web pages, and access streaming media through the Wi-Fi module 170, which provides users with wireless broadband Internet access.

[0088] The processor 180 is the control center of the display device 200, and connects various parts of the display device through various interfaces and lines, and performs various functions and processes data of the display device 200 by running or executing software programs stored in the memory 120 and calling data stored in the memory 120. The processor 180 can also integrate an application processor and a baseband processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, and the baseband processor mainly processes wireless communication. In this application, the processor 180 can run operating systems, application programs, user interface displays, touch responses, and processing methods of embodiments of the application. In addition, the processor 180 is coupled to the display unit 130.

[0089] The Bluetooth component 181 is used to interact with other Bluetooth devices with Bluetooth components through Bluetooth protocol. The Bluetooth component 181 can include multiple antennas for receiving and sending Bluetooth signals and a Bluetooth controller for receiving instructions from the processor 180. In some embodiments, if the Bluetooth signal received by the antenna includes a constant tone extension (CTE) for positioning, the Bluetooth controller can also detect the CTE included in the Bluetooth signal, obtain in-phase quadrature (IQ) data for positioning, and then send the obtained IQ data to the processor 180, so that the processor 180 can calculate the position of the device sending the Bluetooth signal according to the received IQ data. In other embodiments, the display device 200 can establish a Bluetooth connection with an electronic device (such as a remote control) also having a Bluetooth component through the Bluetooth component 181, so as to interact with data. In some embodiments, the display device 200 can establish a Bluetooth connection with a control device through the Bluetooth component to perform Bluetooth communication.

[0090] The display device 200 also includes a power supply 190 (such as a battery) for supplying power to various components. The power supply can be logically connected to the processor 180 through a power management system, so as to realize the functions of managing charging, discharging, and power consumption through the power management system. The display device 200 can also be configured with a power button for the functions of turning on and off the display device, and locking the screen.

[0091] For the convenience of description, the display device 200 will be referred to as the display device hereinafter.

[0092] In some embodiments, from a software perspective, the system of the display device can include a kernel, a shell, a file system and an application. The kernel, the shell and the file system together form a basic operating system structure, which allows a user to manage files, run programs and use the system. After power on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, runs and maintains virtual memory, scheduler, signals and inter-process communication (IPC). After the kernel starts, the shell and the user application are loaded. The application is compiled into machine code after starting, forming a process.

[0093] It should be noted that the hardware configuration of different display devices can be different, and therefore the above description is only an example. Figure 2A and Figure 2B are only exemplary descriptions.

[0094] In the related art, if a touch operation on the display device is to be implemented, a touch screen and a touch system need to be configured for the display device, resulting in a high cost of the display device. Embodiments of the present application provide a display device and a control method of the display device. The display device determines an instruction to be executed by detecting a position change trajectory of a control device in a cuboid space included in a space where the display device is located, i.e., the present application proposes a method similar to a touch operation without the need to configure a touch system and a touch screen, and more control instructions are implemented by the control device.

[0095] First, the control method of the display device proposed by the present application is introduced. The method can be executed by the display device, and the structure of the display device can be referred to the above description Figure 2B . Referring to Figure 3 , a flow chart of a control method of a display device provided by an embodiment of the present application is provided, which specifically includes:

[0096] 301, the display device receives a Bluetooth signal from the control device.

[0097] In some embodiments, the display device includes an antenna group for receiving a Bluetooth signal, and the display device can continuously receive the Bluetooth signal from the control device through the antenna group. The number of antenna groups that the display device can include can be greater than or equal to 2.

[0098] 302, the display device locates the control device according to the Bluetooth signal and obtains a movement trajectory of the control device in the configured cuboid space.

[0099] The cuboid space is a cuboid-shaped space in the space where the display device is located. The cuboid space is formed by setting rules based on a user-configured plane in advance, which is referred to as a first face in the following. The first face is one of the outer surfaces of the cuboid space. The position of the first face in the configured space coordinate system has a mapping relationship with the position of each pixel included in the display screen in the space coordinate system, and the size of the first face has a proportional relationship with the size of the display screen. In some embodiments, when establishing the correspondence between the first face and the display screen, the first face can be divided into M small squares, for example, see Figure 4 , Figure 4 The length of each small square into which the first face is divided as shown can be the positioning accuracy of Bluetooth. After the division, each small square can be corresponded to a corresponding area in the display screen. In some embodiments, the space coordinate system is configured in advance by the display device to indicate the space where the display device is located. The origin of the space coordinate system is the reference point of the display device, for example, the reference point of the display device can be the center point of the display device or the position of the antenna group in the display device.

[0100] In some embodiments, the Bluetooth signal received by the display device from the control device can include a fixed frequency extension signal CTE for positioning. The display device can locate the control device by detecting the CTE included in the Bluetooth signal, and obtain the position coordinates of the control device in the space coordinate system. In order to facilitate description, the position coordinates of the control device in the space coordinate system are referred to as the position of the control device in the following.

[0101] After determining the position of the control device, the display device can further determine whether the position of the control device is located in the cuboid space. In one possible implementation, the display device can be configured with the coordinate range of the cuboid space, such as: a < x < b, c < y < d, e < z < f. After determining the position of the control device, the display device determines whether the position satisfies the above range. If it satisfies, it can be determined that the control device is located in the cuboid space. After determining that the control device is located in the cuboid space, the display device can record the movement trajectory of the control device in the cuboid space, that is, record the change of the position of the control device over time to form the movement trajectory of the control device. In order to facilitate description, the movement trajectory of the control device in the cuboid space can be referred to as the first movement trajectory.

[0102] 303, the display device determines the control instruction to be executed according to the first movement trajectory and the current display interface of the display screen.

[0103] In some embodiments, the display device can determine the second movement track projected into the display screen according to a mapping relationship between the position of the first face in the spatial coordinate system and the position of each pixel included in the display screen in the spatial coordinate system. In order to more clearly understand the process of projecting the movement track in the cuboid space into the display screen according to the mapping relationship, a specific example is described as follows.

[0104] For example, the coordinates of a certain point of the first movement track formed by the control device in the cuboid space are (10, 20, 30), the coordinate range of the first face is: 9 < x < 15, 19 < y < 23, z = 10, and the coordinates of the point projected onto the first face are (10, 20, 10). The mapping relationship between the first face and the display screen can be x1 = x-9, y1 = y-10, z1 = z-10, where x, y, z are the coordinates on the first face, and x1, y1, z1 are the coordinates of each pixel on the display screen. Then the point (10, 20, 30) projected onto the first face is (10, 20, 10), and the coordinates of the point projected from the first face to the display screen according to the mapping relationship are (1, 10, 0). Thus, the display device can map the first movement track to the display screen to obtain the second movement track according to the above mapping method.

[0105] In some embodiments, the display device can also be configured with a corresponding relationship between the movement track on the display screen and the control instruction. For example, when a video is playing in the display screen, the movement track is 1 centimeter to the right, and the corresponding control instruction is to fast forward the playing video by 10 seconds. After determining the second movement track, the display device can determine the control instruction corresponding to the second movement track according to the preconfigured corresponding relationship between the movement track and the control instruction, and then execute the control instruction.

[0106] In the related art, in order to realize the touch screen operation of the display device, the display device needs to be configured with a touch system and a touch screen, which has a high cost. The present application proposes a touch-like control method, obtains the movement track of the control device in a cuboid space in the space where the display device is located, maps the movement track to the display screen of the display device according to the preconfigured mapping relationship, and determines the control instruction to be executed according to the mapping relationship between the mapped track and the control instruction, thereby realizing the control of the display device.

[0107] In some scenarios, the display device can first determine the position and the included range of the cuboid space before determining the control instruction to be executed according to the moving track of the control device in the cuboid space. In some embodiments, the cuboid space can be pre-configured by the user in the display device through the control device. For example, in an optional method, the user can configure different cuboid spaces for different application programs, and the display device can also store the application programs and the corresponding cuboid spaces in association. When the user opens a certain application program, the user can operate in the cuboid space corresponding to the application program through the control device to control the display device. In some other embodiments, the cuboid space can also be configured by the user before each use. The following will be specifically introduced for the above two implementation manners.

[0108] In one case, the cuboid space is configured by the user before each use, and the specific configuration process will be introduced as follows. In some embodiments, the display device can provide a display interface as shown in Figure 5A Figure 5A The display interface shown in Figure 5A includes a space coordinate system established with the reference point of the display device as the origin in the space where the display device is located. For example, the reference point of the display device is point A in Figure 5B In some other embodiments, the display device can also perform three-dimensional modeling on the space where the display device is located according to the floor plan of the space where the display device is located input by the user in advance (or the three-dimensional solid model of the space can also be directly input), and then construct the space coordinate system with the reference point of the display device as the origin in the constructed model. For example, the display interface as shown in Figure 3 can be referred to. The reference point of the display device will be introduced in the above-mentioned

[0109] In some embodiments, the display device can receive the Bluetooth signal from the control device through the antenna group, and calculate the position of the control device according to the Bluetooth signal. The position of the control device is the coordinate of the control device in the space coordinate system. After determining the position of the control device, the display device can determine the first face of the cuboid space according to the selection command received from the control device, and then form the cuboid space based on the first face according to the pre-set rule. The following will be specifically introduced for determining the first face of the cuboid space and further determining the cuboid space according to the first face.

[0110] ​In some embodiments, the control device can respond to a user operation, such as the user pressing a button, and carry a selection command in a Bluetooth signal to the display device, and the display device can determine the first face of the rectangular space in the spatial coordinate system according to the received selection command. As an optional method, the display device can receive at least three selection commands from the control device, each selection command is used to confirm a reference point, and after confirming at least three reference points, the first face is determined according to the at least three reference points. In some embodiments, in the process of determining at least three reference points according to at least three selection commands, the connecting line between the first two confirmed reference points can be used as an edge of the first face. The size of the first face is proportional to the size of the display screen. For example, the ratio of the length of the first face to the length of the display screen and the ratio of the width of the first face to the width of the display screen can be the same.

[0111] The following is a specific example of how a display device determines a reference point based on a selection command. For example, the first reference point is determined based on the first selection command among at least three selection commands. When the display device receives the first selection command from the control device, it displays the first reference point in the spatial coordinate system displayed on the display screen based on the position of the control device obtained at this time. For example, the first reference point can be a black dot. Figure 5C In the schematic diagram shown, point B is the first reference point. The coordinates of the first reference point in the spatial coordinate system displayed on the display screen are the coordinates of the control device in the actual spatial coordinate system. In some embodiments, the display device can use the above method to determine the second reference point, the third reference point, and the fourth reference point. Three reference points can determine a plane (i.e., the first surface). Of course, more reference points can also be used to determine the first surface. This application does not specifically limit the number of reference points used to determine the first surface.

[0112] The following is an example of a display device determining a first surface through three reference points. These three reference points are referred to as the first reference point, the second reference point, and the third reference point, and the selection commands for confirming these three reference points are referred to as the first selection command, the second selection command, and the third selection command, respectively. After the display device determines the first reference point (i.e., point B), the position change trajectory of the control device can be displayed on the display interface according to the user's operation of moving the control device. For example, see Figure 5D As shown in the schematic diagram, the dotted line is the movement trajectory of the control device after confirming point B. As an optional method, if the display interface shows Figure 5DThe schematic diagram shown, the length of the moving track of the control device after the confirmation of the B point can also be displayed. Of course, the display device can also not display the moving track of the control device after the confirmation of the B point. In some embodiments, the display device can determine a second reference point according to the received second selection command after the confirmation of the B point and display it in the display screen, for example, a schematic diagram as shown in FIG. 6B can be displayed. Figure 5E The schematic diagram shown, Figure 5E The C point in the schematic diagram shown is the second reference point. In some embodiments, the display device can determine a third reference point according to the received third selection command after the determination of the second reference point. In some embodiments, the third reference point can be any point on the side of the cylinder or inside the cylinder with the BC connecting line as the axis. For example, refer to the schematic diagram shown in FIG. 6C. Figure 5F The third reference point can be any point on the side of the cylinder or inside the cylinder as shown in the schematic diagram. Figure 5F The third reference point can be any point on the side of the cylinder or inside the cylinder as shown in the schematic diagram. Figure 5F The ratio of the radius of the bottom circle of the cylinder to the BC connecting line is equal to the aspect ratio of the display device, or the ratio of the radius of the bottom circle of the cylinder to the BC connecting line is equal to the width-length ratio of the display device. After the display device determines the third reference point according to the third selection command, it can be displayed in the spatial coordinate system displayed in the display screen, for example, a schematic diagram as shown in FIG. 6D can be displayed. Figure 5G The schematic diagram shown, Figure 5G The D point shown is the third reference point. Exemplarily, the determined third reference point (i.e., the D point) can be any point on the D1D2 connecting line on the side of the cylinder as shown in the schematic diagram. Figure 5F The position of the determined third reference point (i.e., the D point) in the cylinder can be seen from the schematic diagram shown in FIG. 6C. Figure 5H The point D is located on the D1D2 connecting line on the side of the cylinder as shown in the schematic diagram. Figure 5I The schematic diagram shown.

[0113] In some embodiments, after the display device determines the first face, it can generate a cuboid space based on the first face according to a pre-set rule. For example, the pre-set rule can be to select any one of the two directions perpendicular to the first face, create a second face in this direction which is the same size as the first face and parallel to the first face, and the distance between the second face and the first face can be pre-set, for example, the first face and the second face can be separated by N times the positioning accuracy of Bluetooth, where N can be greater than or equal to 2. Exemplarily, a schematic diagram of the cuboid space can be seen from the schematic diagram shown in FIG. 6E. Figure 5J , Figure 5JThe middle-long rectangle D1D2BC is the first face, and the direction perpendicular to the first face is the R direction. The rectangle D1'D2'B'C' created based on the R direction is the second face. The BB' connecting line is perpendicular to the first face and the second face.

[0114] After the display device completes the configuration of the cuboid space, the display device can store the range of the cuboid space, and then determine whether the control device is located in the cuboid space according to whether the position of the control device detected is within the range of the cuboid space. After determining that the control device is located in the cuboid space, the display device can obtain the moving track of the control device, and determine the control instruction to be executed according to the moving track.

[0115] The above describes the process of configuring the cuboid space by the display device before each use in one case.

[0116] In another case, the cuboid space can be pre-configured in the display device. For example, a cuboid space can be configured for each application. For example, in a home scenario, when a cuboid space is created for a video application, in order to facilitate the user to watch the video, the position of the cuboid space can be established at a position that is convenient for the user to operate when the user sits on the sofa. In some embodiments, the process of configuring the cuboid space can refer to the description in the above embodiments, and will not be described here. In the case of pre-configuring the cuboid space based on different applications, after determining that the user configures the cuboid space by the control device, the display device can store the cuboid space and the corresponding application in association. In this way, when the user uses the application next time, the user can go to the corresponding position to perform the corresponding operation by the control device to control the display device, and it is not necessary to configure the cuboid space before each use, thereby saving the time of the user.

[0117] After the display device responds to the operation of the user opening a certain application, the display device determines the position and the included range of the cuboid space corresponding to the application, and then detects whether the position of the control device is within the range. If yes, the display device can continue to obtain the change of the position of the control device with time (i.e., the moving track of the control device in the cuboid space) to execute the corresponding control instruction.

[0118] Exemplarily, the process of how the display device acquires the position of the control device and how the display device acquires the moving track of the control device according to the change of the position of the control device is briefly introduced. In some embodiments, the display device can receive the Bluetooth signal from the control device through at least two antenna groups included in the display device, or the Bluetooth controller included in the display device can receive the Bluetooth signal from the control device through at least two antenna groups included in the display device, then detect the CTE included in the Bluetooth signal, acquire the in-phase quadrature (IQ) data for positioning, and then send the acquired IQ data to the processor of the display device. The processor can determine the phase difference of each antenna group according to the phase value of each antenna included in the IQ data, and then determine the angle of arrival of each antenna group according to the phase difference of each antenna group. For example, taking the first antenna group included in the display device as an example, the first antenna group includes two antennas, and the angle of arrival corresponding to the first antenna group can be determined by the following formula (1):

[0119]

[0120] wherein θ is the angle of arrival corresponding to the first antenna group, is the phase difference corresponding to the first antenna group (i.e., the difference between the phase values of the two antennas included in the first antenna group), λ is the wavelength of the first broadcast signal, and d is the distance between the two antennas included in the first antenna group.

[0121] In some embodiments, the processor can further determine the angle of arrival of each antenna group, and then can determine the position of the control device according to the position of each antenna group and the angle of arrival of each antenna group. For example, taking the display device including two antenna groups (referred to as the first antenna group and the second antenna group for short) as an example, the position of the control device can be determined by the following formula (2) and formula (3):

[0122]

[0123]

[0124] wherein θ1 is the angle of arrival corresponding to the first antenna group, θ2 is the angle of arrival corresponding to the second antenna group, (x, y) is the position of the control device, (x1, y1) is the position of the first antenna group, and (x2, y2) is the position of the second antenna group.

[0125] In some scenarios, after calculating the position of the control device, the display device can also remove some position points with large errors by calculating the centroid coordinates, and then form the moving track of the control device by the remaining position points after removing the position points with large errors. In some embodiments, the display device can obtain a plurality of position points of the control device in a predetermined period of time, calculate the centroid coordinates of the plurality of position points, and remove the position points far from the centroid coordinates among the plurality of position points. For example, the display device can calculate the position of the control device once in a first set time interval, such as every 1 second. The display device can obtain 10 position points of the control device calculated in a second set time interval (longer than the first set time interval, which can be the total time of a plurality of first set time intervals), such as 10 seconds, which are (x3, y3), (x4, y4), (x5, y5), …, (x 13 , y 13 ). The display device can calculate the centroid coordinates of the 10 position points, for example, by using the following formulas (4)-(5) to calculate the centroid coordinates of the 10 position points:

[0126]

[0127]

[0128] where (x c , y c ) is the centroid coordinates of the 10 position points, m is the sum of the masses of the 10 position points, M y is the sum of the static moments of the 10 position points with respect to the y-axis, and M x is the sum of the static moments of the 10 position points with respect to the x-axis.

[0129] In some embodiments, the sum of the static moments of the 10 position points with respect to the y-axis can be calculated by using the following formula (6):

[0130]

[0131] where M y is the sum of the static moments of the 10 position points with respect to the y-axis, m i is the mass of any position point among the 10 position points, and x i is the horizontal coordinate of any position point among the 10 position points.

[0132] In some embodiments, the sum of the static moments of the 10 position points with respect to the x-axis can be calculated by using the following formula (7):

[0133]

[0134] wherein M x is the sum of the static moments of the 10 position points with respect to the x-axis, m i is the mass of any one of the 10 position points, y i is the longitudinal coordinate of any one of the 10 position points.

[0135] After the display device calculates the centroid coordinates of the 10 position points, it can calculate the distances of the 10 position points from the centroid coordinates respectively, and delete several position points farthest from the centroid coordinates. The number of deleted position points is not limited in the present application. After deletion, the display device can obtain the movement trajectory of the control device according to the remaining position points. Alternatively, the display device can take the average of the remaining position points, and then take the average result as the position of the control device in the 10 seconds.

[0136] In some other scenarios, when the display device determines the movement trajectory of the control device according to the plurality of position points of the control device, it can also use the least square method to smooth the movement trajectory of the control device. That is, the display device can determine a curve with the best fitting degree (the fitting degree refers to the degree of coincidence between the curve and the plurality of calculated position points) according to the plurality of calculated position points of the control device, and can take the curve as the movement trajectory of the control device. For example, the display device can use a curve (or a straight line) configured by a person in advance to approximate the plurality of calculated position points, so that the weighted sum of residuals of the points on the curve and the position points is minimized, so that the curve has the best fitting degree with respect to the plurality of position points. The curve is taken as the movement trajectory of the control device. The movement trajectory obtained by using this method is smoother and closer to the actual movement trajectory of the control device in space.

[0137] Due to problems such as signal noise, clock jitter, and signal propagation delay in the transmission process of the Bluetooth signal, especially in an indoor environment, problems such as signal shielding and signal reflection may also occur. These problems will cause errors in the position of the control device calculated by the display device, and will also cause deviations in the movement trajectory of the control device obtained by the display device. Based on the above scheme, by calculating the centroid coordinates of the plurality of position points in a certain time length and deleting the position points farthest from the centroid coordinates, the accuracy of the trajectory of the control device obtained by the display device can be improved. And when determining the movement trajectory, the display device can also use the least square method to smooth the movement trajectory, and determine a curve with the highest fitting degree with respect to the actually calculated position points as the movement trajectory of the control device.

[0138] In some embodiments, after configuring the cuboid space, the display device can further configure an identification space, which can share a face with the cuboid space. The size and shape of the identification space can be the same as or different from the cuboid space, and the present application does not make specific limitations on the size and shape of the identification space. In some embodiments, the face shared by the cuboid space and the identification space can be the first face that has a mapping relationship with the display screen, or can be the face in the cuboid space that is parallel to the first face. For ease of description, the face shared by the cuboid space and the identification space is referred to as the second face, and the distance from the center point of the second face to the plane where the display screen is located is less than the distance from other faces of the identification space to the plane where the display screen is located. That is, compared with the cuboid space, the identification space can be farther away from the display device and closer to the user, so as to facilitate user operation. For example, based on the cuboid space shown in Figure 5J , the schematic diagram of the identification space can be seen in Figure 6A . In Figure 6A , the cuboid L1 is the schematic diagram of the cuboid space, and the cuboid L2 is the schematic diagram of the identification space. The face shared by the cuboids L1 and L2 is the rectangle D1D2BC. Of course, the cuboids L1 and L2 can also share a face that is parallel to the rectangle D1D2BC, that is, the rectangle D1'D2'B'C', which is shown in Figure 6A .

[0139] In some scenarios, before determining whether the position of the control device is located in the cuboid space, the display device can first determine that the position of the control device is located in the identification space. It can also be understood that the display device determines whether the control device reaches the cuboid space through the identification space. In some embodiments, if the display device determines that the control device does not reach the cuboid space through the identification space, but reaches the cuboid space through other paths, the display device will not execute the corresponding control instruction according to the movement track of the control device. Thus, the problem of user misoperation is avoided.

[0140] In some embodiments, after detecting that the position of the control device is located in the identification space, the display device can further determine the coordinates of the point formed by the position of the control device in the identification space when projected onto the first face. For ease of description, the point projected onto the first face is referred to as the first point. In some embodiments, the display device can determine the projection position of the first point on the display screen according to the mapping relationship between the first face and the display screen. For ease of description, the projection position is referred to as the second point hereinafter, and the second point can also be displayed on the display screen, for example, in the form of a black dot or an arrow. For example, see Figure 6B , Figure 6BIt is shown that in the process of playing the video, the display device determines that the position of the control device is located in the identified space, and displays the second point in the form of an arrow in the current display interface.

[0141] The display device can determine whether the control device reaches the cuboid space after determining that the control device is located in the identified space, and if so, execute a corresponding control instruction according to the moving track of the control device in the cuboid space.

[0142] The control method of the display device proposed in the present application can be applied in multiple scenarios such as video playing, audio playing, or drawing, and the following will take the scenario of video playing as an example to introduce the scheme proposed in the present application.

[0143] In some embodiments, the display device can obtain the information of the position and the included range of the stored cuboid space and the identified space corresponding to the video playing scenario when playing the video. The information of the stored cuboid space can be configured before playing the video, or can be pre-configured and stored in the display device. The display device can continuously obtain the Bluetooth signal from the control device in the process of playing the video, and determine the position of the control device, i.e. the coordinates of the control device under the space coordinate system. Then the display device can determine whether the determined position of the control device is within the range included by the identified space, and if not, continue playing the video. If so, the display device can obtain the first point of the position of the control device projected onto the first face having a mapping relationship with the display screen, determine the second point of the first point projected onto the display screen according to the mapping relationship, and display the second point in the display screen with a pre-set identifier. For example, the display device can provide a display interface as shown in Figure 7A when displaying the second point, the display interface as shown in Figure 6B may be referred to. In the display interface as shown in Figure 6B the second point is displayed in the form of an arrow, but it can also be displayed in other forms, such as in the form of a black dot, which is not limited in the present application.

[0144] In some embodiments, the display device can continue to determine whether the position of the control device is located in the cuboid space after displaying the second point, i.e. determine whether the control device reaches the cuboid space from the identified space. If the display device determines that the control device reaches the cuboid space from the identified space, it can obtain the moving track of the control device in the cuboid space, and also obtain the first moving track of the moving track of the control device in the cuboid space projected onto the first face. Then according to the mapping relationship between the first face and the display screen, the second moving track of the first moving track projected onto the display screen is determined. Then the display device can determine the control instruction to be executed according to the pre-configured corresponding relationship between the moving track and the control instruction.

[0145] For example, in the video playing scenario, the pre-configured correspondence between the moving track and the control instruction includes: when the moving track is a straight line of rightward sliding, the corresponding control instruction is fast-forwarding the video by T seconds, where T has a corresponding relationship with the length of the straight line, for example, T can be a multiple of the length of the straight line.

[0146] In some other embodiments, the display device can also be configured to set a moving track as a starting instruction. For example, the starting instruction of adjusting the volume of the loudspeaker can be set to correspond to a clockwise circular ring. For example, the display device can determine that the control device is going to adjust the volume of the loudspeaker after determining that the moving track of the control device in the cuboid space mapped to the display screen is a clockwise circular ring. The display device can also display a display interface as shown in FIG. 6B in the display interface, and then further acquire the moving track of the control device in the cuboid space mapped to the display screen. If it is determined that the subsequent moving track is an upward straight line, it can be determined that the volume of the loudspeaker needs to be increased. Conversely, if the display device further acquires the moving track as a downward straight line after determining that the starting instruction of adjusting the volume is received, it can be determined that the volume of the loudspeaker needs to be decreased. Figure 7B

[0147] In some other embodiments, the display device can also combine the pre-configured correspondence between the moving track and the specific operation with various control instructions included in the specific application to determine the control instruction to be executed. For example, the display device can play the video in the form of fast-forwarding when playing the video through some current video application in response to the user's long-press operation on the display screen. In combination with the scheme proposed in the present application, the display device can determine that the corresponding specific operation is the long-press operation on the display screen when detecting that the control device is located at a certain position in the cuboid space for more than a set time length, and then the display device can determine that the control instruction to be executed is to play the video in the form of fast-forwarding in combination with the function of the video application. In some embodiments, the display device can determine the set time length in the following manner:

[0148] The display device can detect the linear velocity of the arm swing of the user using the control device as f m / s, determine the set time length T=D / f*10 ms according to the positioning accuracy of Bluetooth as D m. 3 Therefore, the display device can determine that the corresponding operation is the long-press operation on the display screen when determining that the control device is located at a certain position in the cuboid space for more than T.

[0149] ​The scheme provided in the application can also be applied to an audio playing or drawing scene. For example, a correspondence between a control instruction, such as adjusting the volume size or switching songs, and a movement track of a control device can be established in advance in the audio playing scene. Alternatively, in the drawing scene, a second movement track of a display control device on a display screen, which is projected from a first movement track of the display control device in a cuboid space, can be used as an image to be drawn.

[0150] Based on the same concept as the above method, referring to Figure 8 The embodiment of the application provides a device 800 for implementing the above control method. The device 800 can perform each step in the above method, and details are not repeated here. The device 800 comprises a transceiver unit 801, a processing unit 802 and a display unit 803.

[0151] The transceiver unit 801 is configured to continuously receive a Bluetooth signal sent by a control device.

[0152] The processing unit 802 is configured to determine a first movement track of the control device in a configured cuboid space according to the continuously received Bluetooth signal.

[0153] The cuboid space is formed based on a first face configured by a user according to a setting rule, the first face is one of outer surfaces of the cuboid space, and a position of the first face in a configured space coordinate system has a mapping relationship with positions of each pixel included in the display unit 803 in the space coordinate system.

[0154] The first movement track is projected to a region of the display unit in the space coordinate system according to the mapping relationship to obtain a second movement track, and a control instruction corresponding to the second movement track is executed for a display interface of the display unit.

[0155] In some embodiments, the display unit 803 is further configured to display the space coordinate system, and an origin of the space coordinate system is a reference point of the display device.

[0156] The transceiver unit 801 is further configured to receive a selection command sent by the control device, and the selection command is used to indicate at least three points selected by the user in the space coordinate system.

[0157] The processing unit 802 is further configured to determine the first face according to the at least three points.

[0158] In some embodiments, the size of the first face has a proportional relationship with the size of the display unit 803.

[0159] In some embodiments, the processing unit 802 is further configured to, before determining the first movement trajectory of the control device in the configured cuboid space according to the continuously received Bluetooth signals:

[0160] determine that the position of the control device in the spatial coordinate system is located in an identified space; the identified space shares a second face with the cuboid space, and the geometric center of the second face is closer to the plane on which the display unit 803 is located than the geometric centers of other outer surfaces of the identified space.

[0161] In some embodiments, the processing unit 802 is further configured to, after determining that the position of the control device in the spatial coordinate system is located in an identified space:

[0162] determine that the position of the control device in the spatial coordinate system projects to a first point on the first face;

[0163] The processing unit 802 is further configured to determine, according to the mapping relationship, a projection position of the first point projected to the area of the display unit 803 in the spatial coordinate system, and prompt the projection position on the display unit 803.

[0164] Based on the same concept as the above method, see Figure 9 The embodiments of the present application also provide a display device 900. The display device 900 can perform each step in the above method, and thus details are not repeated here. The display device 900 comprises a Bluetooth component 901, a processor 902, and a display screen 903.

[0165] The Bluetooth component 901 is configured to continuously receive Bluetooth signals sent by a control device;

[0166] The processor 902 is configured to determine a first movement trajectory of the control device in a configured cuboid space according to the continuously received Bluetooth signals.

[0167] The cuboid space is formed by setting rules based on a first face configured by a user, the first face is one of the outer surfaces of the cuboid space, and the position of the first face in a configured spatial coordinate system has a mapping relationship with the positions of each pixel included in the display screen 903 in the spatial coordinate system.

[0168] The processor 902 is further configured to project the first movement trajectory to an area of the display screen 903 in the spatial coordinate system according to the mapping relationship to obtain a second movement trajectory, and execute a control instruction corresponding to the second movement trajectory on a display interface of the display screen 903.

[0169] The embodiment of the present application further provides a computer storage medium, which stores a computer program. The program is executed by a processor or a Bluetooth controller to implement the steps of any of the above methods.

[0170] Those skilled in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction related hardware. The foregoing program can be stored in a computer readable storage medium. The program is executed to perform the steps of the above-mentioned method embodiments; and the foregoing storage medium includes ROM, RAM, magnetic disk or optical disk and various storage media that can store program codes.

[0171] Although the specific embodiments of the present application are described above, those skilled in the art should understand that these are only illustrative, and the protection scope of the present application is defined by the appended claims. Those skilled in the art can make various changes or modifications to the embodiments without departing from the principles and essence of the present application, and these changes and modifications all fall within the protection scope of the present application. Although the preferred embodiments of the present application have been described, those skilled in the art can make additional changes and modifications to the embodiments once they know the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0172] Obviously, those skilled in the art can make various modifications and variations to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application also intends to include these modifications and variations.

Claims

1. A display device, characterized in that: Includes Bluetooth components, processors and displays; The Bluetooth component is used to continuously receive Bluetooth signals sent by the control device; The processor is configured to determine a first movement trajectory of the control device in the configured rectangular parallelepiped space based on the continuously received Bluetooth signal; The rectangular space is formed by setting rules based on a first surface configured by a user, the first surface being one of the outer surfaces of the rectangular space, and a mapping relationship exists between the position of the first surface in the configured spatial coordinate system and the position of each pixel included in the display screen in the spatial coordinate system; the processor, before determining the first movement trajectory of the control device in the configured rectangular space based on the continuously received Bluetooth signal, is further used to: determine that the position of the control device in the spatial coordinate system is located in an identification space; the identification space and the rectangular space share a second surface, and the distance from the geometric center of the second surface to the plane where the display screen is located is less than the distance from the geometric center of other outer surfaces of the identification space to the plane where the display screen is located; The first movement trajectory is projected onto the area of ​​the display screen in the spatial coordinate system according to the mapping relationship to obtain a second movement trajectory; and a control instruction corresponding to the second movement trajectory is executed on the display interface of the display screen.

2. The display device according to claim 1, wherein The display screen is further configured to display the spatial coordinate system; the origin of the spatial coordinate system is a reference point of the display device; The Bluetooth component is further configured to receive a selection command sent by a control device; the selection command is configured to indicate at least three points selected by a user in the spatial coordinate system; The processor is further configured to determine the first surface based on the at least three points.

3. The display device according to claim 1 or 2, wherein: The size of the first surface is proportional to the size of the display screen.

4. The display device according to claim 1, wherein The processor, after determining that the position of the control device in the spatial coordinate system is located in the identification space, is further configured to: Determine a first point on the first surface projected with the position of the control device in the spatial coordinate system; The processor is further configured to determine a projection position of the first point projected onto an area of ​​the display screen in the spatial coordinate system according to the mapping relationship, and to indicate the projection position on the display screen.

5. A method for controlling a display device, characterized in that: include: Continuously receiving Bluetooth signals sent by the control device; determining a first movement trajectory of the control device within the configured rectangular parallelepiped space based on the continuously received Bluetooth signals; The rectangular space is formed by setting rules based on a first surface configured by a user, the first surface being one of the outer surfaces of the rectangular space, and a mapping relationship exists between the position of the first surface in the configured spatial coordinate system and the position of each pixel included in the display screen in the spatial coordinate system; before determining the first movement trajectory of the control device in the configured rectangular space based on the continuously received Bluetooth signal, the method further includes: determining that the position of the control device in the spatial coordinate system is located in an identification space; the identification space and the rectangular space share a second surface, and the distance from the geometric center of the second surface to the plane where the display screen is located is less than the distance from the geometric center of other outer surfaces of the identification space to the plane where the display screen is located; The first movement trajectory is projected onto the area of ​​the display screen in the spatial coordinate system according to the mapping relationship to obtain a second movement trajectory; and a control instruction corresponding to the second movement trajectory is executed on the display interface of the display screen.

6. The method according to claim 5, wherein The method further comprises: Displaying the spatial coordinate system; the origin of the spatial coordinate system is the reference point of the display device; receiving a selection command sent by a control device; wherein the selection command is used to indicate at least three points selected by a user in the spatial coordinate system; The first surface is determined based on the at least three points.

7. The method according to claim 5 or 6, wherein: The size of the first surface is proportional to the size of the display screen.

8. The method according to claim 5, wherein After determining that the position of the control device in the spatial coordinate system is located in the identification space, the method further includes: Determine a first point on the first surface projected with the position of the control device in the spatial coordinate system; A projection position of the first point projected onto the area of ​​the display screen in the spatial coordinate system is determined according to the mapping relationship, and the projection position is indicated on the display screen.

Citation Information

Patent Citations

  • Image display device and operation method thereof

    CN101909173A

  • Control method, system, device and equipment of smart home equipment and storage medium

    CN113341737A