Projection interaction method, system, device, storage medium, and program product

Abstract

The application discloses a projection interaction method, system, device, storage medium and program product. The projection interaction method comprises the following steps: a projection unit collects a real-time image of a projection picture, and determines a control signal emitted by an optical remote control unit according to the real-time image; a position indicated by the optical remote control unit in the projection picture is determined based on invisible light signals in the control signal; coordinates of the indicated position in an optical dot matrix are determined, and a control corresponding to the coordinates in the projection picture is determined, and an operation instruction corresponding to the control is executed. In the projection interaction method provided by the application, the projection unit can directly determine the position indicated by the optical remote control unit in the projection picture according to the invisible light signals in the projection picture, so as to determine and execute the operation instruction of the control corresponding to the indicated position. Compared with the relatively limited interaction operation in the prior art, the application realizes the interaction operation with the projection picture by determining the invisible light signals, so that the flexibility of the interaction operation is improved.

Description

Technical Field

[0001] This invention belongs to the field of projection equipment technology, specifically relating to a projection interaction method, system, device, storage medium, and program product. Background Technology

[0002] Currently, control commands can typically be transmitted from a controller to a terminal that is in communication with the projector or to the projector controller to control the projector's display. Specifically, the controller can be a mouse that transmits control commands through click operations.

[0003] However, in the actual control of the projector display, in order to avoid the controller transmitting incorrect control commands (for example, the mouse making an incorrect click operation), the actual controlled object of the controller must clearly know the specific display screen of the projected screen to ensure that the transmitted control commands correspond to the controls on the projected screen. At the same time, in order to ensure the effect of the controller's command transmission, the distance between the controller and the terminal or projector controller must be less than or equal to the controller's signal transmission range. This results in relatively limited interactive operations on the projected screen.

[0004] Therefore, the poor flexibility of interactive operations on projected images in existing technologies is a problem that urgently needs to be solved. Summary of the Invention

[0005] In view of the aforementioned defects or deficiencies in the prior art, it is desirable to provide a projection interaction method, system, device, storage medium, and program product. In this projection interaction method, the projection unit can directly determine the indicated position of the optical remote control unit on the projection screen based on invisible light signals in the projection screen, and then determine and execute the operation command of the control corresponding to the indicated position. Compared with the relatively limited interaction operations in the prior art, this application achieves interaction operations with the projection screen by determining invisible light signals, thereby improving the flexibility of the interaction operation.

[0006] According to a first aspect of this application, a projection interaction method is provided. This method is applied to a projection interaction system including a projection unit and an optical remote control unit. The projection unit projects a projected image, which includes a correspondingly set visible image and an optical dot matrix. The size of the optical dot matrix is ​​greater than or equal to the size of the visible image. The method includes: The projection unit acquires real-time images of the projected screen and determines the control signal emitted by the optical remote control unit based on the real-time images. Based on the invisible light signal in the control signal, the indicated position of the optical remote control unit in the projected screen is determined. Determine the coordinates of the indicated position in the optical dot matrix, identify the control corresponding to the coordinates in the projected image, and execute the operation command corresponding to the control.

[0007] According to a second aspect of this application, a projection interaction system is provided, which includes a projection unit and an optical remote control unit: The projection unit is used to project a projected image, which includes a corresponding visible image and an optical dot matrix. The size of the optical dot matrix is ​​greater than or equal to the size of the visible image. The optical remote control unit is used to transmit control signals to the projected image; The projection unit is also used to acquire real-time images of the projected screen, determine control signals based on the real-time images, and determine the indicated position of the optical remote control unit in the projected screen based on the invisible light signals in the control signals. The projection unit is also used to determine the coordinates of the indicated position in the optical dot matrix, and to determine the control corresponding to the coordinates in the projected image, and to execute the operation instructions corresponding to the control.

[0008] According to a third aspect of this application, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, it implements the method as described in the first aspect.

[0009] According to a fourth aspect of this application, a computer-readable storage medium is provided having a computer program stored thereon, characterized in that the program, when executed by a processor, implements the method described in the first aspect.

[0010] According to a fifth aspect of this application, a computer program product is provided, which includes instructions that, when executed, perform the method described in any one of the first aspects.

[0011] Compared to the relatively limited interactive operations in existing technologies, the projection interaction method, system, device, storage medium, and program product provided in this application embodiment allow the projection unit to directly determine the indicated position of the optical remote control unit on the projected screen based on invisible light signals, thereby determining and executing the operation instructions of the control corresponding to that indicated position. By determining the invisible light signals to achieve interactive operation with the projected screen, the flexibility of the interactive operation is improved, and the implementation cost of projection interaction is reduced.

[0012] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0013] Other features, objects, and advantages of this application will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings: Figure 1This is a schematic diagram of the architecture of the projection interaction system 10 provided in the embodiments of this application; Figure 2 This is a flowchart illustrating a projection interaction method provided in an embodiment of this application; Figure 3 This is a schematic diagram of the design of the indicator graphic and optical point provided in this application; Figure 4 This is a schematic diagram of the calibration screen provided in an embodiment of this application; Figure 5 This is a flowchart illustrating another projection interaction method provided in an embodiment of this application; Figure 6 This is a schematic diagram of the structure of the computer device provided in the embodiments of this application. Detailed Implementation

[0014] The present application will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings.

[0015] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. The present application will now be described in detail with reference to the accompanying drawings and embodiments. Furthermore, the term "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. The terms "first" and "second," etc., in the specification and claims of the embodiments of this application are used to distinguish different objects, not to describe a specific order of objects.

[0016] Currently, control commands can typically be transmitted from a controller to a terminal that is in communication with the projector or to the projector controller to control the projector's display. Specifically, the controller can be a mouse that transmits control commands through click operations.

[0017] However, in the actual control of the projector display, in order to avoid the controller transmitting incorrect control commands (for example, the mouse making an incorrect click operation), the actual controlled object of the controller must clearly know the specific display screen of the projected screen to ensure that the transmitted control commands correspond to the controls on the projected screen. At the same time, in order to ensure the effect of the controller's command transmission, the distance between the controller and the terminal or projector controller must be less than or equal to the controller's signal transmission range. This results in relatively limited interactive operations on the projected screen.

[0018] Therefore, the poor flexibility of interactive operations on projected images in existing technologies is a problem that urgently needs to be solved.

[0019] Based on this, this application proposes a projection interaction method. In this method, the projection unit can determine the indicated position of the optical remote control unit in the projected image based on the invisible light signal in the projected image. Then, based on the specific coordinates of the indicated position in the optical dot matrix projected by the projection unit, the control corresponding to the indicated position is determined and executed, thereby realizing interactive operation with the projected image.

[0020] Figure 1 This is a schematic diagram of the architecture of the projection interaction system 10 provided in an embodiment of this application. Figure 1 As shown, the projection interaction system 10 may include a projection unit 11 and an optical remote control unit 12. The projection unit 11 may be a projector for projecting a projected image, and the optical remote control unit 12 may be an interactive remote control capable of transmitting control signals to the projected image.

[0021] For example, refer to Figure 1 The projected image 13 projected by the projection unit 11 may include a visible image 131 and an optical dot matrix 132, wherein the size of the optical dot matrix 132 is greater than or equal to the size of the visible image 131.

[0022] For example, the projected image 13 can be formed by the projection unit 11 projecting onto a smooth surface such as a white wall, projection screen, or projection screen.

[0023] In this embodiment of the application, by setting the size of the optical dot matrix 132 projected by the projection unit 11 to be no smaller than the size of the visible screen 131, each point in the visible screen 131 can correspond to one of the optical dots in the optical dot matrix 132, so that when the control signal of the optical remote control unit 12 indicates any position of the projected screen, the coordinates corresponding to that position can be determined.

[0024] For example, such as Figure 1 As shown, the projection unit 11 is provided with a projection component 111 and an optical camera component 112. The projection component 111 includes an image projection component 1111 and a dot matrix projection component 1112.

[0025] Specifically, the image projection component 1111 can be a display lens for projecting a visible image; the dot matrix projection component 1112 can be a dot matrix lens for projecting an optical dot matrix, such as an invisible infrared photoelectric dot matrix, and correspondingly, the dot matrix projection component 1112 is an infrared dot matrix lens; the optical camera component 112 can be a camera for capturing real-time images of the projected image, and when the optical dot matrix projection component 1112 projects an infrared dot matrix, the optical camera component 112 is, for example, an infrared camera.

[0026] Specifically, the field of view of the dot matrix projection component 1112 can be set to a field of view that can completely cover the screen projection component 1111, so that the size of the optical dot matrix 132 is greater than or equal to the size of the visible screen 131.

[0027] For example, refer to Figure 1 Along the horizontal direction of the projection unit 11, the optical camera component 112 is located to the left of the dot matrix projection component 1112, and the image projection component 1111 is located to the right of the dot matrix projection component 1112.

[0028] It should be noted that the dot matrix projection component 1112 can also be set at any position on the side of the projection unit 11 where the image projection component 1111 is set. This application does not impose specific restrictions on the specific setting positions of the projection component 111 and the optical camera component 112.

[0029] For example, refer to Figure 1 The optical remote control unit 12 is equipped with an optical control 121, a general control 122, and a signal transmission component 123.

[0030] Specifically, when the pressure sensor of the optical control 121 receives a pressure signal (i.e., the optical control 121 is pressed), a control signal can be transmitted to the projected image through the focusing light emission component 1231 in the signal emission component 123. The focusing light emission component 1231 is, for example, a laser emission component.

[0031] For example, corresponding to the design of the left and right mouse buttons in the prior art, this application can set the above-mentioned optical control 121 as a left optical control 1211 and a right optical control 1212, so as to simulate the click operation of a conventional mouse through the left optical control 1211 and the right optical control 1212.

[0032] Specifically, when the pressure sensor of the ordinary control 122 receives a pressure signal (i.e., the ordinary control 122 is pressed), a control signal can be transmitted to the projection unit 11 through the astigmatic emission component 1232 in the signal emission component 123. The astigmatic emission component 1232 is, for example, an infrared emission component capable of emitting red visible light.

[0033] For example, the control signal emitted by the astigmatic emission component 1232 can be set as a modulated infrared remote control signal so that it can be received by a specific receiving component of the projection unit 11 and demodulated into a normal remote control command for the projection unit 11, thereby avoiding interference with the control signal emitted by the focusing emission component 1231 to the projection screen.

[0034] Optionally, when the pressure sensor of the ordinary control 122 receives a pressure signal (i.e., the ordinary control 122 is pressed), it can transmit a control signal to the projection unit 11 via Bluetooth.

[0035] Figure 2 This is a flowchart illustrating a projection interaction method provided in an embodiment of this application. This projection interaction method can be applied to the aforementioned projection interaction system 10, such as... Figure 2 As shown, the method includes the following steps: Step 201: The projection unit 11 acquires the real-time image of the projection screen 13, determines the control signal emitted by the optical remote control unit 12 based on the real-time image, and determines the indicated position of the optical remote control unit 12 in the projection screen based on the invisible light signal in the control signal.

[0036] In one possible implementation, the projection unit 11 can acquire real-time images of the projected screen 13 through the optical camera component 112 to determine the control signal transmitted by the optical remote control unit 12 based on the real-time images.

[0037] For example, the control signal emitted by the optical remote control unit 12 may be a control signal emitted by the optical remote control unit 12 through the focusing emission component 1231 in response to a change in the pressure signal of the optical control 121. The control signal includes visible light signals and invisible light signals.

[0038] For example, when the focusing emission component 1231 is a laser emission component, the control signal emitted by the optical remote control unit 12 onto the projection screen 13 can be represented as a laser spot. Based on this, the projection unit 11 can determine the control signal emitted by the optical remote control unit 12 by identifying the laser spot in the real-time image.

[0039] For example, the real-time image of the projection screen 13 may include a first optical pattern formed by visible light signals on the projection screen 13 and a second optical pattern corresponding to invisible light signals on the projection screen 13.

[0040] Specifically, the first optical pattern formed by the visible light signal on the projection screen 13 may include the visible screen 131 normally projected by the screen projection component 1111 and the indicator pattern formed by the visible light in the control signal emitted by the light-concentrating emission component 1231.

[0041] For example, when the control signal is represented as a laser spot, the indicator pattern formed by the visible light in the control signal can be the pattern corresponding to the spot.

[0042] Specifically, the second optical pattern can be the optical pattern in the projection screen 13 corresponding to the invisible infrared band in the control signal.

[0043] In one possible implementation, the indicated position of the optical remote control unit 12 in the projection screen 13 can be determined based on the second optical pattern described above.

[0044] For example, the projection unit 11 can determine the location of the second optical graphic as the indicated position of the optical remote control unit 12 in the projected image.

[0045] In this embodiment, by setting the control signal emitted by the optical remote control unit 12 to include both visible light and invisible light signals, on the one hand, the indicator pattern formed by the visible light signal can make the controlled object clearly understand the control position of the projected image 13; on the other hand, based on the recognition of the optical pattern formed by the invisible light signal by the projection unit 11, the indicated position of the optical remote control unit 12 can be quickly identified without affecting the normal projection display.

[0046] Step 202: Determine the coordinates of the indicated position in the optical dot matrix 132, determine the control corresponding to the coordinates in the projection screen 13, and execute the operation command corresponding to the control.

[0047] In one possible implementation, the coordinates of the indication position in the optical dot matrix 132 can be determined based on the coordinates of the optical points (i.e., the optical points covered by the indication pattern in the projection screen 13) that overlap with the indication pattern formed by the visible light in the control signal on the projection screen 13.

[0048] For example, the coordinates of the indication position in the optical dot matrix 132 can be determined by calculating the average coordinates of the optical points set to overlap with the indication pattern.

[0049] Specifically, the coordinates of the optical points overlapping the indicator pattern can be determined based on a coordinate system pre-established in the optical dot matrix 132. For example, a coordinate system can be established in the optical dot matrix 132 based on the calibration signal emitted by the optical remote control unit 12 in the calibration screen acquired by the projection unit 11, and the coordinates of each optical point can be determined based on this coordinate system.

[0050] Alternatively, the coordinates of the indicated position in the optical dot matrix 132 can be determined based on the coordinates of the optical points in the circumference of the indicated pattern.

[0051] Specifically, when the indicator graphic does not overlap with any optical point in the optical dot matrix 132 (i.e., the indicator graphic does not cover any optical point in the projection screen 13), the coordinates of the indicator position in the optical dot matrix 132 can be determined by calculating the average coordinates of the circumferential optical points of the indicator graphic.

[0052] For example, to avoid the situation where the above-mentioned indicator graphic does not cover any optical points in the projection screen 13, the diameter of the above-mentioned indicator graphic can be set to be greater than the diameter of any optical point in the optical dot matrix 132.

[0053] For example, Figure 3 This is a schematic diagram of the design of the indicator graphic and optical point provided in this application, such as... Figure 3 As shown, the indicator pattern is represented by a circular light spot, the diameter of which is greater than 1.414 times the distance between adjacent optical points in the optical dot array 132.

[0054] In another embodiment of this application, a specific implementation method for determining the control signal emitted by the optical remote control unit 12 is also provided. For example, the aforementioned "determining the control signal emitted by the optical remote control unit 12 based on a real-time image" includes: determining the control signal emitted by the optical remote control unit 12 based on a target area of ​​the real-time image, where the target area is an area in the real-time image with a brightness higher than a preset threshold.

[0055] In this embodiment, when the optical remote control unit 12 transmits a control signal to the projection screen 13, the brightness of the visible light and invisible light in the visible screen 131, the optical dot matrix 132, and the control signal is superimposed, so that the brightness of the area where the control signal is located is higher than the brightness of other optical points in the optical dot matrix 132. Based on this, the area where the control signal is located can be determined based on the brightness of each area in the real-time image.

[0056] In one possible implementation, the projection unit 11 may further include a processing module 113. When the optical camera component 112 acquires a real-time image of the projected image 13, the processing module 113 can determine the area with a brightness higher than a preset threshold as the target area based on the brightness of each area in the real-time image, so as to determine the control signal emitted by the optical remote control unit 12 based on the target area. The processing module 113 is, for example, a system on a chip (SOC).

[0057] For example, the preset threshold can be the average brightness of the real-time image. Based on this, the processing module 113 can determine the area in the real-time image whose brightness is higher than the average brightness of the image as the target area.

[0058] Optionally, the region with the highest brightness in the real-time image can be identified as the target region.

[0059] In another embodiment of this application, a specific method for constructing the coordinate system in the optical dot matrix 132 is also provided. Exemplarily, the method further includes: the projection unit 11 projects a calibration screen, and determines the calibration signal emitted by the optical remote control unit 12 based on the real-time image of the acquired calibration screen; based on the invisible light signal in the calibration signal, determines at least one calibration position of the optical remote control unit 12 in the calibration screen; and determines the coordinates of each optical point in the optical dot matrix 132 based on the at least one calibration position.

[0060] In this embodiment of the application, when the projection unit 11 is started for the first time, the screen projection component 1111 can project a calibration screen to construct the coordinate system in the optical dot matrix 132 based on the calibration signal emitted by the optical remote control unit 12 to the calibration screen.

[0061] In one possible implementation, the calibration screen may be equipped with a calibration instruction, based on which the optical remote control unit 12 may transmit a calibration signal to the calibration screen based on the calibration instruction.

[0062] For example, calibration indicators can be set on the calibration screen in the form of calibration points. For instance, Figure 4 This is a schematic diagram of the calibration screen provided in the embodiments of this application, such as... Figure 4 As shown, the calibration screen can include five visible calibration points set at the vertex and center positions of the projected screen.

[0063] For example, the optical remote control unit 12 can transmit a calibration signal to the corresponding position of the calibration indication via the focusing emission component 1231 based on the above-mentioned calibration indication. It should be noted that the calibration signal is similar to the control signal described above, and can both be represented as a laser spot, which will not be elaborated further here.

[0064] Specifically, when the optical control 121 is set as follows Figure 1 When the left optical control 1211 and the right optical control 1212 are shown, the calibration signal can be emitted by the focusing light emission component 1231 by changing the pressure signal of the left optical control 1211 (i.e., pressing the left optical control 1211), changing the pressure signal of the right optical control 1212, or changing the pressure signals of the left optical control 1211 and the right optical control 1212 in sequence.

[0065] It should be noted that while the focusing emission component 1231 emits the calibration signal, the diffuse emission component 1232 can also emit a control signal to the projection unit 11 to determine the emission status of the calibration signal based on the control signal, thereby instructing the processing module 113 of the projection unit 11 to acquire the calibration signal and calibrate the calibration image.

[0066] For example, the projection unit 11 can generate prompts to indicate the order in which the focusing emission assembly 1231 emits calibration signals.

[0067] For example, when the calibration screen includes, for example, Figure 4 When the visible calibration point is shown, the calibration screen projected by the projection unit 11 may also include a label corresponding to each visible calibration point, so that the label forms a prompt message, thereby enabling the optical remote control unit 12 to transmit calibration signals to the corresponding visible calibration points in sequence based on the order of the labels.

[0068] Optionally, the prompts generated by the projection unit 11 can be voice prompts, which are used to indicate the calibration sequence of the visual calibration points, so that the optical remote control unit 12 can transmit calibration signals to the corresponding visual calibration points in sequence based on the voice prompts.

[0069] For example, the projection unit 11 can determine the calibration signal emitted by the optical remote control unit 12 based on the area with brightness higher than a preset threshold in the real-time image of the calibration screen, and determine at least one calibration position of the optical remote control unit 12 in the projection screen 13 based on the invisible light signal in the calibration signal.

[0070] It should be noted that since the calibration signal transmitted by the optical remote control unit 12 to the calibration screen is generated based on the calibration indication of the calibration screen, the calibration position determined by the projection unit 11 based on the calibration signal usually corresponds to the position of the calibration indication on the calibration screen.

[0071] For example, when the calibration screen includes, for example, Figure 4 When the five visible calibration points shown are set at the vertex and center positions of the projected image, the calibration position determined by the projection unit 11 based on the calibration signal can be the vertex and center positions of the visible image 131.

[0072] In this embodiment of the application, by overlapping the visible screen 131 and the optical dot matrix 132, the calibration indicator (e.g., the visible calibration point) in the calibration screen and the optical point in the optical dot matrix 132 can be scaled down or enlarged proportionally, thereby ensuring the overlap effect between the calibration position corresponding to the calibration indicator and the optical point.

[0073] In one possible implementation, the optical remote control unit 12 can establish a coordinate system in the optical dot array 132 based on the determined calibration position to determine the coordinates of each optical point in the optical dot array 132.

[0074] For example, the projection unit 11 uses any calibration position as the origin of the coordinate system to establish a two-dimensional coordinate system in the optical dot matrix 132 based on the relative positions of the remaining calibration positions and the origin of the coordinate system, thereby determining the coordinates of each optical point in the optical dot matrix 132 in the two-dimensional coordinate system; wherein, a unit length in the two-dimensional coordinate system is the interval distance between adjacent optical points.

[0075] For example, when the calibration instructions on the calibration screen are like Figure 4 As shown, the calibration position corresponding to the lower left visible calibration point can be determined as the origin of the coordinate system, the calibration position corresponding to the upper left visible calibration point can be determined as the maximum position of the y-axis in the coordinate system, and the calibration position corresponding to the lower right visible calibration point can be determined as the maximum position of the x-axis in the coordinate system, thereby completing the establishment of the coordinate system in the optical dot array 132. Based on this, the interval distance between adjacent optical points in the optical dot array 132 is taken as a unit length in the coordinate system, and the specific coordinates of each optical point are determined in turn.

[0076] It should be noted that the specific coordinates of each determined optical point can be stored in the processing module 113 so that the specific coordinates of the position indicated by the optical remote control unit 12 in the projection screen 13 can be determined based on the pre-stored optical point coordinates.

[0077] In this embodiment, before the actual use of the projection unit 11, the projection image of the projection unit 11 is calibrated by establishing a coordinate system in the optical dot matrix 132 based on at least one calibration position of the optical remote control unit 12 in the calibration screen. This avoids the interaction error that is easily caused when the projection unit 11 is tilted (i.e., the projection image of the projection unit 11 has a certain tilt angle). Secondly, by using the interval distance between adjacent optical points as the basic unit length of the coordinate system, the basic unit length can be proportionally reduced or enlarged as the projection image is reduced or enlarged, avoiding the situation of coordinate disorder caused by the change of the basic unit length in the coordinate system.

[0078] In another embodiment of this application, a specific verification operation for the control signal of the optical remote control unit 12 is also provided. For example, before performing the "determining the coordinates of the indicated position in the optical dot matrix 132" as described above, the method further includes: for each indicated position, determining the number of times the indicated position appears, and when the number of times the indicated position appears within a preset time period reaches a preset number, determining the coordinates of the indicated position in the optical dot matrix 132.

[0079] In this embodiment of the application, before determining the coordinates of the indicated position, the control signal of the optical remote control unit 12 is verified by judging the number of times the indicated position appears, thereby avoiding accidental operation of the optical remote control unit 12.

[0080] For example, for each indicated position, when the projection unit 11 determines that the number of times the indicated position appears is 1, the processing module 113 of the projection unit 11 only determines the control signal that generates the indicated position as a task interruption signal, and not an interactive operation signal for the projected screen 13.

[0081] Specifically, the occurrence of the indicated position once can correspond to the change of the pressure signal of the optical control 121 once. For example, pressing the optical control 121 once or pressing and holding the optical control 121 once both correspond to the occurrence of the indicated position once.

[0082] For example, for each indicated position, when the projection unit 11 determines that the number of times the indicated position appears is greater than 1 within a preset time period, the processing module 113 of the projection unit 11 determines the control signal that generates the indicated position as an interactive operation signal for the projected screen 13, and determines the coordinates of the indicated position in the optical dot matrix 132, so as to execute the operation instructions of the control corresponding to the coordinates.

[0083] Specifically, the occurrence of the indicated position more than once corresponds to the change of the pressure signal of the optical control 121 more than once. For example, pressing the optical control 121 twice or pressing it multiple times can correspond to the occurrence of the indicated position more than once.

[0084] In another embodiment of this application, another projection interaction method is also provided. For example, Figure 5 This is a flowchart illustrating another projection interaction method provided in an embodiment of this application. This projection interaction method can also be applied to the aforementioned projection interaction system 10, such as... Figure 5 As shown, the method includes the following steps: Step 501a: Determine the coordinates of each optical point in the optical dot array 132.

[0085] For example, by determining the coordinates of each optical point in the optical dot matrix 132, the projection display image of the projection unit 11 is calibrated.

[0086] Specifically, the projection unit 11 determines at least one calibration position of the optical remote control unit 12 in the calibration image projected by the projection unit 11 based on the invisible light signal in the calibration signal emitted by the optical remote control unit 12, and establishes a two-dimensional coordinate system in the optical dot matrix 132 based on the at least one calibration position, thereby determining the coordinates of each optical point in the optical dot matrix 132 in the two-dimensional coordinate system.

[0087] Step 502a: Store the coordinates of each optical point to the processing module 113.

[0088] Step 501b: Change the pressure signal of the optical control 121.

[0089] For example, when the pressure signal of the optical control 121 changes (i.e., the optical control 121 is pressed), a control signal can be emitted by the focusing emission component 1231 and transmitted to the projection unit 11 through the diffuse emission component 1232.

[0090] Step 502b: Determine whether the change in the pressure signal of the optical control 121 corresponds to the interactive operation signal of the projection screen 13.

[0091] For example, the projection unit 11 can determine the indicated position of the optical remote control unit 12 in the projection screen 13 based on the invisible light signal in the control signal emitted by the light-concentrating emission component 1231, and determine whether the change of the pressure signal of the optical control 121 corresponds to the interactive operation signal of the projection screen 13 by judging the number of times the indicated position appears.

[0092] Correspondingly, for each indicated position, when the projection unit 11 determines that the number of times the indicated position appears within a preset time period is greater than 1, the processing module 113 of the projection unit 11 determines the control signal that generates the indicated position as an interactive operation signal for the projected screen 13, and then executes step 503a or 503b.

[0093] Step 503a: Determine the coordinates of the indicated position in the optical dot array 132.

[0094] Step 503b: Execute the operation command corresponding to the control signal transmitted from the astigmatic emission component 1232 to the projection unit 11.

[0095] Step 504: Determine the control corresponding to the coordinates in the projected image 13 and execute the operation command corresponding to the control.

[0096] The following is for reference. Figure 6 , Figure 6 A schematic diagram of a computer device suitable for implementing embodiments of this application is shown, such as... Figure 6 As shown, the computer device 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 602 or programs loaded from storage section 608 into random access memory (RAM) 603. The RAM 603 also stores various programs and data required for the system's operating instructions. The CPU 601, ROM 602, and RAM 603 are interconnected via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0097] The following components are connected to the input / output (I / O) interface 605: an input section 606 including a keyboard, mouse, etc.; an output section 607 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the input / output (I / O) interface 605 as needed. A removable medium 611, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 610 as needed so that computer programs read from it can be installed into the storage section 608 as needed.

[0098] Specifically, according to embodiments of this application, the flowchart above refers to... Figure 2 Any of the described processes can be implemented as a computer software program. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowchart. In such an embodiment, the computer program contains program code for performing the methods shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via communication section 609, and / or installed from removable medium 611. When the computer program is executed by central processing unit (CPU) 601, it performs the functions defined in the system of this application.

[0099] It should be noted that the computer-readable medium shown in this application can be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this application, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium compatible with computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0100] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operational instructions of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two connected blocks may actually be executed substantially in parallel, or they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified functions or operational instructions, or using a combination of dedicated hardware and computer instructions.

[0101] The units or modules described in the embodiments of this application can be implemented in software or hardware. The described units or modules can also be housed in a processor; for example, a processor may be described as including a semantic extraction unit, a weight allocation unit, and a determination unit. The names of these units or modules do not necessarily constitute a limitation on the unit or module itself.

[0102] On the other hand, this application also provides a computer-readable storage medium, which may be included in the computer device described in the above embodiments, or may exist independently and not assembled into the computer device. The aforementioned computer-readable storage medium stores one or more programs that, when used by one or more processors, execute the methods described in this application. For example, it may execute... Figure 2 Each step of any of the methods shown.

[0103] This application provides a computer program product including instructions that, when executed, cause the method described in this application to be performed. For example, it can execute... Figure 2 Each step of any of the methods shown.

[0104] The above description is merely a preferred embodiment of this application and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of disclosure in this application is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the foregoing disclosed concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features with similar functions disclosed in this application.

Claims

1. A projection interaction method, characterized in that, A projection interaction system including a projection unit and an optical remote control unit, wherein the projection unit projects a projected image, the projected image including a visible image and an optical dot matrix, the size of the optical dot matrix being greater than or equal to the size of the visible image, the method comprising: The projection unit acquires real-time images of the projected screen, determines the control signal emitted by the optical remote control unit based on the real-time images, and determines the indicated position of the optical remote control unit in the projected screen based on the invisible light signal in the control signal. Determine the coordinates of the indicated position in the optical dot matrix, identify the control in the projected image corresponding to the coordinates, and execute the operation instruction corresponding to the control.

2. The projection interaction method according to claim 1, characterized in that, The step of determining the control signal emitted by the optical remote control unit based on the real-time image includes: The control signal emitted by the optical remote control unit is determined based on the target area of ​​the real-time image, wherein the target area is the region in the real-time image whose brightness is higher than a preset threshold.

3. The projection interaction method according to claim 1, characterized in that, The real-time image includes a first optical pattern formed by visible light signals on the projected screen and a second optical pattern corresponding to invisible light signals on the projected screen. The step of determining the indicated position of the optical remote control unit on the projected screen based on the invisible light signals in the control signal includes: The position indicated by the optical remote control unit in the projected image is determined based on the second optical pattern.

4. The projection interaction method according to claim 1, characterized in that, The method further includes: The projection unit projects a calibration image and determines the calibration signal emitted by the optical remote control unit based on the real-time image of the calibration image. Based on the invisible light signal in the calibration signal, it determines at least one calibration position of the optical remote control unit in the calibration image. The coordinates of each optical point in the optical array are determined based on the at least one calibration position.

5. The projection interaction method according to claim 4, characterized in that, Determining the coordinates of each optical point in the optical array based on the calibration position includes: Using any of the calibration positions as the origin, a two-dimensional coordinate system is established in the optical dot matrix based on the relative positions of the remaining calibration positions and the origin, and the coordinates of each optical point in the optical dot matrix are determined; wherein, a unit length in the two-dimensional coordinate system is the interval distance between adjacent optical points.

6. The projection interaction method according to claim 4, characterized in that, The calibration position is the vertex position and / or center position of the visible image.

7. The projection interaction method according to claim 1, characterized in that, Before determining the coordinates of the indicated position in the optical array, the method further includes: For each indicated position, the number of times the indicated position appears is determined. When the number of times the indicated position appears within a preset time period reaches a preset number, the coordinates of the indicated position in the optical dot array are determined.

8. A projection interaction system, characterized in that, The projection interaction system includes a projection unit and an optical remote control unit: The projection unit is used to project a projected image, which includes a corresponding visible image and an optical dot matrix, wherein the size of the optical dot matrix is ​​greater than or equal to the size of the visible image. The optical remote control unit is used to transmit control signals to the projected image; The projection unit is also used to acquire real-time images of the projected screen, determine the control signal based on the real-time images, and determine the indicated position of the optical remote control unit in the projected screen based on the invisible light signal in the control signal. The projection unit is further configured to determine the coordinates of the indicated position in the optical dot matrix, determine the control in the projected image corresponding to the coordinates, and execute the operation instruction corresponding to the control.

9. The projection interaction system according to claim 8, characterized in that, The projection unit is equipped with a projection component, an optical camera component, and a processing module; The projection component is used to project the projected image; The optical camera component is used to acquire real-time images of the projected screen; The processing module is used to determine the control signal based on the real-time image, and to determine the indicated position of the optical remote control unit in the projected image based on the invisible light signal in the control signal. The processing module is further configured to determine the coordinates of the indicated position in the optical dot matrix, determine the control in the projected image corresponding to the coordinates, and execute the operation instruction corresponding to the control.

10. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method as described in any one of claims 1 to 7.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1 to 7.

12. A computer program product, characterized in that, The computer program product includes instructions that, when executed, cause the method as described in any one of claims 1 to 7 to be performed.

Images