Projection picture control method for projector, remote controller, projector, and projection system

Abstract

Disclosed are a projection picture control method for a projector, a remote controller, a projector, and a projection system, relating to the technical field of multimedia. The method comprises: a remote controller performs modulation coding on light emitted by a light source of the remote controller, and projects, to a projection picture of a projector, a light spot for indicating a control action on the projection picture. The projector acquires the light spot on the projection picture, projects, on the projection picture, a cursor for indicating the control action on the projection picture, and controls the projection picture on the basis of the control action. Compared with a user operating a light pen to implement projection being susceptible to natural light or environmental factors, the method provided by the present application is to capture, by means of the projector, the light spot emitted by the remote controller on the projection picture, and project a cursor onto the projection picture again on the basis of the light spot indicating control over the projection picture of the projector. Since the cursor is projected by the projector, the cursor can be visually and accurately displayed on the projection picture, and the control action can be presented on the projection picture, thereby improving the display effect of the projection picture.

Description

Projection image control method of projector, remote control, projector and projection system

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on March 27, 2024, with application number 202410374082.X and application name “Projector projection image control method, remote control, projector and projection system”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of multimedia technology, and in particular to a method for controlling a projection image of a projector, a remote controller, a projector, and a projection system. Background Art

[0003] Currently, users operate a light pen, which projects light onto the projected image, visually displaying the user's actions on the projected image (such as clicking, circling, and turning pages by pressing buttons on the light pen). However, the light emitted by the light pen is easily affected by natural light and environmental factors, especially in bright environments, resulting in poor display quality on the projected image. Summary of the Invention

[0004] The present application provides a method for controlling a projection image of a projector, a remote control, a projector, and a projection system, which solve the problem of poor display effect of the projection image.

[0005] In a first aspect, a method for controlling a projected image of a projector is provided. The method is applied to a projection system comprising a remote control and a projector. The method comprises: the remote control modulates and encodes light emitted by a light source of the remote control, and projects a light spot onto a projection image of the projector. The light spot is used to indicate a control action on the projection image of the projector. The projector captures the light spot on the projection image, projects a cursor on the projection image for indicating a control action on the projection image, and controls the projection image according to the control action.

[0006] Compared to the user operating a light pen to control the projected image, the light emitted by the light pen is easily affected by natural light or environmental factors, resulting in a poor display effect of the projected image. The projector projection image control method provided in this application obtains a light spot emitted by a remote control on the projected image through the projector. The light spot here is obtained after the remote control modulates and encodes the light. Based on the light spot, the projected image of the projector is indicated, and a cursor is projected onto the projected image again. Since the cursor on the projected image is emitted by the projector, the cursor can be displayed intuitively and accurately on the projected image, and the control action can be presented on the projected image, thereby improving the display effect of the projected image and enhancing the user's experience of interacting with the projection system.

[0007] In a possible implementation, the light emitted by the light source of the remote control includes visible light or invisible light, so as to reduce the influence of natural light or environmental factors.

[0008] In another possible implementation, the light emitted by the light source of the remote control is modulated and encoded, including: spatially modulating and encoding the spatial distribution characteristics of the light emitted by the light source of the remote control to obtain a light spot, where the spatial distribution characteristics of the light include at least one of the shape, position or size of the light.

[0009] In another possible implementation, the remote control includes an optical element; spatial modulation encoding is performed on the spatial distribution characteristics of light emitted by the light source of the remote control, including: spatial modulation encoding is performed on the spatial distribution characteristics of light emitted by the light source of the remote control after passing through the optical element included in the remote control.

[0010] In another possible implementation, the pattern of the light spot is used to indicate a manipulation action on a projection image of the projector, and the pattern of the light spot includes at least one of a cross, a circular ring, or a random shape.

[0011] The pattern of the light spot is obtained through spatial modulation encoding, and different patterns can be used to indicate different control actions. Based on the spatial distribution characteristics of the pattern-coded light formed by spatial modulation encoding, each spatial distribution characteristic of the light can be associated with a specific operation, thereby increasing the variety of operations. Different directional control actions are encoded into the light spot projected by the remote control, allowing the projector to accurately identify the operation from the remote control and eliminate interference from other light. This improves the light spot's ability to resist interference from natural light or environmental factors, and enhances the display effect of the remote control's control of the projected image.

[0012] In another possible implementation, the light emitted by the light source of the remote control is modulated and encoded, including: time-modulating and encoding the periodic variation characteristics of the light emitted by the light source of the remote control to obtain a light spot, where the periodic variation characteristics of the light include the way in which at least one of the brightness or color of the light changes over time.

[0013] In another possible implementation, the time modulation coding method includes any one of amplitude modulation, frequency modulation, frame difference, sine wave, square wave and orthogonal.

[0014] In another possible implementation, the periodic change of the light spot is used to indicate a manipulation action on the projection image of the projector.

[0015] Through time modulation coding, a periodically changing light spot can be obtained, and different periodic changes can be used to indicate different control actions. By encoding the periodic change characteristics of light according to the time modulation coding method, a periodic change characteristic of light can be made to correspond to an operation, thereby increasing the variety of operations. By encoding a variety of control actions into the light spot projected by the remote control, the projector can more easily identify the operation from the remote control based on the control action, eliminating interference from other light, improving the ability of the light spot to resist interference from natural light or environmental factors, enhancing the display effect of the remote control's control of the projected image, and ensuring the reliability of communication between the remote control and the projector.

[0016] In another possible implementation, the light spot carries manipulation information, where the manipulation information is used to indicate a manipulation action on the projection image of the projector.

[0017] The light emitted by the remote control's light source is modulated, so that the light spot projected on the projector's screen carries the control information. The projector demodulates the light spot to obtain this information, making it easier to identify the remote control's control actions and eliminating interference from other light sources. Based on the control information carried by the light spot, the projector displays the corresponding control actions on the projected screen, which helps increase the diversity and flexibility of control methods.

[0018] In another possible implementation, the manipulation action includes at least one of clicking, sliding, dragging, circling, jumping, or a mouse-triggered event.

[0019] In another possible implementation, the projector obtains the light spot on the projection screen, including: a camera included in the projector captures the light spot on the projection screen.

[0020] The configuration of the camera means that the projector is no longer limited to realizing simple display functions. The projector can sense the user's operations in real time and respond quickly. The interaction between the user and the projected image is more intelligent, which improves the user's experience of interacting with the projection system.

[0021] In another possible implementation, projecting the cursor on the projection screen includes: the projector determining the coordinates of the light spot according to the control information carried by the light spot; and projecting the cursor on the projection screen according to the coordinates of the light spot.

[0022] A cursor corresponding to the control information is projected on the projected image, allowing users to intuitively see the control of the projected image in real time. The visualization of the cursor helps users intuitively perceive the dynamic changes of the control actions when controlling the projected image via the remote control, improving the user's interactive experience with the projection system.

[0023] In another possible implementation, projecting a cursor on a projection screen includes: demodulating a light spot by a projector, and projecting the cursor on the projection screen.

[0024] In another possible implementation, the projector demodulates the light spot and projects a cursor on the projection screen, including: the projector performs feature detection on the light spot, obtains at least one of the pattern of the light spot or the periodic change of the light spot, and determines the manipulation action on the projection screen; projects the cursor on the projection screen, and manipulates the projection screen according to the manipulation action.

[0025] The pattern of the light spot or the periodic change of the light spot obtained after the projector demodulates the light spot indicates the control action on the projected image. The projector can more easily identify the control action from the remote control, eliminate the interference of other light, and control the projected image more accurately.

[0026] In another possible implementation, the projector and the remote controller are connected via at least one of wireless, infrared, and Bluetooth.

[0027] On the second aspect, a method for controlling the projection screen of a projector is provided, which is applied to a remote control. The method includes: the remote control modulates and encodes the light emitted by the light source of the remote control, and projects a light spot onto the projection screen of the projector, and the light spot is used to indicate the control action of the projection screen of the projector.

[0028] In a possible implementation, the light emitted by the light source of the remote control includes visible light or invisible light.

[0029] In another possible implementation, the light emitted by the light source of the remote control is modulated and encoded, including: spatially modulating and encoding the spatial distribution characteristics of the light emitted by the light source of the remote control to obtain a light spot, where the spatial distribution characteristics of the light include at least one of the shape, position or size of the light.

[0030] In another possible implementation, the remote control includes an optical element; spatial modulation encoding is performed on the spatial distribution characteristics of light emitted by the light source of the remote control, including: spatial modulation encoding is performed on the spatial distribution characteristics of light emitted by the light source of the remote control after passing through the optical element included in the remote control.

[0031] In another possible implementation, the pattern of the light spot is used to indicate a manipulation action on a projection image of the projector, and the pattern of the light spot includes at least one of a cross, a circular ring, or a random shape.

[0032] In another possible implementation, the light emitted by the light source of the remote control is modulated and encoded, including: time-modulating and encoding the periodic variation characteristics of the light emitted by the light source of the remote control to obtain a light spot, where the periodic variation characteristics of the light include the way in which at least one of the brightness or color of the light changes over time.

[0033] In another possible implementation, the time modulation coding method includes any one of amplitude modulation, frequency modulation, frame difference, sine wave, square wave and orthogonal.

[0034] In another possible implementation, the periodic change of the light spot is used to indicate a manipulation action on the projection image of the projector.

[0035] In another possible implementation, the light spot carries manipulation information, where the manipulation information is used to indicate a manipulation action on the projection image of the projector.

[0036] In another possible implementation, the manipulation action includes at least one of clicking, sliding, dragging, circling, jumping, or a mouse-triggered event.

[0037] On the third aspect, a method for controlling the projection screen of a projector is provided, which is applied to the projector and includes: the projector obtains a light spot on the projection screen; projects a cursor on the projection screen for indicating a control action on the projection screen, and controls the projection screen according to the control action.

[0038] In a possible implementation, the projector obtains the light spot on the projection screen, including: a camera included in the projector captures the light spot on the projection screen.

[0039] In another possible implementation, projecting the cursor on the projection screen includes: the projector determining the coordinates of the light spot according to the control information carried by the light spot; and projecting the cursor on the projection screen according to the coordinates of the light spot.

[0040] In another possible implementation, projecting a cursor on a projection screen includes: demodulating a light spot by a projector, and projecting the cursor on the projection screen.

[0041] In another possible implementation, the projector demodulates the light spot and projects a cursor on the projection screen, including: the projector performs feature detection on the light spot, obtains at least one of the pattern of the light spot or the periodic change of the light spot, and determines the manipulation action on the projection screen; projects the cursor on the projection screen, and manipulates the projection screen according to the manipulation action.

[0042] In another possible implementation, the projector and the remote controller are connected via at least one of wireless, infrared, and Bluetooth.

[0043] In a fourth aspect, a remote control is provided, comprising a light source, a modulation module, and a projection module. The modulation module is configured to modulate and encode light emitted by the remote control's light source. The projection module is configured to project a light spot onto a projection screen of a projector, the light spot being used to indicate manipulation of the projector's projection screen.

[0044] In a possible implementation, the light emitted by the light source of the remote control includes visible light or invisible light.

[0045] In another possible implementation, when the modulation module modulates and encodes the light emitted by the light source of the remote control, it is specifically used to: spatially modulate and encode the spatial distribution characteristics of the light emitted by the light source of the remote control to obtain a light spot, and the spatial distribution characteristics of the light include at least one of the shape, position or size of the light.

[0046] In another possible implementation, the remote control includes an optical element; when the modulation module performs spatial modulation encoding on the spatial distribution characteristics of the light emitted by the light source of the remote control, it is specifically used to: perform spatial modulation encoding on the spatial distribution characteristics of the light emitted by the light source of the remote control after passing through the optical element included in the remote control.

[0047] In another possible implementation, the pattern of the light spot is used to indicate a manipulation action on a projection image of the projector, and the pattern of the light spot includes at least one of a cross, a circular ring, or a random shape.

[0048] In another possible implementation, when the modulation module modulates and encodes the light emitted by the light source of the remote control, it is specifically used to: time-modulate and encode the periodic change characteristics of the light emitted by the light source of the remote control to obtain a light spot, and the periodic change characteristics of the light include at least one of the brightness or color of the light changing over time.

[0049] In another possible implementation, the time modulation coding method includes any one of amplitude modulation, frequency modulation, frame difference, sine wave, square wave and orthogonal.

[0050] In another possible implementation, the periodic change of the light spot is used to indicate a manipulation action on the projection image of the projector.

[0051] In another possible implementation, the light spot carries manipulation information, where the manipulation information is used to indicate a manipulation action on the projection image of the projector.

[0052] In another possible implementation, the manipulation action includes at least one of clicking, sliding, dragging, circling, jumping, or a mouse-triggered event.

[0053] In a fifth aspect, a projector is provided, comprising a camera, a demodulation module, and a projection module. The camera is configured to capture a light spot on a projected image. The demodulation module is configured to demodulate the light spot. The projection module is configured to project a cursor on the projected image for indicating a manipulation action on the projected image, and to manipulate the projected image based on the manipulation information.

[0054] In a possible implementation, when the camera acquires the light spot on the projection screen, it is specifically configured as follows: the camera included in the projector acquires the light spot on the projection screen.

[0055] In another possible implementation, when the projection module projects the cursor on the projection screen, it is specifically configured to: determine the coordinates of the light spot according to the control information carried by the light spot; and project the cursor on the projection screen according to the coordinates of the light spot.

[0056] In another possible implementation, when the projection module projects the light spot on the projection screen, it is specifically configured to: after the demodulation module demodulates the light spot, the projection module projects a cursor on the projection screen.

[0057] In another possible implementation, after the demodulation module demodulates the light spot, when the projection module projects the cursor on the projection screen, it is specifically used to: the demodulation module performs feature detection on the light spot, obtains at least one of the pattern of the light spot or the periodic change of the light spot, and determines the manipulation action on the projection screen; the projection module projects the cursor on the projection screen, and manipulates the projection screen according to the manipulation action.

[0058] In another possible implementation, the projector and the remote controller are connected via at least one of wireless, infrared, and Bluetooth.

[0059] In a sixth aspect, a projection system is provided, which includes a remote control and a projector, the remote control is used to execute the operating steps of the projector projection screen control method in the possible implementation method related to the remote control in the first aspect; the projector is used to execute the operating steps of the projector projection screen control method in the possible implementation method related to the projector in the first aspect.

[0060] In the seventh aspect, a remote control is provided, which includes a light source and a processor, and the processor is used to modulate the light emitted by the light source to execute the operating steps of the projector projection image control method in the second aspect or any possible implementation of the second aspect.

[0061] In an eighth aspect, a projector is provided, which includes a camera, a memory and a processor, the camera being used to obtain a light spot on a projection screen, and the memory being used to store a set of computer instructions; when the processor executes a set of computer instructions, the operating steps of the method for controlling the projection screen of the projector in the third aspect or any possible implementation of the third aspect are executed.

[0062] In a ninth aspect, a computer-readable storage medium is provided, comprising: computer software instructions; when the computer software instructions are run on a remote control, the remote control executes the operating steps of the method for controlling the projection image of a projector as in the second aspect or any possible implementation of the second aspect; or, when the computer software instructions are run on a projector, the projector executes the operating steps of the method for controlling the projection image of a projector as in the third aspect or any possible implementation of the third aspect.

[0063] In the tenth aspect, a computer program product is provided. When the computer program product is run on a remote control, the remote control executes the operating steps of the projector projection screen control method in the second aspect or any possible implementation of the second aspect; or, when the computer software instructions are run on a projector, the projector executes the operating steps of the projector projection screen control method in the third aspect or any possible implementation of the third aspect.

[0064] The technical effects brought about by any design method in the second to tenth aspects can be referred to the technical effects brought about by the first aspect or different design methods in the first aspect, and will not be repeated here.

[0065] Based on the implementation methods provided in the above aspects, this application can also be further combined to provide more implementation methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] FIG1 is a schematic diagram of a television scene provided by the prior art for realizing a “Telepathic Pointing” function;

[0067] FIG2 is a schematic diagram of a UWB positioning principle provided by the prior art;

[0068] FIG3 is a schematic diagram of a projector equipped with a CIS according to the prior art;

[0069] FIG4 is a schematic diagram of a laser pointer provided in the prior art;

[0070] FIG5 is a schematic structural diagram of a projection system provided by the present application;

[0071] FIG6 is a flow chart of a method for controlling a projection image of a projector provided in the present application;

[0072] FIG7 is a schematic diagram of a light spot pattern obtained based on spatial modulation coding provided by the present application;

[0073] FIG8 is a schematic diagram of a method provided by the present application for enabling a light spot to carry control information based on time modulation coding;

[0074] FIG9 is a schematic diagram of a remote control device provided by the present application;

[0075] FIG10 is a schematic diagram of a projector provided by the present application;

[0076] FIG11 is a schematic structural diagram of a remote control provided by the present application;

[0077] FIG12 is a schematic structural diagram of a projector provided in this application. DETAILED DESCRIPTION

[0078] To make the description of the following embodiments clear and concise, the terms involved in this application are first briefly introduced:

[0079] A projector, also known as a projector, is used to magnify and display images or videos and project them onto a screen, wall, or other flat surface. Due to their large projection screen, compact footprint, and low radiation levels, projectors are widely used in office meetings, home entertainment, and educational training. The working principle of a projector is to focus a light source through a lens system and project it onto a screen. The display is achieved using an image sensor or reflection technology, converting the image or video signal into visual information.

[0080] Large-screen products can include televisions and projectors, etc. The ways for users to interact with large-screen products include buttons, remote controls, voice, specific gestures, etc. In order to improve the user experience and increase the accuracy and flexibility of the control method, currently, in TV scenarios, the smart screen can be "air-touched" by using the "Lingxi Pointing" remote control. Figure 1 is a schematic diagram of the implementation of the "Lingxi Pointing" function in a TV scenario provided by the prior art. As shown in Figure 1, the user can open the application by moving the remote control to point to the location of an application displayed on the smart screen. The operation is simple, fast and sensitive.

[0081] The "Lingxi Pointing" feature is based on ultra-wideband (UWB) wireless carrier communication technology. UWB positioning devices are installed in the TV and projector, respectively—for example, a UWB receiver in the TV and a UWB transmitter in the remote control—and are combined with an inertial measurement unit (IMU) to achieve mutual positioning.

[0082] Figure 2 is a schematic diagram of a UWB technology positioning principle provided by the prior art. As shown in Figure 2, four positioning base stations (Anchor0, Anchor01, Anchor2 and Anchor3) with known coordinate positions are arranged in the TV, and the remote control carries a positioning tag (Tag). The positioning tag transmits pulses at a frequency to maintain distance measurement with the four base stations with known positions, obtains the coordinate position of the positioning tag, and thereby determines the position on the TV screen that the remote control is pointing to.

[0083] While UWB-related components can be installed in televisions, projectors are not easily installed because the projected image is located on a screen or a solid surface. Currently, complementary metal oxide semiconductor image sensors (CMOS Image Sensors, CIS) are installed in projectors. Figure 3 shows a schematic diagram of a projector equipped with a CIS, as provided by prior art. The CIS can be used to implement functions such as autofocus and keystone correction to ensure a clear and properly shaped projected image.

[0084] In projector usage scenarios such as office meetings or teaching presentations, a light pen (such as a laser pen) is often used to indicate the location of the presentation content and turn pages in the presentation. Figure 4 is a schematic diagram of a laser pen provided by the prior art. As shown in Figure 4, the user presses the "point" button set on the laser pen to trigger the laser pen to emit a laser spot to indicate the current location. The user presses the "up and down page turning buttons" set on the laser pen to trigger the laser pen to turn pages in the presentation.

[0085] Currently, users operate a light pen, which projects light onto the projector's screen, visually displaying the user's actions on the projected screen (such as clicking, circling, and turning pages). However, the light emitted by the light pen is easily affected by natural light or environmental factors. This is especially true in bright environments, where natural light is brighter than the light emitted by the light pen, resulting in a low anti-interference ability of the light pen, which can lead to poor display quality on the projected screen.

[0086] To address the problem of poor display quality when a user manipulates a projected image using a light pen, as the light emitted by the light pen is easily affected by natural light or environmental factors, this application provides a method for manipulating a projected image of a projector. The method comprises: a remote control modulating and encoding light emitted by a light source of the remote control, and projecting a light spot onto the projected image of the projector, where the light spot is used to indicate manipulation of the projected image of the projector. The projector obtains the light spot on the projected image, projects a cursor on the projected image to indicate manipulation of the projected image, and manipulates the projected image according to the manipulation.

[0087] The projector's projection screen control method provided in this application uses a projector to capture a light spot emitted by a remote control on the projection screen. The light spot is obtained by modulating and encoding light on the remote control. Based on the light spot, the projector's projection screen is controlled, and a cursor is projected onto the projection screen. Because the cursor on the projection screen is emitted by the projector, the cursor can be displayed intuitively and accurately on the projection screen, and the control action can be presented on the projection screen, thereby improving the display quality of the projection screen and enhancing the user's interactive experience with the projection system.

[0088] The following describes in detail the method for controlling the projection image of the projector provided by this application with reference to the accompanying drawings.

[0089] FIG5 is a schematic diagram of the structure of a projection system provided by the present application. As shown in FIG5 , the projection system 500 includes a remote control 510 and a projector 520 .

[0090] The remote control 510 may include a light source, optical elements, and a processor.

[0091] The light source is a light-emitting device on the remote control, which is used to emit light signals. The light source can be a light-emitting diode (LED) or other light-emitting elements.

[0092] Optical components are imaging devices in remote controls, altering the direction of light emitted by the remote's light source. These include, but are not limited to, lenses (convex and concave), prisms, reflectors, gratings, and filters. They can be used to adjust the spatial characteristics of light, such as its direction, position, shape, and size.

[0093] The processor is used to perform spatial modulation coding and temporal modulation coding on the light emitted by the light source, so that the remote control projects a light spot on the projected screen of the projector for indicating the control action of the projected screen. The specific implementation method of the modulation coding provided in the embodiment of the present application can be referred to the description in the subsequent method steps.

[0094] The projector 520 may include a camera, a projection optical engine, and a processor.

[0095] Among them, the camera is used to collect the light spot modulated by the remote control on the projection screen, so that the projector can obtain the light spot projected by the remote control in real time to facilitate subsequent processing of the light spot.

[0096] Projectors are used for optical projection to generate projection images. By controlling the intensity of light, they project documents, images, or videos onto a screen, wall, or other projection surface.

[0097] The processor is used to demodulate the light spot collected by the camera, project a cursor on the projection screen, and manipulate the projection screen. The specific implementation method of the demodulation provided in the embodiment of the present application can refer to the description in the subsequent method steps.

[0098] In some embodiments, the connection between the remote control 510 and the projector 520 in the projection system 500 includes at least one of wireless, infrared, or Bluetooth. The choice of these connection methods can depend on the specific application scenario and user needs. Wireless connections offer greater flexibility, allowing users to move freely over a relatively large area. Infrared connections offer greater stability and are suitable for home entertainment. Bluetooth connections provide reliable communication over relatively short distances and are suitable for office meetings. The most appropriate connection method can be selected based on actual needs to ensure the stability and reliability of the projection system.

[0099] Next, in conjunction with Figures 6 to 8, the projector projection screen control method provided by the present application is described in detail. Figure 6 is a flow chart of a method for controlling the projector projection screen provided by the present application. Here, the remote control 520 in the projection system 500 shown in Figure 5 controls the projection screen of the projector 510 as an example for explanation. As shown in (a), (b) and (c) in Figure 6, the projector projection screen control method may include the following steps.

[0100] Step 610: The remote controller modulates and encodes the light emitted by the remote controller's light source, and projects a light spot onto the projection screen of the projector.

[0101] The light emitted by the remote control's light source can include visible light or invisible light. Visible light refers to electromagnetic waves that the human visual system can perceive, and may include sunlight and lighting. Invisible light refers to electromagnetic waves that the human visual system cannot directly perceive, and may include radio waves, microwaves, infrared rays, ultraviolet rays, and X-rays.

[0102] In some embodiments, after the light emitted by the light source of the remote control is modulated and encoded, the light spot projected by the remote control onto the projection screen of the projector can be used to indicate the control action on the projection screen.

[0103] For example, the shape, position, size, brightness and color of the encoded light are used to indicate different control actions for controlling the projection screen, thereby improving the control types of the projection screen.

[0104] For example, by encoding features such as light shape, position, size, brightness, and color, a light spot is generated that carries control information. This control information is used to indicate the control actions of the projected image. Different control information can indicate different control actions, thus increasing the types of control of the projected image.

[0105] Exemplarily, the manipulation action may include but is not limited to at least one of clicking, sliding, dragging, circling, jumping or a mouse-triggered event, where the mouse-triggered event includes but is not limited to at least one of single-clicking, double-clicking, moving and scrolling.

[0106] A tap is a touch on an area of ​​the projected image, similar to a mouse click. For example, a tap is commonly used to select menu items and open applications.

[0107] Sliding can be used to move a certain area displayed on the projected image vertically or horizontally. For example, sliding is often used to browse long web pages and switch screen content.

[0108] Dragging involves pressing and holding an area on the projected image and moving it to a new location. For example, dragging is often used to arrange the order of applications and adjust the location of applications.

[0109] Circle selection allows you to select an area on the projected image and zoom in or out on the content within it. For example, circle selection is often used to enlarge text and adjust the size of images.

[0110] Jump selection can be to select at least one area displayed on the projection screen at one time. For example, jump selection is usually used to highlight key content.

[0111] In some embodiments, the remote controller modulates the light emitted by the coding light source in a manner that includes at least one of spatial modulation coding and temporal modulation coding. The specific methods of spatial modulation coding and temporal modulation coding are described below in steps 611 and 612, respectively.

[0112] Step 611: spatially modulate and encode the light emitted by the light source of the remote control to obtain a light spot.

[0113] Spatial modulation coding can be performed by modulating and coding the spatial distribution characteristics of light emitted by a light source. The spatial distribution characteristics of light can be the distribution characteristics of light in space, including at least one of the shape, position, or size of the light.

[0114] For example, by adjusting the spatial distribution characteristics of light, such as shape, position or size, different spatial distribution characteristics are encoded into different manipulation actions, so that the pattern of the light spot obtained after encoding is used to indicate the manipulation action on the projection screen.

[0115] Another example is encoding features like light shape, position, or size so that the light spot carries control information, indicating the control actions on the projected image. By encoding different directional control information into the light spot projected by the remote control on the projected image, the projector can accurately identify the remote control operation and display the corresponding control action on the projected image.

[0116] In some embodiments, the remote control may include an optical element for realizing a light diffraction function. The light emitted by the light source may be diffracted by the optical element included in the remote control. By dispersing, focusing, refracting, and reflecting the light, a spatial distribution characteristic of the light may be formed, that is, light of different shapes, positions, or sizes in space. The remote control may perform spatial modulation encoding on the spatial distribution characteristics of the light emitted by the light source after passing through the optical element included in the remote control. After spatial modulation encoding, the spatial distribution characteristics of the light may be reflected in the form of a light spot pattern. The light spot pattern is used to indicate the manipulation action of the projected image. The light spot pattern includes at least one of a cross, a circular ring, or a random shape.

[0117] FIG7 is a schematic diagram of a light spot pattern obtained based on spatial modulation coding provided by the present application. Different light spot patterns can be used to indicate different manipulation actions.

[0118] For example, as shown in FIG7 (a), a circular light spot and a cross light spot superimposed together can represent a movement type operation, such as a sliding operation, a dragging operation, a wheel operation in a mouse trigger event, or a movement operation.

[0119] For another example, as shown in FIG7( b ), a central light spot is located in a square frame, which may represent a jump selection operation.

[0120] For another example, as shown in (c) of FIG7 , a central light spot may represent a tap operation, a single-click operation in a mouse-triggered event, or a double-click operation.

[0121] For example, as shown in Figure 7 (d), multiple light spots converge with the central spot as the focal point, forming a clustered light spot, which can represent a circle selection operation. The circled area is the range formed by the aggregation of multiple light spots, enabling area selection or annotation on the projected image, such as circling a specific area within a group of images.

[0122] It should be noted that the above examples do not limit the correspondence between the pattern of the light spot and the control action after the light emitted by the light source is spatially modulated and encoded. Any pattern of the light spot obtained after spatial modulation and encoding can be used to indicate any control action.

[0123] Step 612: Time-modulate and encode the light emitted by the light source of the remote control to obtain a light spot.

[0124] Temporal modulation coding can be performed on the temporal variation characteristics of light emitted by a light source. The temporal variation characteristics of light can be periodic variation characteristics of light, including the temporal variation of at least one of the brightness or color of the light.

[0125] For example, by adjusting the periodic flashing mode such as the brightness or color of the light, different periodic flashing modes are encoded with different manipulation actions, so that the periodic changes of the light spot obtained after encoding are used to indicate the manipulation action on the projection picture.

[0126] For example, encoding is performed on the periodic flashing pattern of light brightness or color, so that the light spot carries control information to indicate the control action of the projected image. By adjusting the periodic flashing pattern of light brightness or color, different control information can be encoded.

[0127] By adjusting the periodic flickering pattern of light, such as brightness or color, for example, by varying the brightness (e.g., alternating on-off) and / or color (e.g., alternating red-green), various time-dependent control information is encoded into the light spot projected onto the image. Since the flickering frequency of other light sources cannot match the encoded information carried by the time-modulated light spot, the projector can ignore interference from other light sources, accurately identify the remote control's actions, and present the corresponding control information on the projected image.

[0128] In some embodiments, the remote control can perform time modulation encoding on the periodic variation characteristics of the light emitted by the light source. Time modulation encoding methods include any of amplitude modulation, frequency modulation, frame difference, sine wave, square wave, and orthogonal modulation. By using different time coding modulation methods, the way the light changes over time can be adjusted. For example, amplitude modulation can adjust the periodic flickering of the light's brightness, while frequency modulation can adjust the periodic flickering of the light's color, so that the light spot carries different control information.

[0129] FIG8 is a schematic diagram of a method provided by the present application for enabling a light spot to carry control information based on time modulation coding. Different time modulation coding methods can be used to indicate different control actions.

[0130] As shown in Figure 8 (a), Amplitude Shift Keying (ASK) is a modulation method that uses a digital signal to control the time-varying amplitude of a light wave. This modulation modulates the light wave's amplitude to change the periodic flickering pattern of the light's brightness. When a binary digital signal is used to encode light brightness, 1 can represent on, and 0 can represent off. This encoding can be mapped to mouse trigger events. For example, "on" can represent a single click, "on, on" can represent a double click, "on, off, on, off" can alternately represent movement, and "on, on, off, off" can alternately represent a scroll wheel.

[0131] The examples provided above do not limit the correspondence between the brightness of the light and the operation. For example, in the example in Figure 8, the binary digital signal "10110" indicates that the periodic flashing pattern of the brightness of the light is "on, off, on, on, off", which can represent any of the mouse trigger events: single-click, double-click, move, and scroll wheel.

[0132] As shown in Figure 8(b), frequency shift keying (FSK) is a modulation method that uses digital signals to control the time-varying frequency of light waves. By adjusting the light wave frequency, the color of the light changes periodically. When a binary digital signal is used to encode the color of light, 1 can represent red, and 0 can represent green. This encoding can be mapped to mouse trigger events. For example, "red" can represent a single click, "green" can represent a double click, and "red, green, red, green" can alternately represent movement, while "red, red, green, green" can alternately represent a scroll wheel.

[0133] The examples provided above do not limit the correspondence between light colors and operations. For example, in the example shown in Figure 8, the binary digital signal "10110" indicates that the light color flashes in a periodic manner of "red, green, red, red, green", and can also represent any of the mouse trigger events: single-click, double-click, move, and scroll wheel.

[0134] ASK and FSK can also be used to transmit text input information. By setting different binary signal patterns, each signal pattern can correspond to a letter or a number. For example, the binary digital signal "10000" can represent the letter "A," "11000" can represent the letter "B," and so on. The remote control can also use the coded light brightness or color flashing cycle to make the light spot carry input text information.

[0135] In some embodiments, the remote control can perform spatial modulation encoding and temporal modulation encoding on the light emitted by the light source, that is, combine the modulation and coding methods described in steps 611 and 612 above to encode richer control information into the light spot. For example, a circular light spot and a cross-shaped light spot are superimposed together, and the superimposed light spot flashes alternately on and off, which can represent the encoding of control information for sliding operations by moving the mouse, indicating a sliding operation on the projected image. Based on the control information, the projector can more easily identify the control actions from the remote control, eliminate interference from other light, improve the ability of the light spot to resist interference from natural light or environmental factors, and ensure the reliability of communication between the remote control and the projector.

[0136] Step 620: The projector obtains a light spot on the projection screen, projects a cursor on the projection screen, and controls the projection screen according to the control action.

[0137] The projector can have a built-in camera or be connected to an external camera to collect visible and invisible light. After the remote control projects a light spot onto the projector's screen, the projector uses the camera to continuously capture the light spot displayed on the projected screen. This allows the projector to obtain the light spot projected by the remote control on the projected screen in real time through the camera, facilitating subsequent processing of the light spot.

[0138] For example, the camera collects the periodic changes of the light spot over a period of time, such as the periodic flickering of brightness or color, so that the projector can demodulate the light spot after time modulation encoding.

[0139] In some embodiments, the configuration of the camera enables the projector to no longer be limited to realizing simple display functions. The projector can sense the user's operations in real time and respond quickly. The interaction between the user and the projected image is more intelligent, improving the user's experience of interacting with the projection system.

[0140] After the projector acquires the light spot, it can demodulate the light spot. Demodulation can refer to the process of identifying the remote control's manipulation of the projected image based on the light spot, and can be considered the inverse process of modulation. Based on the modulation methods including spatial modulation coding and temporal modulation coding, the projector can demodulate the light spot based on the spatial modulation coding and / or temporal modulation coding, perform feature detection on the light spot, and determine the manipulation of the projected image based on the features of the light spot. Alternatively, the light spot can be demodulated based on the spatial modulation coding and / or temporal modulation coding, and the manipulation information carried by the light spot can be first determined, and the manipulation of the projected image can be determined based on the manipulation information. The cursor is then projected on the projected image, and the projected image is manipulated based on the manipulation action.

[0141] If the light spot doesn't carry any control information, the projector's processor performs feature detection on the light spot. When the remote control performs spatial modulation encoding on the light, it detects the light spot's pattern, including its position, shape, and size, and its center point to determine its center. Because the projector stores the correspondence between light spot patterns and control actions, it compares the shape, size, and position of the light spot, matching the detected spatial distribution characteristics of the light spot with those stored in the projector. This correspondence determines the corresponding control action.

[0142] When the remote control performs time-modulated encoding on the light, the projector's processor decodes the waveform and spectrum of the time-modulated pattern, detects the periodic changes in the brightness and color of the light spot, and then detects the center of the light spot to determine its center. Because the projector stores the correspondence between the periodic changes in the light spot and the control information, it compares the periodic flickering pattern of the light spot's brightness and color, matches the detected periodic changes in the light spot with the stored periodic change characteristics of the light spot, and determines the corresponding control action based on this correspondence.

[0143] In this way, at least one of the shape of the light spot or the periodic variation of the light spot is obtained. Since the shape of the light spot or the periodic variation of the light spot encodes the manipulation action on the projected image, the manipulation action on the projected image is determined after feature detection, a cursor is projected on the projected image, and the projected image is manipulated according to the manipulation action.

[0144] The light spot projected by the remote control onto the projected image is obtained by modulating visible or invisible light. To enable users to intuitively observe the control actions displayed on the projected image, the light spot is converted into a visual cursor. The cursor is projected on the projected image and is used to indicate the control actions on the projected image, and the projected image is controlled according to the control actions.

[0145] If the light spot carries control information, the projector can obtain the control information carried by the light spot after demodulating the light spot. The projector can project a corresponding cursor on the projection screen based on the control information. The cursor can be determined based on the position of the cursor coordinates. For example, the cursor coordinates can be directly determined based on the position of the light spot coordinates corresponding to the control information, or the light spot coordinates corresponding to the control information can be converted into cursor coordinates.

[0146] In some embodiments, the projector's processor can first determine the coordinates of the light spot corresponding to the manipulation information based on the manipulation information. For example, after demodulating the light spot, the projector's processor first determines the manipulation action of the light spot on the projected screen corresponding to the manipulation information based on the obtained manipulation information. The coordinate position of the manipulation action presented on the projected screen coordinate system can be the light spot coordinates corresponding to the manipulation information. Then, at this position in the projected screen coordinate system, the cursor is projected on the projected screen according to the light spot coordinates corresponding to the manipulation information, and the projected screen is manipulated. The cursor position and the light spot position can completely overlap (such as in the case of a small movement range such as a tap operation), or they can be scaled proportionally (such as in the case of a large movement range such as a slide operation).

[0147] In other embodiments, projecting a cursor on a projection screen requires performing coordinate conversion on the light spot coordinates obtained after demodulating the light spot. Based on the corresponding relationship between the light spot coordinates and the cursor coordinates, the light spot coordinates corresponding to the manipulation information are converted to the cursor coordinates corresponding to the manipulation information, so as to facilitate displaying the specific position of the cursor on the projection screen. For example, the processor of the projector can convert the light spot coordinates based on the mapping relationship between the light spot coordinates and the cursor coordinates stored in the projector, such as performing a linear transformation, a nonlinear transformation, or an affine transformation on the light spot coordinates to obtain the corresponding cursor coordinates, and then project the cursor on the projection screen based on the cursor coordinates.

[0148] By projecting a cursor onto the projected image, users can observe the corresponding operations in real time. The visualization of the cursor helps users intuitively perceive the dynamic changes of control actions when controlling the projected image via the remote control, improving the user's interactive experience with the projection system.

[0149] In actual projection scenarios, the projector's position may be adjusted, requiring a calibration mechanism to ensure the accuracy of coordinate conversion and symmetrical projection. For example, using the projector's CIS to implement keystone correction, the detected light spot coordinates are converted to the corrected projection image.

[0150] According to the projector projection screen control method described in the above steps, compared with the user operating a light pen to control the projection screen, the light emitted by the light pen is easily affected by natural light or environmental factors, resulting in a problem of poor display effect of the projection screen. The projector projection screen control method provided in the present application obtains the light spot emitted from the remote control on the projection screen through the projector. The light spot here is obtained after the remote control modulates and encodes the light. Based on the light spot, the projection screen of the projector is indicated, and the cursor is projected onto the projection screen again. Since the cursor on the projection screen is emitted by the projector, the cursor can be displayed intuitively and accurately on the projection screen, and the control action can be presented on the projection screen, which improves the display effect of the projection screen and improves the user's experience of interacting with the projection system.

[0151] Furthermore, the light emitted by the remote control's light source is modulated and encoded, so that the light spot projected on the projector's screen indicates the control actions being taken. After the projector demodulates the light spot, it can more easily identify the control actions from the remote control, eliminating interference from other light sources. Because the light spot indicates a variety of control actions, the projector displays the corresponding control actions on the projected screen, which helps to increase the diversity and flexibility of control methods.

[0152] The above mainly introduces the solution provided in the embodiment of the present application from the perspective of method.

[0153] It is understandable that in order to implement the above functions, the computing device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0154] In the above, in combination with Figures 5 to 8, the projection screen control method of the projector provided according to the embodiment of the present application is described in detail. The projection screen control device of the projector provided according to the embodiment of the present application will be described below in combination with Figures 9 and 10.

[0155] Figure 9 is a schematic diagram of a remote control provided by the present application. The modules in this schematic diagram can be used to implement the functions of the remote control in the above method embodiment, thereby also achieving the beneficial effects of the above method embodiment.

[0156] As shown in FIG. 9 , the remote controller 900 includes a modulation module 910 , a projection module 920 , a light source 930 , and a storage module 940 .

[0157] The modulation module 910 is used to modulate and encode the light emitted by the remote control light source 930. For example, the modulation module 910 is used to execute step 610 in FIG6.

[0158] The projection module 920 is used to project a light spot onto the projection screen of the projector, where the light spot is used to indicate the control action on the projection screen of the projector.

[0159] Optionally, the light emitted by the light source 930 of the remote control includes visible light or invisible light.

[0160] Optionally, when performing spatial modulation encoding on the light emitted by the remote control light source 930, the modulation module 910 is specifically configured to: perform spatial modulation encoding on the spatial distribution characteristics of the light emitted by the remote control light source 930 to obtain a light spot, where the spatial distribution characteristics of the light include at least one of the shape, position, or size of the light. For example, the modulation module 910 is configured to perform step 611 above.

[0161] Optionally, the remote control includes an optical element, and when the modulation module 910 performs spatial modulation encoding on the spatial distribution characteristics of the light emitted by the light source 930 of the remote control, it is specifically used to: perform spatial modulation encoding on the spatial distribution characteristics of the light emitted by the light source 930 of the remote control after passing through the optical element included in the remote control.

[0162] Optionally, the pattern of the light spot is used to indicate an operation of controlling the projection image of the projector, and the pattern of the light spot includes at least one of a cross shape, a circular ring shape or a random shape.

[0163] Optionally, when performing temporal modulation encoding on the light emitted by the remote control light source 930, the modulation module 910 is specifically configured to perform temporal modulation encoding on the periodic variation characteristics of the light emitted by the remote control light source 930 to obtain a light spot, where the periodic variation characteristics of the light include a temporal variation of at least one of brightness or color of the light. For example, the modulation module 910 is configured to perform step 612 above.

[0164] Optionally, the above-mentioned time modulation coding method includes any one of amplitude modulation, frequency modulation, frame difference, sine wave, square wave and orthogonal.

[0165] Optionally, the periodic change of the light spot is used to indicate a manipulation action on the projection image of the projector.

[0166] Optionally, the light spot carries control information, and the control information is used to indicate a control action on the projection image of the projector.

[0167] Optionally, the above-mentioned manipulation action includes at least one of clicking, sliding, dragging, circling, jumping or mouse triggering events.

[0168] The storage module 940 is used to store light spots and control information.

[0169] It should be understood that the remote control 900 according to the embodiment of the present application can correspond to executing the method described in the embodiment of the present application, and the above-mentioned and other operations and / or functions of each unit in the remote control 900 are respectively for implementing the corresponding processes of the corresponding method in Figure 6. For the sake of brevity, they will not be repeated here.

[0170] Figure 10 is a schematic diagram of the projector provided by the present application. The modules in this structural diagram can be used to implement the functions of the projector in the above method embodiment, thereby also achieving the beneficial effects of the above method embodiment.

[0171] As shown in FIG. 10 , the projector 1000 includes a camera 1010 , a demodulation module 1020 , a projection module 1030 , and a storage module 1040 .

[0172] The camera 1010 is used to obtain the light spot on the projection image. For example, the camera 1010 is used to perform step 620 in FIG6 .

[0173] The demodulation module 1020 is used to demodulate the light spot, and the projection module 1030 is used to project a cursor on the projection screen for indicating the manipulation action on the projection screen and manipulate the projection screen according to the manipulation information. For example, the demodulation module 1020 and the projection module 1030 are used to perform step 620 in Figure 6.

[0174] Optionally, when the camera 1010 acquires the light spot on the projection screen, it is specifically used for: the camera 1010 included in the projector acquires the light spot on the projection screen.

[0175] Optionally, when the projection module 1030 projects the cursor on the projection screen, it is specifically configured to: determine the coordinates of the light spot according to the control information carried by the light spot; and project the cursor on the projection screen according to the coordinates of the light spot.

[0176] Optionally, when the projection module 1030 projects a light spot on the projection screen, it is specifically configured to: after the demodulation module 1020 demodulates the light spot, the projection module 1030 projects a cursor on the projection screen.

[0177] Optionally, after the demodulation module 1020 demodulates the light spot, when the projection module 1030 projects a cursor on the projection screen, it is specifically used to: the demodulation module 1020 performs feature detection on the light spot, obtains at least one of the pattern of the light spot or the periodic change of the light spot, and determines the manipulation action on the projection screen; the projection module 1030 projects the cursor on the projection screen, and manipulates the projection screen according to the manipulation action.

[0178] Optionally, the above-mentioned manipulation action includes at least one of clicking, sliding, dragging, circling, jumping or mouse triggering events.

[0179] Optionally, the projector and the remote control are connected via at least one of wireless, infrared, and Bluetooth.

[0180] The storage module 1040 is used to store the light spot, the manipulation information, and the cursor corresponding to the manipulation information.

[0181] It should be understood that the projector 1000 according to the embodiment of the present application can correspond to executing the method described in the embodiment of the present application, and the above-mentioned and other operations and / or functions of each unit in the projector 1000 are respectively for implementing the corresponding process of the corresponding method in Figure 6. For the sake of brevity, they will not be repeated here.

[0182] FIG11 is a schematic diagram of the structure of a remote control provided by the present application. As shown in FIG11 , the remote control 1100 includes a light source 1101 , an optical element 1102 , and a processor 1103 .

[0183] Among them, the light source 1101 is used to emit a light signal, and the optical element 1102 is used to change the light transmission direction of the light emitted by the light source 1101, including but not limited to lenses (convex and concave lenses), prisms, reflectors, gratings, and filters. The processor 1103 is used to modulate the light emitted by the light source 1101 after diffraction by the optical element 1102 using spatial modulation coding and / or temporal modulation coding, and project a light spot onto the projector's projection screen for indicating the control of the projector's projection screen. The light spot here can carry control information to indicate the control action of the projector's projection screen.

[0184] FIG12 is a schematic diagram of the structure of a projector provided by the present application. As shown in FIG12 , the projector 1200 includes a camera 1201 , a projection optical engine 1202 , a memory 1203 , and a processor 1204 .

[0185] The projector 1202 is used to generate a projected image. The camera 1201 is used to capture the light spot on the projected image after being modulated by the remote control. The memory 1203 is used to store computer instructions for demodulating the light spot and converting the light spot coordinates into cursor coordinates. When the processor 1204 executes the computer instructions stored in the memory 1203, it demodulates the light spot and obtains the control action. The cursor is projected on the projected image, and the projected image is manipulated according to the control action.

[0186] The method steps in this embodiment can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and storage medium can be located in an ASIC. In addition, the ASIC can be located in a computing device. Of course, the processor and storage medium can also exist as discrete components in a network device or a terminal device.

[0187] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a remote control or a projector, the remote control or the projector executes a corresponding method for controlling the projection screen of the projector.

[0188] For explanations of the relevant contents and descriptions of the beneficial effects of any of the computer-readable storage media provided above, reference may be made to the corresponding embodiments described above, and no further details will be given here.

[0189] The embodiment of the present application also provides a chip. The chip integrates a control circuit and one or more ports for implementing the functions of the above-mentioned remote control or projector. Optionally, the functions supported by the chip can be referred to above and will not be repeated here. A person of ordinary skill in the art will understand that all or part of the steps of implementing the above-mentioned embodiment can be completed by instructing the relevant hardware through a program. The program can be stored in a computer-readable storage medium. The storage medium mentioned above can be a read-only memory, a random access memory, etc. The above-mentioned processing unit or processor can be a central processing unit, a general-purpose processor, an application specific integrated circuit (ASIC), a microprocessor (digital signal processor, DSP), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof.

[0190] The present application also provides a computer program product containing instructions. When the instructions are executed on a remote control or projector, the remote control or projector executes a corresponding method for controlling the projected image of the projector. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the remote control or projector, the process or function according to the embodiment of the present application is fully or partially generated.

[0191] It should be noted that the above-mentioned devices for storing computer instructions or computer programs provided in the embodiments of the present application, such as but not limited to the above-mentioned memories, computer-readable storage media and communication chips, etc., are all non-transitory.

[0192] In the above embodiments, they can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, they can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed on a remote control or projector, the processes or functions described in the embodiments of the present application are executed in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, or other programmable device. The computer program or instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer program or instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired or wireless means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium, such as a floppy disk, a hard disk, or a tape; it can also be an optical medium, such as a digital video disc (DVD); it can also be a semiconductor medium, such as a solid state drive (SSD).

[0193] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other variations of the disclosed embodiments by reviewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple situations. A single processor or other unit may implement several functions listed in the claims. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0194] Although the present application has been described with reference to specific features and embodiments thereof, it is apparent that various modifications and combinations may be made thereto without departing from the spirit and scope of the present application. Accordingly, this specification and the drawings are merely illustrative of the present application as defined by the appended claims and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, those skilled in the art may make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, the present application is intended to include such modifications and variations as fall within the scope of the claims of the present application and their equivalents.

Claims

1. A method for controlling a projection image of a projector, characterized in that: The method is applied to a projection system, which includes a remote controller and a projector, and includes: The remote controller modulates and encodes light emitted by a light source of the remote controller, and projects a light spot onto a projection screen of the projector, wherein the light spot is used to indicate a manipulation action on the projection screen of the projector; The projector obtains the light spot on the projection screen, projects a cursor on the projection screen, and manipulates the projection screen according to the manipulation action, wherein the cursor is used to indicate the manipulation action on the projection screen.

2. The method according to claim 1, characterized in that The light emitted by the light source of the remote controller includes either visible light or invisible light.

3. The method according to claim 1 or 2, characterized in that Modulating and encoding light emitted by a light source of the remote controller, comprising: The spatial distribution characteristics of the light emitted by the light source of the remote controller are spatially modulated and encoded to obtain the light spot, where the spatial distribution characteristics of the light include at least one of the shape, position or size of the light.

4. The method according to claim 3, characterized in that The remote control includes an optical element; Performing spatial modulation encoding on the spatial distribution characteristics of light emitted by the light source of the remote control includes: Spatial modulation encoding is performed on the spatial distribution characteristics of the light emitted by the light source of the remote control after passing through the optical element included in the remote control.

5. The method according to claim 3 or 4, characterized in that The pattern of the light spot is used to indicate a manipulation action on the projection image of the projector, and the pattern of the light spot includes at least one of a cross shape, a circular ring shape, or a random shape.

6. The method according to any one of claims 1 to 5, characterized in that Modulating and encoding light emitted by a light source of the remote controller, comprising: The light spot is obtained by performing time modulation encoding on the periodic variation characteristics of the light emitted by the light source of the remote controller, wherein the periodic variation characteristics of the light include a variation mode of at least one of the brightness or color of the light over time.

7. The method according to claim 6, characterized in that The time modulation coding method includes any one of amplitude modulation, frequency modulation, frame difference, sine wave, square wave and orthogonal.

8. The method according to claim 6 or 7, characterized in that The periodic change of the light spot is used to indicate the manipulation action on the projection picture of the projector.

9. The method according to any one of claims 1 to 4, 6 or 7, characterized in that The light spot carries control information, and the control information is used to indicate a control action on the projection image of the projector.

10. The method according to any one of claims 1 to 9, characterized in that The manipulation action includes at least one of clicking, sliding, dragging, circling, jumping or mouse triggering events.

11. The method according to any one of claims 1 to 10, characterized in that The projector obtains the light spot on the projection screen, including: The camera included in the projector collects the light spot on the projection screen.

12. The method according to any one of claims 1 to 11, characterized in that Projecting a cursor on the projection screen, comprising: The projector determines the coordinates of the light spot according to the control information carried by the light spot; The projector projects the cursor on the projection screen according to the coordinates of the light spot.

13. The method according to any one of claims 1 to 11, characterized in that Projecting a cursor on the projection screen, comprising: The projector demodulates the light spot and projects the cursor on the projection screen.

14. The method according to claim 13, characterized in that The projector demodulates the light spot and projects the cursor on the projection screen, comprising: The projector performs feature detection on the light spot, obtains at least one of a pattern of the light spot or a periodic change of the light spot, and determines a manipulation action on the projected image; The cursor is projected on the projection screen, and the projection screen is manipulated according to the manipulation action.

15. A remote controller, characterized in that: The remote control includes a light source and a processor, and the processor is configured to perform the operation steps of any one of claims 1 to 10 when modulating the light emitted by the light source.

16. A projector, characterized in that: The projector includes a camera, a memory and a processor, the camera is used to obtain the light spot on the projection screen, and the memory is used to store a set of computer instructions; when the processor executes the set of computer instructions, the operating steps of the method described in any one of claims 11 to 14 are performed.

17. A projection system, characterized in that: The projection system includes a remote controller and a projector. The remote controller is used to execute the operation steps of the method according to any one of claims 1 to 10. The projector is used to execute the operation steps of the method according to any one of claims 11 to 14.

Images