Projection control method and device

Abstract

The invention relates to a projection control method and device, and the method comprises the steps: displaying a target image in a target region corresponding to the current projection direction of projection equipment in a panoramic image in a panoramic projection process; and performing display adjustment for the target image according to the control operation for the projection direction and / or the target image. The display of the target image can be correspondingly adjusted timely and accurately in response to different control operations of the user, personalized projection control requirements of different users are met, and the interactive experience of the user is enhanced.

Description

Technical Field

[0001] The present disclosure relates to the field of projection technology, and in particular to a projection control method and device. Background Art

[0002] A projector is a device that converts images or video signals into visible images and projects them onto a larger surface (such as a screen or wall). It is widely used in business presentations, education, home theaters, monitoring, and other occasions that require large-screen displays. In related technologies, the projection method of projectors is single and cannot meet the projection needs of diverse images. Summary of the invention

[0003] In view of this, the present disclosure proposes a projection control method, which is applied to a projection device and includes:

[0004] During the panoramic projection process, a target image in a target area corresponding to the current projection direction of the projection device in the panoramic image is displayed;

[0005] According to the control operation on the projection direction and / or the target image, a display adjustment is performed on the target image.

[0006] In a possible implementation manner, performing display adjustment on the target image according to the control operation on the projection direction and / or the target image includes:

[0007] In response to a direction adjustment operation for adjusting the projection direction in the control operation, adjusting the projection direction of the projection device;

[0008] A new target image in a new target area corresponding to the adjusted projection direction in the panoramic image is displayed.

[0009] In a possible implementation manner, the target image is displayed in a target window, and a display manner of the target window matches features corresponding to the target image and / or the panoramic image, or matches a projection direction.

[0010] In a possible implementation manner, performing display adjustment on the target image according to the control operation on the projection direction and / or the target image includes:

[0011] In response to a second gesture for adjusting the display mode of an image in the control operation, display adjustment is performed on the target image and / or a target object in the target image corresponding to the second gesture.

[0012] In a possible implementation manner, performing display adjustment on the target image according to the control operation on the projection direction and / or the target image includes:

[0013] In response to a third gesture in the control operation that triggers display of special effect content, displaying special effect content corresponding to the third gesture in the target image.

[0014] In a possible implementation, the special effect content includes at least one of the following: an animation corresponding to the third gesture, an interactive screen corresponding to the third gesture, a virtual object corresponding to the third gesture, and a matching content sound effect.

[0015] In a possible implementation, the method further includes:

[0016] In response to the control operation, an operation sound effect corresponding to the control operation is emitted.

[0017] According to one aspect of the present disclosure, a projection control device is provided, the device being applied to a projection device, the device comprising:

[0018] A display module, used to display a target image in a target area corresponding to a current projection direction of the projection device in the panoramic image during the panoramic projection process;

[0019] The adjustment module is used to perform display adjustment for the target image according to the control operation for the projection direction and / or the target image.

[0020] In a possible implementation, the adjustment module includes:

[0021] a direction adjustment submodule, configured to adjust the projection direction of the projection device in response to a direction adjustment operation for adjusting the projection direction in the control operation;

[0022] The target image adjustment submodule is used to display a new target image in a new target area corresponding to the adjusted projection direction in the panoramic image.

[0023] In a possible implementation manner, the target image is displayed in a target window, and a display manner of the target window matches features corresponding to the target image and / or the panoramic image, or matches a projection direction.

[0024] In a possible implementation, the direction adjustment operation includes at least one of the following: a first gesture for adjusting the projection direction, a direction adjustment voice for adjusting the projection direction, and an adjustment operation on a direction key of a projection controller.

[0025] In a possible implementation, the adjustment module includes:

[0026] The display mode adjustment submodule is used to adjust the display mode of the target image and / or the target object in the target image corresponding to the second gesture in response to the second gesture for adjusting the display mode of the image in the control operation.

[0027] In a possible implementation, the adjustment module includes:

[0028] The special effect submodule is used to respond to a third gesture in the control operation that triggers the display of special effect content, and to display the special effect content corresponding to the third gesture in the target image.

[0029] In a possible implementation, the special effect content includes at least one of the following: an animation corresponding to the third gesture, an interactive screen corresponding to the third gesture, a virtual object corresponding to the third gesture, and a matching content sound effect.

[0030] In a possible implementation manner, the device further includes:

[0031] The operation sound effect module is used to emit an operation sound effect corresponding to the control operation in response to the control operation.

[0032] According to another aspect of the present disclosure, a projection device is provided, comprising the above-mentioned projection control device.

[0033] According to another aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0034] According to another aspect of the present disclosure, a non-volatile computer-readable storage medium is provided, on which computer program instructions are stored, wherein the computer program instructions implement the above method when executed by a processor.

[0035] According to another aspect of the present disclosure, a computer program product is provided, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0036] The projection control method and device provided by the embodiments of the present disclosure. During the panoramic projection process, a target image in a target area corresponding to the current projection direction of the projection device in the panoramic image is displayed; and the display of the target image is adjusted according to the control operation on the projection direction and / or the target image. The display of the target image can be adjusted in a timely and accurate manner in response to different control operations of the user, thereby meeting the personalized projection control needs of different users and enhancing the user's interactive experience.

[0037] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

[0039] Figure 1 A flowchart of a projection control method according to an embodiment of the present disclosure is shown.

[0040] Figure 2 , Figure 3 A schematic diagram showing a control gesture according to an embodiment of the present disclosure is shown.

[0041] Figure 4 A schematic diagram of a target window according to an embodiment of the present disclosure is shown.

[0042] Figure 5 A schematic diagram showing an application example of a target window according to an embodiment of the present disclosure.

[0043] Figure 6 , Figure 7 A schematic diagram showing display adjustment for a target image according to an embodiment of the present disclosure is shown.

[0044] Figure 8 A schematic diagram showing an angle limitation range of a projection device according to an embodiment of the present disclosure.

[0045] Fig. 9 A schematic diagram showing the application of a second gesture in a projection control method according to an embodiment of the present disclosure is shown.

[0046] Fig.10 is a block diagram of a device 1900 for projection control according to an exemplary embodiment. DETAILED DESCRIPTION

[0047] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0048] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0049] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

[0050] Panoramic projection technology is to stitch multiple photos or video contents into a panoramic image and project it onto a specific surface, achieving a 360-degree panoramic visual experience without blind spots, allowing users to interactively watch the restoration of real scenes in all directions, and is widely used in occasions that require an immersive viewing experience. For example, it can be used in scene understanding, virtual reality, urban planning, entertainment, astronomical education, multimedia art performances and other fields to provide users with an immersive feeling. However, in the related technology, the implementation method of panoramic projection is single and cannot meet the diverse image projection needs of users.

[0051] In order to solve the above technical problems, the embodiments of the present disclosure provide a projection control method and device. During the panoramic projection process, a target image in a target area corresponding to the current projection direction of the projection device in the panoramic image is displayed; and the display adjustment of the target image is performed according to the control operation for the projection direction and / or the target image. The display of the target image can be adjusted in a timely and accurate manner in response to different control operations of the user, so as to meet the personalized projection control needs of different users and enhance the user's interactive experience.

[0052] The present disclosure provides a projection control method. Figure 1 As shown, the method includes step S101 and step S102. The method is applied to a projection device.

[0053] In step S101, during the panoramic projection process, a target image in a target area corresponding to a current projection direction of a projection device in a panoramic image is displayed.

[0054] In this embodiment, the projection device may be a device with a projection function such as a projector, and the present disclosure does not limit this. The target image may be projected by the projection device and displayed on a screen or wall in the current projection direction and other projection-capable surfaces that can display the projection image, so that the user can view the target image on the projection-capable surface in the current projection direction. The projection-capable surface may be a sphere, a side of a cylinder, six faces of a cube, a three-fold plane (such as a three-fold screen), a plane, etc., and the present disclosure does not limit this.

[0055] In this embodiment, the target image is a partial panoramic image in the target area corresponding to the current projection direction of the projection device in the panoramic image. When the current projection direction of the projection device changes, the target area changes, and the projected target image also changes accordingly to achieve a panoramic display effect.

[0056] In step S102, display adjustment is performed on the target image according to the control operation on the projection direction and / or the target image.

[0057] In this embodiment, the control operation may be an operation related to the display of the target image, such as the projection direction, the display mode of the target image, and the special effects content in the target image. The control operation may be issued by the user by operating the projection controller, operating an electronic device such as a mobile phone that can control the projection device, operating the projection device itself, directly issuing a corresponding preset gesture, voice, etc. Among them, the projection device can realize user gesture detection. For example, the projection device can perform image detection on the area covered by the target image to determine the gesture issued by the user.

[0058] In some embodiments, the control operation may include a direction adjustment operation for adjusting the projection direction, and the direction adjustment operation may include at least one of the following: a first gesture for adjusting the projection direction, a direction adjustment voice for adjusting the projection direction, and an adjustment operation for a direction key of a projection controller. The control operation may also include a second gesture for adjusting the display mode of an image, a third gesture for triggering the display of special effect content, and the like. The type of control operation may be set according to actual needs, and the present disclosure does not limit this.

[0059] In this embodiment, the control gestures (including the first gesture, the second gesture and the third gesture) can be set in advance, such as Figure 2 As shown, the control gestures may include an up swipe gesture, a down swipe gesture, a left or right swipe gesture, a double-click gesture, a single-click gesture, a left swipe gesture, a right swipe gesture, a two-finger zoom gesture, an "OK" gesture, a "like" gesture, a two-hand heart gesture, a one-hand heart gesture, a two-hand heart gesture, a YAY gesture, a LOVE gesture, a high five gesture, a fist bump gesture, a one-hand zoom gesture, an open hand gesture, a handshake gesture, and the like. Figure 3 As shown, the control gestures may also include gestures for pointing out animals, plants, and other objects. The control gestures may be increased or decreased according to actual needs, and the present disclosure does not limit this. The same control gesture may belong to one of the first gesture, the second gesture, and the third gesture, or may belong to two or more gestures at the same time. The type to which the detected control gesture belongs may be determined based on the display of the currently projected panoramic image.

[0060] In a possible implementation, the target image is displayed in a target window, and the display mode of the target window matches the features corresponding to the target image and / or the panoramic image, or matches the projection direction. Accordingly, the method may also include: determining window parameters according to the features corresponding to the target image and / or the panoramic image, or the projection direction, and displaying the target image in the target window displayed according to the window parameters.

[0061] In this implementation, the window parameters may determine the display mode of the target window, and the window parameters may include at least one of the following: shape, size, filter, special effect. Accordingly, the display mode of the target window also includes at least one of shape, size, filter, special effect. Figure 4 As shown, the shape of the target window can include multiple types. For example, a square, a square with rounded corners, a triangle with rounded corners, a rectangle with rounded corners, and a rectangle. And shapes with certain specific meanings, such as a "heart" shape, a "five-pointed star" shape, an "umbrella" shape, a "yeah gesture" shape, a "play key" shape, a "position positioning" shape, a "binocular telescope viewfinder" shape, etc., which are not limited by the present disclosure. The window parameters of different target windows can be pre-set by the projection device, or can be determined based on the user's settings, which are not limited by the present disclosure.

[0062] The window parameters may indicate the specific display method of the target window during the display process. In the same panoramic image, the target windows in different projection directions may be the same or different. In some embodiments, the display effects of the target windows with the same window parameters in different projection directions may be the same or may have certain differences, and the present disclosure does not limit this.

[0063] In one implementation, the projection direction and the display mode of the target window (eg, the corresponding relationship between the window parameters) may be preset, so that the display mode of the target window is determined according to the projection direction.

[0064] In another implementation, matching window parameters may be determined based on features of the target image and / or features corresponding to the panoramic image, so that the target window displayed based on the window parameters can match the target image. Features of the target image may include: attributes of objects in the target image (such as object category, shape, size, etc.), image features of the target image (such as primary color, hue, color temperature, etc.), semantics of the target image, etc. Features of a panoramic image may be features that reflect the overall attributes of the panoramic image, such as scene features. Scene features may include: corresponding natural environment types, building types, corresponding eras, etc. in the panoramic image, and the present disclosure does not limit this. For example, in the case of Figure 5 When the panoramic image shown is displayed by panoramic projection, the scene feature is to display the moon, then the shape of the window parameters of the target window can be circular, the size can be corresponding to the size of the moon in the panoramic image, the filter is soft, and there is no special effect.

[0065] In this embodiment, the display adjustment of the target image varies according to different control operations. Figure 6-Figure 9 Different implementations of step S102 are schematically illustrated.

[0066] Step S102 may include: when the control operation includes a direction adjustment operation, in response to the direction adjustment operation for adjusting the projection direction in the control operation, adjusting the projection direction of the projection device; and displaying a new target image in a new target area in the panoramic image corresponding to the adjusted projection direction.

[0067] Among them, the projection device can adjust the projection direction in the direction corresponding to the direction adjustment operation, such as upward, downward, left, right, etc., based on the current projection direction in response to the direction adjustment operation. The adjustment angle can be further determined according to the direction adjustment operation, and the adjustment angle can be 10 degrees, 60 degrees, 90 degrees, etc. In some embodiments, the projection direction can be adjusted by a preset angle each time in response to the direction adjustment operation according to the direction indicated by the direction adjustment operation. For example, if a first gesture is detected, and the direction indicated by the first gesture is to the left, the projection direction can be rotated 10 degrees to the left each time based on the current direction (that is, the preset angle). The projection direction can also be adjusted directly based on the direction and angle indicated by the direction adjustment operation. For example, assuming that a direction adjustment voice of "rotate 30 degrees to the left" is detected, the projection direction can be directly rotated 30 degrees to the left based on the current direction. The implementation method of adjusting the projection direction in response to the direction adjustment operation can be set according to actual needs, and the present disclosure does not limit this.

[0068] For example, Figure 6 As shown, assuming that the current projection direction of the projection device is in the first direction of the front without any rotation, the target window is Figure 6 Then, in response to the direction adjustment operation, when the projection direction is rotated 90 degrees to the left, 90 degrees to the right, 90 degrees upward, and 10 degrees downward, the position of the target window 1 also changes accordingly, and the target image in the target window 1 also changes based on the projection direction. Figure 7 As shown, assuming that the current projection direction of the projection device is in the first direction of the front without any rotation, the target window is Figure 7 The target window 2 shown in the figure. Then, in response to the direction adjustment operation, when the projection direction is rotated 90 degrees to the left and 60 degrees upward, the position of the target window 2 also changes accordingly (to the ceiling window and the left window respectively), and the target image in the target window 2 also changes based on the projection direction. In this way, the user can see the target image in the target window 1 corresponding to different projection directions in the panoramic image, realizing the all-round surround stereo display of the panoramic image.

[0069] In one implementation, a reference projection direction (e.g., a frontal direction without rotation) and a reference area in the panoramic image corresponding to the reference projection direction may be preset, and based on the deviation between the adjusted projection direction and the reference projection direction, an area having a corresponding deviation from the reference area may be determined as a new target area.

[0070] In combination with the foregoing, the target image corresponding to the direction can also be displayed in different projection directions with target windows having different window parameters, so that the display form of the target window is adapted to the content or style of the target image, thereby enriching the user's viewing experience and achieving a better display effect.

[0071] In this embodiment, the projection direction of the projection device may have a preset angle limit range, and in the process of adjusting the projection direction of the projection device in response to the direction adjustment operation, the projection direction may be adjusted within the angle limit range. Figure 8 As shown, the angle limit range of the projection device is 90 degrees to the left and right sides and 70 degrees to the up and down in the non-rotation position at the front.

[0072] In this embodiment, step S102 may further include: in response to the second gesture for adjusting the display mode of the image in the control operation, adjusting the display of the target image and / or the target object corresponding to the second gesture in the target image. The target object may include the object corresponding to the second gesture in the target image. The display adjustment may include any one of the following: zooming in, zooming out, moving, highlighting, and display state adjustment.

[0073] In this embodiment, the image display method may include a target image and / or a target object in the target image. The corresponding second gesture may be adaptively set according to the image display method adjusted according to actual needs, such as Figure 2 As shown, the second gesture may include: a two-finger extension and enlargement gesture for enlarging the target object, an enlargement gesture for enlarging the target image, a double-click gesture for highlighting, and an upward swipe gesture for adjusting the display state of the target image or target object. Among them, the target image and the target object may have at least one preset display state, and each display state matches the state that the objectively existing physical entity corresponding to the target image (or target object) can present in the actual environment, or matches the state that the virtual body corresponding to the target image (or target object) can present in the environment corresponding to the virtual body. The states displayed by the target image and the target object in different display states are different, and the number of display states of different target images and target objects may also be different. Taking the target object as an example, the display state of a book may include closed and open, the display state of a lamp may include closed and open, the display state of an electronic device such as a mobile phone may include lighting the screen and locking the screen, the display state of a fireplace may include ignition (ignition may also include starting to burn, burning fiercely, and burning almost) and extinguishing, the display state of a car window may include opening and closing, and the display state of a plant may include different growth stages, states of different seasons in each growth stage, etc. Taking the target image as an example, the display state of the target image may include a normal state, and states of different seasons, different weather, and different time periods of the day, such as snow, rain, wind, cloudy, sunny, and night in the scene displayed by the target image. The change of the display state of the image can be reflected by changing parameters such as the color and brightness of the image, adding animation or special effects to the image, or moving the position of background elements in the image. Among them, when the same target object (or target image) switches between different display states, the transition process of state switching can also be displayed. For example, the display state adjustment of the car window from closed to open can display the change transition process of the car window from closed to open.

[0074] The second gesture can simultaneously control the target image and the display state of one or more target objects in the target image to change accordingly, so as to form a new display state. In one example, the user can perform the second gesture "slide up" at the position of the car window in the target image to change the display state of the car window to open. At the same time, the display state of the person next to the car window can be changed to fluttering hair, simulating the scene of wind blowing in from the car window, and the display state of the target image can be changed to snowflakes or fallen leaves floating into the car window.

[0075] The first gesture, the second gesture and the third gesture may be the same or different, and the gesture detected by the user may be determined according to the actual situation of the current target image display.

[0076] In some embodiments, the method may further include: displaying at least one display adjustment reminder for the target image and / or the object in the target image, each display adjustment reminder being used to remind the user of the target (including the target image, the object in the target image) that can be displayed and the second gesture required for display adjustment of the target. In this way, the user can issue the corresponding second gesture under the prompt of the display adjustment reminder to adjust the display mode of the target image and the target object in the target image, thereby increasing the user's interactive experience in the panoramic projection and meeting the personalized needs of different users for interaction.

[0077] For example, if Fig. 9 As shown in FIG. 1 , the reminder “Swipe up to open the window and unlock the surprise” can be displayed on the target image. Then, after detecting the user’s swipe up gesture, Fig. 9 As shown, the car window is opened gradually according to the speed and amplitude of the upward sliding. For another example, through the second gesture, the user can open a book in the target image, light up the screen of a mobile phone, turn on a lighting, light a fireplace, melt ice and snow, etc., and the present disclosure does not limit this.

[0078] The user can perform the second gesture within the acquisition range of the gesture acquisition module (e.g., image acquisition module) of the projection device. The correspondence between the operation position of the second gesture and the image object can be preset. When the second gesture is detected at a preset position, the image object corresponding to the position can be displayed and adjusted. The correspondence between the type of the second gesture and the image object can also be preset. When a specific type of second gesture is detected, the image object corresponding to the second gesture of that type can be displayed and adjusted. This application does not limit the correspondence between the second gesture and the image object.

[0079] In this embodiment, step S102 may further include: in response to a third gesture in the control operation that triggers the display of special effect content, displaying special effect content corresponding to the third gesture in the target image. The special effect content may include at least one of the following: an animation corresponding to the third gesture, an interactive screen corresponding to the third gesture, a virtual object corresponding to the third gesture, and a matching content sound effect.

[0080] Among them, the animation corresponding to the third gesture may include multiple preset animations, each preset animation corresponds to a different third gesture, and the preset animation may be an animation such as rain, snow, and scattering petals, which can be added to the target image and displayed synchronously with the target image. The interactive screen may also include multiple types, and each interactive screen corresponds to a different third gesture. The interactive screen may be a screen that enables the user to interact with the object in the target image, or between different objects in the target image, such as adding an interactive screen so that two objects can make a heart shape with each other, adding an interactive screen so that two objects can shake hands, adding an interactive screen so that the user can like a certain object, etc. Virtual objects may be virtual animals, plants, virtual animation images, etc., and the present disclosure does not limit this.

[0081] Among them, the third gesture may include Figure 2 The gestures shown in the figure include "ok", "like", "heart with both hands", "heart", "heart with two hands", "yeah", "love", "high five", "fist bump", "open hand", "handshake", etc., and can also include Figure 3 The gesture of making an animal, plant or other object can display a virtual object corresponding to the third gesture to the user.

[0082] The content sound effects in the special effects content match the displayed animation, interactive screen or virtual object. The content sound effects can be the reproduction of natural sounds, or they can be synthesized or processed sounds, such as the sound of a door opening, wind, explosion, bird song, airplane takeoff, laughter, sigh, etc., which are not limited in this disclosure. The content sound effects can create a specific auditory atmosphere, enhance interactivity, and strengthen the interactive effect.

[0083] In some embodiments, the method may further include: in response to the control operation, issuing an operation sound effect corresponding to the control operation. Different control operations may have corresponding operation sound effects, so that the user can get a better interactive experience. Among them, operation sound effects can be set for some or all control operations. For example, different operation sound effects can be set for various control gestures, so that the user can determine which control gesture he has issued based on different operation sound effects. A fixed operation sound effect is set for different direction adjustment operations, so that the user can determine that the projection direction is currently being adjusted based on the operation sound effect. The operation sound effect is similar to the above-mentioned content sound effect, and can be set according to actual needs. The present disclosure does not limit this.

[0084] In some embodiments, the method may further include: displaying a special effect reminder to the user in combination with the current target image, the special effect reminder being used to remind the user that the special effect content can be displayed and the third gesture corresponding to the special effect content. In this way, the user can issue the corresponding third gesture under the prompt of the special effect reminder to display the special effect content, thereby increasing the user's interactive experience in the panoramic projection and meeting the personalized needs of different users for interaction.

[0085] After the above control operations are collected by the image acquisition module, voice acquisition module, buttons, etc. of the projection device, corresponding recognition (such as gesture recognition, voice recognition, etc.) can be performed based on relevant technologies, and the recognition results can be used to generate image adjustment instructions for the target image of the projected target area, so as to perform the above-mentioned scaling, moving target objects, adding special effects, etc. on the target image based on the image processing technology in the relevant technology. The processed target image can be temporarily stored in the projection device and released after the user changes the control operation mode or turns off the projection device. For certain types of control operations, the corresponding adjusted target image can also be pre-set and stored. When it is detected that the user performs the control operation, the corresponding adjusted target image is directly called for display.

[0086] The embodiment of the present disclosure further provides a projection control device, which is applied to a projection device, and includes:

[0087] A display module, used to display a target image in a target area corresponding to a current projection direction of the projection device in the panoramic image during the panoramic projection process;

[0088] The adjustment module is used to perform display adjustment for the target image according to the control operation for the projection direction and / or the target image.

[0089] In a possible implementation, the adjustment module includes:

[0090] a direction adjustment submodule, configured to adjust the projection direction of the projection device in response to a direction adjustment operation for adjusting the projection direction in the control operation;

[0091] The target image adjustment submodule is used to display a new target image in a new target area corresponding to the adjusted projection direction in the panoramic image.

[0092] In a possible implementation manner, the target image is displayed in a target window, and a display manner of the target window matches features corresponding to the target image and / or the panoramic image, or matches a projection direction.

[0093] In a possible implementation, the direction adjustment operation includes at least one of the following: a first gesture for adjusting the projection direction, a direction adjustment voice for adjusting the projection direction, and an adjustment operation on a direction key of a projection controller.

[0094] In a possible implementation, the adjustment module includes:

[0095] The display mode adjustment submodule is used to adjust the display mode of the target image and / or the target object in the target image corresponding to the second gesture in response to the second gesture for adjusting the display mode of the image in the control operation.

[0096] In a possible implementation, the adjustment module includes:

[0097] The special effect submodule is used to respond to a third gesture in the control operation that triggers the display of special effect content, and to display the special effect content corresponding to the third gesture in the target image.

[0098] In a possible implementation, the special effect content includes at least one of the following: an animation corresponding to the third gesture, an interactive screen corresponding to the third gesture, a virtual object corresponding to the third gesture, and a matching content sound effect.

[0099] In a possible implementation manner, the device further includes:

[0100] The operation sound effect module is used to emit an operation sound effect corresponding to the control operation in response to the control operation.

[0101] The embodiment of the present disclosure further provides a projection device, comprising the above-mentioned projection control device.

[0102] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation thereof can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0103] It should be noted that although the above embodiments are used as examples to introduce the projection control method and device, those skilled in the art will appreciate that the present disclosure should not be limited thereto. In fact, the user can flexibly set each step and module according to personal preferences and / or actual application scenarios, as long as it complies with the technical solution of the present disclosure.

[0104] The embodiment of the present disclosure also provides a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.

[0105] An embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0106] The embodiments of the present disclosure also provide a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0107] Fig.10 1 is a block diagram of a device 1900 for projection control according to an exemplary embodiment. For example, the device 1900 may be provided as a server or an electronic device. Fig.10 , the apparatus 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions, such as an application, that can be executed by the processing component 1922. The application stored in the memory 1932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

[0108] The device 1900 may also include a power supply component 1926 configured to perform power management of the device 1900, a wired or wireless network interface 1950 configured to connect the device 1900 to a network, and an input / output interface 1958 (I / O interface). The device 1900 may operate based on an operating system stored in the memory 1932, such as Windows Server 2000. TM , MacOS X TM , Unix TM ,Linux TM , FreeBSD TM or similar.

[0109] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the device 1900 to perform the above method.

[0110] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0111] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0112] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0113] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0114] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0115] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0116] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0117] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and the part of the module, program segment or instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

[0118] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A projection control method, characterized in that: The method is applied to a projection device, and the method comprises: During the panoramic projection process, a target image in a target area corresponding to the current projection direction of the projection device in the panoramic image is displayed; According to the control operation on the projection direction and / or the target image, a display adjustment is performed on the target image.

2. The method according to claim 1, characterized in that: According to the control operation on the projection direction and / or the target image, performing display adjustment on the target image includes: In response to a direction adjustment operation for adjusting the projection direction in the control operation, adjusting the projection direction of the projection device; A new target image in a new target area corresponding to the adjusted projection direction in the panoramic image is displayed.

3. The method according to claim 1 or 2, characterized in that: The target image is displayed in a target window, and a display mode of the target window matches features corresponding to the target image and / or the panoramic image, or matches a projection direction.

4. The method according to claim 1, characterized in that According to the control operation on the projection direction and / or the target image, performing display adjustment on the target image includes: In response to a second gesture for adjusting the display mode of an image in the control operation, display adjustment is performed on the target image and / or a target object in the target image corresponding to the second gesture.

5. The method according to claim 1, characterized in that According to the control operation on the projection direction and / or the target image, performing display adjustment on the target image includes: In response to a third gesture in the control operation that triggers display of special effect content, displaying special effect content corresponding to the third gesture in the target image.

6. The method according to claim 5, characterized in that The special effect content includes at least one of the following: an animation corresponding to the third gesture, an interactive screen corresponding to the third gesture, a virtual object corresponding to the third gesture, and a matching content sound effect.

7. The method according to claim 1, characterized in that The method further comprises: In response to the control operation, an operation sound effect corresponding to the control operation is emitted.

8. A projection control device, characterized in that: The device is applied to a projection device, and comprises: A display module, used to display a target image in a target area corresponding to a current projection direction of the projection device in the panoramic image during the panoramic projection process; The adjustment module is used to perform display adjustment for the target image according to the control operation for the projection direction and / or the target image.

9. A projection device, characterized in that: Includes the projection control device as claimed in claim 7.

10. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method described in any one of claims 1 to 7 when executing the instructions stored in the memory.

11. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.

12. A computer program product, comprising a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code, wherein when the computer-readable code is executed in a processor of an electronic device, the processor in the electronic device executes the method according to any one of claims 1 to 7.

Images