Watermark adding method, device, equipment and storage medium

Abstract

The present application provides a watermark adding method, device, equipment and storage medium, the method comprising: obtaining at least one watermark information and a panoramic image; determining the position to be added of each watermark information in the target area where the watermark information can be added in the panoramic image; the area where the watermark information can be added includes: an area irrelevant to the position of the stitching line corresponding to the panoramic image; determining the target position corresponding to the position to be added in the stitched image according to the transformation relationship between the multiple stitched images used to generate the panoramic image and the panoramic image; adding the watermark information at the target position to obtain the target image, and stitching the target images to generate a target panoramic image with the watermark information added. This embodiment implements stitching after adding watermark information to the multiple stitched images used to generate the panoramic image, avoiding the problem of watermark deformation and reducing the computational complexity of adding watermarks.

Description

Technical Field

[0001] The present application relates to the field of image processing, and in particular to a watermark adding method, device, equipment and storage medium. Background Art

[0002] In recent years, virtual reality and computer vision technologies have developed rapidly, and panoramic images have gradually become popular, such as 360-degree panoramas, which are obtained by capturing the image information of the entire scene with a professional camera, or rendering the picture using modeling software, and then stitching these pictures together and playing them with a special player (such as a VR player), so that users can watch 360-degree pictures, simulating a two-dimensional plane map into a real three-dimensional space, presenting it to the viewer, and providing people with an interactive and immersive experience.

[0003] With the popularity of near-eye display devices, panoramic images or videos are widely used in various industries. As panoramic images or videos are widely used, the importance of copyright protection issues has gradually emerged. Among them, adding watermarks to panoramic image frames in panoramic images or panoramic videos can effectively control the copying of panoramic images and track the source after illegal use. However, the method of adding watermarks to panoramic images in related technologies has the problem of deformation of the added watermark content or cumbersome adding steps. Summary of the invention

[0004] In view of this, the present application provides a watermark adding method, apparatus, device and computer-readable storage medium.

[0005] First, a first aspect of the present application provides a watermark adding method, comprising:

[0006] Acquire at least one watermark information and a panoramic image;

[0007] Determine the position where each watermark information is to be added in the area where the watermark information can be added in the panoramic image; the area where the watermark information can be added includes: an area irrelevant to the position of the stitching line corresponding to the panoramic image;

[0008] Determining a target position in the stitched image corresponding to the position to be added according to a transformation relationship between a plurality of stitched images used to generate the panoramic image and the panoramic image;

[0009] The watermark information is added at the target position to obtain a target image, and the target images are spliced ​​to generate a target panoramic image with the watermark information added thereto.

[0010] Optionally, the area to which watermark information can be added is determined by:

[0011] Determining a stitching area according to a stitching line obtained during the stitching process of the panoramic image;

[0012] An area in the panoramic image excluding the stitching area is determined as the area to which watermark information can be added.

[0013] Optionally, the area to which the watermark information can be added is determined according to a stitching line obtained during the stitching process of the panoramic image and a display size of the watermark information.

[0014] Optionally, the area to which watermark information can be added is an area in the panoramic image excluding a stitching area and an area adjacent to the stitching area;

[0015] The stitching area is determined according to a stitching line obtained during the stitching process of the panoramic image; and the size of an adjacent area of ​​the stitching area is determined according to a display size of the watermark information.

[0016] Optionally, the size of an area adjacent to the stitching area is greater than or equal to half of the display size of the watermark information.

[0017] Optionally, the area to which the watermark information can be added is determined according to a stitching line obtained during the stitching process of the panoramic image, a display size of the watermark information, and a target object in the panoramic image.

[0018] Optionally, the area to which the watermark information can be added is an area in the panoramic image excluding a stitching area, an adjacent area to the stitching area, and an area where the target object is located;

[0019] Among them, the stitching area is determined according to the stitching line obtained during the stitching process of the panoramic image; the size of the adjacent area of ​​the stitching area is determined according to the display size of the watermark information; and the area where the target object is located is determined according to the target object identified in the panoramic image.

[0020] Optionally, determining a location to be added in an area where watermark information can be added in the panoramic image includes:

[0021] Displaying an area in the panoramic image where watermark information can be added on the interactive interface;

[0022] When a selection operation of the user in the area to which watermark information can be added is detected, the position to be added is determined according to the operation position of the selection operation.

[0023] Optionally, there are multiple watermark information;

[0024] The contents, sizes and / or display styles of the multiple watermark information are different.

[0025] According to a second aspect of an embodiment of the present application, a watermark adding device is provided, including:

[0026] An acquisition module, used to acquire at least one watermark information and a panoramic image;

[0027] A position determination module, configured to determine a position to be added of each watermark information in an area where watermark information can be added in the panoramic image; the area where watermark information can be added includes: an area irrelevant to the position of a stitching line corresponding to the panoramic image;

[0028] The position determination module is further used to determine a target position corresponding to the position to be added in the stitched image according to a transformation relationship between a plurality of stitched images used to generate the panoramic image and the panoramic image;

[0029] The watermark adding module is used to add the watermark information at the target position to obtain a target image, and to stitch the target images to obtain a target panoramic image with the watermark information added.

[0030] According to a third aspect of an embodiment of the present application, a rendering device is provided, including:

[0031] processor;

[0032] a memory for storing processor-executable instructions;

[0033] When the processor executes the executable instructions, it is configured to execute any one of the methods described in the first aspect.

[0034] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is further provided, on which computer instructions are stored, and when the instructions are executed by a processor, the steps of any method described in the first aspect are implemented.

[0035] The technical solution provided by the embodiments of the present application may have the following beneficial effects:

[0036] The present application provides a watermark adding method, which obtains at least one watermark information and a panoramic image, and then determines the position to be added of each watermark information in the area of ​​the panoramic image where the watermark information can be added, wherein the area where the watermark information can be added includes: an area that is irrelevant to the position of a stitching line corresponding to the panoramic image; then, according to a transformation relationship between a plurality of stitched images used to generate the panoramic image and the panoramic image, determines the target position corresponding to the position to be added in the stitched image; finally, adds the watermark information at the target position to obtain a target image, and stitches the target image to generate a target panoramic image with the watermark information added. This embodiment implements adding watermark information to multiple stitched images used to generate the panoramic image before stitching, thereby avoiding the problem of watermark deformation. At the same time, there is no need to convert the watermark information into a three-dimensional format, which also reduces the computational complexity of adding the watermark. In addition, considering that when the watermark is added to the stitched image and then stitched together, there is a problem that the repeated parts between the images may be covered or the pixel values ​​may change during the stitching process. Therefore, the embodiment of the present application avoids the position of the stitching line in the panoramic image, that is, the area to which the watermark information can be added includes: an area that is irrelevant to the position of the stitching line corresponding to the panoramic image, thereby ensuring that the watermark information in the finally generated target panoramic image is presented completely and clearly, and avoiding the watermark information from being covered or changed during the stitching process.

[0037] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1A This is a schematic diagram of the architecture of a server and a client according to an exemplary embodiment of the present application;

[0039] Figure 1B This is a flow chart of an embodiment of a watermark adding method according to an exemplary embodiment of the present application;

[0040] Figure 2 This is a schematic diagram of a panoramic image according to an exemplary embodiment of the present application;

[0041] Figure 3A , Figure 3B and Figure 3C This is a schematic diagram of different stitched images according to an exemplary embodiment of the present application;

[0042] Figure 4 This is a schematic diagram of a stitching area according to an exemplary embodiment of the present application;

[0043] Figure 5 This is a schematic diagram of a stitching area and its adjacent areas according to an exemplary embodiment of the present application;

[0044] Figure 6 This is a schematic diagram of a target image according to an exemplary embodiment of the present application;

[0045] Figure 7 This is a schematic diagram of a target panoramic image to which watermark information is added according to an exemplary embodiment of the present application;

[0046] Figure 8 This is a schematic diagram of an embodiment of a watermark adding device according to an exemplary embodiment of the present application;

[0047] Fig. 9 The present application provides a structural schematic diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0048] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0049] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0050] It should be understood that although the terms first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0051] With the popularity of near-eye display devices, panoramic images or videos are widely used in various industries. As panoramic images or videos are widely used, the importance of copyright protection issues has gradually emerged. Among them, adding watermarks to panoramic images can effectively control the copying of panoramic images and track and trace the source after illegal use. The method of adding watermarks to panoramic images in related technologies usually has the following two implementation methods.

[0052] In the first implementation, the 3D panoramic image is mapped into a 2D panoramic image, watermark information is added to the 2D panoramic image, and then mapped into the 3D space. However, when the 2D panoramic image with watermark information is remapped into a 3D panoramic image, the watermark information is easily deformed.

[0053] In the second implementation, to add watermark information to the 3D panoramic image, the watermark information needs to be converted into a 3D format and then merged with the 3D panoramic image. However, converting the watermark information into a 3D format is relatively cumbersome, which increases the difficulty of adding.

[0054] In response to the above problems, an embodiment of the present application provides a watermark adding method, which first obtains at least one watermark information and a panoramic image, and then determines the position to be added of each watermark information in the area of ​​the panoramic image where the watermark information can be added, and the area where the watermark information can be added includes: an area that is irrelevant to the position of the stitching line corresponding to the panoramic image; then, based on the transformation relationship between multiple stitched images used to generate the panoramic image and the panoramic image, determines the target position corresponding to the position to be added in the stitched image; finally, adds the watermark information at the target position to obtain the target image, and stitches the target image to generate a target panoramic image with the watermark information added. This embodiment implements adding watermark information to multiple stitched images used to generate the panoramic image before stitching, thereby avoiding the problem of watermark deformation and reducing the computational complexity of adding watermarks. In addition, considering that if the stitching is performed after adding the watermark to the stitched image, the repeated parts between the images may be covered or the pixel values ​​may change during the stitching process, the position of the stitching line in the panoramic image is avoided, that is, the area to which the watermark information can be added includes: an area that is irrelevant to the position of the stitching line corresponding to the panoramic image, thereby ensuring that the watermark information in the finally generated target panoramic image is presented completely and clearly, and avoiding the watermark information from being covered or changed during the stitching process.

[0055] The watermark adding method may be performed by an electronic device, including but not limited to a terminal device or a computing device such as a server. Examples of the terminal device include but are not limited to: a smart phone / mobile phone, a tablet computer, a personal digital assistant (PDA), a laptop computer, a desktop computer, a media content player, a video game station / system, a virtual reality system, an augmented reality system, a wearable device (e.g., a watch, glasses, gloves, headwear (e.g., a hat, a helmet, a virtual reality headset, an augmented reality headset, a head-mounted device (HMD), a headband), a pendant, an armband, a leg ring, a shoe, a vest) or any other type of device.

[0056] The watermark adding method provided in the embodiment of the present application is applicable to any scenario in which a panoramic image or panoramic video is generated. In order to effectively control the copying of panoramic images and track and trace the source after illegal use, watermark information can be added to the panoramic image frames in the panoramic image or panoramic video.

[0057] Exemplary, for example, in a scenario where a user uses the panoramic shooting function of a mobile phone to take pictures, the mobile phone is used to collect stitched images and use the collected stitched images to generate a panoramic image. In this process, the mobile terminal can use the watermark adding method provided in the embodiment of the present application to add a watermark to the panoramic image, and obtain the target panoramic image with the watermark information added. The user can then share the target panoramic image with the watermark information added to a related platform (such as a social platform, etc.), thereby strengthening the protection of the copyright of the panoramic image through the watermark information, effectively controlling the copying of the panoramic image, and tracing the source after illegal use.

[0058] For example, see Figure 1A In the architecture of the server and the client, the user can obtain the panoramic image or panoramic video provided by the server through the client. For example, the user can access the designated multimedia website (server) through the browser (client) to browse or download the panoramic image or panoramic video provided by the multimedia website. Among them, the server pre-stores the panoramic image or panoramic video, or the server can communicate with the panoramic camera to obtain the panoramic image or panoramic video taken by the panoramic camera. Among them, the server can use the watermark adding method provided in the embodiment of the present application to add watermark information to the panoramic image or the panoramic image frame in the panoramic video, so as to obtain the target panoramic image or target panoramic video with the watermark information added. Then, the server can send the target panoramic image or target panoramic video with the watermark information added to the client connected to the server based on the needs of the actual scene, and the user of the client can watch the panoramic image or panoramic video with the watermark information added, so as to strengthen the protection of the copyright of the panoramic image or panoramic video through the watermark information, effectively control the copy of the panoramic video, and track and trace the source after illegal use.

[0059] Next, the watermark adding method provided by the embodiment of the present application is described: This embodiment implements adding watermark information to a panoramic image, and the panoramic image can be a single image or a panoramic image frame in a panoramic video. Figure 1B , Figure 1B The present invention provides a flowchart of a method for adding a watermark according to an embodiment of the present invention. The method can be executed by an electronic device, and the method includes:

[0060] In step S101, at least one watermark information and a panoramic image are obtained.

[0061] In step S102, the position where each watermark information is to be added is determined in the area where the watermark information can be added in the panoramic image; the area where the watermark information can be added includes: an area that is irrelevant to the position of the stitching line corresponding to the panoramic image.

[0062] In step S103, a target position corresponding to the position to be added in the stitched image is determined according to a transformation relationship between a plurality of stitched images used to generate the panoramic image and the panoramic image.

[0063] In step S104, the watermark information is added at the target position to obtain a target image, and the target images are stitched together to generate a target panoramic image with the watermark information added.

[0064] In one embodiment, the electronic device can obtain a generated panoramic image and multiple stitched images used to generate the panoramic image, wherein the panoramic image can be generated by other devices and sent to the electronic device, or can be generated by the electronic device based on the multiple stitched images.

[0065] It is understandable that this embodiment does not impose any restrictions on the source of the multiple stitched images, and specific selection can be made according to the actual application scenario. Exemplarily, the multiple stitched images are acquired in real time by an imaging device, for example, the multiple stitched images can be acquired by the same imaging device in a continuous time series, or the multiple stitched images can be acquired in real time by different imaging devices. Wherein, the imaging device can be installed on the electronic device; or, the imaging device and the electronic device are both independent devices, and the imaging device is communicatively connected to the electronic device. Wherein, the imaging device includes but is not limited to a color camera, a grayscale camera, or an infrared camera, etc. Exemplarily, the multiple stitched images can also be obtained from a related network platform (such as a related image website) or from a designated storage device, etc., but is not limited thereto.

[0066] Here, the electronic device generating the panoramic image is taken as an example: after acquiring the multiple stitched images, the electronic device can stitch the multiple stitched images into a panoramic image. In this process, the electronic device first needs to perform image registration, and then transform the multiple stitched images into the same coordinate system according to the image registration data, and finally fuse the registered multiple stitched images to generate the panoramic image.

[0067] In one example, in the process of generating the panoramic image, the electronic device can first extract feature points from each stitched image to obtain a feature point set corresponding to each stitched image; then, the feature point sets corresponding to the plurality of stitched images are matched in pairs, and the stitched images are registered according to the matched feature point sets (for example, the relative pose between the stitched images is obtained, etc.), and then, the plurality of stitched images are transformed into the same coordinate system according to the image registration data; then, the stitching lines between the plurality of stitched images after registration are determined based on a stitching line algorithm, and the plurality of stitched images after registration are fused based on the determined stitching lines to generate the panoramic image. For example, please refer to Figure 2 , Figure 2 The panoramic image shown is from Figure 3A The stitched image shown, Figure 3B The stitched images shown and Figure 3C The stitched images shown are stitched together to obtain, where Figure 2 The locations of the stitching lines between the stitched images are shown in .

[0068] In the process of generating the panoramic image, the electronic device can save relevant image registration data and related stitching parameters such as the determined stitching line information; wherein the saved stitching line information can be used to determine the area in the panoramic image where watermark information can be added, thereby avoiding the problem that the watermark information is added to the position near the stitching line and is covered or changed, and ensuring the complete presentation of the added watermark information in the panoramic image; the saved image registration data and related stitching parameters such as the stitching line information can be used in the subsequent stitching process of the target image with the watermark information added, without the need to repeatedly determine the relevant image registration data and related stitching parameters such as the stitching line information, which is beneficial to improving the stitching efficiency of the target image.

[0069] In some embodiments, after generating the panoramic image, the electronic device may use the watermark adding method of this embodiment to add watermark information to the panoramic image. The electronic device may obtain one or more preset watermark information; or the electronic device provides an interactive interface, and may obtain one or more watermark information selected by the user through the interactive interface.

[0070] The content, size and / or display style of the multiple watermark information obtained may be different, so as to improve the user's visual experience. Of course, the content of the watermark information can be specifically set according to the actual application scenario, and this embodiment does not impose any restrictions on this. For example, the content of the watermark information can be a number, text or pattern, etc., and the display style of the watermark information includes but is not limited to color, brightness, chroma, contrast or transparency, etc., but is not limited to this. As an example, the watermark information can be presented in the form of a picture.

[0071] In some embodiments, after acquiring the one or more watermark information and the panoramic image, the electronic device can determine the target area in the panoramic image to which the watermark information can be added based on the stitching line obtained during the stitching process of the panoramic image. The area to which the watermark information can be added includes: an area that is irrelevant to the position of the stitching line corresponding to the panoramic image, thereby ensuring that the watermark information is presented clearly and completely in the panoramic image.

[0072] In the first possible implementation, if the watermark information is added at or near the stitching line, after the watermark information is added to the stitched image, the part of the image near the stitching line may be covered during the stitching process, resulting in the problem that the watermark information is also covered, or the pixels (such as pixel values) at or near the stitching line may change, resulting in the watermark content changing, so that the watermark information cannot be presented clearly and completely. Therefore, the electronic device can determine the stitching area based on the stitching line obtained during the stitching process of the panoramic image, and then determine the area in the panoramic image excluding the stitching area as the area where the watermark information can be added. This embodiment avoids the stitching line area when adding the watermark information, thereby ensuring that the watermark information is presented clearly and completely in the panoramic image.

[0073] In one example, the stitching line can be used as the middle position, and parts obtained by taking a preset number of pixels on both sides can be used as the stitching area, for example Figure 4 The position of the stitching area is shown. The preset number of pixels can be determined according to a specific stitching line algorithm. In other words, the size of the stitching area is determined according to the stitching line algorithm corresponding to the stitching line.

[0074] Exemplarily, the pixels in the panoramic image that belong to the stitching area may be recorded, and the pixels in the panoramic image that do not belong to the stitching area are the pixels that belong to the area to which watermark information can be added.

[0075] Of course, when generating the panoramic image, the area to which the watermark information can be added can be determined in advance according to the acquired stitching line. This embodiment does not impose any restriction on the timing of determining the area to which the watermark information can be added.

[0076] In the second possible implementation method, considering that if the watermark information is added near the stitching area, the watermark information requires a certain display space, part of the watermark information may be within the stitching area, which may cause part of the watermark information to be blocked or changed. Therefore, in order to further ensure that the watermark information is presented clearly and completely in the panoramic image and avoid the watermark information from being covered, the area where the watermark information can be added can be determined based on the stitching line obtained in the stitching process of the panoramic image and the display size of the watermark information.

[0077] The electronic device may determine a stitching area according to a stitching line obtained during the stitching process of the panoramic image; and determine a size of an adjacent area of ​​the stitching area according to a display size of the watermark information, such as Figure 5 The adjacent areas of the stitched area are exemplarily shown, and then the area in the panoramic image excluding the stitched area and the adjacent areas of the stitched area is determined as the area to which watermark information can be added, thereby avoiding the problem that part of the watermark information is blocked or changed, and further ensuring that the watermark information is presented clearly and completely in the panoramic image.

[0078] In some embodiments, the size of the adjacent area of ​​the stitching area is greater than or equal to half of the display size of the watermark information. Exemplarily, assuming that the watermark information is presented in a rectangular picture style, assuming that the electronic device can determine the center of the watermark information according to the position to be added, when the center of the watermark information is at the edge of the stitching area, then at most half of the content of the rectangular picture may be within the stitching area, thereby affecting the clear presentation of the watermark content. In this case, it is necessary to determine that the size of the adjacent area of ​​the stitching area is at least equal to half of the display size of the watermark information. Exemplarily, assuming that the watermark information is presented in a rectangular picture style, assuming that the electronic device can determine the upper left corner position or the upper right corner position of the watermark information according to the position to be added, when the upper left corner or the upper right corner of the watermark information is at the edge of the stitching area, then more than half of the content of the rectangular picture may be within the stitching area, thereby affecting the clear presentation of the watermark content. In this case, it is necessary to determine that the size of the adjacent area of ​​the stitching area is at least greater than half of the display size of the watermark information.

[0079] Exemplarily, the watermark information is presented in the form of a picture, and the display size of the watermark information includes the resolution of the picture containing the watermark information.

[0080] In a third possible implementation, if watermark information is added to certain positions in a panoramic image, such as the position of a face in a person panoramic image, the position of a characteristic scene in a landscape panoramic image, etc., it may be blocked, affecting the visibility of the panoramic image and reducing the user's visual perception. Therefore, in order to ensure the viewing quality of the panoramic image, the electronic device may determine the area where the watermark information can be added based on the stitching line obtained during the stitching process of the panoramic image, the display size of the watermark information, and the target object in the panoramic image.

[0081] The electronic device can determine a stitching area based on stitching lines obtained during the stitching process of the panoramic image; and determine the size of an adjacent area of ​​the stitching area based on the display size of the watermark information; and identify a target object in the panoramic area and determine the area where the target object is located; and then determine an area in the panoramic image excluding the stitching area, an adjacent area of ​​the stitching area, and an area where the target object is located as an area to which watermark information can be added, thereby preventing the added watermark information from obscuring the target object in the panoramic image and ensuring the viewing quality of the panoramic image.

[0082] Of course, the target object can be specifically set according to the type of the panoramic image, and this embodiment does not impose any restrictions on this. For example, if the type of the panoramic image is a person image, the target object can be a face or a person, etc. For example, if the type of the panoramic image is a landscape painting, the target object can be a specified scene. For example, if the type of the panoramic image is an object image, the target object can be a specified object. Figure 2 In the panoramic image shown, the target object may be a building, a vehicle, etc.

[0083] In some embodiments, for step S102, after determining the area in the panoramic image where watermark information can be added, the electronic device can determine a position to add each watermark information in the area in the panoramic image where watermark information can be added.

[0084] In one example, the area in the panoramic image where watermarks can be added can be displayed on the interactive interface of the electronic device, and the user can select one or more locations to be added in the area where watermark information can be added; for example, the electronic device can display the area in the panoramic image where watermarks can be added on the interactive interface, and then, when a selection operation of the user in the area where watermark information can be added is detected, the location to be added is determined according to the operation location of the selection operation, for example, the location to be added can be determined according to the location where the user clicks on the interactive interface, thereby enabling the user to customize the location to add the watermark according to their actual needs, thereby meeting the user's personalized needs.

[0085] Furthermore, in order to facilitate users to clearly identify the area where watermark information can be added, the area where watermark information can be added can also be highlighted, such as highlighting the area where watermark information can be added or framing the area where watermark information can be added, so that users can select one or more locations to be added in the area where watermark information can be added.

[0086] In another example, the electronic device can randomly determine one or more locations to be added in the area where watermark information can be added in the panoramic image, without the user manually selecting the watermark adding location, which helps to reduce the user's operation steps and improve the user's experience.

[0087] Exemplarily, each watermark information may have one or more positions to be added. For example, one watermark information and multiple positions to be added may be obtained to add the same watermark information to different positions. The watermark can be present when the panoramic image is previewed from multiple angles, thereby strengthening the protection of the copyright of the panoramic image by the watermark. Exemplarily, multiple watermark information and corresponding multiple positions to be added may be obtained. Each watermark information may have one or more positions to be added. Different watermark information may be added to different positions. The watermark can be present when the panoramic image is previewed from multiple angles, thereby strengthening the protection of the copyright of the panoramic image by the watermark. Different watermark information is also conducive to improving the user's visual perception.

[0088] After determining the at least one position to be added, in step S103, the electronic device can determine the target position corresponding to the position to be added in the stitched image based on the transformation relationship between the multiple stitched images used to generate the panoramic image and the panoramic image, that is, the electronic device can use the transformation relationship between the multiple stitched images used to generate the panoramic image and the panoramic image to transform the position to be added from the coordinate system where the panoramic image is located to the coordinate system where the stitched image is located, thereby obtaining the target position corresponding to the position to be added in the stitched image. Among them, the transformation relationship between the multiple stitched images used to generate the panoramic image and the panoramic image can be determined in the process of generating the panoramic image. It can be understood that the specific form of the transformation relationship can be specifically set according to the actual application scenario, and this embodiment does not have any restrictions on this. For example, the transformation relationship can be represented by a projection matrix.

[0089] Then in step S104, the electronic device can add the watermark information at the target position in the stitched image to obtain the target image, and stitch the target image to generate a target panoramic image with the watermark information. This embodiment implements stitching after adding watermark information to multiple stitched images used to generate the panoramic image, avoiding the problem of watermark deformation, and also reducing the computational complexity of adding watermarks. In addition, considering that the repeated parts between images may be covered or some pixels may change during the stitching process after adding watermarks to the stitched images, the position of the stitching line in the panoramic image is avoided, that is, the area where the watermark information can be added includes: an area that is irrelevant to the position of the stitching line corresponding to the panoramic image, to ensure that the watermark information in the target panoramic image generated finally is fully presented, and to avoid the watermark information being covered or changed during the stitching process.

[0090] Exemplarily, the watermark information is presented in the form of a picture, and the picture including the watermark information can be fused with the stitched image to generate the target image.

[0091] In some embodiments, considering that other image information of the target image has not changed except for the addition of watermark information, the electronic device can stitch the target image according to relevant stitching parameters such as image registration data and stitching line information stored when generating the panoramic image to obtain the target panoramic image with the watermark information added, which is beneficial to improve stitching efficiency and shorten stitching time.

[0092] In some embodiments, taking the watermark information presented in the form of a picture as an example, the color gamut range of the panoramic image can also be obtained, and the color of the picture including the watermark information can be adjusted according to the color gamut range of the panoramic image, so that the adjusted picture including the watermark information matches the color scheme of the panoramic image, which is conducive to ensuring the viewing experience of the target panoramic image with the watermark information added, and avoiding the added watermark information being too abrupt and affecting the user's visual experience.

[0093] For example, the electronic device determines a watermark information and a position to be added corresponding to the watermark information, and the target position in the spliced ​​image corresponding to the position to be added is located at Figure 3A In the stitched image shown, the electronic device can Figure 3A Add the watermark information to the target position of the spliced ​​image to obtain Figure 6 Considering that other information in the target image has not changed except for the addition of the watermark information, the electronic device can stitch the target image according to the image registration data and stitching line information stored when generating the panoramic image. Figure 6 The target image shown, Figure 3B as well as Figure 3C The spliced ​​image shown in FIG. 1 generates an image with watermark information added as shown in FIG. Figure 7 The target panoramic image is shown.

[0094] Correspondingly, such as Figure 8 As shown, the embodiment of the present application also provides a watermark adding device, including:

[0095] The acquisition module 201 is used to acquire at least one watermark information and a panoramic image.

[0096] The position determination module 202 is used to determine the position where each watermark information is to be added in the area where the watermark information can be added in the panoramic image; the area where the watermark information can be added includes: an area that is irrelevant to the position of the stitching line corresponding to the panoramic image.

[0097] The position determination module 202 is further configured to determine a target position corresponding to the position to be added in the stitched image according to a transformation relationship between a plurality of stitched images used to generate the panoramic image and the panoramic image.

[0098] The watermark adding module 203 is used to add the watermark information at the target position to obtain a target image, and to stitch the target images to obtain a target panoramic image with the watermark information added.

[0099] In one embodiment, it also includes a region determination module, including: determining a stitching region according to a stitching line obtained during the stitching process of the panoramic image; and determining a region in the panoramic image excluding the stitching region as the region to which watermark information can be added.

[0100] In one embodiment, the area to which the watermark information can be added is determined according to a stitching line obtained during the stitching process of the panoramic image and a display size of the watermark information.

[0101] In one embodiment, the area to which watermark information can be added is an area in the panoramic image excluding a stitching area and an adjacent area of ​​the stitching area; wherein the stitching area is determined based on a stitching line obtained during a stitching process of the panoramic image; and a size of an adjacent area of ​​the stitching area is determined based on a display size of the watermark information.

[0102] In one embodiment, the size of the adjacent area of ​​the stitching area is greater than or equal to half of the display size of the watermark information.

[0103] In one embodiment, the area to which the watermark information can be added is determined according to a stitching line obtained during the stitching process of the panoramic image, a display size of the watermark information, and a target object in the panoramic image.

[0104] In one embodiment, the area to which watermark information can be added is an area in the panoramic image excluding a stitching area, an adjacent area of ​​the stitching area, and an area where the target object is located; wherein the stitching area is determined based on a stitching line obtained during a stitching process of the panoramic image; a size of an adjacent area of ​​the stitching area is determined based on a display size of the watermark information; and the area where the target object is located is determined based on an identified target object in the panoramic image.

[0105] In one embodiment, the location determination module 202 includes:

[0106] An area display unit, used for displaying the area in the panoramic image to which a watermark can be added on an interactive interface;

[0107] The position adding unit is used to determine at least one position to be added according to the operation position of the selection operation when a selection operation of the user in the area where the watermark information can be added is detected.

[0108] In one embodiment, there are multiple watermark information; the multiple watermark information have different contents, sizes and / or display styles.

[0109] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can refer to the partial description of the method embodiments. The device embodiments described above are merely schematic, in which the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application scheme. A person of ordinary skill in the art can understand and implement it without paying any creative work.

[0110] Correspondingly, such as Fig. 9 The present application also provides an electronic device 30, including a processor 31; a memory 32 for storing executable instructions, the memory 32 including executable instructions 33; wherein when the processor 31 executes the executable instructions 33, it is configured as follows:

[0111] Acquire at least one watermark information and a panoramic image;

[0112] Determine the position where each watermark information is to be added in the target area where the watermark information can be added in the panoramic image; the area where the watermark information can be added includes: an area that is irrelevant to the position of the stitching line corresponding to the panoramic image;

[0113] Determining a target position in the stitched image corresponding to the position to be added according to a transformation relationship between a plurality of stitched images used to generate the panoramic image and the panoramic image;

[0114] The watermark information is added at the target position to obtain a target image, and the target images are spliced ​​to generate a target panoramic image with the watermark information added thereto.

[0115] The processor 31 executes the executable instructions 33 included in the memory 32. The processor 31 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0116] The memory 32 stores executable instructions (such as computer programs, etc.) of the watermark adding method. The memory 32 may include at least one type of storage medium, including flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. Moreover, the device may cooperate with a network storage device that performs the storage function of the memory through a network connection. The memory 32 may be an internal storage unit of the device 30, such as a hard disk or memory of the device 30. The memory 32 may also be an external storage device of the device 30, such as a plug-in hard disk equipped on the device 30, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Further, the memory 32 may also include both an internal storage unit of the device 30 and an external storage device. The memory 32 is used to store executable instructions 33 and other programs and data required by the device. The memory 32 may also be used to temporarily store data that has been output or is to be output.

[0117] Various embodiments described herein can be implemented using computer readable media such as computer software, hardware or any combination thereof. For hardware implementation, the embodiments described herein can be implemented using at least one of application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and electronic units designed to perform the functions described herein. For software implementation, embodiments such as processes or functions can be implemented with separate software modules that allow execution of at least one function or operation. Software code can be implemented by a software application (or program) written in any appropriate programming language, and the software code can be stored in a memory and executed by a controller.

[0118] The electronic device 30 may be a computing device such as a server, a desktop computer, a notebook, a PDA, or a mobile phone. The device may include, but is not limited to, a processor 31 and a memory 32. Those skilled in the art will appreciate that Fig. 9 It is only an example of the electronic device 30 and does not constitute a limitation of the electronic device 30. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the device may also include input and output devices, network access devices, buses, etc.

[0119] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.

[0120] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the above instructions can be executed by a processor of the device to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0121] A non-transitory computer-readable storage medium enables a terminal to execute the above method when instructions in the storage medium are executed by a processor of an electronic device.

[0122] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0123] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

[0124] The above are only preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application.

Claims

1. A watermark adding method, characterized in that: include: Acquire at least one watermark information and a panoramic image; Determining a location where each watermark information is to be added in an area where watermark information can be added in the panoramic image; The area to which watermark information can be added includes: an area irrelevant to the position of the stitching line corresponding to the panoramic image; the area to which watermark information can be added is an area in the panoramic image excluding the stitching area, the adjacent area of ​​the stitching area, and the area where the target object is located; wherein the stitching area is determined according to the stitching line obtained during the stitching process of the panoramic image; the size of the adjacent area of ​​the stitching area is determined according to the display size of the watermark information; the area where the target object is located is determined according to the identified target object in the panoramic image; Determining a target position in the stitched image corresponding to the position to be added according to a transformation relationship between a plurality of stitched images used to generate the panoramic image and the panoramic image; The watermark information is added at the target position to obtain a target image, and the target images are spliced ​​to generate a target panoramic image with the watermark information added thereto.

2. The method according to claim 1, characterized in that The size of the adjacent area of ​​the stitching area is greater than or equal to half of the display size of the watermark information.

3. The method according to claim 1, characterized in that The area to which the watermark information can be added is determined according to a stitching line obtained during the stitching process of the panoramic image, a display size of the watermark information, and a target object in the panoramic image.

4. The method according to claim 1, characterized in that: The determining of a location where each watermark information is to be added in an area where watermark information can be added in the panoramic image comprises: Displaying the area in the panoramic image where watermark information can be added on the interactive interface; When a selection operation of the user in the area to which watermark information can be added is detected, the position to be added is determined according to the operation position of the selection operation.

5. The method according to claim 1, characterized in that There are multiple watermark information; The contents, sizes and / or display styles of the multiple watermark information are different.

6. A watermark adding device, characterized in that: include: An acquisition module, used to acquire at least one watermark information and a panoramic image; A position determination module, used for determining a position where each watermark information is to be added in an area where watermark information can be added in the panoramic image; The area to which watermark information can be added includes: an area irrelevant to the position of the stitching line corresponding to the panoramic image; the area to which watermark information can be added is an area in the panoramic image excluding the stitching area, the adjacent area of ​​the stitching area, and the area where the target object is located; wherein the stitching area is determined according to the stitching line obtained during the stitching process of the panoramic image; the size of the adjacent area of ​​the stitching area is determined according to the display size of the watermark information; the area where the target object is located is determined according to the identified target object in the panoramic image; The position determination module is further used to determine a target position corresponding to the position to be added in the stitched image according to a transformation relationship between a plurality of stitched images used to generate the panoramic image and the panoramic image; The watermark adding module is used to add the watermark information at the target position to obtain a target image, and to stitch the target images to obtain a target panoramic image with the watermark information added.

7. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, when the processor executes the executable instructions, it is configured to execute the method according to any one of claims 1 to 5.

8. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the instruction is executed by a processor, the steps of any method described in claims 1 to 5 are implemented.

Images