Image processing method, device, equipment, and storage medium
The image processing method enhances photography experiences by applying shooting templates based on detected objects, improving user experience through increased template relevance and functionality.
Patent Information
- Application Number
- JP2023572548
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-07-01
- Filing Date
- 2022-06-13
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2042-06-13
AI Technical Summary
Existing image processing systems lack the ability to enhance photography experiences by providing shooting templates tailored to detected objects, leading to a lack of consistency and richness in functionality.
An image processing method that detects preset objects on the shooting screen and applies corresponding shooting templates, including description information, to enrich the user experience by increasing template relevance and functionality.
The method improves user experience by recommending shooting templates that align with detected objects, enhancing the functionality and consistency of the photography page.
Smart Images

Figure 0007739465000001 
Figure 0007739465000002 
Figure 0007739465000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to the field of data processing, and more particularly to an image processing method, apparatus, device, and storage medium.
[0002] This application claims priority to a Chinese patent application bearing application number 202110744004.0 and entitled "Image Processing Method, Apparatus, Device and Storage Medium" filed with the State Intellectual Property Administration of China on July 1, 2021, the entire contents of which are incorporated herein by reference. [Background technology]
[0003] With the popularity of multimedia short videos, interest in taking pictures or videos is increasing, and how to improve the photography experience by enriching the functions of the photography page has been a pressing technical issue. Summary of the Invention [Means for solving the problem]
[0004] To solve or at least partially solve the above technical problems, the disclosed embodiments provide an image processing method, which can recommend a shooting template to a user based on preset objects in a shooting screen, enrich the functionality of the shooting page, and improve the user's shooting experience.
[0005] In a first aspect, the present disclosure provides an image processing method, said method comprising: a step of acquiring a shooting template corresponding to a preset object when the preset object is detected in a shooting screen of the shooting page, the shooting template being determined based on the preset object, and the shooting template including at least description information of the preset object; applying the shooting template within a shooting screen of the shooting page, and displaying a preview effect diagram corresponding to the shooting template on the shooting page.
[0006] In an optional embodiment, the shooting templates corresponding to the preset objects include a plurality of shooting templates, the plurality of shooting templates including a default preview template, and the method further comprises: and further comprising: displaying a photography template corresponding to the preset object on the photography page; Correspondingly, the step of applying the shooting template in the shooting screen of the shooting page and displaying a preview effect diagram corresponding to the shooting template on the shooting page includes: Applying the default preview template to a shooting screen of the shooting page, and displaying a preview effect diagram corresponding to the default preview template on the shooting page.
[0007] In an optional embodiment, the photography template further includes at least one of an item resource, an audio resource, a virtual reality (AR) resource, and an interactive resource.
[0008] In an optional embodiment, after the step of displaying a preview effect diagram corresponding to the default preview template on the shooting page, The method further includes a step of applying the first shooting template to a shooting screen of the shooting page in response to a selection operation on a first shooting template from the plurality of shooting templates, and switching a preview effect image corresponding to the default preview template displayed on the shooting page to a preview effect image corresponding to the first shooting template.
[0009] In an alternative embodiment, the method comprises: The method further includes switching a current display state of the photography template on the photography page to a hidden state in response to a trigger operation on an identification stop control on the photography page.
[0010] In an optional embodiment, when a preset object is detected in the photography screen of the photography page, before the step of obtaining a photography template corresponding to the preset object, acquiring a photographed image of a photographed page and extracting image features of the photographed image; The method further includes matching the image features with features of a preset object, and determining that the preset object exists in the shooting screen if the matching is successful.
[0011] In a second aspect, the present disclosure provides an image processing apparatus, the apparatus comprising: a first acquisition module, when a preset object is detected in a photography screen of a photography page, for acquiring a photography template corresponding to the preset object, the photography template being determined based on the preset object, and the photography template including at least description information of the preset object; a display module used for applying the shooting template within the shooting screen of the shooting page and displaying a preview effect diagram corresponding to the shooting template on the shooting page.
[0012] In a third aspect, the present disclosure provides a computer-readable storage medium having stored thereon instructions that, when run on a terminal device, cause the terminal device to implement the above method.
[0013] In a fourth aspect, the present disclosure provides an apparatus, the apparatus including a memory, a processor, and a computer program stored in the memory and executable by the processor, the computer program, when executed by the processor, implementing the method described above.
[0014] In a fifth aspect, the present disclosure provides a computer program product, the computer program product including computer programs / instructions that, when executed by a processor, implement the above method.
[0015] Compared with the prior art, the technical solutions provided by the disclosed embodiments have the following advantages:
[0016] In the image processing method provided by the embodiment of the present disclosure, when a preset object is detected on the shooting screen of a shooting page, a shooting template corresponding to the preset object is obtained, and the shooting template includes at least description information of the preset object. Then, the shooting template is applied to the shooting screen of the shooting page, and a preview effect image corresponding to the shooting template is displayed on the shooting page. Therefore, in the embodiment of the present disclosure, a shooting template can be recommended to the user based on the preset object detected on the shooting screen, thereby increasing the consistency between the recommended shooting template and the content on the shooting screen, enriching the functionality of the shooting page, and improving the user's shooting experience.
[0017] The drawings herein are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure, and together with the specification serve to explain the principles of the present disclosure.
[0018] In order to more clearly describe the embodiments of the present disclosure or the technical solutions of the prior art, the following briefly introduces drawings used in the description of the embodiments or the prior art, and it is obvious that those skilled in the art can further obtain other drawings based on these drawings without requiring creative work. [Brief explanation of the drawings]
[0019] [Figure 1] FIG. 1 is a flowchart of an image processing method provided by an embodiment of the present disclosure. [Figure 2] FIG. 2 is a schematic diagram of a capture page provided by an embodiment of the present disclosure. [Figure 3] FIG. 3 is a schematic diagram of another capture page provided by an embodiment of the present disclosure. [Figure 4] FIG. 4 is a structural schematic diagram of an image processing device provided by an embodiment of the present disclosure. [Figure 5] FIG. 5 is a structural schematic diagram of an image processing device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0020] In order to more clearly understand the above-mentioned objects, features, and advantages of the present disclosure, the present disclosure will be further described below. It is necessary to note that, if there is no conflict, the embodiments and features of the embodiments of the present disclosure can be combined with each other.
[0021] In the following description, numerous specific details are set forth to provide a thorough understanding of the present disclosure. However, the present disclosure may be implemented in other ways different from those described herein, and it should be apparent that the embodiments in the specification are merely some embodiments of the present disclosure, but not all embodiments.
[0022] To enhance the functionality of the photography page, the disclosed embodiment provides an image processing method. Specifically, when a preset object is detected on the photography screen of the photography page, a photography template corresponding to the preset object is first obtained, and the photography template includes at least description information of the preset object. Next, the photography template is applied to the photography screen of the photography page, and a preview effect image corresponding to the photography template is displayed on the photography page. Therefore, the disclosed embodiment can recommend a photography template to the user based on the preset object detected on the photography screen. This increases the consistency between the recommended photography template and the content on the photography screen, enriching the functionality of the photography page and improving the user's photography experience.
[0023] Based on this, an embodiment of the present disclosure provides an image processing method. Figure 1 is a flowchart of the image processing method provided by the embodiment of the present disclosure. The method includes S101 and S102.
[0024] S101: When a preset object is detected in a photography screen of a photography page, a photography template corresponding to the preset object is obtained.
[0025] The photography template is determined based on the preset object, and the photography template includes at least description information of the preset object.
[0026] In an embodiment of the present disclosure, when a photography page is opened in a specific photography mode, the presence of a preset object in the photography screen captured by the camera is detected, and if it is determined that a preset object exists in the photography screen, a photography template determined based on the preset object is obtained. The preset object may be a specific object set in advance, such as a sunflower, green foxtail, or a cola bottle.
[0027] In an alternative embodiment, the photographic image of the photographing page is first acquired and assumed to be the first photographic image. Image features of the first photographic image are then extracted. The image features are matched with the features of the preset object. If the match is successful, it is determined that the preset object exists in the first photographic image. If the image features and the features of the preset object cannot be matched successfully, it is determined that the preset object does not exist in the first photographic image. The photographic image of the next frame after the first photographic image is acquired and assumed to be the second photographic image. The detection of the preset object continues in the second photographic image until the preset object is detected in the photographic image of the photographing page. The features of the preset object are acquired and stored in advance and used as feature matching standard information. For example, the features of a sunflower are acquired and stored in advance and used to match the image features corresponding to the photographic image.
[0028] In another alternative embodiment, the features of multiple preset objects can be acquired and stored in advance, and after extracting the image features of the shooting screen of the shooting page, the image features are matched with the features of each preset object, and the preset object corresponding to the successfully matched features is determined. For example, the features of at least three preset objects, such as a sunflower feature, a foxtail feature, and a cola bottle feature, are acquired and stored in advance, and after extracting the image features of the shooting screen, the image features are matched with the sunflower feature, the foxtail feature, and the cola bottle feature, respectively. Assuming that the image features are successfully matched with the sunflower feature, a shooting template corresponding to the sunflower is obtained.
[0029] In an embodiment of the present disclosure, a photography template corresponding to a preset object includes description information of the preset object, and the description information of the preset object may include the name of the preset object, attribute information, etc. For example, description information of a sunflower may include the name "Sunflower" and attribute information such as "Loves the sun, born facing the sun."
[0030] However, the disclosed embodiment can set various types of description information to the preset object according to needs, and the disclosed embodiment is not limited thereto.
[0031] In an alternative embodiment, the photography template may further include at least one of an item resource, an audio resource, a virtual reality (AR) resource, and an interactive resource, where the item resource refers to an item for photography, such as a "cat ear" item, the audio resource may include sound effects or music, the AR resource refers to a resource with a 3D effect, such as a 3D cartoon character, and the interactive resource refers to a resource that realizes an interactive function based on an interactive control, such as a purchase link or purchase control of a preset object.
[0032] S102, applying the photography template to the photography screen of the photography page, and displaying a preview effect diagram corresponding to the photography template on the photography page.
[0033] In the disclosed embodiment, after obtaining the shooting template corresponding to the preset object, the shooting template is applied in the shooting screen of the shooting page, and a preview effect diagram of the current shooting screen when the shooting template is used is displayed on the shooting page.
[0034] 2 is a schematic diagram of a photography page provided by an embodiment of the present disclosure. The preset object is a sunflower, and the photography page displays a preview effect image of the current photography screen using a photography template corresponding to the sunflower. The preview effect image displays descriptive information about the sunflower included in the photography template, such as the name "Sunflower" and attribute information such as "Love the sun, born facing the sun."
[0035] In practical application, a user can trigger image or video capture by clicking the capture control on the capture page. During the capture process, the capture page will display a preview effect diagram corresponding to the preset object's capture template, and the capture result image or capture result video obtained after capture will display the effect of the capture template.
[0036] In an image processing method provided by an embodiment of the present disclosure, when a preset object is detected on the shooting screen of a shooting page, a shooting template corresponding to the preset object is obtained, and the shooting template includes at least description information of the preset object. Then, the shooting template is applied to the shooting screen of the shooting page, and a preview effect image corresponding to the shooting template is displayed on the shooting page. Therefore, in an embodiment of the present disclosure, a shooting template can be recommended to a user based on the preset object detected on the shooting screen, thereby increasing the consistency between the recommended shooting template and the content on the shooting screen, enriching the functionality of the shooting page, and improving the user's shooting experience.
[0037] In an optional embodiment, after detecting a preset object on the shooting screen of the shooting page, a plurality of shooting templates can be determined based on the preset object, and after obtaining the plurality of shooting templates corresponding to the preset object, the plurality of shooting templates corresponding to the preset object are displayed on the shooting page.
[0038] 3 is a schematic diagram of another photography page provided by an embodiment of the present disclosure. At the bottom of the photography page, multiple photography templates corresponding to preset objects on the photography screen are displayed, and the currently selected photography template can be switched by sliding the screen.
[0039] In addition, the plurality of shooting templates corresponding to the preset objects may include a default preview template, and when the plurality of shooting templates corresponding to the preset objects are displayed on the shooting page, the default preview template can be applied to the shooting screen of the shooting page, and a preview effect diagram corresponding to the default preview template can be displayed on the shooting page. As shown in Figure 3 above, the preview effect diagram corresponding to the default preview template is displayed on the shooting page.
[0040] In an embodiment of the present disclosure, in response to a selection operation on a first shooting template among a plurality of shooting templates, the first shooting template can be applied to the shooting screen of the shooting page, and the preview effect image corresponding to the default preview template displayed on the shooting page can be switched to the preview effect image corresponding to the first shooting template.
[0041] In an optional embodiment, by sliding the bottom position of the shooting page shown in FIG. 3, the default preview template can be switched to another shooting template, which is assumed to be the first shooting template, and the preview effect diagram corresponding to the default preview template displayed on the shooting page is switched to the preview effect diagram corresponding to the first shooting template.
[0042] In another optional embodiment, the shooting page may further be configured with a recognition stop control, and when a trigger operation is received on the recognition stop control of the shooting page, the current display state of the shooting template on the shooting page can be switched to a hidden state, and the preview effect diagram of the shooting template will not be displayed on the shooting page at the same time, that is, the current shooting mode is stopped and the shooting mode is returned to the normal shooting mode.
[0043] Based on the above method embodiment, the present disclosure further provides an image processing device. Figure 4 is a structural schematic diagram of the image processing device provided by the present disclosure embodiment. The device includes: a first acquisition module 401, which is used to acquire a shooting template corresponding to a preset object when the preset object is detected in the shooting screen of the shooting page, and the shooting template is determined based on the preset object, and the shooting template includes at least description information of the preset object; a display module 402, which is used for applying the shooting template within the shooting screen of the shooting page and displaying a preview effect diagram corresponding to the shooting template on the shooting page.
[0044] In an optional embodiment, the photography templates corresponding to the preset objects include a plurality of photography templates, the plurality of photography templates including a default preview template, and the device further: a display module for displaying a photography template corresponding to the preset object on the photography page; Correspondingly, the display module specifically comprises: The default preview template is applied to the photographing screen of the photographing page, and a preview effect diagram corresponding to the default preview template is displayed on the photographing page.
[0045] In an optional embodiment, the photography template further includes at least one of an item resource, an audio resource, a virtual reality (AR) resource, and an interactive resource.
[0046] In an alternative embodiment, the apparatus comprises: The camera further includes a first switching module for applying the first shooting template to the shooting screen of the shooting page in response to a selection operation on a first shooting template among the plurality of shooting templates, and switching a preview effect image corresponding to the default preview template displayed on the shooting page to a preview effect image corresponding to the first shooting template.
[0047] In an alternative embodiment, the apparatus comprises: The imaging device further includes a second switching module, which is used to switch the current display state of the imaging template on the imaging page to a hidden state in response to a trigger operation on the identification stop control of the imaging page.
[0048] In an alternative embodiment, the apparatus comprises: an extraction module for acquiring a captured image of a captured page and extracting image features of the captured image; a matching module used to match the image features with features of a preset object; The system further includes a determination module for determining that the preset object exists in the photographic screen when the matching result of the matching module is a successful match.
[0049] In the image processing device provided in the disclosed embodiment, when a preset object is detected on the shooting screen of a shooting page, a shooting template corresponding to the preset object is obtained, and the shooting template includes at least description information of the preset object. Then, the shooting template is applied to the shooting screen of the shooting page, and a preview effect image corresponding to the shooting template is displayed on the shooting page. Therefore, in the disclosed embodiment, a shooting template can be recommended to a user based on the preset object detected on the shooting screen, thereby increasing the consistency between the recommended shooting template and the content on the shooting screen, enriching the functionality of the shooting page, and improving the user's shooting experience.
[0050] In addition to the above method and apparatus, the disclosed embodiments further provide a computer-readable storage medium having instructions stored thereon that, when executed by a terminal device, cause the terminal device to implement the image processing method described in the disclosed embodiments.
[0051] The disclosed embodiments further provide a computer program product, which includes computer programs / instructions that, when executed by a processor, implement the image processing method described in the disclosed embodiments.
[0052] In addition, the present disclosure further provides an image processing device, as shown in FIG. 5 , The image processing device may include a processor 501, a memory 502, an input device 503, and an output device 504. The number of processors 501 in the image processing device may be one or more, and Fig. 5 illustrates an example in which one processor is provided. In some embodiments of the present disclosure, the processor 501, the memory 502, the input device 503, and the output device 504 are connected via a bus or other method, and Fig. 5 illustrates an example in which they are connected via a bus.
[0053] The memory 502 can be used to store software programs and modules, and the processor 501 executes the software programs and modules stored in the memory 502 to perform various functional applications and data processing of the image processing device. The memory 502 can mainly include a program storage area and a data storage area, and the program storage area can store an operating system, an application program required for at least one function, etc. The memory 502 can also include high-speed random access memory and non-volatile memory such as at least one magnetic disk storage device, flash storage device, or other volatile solid-state storage device. The input device 503 can be used to receive input numeric or character information and to generate signal inputs related to user settings and function control of the image processing device.
[0054] Specifically, in this embodiment, the processor 501 loads executable files corresponding to the processes of one or more application programs into the memory 502 in accordance with the following instructions, and executes the application programs stored in the memory 502 on the processor 501, thereby implementing various functions of the image processing device.
[0055] It should be noted that, in this specification, relational terms such as "first," "second," etc. are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any actual relationship or order between those entities or operations. Furthermore, the terms "comprise," "comprises," or any variation thereof are intended to cover a non-exclusive inclusion, whereby a process, method, article, or device comprising a set of elements not only includes those elements, but also includes other elements not expressly stated, or includes elements inherent in the process, method, article, or device. Without further limitation, an element qualified by "comprises ..." does not exclude the presence of other identical elements in the process, method, article, or device that includes the element.
[0056] The foregoing are merely specific embodiments of the present disclosure, by which those skilled in the art can understand or realize the present disclosure. Many modifications to these examples will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other examples without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the examples described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. 1. An image processing method, comprising: a step of obtaining a photography template corresponding to a preset object and determined based on the preset object when a preset object is detected within a photography screen of a photography interface, the photography template being a preset photography style, the photography template including description information of the preset object, and the description information including a name and attribute information of the preset object; applying the photography template within a photography screen of the photography interface, and displaying a preview effect diagram corresponding to the photography template on the photography interface; switching a current display state of the photography template in the photography interface to a hidden state in response to a trigger operation on an identification stop control of the photography interface; Including, The photography templates corresponding to the preset objects include a plurality of photography templates, and the plurality of photography templates include a default preview template; The method further comprises: displaying a photography template corresponding to the preset object on the photography interface; The step of applying the photography template to the photography screen of the photography interface and displaying a preview effect diagram corresponding to the photography template on the photography interface includes: applying the default preview template to a shooting screen of the shooting interface, and displaying a preview effect diagram corresponding to the default preview template on the shooting interface; A method characterized by:
2. The shooting template further includes at least one of an item resource, an audio resource, a virtual reality (AR) resource, and an interactive resource; The item resource is a special effect or a virtual sticker that is displayed overlaid on the shooting screen.
2. The method of claim 1.
3. The method further comprises: After displaying a preview effect diagram corresponding to the default preview template on the photography interface, In response to a selection operation on a first photographing template from the plurality of photographing templates, applying the first photographing template to a photographing screen of the photographing interface, and switching a preview effect image corresponding to the default preview template displayed on the photographing interface to a preview effect image corresponding to the first photographing template.
2. The method of claim 1.
4. The method further comprises: When a preset object is detected within the shooting screen of the shooting interface, before the step of obtaining a shooting template corresponding to the preset object and determined based on the preset object, acquiring a photographed screen of a photographing interface and extracting image features of the photographed screen; Matching the image features with features of a preset object, and determining that the preset object exists in the photographed image if the matching is successful; Including, 2. The method of claim 1.
5. An image processing device, a first acquisition module, when a preset object is detected within a shooting screen of a shooting interface, for acquiring a shooting template corresponding to the preset object, the shooting template being determined based on the preset object, the shooting template being a preset shooting style, the shooting template including description information of the preset object, the description information including the name and attribute information of the preset object; a display module, used for applying the photography template within a photography screen of the photography interface and displaying a preview effect diagram corresponding to the photography template on the photography interface; a switching module for switching a current display state of the photography template in the photography interface to a hidden state in response to a trigger operation on an identification stop control of the photography interface; Including, The photography template corresponding to the preset object includes a plurality of photography templates, and the plurality of photography templates includes a default preview template, and the display module further comprises: Displaying a photography template corresponding to the preset object on the photography interface; Applying the photography template within the photography screen of the photography interface and displaying a preview effect diagram corresponding to the photography template on the photography interface; Applying the default preview template to a shooting screen of the shooting interface, and displaying a preview effect diagram corresponding to the default preview template on the shooting interface. An apparatus characterized in that
6. The shooting template further includes at least one of an item resource, an audio resource, a virtual reality (AR) resource, and an interactive resource; The item resource is a special effect or a virtual sticker that is displayed overlaid on the shooting screen.
6. The device according to claim 5, characterized in that
7. After displaying the preview effect diagram corresponding to the default preview template on the shooting interface, the display module further comprises: In response to a selection operation on a first photographing template among the plurality of photographing templates, the first photographing template is applied to a photographing screen of the photographing interface, and a preview effect image corresponding to the default preview template, displayed on the photographing interface, is switched to a preview effect image corresponding to the first photographing template.
6. The device according to claim 5, characterized in that
8. 1. A computer-readable non-transitory storage medium, comprising: The computer-readable non-transitory storage medium has stored thereon instructions, which, when executed by a terminal device, cause the terminal device to: a step of obtaining a photography template corresponding to a preset object and determined based on the preset object when a preset object is detected within a photography screen of a photography interface, the photography template being a preset photography style, the photography template including description information of the preset object, and the description information including a name and attribute information of the preset object; applying the photography template within a photography screen of the photography interface, and displaying a preview effect diagram corresponding to the photography template on the photography interface; switching a current display state of the photography template in the photography interface to a hidden state in response to a trigger operation on an identification stop control of the photography interface; was carried out, The shooting templates corresponding to the preset objects include a plurality of shooting templates, and the plurality of shooting templates include a default preview template. In the terminal device, further: a step of displaying a photography template corresponding to the preset object on the photography interface is performed; The step of applying the photography template to the photography screen of the photography interface and displaying a preview effect diagram corresponding to the photography template on the photography interface includes: applying the default preview template to a shooting screen of the shooting interface, and displaying a preview effect diagram corresponding to the default preview template on the shooting interface; A computer-readable non-transitory storage medium comprising:
9. The shooting template further includes at least one of an item resource, an audio resource, a virtual reality (AR) resource, and an interactive resource; The item resource is a special effect or a virtual sticker that is displayed overlaid on the shooting screen.
9. The computer-readable non-transitory storage medium of claim 8.
10. A device, a memory; a processor; and a computer program stored in the memory and executable by the processor; The processor, when executing the computer program, performs the method of claim 1. The device characterized by:
Citation Information
Patent Citations
Pop article information display system
JP2004246572A
Video processing system, video processing method, video processing device for portable terminal or server, and control method and control program of the same
JP2015062090A
Material recognition device and material recognition method
JP2017199259A
Photographing method and terminal device
US20210105400A1