Image operation method and device

By identifying and using the reference point information of the image in the user interface of the electronic device, the image is aligned and typing, and the alignment efficiency and user experience in image arrangement is solved, and more efficient and convenient image layout operations are achieved.

CN120215788APending Publication Date: 2025-06-27HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311818238.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-12-26
Publication Date
2025-06-27

AI Technical Summary

Technical Problem

In image orchestration, how to improve the efficiency and user experience of image alignment and layout has become an important issue.

Method used

By determining the reference point information of the image in the user interface of the electronic device, the image is aligned and typed. Electronic devices can identify reference points of the image subject through an application or operating system and display alignment reference lines in the user interface to help users align images with other display objects.

Benefits of technology

Improve the efficiency and user experience of image alignment layout. By automatically identifying the reference points of the image subject and the reference points of the edge line, the steps of manual alignment of the user are reduced, and the convenience and accuracy of the operation are enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120215788A_ABST
    Figure CN120215788A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of image processing, and discloses an image operation method and device which are used for improving image typesetting efficiency and user experience. In the method, an electronic device may display a plurality of display objects on a user interface, where the plurality of display objects include a first image. The electronic equipment can determine reference point information of a first image in a user interface; wherein the reference point information of the first image is used for indicating the position of a reference point of an image main body in the first image, the reference point information is used for aligning the first image with other display objects, and the other display objects are display objects except the first image in the plurality of display objects. The electronic equipment can also respond to the typesetting operation of the user and typeset the first image according to the reference point information. Therefore, the first image and other display objects can be aligned and typeset according to the reference point of the image main body, so that the image alignment and typesetting efficiency and the user experience can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of image processing, and in particular, to an image operation method and apparatus. Background Art

[0002] In daily office work and creation, the layout of text and images is a common behavior. In image layout, in order to make the typesetting beautiful, dragging the position of the image to align it is a frequently-occurring and common operation. Therefore, how to improve the efficiency and experience of this operation becomes crucial. Summary of the Invention

[0003] The embodiments of the present application provide an image operation method and apparatus to improve the efficiency of image layout and the user experience.

[0004] In a first aspect, the embodiments of the present application provide an image operation method, which is applied to an electronic device. The method includes:

[0005] When the electronic device displays a plurality of display objects in the user interface, it can determine the reference point information of the first image among the plurality of display objects. The reference point information is used to indicate the position of the reference point of the image subject in the first image, and the reference point information is used to align the first image with one or more other display objects in the user interface, where the other display objects are the display objects other than the first image among the plurality of display objects. The electronic device can also, in response to the user's typesetting operation, perform typesetting on the first image according to the reference point information.

[0006] In this method, the electronic device can not only obtain the reference point of the image subject in the first image, but also perform alignment typesetting on the first image according to the reference point of the image subject in the first image, thereby improving the efficiency of image alignment typesetting and the user experience.

[0007] Optionally, the electronic device can execute the above image operation method through an application program or through the operating system.

[0008] In an alternative design, the electronic device can also display a plurality of display objects in the user interface of the application program.

[0009] With this design, the electronic device can display a plurality of display objects in the user interface of the application program. In this way, the electronic device can perform typesetting on the first image among the plurality of display objects through the application program (such as a third-party application program).

[0010] In an alternative design, the electronic device can also perform image recognition on the first image to determine the reference point information of the first image.

[0011] With this design, the electronic device can determine the reference point of the image subject in the image through the application that displays the image, or can also determine the reference point of the image subject through the operating system, improving the applicability of the image alignment method.

[0012] Optionally, when the electronic device executes the above image operation method through the application, it can also call the operating system of the electronic device to determine the reference point information of the first image.

[0013] In an alternative design, the electronic device can send the first image displayed in the user interface of the application to the operating system and determine the reference point information of the first image through the operating system.

[0014] With this design, an application (such as a third-party application) can determine the reference point information of the first image by calling the operating system of the electronic device, so that the first image can be aligned according to the reference point of the image subject, thereby improving the user experience. And the application can borrow the capabilities of the operating system to determine the reference point information of the first image, reducing the data processing volume of the application and making the complexity of the application relatively low.

[0015] In an alternative design, the electronic device can perform image subject recognition on the first image to determine the image subject in the first image. The electronic device can also determine the reference point of the image subject according to the image subject.

[0016] With this design, the electronic device can obtain the reference points of multiple image subjects, so as to provide a more abundant typesetting alignment reference scheme for the user, thereby improving the image alignment typesetting efficiency and user experience.

[0017] In an alternative design, the reference point of the image subject includes at least one of the center points of the sides of the circumscribed rectangle of the image subject, the center point of the image subject, and the golden section point of the image subject.

[0018] In an alternative design, the reference point information of the first image is also used to indicate the position of the reference point of the edge line of the first image.

[0019] With this design, the electronic device can also align the first image through the reference point of the edge line, increasing the user's image alignment options, thereby improving the user experience.

[0020] In an alternative design, the first image may include multiple image subjects, and the reference point information may indicate the positions of the reference points of all or part of the image subjects in the first image.

[0021] With this design, the electronic device can align the first image according to the reference points of all the image subjects in the first image, or can also align the first image according to the reference points of some of the image subjects, thereby providing options for the user to align the first image, and further improving the user experience.

[0022] In an alternative design, the electronic device can also display alignment reference lines in the user interface according to the reference point information. Among them, the alignment reference lines are used to align the reference points of one or more other display objects in the user interface with the reference points of the image subject.

[0023] With this design, the electronic device can inform the user that the first image is aligned with other display objects by displaying alignment reference lines in the user interface, thereby improving the user experience.

[0024] In an alternative design, the other display objects are images or text boxes.

[0025] With this design, the electronic device can typeset and align the first image with an image, or can also typeset and align it with a text box, thereby improving the user experience.

[0026] In an alternative design, the electronic device can store the reference point information of the first image.

[0027] With this design, when the electronic device displays the first image in the user interface, it can determine the reference point information of the first image, so that when the user typesets the first image, it can respond to the typesetting operation in a timely manner, thereby improving the user experience.

[0028] In a second aspect, the present application provides an image operation device, which includes:

[0029] A display screen for displaying a user interface;

[0030] A determination unit for determining the reference point information of the image; the reference point information is used to indicate the position of the reference points of the image subjects in the first image, and the reference point information is used to align the first image with one or more other display objects in the user interface, and the other display objects are the display objects other than the first image among the multiple display objects;

[0031] A typesetting unit for displaying the multiple display objects in the user interface, the multiple display objects including the first image; in response to the user's typesetting operation, typesetting the first image according to the reference point information.

[0032] In a third aspect, the present application provides an electronic device, including a display screen, one or more processors, and one or more memories. The display screen is used to display a user interface; the one or more memories are used to store one or more computer programs and data information, and the one or more processors are used to execute the computer programs stored in the one or more memories, so that the electronic device executes the method described in any aspect of the above first aspect.

[0033] In a fourth aspect, the present application provides a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is executed by a computing device, the computing device executes the method in any aspect of the above first aspect and any possible implementation manner of any aspect.

[0034] In a fifth aspect, an embodiment of the present application provides a chip, which is coupled to a memory in an electronic device, so that the chip calls the computer program stored in the memory when running, and implements the method that may be designed in any aspect of the above first aspect of the embodiment of the present application.

[0035] In a sixth aspect, the present application provides a computer program product, which includes a computer program or instruction. When the computer program or instruction is executed by a computing device, the computing device executes the method in any aspect of the above first aspect and any possible implementation manner of any aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 It is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application;

[0037] Figure 2 It is a schematic block diagram of the software structure of an electronic device provided by an embodiment of the present application;

[0038] Figure 3 It is a schematic flowchart of an image operation method provided by the present application;

[0039] Figure 4 It is a schematic execution flowchart of a screenshot operation provided by the present application;

[0040] Figure 5 It is a schematic diagram of an image operation provided by the present application;

[0041] Figure 6 It is a schematic diagram of an image anchor point provided by the present application;

[0042] Figure 7 It is another schematic diagram of an image anchor point provided by the present application;

[0043] Figure 8 It is still another schematic diagram of an image anchor point provided by the present application;

[0044] Figure 9 A schematic diagram of a user interface provided for this application;

[0045] Figure 10 A schematic diagram of image alignment provided for this application;

[0046] Figure 11 Another schematic diagram of image alignment provided for this application;

[0047] Figure 12 Another schematic diagram of image alignment provided for this application;

[0048] Figure 13 Another schematic diagram of image alignment provided for this application;

[0049] Figure 14 Another schematic diagram of image alignment provided for this application;

[0050] Figure 15 Another schematic diagram of a user interface provided for this application;

[0051] Figure 16 Another schematic diagram of image alignment provided for this application;

[0052] Figure 17 A schematic diagram of batch image alignment provided for this application;

[0053] Figure 18 A software system architecture block diagram of an electronic device for an image operation method provided in an embodiment of this application;

[0054] Figure 19 A schematic diagram of an image operation example provided in an embodiment of this application;

[0055] Figure 20 A software system architecture block diagram of an electronic device for another image operation method provided in an embodiment of this application;

[0056] Figure 21 A schematic diagram of another image operation example provided in an embodiment of this application;

[0057] Figure 22 A structural schematic diagram of an image operation device provided for this application. Detailed implementation manners

[0058] Next, the technical solutions in the embodiments of this application will be described in detail with reference to the accompanying drawings in the following embodiments of this application.

[0059] In the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one (item)" or similar expressions refer to any combination of these items, including any combination of single item(s) or plural item(s). For example, at least one (item) of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0060] Also, unless otherwise stated, the ordinal numbers such as "first" and "second" mentioned in the embodiments of the present application are used to distinguish multiple objects, and are not used to limit the size, content, order, time sequence, priority, or importance of multiple objects. For example, the first file and the second file are only used to distinguish different files, rather than indicating differences in the size, content, priority, or importance of these two files.

[0061] In daily office work and creation, the layout of text and images is a common behavior. In image layout, to make the typesetting beautiful, dragging and positioning an image for alignment is a frequently occurring and common operation, and how to improve the efficiency and experience of this operation becomes crucial.

[0062] In view of this, the embodiments of the present application provide an image operation method and device. Through this solution, an electronic device can determine the anchor point information of an image displayed in a user interface. The anchor point information is used to indicate the position of a reference point of the image main body, and the reference point is used for image alignment; it can also align and typeset the image in combination with the reference point of the image main body in the image. In this way, through the method provided by the present application, the efficiency of image alignment and typesetting of the electronic device and the user experience can be improved.

[0063] In the embodiments of the present application, the reference point is also called the anchor point, and the corresponding reference point information can also be called anchor point information. The embodiments of the present application will be described in detail below with reference to the accompanying drawings. The "anchor point" that appears subsequently in the embodiments of the present application can be replaced with the "reference point", and the "anchor point information" can be replaced with the "reference point information".

[0064] It can be understood that the electronic device involved in the image operation method provided by the embodiments of the present application can be a terminal device. For example, the terminal device can be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) device, a virtual reality (VR) device, a notebook computer, a drone, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a smart TV, or other devices that support image layout. In the embodiments of the present application, the specific form of the electronic device is not particularly limited. For example, the electronic device can be a mobile phone or a tablet computer.

[0065] The electronic devices to which the embodiments of the present application can be applied, exemplary embodiments include but are not limited to those equipped with or other operating systems.

[0066] Figure 1 A schematic diagram of the hardware structure of a possible electronic device is shown. As Figure 1 shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0067] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a micro control unit (MCU), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions. A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use this instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0068] In the embodiments of the present application, the processor 110 may save one or more application programs, display images on the display screen 194, and extract the anchor point information of the image main body from the images displayed on the display screen 194. In addition, the processor 110 may also respond to the user's typesetting operation on the image and typeset the image according to the anchor point information.

[0069] The USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. The charging management module 140 is used to receive the charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives the inputs from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160, etc.

[0070] The wireless communication function of the electronic device 100 can be implemented by antenna 1, antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, etc. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0071] The mobile communication module 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves through antenna 1 and radiate it out. In some embodiments, at least some functional modules of the mobile communication module 150 can be arranged in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be arranged in the same device.

[0072] The wireless communication module 160 can provide solutions for wireless communications applied to the electronic device 100, including wireless local area network (WLAN) (such as Wi-Fi network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves through antenna 2, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signals to be sent from the processor 110, frequency-modulate and amplify them, and convert them into electromagnetic waves through antenna 2 and radiate them out.

[0073] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, such that electronic device 100 can communicate with a network and other devices via wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-CDMA), long term evolution (LTE), the fifth generation (5G) mobile communication system, future communication systems such as the sixth generation (6G) system, etc., BT, GNSS, WLAN, NFC, FM, and / or IR technologies. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0074] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1. In the embodiments of the present application, the display screen 194 can be used to display the main interface, the application interface, the granularity adjustment control, etc.

[0075] The camera 193 is used to capture static images or videos. The camera 193 may include a front camera and a rear camera.

[0076] The internal memory 121 can be used to store computer-executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store the operating system and software codes of at least one application program (such as Huawei Video, Changlian, etc.). The data storage area can store the data generated during the use of the electronic device 100 (such as images, videos, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0077] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as images and videos are saved in the external memory card.

[0078] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0079] Understandably, Figure 1 The components shown do not constitute a specific limitation on the electronic device, and the electronic device may also include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. Figure 1 The electronic device 100 shown is taken as an example for introduction.

[0080] The operating system (OS) involved in the embodiment of the present application is the most basic system software running on the electronic device 100. Taking a mobile phone as an example, the operating system may be HarmonyOS or Android or IOS. The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an operating system adopting a layered architecture as an example to illustrate the software structure of the electronic device 100.

[0081] Figure 2 The software structure block diagram of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the software structure of the electronic device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime and system library, the kernel layer, and the hardware layer.

[0082] The application layer can include a series of application packages. Figure 2 As shown, the application layer may include camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, the third-party applications may include office, image editing and typesetting, music, call, Bluetooth, video, etc.

[0083] In one possible implementation, the application can be developed using the Java language and completed by calling the application programming interface (API) provided by the application framework layer. Developers can interact with the underlying layers of the operating system (such as the hardware layer, kernel layer, etc.) through the application framework layer to develop their own applications. The application framework layer mainly consists of a series of services and management systems of the operating system.

[0084] The application framework layer provides application programming interfaces and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions. For example, Figure 2 as shown, the application framework layer may include a quick icon management module, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0085] The quick icon management module is used to manage the quick icons displayed on the electronic device, such as creating quick icons, removing quick icons, monitoring whether the quick icons meet the display conditions, etc.

[0086] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make this data accessible to applications. The data may include videos, images, audio, dialed and received calls, browsing history and bookmarks, phone books, etc.

[0087] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying an image.

[0088] The phone manager is used to provide the communication function of the electronic device. For example, the management of call states (including connection, disconnection, etc.).

[0089] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, etc.

[0090] The notification manager enables an application to display notification information in the status bar. It can be used to convey informative messages, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that a download is completed, a message is reminded, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or a scrolling text, such as a notification of a background-running application, or a notification that appears on the screen in the form of a dialogue window. For example, it can prompt text information in the status bar, emit a prompt tone, vibrate the electronic device, blink the indicator light, etc.

[0091] In some embodiments of the present application, the application framework layer is mainly responsible for calling the service interface for communication with the hardware layer to transfer the operation requests of the user's operations to the hardware layer. The operation requests may include operations such as the user typesetting an image through the display screen 194.

[0092] The runtime includes a core library and a virtual machine. The runtime is responsible for the scheduling and management of the operating system.

[0093] The core library includes two parts: one part is the functional functions that need to be called by the Java language, and the other part is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as the management of the object life cycle, stack management, thread management, security and exception management, and garbage collection.

[0094] The system library can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing library (such as: OpenGL ES), 2D graphics engine (such as: SGL), etc.

[0095] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0096] The media library supports the playback and recording of multiple common audio and video formats, as well as static image files, etc. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0097] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0098] The 2D graphics engine is a drawing engine for 2D drawing.

[0099] In some embodiments, a 3D graphics processing library can be used to draw 3D motion trajectory images, and a 2D graphics engine can be used to draw 2D motion trajectory images.

[0100] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0101] The hardware layer may include various sensors, such as an acceleration sensor, a gyroscope sensor, a touch sensor, etc.

[0102] Generally, the electronic device 100 can run multiple applications simultaneously. More simply, one application can correspond to one process, and more complexly, one application can correspond to multiple processes. Each process has a process number (process ID).

[0103] Combined with the above Figure 1 introduction to the hardware structure of the electronic device, and Figure 2 introduction to the software framework of the electronic device, below, in combination with multiple embodiments and drawings, the working principles of the software and hardware of the electronic device for executing an image operation method proposed in the embodiments of the present application will be exemplarily described.

[0104] In the embodiments of the present application, "electronic device", "device", etc. can be used interchangeably, that is, it refers to various devices that can be used to implement the embodiments of the present application.

[0105] It should be understood that the hardware structure of the electronic device can be as Figure 1 shown, and the software architecture can be as Figure 2 shown. Among them, the software programs and / or modules corresponding to the software architecture in the electronic device can be stored in the memory 121, and the processor 110 can run the software programs and applications stored in the memory 121 to execute the process of an image operation method provided in the embodiments of the present application.

[0106] To facilitate the understanding of an image operation method provided in the present application, the implementation process of the method provided in the present application will be introduced below in combination with Figures 3 to 19 the content shown in

[0107] First, a possible image operation method applicable to the embodiments of the present application will be introduced. Figure 3 It is a schematic flowchart of an image operation method provided in the embodiments of the present application. The process includes:

[0108] S301: The electronic device displays a plurality of display objects in the user interface, and the plurality of display objects include a first image.

[0109] Exemplarily, the electronic device can generally be an electronic device that provides an image layout function. For example, a mobile phone, a computer, etc. Among them, an application program for laying out images can be installed on the electronic device. The application program can be an application program built into the operating system of the electronic device or a third-party application program provided by a third party. For example, the application program can be an office software, an image editing software, etc.

[0110] The electronic device can display a first image on the user interface of the application program in response to a user operation. Exemplarily, the first image can be an image downloaded from the network, an image stored in the electronic device, or a screenshot, which is not limited herein.

[0111] As an example, the user can download an image on the network to the electronic device. For example, the user can query an image on the network through a browser and download the network image to the electronic device.

[0112] As another example, the user can also trigger a screenshot operation on the electronic device to capture the first image. The electronic device can determine the image of the captured area in response to the user's screenshot operation. Exemplarily, the user can trigger the screenshot operation through an application program installed on the electronic device that can perform the screenshot operation, or can also trigger the screenshot operation through the operating system of the electronic device. Among them, the application program for taking screenshots can be an application program permitted by the operating system of the electronic device to perform the screenshot operation. After obtaining the image of the captured area, the electronic device can use the image of the captured area in subsequent processes. For example, the electronic device can use the image of the captured area for pasting, layout, etc.

[0113] As another example, the user can also trigger a screenshot operation on the electronic device to capture the image the user wants. The electronic device can obtain the image the user wants to capture through the following steps:

[0114] A1: The electronic device determines the image of the captured area in response to the user's screenshot operation. This process is the same as the process in which the electronic device determines the image of the captured area in the above example and will not be elaborated here.

[0115] A2: The electronic device can perform image recognition on the image of the captured area to determine the position and size of the target image in the image of the captured area. Among them, the target image is the image the user wants to capture. Exemplarily, the electronic device can perform image recognition on the image of the captured area through an artificial intelligence (AI) model and / or an image processing algorithm to determine the position and size of the target image in the image of the captured area. Among them, the AI model can be an image recognition model.

[0116] A3: The electronic device can extract the target image from the image of the intercepted area. Exemplarily, the electronic device can remove the redundant areas other than the target image in the image of the intercepted area to obtain one or more target images. After obtaining the target image, the electronic device can also use the target image in subsequent processing. For example, the electronic device can use one or more target images for pasting, typesetting, etc. In this way, the electronic device can quickly and accurately intercept the target image when taking a screenshot.

[0117] For example, as Figure 4 shown, the electronic device displays Image A and Image B. In response to the user's screenshot operation, the electronic device obtains the image of the intercepted area including Image A and Image B. Among them, the dashed box represents the intercepted area. The electronic device can perform image subject recognition on the image of the intercepted area to determine that the image subjects in the intercepted area are Image A and Image B. The electronic device can remove the blank areas other than Image A and Image B in the image of the intercepted area and output Image A and Image B.

[0118] In some embodiments, after obtaining the first image, the electronic device can display the first image in the user interface of the application. For example, the first image obtained by the electronic device can be the image of the intercepted area, or the target image in the image of the intercepted area, or the image downloaded by the user from the network, which is not limited here. Exemplarily, the user can place the first image in the application of the electronic device for display. The electronic device can obtain the image information of the first image through the application in response to the user's operation. Exemplarily, the user can move the obtained first image to the application for typesetting operation on the first image. For example, as Figure 5 shown, the electronic device displays Image A and Application A. The user can move Image A to the user interface of Application A for display so that the user can operate on Image A through Application A. Another example is that the user can also paste Image A into Application A and operate on Image A through Application A. When the user pastes Image A into Application A, Application A displays Image A in the user interface. Another example is that the user can also open or download Image A through Application A so that Application A displays Image A in the user interface.

[0119] S302: The electronic device determines the anchor point information of the first image.

[0120] As an example, the anchor information is used to indicate the position of the anchor of the image subject in the first image, and the anchor information is used to align the first image with one or more other display objects, where the other display objects are display objects other than the first image among the multiple display objects. The anchor of the image subject includes but is not limited to: the center points of the sides of the circumscribed rectangle of the image subject, the center point of the image subject, and the golden section points of the image subject. Exemplarily, the center point of the image subject can be the center point of the closed image inside the image subject. For example, as Figure 6 shown, the anchors of the first image are the center point of the image subject and the center points of the sides of the circumscribed rectangle of the image subject.

[0121] As another example, the anchor information is also used to indicate the position of the anchor of the edge line of the first image. The anchors of the first image include the anchors of the edge line and the anchors of the image subject. Again, for example, as Figure 7 shown, the anchor of the first image can also be the anchor of the edge line of the image, or the center points of the sides of the circumscribed rectangle of the image subject. Again, for example, as Figure 8 shown, when the first image is an image of a cropped area, the anchors of the first image can include the anchors of the edge line of the image of the cropped area, the anchors of the edge line of the target image in the image of the cropped area, the center points of the sides of the circumscribed rectangle of the image subject inside the target image, and the center point of the closed figure inside the image subject. Among them, when the first image is an image of a cropped area, the image subject of the first image can be the target image in the image of the cropped area.

[0122] In some embodiments, the electronic device can determine the anchor information through the application program or through the operating system. The determination process of the anchor is described below according to the above two situations.

[0123] Situation 1: The electronic device determines the anchor information through the application program.

[0124] When the application program of the electronic device displays an image in the user interface, it can perform image recognition on the first image to determine the anchor information of the first image. Exemplarily, the application program of the electronic device can perform image subject recognition on the image through an AI model and an image recognition algorithm to determine the image subject in the first image. The application program can obtain the image subject feature information from the image subject as the anchor of the image subject. In addition, the application program can also use the position of the anchor of the edge line of the first image as part of the anchor information of the first image.

[0125] After determining the anchor information, the application program can record and store the determined anchor information. In this way, the application program can perform operations such as typesetting on the first image according to the recorded anchor information later.

[0126] Situation 2: The electronic device determines the anchor information through the operating system.

[0127] When the application program of the electronic device displays the first image in the user interface, the application program can call the operating system to determine the anchor point information of the first image. Exemplarily, the application program can send the image information of the first image to the operating system so that the operating system can determine the anchor point information according to the image information. After receiving the image information, the operating system can determine the main body of the image in the image through an AI model and an image recognition algorithm. The operating system can obtain the anchor point of the main body of the image from the main body of the image. For example, the operating system can record the center points of the sides of the circumscribed rectangle of the main body of the image as the anchor points. In addition, the operating system can also use the anchor points of the edge line of the first image as the anchor points of the first image.

[0128] After determining the anchor point information, the operating system can record the anchor point information and send the anchor point information to the application program. Subsequently, the application program can perform operations such as typesetting the image according to the anchor point information of the first image. In this way, by recording the determined anchor point information of the first image, the operating system can send the anchor point information to other subsequent application programs when they need to apply the anchor point information.

[0129] S303: The electronic device responds to the user's typesetting operation and typesets the first image according to the anchor point information.

[0130] The user can drag or move the first image in the user interface of the application program of the electronic device to typeset the first image. The application program of the electronic device responds to the user's operation and displays alignment reference lines in the user interface according to the anchor point information of the first image. Among them, the alignment reference lines are used to align the anchor points of one or more other display objects in the user interface with the anchor points of the main body of the image. The alignment reference line is the same horizontal line or the same vertical line where the anchor point of the first image and the anchor points of one or more other display objects are located. That is, when the anchor point of the first image and the anchor points of one or more other display objects are on the same horizontal line or the same vertical line, the application program will display the horizontal line or the vertical line in the user interface, where the horizontal line or the vertical line is the alignment reference line.

[0131] In some examples, during the typesetting process, the application program of the electronic device can determine the anchor points of one or more other display objects displayed in the user interface. The other display objects can be images or text boxes. Among them, the anchor points of the text box can include the anchor points of the edge line of the text box and the anchor points of the text area. For example, the anchor points of the text box include, but are not limited to: the edge points of the text box, the center point of the text box, and the center points of the sides of the circumscribed rectangle of the text area.

[0132] As an example, such as Figure 9As shown, the user interface of Application A displays Image A and Image B. Among them, Image A includes Image Body A1 and Image Body A2. The anchor point of Image A is as Figure 6 shown, and the anchor point of Image B is as Figure 7 shown. The user can complete the layout of Images A and B by moving or dragging Image A and Image B. For example, as Figure 10 shown, the user can drag Image A and Image B, and the application responds to the user's operation and displays alignment reference lines for Image A and Image B in the user interface. At this time, Image Body A2 in Image A is on the same horizontal line as the center point of Image B. Another example, as Figure 11 shown, the user can also align the circumscribed rectangle of Image Body A1 in Image A with the center point of Image B and make them on the same vertical line. Another example, as Figure 12 shown, the user can also align the circumscribed rectangle of Image Body A1 in Image A with the center point of Image B and make them on the same horizontal line.

[0133] As another example, the user can also layout and align the first image with the image in the cropped area. For example, as Figure 13 shown, the first image can be Image a, and the image in the cropped area can be Image b. Among them, the anchor point of Image a is as Figure 6 shown, and the anchor point of Image b is as Figure 8 shown. The user can drag Image a or Image b in the user interface to complete the layout alignment. The user can align the center point of the circumscribed rectangle of the image body of Image a with the circumscribed rectangle of the person in Image b and make them on the same horizontal line. Another example, as Figure 14 shown, the user can also align the center point of the circumscribed rectangle of the image body of Image a with the circumscribed rectangle of the image body "door" in Image b and make them on the same vertical line.

[0134] As another example, the application can display the first image and a text box in the display interface. For example, as Figure 15 shown, the user interface of Application A displays a text box and Image A. Among them, the border of the text box may not be displayed. The user can drag the image to align the text box with the image. The application can respond to the user's operation, move the image, and display alignment reference lines for the image and the text box in the user interface. For example, as Figure 15 shown, the user can move Image A to align Image A and the text box. As Figure 16 shown, the user can align the circumscribed rectangle of Image Body A1 of Image A with the text box and make them on the same horizontal line. The application can respond to the user's operation, move Image A, and display alignment reference lines in the user interface.

[0135] In some embodiments, multiple images can be displayed in the user interface of an application, and the user can batch-align the multiple images by triggering a typesetting operation. Exemplarily, when the application displays multiple images, it determines the anchor point information of each of the multiple images. Among them, the process of obtaining the anchor point information is the same as the process of determining the anchor point information in step S302 shown in the above embodiments, and will not be elaborated here. The user can trigger a batch alignment operation in the user interface of the application to align the multiple images. In response to the user's batch alignment operation, the application aligns the multiple images according to a pre-set alignment strategy.

[0136] Exemplarily, the alignment strategy can be set to align the main bodies of the images, or to horizontal alignment (top alignment or bottom alignment), or to vertical alignment (left alignment or right alignment). For example, aligning the main bodies of the images can be aligning the center points of the main bodies of the images, or aligning the circumscribed rectangles. In the present application, the alignment strategy can also be set to other alignment methods, which will not be elaborated here.

[0137] As an example, the user can select the images that need to be batch-aligned in the user interface of the application and trigger a batch alignment operation. The application can respond to the user's operation and batch-align the images selected by the user. For example, as Figure 17 shown, the user can select 8 images that need to be aligned on the user interface. The user can click on the batch alignment area in the user interface to batch-align the 8 images. In response to the batch alignment operation triggered by the user, the application performs bottom alignment typesetting on the 8 images.

[0138] In some other embodiments, the first image can include multiple image main bodies, and the anchor point information of the first image can indicate the positions of the anchor points of some or all of the image main bodies in the first image. Exemplarily, the electronic device performs image main body recognition on the first image to determine multiple image main bodies in the first image. The electronic device can determine the anchor points of all the image main bodies among the multiple image main bodies, or can determine the anchor points of some of the image main bodies among the multiple image main bodies. For the case where the anchor point information indicates the positions of the anchor points of some of the image main bodies in the first image, the electronic device can determine the anchor point information through the following methods:

[0139] As an example, an electronic device can select a required image subject from multiple image subjects according to pre-set image subject selection conditions. Exemplarily, the image subject selection conditions include but are not limited to: the type of the image subject, the size of the image subject, and the number of image subjects. For example, when the image subject selection condition is a person, the electronic device can select an image subject of the type of person from multiple image subjects and determine the anchor position of the image subject. For another example, when the image subject selection condition is the size of the image subject, the electronic device can select an image subject with an image proportion greater than a set threshold from multiple image subjects and determine the anchor position of the image subject. For yet another example, after the electronic device identifies n image subjects, it can directly select m image subjects from the n image subjects, where n>m.

[0140] As another example, after the electronic device determines multiple image subjects of the first image, it can display the multiple image subjects of the first image in the user interface. The user can select the image subject required for alignment from the multiple image subjects displayed in the user interface. The electronic device can, in response to the user's selection operation, determine the partial image subjects selected by the user from the multiple image subjects and determine the anchor information of the partial image subjects.

[0141] In the embodiments of the present application, the electronic device can also select partial image subjects from multiple image subjects of the first image in other ways, which are not limited herein.

[0142] After obtaining the anchor information, the electronic device can, in response to the user's typesetting operation, perform typesetting alignment on the first image according to the anchor information.

[0143] In the content shown in the above embodiments, the electronic device can perform image recognition on the image displayed in the user interface to determine the anchor points of the image subjects of the image. In this way, during the typesetting alignment process of the image, the electronic device can not only use the alignment reference lines of the anchor points of the edge lines of the image to prompt the user, but also use the alignment reference lines corresponding to the anchor points of the image subjects to prompt the user, thereby improving the typesetting efficiency of the user for the image.

[0144] The content shown in the above embodiments can be executed by an application in the electronic device. Figure 18 The software system architecture block diagram of an electronic device provided for the embodiments of the present application. The system at least includes an APP layer and an APP framework layer.

[0145] Among them, the APP layer includes an image typesetting APP that can perform image typesetting operations. Exemplarily, the image typesetting APP can be an office APP or an image editing APP.

[0146] The APP framework layer includes an image operation interaction module, a screenshot module, a typesetting module, and an image recognition module.

[0147] In some embodiments, as Figure 18 shown, the user can open the first image in the image layout APP. In response to the user's operation, the image operation interaction module displays the first image in the image layout APP. The image recognition module can perform image recognition on the first image opened by the user to determine the anchor points of the image subject in the first image. Exemplarily, the image recognition module can perform image subject recognition on the first image through an AI model and an image processing algorithm to determine the anchor points of the image subject in the first image and obtain the anchor point information of the first image. The image recognition module can send the determined anchor point information to the layout module, and the layout module can record and store the received anchor point information.

[0148] In some embodiments, the user can also perform layout and alignment on the image in the image layout APP. In response to the user's operation, the image operation interaction module in the APP framework layer notifies the layout module that the user wants to perform layout on the first image. The layout module can display alignment reference lines on the image layout APP according to the anchor point information of the first image. The user can determine whether the layout is beautiful according to the alignment reference lines displayed on the image layout APP.

[0149] The user can also trigger a screenshot operation in the image layout APP. In response to the user's screenshot operation, the image operation interaction module notifies the screenshot module to take a screenshot. The screenshot module can determine the intercepted area and generate an image of the intercepted area.

[0150] Figure 19 This is an example of an image operation method provided by an embodiment of the present application. Taking the application program installed on an electronic device to execute the image operation method as an example, this example includes the following steps.

[0151] S1901: The user opens the first image in the application program of the electronic device.

[0152] S1902: In response to the user's operation, the application program displays the first image in the user interface. Among them, other display objects are also displayed in the user interface.

[0153] S1903: The application program performs first image subject recognition on the image through an image recognition model and an image recognition algorithm to determine the image subject in the first image.

[0154] S1904: The application program determines the anchor points of the image subject according to the image subject.

[0155] Among them, the anchor points of the image subject include but are not limited to: the center points of each side of the circumscribed rectangle of the image subject, the center point of the image subject, and the golden section points of the image subject.

[0156] S1905: The application records the anchor information of the first image. The anchor information is used to indicate the positions of the anchors of the image main body in the first image and the positions of the anchors of the edge lines of the first image.

[0157] S1906: The user initiates a typesetting operation in the user interface.

[0158] S1907: In response to the user's typesetting operation, the application displays alignment reference lines in the user interface according to the anchor information.

[0159] Among them, the alignment reference lines are used to align the anchors of other display objects in the user interface with the anchors of the image main body.

[0160] The user can determine whether to continue typesetting and aligning the image according to the alignment reference lines displayed in the user interface.

[0161] Based on Figure 19 As shown in the content, when the application of the electronic device displays an image, it can determine and record the anchors of the image main body in the image. In this way, when the application typesets the image, it can typeset and align the image according to the anchors of the image main body, thereby improving the typesetting efficiency and user experience.

[0162] The content shown in the above embodiments can also be executed by the application and the operating system in the electronic device. Figure 20 This is another software system architecture diagram of the electronic device provided by the embodiment of the present application. The system at least includes an APP layer, an APP framework layer, and an operating system framework layer.

[0163] Among them, the APP layer includes an image typesetting APP that can perform image typesetting operations.

[0164] The APP framework layer includes an image operation interaction module, a screenshot module, and a typesetting module.

[0165] The operating system framework diagram includes an image recognition module.

[0166] In some embodiments, as Figure 20 shown, the user can open the first image in the image typesetting APP. The image operation interaction module in the APP framework layer responds to the user's operation and displays the first image in the image typesetting APP. The image operation interaction module can notify the image recognition module in the operating system framework to perform image recognition on the first image displayed in the image typesetting APP.

[0167] After receiving the notification from the image operation interaction module, the image recognition module can perform image subject recognition on the first image displayed in the image layout APP, determine the anchor points of the image subject in the first image, and obtain the anchor point information of the first image. Exemplarily, the image recognition module can perform image subject recognition on the first image through an AI model and an image processing algorithm, determine the anchor points of the image subject in the first image, and obtain the anchor point information of the first image. The image recognition module can send the determined anchor point information to the layout module in the APP framework layer. The layout module can record and store the received anchor point information.

[0168] In some embodiments, the user can also perform typesetting and alignment on the first image in the image layout APP. The image operation interaction module in the APP framework layer responds to the user's operation and notifies the layout module that the user wants to perform typesetting on the first image. The layout module can display alignment reference lines on the image layout APP according to the anchor point information of the first image. The user can determine whether the typesetting is beautiful according to the alignment reference lines displayed on the image layout APP.

[0169] The user can also trigger a screenshot operation in the image layout APP. The image operation interaction module responds to the user's screenshot operation and notifies the screenshot module to take a screenshot. The screenshot module can determine the intercepted area and generate an image of the intercepted area.

[0170] Figure 21 This is an example of another image operation method provided by the embodiments of the present application. Taking the application program and operating system installed on an electronic device to execute the image operation method as an example, this example includes the following steps.

[0171] S2101: The user opens the first image in the application program of the electronic device.

[0172] S2102: The application program of the electronic device responds to the user's operation and displays the first image in the user interface. Among them, other display objects are also displayed in the user interface.

[0173] S2103: The application program can send the first image to the operating system of the electronic device. The operating system receives the first image from the application program.

[0174] S2104: The operating system performs image subject recognition on the first image through an image recognition model and an image recognition algorithm, and determines the image subject in the first image.

[0175] S2105: The operating system determines the anchor points of the image subject according to the image subject.

[0176] Among them, the anchor points of the image subject include but are not limited to: the center points of the sides of the circumscribed rectangle of the image subject, the center point of the image subject, and the golden section points of the image subject.

[0177] S2106: The operating system sends the anchor point information of the image to the application. The application receives the anchor point information from the operating system. Among them, the anchor point information is used to indicate the position of the anchor point of the image subject in the first image, and the position of the anchor point of the edge line of the first image.

[0178] S2107: The application records the anchor point information of the first image.

[0179] S2108: The user triggers a typesetting operation in the user interface.

[0180] S2109: In response to the user's typesetting operation, the application displays alignment reference lines in the user interface according to the anchor point information.

[0181] Among them, the alignment reference lines are used to align the anchor points of other display objects in the user interface with the anchor point of the image subject.

[0182] The user can determine whether to continue typesetting and aligning the image according to the alignment reference lines displayed in the user interface.

[0183] Based on Figure 21 As shown in the content, when the application of the electronic device displays an image, it can call the operating system of the electronic device to determine and record the anchor point of the image subject in the image. In this way, when the application typesets the image, it can typeset and align the image according to the anchor point of the image subject determined by the operating system, thereby improving the typesetting efficiency and user experience.

[0184] Based on the above content and the same concept, Figure 22 FIG. 2200 is a schematic structural diagram of a possible image operation device 2200 provided by the present application. The image operation device 2200 is applied to an electronic device.

[0185] In some embodiments, the electronic device includes the image operation device 2200, or the electronic device is the image operation device 2200. The image operation device 2200 can be used to implement the functions of the electronic device in the above method embodiments, and thus can also achieve the beneficial effects of the above method embodiments.

[0186] A display screen 2201, configured to display a user interface;

[0187] A determination unit 2202, configured to perform image recognition on a first image to determine the anchor point information of the first image; the anchor point information is used to indicate the position of the anchor point of the image subject in the first image, the anchor point information is used for the first image to be aligned with one or more other display objects, and the other display objects are display objects other than the first image among a plurality of display objects;

[0188] A layout unit 2203, configured to display the multiple display objects in the user interface, where the multiple display objects include the first image; and in response to a layout operation of a user, layout the first image according to the anchor point information.

[0189] An alternative implementation is that the layout unit 2203 is specifically configured to:

[0190] Display the multiple display objects in the user interface of the application.

[0191] An alternative implementation is that the determination unit 2202 is specifically configured to:

[0192] Perform image recognition on the first image through the application or the operating system to determine the anchor point information of the first image.

[0193] An alternative implementation is that the determination unit 2202 is specifically configured to:

[0194] Perform image main body recognition on the first image to determine the image main body in the first image;

[0195] Determine the anchor point of the image main body according to the image main body.

[0196] An alternative implementation is that the anchor point of the image main body includes at least one of the center points of each side of the circumscribed rectangle of the image main body, the center point of the image main body, and the golden section points of the image main body.

[0197] An alternative implementation is that the anchor point information of the first image is further used to indicate the positions of the anchor points of the edge lines of the first image.

[0198] An alternative implementation is that the layout unit 2203 is specifically configured to:

[0199] According to the anchor point information, display alignment reference lines in the user interface, where the alignment reference lines are used for the anchor points of one or more display objects in the user interface to be aligned with the anchor points of the image main body.

[0200] An alternative implementation is that the other display objects are images or text boxes.

[0201] Based on the above content and the same concept, the present application provides an electronic device, including a display screen, a processor, and a memory. The display screen is used to display a user interface, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory so that the electronic device executes the steps executed by the electronic device in the above method embodiments.

[0202] Based on the above content and the same concept, the present application provides a computer-readable storage medium. A computer program or instruction is stored in the computer-readable storage medium. When the computer program or instruction is executed by a computing device, the computing device executes the steps performed by the electronic device in the above method embodiments.

[0203] Based on the above content and the same concept, the present application provides a computer program product. The computer program product includes a computer program or instruction. When the computer program or instruction is executed by a computing device, the computing device executes the steps performed by the electronic device in the above method embodiments.

[0204] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0205] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the specified function in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0206] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including an instruction device, and the instruction device implements the specified function in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0207] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process. Thus, the instructions executed on the computer or other programmable device provide for implementing the specified function in Figure 1 one process or multiple processes and / or blocksFigure 1 Steps of the functions specified in one or more boxes.

[0208] Obviously, those skilled in the art can make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, this application also intends to include these changes and modifications.

Claims

1. An image operation method, characterized in that, The method includes: Displaying a plurality of display objects in a user interface, the plurality of display objects including a first image; Determining reference point information of the first image; the reference point information is used to indicate the position of a reference point of an image subject in the first image, and the reference point information is used for aligning the first image with one or more other display objects in the user interface, where the other display objects are display objects other than the first image among the plurality of display objects; In response to a typesetting operation of a user, typesetting the first image according to the reference point information.

2. The method according to claim 1, wherein The displaying a plurality of display objects in a user interface includes: Displaying a plurality of display objects in a user interface of an application program.

3. The method according to claim 1 or 2, characterized in that, The determining reference point information of the first image includes: Performing image recognition on the first image to determine the reference point information of the first image.

4. The method according to claim 3, wherein The determining reference point information of the first image includes: Performing image subject recognition on the first image to determine the image subject in the first image; Determining the reference point of the image subject according to the image subject.

5. The method according to any one of claims 1 to 4, characterized in that, The reference point of the image subject includes at least one of the center points of the sides of the circumscribed rectangle of the image subject, the center point of the image subject, and the golden section points of the image subject.

6. The method according to any one of claims 1-5, characterized in that, The reference point information of the first image is further used to indicate the position of a reference point of an edge line of the first image.

7. The method according to any one of claims 1-6, characterized in that, The typesetting the first image according to the reference point information includes: Displaying alignment reference lines in the user interface according to the reference point information, where the alignment reference lines are used for aligning the reference points of one or more other display objects in the user interface with the reference point of the image subject.

8. The method according to claim 7, wherein The other display objects are images or text boxes.

9. An image operation device, characterized in that, Including: A display screen for displaying a user interface; A determining unit for determining reference point information of a first image; the reference point information is used to indicate the position of a reference point of an image subject in the first image, and the reference point information is used for aligning the first image with one or more other display objects in the user interface, where the other display objects are display objects other than the first image among the plurality of display objects; A typesetting unit for displaying the plurality of display objects in the user interface, the plurality of display objects including the first image; in response to a typesetting operation of a user, typesetting the first image according to the reference point information.

10. The device according to claim 9, characterized in that The typesetting unit is specifically configured to: Display the plurality of display objects in a user interface of an application program.

11. The device according to claim 9 or 10, characterized in that, The determining unit is specifically configured to: Perform image recognition on the first image to determine the reference point information of the first image.

12. The device according to claim 11, characterized in that, The determining unit is specifically configured to: Perform image subject recognition on the first image to determine the image subject in the first image; Determine the reference point of the image subject according to the image subject.

13. The device according to any one of claims 9-12, characterized in that, The reference point of the image subject includes at least one of the center points of the sides of the circumscribed rectangle of the image subject, the center point of the image subject, and the golden section points of the image subject.

14. The device according to any one of claims 9-13, characterized in that, The reference point information of the first image is further used to indicate the position of a reference point of an edge line of the first image.

15. The device according to any one of claims 9-14, characterized in that, The typesetting unit is specifically configured to: According to the reference point information, display alignment reference lines in the user interface, where the alignment reference lines are used to align the reference points of one or more other display objects in the user interface with the reference points of the image main body.

16. The device according to any one of claims 9 - 15, characterized in that, The other display objects are images or text boxes.

17. An electronic device, characterized in that, Comprising: A display screen; One or more processors; One or more memories; The display screen is used to display the user interface; The one or more memories are used to store one or more computer programs and data information; wherein the one or more computer programs include instructions; When the instructions are executed by the one or more processors, the terminal device is caused to execute the method according to any one of claims 1 to 8.

18. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, and when the computer program runs on a computer, the computer is caused to execute the method according to any one of claims 1 to 8.

19. A computer program product, characterized in that, Comprising a computer program, and when the computer program runs on a computer, the computer is caused to execute the method according to any one of the above claims 1 to 8.

20. A chip, characterized in that, The chip is coupled to the memory in the electronic device, so that when the chip runs, it calls the computer program stored in the memory to implement the method according to any one of claims 1 to 8.