Electronic device, method, and recording medium for supporting image reframing

Abstract

An embodiment of the present invention provides an electronic device for defining focusing on a subject in content (e.g., a video) to perform auto-focusing (e.g., auto-reframing) for the focused subject during content reproduction, and providing the content, an operation method thereof, and a recording medium. The electronic device may execute an application related to content editing. The electronic device may display, in response to a first input for selecting one or more pieces of content, a first interface including the content. The electronic device may display a second interface for edition of the content in response to a second input for executing edition of the content included in the first interface. The electronic device may identify, on the basis of a third input for selecting object information included in the second interface, a subject corresponding to the selected object information in the content. The electronic device may track the subject in the content and focus and display same on the basis of a defined region of interest setting. Various embodiments are possible.

Description

Electronic devices, methods, and recording media supporting image reframing

[0001] Embodiments of the present disclosure provide an electronic device, an operating method thereof, and a recording medium for providing an image by automatically focusing (e.g., auto reframing) on ​​a subject defined in content (e.g., an image and / or a video).

[0002] With the advancement of digital technology, various types of electronic devices, such as smartphones, tablet PCs (personal computers), laptop computers, desktop computers, digital cameras, and / or wearable devices, are becoming widely used. The hardware and / or software components of these electronic devices are continuously being developed to support and enhance their functionality.

[0003] For example, portable electronic devices (hereinafter referred to as "electronic devices"), such as smartphones, can now be equipped with various functions. For example, electronic devices can provide a reframing (or auto-reframing) function for images. In one embodiment, the reframing function may include a function to detect moving objects in an image (e.g., a video) and crop it to fit various aspect ratios. For example, a user can edit an image (e.g., a video) to fit a format (e.g., an aspect ratio of the image) supported by various social media platforms (e.g., YouTube, Instagram, and Facebook) through the reframing function on the electronic device and post the edited image on the relevant social media platform.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0005] In one embodiment of the present disclosure, an electronic device, an operating method thereof, and a recording medium are provided, which define focusing on a subject in content (e.g., an image and / or a video) and automatically focus (e.g., auto reframing) the focused subject when playing the content.

[0006] In one embodiment of the present disclosure, an electronic device, an operating method thereof, and a recording medium are provided that support content editing for setting a region of interest for a subject of content for a reframing function in the electronic device.

[0007] In one embodiment of the present disclosure, an electronic device, an operating method thereof, and a recording medium are provided to support content editing by providing an intuitive interface for a user to specify a subject when editing content.

[0008] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0009] An electronic device according to an embodiment of the present disclosure may include a display, at least one processor including processing circuitry, and a memory storing instructions.

[0010] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to execute an application related to content editing. The instructions, when executed by the at least one processor, may cause the electronic device to receive a first input for selecting one or more contents. The instructions, when executed by the at least one processor, may cause the electronic device to display a first interface including the contents in response to the first input. The instructions, when executed by the at least one processor, may cause the electronic device to receive a second input for executing editing of the contents included in the first interface. The instructions, when executed by the at least one processor, may cause the electronic device to display a second interface for editing the contents in response to the second input. According to one embodiment, the second interface may include the content, object information related to a subject included in the content, and an indicator regarding a location and time point at which a subject corresponding to the object information in the content is provided. The instructions, when executed by the at least one processor, may cause the electronic device to identify a subject corresponding to the selected object information in the content based on a third input selecting the object information included in the second interface. The instructions, when executed by the at least one processor, may cause the electronic device to track the subject in the content and display it by focusing it with a defined region of interest setting.

[0011] A method of operating an electronic device according to an embodiment of the present disclosure may include an operation of executing an application related to content editing. The method may include an operation of receiving a first input for selecting one or more contents. The method may include an operation of displaying a first interface including the contents in response to the first input. The method may include an operation of receiving a second input for executing editing of the contents included in the first interface. The method may include an operation of displaying a second interface for editing the contents in response to the second input. According to one embodiment, the second interface may include an indicator regarding the contents, object information related to a subject included in the contents, and a position and time point at which a subject corresponding to the object information in the contents is provided. The method may include an operation of identifying a subject corresponding to the selected object information in the contents based on a third input for selecting the object information included in the second interface. The above method of operation may include an operation of tracking the subject in the content and focusing and displaying it in a defined area of ​​interest.

[0012] In order to solve the above-described problem, various embodiments of the present disclosure may include a computer-readable recording medium having recorded thereon a program for executing the method on a processor.

[0013] According to one embodiment, a non-transitory computer-readable recording medium (or storage medium or computer program product) storing one or more programs is described. According to one embodiment, one or more programs may include instructions for executing an application related to content editing, receiving a first input for selecting one or more contents, displaying a first interface including the contents in response to the first input, receiving a second input for executing editing of the contents included in the first interface, displaying a second interface for editing the contents in response to the second input, the second interface including the contents, object information related to a subject included in the contents, and an indicator regarding a position and a time point at which a subject corresponding to the object information in the contents is provided, and identifying a subject corresponding to the selected object information in the contents based on a third input for selecting the object information included in the second interface, and performing an operation of tracking the subject in the contents and focusing and displaying it by setting a defined region of interest.

[0014] Further scope of the applicability of the present disclosure will become apparent from the detailed description below. However, since various modifications and variations within the spirit and scope of the present disclosure will readily become apparent to those skilled in the art, it should be understood that the detailed description and specific examples, such as preferred embodiments of the present disclosure, are given by way of example only.

[0015] According to an embodiment of the present disclosure, an electronic device, an operation method thereof, and a recording medium, focusing on a subject in content (e.g., an image and / or a video) can be defined, and when the content (e.g., the video) is played, the focused subject can be automatically focused (e.g., auto reframing) and provided. According to an embodiment, for a reframing function in an electronic device, easy content editing for setting a region of interest for a subject of the content can be supported. According to an embodiment, content editing can be supported by providing an intuitive interface for a user to specify a subject when editing content. According to an embodiment, a new UX for content editing (e.g., video editing) can be provided.

[0016] In addition, various effects may be directly or indirectly realized through this document. The effects obtained through this disclosure are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains, based on the description below.

[0017] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0018] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0019] FIG. 2 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0020] FIG. 3 is a diagram illustrating a display according to one embodiment of the present disclosure.

[0021] FIG. 4 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.

[0022] FIGS. 5A, 5B, 5C, and 5D are diagrams illustrating an example of an operation of image editing including image reframing in an electronic device according to one embodiment of the present disclosure.

[0023] FIG. 6 is a diagram illustrating an example of providing a region of interest by focusing in an electronic device according to one embodiment of the present disclosure.

[0024] FIG. 7 is a diagram illustrating an example of providing a region of interest by focusing in an electronic device according to one embodiment of the present disclosure.

[0025] FIG. 8 is a diagram illustrating an example of changing a region of interest in an electronic device according to one embodiment of the present disclosure.

[0026] FIG. 9 is a diagram illustrating an example of changing a focus range of a subject in an electronic device according to an embodiment of the present disclosure.

[0027] FIG. 10 is a diagram illustrating an example of providing information about a subject through a focus range in an electronic device according to one embodiment of the present disclosure.

[0028] FIG. 11 is a diagram illustrating an example of providing a preview of an edited image during image editing in an electronic device according to one embodiment of the present disclosure.

[0029] FIG. 12 is a diagram illustrating an example of providing a preview of an edited image during image editing in an electronic device according to one embodiment of the present disclosure.

[0030] FIG. 13 is a diagram illustrating an example of adding a focus target during image editing in an electronic device according to one embodiment of the present disclosure.

[0031] FIG. 14 is a diagram illustrating an example of an operation that supports selection of a focus target in an electronic device according to one embodiment of the present disclosure.

[0032] FIG. 15 is a diagram illustrating an example of an operation that supports selection of a focus target in an electronic device according to one embodiment of the present disclosure.

[0033] FIG. 16 is a diagram illustrating an example of an operation that supports selection of a focus target in an electronic device according to one embodiment of the present disclosure.

[0034] FIG. 17 is a diagram illustrating an example of configuring a screen according to the position of a subject in an electronic device according to one embodiment of the present disclosure.

[0035] FIG. 18 is a diagram illustrating an example of an operation that supports audio focusing in an electronic device according to one embodiment of the present disclosure.

[0036] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0037] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0038] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0039] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0040] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0041] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0042] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).

[0043] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0044] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0045] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0046] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0047] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0048] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0049] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0050] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0051] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0052] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0053] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0054] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0055] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimizing terminal power and connecting multiple terminals (mMTC, massive machine type communications), or high reliability and low latency communications (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0056] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0057] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0058] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0059] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0060] FIG. 2 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0061] According to one embodiment, FIG. 2 may represent a block diagram of an exemplary electronic device (200) (e.g., electronic device (101) of FIG. 1) capable of performing the operations described herein.

[0062] Referring to FIG. 2, the electronic device (200) may be one of various forms of electronic devices, such as a notebook (290), smartphones (291) having various form factors (e.g., a bar-type smartphone (291-1), a foldable-type smartphone (291-2), or a sliderable (or rollable) type smartphone (291-3)), a tablet (292), a cellular phone (not shown), and other similar computing devices (not shown). The components, their relationships, and their functions illustrated in FIG. 2 are exemplary only and do not limit the implementations described or claimed in this document. The electronic device (200) may be referred to as a mobile device, a user device, a multi-function device, a portable device, or a server.

[0063] According to one embodiment, the electronic device (200) may include all or at least a portion of the components of the electronic device (101) as described in the description with reference to FIG. 1. For example, in various embodiments of the present document, some of the illustrated components may be omitted or replaced. The electronic device (200) may include at least a portion of the components and / or functions of the electronic device (101) of FIG. 1. At least some of the individual components of the illustrated (or not illustrated) electronic device (200) may be operatively, functionally, and / or electrically connected to each other.

[0064] The electronic device (200) may include components including at least one processor (210) (e.g., processor (120) of FIG. 1) (hereinafter, referred to as processor (210)), at least one memory (220) (e.g., memory (130) of FIG. 1) (hereinafter, referred to as memory (220)), at least one display (240) (e.g., display module (160) of FIG. 1) (hereinafter, referred to as display (240)), at least one image sensor (250) (hereinafter, referred to as image sensor (250)), at least one communication circuit (260) (e.g., communication module (190) of FIG. 1) (hereinafter, referred to as communication circuit (260)), and / or at least one sensor (270) (hereinafter, referred to as sensor (270)). The above components are merely exemplary. For example, the electronic device (200) may include other components (e.g., power management integrated circuitry (PMIC), audio processing circuitry, an antenna, a rechargeable battery, or input / output interfaces). For example, some components may be omitted from the electronic device (200). For example, some components may be integrated into a single component.

[0065] The processor (210) may perform application layer processing functions requested by a user of the electronic device (200). According to one embodiment, the processor (210) may provide control and commands of functions for various blocks of the electronic device (200). According to one embodiment, the processor (210) may perform operations or data processing related to control and / or communication of each component of the electronic device (200). For example, the processor (210) may include at least some of the configurations and / or functions of the processor (120) of FIG. 1. According to one embodiment, the processor (210) may be operatively connected to components of the electronic device (200). According to one embodiment, the processor (210) may load commands or data received from other components of the electronic device (200) into the memory (220), process the commands or data stored in the memory (220), and store result data.

[0066] The processor (210) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (210) may include at least one electrical circuit and may individually and / or collectively perform distributed processing of instructions (or programs, data, etc.) stored in the memory (220). The processor (210) may include a processor assembly including one or more processing circuitries and / or executable program elements.

[0067] The processor (210) may include any processing circuit operative to control the performance and operations of one or more components (e.g., memory (220), display (240), image sensor (250), communication circuit (260), and / or sensor (270)) of the electronic device (200). For example, the processor (210) may be an application processor (AP). For example, the processor (210) may be a system semiconductor that is responsible for various functions (e.g., calculation and multimedia driving functions) of the electronic device (200). The processor (210) may be implemented as a system on chip (SoC) (e.g., one chip or chipset). For example, the processor (210) may be implemented as a plurality of cores (or at least one core circuit), a plurality of chips, or a plurality of chipsets. For example, the processor (210) may include one or more processing circuits. For example, the processor (210) may include one or more processing circuits configured to individually and / or collectively perform various functions of the present disclosure. As a non-limiting example, at least a portion of the processor (210) may be included in a first chip of the electronic device (200), and at least another portion of the processor (210) may be included in a second chip of the electronic device (200), different from the first chip of the electronic device (200).

[0068] For example, the processor (210) may include a central processing unit (CPU) (211), a graphics processing unit (GPU) (212), a neural processing unit (NPU) (213), an image signal processor (ISP) (214), a display controller (215), a memory controller (216), a storage controller (217), a communication processor (CP) (218), and / or a sensor interface (219). These components of the processor (210) are merely exemplary. For example, the processor (210) may further include other components. For example, some components of the processor (210) may be omitted from the processor (210). For example, some components of the processor (210) may be included as separate components of the electronic device (200) outside the processor (210). For example, some components of the processor (210) (e.g., memory controller (216)) may be included within other components (e.g., at least a portion of memory (220), an interface (e.g., available for connection to at least one component of the electronic device (200)), a display (240) and / or an image sensor (250)).

[0069] The processor (210) can cause other components of the electronic device (200) to perform various operations by executing instructions stored in the memory (220).

[0070] The CPU (211) (or central processing circuit) may be configured to control components of the processor (210) based on the execution of instructions stored in the memory (220) (e.g., volatile memory (221) and / or non-volatile memory (222)). The CPU (211) may decipher user commands and perform arithmetic and logical operations, and / or data processing operations. For example, the CPU (211) may be responsible for functions such as memory, interpretation, operation, and control. The CPU (211) may execute all software (e.g., application (146) of FIG. 1) of the electronic device (200) on top of an operating system (OS) and control hardware devices.

[0071] The CPU (211) may store commands or data in a volatile memory (221) of the memory (220) (e.g., the volatile memory (132) of FIG. 1) as at least part of data processing or calculation, process the commands or data stored in the volatile memory (221), and store result data in a non-volatile memory (222) of the memory (220) (e.g., the non-volatile memory (134) of FIG. 1).

[0072] The CPU (211) may include a single processor core or multiple processor cores (multi-core). The CPU (211) may be a programmable processor that stores executable instructions (e.g., instructions capable of performing operations of the CPU (211)) and executes the instructions.

[0073] The CPU (211) can operate in a multi-domain environment. The CPU (211) can operate in a multi-domain environment of a normal world (e.g., a non-secure world, a framework, or a non-secure environment) and a secure world (e.g., a secure framework or a secure environment). In one embodiment, a domain of the secure world can include one or more domains (e.g., a trusted OS, a trust zone, and / or a virtualization framework).

[0074] The GPU (212) (or graphics processing circuit) may be configured to execute parallel operations (e.g., rendering). The GPU (212) may be responsible for graphics processing. The GPU (212) may receive commands from the CPU (211) and perform graphics processing to express the shape, position, color, shading, movement, and / or texture of objects (or objects) on the display (240).

[0075] The NPU (213) (or neural processing circuit, or AI (artificial intelligence) chip) may be configured to execute operations (e.g., convolution computation) for an artificial intelligence model. The NPU (213) may perform processing optimized for an artificial intelligence deep-learning algorithm. The NPU (213) is a processor optimized for deep-learning algorithm operations (e.g., artificial intelligence operations) and can process big data quickly and efficiently like a human neural network. For example, the NPU (213) may be mainly used for artificial intelligence operations. The NPU (213) may recognize objects, environments, and / or people in the background when taking a video through a camera and automatically adjust the focus, automatically switch the camera's shooting mode to food mode when taking a picture of food, and / or perform processing to erase only unnecessary subjects from the captured results. The NPU (213) may perform processing to generate an answer based on given information (e.g., natural language).

[0076] The ISP (214) (or image signal processing circuit) may be configured to process a raw image acquired through the image sensor (250) into a format suitable for a component within the electronic device (200) or a component of the processor (210). For example, the ISP (214) may be responsible for image processing and correction of images and videos. The ISP (214) may correct unprocessed data (e.g., raw data) transmitted from the image sensor (250) of a camera (e.g., the camera module (180) of FIG. 1) to generate an image in a form more preferred by the user. The ISP (214) may perform post-processing, such as adjusting partial brightness of the image and emphasizing detailed parts. For example, the ISP (214) may independently perform a process of tuning and correcting the image quality of an image acquired through the camera to generate a result preferred by the user.

[0077] The ISP (214) may support artificial intelligence-based image processing technology. The ISP (214) may support scene segmentation (e.g., image segmentation) technology that recognizes and / or classifies parts of a scene being captured in conjunction with the NPU (213). For example, the ISP (214) may include a function that processes objects such as the sky, bushes, and / or skin by applying different parameters to them. The ISP (214) may detect and display a human face during image capture using the artificial intelligence function, or adjust the brightness, focus, and / or color of the image using the coordinates and information of the face.

[0078] According to one embodiment, the electronic device (200) can support integrated machine learning processing by interacting with all processors such as the CPU (211), GPU (212), NPU (213), and ISP (214).

[0079] The display controller (215) (or display control circuit, or DPU (display processing unit)) may be configured to process an image obtained from the CPU (211), GPU (212), ISP (214), or memory (220) (e.g., volatile memory (221)) into a format suitable for the display (240).

[0080] The memory controller (216) (or memory control circuit) may be configured to control reading data from the volatile memory (221) and writing data to the volatile memory (221).

[0081] The storage controller (217) (or storage control circuit) may be configured to control reading data from the nonvolatile memory (222) and writing data to the nonvolatile memory (222).

[0082] The CP (218) (or communication processing circuit) may be configured to process data obtained from a component of the processor (210) into a format suitable for transmission to another electronic device via the communication circuit (260), or to process data obtained from another electronic device via the communication circuit (260) into a format suitable for processing by the component of the processor (210). For example, the communication circuit (260) may include one or more communication circuits.

[0083] The sensor interface (219) (or sensing data processing circuit, sensor hub) may be configured to process data about the state of the electronic device (200) and / or the state of the surroundings of the electronic device (200), obtained through the sensor (270), into a format suitable for components of the processor (210).

[0084] According to one embodiment, the processor (210) is operable in a general mode (or normal world) and a secure mode (or secure world). According to one embodiment, the processor (210) may control (or process) the overall operation related to defining focusing on a subject in content (e.g., an image and / or a video) (hereinafter referred to as “video”) based on processing circuits and / or executable program elements, and automatically focusing (e.g., auto reframing) on ​​the focused subject during video playback.

[0085] According to one embodiment, the processor (210) may execute an application related to video editing. According to one embodiment, the processor (210) may receive a first input for selecting one or more videos. According to one embodiment, the processor (210) may display a first interface including the videos to be used for video editing in response to the first input. According to one embodiment, the processor (210) may receive a second input for executing editing of the videos included in the first interface. According to one embodiment, the processor (210) may display a second interface for editing the videos in response to the second input. According to one embodiment, the second interface may include the videos, object information related to a subject included in the videos, and indicators regarding a position and a time point at which a subject corresponding to the object information in the videos is provided. According to one embodiment, the processor (210) may identify a subject corresponding to the selected object information in the videos based on a third input for selecting the object information included in the second interface. According to one embodiment, the processor (210) can track the subject in the video and display it by focusing it in a defined area of ​​interest.

[0086] According to one embodiment, the detailed operation of a processor (210) (e.g., processor (120) of FIG. 1) of an electronic device (200) (e.g., electronic device (101) of FIG. 1) is described with reference to the drawings described below.

[0087] According to one embodiment, the operations performed by the processor (210) may be implemented by executing instructions stored in a recording medium (or a computer program product or storage medium). For example, the recording medium may include a non-transitory computer-readable recording medium having recorded thereon a program for executing various operations performed by the processor (210).

[0088] The embodiments described in the present disclosure may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. In a hardware implementation, the operations described in one embodiment may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and / or other electrical units for performing functions.

[0089] In one embodiment, a computer-readable recording medium (or computer program product or storage medium) is provided, which records a program for causing an electronic device (200) to perform (or execute) various operations.

[0090] The above operations may include: an operation of executing an application related to content editing, an operation of receiving a first input for selecting one or more contents, an operation of displaying a first interface including the contents in response to the first input, an operation of receiving a second input for executing editing of the contents included in the first interface, an operation of displaying a second interface for editing the contents in response to the second input, the second interface including the contents, object information related to a subject included in the contents, and an indicator regarding a position and a time point at which a subject corresponding to the object information in the contents is provided, an operation of identifying a subject corresponding to the selected object information in the contents based on a third input of selecting the object information included in the second interface, and an operation of tracking the subject in the contents and focusing and displaying it by setting a defined region of interest.

[0091] Memory (220) includes at least a portion of the configuration and / or function of memory (130) of FIG. 1, and may store software (e.g., program (140) of FIG. 1 and / or application (146) of FIG. 1). Memory (220) may include one or more storage media (or one or more storage devices). For example, memory (220) may include a memory assembly including one or more storage media. For example, the one or more storage media may include permanent memory (e.g., non-volatile memory (222)) such as a hard drive, flash memory, read-only memory (ROM), semi-permanent memory (e.g., volatile memory (221)) such as random access memory (RAM), any other suitable type of storage (or storage assembly), or any combination thereof.

[0092] The memory (220) may include a cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (200). As a non-limiting example, the cache memory may be included within the processor (210).

[0093] The memory (220) may be fixedly embedded within the electronic device (200) or incorporated into one or more suitable types of components (e.g., a subscriber identity module (SIM) card and / or a secure digital (SD) card) that can be repeatedly inserted into and removed from the electronic device (200).

[0094] For example, the memory (220) may store one or more software applications, such as an operating system (OS) (or system) software application, a firmware software application, a driver software application, a plug-in (e.g., add-in, add-on, and / or applet) software application, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (210). For example, the memory (220) may store instructions callable by an application programming interface (API). For example, the memory (220) may store instructions within a library.

[0095] The memory (220) can store various data used by at least one component (e.g., processor (210)) of the electronic device (200). In one embodiment, the data can include input data or output data for software (e.g., program (140) of FIG. 1 (e.g., operating system (142), middleware (144), and / or application (146) of FIG. 1)) and commands related to the software.

[0096] The memory (220) may include a volatile memory (221) (e.g., the volatile memory (132) of FIG. 1) or a non-volatile memory (222) (e.g., the non-volatile memory (134) of FIG. 1). The memory (220) may store a command or data received from the processor (210) in the volatile memory (221), and may store result data of the command or data stored in the volatile memory (221) being processed by the processor (210) in the non-volatile memory (222).

[0097] According to one embodiment, the memory (220) may include at least one storage, including a first storage portion corresponding to a normal mode and a second storage portion corresponding to a secure mode. The first storage portion and the second storage portion may be different areas of a single storage, or may be separate storage.

[0098] In one embodiment, the data stored in the memory (220) may include various learning data and / or parameters acquired based on the user's learning through interaction with the user. In one embodiment, the data may include various schemas (or algorithms, models, networks, or functions) for supporting artificial intelligence-based operations.

[0099] In one embodiment, the fields in which artificial intelligence technology is applied may be diverse. For example, it may consist of technologies in the fields of linguistic understanding, visual understanding, inference / prediction, knowledge representation, and / or motion control. Linguistic understanding refers to technologies that recognize and apply / process human language / characters, and may include natural language processing, machine translation, conversational systems, question answering, and / or speech recognition / synthesis. Visual understanding refers to technologies that recognize and process objects similar to human vision, and may include object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and / or image enhancement. Inference / prediction refers to technologies that logically infer and predict by judging information, and may include knowledge / probability-based inference, optimized prediction, preference-based planning, and / or recommendation. Knowledge representation refers to technologies that automatically process human experience information into knowledge data, and may include knowledge construction (e.g., data generation / classification) and / or knowledge management (e.g., data utilization). Motion control is a technology for controlling the movement of an electronic device (200), and may include motion control and / or manipulation control (e.g., action control).

[0100] In one embodiment, a scheme for supporting artificial intelligence-based operations in an electronic device (200) may include a neural network. In one embodiment, the neural network may include a neural network model based on at least one of an artificial neural network (ANN), a convolution neural network (CNN), a region with convolution neural network (R-CNN), a region proposal network (RPN), a recurrent neural network (RNN), a stacking-based deep neural network (S-DNN), a state-space dynamic neural network (S-SDNN), a deconvolution network, a deep belief network (DBN), a restricted Boltzman machine (RBM), a long short-term memory (LSTM) network, a classification network, a plain residual network, a dense network, a hierarchical pyramid network, and / or a fully convolutional network. According to one embodiment, the type of the neural network model is not limited to the examples described above.

[0101] According to one embodiment, the memory (220) may store instructions that, when executed individually and / or collectively by the processor (210), cause the electronic device (200) to perform operations.

[0102] According to one embodiment, the memory (220) may store instructions that, when executed individually and / or collectively by the processor (210), cause the electronic device (200) to perform operations.

[0103] According to one embodiment, the memory (220) may store instructions that, when individually and / or collectively executed by the processor (210), cause the electronic device (200) to execute an application related to content editing, receive a first input for selecting one or more contents, display a first interface including the contents in response to the first input, receive a second input for executing editing of the contents included in the first interface, and display a second interface for editing the contents, the second interface including the contents, object information related to a subject included in the contents, and an indicator regarding a position and a time point at which a subject corresponding to the object information in the contents is provided, and identify a subject corresponding to the selected object information in the contents based on a third input for selecting the object information included in the second interface, and track the subject in the contents and focus on and display the subject in a defined region of interest setting.

[0104] For example, the instructions may be stored as software (e.g., program (140) of FIG. 1) on the memory (220) and executable by the processor (210). For example, the instructions may include control commands such as arithmetic and logical operations, data movement, and / or input / output that may be recognized by the processor (210). According to one embodiment, the software may include various applications (e.g., application (146) of FIG. 1) that may provide various functions (or services) (e.g., interactive service function, routine function, call function, message function, messenger function, e-mail function, SNS (social networking service) function, search function, media (e.g., video and / or music) playback function, game function, and / or wireless communication function) in the electronic device (200).

[0105] The display (240) may include a configuration identical or similar to that of the display module (160) of FIG. 1. The display (240) may display various images provided from the processor (210). Under the control of the processor (210), the display (240) may visually provide an application being executed (e.g., the application (146) of FIG. 1) and various screens related to its use (e.g., a contents screen, an application execution screen, a menu screen, and / or a function execution screen). According to one embodiment, the screen size of the display (240) may change depending on the form factor of the electronic device (200) (e.g., a bar-type smartphone (291-1), a foldable-type smartphone (291-2), a slider-type smartphone (291-3), a tablet (292)). For example, the display (240) may be configured to provide a first state having a first screen size and a second state having a second screen size larger than the first screen size.

[0106] The display (240) may be combined with a touch sensor, a pressure sensor capable of measuring the intensity of a touch, and / or a touch panel (e.g., a digitizer) that detects a magnetic stylus pen. The display (240) may detect a touch input, an air gesture input, and / or a hovering input (or a proximity input) by measuring a change in a signal (e.g., voltage, light intensity, resistance, electromagnetic signal, and / or charge) for a specific location of the display (240) based on the touch sensor, the pressure sensor, and / or the touch panel. For example, the display (240) may include a touch screen that detects a touch and / or a proximity touch (or a hovering) input using a part of a user's body (e.g., a finger) or an input device (e.g., a stylus pen).

[0107] The display (240) may include, but is not limited to, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, and / or an active matrix OLED (AMOLED) display, a micro electro mechanical systems (MEMS) display, or an electronic paper display. In one embodiment, the display (240) may include a flexible display.

[0108] The communication circuit (260) can support the establishment of a designated wireless communication channel (e.g., short-range communication such as Bluetooth communication and / or BLE communication) and the performance of communication through the established wireless communication channel. For example, the communication circuit (260) can perform designated communication (e.g., Bluetooth communication and / or BLE communication) with an external device. The communication circuit (260) can support wireless communication with an external device using cellular wireless communication (e.g., 4G LTE, 5G NR) and / or short-range wireless communication (e.g., Wi-Fi). For example, the electronic device (200) can communicate with an external server (e.g., a generative artificial intelligence server) that provides artificial intelligence-based functions (e.g., conversational services, assistant services, or AI agents) through a network using the communication circuit (260). According to one embodiment, the communication circuit (260) can transmit data generated in the electronic device (200) to the external server and receive data transmitted from the external server. The communication circuit (260) may include at least some of the configuration and / or functions of the communication module (190) of FIG. 1.

[0109] FIG. 3 is a diagram illustrating a display according to one embodiment of the present disclosure.

[0110] Referring to FIG. 3, the display (240) may include a display having a fixed shape, and / or a deformable display, such as a foldable display or a rollable (or slidable) display. The components, their relationships, and their functions depicted in FIG. 3 are exemplary only and do not limit the implementations described or claimed in this document.

[0111] The display (240) may include components such as a display panel (310), a display driver integrated circuitry (DDI) (330) (or display driver circuitry (330)), and / or touch circuitry (350). The above components are merely exemplary. For example, the display (240) may include other components (e.g., a digitizer and / or circuitry for controlling a sensor (270). For example, some components may be omitted from the display (240).

[0112] The display panel (310) may include a plurality of pixels and a plurality of thin film transistors (TFTs) that control the plurality of pixels. For example, the plurality of TFTs may include p-channel metal-oxide semiconductor (PMOS) transistors and / or n-channel metal-oxide semiconductor (NMOS) transistors. Each of the plurality of pixels may include a set of sub-pixels (e.g., a sub-pixel for providing red light, a sub-pixel for providing blue light, a sub-pixel for providing green light, and / or a sub-pixel for providing white light). For example, the plurality of pixels in the display panel (310) may be driven based on a voltage (or current) provided to the TFTs through (or from) the display driving circuit (330).

[0113] The display driving circuit (330) can provide visual information through the display panel (310) based on image data received from the processor (210) and / or commands for controlling the operation of sub-components of the display driving circuit (330). The display driving circuit (330) can include sub-components such as an interface controller (331) (e.g., including an interface control circuit), a timing controller (332) (e.g., including a timing control circuit), a command controller (333) (e.g., including a command control circuit), a graphics random access memory (GRAM) controller (334) (e.g., including a GRAM control circuit), a GRAM (335), a source driver (338), and / or a gate driver (339).

[0114] The above sub-components are exemplary. For example, the display driver circuit (330) may further include other sub-components (e.g., a self-drawing engine (or any suitable circuit for self-drawing)). For example, some sub-components (e.g., a GRAM controller (334) and a GRAM (335)) may be omitted from the display driver circuit (330). For example, some sub-components (e.g., a source driver (338) and a gate driver (339)) may be arranged as separate components from the display driver circuit (330).

[0115] The interface controller (331) may provide image data acquired from the processor (210) (e.g., the display controller (215)) to the GRAM (335) and provide commands acquired from the processor (210) to the command controller (333). For example, the interface controller (331) may be used for one or more interfaces (e.g., a mobile industry processor interface (MIPI), a mobile display digital interface (MDDI), a serial peripheral interface (SPI), an inter-integrated circuit (I2C), and / or a compact display port (CDP)). In one embodiment, the image data may be stored in the GRAM (335). In one embodiment, storing the image data in the GRAM (335) may be bypassed. When storing the image data is bypassed, the image data may be provided to an image processing circuit (not shown) or a source driver (338) in the display driving circuit (330) through the interface controller (331).

[0116] The timing controller (332) can provide a synchronization signal (or timing signal) to the GRAM controller (334), the source driver (338), and / or the gate driver (339). In one embodiment, the synchronization signal is generated by the timing controller (332), and the synchronization signal generated by the timing controller (332) can be provided from the timing controller (332) to the GRAM controller (334), the source driver (338), the gate driver (339), and / or the touch circuit (350). In one embodiment, the synchronization signal can be generated by a synchronization signal generation circuit located outside the display driver circuit (330), and can be provided from the synchronization signal generation circuit to the timing controller (332).

[0117] The synchronization signal provided from the synchronization signal generation circuit may be provided from the timing controller (332) to the GRAM controller (334), the source driver (338), and / or the gate driver (339). For example, the synchronization signal may include a display synchronization signal (e.g., a display vertical synchronization signal and a display horizontal synchronization signal). For example, the display vertical synchronization signal and the display horizontal synchronization signal may be used for reference timing for switching the source driver (338) and the gate driver (339), respectively. For example, the synchronization signal may include a touch synchronization signal (e.g., a touch vertical synchronization signal and a touch horizontal synchronization signal). For example, the touch vertical synchronization signal and the touch horizontal synchronization signal may each be provided to the touch circuit (350). As a non-limiting example, the frequency of the display synchronization signal may be different from the frequency of the touch synchronization signal.

[0118] The command controller (333) can provide the above command to the GRAM controller (334) and / or the timing controller (332).

[0119] The GRAM controller (334) can scan the image data recorded in the GRAM (335) based on the synchronization signal obtained from the timing controller (332) and the command obtained from the command controller (333), thereby providing the image data to the source driver (338). In one embodiment, the image data can be processed based on the command provided to the image processing circuit from the command controller (333) through an image processing circuit (not shown) located between the GRAM (335) and the source driver (338) before being provided to the source driver (338).

[0120] The source driver (338) can provide color through the set of sub-pixels based on the display vertical synchronization signal and the image data. For example, the source driver (338) can provide a data voltage corresponding to the input image data to a plurality of pixels. The gate driver (339) can turn on or turn off the set of sub-pixels based on the display horizontal synchronization signal and the emission signal.

[0121] The touch circuit (350) may include a touch sensor controller (351) and a touch sensor (352). The touch sensor controller (351) may control the touch sensor (352) based on the touch synchronization signal (e.g., the touch vertical synchronization signal and / or the touch horizontal synchronization signal) to obtain information about an input on the display panel (310) (e.g., a touch input or a hovering input on the display panel (310). The touch sensor controller (351) may provide the information obtained based on the touch synchronization signal to the processor (210) or the display driving circuit (330). The touch sensor (352) may be disposed in relation to the display panel (310). For example, the touch sensor (352) may be disposed within the display panel (310) or on the display panel (310).

[0122] An electronic device (e.g., an electronic device (101, 200) of FIG. 1 or 2) (hereinafter referred to as electronic device (101)) according to one embodiment of the present disclosure may include a display (e.g., a display module (160) of FIG. 1, a display (240) of FIG. 2 or 3) (hereinafter referred to as display (160)), at least one processor including processing circuitry (e.g., a processor (120) of FIG. 1, a processor (210) of FIG. 2 or 3)) (hereinafter referred to as processor (120)), and a memory (e.g., a memory (130, 220) of FIG. 1 or 2) (hereinafter referred to as memory (130)). In one embodiment, the memory (130) may store instructions that, when individually and / or collectively executed by the processor (120), cause the electronic device (101) to perform operations.

[0123] According to one embodiment, the instructions, when individually and / or collectively executed by the processor (120), may cause the electronic device (101) to execute an application related to content editing. The instructions, when individually and / or collectively executed by the processor (120), may cause the electronic device (101) to receive a first input for selecting one or more contents. The instructions, when individually and / or collectively executed by the processor (120), may cause the electronic device (101) to display a first interface including the contents in response to the first input. The instructions, when individually and / or collectively executed by the processor (120), may cause the electronic device (101) to receive a second input for executing editing of the contents included in the first interface. The instructions, when individually and / or collectively executed by the processor (120), may cause the electronic device (101) to display a second interface for editing the content in response to the second input. According to one embodiment, the second interface may include the content, object information related to a subject included in the content, and an indicator regarding a position and a time point at which a subject corresponding to the object information in the content is provided. The instructions, when individually and / or collectively executed by the processor (120), may cause the electronic device (101) to identify a subject corresponding to the selected object information in the content based on a third input selecting the object information included in the second interface.The above instructions, when individually and / or collectively executed by the processor (120), may cause the electronic device (101) to track the subject in the content and focus and display it in a defined area of ​​interest.

[0124] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to recognize a subject included in the content based on object recognition on the content, generate object information related to the recognized subject, and display a third interface including the object information.

[0125] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to receive, through the third interface, an input for selecting object information related to a subject for setting a region of interest.

[0126] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to change and display object information included in the third interface based on a change in an object included in the content while displaying the content.

[0127] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to recognize at least one subject in the content, infer at least one object of interest included in the content from among the at least one subject, identify a distribution of the at least one object of interest in the content, and generate the indicator based on the distribution of the at least one object of interest in the content.

[0128] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to set the region of interest by taking into account the size of the subject, surrounding subjects, and / or maximum and minimum areas of the subject.

[0129] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to store editing information related to a subject set to be focused and displayed in a content editing operation.

[0130] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to record edited content during a content editing operation to concurrently generate edited content.

[0131] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to focus and display a tracked subject based on a defined focus box.

[0132] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to dim an area other than a region of interest of the tracked subject and display the tracked subject in focus.

[0133] Hereinafter, an operating method of an electronic device (101, 200) according to various embodiments (hereinafter referred to as electronic device (101)) will be described in detail. Operations performed in the electronic device (101) according to various embodiments may be executed by at least one processor (120, 210) (hereinafter referred to as processor (120)) including various processing circuitry and / or executable program elements of the electronic device (101). According to one embodiment, the operations performed in the electronic device (101) may be stored as instructions in a memory (130, 220) (hereinafter referred to as memory (130)) and individually and / or collectively performed (or executed) by the processor (120).

[0134] FIG. 4 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.

[0135] According to one embodiment, FIG. 4 may illustrate an example of a method for providing image editing including image reframing in an electronic device (101) according to one embodiment.

[0136] A method for defining focusing on a subject in an image (e.g., a video) in an electronic device (101) according to one embodiment of the present disclosure and automatically focusing (e.g., auto-reframing) the focused subject during image playback may be performed, for example, according to a flowchart illustrated in FIG. 4. The flowchart illustrated in FIG. 4 is an example according to one embodiment of the operation of the electronic device (101), and the order of at least some operations may be changed or performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 401 to 415 may be performed in at least one processor (120) of the electronic device (101).

[0137] As illustrated in FIG. 4, an operation method performed by an electronic device (101) according to an embodiment may include an operation of executing an application related to content editing (operation 401), an operation of receiving a first input for selecting one or more contents (e.g., contents to be used for editing) (operation 403), an operation of displaying a first interface including contents (e.g., contents to be used for editing) in response to the first input (operation 405), an operation of receiving a second input for executing editing of contents included in the first interface (or for executing a designated content editing mode) (operation 407), an operation of displaying a second interface for editing contents in response to the second input (operation 409), an operation of receiving a third input for selecting object information included in the second interface (operation 411), an operation of identifying a subject corresponding to object information selected from the contents based on the third input (operation 413), and an operation of tracking a subject in the contents and displaying it by focusing on it by setting a defined region of interest (operation 415). there is.

[0138] Referring to FIG. 4, in operation 401, the processor (120) of the electronic device (101) may execute an application (or editing application) related to editing content (e.g., an image and / or video) (e.g., a content editing (e.g., a video editing) application). According to one embodiment, the processor (120) may receive an input from a user to execute an application related to editing content. According to one embodiment, the processor (120) may execute the application and display an execution screen of the application on a display in response to an input related to executing the application.

[0139] In operation 403, the processor (120) may receive a first input for selecting one or more contents (e.g., images and / or videos) (e.g., contents to be used for editing). In one embodiment, an application may be executed, and one or more contents (or content clips (e.g., video clips)) may be selected based on a list of contents stored in the electronic device (101) using a menu defined in the application.

[0140] In operation 405, the processor (120) may display a first interface including content (e.g., images and / or videos) (e.g., content to be used for editing) in response to the first input. According to one embodiment, the first interface may include one or more contents selected by the user and additional information related to the contents. In one embodiment, an example of the first interface is described with reference to FIG. 5A.

[0141] In operation 407, the processor (120) may receive a second input for executing editing of content included in the first interface. In one embodiment, the user may perform an input (e.g., a tap touch gesture) for selecting a defined button (e.g., an execution button, an execution icon, or an execution item) for entering a designated content editing mode (e.g., a subject identification-based editing mode) in the first interface. In one embodiment, the processor (120) may, in response to the second input, execute (or enter) the designated content editing mode (e.g., a subject identification-based editing mode).

[0142] In operation 409, the processor (120) may display a second interface for editing content (e.g., for editing content based on subject identification) in response to the second input. According to one embodiment, the second interface may include content, object information (or a subject indicator, subject information, or image information) related to a subject included in the content (e.g., an image item or visual object that graphically represents information about a subject (e.g., a person or an object)), and an indicator regarding a location and time point at which a subject corresponding to the object information in the content is provided. In one embodiment, an example of the second interface is described with reference to FIG. 5B.

[0143] According to one embodiment, the processor (120) may perform object recognition on the content in response to the second input. According to one embodiment, the processor (120) may recognize an object included in the content based on the object recognition. In one embodiment, the object (or subject) may represent a person or an object that is the target of the content (e.g., an object that is the subject of the content). According to one embodiment, the processor (120) may recognize (or extract or identify) a subject (e.g., a person and / or an animal) defined by a user among a plurality of objects included in the content.

[0144] According to one embodiment, the processor (120) may generate object information (or subject indicator, subject information, image information) related to the recognized subject (or object) (e.g., an image item or visual object that graphically represents information about the subject (e.g., a person or an object)). According to one embodiment, the content information may be generated to correspond to each subject (e.g., a person object) recognized through object recognition in content displayed on the screen, and may represent a visual indicator that allows the user to recognize the recognized subject. For example, the object information may include a thumbnail image (e.g., a thumbnail image of an object (e.g., a subject)) captured from the recognized subject and generated (or produced) in a specified shape (e.g., a circle).

[0145] According to one embodiment, object information may be provided through a defined third interface. For example, the processor (120) may display a third interface including at least one object information on the second interface. According to one embodiment, the third interface may include content information, and according to one embodiment, may include an indicator (or visual object) (e.g., an indicator (570) including a first visual object (571) (e.g., a dot object) and a second visual object (573) (e.g., a section object) of FIGS. 5B and 5C) that provides visual information regarding a section in which a subject corresponding to the content information is included in the content (e.g., a point in time when the subject changes within the screen). In one embodiment, examples of the third interface and content information are described with reference to FIGS. 5B and 5C.

[0146] According to one embodiment, the object information of the third interface may be correspondingly changed based on a change in the subject within the screen while the content is being played (or displayed). For example, the content information may include a change in the properties of the subject within the screen (e.g., a change in the number of subjects and / or a replacement of at least one subject with a different subject even if the number of subjects is the same), such as the subject (or object) being currently displayed on the screen, the subject (or object) displayed on the screen not being displayed on the screen, or a new subject (or object) being added to the screen. According to one embodiment, the processor (120) may change and display the object information of the third interface based on a change in the subject included in the content while the content is being displayed.

[0147] According to one embodiment, the processor (120) can determine (or identify) the distribution of recognized objects within the content. In one embodiment, the distribution of objects may indicate a state in which recognized objects are scattered throughout the entire playback range (or playback section) of the content. For example, the processor (120) can identify objects (e.g., the distribution of objects) scattered throughout the playback range of the content, and thereby identify the section (or time point) in which each object appears on the screen. According to one embodiment, the processor (120) can generate an indicator based on the distribution of recognized objects. In one embodiment, examples of indicators are described with reference to FIGS. 5B and 5C .

[0148] In operation 411, the processor (120) may receive a third input for selecting object information included in the second interface. According to one embodiment, the processor (120) may receive a third input for selecting at least one object information from the third interface including object information.

[0149] In operation 413, the processor (120) may identify a subject corresponding to object information selected from the content based on a third input. According to one embodiment, the processor (120) may identify (or track) at least one subject (e.g., a target subject or a subject of interest) corresponding to object information selected from the content based on a third input that selects object information included in the second interface (e.g., object information of the third interface). According to one embodiment, the processor (120) may extract a frame (e.g., a frame of the content) containing a subject corresponding to the selected content information (e.g., a thumbnail image) from the content, identify a subject area in each frame, and edit the subject so that it is positioned in a predetermined area (e.g., the center of the screen), or store editing information (e.g., location information) for the editing.

[0150] In operation 415, the processor (120) may track a subject in the content and display it by focusing on it with a defined region of interest setting. In one embodiment, the defined region of interest setting may include a setting for displaying a focus box centered on the subject or a setting for displaying the remaining area (e.g., the left and / or right area based on the subject) excluding the subject by dimming it. According to one embodiment, the processor (120) may track a subject in the content and display it by focusing on the subject by using a focus box centered on the subject or dimming the left and right areas excluding the subject. In one embodiment, an example of focusing on the subject by setting a region of interest is described with reference to FIGS. 6 and 7.

[0151] Hereinafter, embodiments of the present disclosure will be described with reference to exemplary drawings. However, the exemplary drawings may be implemented in various different forms and are not limited to the embodiments described herein. In the drawings and the related descriptions of the drawings, descriptions of well-known functions and configurations may be schematically illustrated or omitted for clarity and conciseness. For example, the exemplary drawings schematically illustrate content displayed in a playback area (e.g., a video portion), each frame in an area (e.g., a frame area) in which frames constituting the content (e.g., a video) are displayed, and / or a section in which various elements related to a subject in the content are output, and an information area providing information related to the elements output in the section (e.g., subtitle information, sound information). However, the configuration of the content displayed in the playback area (e.g., a video portion), each frame in the frame area, and / or the information area providing information related to the output elements may include various different forms corresponding to the playback of the content.

[0152] FIGS. 5A, 5B, 5C, and 5D are diagrams illustrating an example of an operation of image editing including image reframing in an electronic device according to one embodiment of the present disclosure.

[0153] According to one embodiment, FIGS. 5A, 5B, 5C, and 5D may illustrate a user interface that supports content (e.g., image and / or video) editing (hereinafter, referred to as “video editing”) in an electronic device (101) according to one embodiment, and an operation example of defining a subject for auto focusing (e.g., image reframing) in content (e.g., image and / or video) (hereinafter, referred to as “video”) using the same.

[0154] In one embodiment, a video reframing function may refer to an editing function that crops out unnecessary portions of a video (e.g., a video) or zooms in (e.g., enlarges) a defined portion. For example, a user may implement an optimal composition by reframing a captured video during the editing stage. According to one embodiment, a user may crop out or zoom in (e.g., focus) a moving subject (or object) in a video to fit various aspect ratios through reframing during video editing. For example, a user may reconfigure a screen composition that is optimized for an aspect ratio (e.g., 16:9 ratio, 1:1 ratio, 9:16 ratio, 4:3 ratio, 21:9 ratio) according to a social media platform on which the video is to be posted.

[0155] In one embodiment, a subject (or object) in a video may change position, or may be excluded (e.g., moved off-screen) in some frames of the video, and then reappear in other frames. In an embodiment of the present disclosure, focusing on a user-specified subject in a video (e.g., a video) can be defined, and the focused subject can be continuously and automatically focused (e.g., auto-reframing) during video playback.

[0156] Referring to FIG. 5A, a user may execute an application (e.g., a video editing application). In response to the execution of the application, the electronic device (101) may display an execution screen on the display based on an interface (or user interface) (e.g., a first interface) defined in the application. According to one embodiment, the user may select at least one video (or clip) to be edited (e.g., a video or video clip to be used for editing) based on the execution of the application. For example, the user may select multiple videos as target videos for video editing.

[0157] As illustrated in FIG. 5A, an interface related to video editing (e.g., a first interface) may include a playback area (or media area) (501) in which a target video selected by a user (e.g., a video to be used for editing in a specified content editing mode) is played (or displayed), a frame area (503) in which frames constituting each video are displayed, a section in which various elements (e.g., subtitles, sounds) related to a subject in the video are output (or generated), and an information area (505) that provides information related to the elements output in the section (e.g., subtitle information, sound information).

[0158] In one embodiment, the playback area (or media area (501)) may include a display area (510) where an image is played (or displayed) and an information area (520) where information related to the playback of the image is provided.

[0159] In one embodiment, the display area (510) may be provided with a screen ratio corresponding to an aspect ratio defined by the user through the application. For example, the user may preset an aspect ratio (e.g., 16:9 ratio, 1:1 ratio, 9:16 ratio, 4:3 ratio, 21:9 ratio, or the aspect ratio of the original image) for which he or she wishes to produce an image, and the electronic device (101) may provide the display area (510) with a screen ratio corresponding to the aspect ratio defined by the user when executing the application.

[0160] In one embodiment, the information area (520) may include time information (501-1) related to the playback of the video being played (or displayed), an object (501-2) for toggling the sound (or audio) of the video on / off (e.g., a sound switch icon), and / or an object (501-3) for switching functions such as previewing or viewing the video in full screen (e.g., a full screen view icon). In one embodiment, the top of the information area (520) may include a completion button (501-4) (e.g., a Done button) for completing an action being performed (e.g., completing an editing mode of the video).

[0161] In one embodiment, the frame area (503) may sequentially provide frames that constitute one or more images (e.g., target images) selected by the user (e.g., images to be used for editing in a specified content editing mode). In one embodiment, each frame of the frame area (503) may include a thumbnail image corresponding to an image (e.g., a preview image) currently displayed in the display area (510). In one embodiment, the frame area (503) may provide frames (or groups of frames) for each image (e.g., a first image and a second image) by distinguishing them. For example, as illustrated in FIG. 5A, when a first image (or a first clip) (e.g., a first video clip to be used for editing) and a second image (or a second clip) (e.g., a second video clip to be used for editing) are selected as target images by the user, a plurality of first frames (531) related to the first image and a plurality of second frames (533) related to the second image may be distinguished and provided. In one embodiment, the first frame (531) of the first image and the second frame (533) of the second image can be distinguished by a delimiter (540).

[0162] In one embodiment, the information area (505) may represent an area that provides additional information related to the image. In one embodiment, the information area (505) may include a section in which various elements (e.g., visual elements and / or auditory elements) (e.g., subtitles, sounds, graphic objects) related to a subject in the image are output (or generated) and information related to the elements (e.g., subtitles, sounds, graphic objects) output in the section. In one embodiment, the information related to the elements may include, for example, a designated graphic object (505-1) corresponding to a graphic object element (e.g., a sticker and / or an emoticon), subtitle information (505-2) corresponding to a subtitle element (e.g., a text preview), and / or sound information (e.g., an audio title) (505-3) corresponding to a sound element.

[0163] In one embodiment, the information area (505) may include various menus (or icons or indicators) for executing functions related to the image, although not illustrated. For example, the various menus may include an edit menu (or edit object) for entering a designated editing mode of the image, a share menu (or share object) for sharing the image, a delete menu (or delete object) for deleting the image, and / or a background setting menu (or background setting object) for setting a background based on the image. In one embodiment, the various menus of the information area (505) are specific examples presented to easily explain the contents and help understand the present disclosure, and the various menus are not limited to the examples described above. For example, the embodiments of the various menus may be given merely as examples, and the scope of the various menus may vary beyond the embodiments disclosed herein.

[0164] In one embodiment, for convenience of explanation, FIG. 5A illustrates, but is not limited to, an edit menu (or an edit object) (e.g., an execution button (560)) for entering a designated edit mode (or a designated content edit mode) (e.g., a subject identification-based edit mode). For example, an edit menu may be selected by a user in the information area (505), and in response to the selection of the edit menu, various edit objects related to editing an image (e.g., icons (or buttons or indicators) for entering each edit mode) may be provided through the menu area of ​​the information area (505). For example, the various edit objects related to editing an image may include objects related to various edit modes, such as an image cropping object, an image adjustment (e.g., rotation, horizontal flip, ratio, shape correction) object, a filter object, a color tone object, a decoration (e.g., drawing sticker, text) object, and / or a face retouching object. In one embodiment, examples of edit modes are presented as specific examples to help understanding and are not limited thereto. For example, the embodiments regarding the edit mode may be given merely as an example, and the scope of the edit mode may vary beyond the embodiments disclosed herein.

[0165] According to one embodiment, the display may include a play head (550) (e.g., a playback status indicator or a playback timeline indicator) based on the vertical center axis of the display, including a frame area (503) and an information area (505). According to one embodiment, while the video is being played, each piece of information (e.g., a frame, additional information) in the frame area (503) and the information area (505) may move (e.g., move from right to left) according to a temporal characteristic (e.g., a timeline or time flow), and the play head (550) may be a visual object that assists a user in recognizing the movement status of a frame according to time flow and / or the position of a frame displayed on a screen in the video. In one embodiment, the play head (550) may be displayed fixedly on the vertical center axis of the display.

[0166] According to one embodiment, a user may perform an input (e.g., a tap touch gesture) to select a defined execution button (or execution icon or execution item) (560) to enter an image editing mode in a first interface. According to one embodiment, the user may select the designated execution button (560) to execute (or enter) a focusing setting (e.g., reframing a frame containing a subject) for a user-specified subject in a target image (e.g., entering an image editing mode (or reframing mode)). According to one embodiment, the electronic device (101) may execute (or enter) the image editing mode in response to an input of selecting the execution button (560). Examples of an interface (e.g., a second interface) for entering an image editing mode according to one embodiment are illustrated in FIGS. 5B to 5D .

[0167] Referring to FIG. 5B, an interface (e.g., a second interface) may be displayed upon entering the video editing mode. In one embodiment, the interface may include components of the interface (e.g., the first interface) illustrated in FIG. 5A, and may include a visual object (500) (e.g., a focus box) related to setting a region of interest, and an indicator (570) providing visual information regarding the point in time when the subject of the video changes within the screen.

[0168] According to one embodiment, when entering an image editing mode, the electronic device (101) may determine (or identify) the distribution of subjects within the image through object recognition (e.g., character analysis) in the target image. According to one embodiment, the electronic device (101) may generate and provide an indicator (570) based on the distribution of subjects within the image. In one embodiment, the electronic device (101) may recognize (or extract) subjects (e.g., characters and / or animals) defined by the user among various subjects included in the image.

[0169] According to one embodiment, the indicator (570) may include a first visual object (571) (e.g., a dot object) indicating a point at which a subject shown within the screen changes, and a second visual object (573) (e.g., a section object) indicating a section at which the same subject is shown within the screen, as illustrated in FIGS. 5b and 5c.

[0170] According to one embodiment, a visual object (500) (e.g., a focus box) associated with setting a region of interest may support setting a region of interest based on a subject selected by a user in a playback area (or media area) (501) where an image is played (or displayed), and may include a function of focusing on at least one subject based on the set region of interest. Examples of this are illustrated in FIGS. 5C and 5D .

[0171] Referring to FIG. 5C, FIG. 5C may illustrate an example in which an interface (e.g., a second interface) includes a third interface (580) for object information. For example, the electronic device (101) may generate at least one piece of object information related to a subject. In one embodiment, the object information may include a thumbnail image captured from a subject recognized in an image and created (or manufactured) in a specified shape (e.g., a circle). According to one embodiment, the object information may be provided through a defined third interface (580). For example, the electronic device (101) may provide, on the second interface, a third interface (580) including at least one piece of object information.

[0172] According to one embodiment, the object information of the third interface (580) may be correspondingly changed based on a change in the subject within the screen while the image is being played (or displayed). According to one embodiment, the electronic device (101) may change and display the object information of the third interface (580) based on a change in the subject included in the image (e.g., the subject displayed on the screen) while displaying the image. According to one embodiment, when a portion of the first visual object (571) is selected in the indicator (570), the electronic device (101) may display object information related to at least one subject displayed on the screen at a time corresponding to the visual object of the selected portion on the third interface (580).

[0173] According to one embodiment, a user may change the scope of the region of interest (e.g., change focus information) by adjusting (e.g., expanding or reducing) a visual object (500) (e.g., a focus box) related to setting a region of interest. For example, the user may adjust the size and / or number of subjects to be included in the region of interest by adjusting (e.g., dragging) the size of the focus box. According to one embodiment, when the focus information is changed, the electronic device (101) may provide object information related to a subject included in the region of interest by emphasizing (e.g., highlighting the edge) that it has been selected in the object information of the third interface (580). For example, as illustrated in FIG. 5C, the first object information (581) may be in a selected state. For example, the electronic device (101) may indicate the selected state in a highlighting manner (e.g., highlighting the edge) defined in the first object information (581).

[0174] According to one embodiment, when object information of the third interface (580) (e.g., first object information (581)) is selected, the electronic device (101) can track a subject corresponding to the first object information (581) on the screen and set it as a region of interest. For example, the focus box (500) can be provided by focusing on the subject corresponding to the first object information (581).

[0175] According to one embodiment, the electronic device (101) may provide visual information about a section in which a subject of an area of ​​interest or a subject corresponding to selected object information is included in an image through a defined visual object (590) (e.g., a section visual object) in the information area (505). For example, the electronic device (101) may display information about a section (or length) in which selected first object information (581) is displayed on the screen as a section visual object (e.g., a timeline, a bar graph) together with the object information.

[0176] In one embodiment, a user can adjust the length of a segment visual object to adjust the segment in which the subject is focused, or toggle the subject out of focus by re-selecting the object information for the subject.

[0177] According to one embodiment, a user can add a target subject to focus on via the third interface (580). For example, the user can additionally select second object information (583) while first object information (581) is selected via the third interface (580). An example of an additional selection of second object information (583) is illustrated in FIG. 5D.

[0178] Referring to FIG. 5D, the electronic device (101) may provide visual information (e.g., a visual object (590)) for a section in which a subject corresponding to the first object information (581) is included in the image (or shown on the screen) and visual information (e.g., a visual object (595)) for a section in which a subject corresponding to the second object information (583) is included in the image (or shown on the screen) in the information area (505). According to one embodiment, the electronic device (101) may provide information based on an interlocutor (570) about a point at which a subject (e.g., a subject of the second object information (583)) that the user focuses on is shown. For example, the electronic device (101) may provide information by emphasizing a portion corresponding to a point at which a subject that the user focuses on is shown in the indicator (570) as a defined visual object (575).

[0179] As illustrated in FIGS. 5A to 5D , when entering an image editing mode, the electronic device (101) may analyze a subject (e.g., a person and / or an object) to display an indicator (570) (e.g., a subject selection layer) including a change point for each subject composition in correspondence with the length of an image (e.g., a video clip) (e.g., see FIG. 5A ). According to one embodiment, when the electronic device (101) receives an input for selecting a portion of the indicator (570), the electronic device (101) may display object information corresponding to the subject included in the section of the portion selected by the indicator (570) (e.g., see FIG. 5B ). According to one embodiment, when the electronic device (101) receives an input for selecting a portion of object information, the electronic device (101) may set the subject corresponding to the selected object information as a region of interest and focus on the subject on the screen (e.g., see FIGS. 5C to 5D ). According to one embodiment, the electronic device (101) may provide visual information (e.g., a section visual object, a focusing edit layer) regarding a section in which the subject is displayed on the screen, at a position corresponding to the point of focus (e.g., FIGS. 5C to 5D ). The user may edit the focusing of the subject displayed on the screen by adjusting the visual information.

[0180] FIGS. 6 and 7 are drawings illustrating examples of providing a region of interest by focusing in an electronic device according to one embodiment of the present disclosure.

[0181] Referring to FIGS. 6 and 7, the electronic device (101) can track a subject in an image and display it by focusing on a defined region of interest.

[0182] In one embodiment, FIG. 6 may illustrate an example of providing a focus on a target subject in an area of ​​interest by displaying a focus box (600) centered on the target subject.

[0183] In one embodiment, FIG. 7 may illustrate an example of providing a focused image of a target subject of a region of interest by dimming (700) the remaining area (e.g., the left and / or right area relative to the subject) other than the target subject. According to one embodiment, the electronic device (101) may display an area (e.g., a region of interest) reconstructed to fit the subject selected by the user based on the original image, and may display the remaining areas by dimming them.

[0184] According to one embodiment, the electronic device (101) can track a target subject in an image, and display the target subject by focusing on it through a focus box (600) centered on the target subject or dimming (700) the left and right areas outside the target subject. According to one embodiment, when playing back an image, the convenience of image editing can be improved by allowing the original image and the image centered on the subject to be viewed together.

[0185] FIG. 8 is a diagram illustrating an example of changing a region of interest in an electronic device according to one embodiment of the present disclosure.

[0186] As illustrated in FIG. 8, a user can change the scope of a region of interest (e.g., change focus information) by adjusting (e.g., moving, expanding, or reducing) a visual object (800) (e.g., a focus box) associated with setting a region of interest. For example, a user can change the subject to be set as a region of interest by adjusting (e.g., dragging) the size of a visual object (800) (e.g., a focus box).

[0187] According to one embodiment, in the example of FIG. 8, an area of ​​interest is set centered on a first subject (810) displayed on the screen, and an example of setting an area of ​​interest including a second subject (820) displayed on the screen while the first subject (810) is displayed in focus may be shown. For example, a user may expand a visual object (800) with a drag input to include the first subject (810) and the second subject (820) in the area of ​​interest, thereby displaying the first subject (810) and the second subject (820) in focus.

[0188] According to one embodiment, when focus information is changed, the electronic device (101) may provide object information related to a subject included in a region of interest by highlighting (e.g., highlighting the edge) that has been selected from the object information. For example, the electronic device (101) may indicate a selected state in an emphasis manner defined in the first object information of the first subject (810) and the second object information of the second subject (820).

[0189] According to one embodiment, a visual object (800) related to setting a region of interest (e.g., a focus box) may support setting a region of interest based on a subject selected by a user, and may include a function of focusing on at least one subject based on the set region of interest.

[0190] According to one embodiment, the setting of the region of interest may be changed by directly adjusting the visual object (800) and / or based on the selection of object information. For example, as illustrated in FIG. 8, when the region of interest is set based on the selection of the first object information of the first subject (810) in the object information (850), and the second object information of the second subject (820) is additionally selected by the user in the object information (850), the visual object (800) is automatically adjusted to adjust the region of interest (e.g., expand the visual object (800)) so that the first subject (810) and the second subject (820) are included within the screen, so that the first subject (810) and the second subject (820) can be displayed by focusing on them.

[0191] FIG. 9 is a diagram illustrating an example of changing a focus range of a subject in an electronic device according to an embodiment of the present disclosure.

[0192] In one embodiment, FIG. 9 may illustrate an example of an operation according to adjustment of a visual object (900) (e.g., a section visual object or a focus subject layer) that represents visual information about a section (or length) within which a subject is included within an image.

[0193] Referring to FIG. 9, a user can adjust the length of a visual object (900) using a defined user input (e.g., a drag touch gesture). For example, by adjusting the length of the visual object (900), the user can change (e.g., expand or reduce) the focus section (or length) within which a specified subject is focused within the screen. According to one embodiment, the electronic device (101) can change the section (or length) within which the subject is displayed within the screen based on the length of the visual object (900).

[0194] FIG. 10 is a diagram illustrating an example of providing information about a subject through a focus range in an electronic device according to one embodiment of the present disclosure.

[0195] In one embodiment, FIG. 10 may illustrate an example of providing information about the presence or absence of a subject through a visual object (1000) (e.g., a section visual object or a focus subject layer) that represents visual information about a section (or length) within which the subject is included within the image.

[0196] Referring to FIG. 10, the electronic device (101) can identify a section (e.g., at least a section (1050) without a subject within the entire set section) within a focus section in which a designated subject is focused on, in which the subject is not visible on the screen. According to one embodiment, the electronic device (101) can process and provide a portion corresponding to the identified section (1050) within the entire section according to a visual object (1000) in a defined manner. For example, the electronic device (101) can identify a section (1050) without a subject within the entire section designated to be focused on the subject, and dim or dot the identified section (1050) to visually provide the user with information that the subject is not visible in the corresponding section (1050).

[0197] FIG. 11 is a diagram illustrating an example of providing a preview of an edited image during image editing in an electronic device according to one embodiment of the present disclosure.

[0198] In one embodiment, FIG. 11 may illustrate an example of improving the convenience of video editing by providing a preview of an original video (1100) and a video (e.g., an edited video) (1150) centered on a focused subject (1110) during video editing.

[0199] According to one embodiment, the electronic device (101) may provide the original image (1100) and the edited image (1150) together through screen splitting. For example, the electronic device (101) may provide the original image (1100) in the left area (or lower area) and provide a preview of the edited image (1150) centered on the focused subject (1110) in the original image (1100) in the right area (or upper area).

[0200] According to one embodiment, the electronic device (101) may provide an original image (1100) as a pop-up, and an edited image (1150) centered on a focused subject (1110) in the original image (1100) may provide a preview of the focused subject by dimming the remaining area (e.g., the left and / or right area based on the subject).

[0201] According to one embodiment, the electronic device (101) may display an area (e.g., an area of ​​interest) that is reconstructed to fit a subject selected by a user based on the original image (1100), and dim the other areas, thereby simultaneously providing the original image (1100) and the edited image (1150) as a single image.

[0202] FIG. 12 is a diagram illustrating an example of providing a preview of an edited image during image editing in an electronic device according to one embodiment of the present disclosure.

[0203] In one embodiment, FIG. 12 may illustrate an example of improving the convenience of video editing by providing a preview of an original video (1210) and a focused subject-centered video (e.g., edited video) (1220) during video editing.

[0204] According to one embodiment, the electronic device (101) may display an area (e.g., an area of ​​interest) reconstructed to fit a subject selected by a user based on an original image (1210), and may display other areas by dimming them. According to one embodiment, the user may perform an input to select a defined visual object (1200) (e.g., a preview icon) for switching a preview function to preview an edited image (1220).

[0205] According to one embodiment, in response to an input for selecting a visual object (1200), the electronic device (101) may provide an original image (1210) in a lower area through screen splitting, and provide a preview of an edited image (1220) centered on a focused subject in the original image (1210) in an upper area together.

[0206] In one embodiment, while a preview of the edited video (1220) is displayed, the user may execute a full view of the edited video (1220). For example, the user may perform a defined input (e.g., a double-tap touch gesture) on the edited video (1220). In one embodiment, the electronic device (101) may display the edited video (1220) in full screen (1230) in response to the defined input related to executing the full view function.

[0207] FIG. 13 is a diagram illustrating an example of adding a focus target during image editing in an electronic device according to one embodiment of the present disclosure.

[0208] Referring to FIG. 13, FIG. 13 may illustrate an example of providing an options menu (1330) for adding a focus target based on user input.

[0209] According to one embodiment, a user may perform an input (e.g., a long press touch gesture) to select a portion of second object information (1320) to add a second subject of second object information (1320) as a focus target while setting a first subject as a region of interest based on first object information (1310) among object information.

[0210] According to one embodiment, in response to an input selecting a portion of second object information (1320), the electronic device (101) may provide an options menu (1330) that allows the user to select an option for displaying the focus target (e.g., “Add subject” or “Add as split screen”). For example, when selecting to add a subject, the electronic device (101) may provide an option to configure the frame in a desired configuration.

[0211] In one embodiment, when “Add subject” is selected in the option menu (1330), for example, a second subject may be included in the region of interest and displayed by expanding the region of interest. In one embodiment, when “Add to split screen” is selected in the option menu (1330), for example, a first region of interest centered on a first subject (1340) corresponding to the first object information (1310) and a second region of interest centered on a second subject (1350) corresponding to the second object information (1320) may be displayed in a split screen.

[0212] FIG. 14 is a diagram illustrating an example of an operation that supports selection of a focus target in an electronic device according to one embodiment of the present disclosure.

[0213] Referring to FIG. 14, FIG. 14 may illustrate an example of an interface that supports selection of a focus target. According to one embodiment, the interface may include a first item (1410) (e.g., “Summary”) that supports selection of a subject based on a summary of the subject included in the image, and a second item (1420) (e.g., “Details”) that supports selection of a subject based on a detailed section of the subject included in the image. According to one embodiment, the example of FIG. 15 may illustrate an interface provided upon selection of the first item (1410) and an example of an operation using the interface. According to one embodiment, the example of FIG. 16 may illustrate an interface provided upon selection of the second item (1420) and an example of an operation using the interface.

[0214] FIG. 15 is a diagram illustrating an example of an operation that supports selection of a focus target in an electronic device according to one embodiment of the present disclosure.

[0215] Referring to FIG. 15, in response to the selection of the first item (1410) portion in FIG. 14, the electronic device (101) may provide an interface including an object information area (1501) and a frame area (1503) for each image (or video clip). In one embodiment, the object information area (1501) may include object information corresponding to each subject recognized from a plurality of images (or entire images) selected by the user as a target of image editing.

[0216] According to one embodiment, in the object information area (1501), object information may be provided differentially based on the proportion of the subject appearing (e.g., displayed on the screen) in the entire image. For example, the electronic device (101) may determine (or identify) the distribution of subjects within the entire image based on object recognition (or character analysis) of the entire image. According to one embodiment, the electronic device (101) may provide object information of the subject (e.g., the main subject) that appears most frequently (e.g., displayed on the screen) in the entire image at the largest scale based on the distribution of the subjects.

[0217] In one embodiment, the image-specific frame area (1503) may include frame layers (or frame areas or frame visual objects) each corresponding to a plurality of images selected as targets of image editing.

[0218] As illustrated in FIG. 15, when at least one object information (e.g., first object information (1510)) is selected in the object information area (1501), the electronic device (101) can provide visual information (1520) for a section including the subject of the selected object information (1510) through each frame layer corresponding to the entire image.

[0219] According to one embodiment, a user may search for a designated subject using the stored person information in the electronic device (101) and add the subject as a focus target. For example, the user may select a search button (1530), and the electronic device (101) may, in response to the selection of the search button (1530), provide a search box (1540) through a defined area in the interface. According to one embodiment, the user may select a search box (1540), and the electronic device (101) may, in response to the selection of the search box (1540), provide a keyboard (1550) on the interface.

[0220] According to one embodiment, a user may input information (e.g., name) of a subject related to a focus target using a keyboard (1550). According to one embodiment, the electronic device (101) may search for a requested subject using person information stored in the electronic device (101) and determine (or identify) object information (e.g., second object information (1560)) of the subject corresponding to the search result. According to one embodiment, when a subject of the second object information (1560) is added, the electronic device (101) may provide visual information (1570) for a section including the subject of the added object information (1560) together with the existing visual information (1520) through each frame layer corresponding to each of the entire image.

[0221] FIG. 16 is a diagram illustrating an example of an operation that supports selection of a focus target in an electronic device according to one embodiment of the present disclosure.

[0222] Referring to FIG. 16, in response to the selection of the second item (1420) portion in FIG. 14, the electronic device (101) may provide an interface that includes information on detailed sections of each video by dividing the entire video (e.g., the entire video clip) into sections (e.g., the first clip section (1601) and the second clip section (1603)). For example, the interface may provide object information by dividing sections (e.g., sections where the main subject changes) according to the point in time when the main subject (e.g., the subject displayed on the screen) changes in the entire video.

[0223] According to one embodiment, the electronic device (101) may provide text (e.g., timeline information) and object information of the target subject by dividing the section according to the change point of the subject shown in each image (1601, 1603). According to one embodiment, the user may select object information related to the subject of the focus among the object information and add it as the subject of the focus.

[0224] According to one embodiment, a user can search for a designated subject using the stored person information in the electronic device (101) and add the subject as a focus target. For example, a user may select a search button, and in response to the selection of the search button, the electronic device (101) may provide a search box (1610) through a defined area in the interface. According to one embodiment, a user may select a search box (1610), and in response to the selection of the search box (1610), the electronic device (101) may provide a keyboard on the interface.

[0225] According to one embodiment, a user may input information (e.g., a name) of a subject related to a focus target using a keyboard. According to one embodiment, the electronic device (101) may search for a requested subject using person information stored in the electronic device (101) and determine (or identify) object information of the subject corresponding to the search result. According to one embodiment, the electronic device (101) may sort and provide only the determined object information. According to one embodiment, in response to an input for selecting object information, the electronic device (101) may add the subject of the selected object information as a subject of the focus target.

[0226] According to one embodiment, the electronic device (101) may provide highlighting for a selection (or activation) state for object information related to a subject identified as a subject of focus.

[0227] FIG. 17 is a diagram illustrating an example of configuring a screen according to the position of a subject in an electronic device according to one embodiment of the present disclosure.

[0228] Referring to Fig. 17, Fig. 17 may illustrate an example of a screen configuration in a case where multiple subjects are selected as focus targets and another subject exists between the multiple subjects. For example, Fig. 17 may illustrate an example in which, in a case where a single region of interest (e.g., focus box) cannot be set due to another subject being present between the selected subjects, a region of interest is set for each selected subject and each target subject is provided by focusing on it.

[0229] As illustrated in FIG. 17, a user can select a first subject (1710) and a second subject (1720) as subjects to be focused on. For example, a user can select the first subject (1710) as the subject to be focused on, and additionally select the second subject (1720) as the subject to be focused on.

[0230] According to one embodiment, when there is another object between the first subject (1710) and the second subject (1720), for example, when they are not set as one area of ​​interest (e.g., focus box), the electronic device (101) sets areas of interest corresponding to the subjects (1710, 1720) of the focus target, and provides the subjects (1710, 1720) of each area of ​​interest by dividing the screen into focusing areas (1750) (e.g., first focusing area (1751), second focusing area (1753)).

[0231] According to one embodiment, the electronic device (101) may set a region of interest defined by tracking a corresponding subject in an image based on selected object information, and may focus on and display the target subject based on the region of interest. According to one embodiment, when setting the region of interest, the electronic device (101) may set the region of interest to include a main part (or main area) of the selected subject (e.g., a face area and / or a body area including a face area) based on a preset ratio (e.g., an original image ratio or a preset edited image ratio).

[0232] According to one embodiment, the region of interest may be set based on a required configuration region of the target subject (e.g., in the case of a person, the face, the upper body (e.g., the face + a body part (e.g., the shoulder area), or the whole body). According to one embodiment, the region of interest may be set to a size of an area that does not include other surrounding subjects (or objects) between the required configuration region and the whole area according to a set ratio (e.g., the ratio of the region of interest (or focus area)) in the entire area (e.g., an area including the entire subject).

[0233] For example, the electronic device (101) may set a first region of interest for a first subject (1710) to correspond to a major portion of the first subject (1710). For example, the electronic device (101) may set a second region of interest, different from the first region of interest, for a second subject (1720), to correspond to a major portion of the second subject (1720). According to one embodiment, the electronic device (101) may set a region of interest for a subject so as to maintain an aspect ratio as much as possible within a range in which the selected subject is not cropped and / or a range in which other surrounding subjects (e.g., surrounding objects) are not included within the region of interest. Accordingly, as illustrated in FIG. 17, the range (or aspect ratio) of the region of interest may be different for each subject of focus (e.g., the first subject (1710) and the second subject (1720)).

[0234] In one embodiment, if the same aspect ratio cannot be provided for each subject of the focus target, each region of interest may be set to match the height of the region of interest as much as possible. For example, the heights of the first region of interest of the first subject (1710) and the second region of interest of the second subject (1720) may be adjusted to be the same, such as the third region of interest (1730) and the fourth region of interest (1740), respectively.

[0235] FIG. 18 is a diagram illustrating an example of an operation that supports audio focusing in an electronic device according to one embodiment of the present disclosure.

[0236] Referring to FIG. 18, FIG. 18 may illustrate an example of focusing (e.g., increasing the volume) the audio of a focus subject together with the focus subject so that the audio of the focus subject shown on the screen can be emphasized (or focused), or relatively decreasing the volume of the audio of other subjects other than the focus subject.

[0237] As illustrated in FIG. 18, default audio (1810) may be set for each of the objects displayed on the screen. According to one embodiment, the electronic device (101) may set audio focusing for a focus object when the focus object is designated. For example, while the focus object is displayed on the screen, the electronic device (101) may change the default audio (1810) to audio (1820) that increases the volume of the audio (1830) of the focus object and relatively decreases the volume of the audio of objects other than the focus object. For example, the electronic device (101) may provide audio by emphasizing the volume of the focus object.

[0238] According to one embodiment, the electronic device (101) may vary the audio focusing distribution when multiple focus subjects are included. For example, the electronic device (101) may set a relatively high volume level for a focus subject with a high importance among the focus subjects (e.g., a main subject that is relatively visible on the screen).

[0239] An operation method performed in an electronic device (101) according to one embodiment of the present disclosure may include an operation of executing an application related to content editing. The operation method may include an operation of receiving a first input for selecting one or more contents. The operation method may include an operation of displaying a first interface including the contents in response to the first input. The operation method may include an operation of receiving a second input for executing editing of the contents included in the first interface. The operation method may include an operation of displaying a second interface for editing the contents in response to the second input. According to one embodiment, the second interface may include an indicator regarding the contents, object information related to a subject included in the contents, and a position and time point at which a subject corresponding to the object information in the contents is provided. The operation method may include an operation of identifying a subject corresponding to the selected object information in the contents based on a third input for selecting the object information included in the second interface. The above method of operation may include an operation of tracking the subject in the content and focusing and displaying it in a defined area of ​​interest.

[0240] According to one embodiment, the operating method may include an operation of recognizing a subject included in the content based on object recognition on the content, an operation of generating object information related to the recognized subject, and an operation of displaying a third interface including the object information.

[0241] According to one embodiment, the method may include receiving, through the third interface, an input for selecting object information related to a subject for setting a region of interest.

[0242] According to one embodiment, the operating method may include an operation of changing and displaying object information included in the third interface based on a change in a subject included in the content while displaying the content.

[0243] According to one embodiment, the operating method may include an operation of recognizing at least one subject in the content, an operation of inferring at least one object of interest included in the content from among the at least one subject, an operation of identifying a distribution of the at least one object of interest in the content, and an operation of generating the indicator based on the distribution of the at least one object of interest in the content.

[0244] According to one embodiment, the method may include setting the region of interest by taking into account the size of the subject, surrounding subjects, and / or maximum and minimum areas of the subject.

[0245] According to one embodiment, the method may include, in a content editing operation, an operation of storing editing information related to a subject set to be displayed by focusing.

[0246] According to one embodiment, the method may include an operation of simultaneously generating edited content by recording edited content during a content editing operation.

[0247] According to one embodiment, the focusing and displaying operation may include an operation of focusing and displaying a tracked subject based on a defined focus box.

[0248] According to one embodiment, the focusing and displaying operation may include an operation of focusing and displaying the tracked subject by dimming the remaining area other than the area of ​​interest of the tracked subject.

[0249] A non-transitory computer-readable recording medium storing instructions that, when executed by a processor (120) of an electronic device (101) according to one embodiment of the present disclosure, cause the processor (120) to perform operations, wherein the instructions, when executed by the processor, cause the electronic device to perform an operation related to content editing, an operation of receiving a first input for selecting one or more contents, an operation of displaying a first interface including the contents in response to the first input, an operation of receiving a second input for executing editing of the contents included in the first interface, an operation of displaying a second interface for editing the contents, the second interface including the contents, object information related to a subject included in the contents, and an indicator regarding a position and a time point at which a subject corresponding to the object information in the contents is provided, and based on a third input of selecting the object information included in the second interface, displaying a subject corresponding to the selected object information in the contents. The recording medium may include an identifying action, and an action of tracking the subject in the content and setting a defined area of ​​interest, and focusing and displaying the same.

[0250] It will be appreciated that the above-described embodiments and their technical features may be combined with each other in any and all combinations, as long as there is no potential conflict between the two embodiments or features. For example, any and all combinations of two or more of the above-described embodiments may be envisioned and incorporated within the present disclosure. One or more features from any embodiment may be incorporated into any other embodiment, providing a corresponding advantage or advantages.

[0251] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0252] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0253] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0254] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (or recording medium) (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0255] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium (or recording medium), such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0256] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0257] The various embodiments of the present disclosure disclosed in this specification and drawings are intended to provide specific examples to facilitate easy explanation of the technical content of the present disclosure and to aid understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be interpreted to include all modifications or variations derived based on the technical concepts of the present disclosure, in addition to the embodiments disclosed herein.

Claims

1. In an electronic device (101, 200), display(160, 240); At least one processor (120, 210) comprising processing circuitry; and Includes a memory (130, 220) for storing instructions, The above instructions, when individually and / or collectively executed by the at least one processor (120, 210), cause the electronic device (101, 200) to: Run the application related to content editing, Receive a first input selecting one or more contents, In response to the first input, display a first interface including the content, Receiving a second input for executing editing of the content included in the first interface; In response to the second input, a second interface for editing the content is displayed, the second interface including the content, object information related to a subject included in the content, and an indicator regarding a position and time point at which a subject corresponding to the object information in the content is provided, Based on a third input that selects the object information included in the second interface, identifying a subject corresponding to the selected object information in the content, and An electronic device that tracks the subject in the above content and displays it by focusing on a defined area of ​​interest.

2. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, Recognize the subject contained in the content based on object recognition in the content, Generate object information related to the above recognized subject, An electronic device that displays a third interface including the above object information.

3. In the second paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device configured to receive an input for selecting object information related to a subject for setting a region of interest through the third interface.

4. In the second paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that changes and displays object information included in the third interface based on a change in the subject included in the content while displaying the content.

5. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, Recognize at least one subject in the above content, Inferring at least one object of interest contained in the content from among the at least one subject, Identifying the distribution of at least one object of interest in the above content, An electronic device that generates the indicator based on the distribution of at least one object of interest in the content.

6. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that sets the region of interest by taking into account the size of the subject, surrounding subjects, and / or the maximum and minimum areas of the subject.

7. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that stores editing information related to a subject set to be focused and displayed in a content editing operation.

8. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that records edited content during a content editing operation to simultaneously generate edited content.

9. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that focuses and displays a tracked subject based on a defined focus box.

10. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that dims the remaining area outside the area of ​​interest of the tracked subject, thereby focusing and displaying the tracked subject.

11. In the operating method of an electronic device (101, 200), The action of running an application related to content editing; An action of receiving a first input selecting one or more contents; In response to the first input, an action of displaying a first interface including the content; An action of receiving a second input for executing editing of the content included in the first interface; In response to the second input, an action of displaying a second interface for editing the content, the second interface including the content, object information related to a subject included in the content, and an indicator regarding a position and time point at which a subject corresponding to the object information in the content is provided; An operation of identifying a subject corresponding to the selected object information in the content based on a third input that selects the object information included in the second interface; and A method comprising an action of tracking the subject in the above content, setting a defined area of ​​interest, and focusing and displaying it.

12. In paragraph 11, An action of recognizing a subject contained in the content based on object recognition in the content; An action of generating object information related to the recognized subject; A method comprising an action of displaying a third interface including the object information.

13. In paragraph 12, A method comprising receiving an input for selecting object information related to a subject for setting a region of interest through the third interface.

14. In paragraph 12, A method comprising an action of changing and displaying object information included in the third interface based on a change in the subject included in the content while displaying the content.

15. In paragraph 11, An action of recognizing at least one subject in the above content; An operation of inferring at least one object of interest contained in the content from among the at least one subject; An action of identifying a distribution of at least one object of interest in the above content; A method comprising an action of generating the indicator based on a distribution of the at least one object of interest in the content.

Images