Electronic device and method for displaying image at electronic device

Abstract

A method for displaying a video image in an electronic device is provided. The method includes: obtaining a first video image including a plurality of subjects; setting a plurality of sub-regions each including the plurality of subjects, wherein each sub-region includes at least one of the plurality of subjects; displaying a second video image obtained by changing a size of each of the plurality of sub-regions and rearranging each of the plurality of sub-regions according to a number of the plurality of sub-regions; and after detecting that one of the plurality of subjects corresponding to one of the rearranged sub-regions has moved by a distance equal to or greater than a specified distance, maintaining the changed size and arrangement of the plurality of sub-regions of the second video image for a latency.

Description

[0001] This application is a divisional application of the application with the application date of February 5, 2021 and the application number of 202180012104.2, and the invention title of "Electronic device and method for displaying an image at an electronic device". Technical Field

[0002] The present disclosure relates to an electronic device and a technique for displaying an image in an electronic device. Background Art

[0003] An electronic device may use its camera to set a part of an image as a zoom area. When an instruction stored in the memory of the electronic device is executed, the processor of the electronic device may use the camera to set a zoom area around a specified object. For example, the processor may use the camera to capture multiple images and may obtain information associated with the movement of an object between the multiple images. The processor may set the object as a focused subject and may track the focused subject to obtain information associated with the movement. The processor may perform an automatic zoom that automatically magnifies the focused subject. When performing the automatic zoom, the zoom area may be generated to include the focused subject. The processor may use object detection technology based on a convolutional neural network (CNN) to track the focused subject.

[0004] Meanwhile, an electronic device may divide and display images captured from multiple parties on one screen. For example, the electronic device may display multiple images obtained by capturing a video frame by frame on one screen. For another example, the electronic device may send image data captured by multiple cameras to another electronic device. Upon receiving the image data, the other electronic device may display a screen that divides the multiple images based on the image data. Summary of the Invention

[0005] Technical Problem

[0006] When an existing electronic device sets a zoom area around a specified object and divides and displays images captured from multiple parties on one screen, multiple subjects may be set as the focused subject at one side or one end point. When the number of focused subjects is multiple, a space may be generated between the focused subjects.

[0007] When there is a space between the focused subjects, the existing electronic device may set the zoom area to include all the focused subjects. When the zoom area is set to include all the focused subjects, it may not be easy to magnify and display each subject at a specified ratio.

[0008] One aspect of the present disclosure is to provide an electronic device for improving the execution of magnification of each of multiple subjects when focusing on the multiple subjects and a method for displaying an image in the electronic device.

[0009] Solution to the problem

[0010] According to an aspect of the present disclosure, a method for displaying a video image in an electronic device is provided. The method includes: obtaining a first video image including a plurality of subjects; setting a plurality of sub-regions respectively including the plurality of subjects, where each sub-region includes at least one of the plurality of subjects; displaying a second video image obtained by changing the size of each of the plurality of sub-regions and rearranging each of the plurality of sub-regions according to the number of the plurality of sub-regions; and after detecting that one of the plurality of subjects corresponding to one of the rearranged sub-regions has moved a distance equal to or greater than a specified distance, maintaining the changed size and arrangement of the plurality of sub-regions of the second video image for a waiting period.

[0011] According to another aspect of the present disclosure, an electronic device is provided. The electronic device includes: a camera circuit including an image sensor, the camera circuit being configured to obtain image data corresponding to an external environment; a display configured to display a video image generated based on the image data; a processor operably connected to the camera circuit and the display; and a memory operably connected to the processor. Wherein the memory stores instructions that, when executed, cause the processor to: obtain a first video image including a plurality of subjects, set a plurality of sub-regions respectively including the plurality of subjects, where each sub-region includes at least one of the plurality of subjects, display a second video image obtained by changing the size of each of the plurality of sub-regions and rearranging each of the plurality of sub-regions according to the number of the plurality of sub-regions, and after detecting that at least one of the plurality of subjects corresponding to at least one of the rearranged sub-regions has moved a distance equal to or greater than a specified distance, maintain the changed size and arrangement of the plurality of sub-regions of the second video image for a waiting period.

[0012] According to another aspect of the present disclosure, a method for displaying an image in an electronic device is provided. The method includes: obtaining a first image including a plurality of subjects; setting a plurality of sub-regions respectively including the plurality of subjects; obtaining the distances between the plurality of sub-regions; when the distance between a first region and a second region adjacent to each other among the plurality of sub-regions is greater than or equal to a specified threshold distance, omitting at least a part of a third region disposed between the first region and the second region from the first image; and displaying a second image obtained by resetting the size of each of the plurality of sub-regions and rearranging each of the plurality of sub-regions.

[0013] According to another aspect of the present disclosure, an electronic device is provided. The electronic device includes: a lens assembly configured to capture an external environment; an image sensor configured to convert the captured external environment into image data; a display device configured to display an image generated based on the image data; a processor operably connected to the lens assembly, the image sensor, and the display device; and a memory operably connected to the processor. The memory may store instructions that, when executed, cause the processor to: obtain a first image including a plurality of subjects; set a plurality of sub-regions respectively including the plurality of subjects; obtain distances between the plurality of sub-regions; when a distance between a first region and a second region that are adjacent to each other among the plurality of sub-regions is greater than or equal to a specified threshold distance, omit at least a portion of a third region disposed between the first region and the second region from the first image; and display a second image obtained by resetting a size of each of the plurality of sub-regions and re-arranging each of the plurality of sub-regions.

[0014] According to another aspect of the present disclosure, a method for displaying an image in an electronic device is provided. The method includes: obtaining a first image including a plurality of subjects; setting a plurality of sub-regions respectively including the plurality of subjects; obtaining distances between the plurality of sub-regions; when a distance between a first region and a second region that are adjacent to each other among the plurality of sub-regions is greater than or equal to a specified threshold distance, displaying a second image generated based on the first region and the second region; when the distance between the first region and the second region is less than the threshold distance while the second image is being displayed, displaying a timer that counts a specified waiting time together with the second image; and when the waiting time counted by the timer has passed, returning to the first image.

[0015] Advantageous effects of the invention

[0016] According to the embodiments disclosed in the present disclosure, when the interval between a plurality of subjects is greater than or equal to a specified distance, the electronic device can remove the space between the plurality of subjects, can magnify each subject at a higher magnification, and can display the magnified subjects on the screen.

[0017] In addition, according to the embodiments disclosed in the present disclosure, when the interval between a plurality of subjects is greater than or equal to a specified distance, the electronic device can set a plurality of sub-regions to respectively include the plurality of subjects and can re-arrange the plurality of sub-regions to more freely arrange each subject on the screen.

[0018] In addition, various effects directly or indirectly determined by the present disclosure may be provided. Description of the drawings

[0019] Figure 1is a block diagram showing an electronic device in a network environment according to an embodiment of the present disclosure;

[0020] Figure 2 is a block diagram showing a camera module according to an embodiment of the present disclosure;

[0021] Figure 3a is a block diagram showing an electronic device according to an embodiment of the present disclosure;

[0022] Figure 3b is a flowchart showing a method for displaying an image in an electronic device according to an embodiment of the present disclosure;

[0023] Figure 4 is a diagram showing a plurality of focused subjects captured by a camera of an electronic device according to an embodiment of the present disclosure;

[0024] Figure 5 is a diagram showing a case where the distance interval between at least one adjacent subject and other subjects among a plurality of focused objects captured by a camera of an electronic device according to an embodiment is greater than or equal to a threshold distance;

[0025] Figure 6 is a diagram showing a method for setting a plurality of sub-regions to a plurality of focused subjects captured by a camera of an electronic device according to an embodiment of the present disclosure;

[0026] Figure 7 is a diagram showing rearrangement and display of a plurality of sub-region settings according to an embodiment of the present disclosure;

[0027] Figure 8 is a diagram showing a method for setting a boundary region for each of a plurality of objects according to an embodiment of the present disclosure;

[0028] Figure 9 is a diagram showing a method for setting a human region according to an embodiment of the present disclosure;

[0029] Figure 10 is a diagram showing a method for setting a human width according to an embodiment of the present disclosure;

[0030] Figure 11 is a flowchart showing a method for displaying an image in an electronic device according to an embodiment of the present disclosure;

[0031] Figure 12 is a flowchart showing a method for displaying an image in an electronic device according to an embodiment of the present disclosure; and

[0032] Figure 13 is a diagram showing a second image and a timer according to an embodiment.

[0033] In all the drawings, it should be noted that the same reference numerals are used to describe the same or similar elements, features, and structures. Detailed Description

[0034] The following description with reference to the accompanying drawings helps to provide a comprehensive understanding of various embodiments of the present disclosure defined by the claims and their equivalents. It includes various specific details that are helpful for understanding, but these are merely considered exemplary. Thus, those of ordinary skill in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure. In addition, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0035] The terms and words used in the following description and claims are not limited to the written meanings, but are used solely by the inventor to enable a clear and consistent understanding of the present disclosure. Thus, it should be apparent to those skilled in the art that the following description of the various embodiments of the present disclosure is provided for illustrative purposes only and not for the purpose of limiting the present disclosure defined by the appended claims and their equivalents.

[0036] It will be understood that, unless the context clearly dictates otherwise, the singular forms "a", "an", and "the" include plural referents. Thus, for example, a reference to "a component surface" includes a reference to one or more such surfaces.

[0037] Figure 1 is a block diagram showing an electronic device 101 in a network environment according to an embodiment of the present disclosure.

[0038] Reference Figure 1, in a network environment 100, an electronic device 101 may communicate with an electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or communicate with an electronic device 104 or a server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a subscriber identity module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 176 (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented as embedded in the display device 160 (e.g., a display).

[0039] The processor 120 may run software (e.g., a program 140), for example, to control at least one other component (e.g., a hardware component or a software component) connected to the processor 120 of the electronic device 101, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load a command or data received from another component (e.g., the sensor module 176 or the communication module 190) into the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resulting data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)), and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor central processor, or a communication processor (CP)), which may operate independently or in combination with the main processor 121. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or be dedicated to a specified function. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of the main processor.

[0040] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (instead of the main processor 121) may control at least some of the functions or states related to at least one of the components of the electronic device 101 (e.g., the display device 160, the sensor module 176, or the communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control, together with the main processor 121, at least some of the functions or states related to at least one of the components of the electronic device 101 (e.g., the display device 160, the sensor module 176, or the communication module 190). According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 180 or the communication module 190) that is functionally related to the auxiliary processor 123.

[0041] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.

[0042] The program 140 may be stored in the memory 130 as software and may include, for example, an operating system (OS) 142, middleware 144, or an application 146.

[0043] The input device 150 may receive commands or data to be used by other components of the electronic device 101 (e.g., the processor 120) from the outside of the electronic device 101 (e.g., a user). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

[0044] The sound output device 155 may output a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as playing multimedia or playing a recording, while the receiver may be used for incoming calls. According to an embodiment, the receiver may be implemented separately from the speaker or as part of the speaker.

[0045] The display device 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include (e.g.) a display, a holographic device, or a projector, and a control circuit for controlling the corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display device 160 may include a touch circuit suitable for detecting a touch, or a sensor circuit (e.g., a pressure sensor) suitable for measuring the intensity of the force caused by the touch.

[0046] The audio module 170 may convert sound into an electrical signal and vice versa. According to an embodiment, the audio module 170 may obtain sound via the input device 150, or output sound via the sound output device 155 or headphones of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0047] The sensor module 176 may detect the operating state of the electronic device 101 (e.g., power or temperature) or the environmental state outside the electronic device 101 (e.g., the state of the user), and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0048] The interface 177 may support one or more specific protocols used to directly (e.g., wired) or wirelessly connect the electronic device 101 to an external electronic device (e.g., electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0049] The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (e.g., electronic device 102). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0050] The haptic module 179 may convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be recognized by the user via his sense of touch or kinesthesia. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0051] The camera module 180 may capture a still image or a moving image. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0052] The power management module 188 may manage the power supply to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

[0053] The battery 189 may supply power to at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a primary battery that is not rechargeable, a rechargeable storage battery, or a fuel cell.

[0054] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., the electronic device 102, the electronic device 104, or the server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently of the processor 120 (e.g., an application processor (AP)), and support direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module), or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules may communicate with an external electronic device via a first network 198 (e.g., a short-range communication network, such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a telecommunication network, such as a cellular network, the Internet, or a computer network (e.g., LAN or wide area network WAN)). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple separate components (e.g., multiple chips). The wireless communication module 192 may use the subscriber information (e.g., the international mobile subscriber identity (IMSI)) stored in the subscriber identification module 196 to identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199).

[0055] The antenna module 197 may transmit signals or power to the outside of the electronic device 101 (e.g., an external electronic device) or receive signals or power from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiation element composed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, for example, the communication module 190 (e.g., the wireless communication module 192) may select at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) from the plurality of antennas. Then, signals or power are transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiation element may be additionally formed as part of the antenna module 197.

[0056] At least some of the above components may be interconnected via an inter-peripheral communication scheme (e.g., a bus, a general-purpose input / output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0057] According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 via a server 108 connected to the second network 199. Each of the electronic devices 102 and 104 may be a device of the same type or a different type from the electronic device 101. According to an embodiment, all or some of the operations to be performed at the electronic device 101 may be executed at one or more of the external electronic devices 102, 104, or 108. For example, if the electronic device 101 is to automatically execute a function or service, or in response to a request from a user or another device, instead of or in addition to executing the function or service, the electronic device 101 may request one or more external electronic devices to execute at least a part of the function or service. One or more external electronic devices that receive the request may execute at least a part of the requested function or service, or additional functions or additional services related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a part of a response to the request with or without further processing of the result. To this end, for example, cloud computing, distributed computing, or client-server computing technologies may be used.

[0058] Figure 2 is a block diagram showing a camera module according to an embodiment of the present disclosure.

[0059] Reference Figure 2, in the camera 200, the camera module 180 may include a lens assembly 210, a flash 220, an image sensor 230, an image stabilizer 240, a memory 250 (e.g., a buffer memory), or an image signal processor 260. The lens assembly 210 may collect light emitted or reflected from an object whose image is to be captured. The lens assembly 210 may include one or more lenses. According to an embodiment, the camera module 180 may include a plurality of lens assemblies 210. In this case, the camera module 180 may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies 210 may have the same lens properties (e.g., viewing angle, focal length, autofocus, f-value, or optical zoom), or at least one lens assembly may have one or more lens properties different from those of another lens assembly. The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens.

[0060] The flash 220 may emit light for enhancing the light reflected from the object. According to an embodiment, the flash 220 may include one or more light-emitting diodes (LEDs) (e.g., red-green-blue (RGB) LEDs, white LEDs, infrared (IR) LEDs, or ultraviolet (UV) LEDs) or a xenon lamp. The image sensor 230 may obtain an image corresponding to the object by converting the light emitted or reflected from the object and transmitted via the lens assembly 210 into an electrical signal. According to an embodiment, the image sensor 230 may include one selected from image sensors having different properties (such as an RGB sensor, a black-and-white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor 230 may be implemented using, for example, a charge-coupled device (CCD) sensor or a complementary metal-oxide-semiconductor (CMOS) sensor.

[0061] The image stabilizer 240 may move the image sensor 230 or at least one lens included in the lens assembly 210 in a specific direction, or control the operation properties of the image sensor 230 (e.g., adjust the readout timing) in response to the movement of the camera module 180 or the electronic device 101 including the camera module 180. This allows compensating for at least a part of the negative effects (e.g., image blurring) caused by the movement of the image being captured. According to an embodiment, the image stabilizer 240 may use a gyro sensor (not shown) or an acceleration sensor (not shown) provided inside or outside the camera module 180 to sense such movement of the camera module 180 or the electronic device 101. According to an embodiment, the image stabilizer 240 may be implemented as, for example, an optical image stabilizer.

[0062] The memory 250 may store at least a part of an image obtained via the image sensor 230 at least temporarily for subsequent image processing tasks. For example, if image capture is delayed due to shutter lag or multiple images are captured rapidly, the obtained original images (e.g., Bayer pattern images, high-resolution images) may be stored in the memory 250, and corresponding copy images (e.g., low-resolution images) thereof may be previewed via the display device 160. Thereafter, if a specified condition is satisfied (e.g., by a user input or a system command), at least a part of the original image stored in the memory 250 may be obtained and processed, for example, by the image signal processor 260. According to an embodiment, the memory 250 may be configured as at least a part of the memory 130 or as a separate memory that operates independently of the memory 130.

[0063] The image signal processor 260 may perform one or more image processes on an image obtained via the image sensor 230 or an image stored in the memory 250. The one or more image processes may include, for example, depth map generation, three-dimensional (3D) modeling, panoramic generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor 260 may control at least one of the components included in the camera module 180 (e.g., the image sensor 230) (e.g., exposure time control or readout timing control). The image processed by the image signal processor 260 may be stored back in the memory 250 for further processing or may be provided to an external component (e.g., the memory 130, the display device 160, the electronic device 102, the electronic device 104, or the server 108) located outside the camera module 180. According to an embodiment, the image signal processor 260 may be configured as at least a part of the processor 120 or as a separate processor that operates independently of the processor 120. If the image signal processor 260 is configured as a processor separate from the processor 120, at least one image processed by the image signal processor 260 is displayed by the processor 120 via the display device 160 as is or after further processing.

[0064] According to an embodiment, the electronic device 101 may include a plurality of camera modules 180 having different attributes or functions. In this case, at least one of the plurality of camera modules 180 may form, for example, a wide-angle camera, and at least another one of the plurality of camera modules 180 may form a telephoto camera. Similarly, at least one of the plurality of camera modules 180 may form, for example, a front camera, and at least another one of the plurality of camera modules 180 may form a rear camera.

[0065] Figure 3a is a block diagram showing an electronic device according to an embodiment of the present disclosure.

[0066] Reference Figure 3a , in system 300, the electronic device 101 may include a processor 120, a memory 130, a display device 160, a communication circuit 195, a lens assembly 210, and / or an image sensor 230.

[0067] In one embodiment, the processor 120 may control the operations of the memory 130, the display device 160, the communication circuit 195, the lens assembly 210, and / or the image sensor 230. The processor 120 may execute instructions 310 stored in the memory 130. The processor 120 may control the communication circuit 195 to transmit and receive radio frequency (RF) signals.

[0068] In one embodiment, the memory 130 may store instructions 310. The instructions 310 may set the operations of the display 160, the lens assembly 210, and the image sensor 230. The instructions 310 may include object detection instructions 311, object tracking instructions 312, zoom control instructions 313, and image reconstruction instructions 314.

[0069] In one embodiment, the display 160 may display an image. The display device 160 may include a user interface 161. The user interface 161 may include a touch interface for receiving a touch input from a user and a graphical user interface for visually guiding the user through the state of the electronic device 101.

[0070] In one embodiment, the communication circuit 195 may be a component substantially the same as the wireless communication module 192 included in Figure 1 the communication module 190.

[0071] In one embodiment, the lens assembly 210 may capture the external environment. The lens assembly 210 may capture at least one or more persons. The lens assembly 210 may obtain a visual image of the external environment. The lens assembly 210 may obtain light incident from the external environment.

[0072] In one embodiment, the image sensor 230 may convert the external environment into image data based on the obtained light. The image sensor 230 may display the image data as an image on the display device 160.

[0073] In one embodiment, the image sensor 230 may detect an object from the image data based on the object detection instructions 311. The image sensor 230 may detect a person from the image data based on the object detection instructions 311. The image sensor 230 may simultaneously detect multiple objects from the image data based on the object detection instructions 311.

[0074] In one embodiment, the lens assembly 210 may track an object from the image data based on the object tracking instruction 312. The lens assembly 210 may track a moving object from the image data based on the object tracking instruction 312. The lens assembly 210 may track a person from the image data based on the object tracking instruction 312. The lens assembly 210 may select and track an object that the user is very interested in from the image data based on the object tracking instruction 312. The lens assembly 210 may set the object to be tracked as the focused subject.

[0075] In one embodiment, the lens assembly 210 may magnify the visual image of the captured external environment based on the zoom control instruction 313. The lens assembly 210 may magnify at least a part of the visual image of the captured external environment based on the zoom control instruction 313. The lens assembly 210 may set the area to be magnified in the visual image of the captured external environment as the zoom area based on the zoom control instruction 313. The lens assembly 210 may set at least one or more zoom areas based on the zoom control instruction 313. The lens assembly 210 may control the magnification ratio of the zoom area based on the zoom control instruction 313.

[0076] In one embodiment, the processor 120 may set the zoom area to include the object to be magnified and displayed based on the zoom control instruction 313. The processor 120 may control the lens assembly 210 to magnify an object that the user is very interested in from the image data based on the zoom control instruction 313. The lens assembly 210 may magnify a person in the image data based on the zoom control instruction 313. The processor 120 may set the object to be magnified as the focused subject. The lens assembly 210 may magnify the focused subject under the control of the processor 120.

[0077] In one embodiment, the processor 120 may reconstruct an image based on the image reconstruction instruction 314. The processor 120 may display the reconstructed image on the display device 160. The processor 120 may display, on the display 160, an image obtained by magnifying on the zoom area based on the image reconstruction instruction 314. The processor 120 may display, on the display 160, an image obtained by magnifying on a person based on the image reconstruction instruction 314. The processor 120 may display, on the display 160, an image obtained by rearranging the zoom area based on the image reconstruction instruction 314. The processor 120 may display, on the display 160, an image obtained by emphasizing the zoom area based on the image reconstruction instruction 314. The processor 120 may display, on the display 160 based on the image reconstruction instruction 314, an image that moves along with an object moving on the zoom area.

[0078] Figure 3b Shown is an indication of a method for use in an electronic device (e.g., Figure 3aFlowchart of a method for displaying an image in an electronic device 101).

[0079] Reference Figure 3b In method 350, in operation 351, a processor (e.g., Figure 3a processor 120) of the electronic device 101 according to an embodiment may obtain a first image including a plurality of subjects. The first image may be an image captured using a camera (e.g., Figure 2 camera module 180) of the electronic device 101. For example, the first image may be an image obtained through a lens assembly (e.g., Figure 3a lens assembly 210) of the electronic device 101. The plurality of subjects may be objects focused on the first image. For example, the plurality of subjects may be people included in the captured first image.

[0080] In operation 353, the processor 120 of the electronic device 101 may set a plurality of sub-regions respectively including the plurality of subjects. The processor 120 may set each of the plurality of sub-regions to include at least one of the plurality of subjects. For example, the processor 120 may set a rectangular sub-region to surround each person included in the first image.

[0081] In operation 355, the processor 120 of the electronic device 101 according to an embodiment may obtain distances between the plurality of sub-regions. The processor 120 may measure the lengths of each of the plurality of sub-regions displayed on a display device (e.g., Figure 3a display device 160) of the electronic device 101 in the horizontal and vertical directions pixel by pixel. Pixel by pixel may be the physical length of any one of the plurality of pixels arranged on the display device 160 in the horizontal and / or vertical direction. The processor 120 may measure the distance between any two of the plurality of sub-regions pixel by pixel. For example, the processor 120 may measure that a first region among the plurality of sub-regions has a length of 50 pixel units in the horizontal direction, a second region among the plurality of sub-regions has a length of 30 pixel units in the horizontal direction, and the distance between the first region and the second region changes from 20 pixel units to 60 pixel units in the horizontal direction.

[0082] In operation 357, the processor 120 of the electronic device 101 according to an embodiment may identify whether the distance between a first region and a second region adjacent to each other among a plurality of sub-regions is greater than or equal to a specified threshold distance. It may not be possible to set another sub-region between the first region and the second region, and the background of the first image may be filled between the first region and the second region. The threshold distance may be preset according to the sizes of the first region and the second region and a specified magnification condition. For example, when the threshold distance is set to 1.5 times the length in the horizontal direction of the region with the shorter length in the horizontal direction between the first region and the second region, when the first region has a length of 50 pixel units in the horizontal direction, and when the second region has a length of 30 pixel units in the horizontal direction, the threshold distance may be 45 pixel units in length. When the distance between the first region and the second region adjacent to each other among the plurality of regions is less than the threshold distance (No in operation 357), the processor 120 may proceed to operation 359. When the distance between the first region and the second region adjacent to each other among the plurality of regions is greater than or equal to the threshold distance (Yes in operation 357), the processor 120 may proceed to operation 361.

[0083] In operation 359, the processor 120 of the electronic device 101 according to an embodiment may display a first screen. When the distance between the first region and the second region is less than the threshold distance, the processor 120 may determine that it is not necessary to omit the background between the first region and the second region. The display device 160 may display the first image without change.

[0084] In operation 361, the processor 120 of the electronic device 101 according to an embodiment may omit at least a part of a third region provided between the first region and the second region from the first image. The third region may be a region that displays the background between the first region and the second region. When the distance between the first region and the second region is greater than or equal to the threshold distance, the processor 120 may determine to omit at least a part of the third region to more strongly emphasize the first region and the second region.

[0085] In operation 363, the processor 120 of the electronic device 101 according to an embodiment may display a second image obtained by resetting the size of each of the plurality of sub-regions and rearranging each of the plurality of sub-regions. The processor 120 may reset the size of each of the plurality of sub-regions to fill the remaining region after omitting at least a part of the third region. For example, the processor 120 may enlarge the first region and / or the second region. The processor 120 may rearrange the enlarged first region and / or the enlarged second region to correspond to the screen composition to generate a second image. The display device 160 may display the second image in which the first region and the second region are more strongly emphasized.

[0086] Figure 4 is a diagram showing multiple focused subjects captured by a camera (e.g., Figure 3a camera module 180) of an electronic device (e.g., Figure 2 electronic device 101) according to an embodiment of the present disclosure.

[0087] Refer to Figure 4 , a processor (e.g., Figure 3a processor 120) may set multiple subjects 410, 420, and 430 as people in the image data 400, respectively. The processor 120 may obtain a first image captured by the camera module 180 and may display the obtained first image on a display device (e.g., Figure 1 display device 160).

[0088] In one embodiment, the first image may be a screen, video, and / or preview screen captured by one camera (e.g., camera module 180). The processor 120 may obtain the first image including multiple subjects 410, 420, and 430 using one camera (e.g., camera module 180) instead of using several cameras (e.g., camera modules).

[0089] In one embodiment, the multiple focused subjects 410, 420, and 430 may include a first subject 410, a second subject 420, and a third subject 430. The first subject 410, the second subject 420, and the third subject 430 may be people. The first image including the first subject 410, the second subject 420, and the third subject 430 may be displayed on a display device (e.g., Figure 3a display device 160).

[0090] In one embodiment, the processor 120 may set multiple sub-regions in the first image, each of which includes multiple subjects in the first image. The processor 120 may set each of the multiple sub-regions to include at least one of the first subject 410, the second subject 420, and the third subject 430. The processor 120 may set each sub-region to include at least one of the first subject 410, the second subject 420, and the third subject 430. For example, the processor 120 may set a virtual rectangular region including the first subject 410, a virtual rectangular region including the second subject 420, and a virtual rectangular region including the third subject 430 as sub-regions.

[0091] Refer to Figure 4, which shows that the boundaries of each of the multiple sub-regions are not displayed. However, various embodiments are not limited thereto. The processor 120 may display the boundaries of each of the multiple sub-regions on the display device 160, and the sub-regions are a virtual rectangular region including the first subject 410, a virtual rectangular region including the second subject 420, and a virtual rectangular region including the third subject 430.

[0092] Figure 5 is a diagram showing a case where the distance interval between at least one adjacent subject and other subjects among multiple focused subjects captured by a camera (e.g., Figure 3a the camera module 180) of an electronic device 101 (e.g., Figure 2 of the present disclosure) is greater than or equal to a threshold distance.

[0093] Refer to Figure 5 , in the image data 400, at least one (430) of the multiple focused subjects 410, 420, and 430 may move away from the other subjects 410 and 420. The third subject 430 may move away from the first subject 410 and the second subject 420. For example, the third subject 430 may be the rightmost captured person. The first subject 410 and the second subject 420 may be other captured persons.

[0094] In one embodiment, the distance between the third subject 430 and the first subject 410 and the second subject 420 may be less than or equal to a threshold distance (α). When the third subject 430 does not move away from the first subject 410 and the second subject 420, it may be less than the threshold distance. When the distance between the third subject 430 and the first subject 410 and the second subject 420 is less than or equal to the threshold distance, the third subject 430 may be included in one sub-region.

[0095] In one embodiment, the distance between the third subject 430 and the first subject 410 and the second subject 420 may be greater than or equal to the threshold distance. The third subject 430 may move away from the first subject 410 and the second subject 420 in the first direction D1 by more than the threshold distance. For example, the rightmost captured person as the third subject 430 may move away from the other captured persons as the first subject 410 and the second subject 420 in the first direction D1 by more than the threshold distance. When the distance between the third subject 430 and the first subject 410 and the second subject 420 is greater than or equal to the threshold distance, a space may be generated between the third subject 430 and the first subject 410 and the second subject 420.

[0096] When the distance between the third subject 430 and the first subject 410 and the second subject 420 is greater than or equal to a threshold distance, due to the space between the third subject 430 and the first subject 410 and the second subject 420, it may not be easy to magnify the first subject 410, the second subject 420, and the third subject 430 by more than a specific ratio. Therefore, the captured persons corresponding to the first subject 410, the second subject 420, and the third subject 430 can be represented as being generally smaller. In addition, unnecessary space can be generated in the first image. In addition, since it is not easy to rearrange the magnified first subject 410, the magnified second subject 420, and the magnified third subject 430 on a display device (e.g., Figure 3a the display device 160), the first subject 410, the second subject 420, and the third subject 430 can be displayed in a form limited to a specific composition on the display device 160.

[0097] In one embodiment, a processor (e.g., Figure 3a the processor 120) can measure the distances between multiple subjects. The processor 120 can measure the distances between multiple sub-regions in units of the pixels of the display device 160.

[0098] In one embodiment, the processor 120 can obtain the lengths of the outer boundaries of each of the first subject 410, the second subject 420, and the third subject 430 and / or can obtain the distances between adjacent outer boundaries. The processor 120 can obtain the lengths of the outer boundaries of each of the first subject 410, the second subject 420, and the third subject 430 in the first direction D1 during a specified period and / or can obtain the distances between adjacent outer boundaries in the first direction D1 during a specified period. For example, the processor 120 can detect that the length of the outer boundary of the first subject 410 in the first direction D1 is 50 unit pixels, the length of the outer boundary of the second subject 420 in the first direction D1 is 40 unit pixels, and the length of the outer boundary of the third subject 430 in the first direction D1 is 30 unit pixels.

[0099] In one embodiment, the processor 120 can detect that the outer boundary of the sub-region surrounding the third subject 430 moves away from the outer boundary of the sub-region surrounding the first subject 410 and the second subject 420 by more than a threshold distance. The threshold distance can be preset according to the size of each of the multiple sub-regions and specified magnification conditions. For example, when the threshold distance is set to 1.5 times the length in the horizontal direction of the region with the shorter length in the horizontal direction among the multiple sub-regions, since the length of the outer boundary of the third subject 430 in the first direction D1 is 30 unit pixels (which is the shortest distance), the processor 120 can set the threshold distance to a length of 45 pixel units.

[0100] Figure 6 It is a diagram showing a method for setting multiple sub - regions 610 and 620 of multiple focused subjects 410, 420, and 430 captured by a camera (e.g., Figure 3a the camera module 180 of the electronic device 101) to be set to an electronic device (e.g., Figure 2 according to an embodiment of the present disclosure.

[0101] Referring to Figure 6 , in one embodiment, a processor (e.g., Figure 3a the processor 120) may set multiple sub - regions 610 and 620 in the image data 600 to respectively include a first subject 410, a second subject 420, and a third subject 430. The processor 120 may determine the first subject 410 and the second subject 420 that are close to or attached and less than or equal to a threshold distance as one subject. The processor 120 may include the first subject 410 and the second subject 420 that are close to or attached and less than or equal to a threshold distance in one sub - region. For example, the processor 120 may set the first sub - region to include the first subject 410 and the second subject 420, and may set the second sub - region 620 to include the third subject 430. The processor 120 may set a virtual rectangle including the first subject 410 and the second subject 420 as the first sub - region 610. The processor 120 may set a virtual rectangle including the third subject 430 as the second sub - region 620.

[0102] In one embodiment, the processor 120 may detect that at least one subject 430 moves away from other subjects 410 and 420 by more than a threshold distance. For example, the processor 120 may detect that at least one subject 430 moves away from an adjacent subject 420 by more than a threshold distance. For example, the processor 120 may detect that the outer boundary of the second sub - region 620 around the third subject 430 moves away from the outer boundary of the first sub - region 610 around the first subject 410 and the second subject 420 by more than a threshold distance. In this case, the processor 120 may determine that the third subject 430 moves away from the first subject 410 and the second subject 420 by more than a threshold distance. When the third subject 430 moves away from the first subject 410 and the second subject 420 by more than a threshold distance, the processor 120 may reconstruct the first image to more clearly represent the first subject 410, the second subject 420, and the third subject 430.

[0103] In one embodiment, the processor 120 may set a plurality of sub-regions 610 and 620 such that the plurality of sub-regions 610 and 620 do not overlap with each other. The processor 120 may set a first sub-region 610 and a second sub-region 620 such that the first sub-region 610 and the second sub-region 620 do not overlap with each other.

[0104] In one embodiment, the processor 120 may obtain the distance between a plurality of sub-regions 610 and 620. When the third subject 430 moves away from the first subject 410 and the second subject 420 by more than a threshold distance, the processor 120 may prepare a trigger operation for reconstructing the first image.

[0105] In one embodiment, an image sensor (e.g., Figure 3a the image sensor 230) may obtain image data including a first sub-region 610, a second sub-region 620, and a space 630 between the first sub-region 610 and the second sub-region 620. The image sensor 230 may determine the space 630 between the first sub-region 610 and the second sub-region 620 as a third region 630.

[0106] Figure 7 FIG. is a diagram showing rearrangement and display of a plurality of sub-region settings according to an embodiment of the present disclosure.

[0107] Reference Figure 7 FIG., in one embodiment, a processor (e.g., Figure 3a the processor 120) may resize each of a plurality of sub-regions 710 and 720 in the image data 700 based on an image reconstruction instruction (e.g., Figure 3a the image reconstruction instruction 314). For example, the processor 120 may enlarge each of the plurality of sub-regions 710 and 720. The processor 120 may rearrange the plurality of sub-regions 710 and 720 based on the image reconstruction instruction 314. The processor 120 may display, on a display device (e.g., Figure 3a the display device 160), an image obtained by rearranging the plurality of sub-regions 710 and 720. The processor 120 may display, on the display device 160, a second image obtained by enlarging and rearranging a first sub-region 710 and a second sub-region 720 of a first image based on the image reconstruction instruction 314.

[0108] When the distance between the plurality of sub-regions 710 and 720 is greater than or equal to a specified threshold distance, the processor 120 may omit setting a third region (e.g., Figure 6at least a portion of the third region 630). The threshold distance may be set according to the distances in the first direction D1 of each of the plurality of sub-regions 710 and 720 and the designated magnification ratios of each of the plurality of sub-regions 710 and 720. For example, the threshold distance may be set to 1.5 times the distance in the first direction D1 of the smaller sub-region 720 among the plurality of sub-regions 710 and 720. The processor 120 may crop some regions in the first image captured when the interval between the moving objects of interest is greater than the threshold distance to digitally generate a plurality of segmented images. When the length of the third region 630 in the first direction D1 is greater than or equal to the threshold distance, the processor 120 may determine that the third region 630 is occupied by more than a certain proportion in the first image and may crop the first sub-region 610 and the second sub-region 620 of the first image. For example, when the threshold distance is greater than or equal to 1.5 times the distance in the first direction D1 of the smaller sub-region 720 among the plurality of sub-regions 710 and 720, the processor 120 may omit at least a portion of the third region 630 from the image data.

[0109] In one embodiment, the processor 120 may display a second image obtained by resetting the size of each of the plurality of sub-regions 710 and 720 and rearranging each of the plurality of sub-regions 710 and 720. The processor 120 may adjust the sizes of the first subject 410 and the second subject 420 included in the first sub-region 710 and / or the third subject 430 included in the second sub-region 720. For example, the processor 120 may apply different magnification ratios to the first subject 410 and the second subject 420 included in the first sub-region 710 and the third subject 430 included in the second sub-region 720. The processor 120 may connect the first sub-region 710 including the first subject 410 and the second subject 420 to the second sub-region 720 including the third subject 430 to generate and display a second image on the display device 160.

[0110] In one embodiment, the processor 120 may rearrange the first subject 410 and the second subject 420 included in the first sub-region 710 and the third subject 430 included in the second sub-region 720 to be reconstructed into a second image. For example, the processor 120 may stitch together the first subject 410 and the second subject 420 included in the first sub-region 710 and the third subject 430 included in the second sub-region 720. The processor 120 may adjust and arrange the first sub-region 710 and the second sub-region 720 cropped by a specific queue signal to fit the configuration of the display device 160 to form a second image.

[0111] In one embodiment, the processor 120 may rearrange a plurality of sub-regions (or a plurality of zoom regions) 710 and 720 such that the plurality of sub-regions 710 and 720 are adjacent to each other in a first direction D1, and such that a dividing line 730 is displayed between the plurality of sub-regions 710 and 720. The processor 120 may rearrange each of the plurality of sub-regions 710 and 720, may omit at least a portion of the third region 630, and may increase the magnification ratios of the first sub-region 710 and the second sub-region 720. The processor 120 may notify the user of the electronic device 101 that at least a portion of the third region 630 is omitted and that there was originally an omitted space between the first sub-region 710 and the second sub-region 720. The processor 120 may control the display device 160 to display the dividing line 730 between the first sub-region 710 and the second sub-region 720 based on the image reconstruction instruction 314.

[0112] In one embodiment, the processor 120 may arrange a plurality of sub-regions 710 and 720 such that the plurality of sub-regions 710 and 720 are respectively displayed as separate windows, and such that at least some of the edges and / or regions forming the windows overlap each other. Rearrangement of each of the plurality of sub-regions 710 and 720 may be performed to differently apply the magnification ratios to the first sub-region 710 and the second sub-region 720 or correspond to the screen ratio of the display device 160. In this case, the plurality of sub-regions 710 and 720 may be rearranged such that they are respectively displayed as separate windows, and some of the edges and / or regions forming the windows overlap each other. The processor 120 may set the sizes and positions of the windows forming the first sub-region 710 and the second sub-region 720 based on the image reconstruction instruction 314.

[0113] Figure 8 is a diagram showing a method for setting boundary regions of a plurality of subjects according to an embodiment of the present disclosure.

[0114] Reference Figure 8 , in one embodiment, a processor (e.g., Figure 3a the processor 120) may obtain the distances between objects or people included in an image. To obtain the distances between objects or people included in an image, the processor 120 may set boundary regions 810, 820, 830, 840, 850 of a plurality of subjects 811, 812, 813, 814, and 815 in the image data 800. For example, the processor 120 may set a first boundary region 810, a second boundary region 820, a third boundary region 830, a fourth boundary region 840, and a fifth boundary region 850 that respectively include a first subject 811, a second subject 812, a third subject 813, a fourth subject 814, and a fifth subject 815.

[0115] In one embodiment, the processor 120 may control the lens assembly (e.g., Figure 3a the lens assembly 210) to detect an object from the image data based on an object detection instruction (e.g., Figure 3a the object detection instruction 311). The processor 120 may control the lens assembly 210 to track an object from the image data based on an object tracking instruction (e.g., Figure 3a the object tracking instruction 312). For example, when the object to be tracked is a person, the processor 120 may calculate in real time the bounding boxes of each of the subjects 811, 812, 813, 814, and 815 and the intervals between the bounding boxes. Human body tracking may be a method for performing human body detection to identify the positions of each of the subjects 811, 812, 813, 814, and 815 and continuing to track the positions of each of the subjects 811, 812, 813, 814, and 815 based on parts similar to the previous frame on consecutive frames of a camera (e.g., Figure 2 the camera module 180). In addition, human body detection may be a method for detecting a human body based on whether the shape of a human body is detected and setting a boundary area 810, 820, 830, 840, and 850 in a form covering the human body.

[0116] Figure 9 is a diagram showing a method for setting a human area 910 according to an embodiment of the present disclosure.

[0117] Referring to Figure 9 , in an embodiment, the processor (such as Figure 3a the processor 120) may separate the human area 910 in the first image in the image data 900 from the background area 920. The human area 910 may be an area representing a person in the first image. The background area 920 may be an area in the first image other than the human area 910.

[0118] In one embodiment, the processor 120 may record and / or track in real time the intervals between the people included in the human area 910 based on semantic segmentation. Semantic segmentation may be a method for deriving a boundary part or mask regarding the category "person" in the first image on a pixel-by-pixel basis. The processor 120 may measure the distance between the separated people in the human area 910 of the first image based on semantic segmentation to measure the intervals between people in real time.

[0119] Figure 10 is a diagram showing a method for setting a human width according to an embodiment of the present disclosure.

[0120] Referring to Figure 10 , in an embodiment, the processor (e.g., Figure 3aThe processor 120) may set the length of the boundary region 810 of the subject 811 in the first direction D1 as the human width in the image data 1000. When the subject 811 is set as the target to be magnified, the boundary region 810 may be a region substantially the same as the zoom region (e.g., Figure 7 the second sub-region 720) including one subject. The processor 120 may set the length of the zoom region in the first direction D1 as the human width.

[0121] In one embodiment, the processor 120 may set a specified distance based on the width of each of the plurality of zoom regions in the first direction D1. The processor 120 may obtain a threshold distance (α) based on the length of the narrow side of the boundary region 810 of one subject 811 by human body detection. When there are multiple human width values, the processor 120 may set the minimum of the human width values as the threshold distance.

[0122] In one embodiment, the processor 120 may set the threshold distance as a value obtained by multiplying the human width by a specified constant (β). The specified constant may be approximately "1". However, various embodiments are not limited thereto. The specified constant may be set differently according to the application.

[0123] Figure 11 is a flowchart showing a method for displaying an image in an electronic device (e.g., Figure 3a the electronic device 101) according to an embodiment of the present disclosure.

[0124] Referring to Figure 11 , in method 1100, in operation 1110, the camera (e.g., Figure 2 the camera module 180) of the electronic device 101 according to an embodiment may perform screen reconstruction according to the number and size of the zoom regions (e.g., Figure 7 the first sub-region 710 and the second sub-region 720). The camera 180 may generate a first image based on the number and size of the sub-regions 710 and 720, and may display the first image on the display device (e.g., Figure 3a the display device 160).

[0125] In operation 1120, the camera 180 of the electronic device 101 according to an embodiment may update the camera preview. The camera 180 may pre-display on the display device 160 a preview screen showing the external environment obtained by the lens assembly (e.g., Figure 3a the lens assembly 210). The camera 180 may continuously update the preview image before capturing an image obtained by using the image sensor (e.g., Figure 3a the image sensor 230).

[0126] In operation 1130, the electronic device 101 according to an embodiment may determine whether the driving of the camera 180 has ended. When the driving of the camera 180 ends (Yes in operation 1130), the electronic device 101 may end the above process without performing additional operations. When the camera 180 continues to be driven (No in operation 1130), the electronic device 101 may proceed to operation 1140.

[0127] In operation 1140, the electronic device 101 according to an embodiment may determine whether a screen division signal is detected. When the distance between a plurality of subjects (e.g., Figure 4 the plurality of subjects 410, 420, and 430) is greater than or equal to a threshold distance, the processor 120 may send a screen division signal to the camera 180.

[0128] In operation 1150, the camera 180 of the electronic device 101 according to an embodiment may track new target subjects 410, 420, and 430 and generate a zoom area. The camera 180 may receive a screen division signal from the processor 120 and may track the subjects 410, 420, and 430 to set a new zoom area. When the distance between the subjects 410, 420, and 430 is greater than or equal to the threshold distance, the camera 180 may generate a plurality of zoom areas.

[0129] In operation 1160, the electronic device 101 according to an embodiment may determine whether a screen integration signal is detected. When the distance between a plurality of subjects (e.g., Figure 4 the plurality of subjects 410, 420, and 430) is less than the threshold distance, the processor 120 may send a screen integration signal to the camera 180. When the screen integration signal is detected (Yes in operation 1160), the camera 180 may proceed to operation 1170. When the screen integration signal is not detected (No in operation 1160), the camera 180 may perform operation 1110 to reconstruct the screen according to the number and size of the zoom areas to display a second image.

[0130] In operation 1170, the camera 180 of the electronic device 101 according to an embodiment may stop tracking the subjects 410, 420, and 430 and may remove the zoom area. The camera 180 may end the zoom operation and may capture and display an image in a common manner.

[0131] Figure 12 is a diagram illustrating a method for displaying an image in an electronic device (e.g., Figure 3a the electronic device 101) according to an embodiment.

[0132] Reference Figure 12 , in method 1200, in operation 1210, the processor of the electronic device 101 according to an embodiment (e.g.,Figure 3a The processor 120) can display a second image. When a plurality of sub-regions (e.g., Figure 7 Among the sub-regions 710 and 720) of the first region adjacent to each other (e.g., Figure 7 The first sub-region 710) and the second region (e.g., Figure 7 The second sub-region 720) of the distance between is greater than or equal to a specified threshold distance, the processor 120 can display a second image generated based on the first region and the second region.

[0133] In operation 1220, the processor 120 of the electronic device 101 according to an embodiment can identify whether the distance between the first region and the second region is less than the threshold distance when displaying the second image. Subjects included in the first region (e.g., Figure 7 The first subject 410 and the second subject 420) and the subjects included in the second region (e.g., Figure 7 The third subject 430) can move away from each other by more than a threshold range, and then can move closer to each other to below the threshold distance. The processor 120 can detect the case where the distance between the first region and the second region is greater than or equal to the threshold distance to display the second image, and then detect the case where the distance between the first region and the second region is less than the threshold distance. When the distance between the first region and the second region is greater than or equal to the threshold distance when displaying the second image (No in operation 1220), the processor 120 can return to operation 1210 to continue displaying the second image. When the distance between the first region and the second region is less than the threshold distance when displaying the second image (Yes in operation 1220), the processor 120 can proceed to operation 1230.

[0134] In operation 1230, the processor 120 of the electronic device 101 according to an embodiment can display a timer that counts a specified waiting time together with the second image. The waiting time can be the waiting time for maintaining the second image before returning to the first image. For example, the waiting time can be set to a time greater than or equal to about 2 seconds and less than or equal to about 10 seconds.

[0135] In one embodiment, the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 may continue to move. The subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 may be temporarily close to each other below a threshold distance and may be close below the threshold distance such that a specified time elapses. Although the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 are temporarily close to each other, whenever the second image returns to the first image when the distance between the subjects 410 and 420 and the subject 430 is less than the threshold distance, power consumption may be wasted because the execution of screen change and rearrangement is more than necessary, and the user's viewing of the image may be interrupted due to multiple screen changes. The processor 120 may hold the second image before the waiting time elapses after displaying the second image, thereby reducing power consumption and improving the visibility of the image.

[0136] In one embodiment, the processor 120 may display a timer that counts the waiting time when displaying the second image. The timer may start counting down the waiting time from the time when the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 are close to each other.

[0137] In operation 1240, the processor 120 of the electronic device 101 according to an embodiment may identify whether the waiting time counted by the timer has elapsed. The timer may start counting down the waiting time from the time when the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 are close to each other. When the waiting time has elapsed, the timer may reach "0". When the timer reaches "0", the processor 120 may determine that the waiting time counted by the timer has elapsed. When the waiting time counted by the timer has not elapsed (No in operation 1240), the processor 120 may maintain operation 1230 to display a timer that counts the waiting time when displaying the second image. When the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 move away from each other by more than the threshold distance before the timer 1310 reaches "0", the processor 120 may be configured to initialize the waiting time. When the waiting time counted by the timer has elapsed (Yes in operation 1240), the processor 120 may proceed to operation 1250.

[0138] In operation 1250, the processor 120 of the electronic device 101 according to an embodiment may return to the first image. The processor 120 may detect that the timer shows "0" and wait for time to pass. Although the specified time has elapsed, when the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 remain less than a threshold distance, the processor 120 may display the original first image.

[0139] Figure 13 FIG. is a diagram showing a second image and a timer according to an embodiment of the present disclosure.

[0140] Reference Figure 13 , in one embodiment, the second image may highlight the first sub-region 710 and the second sub-region 720 in the image data 1300. When the distance between the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 is less than a threshold distance when the second image is being displayed, a timer 1310 may be displayed at one side of the second image. When the timer 1310 is displayed, the initial time may be the waiting time. For example, the initial time may be 3 seconds. When the distance between the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 is less than a threshold distance when the second image is being displayed, the timer 1310 may count down. When the timer 1310 reaches "0", the processor (e.g., Figure 3a the processor 120) may determine that the waiting time has passed and may return the second image to the first image. When the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 move away from each other by more than a threshold distance before the timer 1310 reaches "0", the processor 120 may be configured to stop the countdown of the timer 1310. When the subjects 410 and 420 included in the first sub-region 710 and the subject 430 included in the second sub-region 720 move away from each other by more than a threshold distance before the timer 1310 reaches "0", the processor 120 may be configured to initialize the timer 1310 to the waiting time and display the second image.

[0141] An electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include (e.g.) a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to an embodiment of the present disclosure, the electronic device is not limited to the above-described devices.

[0142] It should be understood that the embodiments of the present disclosure and the terms used herein are not intended to limit the technical features described herein to specific embodiments, and include various changes, equivalents or alternatives of the corresponding embodiments. For the description of the drawings, like reference numerals may be used to refer to like or related elements. It will be understood that a singular noun corresponding to a term may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B or C" may include any one or all possible combinations of the terms enumerated together in the corresponding one of the phrases. As used herein, terms such as "first" and "second" or "1st" and "2nd" may be used to simply distinguish a corresponding component from another component, and do not limit the component in other respects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as "coupled to", "coupled with", "connected to" or "connected with" another element (e.g., a second element), with or without the terms "operatively" or "communicatively", it means that the element can be directly (e.g., wired), wirelessly or via a third element coupled to the other element.

[0143] As used herein, the term "module" may include a unit implemented in hardware, software or firmware, and may be used interchangeably with other terms, such as "logic", "logic block", "component" or "circuitry". A module may be a single integrated part suitable for performing one or more functions, or its smallest unit or part. For example, according to an embodiment, the module may be implemented in the form of an application specific integrated circuit (ASIC).

[0144] The various embodiments described herein can be implemented as software (e.g., program 140) including one or more instructions readable by a machine (e.g., electronic device 101) stored in a storage medium (e.g., internal memory 136 or external memory 138). For example, a processor (e.g., processor 120) of a machine (e.g., electronic device 101) can call at least one of the one or more instructions stored in the storage medium and, under the control of the processor, use or not use one or more other components to execute the instructions. This allows the machine to be operated in accordance with the at least one called instruction to perform at least one function. The one or more instructions can include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium can be provided in the form of a non-transitory storage medium. Herein, the term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data stored semi-permanently in the storage medium and data stored temporarily in the storage medium.

[0145] According to an embodiment, a method according to various embodiments of the present disclosure can be included and provided in a computer program product. The computer program product can be traded between a seller and a purchaser as a product. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online via an application store (e.g., PlayStore™) or directly between two user devices (e.g., smart phones) (e.g., download or upload). If distributed online, then at least a portion of the computer program product can be generated temporarily or stored at least temporarily in a machine-readable storage medium (e.g., the memory of a manufacturer's server, an application store's server, or a relay server).

[0146] According to various embodiments, each of the above components (e.g., a module or a program) can include a single entity or multiple entities. According to various embodiments, one or more of the above components can be omitted, or one or more other components can be added. Additionally or alternatively, multiple components (e.g., modules or programs) can be integrated into a single component. In this case, according to various embodiments, the integrated component can still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding one of the multiple components performed the one or more functions before integration. According to various embodiments, the operations performed by a module, a program, or another component can be performed sequentially, in parallel, repeatedly, or in a heuristic manner, or one or more of the operations can be run in a different order or omitted, or one or more other operations can be added.

Claims

1. A method for displaying a video image in an electronic device, the method comprising: obtaining a first video image including a plurality of subjects; setting a plurality of sub-regions respectively including the plurality of subjects, wherein each sub-region includes at least one of the plurality of subjects; displaying a second video image obtained by changing the size of each of the plurality of sub-regions and rearranging each of the plurality of sub-regions according to the number of the plurality of sub-regions; and after detecting that one of the plurality of subjects corresponding to one of the rearranged sub-regions has moved a distance equal to or greater than a specified distance, maintaining the changed size and arrangement of the plurality of sub-regions of the second video image for a waiting time.

2. The method according to claim 1, wherein, each of the plurality of sub-regions is set as a bounding box of each of the plurality of subjects.

3. The method according to claim 1, wherein, the rearrangement of each of the plurality of sub-regions includes: rearranging the plurality of sub-regions such that each of the plurality of sub-regions is adjacent in a first direction and a dividing line is displayed between the plurality of sub-regions.

4. The method according to claim 1, wherein, the rearrangement of each of the plurality of sub-regions includes: rearranging the plurality of sub-regions such that the plurality of sub-regions are respectively displayed as separate windows and at least some edges or regions forming the windows overlap each other.

5. The method according to claim 1, wherein, the first video image is at least one of a screen, a video or a preview screen captured by a camera.

6. The method according to claim 1, wherein, each of the plurality of subjects is a person.

7. The method according to claim 1, wherein, the plurality of sub-regions are set not to overlap each other.

8. The method according to claim 1, wherein, a first sub-region includes a first subject and a second subject among the plurality of subjects, wherein a second sub-region includes a third subject among the plurality of subjects, and wherein the second video image is generated by connecting the first sub-region and the second sub-region.

9. The method according to claim 1, wherein, displaying the second video image includes: displaying a second video image obtained by omitting at least a part of the region located between adjacent sub-regions from the first video image.

10. The method according to claim 1, wherein, changing the size of each of the plurality of sub-regions includes: changing the size of each of the plurality of sub-regions by magnifying at least one of the plurality of subjects included in the respective sub-region.

11. An electronic device, comprising: a camera circuit including an image sensor, the camera circuit being configured to obtain image data corresponding to an external environment; a display configured to display a video image generated based on the image data; a processor operably connected to the camera circuit and the display; and a memory operably connected to the processor, Wherein the memory stores instructions which, when executed, cause the processor to: Obtain a first video image including a plurality of subjects, Set a plurality of sub-regions respectively including the plurality of subjects, where each sub-region includes at least one of the plurality of subjects, Display a second video image obtained by changing the size of each of the plurality of sub-regions and rearranging each of the plurality of sub-regions according to the number of the plurality of sub-regions, After detecting that at least one subject among the plurality of subjects corresponding to at least one of the rearranged sub-regions has moved a distance equal to or greater than a specified distance, maintain the changed size and arrangement of the plurality of sub-regions of the second video image for a waiting time.

12. The electronic device according to claim 11, Wherein, Each of the plurality of sub-regions is set as a bounding box of each of the plurality of subjects.

13. The electronic device according to claim 11, Wherein, The rearrangement of each of the plurality of sub-regions includes: Rearranging the plurality of sub-regions such that each of the plurality of sub-regions is adjacent in a first direction and such that a dividing line is displayed between the plurality of sub-regions.

14. The electronic device according to claim 11, Wherein, The rearrangement of each of the plurality of sub-regions includes: Rearranging the plurality of sub-regions such that the plurality of sub-regions are respectively displayed as separate windows and such that at least some edges or regions forming the windows overlap each other.

15. The electronic device according to claim 11, Wherein, The first video image is at least one of a screen, a video, or a preview screen captured by one camera.

16. The electronic device according to claim 11, Wherein, Each of the plurality of subjects is a person.

17. The electronic device according to claim 11, Wherein, The plurality of sub-regions are set to not overlap with each other.

18. The electronic device according to claim 11, Wherein, Displaying the second video image includes: displaying a second video image obtained by omitting at least a part of the region located between adjacent sub-regions from the first video image.

19. The electronic device according to claim 11, Wherein, Changing the size of each of the plurality of sub-regions includes: changing the size of each of the plurality of sub-regions by magnifying at least one subject among the plurality of subjects included in the respective sub-region.

Images