An electronic device for controlling the display of multiple responsive images

Abstract

To provide an electronic device configured to control to display a multi reactive video that makes a response through user operation.SOLUTION: An electronic device includes a touch screen for displaying a reactive video, and a processor which controls display operation of the reactive video. The reactive video includes a first video including a first pose of a target body and a second video in which the first pose changes to a second pose. The first video is first displayed when the reactive video is displayed. The second video is mapped with a touch gesture having a predetermined pattern. When the touch gesture is received on the touch screen on which the first video is displayed, the processor performs control to replace the first video by the second video for display.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a method for producing a multi-reaction type video, a method for generating metadata for a multi-reaction type video, and a method for analyzing human behavior. More detailed information on the method of analyzing interaction data to understand the The present invention relates to a method and program for producing a multi-reaction image that reacts to user operations. do. [Background technology]

[0002] In recent years, video capture technology has been developing rapidly. Not only camcorders and digital cameras, Mobile devices such as smartphones can also capture high-resolution images. Recently, digital cameras and 3D imaging cameras have appeared.

[0003] Images are captured by a video camera, stored in a specific format, and played back on a The video is played by the terminal. There is no interaction between the viewer and the video. In other words, the viewer is given a visual sensation by the images being played. You can only feel it. Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention has been made in view of the above circumstances, and its object is to provide a method for recording general moving images or multiple moving images. Based on a video database (e.g., basic video) in which image frames are stored, A method of producing a multi-reaction video that reproduces various conditions according to the The purpose of the Act is to provide a law.

[0005] Another object of the present invention is to provide an output image for various input operations based on a plurality of basic images. The present invention provides a method for generating a multi-reactive image by compressing the image to reduce the capacity. The point is that.

[0006] Furthermore, another object of the present invention is to provide a method for inputting a plurality of input operations into a single image, the method being characterized in that the input operations are reflected together and can be performed separately or simultaneously. To provide a method for generating and using a multi-reaction image capable of generating a variety of output images. is located.

[0007] Another object of the present invention is to provide a method for detecting a moving image, a 2D image, or a 3D image database. It is a multi-reaction image generator that realizes multi-reaction images with various functions applied under certain conditions. To provide a method and program for implementing a multi-reaction image generation file. The point is that.

[0008] A further object of the present invention is to obtain a user's multiple reaction type image operation and to respond to an object in the image. To provide a method for analyzing user interest levels based on multiple reaction-type video, which calculates the level of interest of users in a video. The point is...

[0009] Another object of the present invention is to provide a system that allows users to play videos in a chronological order, which has been conventionally limited to this. To overcome the limitations of content, an event axis has been added to the video (e.g., By adding that the image can be controlled in units of 100 pixels, the direction or order in which the image is output can be controlled. Create a multi-responsive data structure that can be adjusted according to user operations. To provide a method for generating a responsive image.

[0010] The problems to be solved by the present invention are not limited to the problems mentioned above, and may include any other problems not mentioned above. Other problems will be clearly understood by those skilled in the art from the following description. [Means for solving the problem]

[0011] According to an embodiment of the present invention, a method for generating a multi-reaction image includes: The basic image includes a motion of a target object to be realized in response to a user's operation. A step of acquiring a basic image, which is an original image, and a step of compressing the image based on the basic image by a computer. The compressed image is generated in a responsive manner according to a user's operation. A compressed image generation step includes only the movement of the A condition is received, and the multiple reaction type image generation condition corresponds to a reaction that can be generated in the compressed image. A multi-reaction type image generating condition receiving step, which is a plurality of operation inputs, and applying the method to the image to generate a multi-responsive image.

[0012] In another embodiment, the step of generating the compressed image includes dividing or compressing an image section in the basic image. By recognizing the similarity of video frames, it is possible to delete video frames that are not responsively realized. It is characterized by:

[0013] In still another embodiment, the step of generating the compressed image comprises: and if the second basic image includes the object moving along the same path, the computer A section image including a motion of the same path is extracted from the first basic image and the second basic image. and extracting overlapping images included in either the first basic image or the second basic image. It is characterized by preserving section footage.

[0014] In another embodiment, the step of generating the compressed image further comprises: a first section image of moving to a position, and a second section image of moving from the second position to the first position; If the compressed image includes the first section image, the computer leaves only the first section image in the compressed image and deletes the second section image. Upon input of a user operation that generates a movement of the object from a position to the first position, The feature of this is that the section video is set to be played in reverse.

[0015] In still another embodiment, the step of generating a compressed image is performed by compressing the entire basic image or a part of the basic image. A background in which no change occurs within multiple image frames contained in a specific section of the base image If the background image includes a background region, the computer extracts the background image from the basic image or the section image. After extracting the background region, the background region is included only in the initial frame of the basic image or the section image. and leaving only one or more extracted regions in the subsequent video frame, The region is a region where a change occurs in the movement of the object in the basic image.

[0016] In another embodiment, the step of generating a compressed image comprises: When the first and second event sections have different changes in the external appearance of the object, The first playback time is set to play the first incident section forward and then play the second incident section continuously. The second playback type plays the first incident section forward and then plays it backward. The multi-reaction type image generating condition receiving step is characterized in that the multi-reaction type image generating condition receiving step is performed by the same user operation. For each type of reference maneuver, the strength of the specific reference maneuver, the length of the reference movement, the speed of the reference maneuver or the reference movement Based on the duration of the operation, the first operation and the second operation are divided, and the first playback type and the second playback type are The present invention is characterized by linking types.

[0017] In still another embodiment, the step of generating the compressed image comprises: From the initial frame including all of the extracted regions, each image frame is The extracted regions of the image are sequentially accumulated in a stack structure to generate a compressed image file, The multi-reaction type image generating step is performed by linking the user's operation with each extracted region on the stack structure. It is characterized by storing.

[0018] In another embodiment, the multi-reaction image is extracted into a plurality of regions within an image frame. When a region stack is formed, multiple extracted regions are input by multiple user operations. It is characterized by simultaneously extracting the background region and combining it with the other region before outputting it.

[0019] In still another embodiment, the multi-reaction type image generating step may include: When the reactive generation condition is met, a specific section of the compressed video is output in a specific playback mode. The present invention is characterized in that the input signal is set to a value that is greater than the input signal.

[0020] In another embodiment, the multiple reaction type image generating step includes consecutively generating a plurality of multiple reaction type images. As a result, the first multiple reaction type image changes to the second multiple reaction type image according to the user's operation. The first multiple reaction type image and the second multiple reaction type image are generated so as to be outputted. These are set to be output simultaneously on the screen. Effect of the Invention

[0021] The present invention as described above has various advantages as follows.

[0022] First, by applying various playback conditions to the multi-reaction video according to the user's operation, Unlike existing media that is limited by a simple time axis, This allows the user to be provided with multiple reaction images that can produce a variety of different outputs. By inducing users to make repeated attempts to confirm various results, multiple reactions can be avoided. This can increase the user's interest in the object (i.e., object) included in the video. In other words, by setting specific conditions for the image using the multi-reaction image generation file, This allows users to view multi-reaction videos that reflect various events.

[0023] Secondly, the multi-reaction video generation file can be combined with general videos or multiple video frames. By playing them together, a variety of actions (i.e., reactions) can be applied.

[0024] Third, you can apply video splitting or cropping to the video frames to get the best possible results. The effect is that it allows you to embody a variety of actions based on the video.

[0025] Fourth, by recording the details of operations performed by a specific user on a multi-reaction video, For example, the user's touch operation on the multi-reaction image can be understood. It is possible to know the number of times a user touches a screen, the frame where the touch operation was performed, and the object in the frame, and so on. The target and the level of interest can be grasped, and the user's level of interest in the user can be grasped.

[0026] In addition, each event is combined with various input conditions to simulate real-world phenomena. Various attributes of the object (e.g., gravity and force action, weight, resistance, both environmental and physical aspects) Perfectly reflects surface texture, elasticity, density, size, pattern, distance to the target object, and sound It maximizes the sense of reality and creates rich experiential content that can be directly interacted with in various ways. It is possible.

[0027] Furthermore, the multiple reaction type image generated according to the embodiment of the present invention can be used to evaluate the multiple reaction type of the user. Accumulate and analyze interaction data on video content to understand users' intentions and desires Based on the results of data analysis, it is possible to perform hyper-personalization by understanding the characteristics of users. [Brief description of the drawings]

[0028] [Figure 1] 4 is a flowchart illustrating a method for generating a multi-reaction image according to an embodiment of the present invention. [Diagram 2] 13 is an exemplary diagram showing how to change the direction and facial expression of a target face's neck in response to a user's operation according to an embodiment of the present invention; [Diagram 3] 1 is an example of a basic image including a plurality of events so that different results can be realized in response to operations input by a user according to an embodiment of the present invention; [Figure 4] 4 is an example of a basic image for implementing a change in the position of an object according to the position of each touch operation of a user according to an embodiment of the present invention; FIG. [Diagram 5] 2 is an exemplary diagram showing a stack structure of compressed images according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0029] The present invention will now be described in detail with reference to the accompanying drawings, in which: The features and methods of achieving them are described in detail below with reference to the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below. However, the present invention may be embodied in various different forms. The present invention is intended to be understood as being illustrative and not restrictive. The present invention is defined by the following claims, which are provided for a complete understanding of the invention. The present invention is only defined as such. Like reference numbers refer to like elements throughout the specification.

[0030] Unless otherwise defined, all terms (including technical and scientific terms) used herein are The meanings are those that can be commonly understood by those having ordinary skill in the art to which the present invention pertains. In addition, terms defined in commonly used dictionaries are used without being expressly defined. Unless otherwise stated, they should not be interpreted ideally or excessively.

[0031] The terms used in this specification are intended to describe the embodiments and are not intended to limit the present invention. In this specification, the singular includes the plural unless specifically stated otherwise. As used in the specification, the words "comprises" and / or "comprises" mean "rising" refers to the presence or addition of one or more other elements beyond the element being mentioned Does not exclude.

[0032] In this specification, the multiple reaction type video is a video that responds to a specific user (i.e., viewer) who watches the video. It means an image that changes or is played in a form corresponding to an input operation. For example, The user's input operations corresponding to specific movements in the original video are linked, and the user's operations are Therefore, it can refer to an image in which an object in the image is played as if it is moving.

[0033] As used herein, "computer" includes any of a variety of devices capable of performing computations. For example, computers are desktop PCs and notebook computers. Smartphones, tablet PCs, cellular phones Cellular phone, PCS phone (Perso nal Communication Service phone), synchronous / asynchronous IMT-2000(International Mobile Telecommunication cation-2000) mobile terminal, Palm PC (Palm Personal Computer puter), personal digital assistant (PDA) In addition, the computer is a server that receives information from a client. In the following description, a computer is a terminal. It can also be expressed as:

[0034] In this specification, the term "input operation" refers to an input means for a computer that reproduces a multiple reaction type image. For example, the input operation may be performed by a mouse. The input is made to a specific point or area in the image by an input means such as a mouse or a touch screen. Operations that may be detected (e.g., click operations, drag operations, touch operations that last for a certain period of time, Pressure touch operation (i.e., touch operation in which a specific pressure is applied to the touch screen or touch pad) For example, the input operation may include a computer (or a terminal). The sensors (e.g., acceleration sensor, gyro sensor, etc.) provided on the terminal are used as input means. The information may include the position or movement of the terminal itself.

[0035] In this specification, the term "object" refers to an object that is manipulated by a user. In the case of a video of a user touching a specific object with his / her hand, the object is In addition, if the video shows the movements of a specific person, The object may be a person in the image.

[0036] In this specification, the term "operating object" refers to an object that performs an operation on a target object in an image. For example, In the video, when a hand touches or presses a bag or a pillow, the operating object is the bag. Or it means hands touching a pillow.

[0037] In this specification, the term "basic image" refers to an image that is not embodied in a reactive manner. The images are either video images produced by a general shooting method or image frames generated according to the position of the object in space. A combination of multiple video frames that contain a single video stream corresponds to this.

[0038] In this specification, the term "compressed image" refers to a minimum of a basic image that is compressed to realize a responsive image. For example, if the basic image contains the same motion repeatedly, If the compression is done, the repeated motion is removed and only one is left. For example, the basic image may include a motion from a first position to a second position and a motion from the second position to the first position. If both of the above are included, only the basic image moving from the first position to the second position is left in the compressed image, The movement from the second position to the first position can be reproduced by reversing the remaining basic images.

[0039] In this specification, the term "multiple reaction type image generation file" refers to a file that is generated by compressing multiple basic images. It is a video file that can play various actions according to user operations. It can be realized as a multi-reaction image by playing it together with one or more basic images. This refers to metadata that can be used to

[0040] Hereinafter, a method for generating a multiple reaction image according to an embodiment of the present invention will be described with reference to the accompanying drawings.

[0041] FIG. 1 is a flowchart illustrating a method for generating a multi-reaction image according to an embodiment of the present invention. be.

[0042] The computer acquires a basic image (S200). The basic image is generated by a user's operation. It is an original video that includes the movement of the subject that you want to embody in a responsive manner.

[0043] The computer can load the basic image that has already been generated and stored, and link the image frames. Real-time acquisition and generation of basic images (i.e., multiple reaction image generation function is included) After running a program or application, Therefore, you can activate the camera function and immediately take basic images.

[0044] Responsive video creators (e.g., content providers or individual users) can create responsive Shoot footage that includes the act of stealing.

[0045] In one specific embodiment, the computer receives various movements of the same object from the user. After acquiring the image, it can be generated in the form of a multi-reaction image. If it is a hand, the computer will display the user's index fingers in a variety of directions with the fingers spread apart. The camera captures multiple images of the object being twisted and bent.

[0046] For example, as shown in Figure 2, the robot can move its head up, down, left and right in response to a specific command. If you want to create a responsive video that rotates to the right or changes facial expressions, The user captures footage that includes all of the desired facial movements and expressions.

[0047] Furthermore, the water balloons burst or fall from the floor or ground according to the operations input by the user. To create a popping reactive image, the user must drop water balloons of the same color and size. The first video shows a water balloon bursting, and the second video shows the water balloon bouncing up without bursting. .

[0048] Also, after performing a certain move, a different incident occurs, rather than a repetition of the existing move. That is, the computer obtains one basic image. For example, as shown in Figure 3, the computer acquires the image of a water balloon. The first incident involved a downward movement of the water balloon, and the second involved a water balloon bursting after hitting the floor or ground. In addition, for example, a tree branch bending event ( First, footage including the incident of a tree branch breaking (first incident) and the incident of a tree branch breaking (second incident) are acquired as base footage. In addition, the computer was used in the first case where an air-filled balloon was dented by applying pressure to it (Case 1). ) and footage including the balloon bursting incident (second incident) are acquired as base footage.

[0049] Also, as shown in FIG. 4, pasta served in a bowl can be lifted in various directions or at various heights. In order to realize a responsive image that can realize the action of picking up pasta, The robot repeats the same movements, scoops up pasta from a bowl, and moves it to various positions in three-dimensional space. We shoot footage that shows the characters in a variety of different ways.

[0050] Furthermore, the computer obtains an image of the object being deformed by using the operation object, and then The corrected image to be deleted can be stored as the base image.

[0051] The computer generates a compressed image based on the basic image (S400; compressed image generating step). The compressed image is responsive to the user's operation and only captures the movement of the object to be realized. include.

[0052] A detailed description of how the compressed video is generated is provided below.

[0053] In one embodiment, the computer may remove unnecessary image areas during the process of reactively implementing the basic image. For example, to realize an image where the user can react in multiple ways, When shooting a scene, the basic image is a reactive image between the acquisition of the first movement and the acquisition of the second movement. The computer may include frames that are not rendered in a responsive manner. Image segments can be separated and deleted.

[0054] For example, the computer recognizes all the frames in the base image and then selects the target Frames with large differences in the similarity of body movements are automatically separated as deletable frames and then deleted. In addition, for example, the computer can automatically divide the basic video into a plurality of sections and You can select and delete video sections that are not responsively implemented. The computer converts the basic image into units of the target's movement (e.g., turning the head to the right, turning the head to the left, etc.). It is possible to separate video sections by motion (e.g., motion of a target object) and delete video sections between motion units of multiple targets.

[0055] In another embodiment, the basic image includes a plurality of motion images that overlap with each other. If so, the computer can delete the overlapping section. The second basic image and the third basic image are initially arranged at the same finger position, and then the second basic image and the third basic image are arranged at different finger positions. When the motion is in different directions, the computer uses the same image frames. Only one is left. After that, the first and second basic images keep the same movement, and the third basic image When the image is divided and moves, the computer splits the first basic image and the second basic image into Only one frame of the image at that time will be left, and the frame for the third basic image will be left separately. Store in.

[0056] Further, for example, the first basis may be used to realize different results after the same movement is generated in the object. In the case of a video and a second basic video (for example, a balloon is dropped on the floor in multiple videos, and the speed difference (If the result changes after being dropped), only one is left in the section moving along the same path, and as a result Only the sections that correspond to the reaction results of the first basic video and the second basic video can be kept. To this end, the computer compares the first basic image with the second basic image, and The section having motion is separated, and only one overlap section is left. The overlap video section, the first result video, and In addition, for example, if the object is the same in the entire basic image, When moving between sections repeatedly (for example, when turning your head left and right), you are looking straight ahead The first section shows the subject turning left and then returning to the front, and the second section shows the subject turning right from the front. The second section image, which turns around and then returns to the front, is repeated, so the computer removes the portion overlapping with the first interval video and the portion overlapping with the second interval video.

[0057] For example, when moving from a first position to a second position and then returning to the first position, The computer only retains the first section image moving from the first position to the second position, and The second section of the video that returns to the first position can be compressed by deleting it. Since the first section can be output by playing the video in reverse, the computer can output the second section. For example, the intermediate image is deleted and only the first image is left in the compressed image. If a person turns their head to the left and then turns back to the front, the computer will Only the first section image facing left from the front can be retained. To achieve this, the computer Search for areas in the basic image where the movement of the target object goes back and forth along the same path, and change the direction of the movement. frame where the motion begins to change (for example, from a motion in a first direction to a motion in the opposite second direction). The video is divided based on the number of frames that will be included in the first section, and only the first section of video is left.

[0058] In addition, after performing a certain movement, a different event occurs, rather than a repetition of the same movement section. One basic image (e.g., a water balloon bursting after being dropped from the air) can be used to cover multiple cases. It is possible to generate compressed video that is divided and stored.

[0059] Specifically, the step of generating the compressed image may include: In the case where the change in the external shape of the body includes a first event section and a second event section that are different, the first event section is A first playback type in which the second event section is played back continuously after the first event is played back in the forward direction, and Set the second playback type to play the selected section in the forward direction and then in the reverse direction. In the step of receiving the multi-reaction type image generation conditions, specific conditions are received for the same type of user operation. The strength of the reference movement, the length of the reference movement (i.e., the amount of swiping on the touch display) the length of time that the touch can be made to the specified position), the speed of the reference action, or the duration of the reference action (i.e., the number of times a touch can be made to a specific position in succession), Based on the time length during which the first regeneration tap operation is applied, the first regeneration tap operation is divided into a first operation and a second operation. The first and second playback types can be linked together.

[0060] The following is a list of the basic images that can be used by a computer to create responsive images that include multiple events. The method for generating compressed video will now be described in detail.

[0061] The water balloons burst or bounce off the floor or ground according to the operations input by the user. In the case of creating a responsive image, the user creates a first image of a water balloon bursting. After filming only the first video corresponding to one event, the first video is divided into the first incident section and the second incident section. After splitting, the first section is played forward and then played backward. It can be generated as a second playback in which one incident section is played forward and then the first incident section is played. The computer links the first playback and the second playback to different user operations, respectively, and The content can be reproduced in accordance with a user's operation input by the user.

[0062] As an example, as shown in Figure 3, a video of a water balloon being dropped and bursting is used as the base video. When used in this way, the computer obtains a reference point before the water balloon is dropped and popped, and The first and second incident sections are divided around the time point. The computer generates a responsive image. It is also possible to receive reference point input from the user who creates the deep learning training. It is also possible to automatically calculate the reference point by using a learning model in which the The learning model automatically detects the point where deformation of the body contour occurs beyond a certain threshold. This allows the computer to recognize the first user operation (e.g., a specific According to the weak swiping operation that makes the target object, the water balloon, move at a speed lower than the reference speed, Then, play the first incident section where the water balloon falls forward, and then play the first incident section backward. The first playback is a user action (e.g., a water balloon moving at a certain speed exceeding a certain reference speed). The water balloon falls according to the strong swiping action (the first event section in the forward direction) After first playing the first incident section, a second playback can be implemented in which the second incident section is played back continuously.

[0063] In addition, even if the target object is dropped below a certain reference speed, the system responds to the user's swiping operation. Depending on the speed of response, different events can be classified. For example, as described below, After the user's operation is linked to the direction of the water balloon's movement, the computer calculates the strength of the touch operation. This allows you to set the point at which the first incident will start playing backwards. The balloon is dropped. Depending on the speed, the balloon will deform to a different degree after hitting the floor, so the computer The weaker the user operation, the longer the separation criterion for the second event is from the reference point. You can play it back and then start playing it backwards.

[0064] As another example, a tree branch is broken, that is, a video of the branch being pulled, bent, and then broken is shown. When the image is used as the base image, the computer sets the time when the tree branch breaks as the reference time. The reference time is the time when the responsive video is produced. It can be set by input by the user, and the change in the external shape of the object beyond the standard (i.e. It is also possible to automatically calculate and set the time when a change such as a tree branch breaking occurs. The first incident is played back in both forward and reverse order, so that the first In order to generate an image where the movement of the first incident section moves upward from the starting position, The center position of the compressed image is set to the start point of the compressed image. The computer can also set the basic image by the user. After calculating the route, you can set the frame that is the center of the route as the starting point. In addition, the user's operation level (e.g., touch) input by the user in the first event section The camera moves forward from the start according to the length of the swiping motion entered on the touch display. The point at which reverse playback begins after forward playback can be set differently.

[0065] This allows the computer to use one basic image to generate various images according to the user's operations. A compressed image that can realize a responsive image that generates a reaction can be generated. After playing the video frames forward from the start of the incident section, the second incident section after the reference point is The first playback type can be realized by playing the entire section continuously. Also, the first playback type can be realized by playing the entire section continuously from the start of the first incident. Play forward to a specific first stop point, then play backward to the start point Then, playback is performed in the reverse direction from the start point to the initial point of the basic video to the second stop point. In the second playback type, the playback starts again in the forward direction from the start point after the first playback. During the second playback, the computer gradually moves the first and second stop points closer to the start points. By repeating the regeneration process to shorten the difference in the frequency, the vibration amplitude of the branch becomes smaller and stops. This enables the realization of highly realistic, responsive images.

[0066] The second stop time point is set corresponding to the first stop time point. The position of the object on the frame in which the image is captured (hereinafter, the start position) and the position of the object on the first stop point The difference between the start position and the initial position in the initial image is the same or a specific percentage less than the difference. The time point in the image frame where the object moves away from the target position is set as the second stopping time point.

[0067] In the second playback type, the computer also It can be divided into playback types (for example, 2-1 playback type, 2-2 playback type, etc.) In other words, the degree to which the object undergoes vibration motion after being deformed in the forward direction from the reference position is determined by detailed task. It can be divided into types.

[0068] As described later, the computer can store different user preferences for the first and second playback types. Operations can be linked together. For example, a user swiping on an object can be When connecting, the computer can set a specific reference speed or a specific reference length according to the user's request. The swiping operation exceeding the specified speed or length is combined with the first playback type. The downward swiping operation can be linked to a second playback type. The sub-speed or reference length can be divided and sequentially linked with the sub-types of the second playback type.

[0069] As another example, a computer can compress an air-filled balloon and see how it deforms after it is dented. The video of the balloon bursting was used as the base video, and the point just before the balloon burst was used as the reference point. The computer sets the period before the reference time as the first incident period, and the period after the reference time as the second incident period. This will allow the computer to play the second incident section after the first incident section is played. The first playback type plays the two incident sections consecutively, and the second playback type plays the first section forward and backward. Set the second playback type to play. As described below, the computer will A user operation that exceeds the touch strength or the length of time that the touch operation is input. and the first playback type, and a specific pressure-sensitive touch strength or a specific touch operation is input. The second playback type is linked to a user operation having a duration equal to or shorter than the duration specified by the second playback type.

[0070] The method of generating the basic image for generating the responsive image as a compressed image is not limited to this. , a variety of schemes can be applied.

[0071] The computer performs the above-mentioned video frame or video section extraction process on a plurality of basic images. This allows the computer to perform multiple image processing of one object's movements. In the process of producing a multi-reaction video as a basic video of numbers, the number of video frames required can be minimized. Cut.

[0072] The computer also performs frame division for each of a plurality of frames included in a plurality of basic images. The area within the frame is divided, and the area that is stored overlappingly in multiple video frames is The data is processed so as not to be stored.

[0073] For example, multiple basic images (e.g., the first basic image) are images of moving the index finger in different ways. When a multi-reaction image is generated using the basic image, the second basic image, and the third basic image, The data extracts the background image excluding the target object, the finger. The background area is the area that is detected by the movement of the index finger. Since the background region is a common part in multiple images, the computer extracts the background region. The computer then selects the target object from multiple basic images. Only the areas where no finger is present and which are maintained as background are extracted and collected, and can be extracted as background areas. In another example, the computer can detect background information and Based on the surrounding image of the background, a background image is generated that fills the area where the finger is placed. This allows the computer to store the background parts of all frames. This reduces the required capacity.

[0074] The computer also detects a target region (e.g., a user's hand) in a plurality of basic images. By storing them separately, the data volume is reduced. For example, the first basic video and the second basic video are If the image shows only the fingers moving and the back of the hand area remains in the same position, the computer will For one or more specific frames of the first basic image and the second basic image, Only one can be stored, and only the part of the finger that performs the movement can be stored. Then, multiple reaction type images When playing back the video, the computer selects a specific basic video image requested by the user's input operation. In order to reproduce the image, multiple regions (e.g., background region, back of hand region, and It can extract multiple matching finger areas and output the image.

[0075] A computer receives a condition for generating a multi-reactive image for a compressed image (S600). The generation condition of the multiple reaction type image is a plurality of operations corresponding to reactions that can be generated in the compressed image. That is, the computer can process the various object movements that can be realized by the compressed image. A plurality of user operations related to the video segment or frame are matched and acquired.

[0076] One embodiment of the conditions for generating the multi-reaction type image is that the basic image is generated by the user's touch operation. Responsive (i.e., providing video frames in real time that correspond to the user's touch operations) This means that the user can input the An action occurs (for example, the operating object or the target object moves in accordance with the user's touch operation). It can be visually recognized as something that causes a malfunction.

[0077] In addition, the computer acquires and compresses a plurality of basic images for generating a multi-reaction type image. After the process of compressing, the process of linking the user's input operation type to the multi-reaction image is performed. For example, a computer can detect the relationship between an individual user's input operation and a specific section of a compressed video or The image is then linked to one or more image frames. For example, the computer can generate a multi-reactive image. In the process of creating the input operation, the pressure-sensitive touch is adjusted to match the input operation position, the input operation type, etc. In the case of force touch, the strength of the force applied and the angle of pressure should be adjusted accordingly. In the case of a drag operation, the section image or image frame is adjusted to match the moving direction. To connect.

[0078] For example, the computer may detect a right-to-left swipe input from the user. The operation and the section video in which the target face changes from facing forward to facing left The face of the target object is correctly aligned by the user's operation moving from right to left. It can be connected to rotate left from the surface.

[0079] For example, the first basic image is an image of moving the index finger to the left while bending the other fingers. If the second basic image is an image of moving the index finger to the right, the computer The user client acquires an input operation of touching the index finger area and dragging it to the left, Matching with the first section video, the input operation of touching the index finger area and dragging to the right was obtained. The computer then selects various types of basic images according to the format of the basic image. After receiving the input of the input operation, it matches and stores it.

[0080] Further, as an embodiment, the computer detects changes in depth information according to the pressure applied to the input operation. Therefore, the image frames provided may be provided differently. It is designed to provide different image frames depending on the angle at which the computer is pressed. The user can then see the reaction that actually reflects the pressure angle.

[0081] In addition, another embodiment of the condition for generating a multi-reaction type image is that a specific input operation reaches a specific condition. Then, a specific part of the basic video is played (i.e., an action occurs). In addition, as another embodiment, the condition that the duplicated image in the frame is generated by one basic image is This means a condition under which a number of regions react individually or simultaneously to generate a multiple reaction type image.

[0082] The condition for generating a multi-reaction type image is to generate a multi-reaction type image in which the basic image reacts to the user's operation. If this is the condition for realizing the above, multiple reaction types will be implemented in different ways depending on the type of basic image. It is possible to receive input of the generation conditions to be stored in the video generation file.

[0083] As an example, the basic image is a video captured in a general manner (i.e., a video captured by a camera). In the case of a general video in which frames are acquired and stored in chronological order, the computer uses a multi-reaction Receive data that sets a specific playback range or area within a frame to be realized as a video At this time, the computer executes a multiple reaction type image generation file generation program, Condition data can be input from the user.

[0084] Specifically, the computer receives input from a user specifying a particular playback range. In other words, multiple detailed images are stored in one file, and the images are sent according to the user's operation. Therefore, when generating a multiple reaction type image that moves to a desired position, the computer From the user, a specific start frame of the basic image (i.e., the time range produced as a multiple reaction type image) The time range from the first frame of the region to the last frame (i.e., the time range produced as a multi-reaction image) Select the frame up to the last frame of the region, and use this to determine the desired condition for a particular input operation. You can set it to play when a certain number of times has been reached.

[0085] Then, the computer links all or a specific region of the frames in the playback range. The system receives a specific input operation from the user or analyzes the movement of the operating body in the video to determine the operation. Applying input operations that correspond to the body movements. That is, the computer applies input operations that correspond to the body movements within the specified playback range. An input action corresponding to a movement of the object can be received or specified.

[0086] Also, a method for linking the playback range (or section image) of the basic image or compressed image with the input operation. A variety of methods can be applied.

[0087] In one embodiment of the method for linking the playback range with a specific input operation, the computer A virtual ray is applied to the entire area or a specific area of ​​each frame within the playback range. The virtual layer is not visible on the screen but is generated based on user input. This may refer to a layer that is overlaid on the frame, which can receive the ,The conditions for generating a virtual layer on a frame consisting of a certain number of ,detailed cells (i.e. the time range or number of frames for which the virtual layer will be generated, the range over the frames, etc.) When the computer plays back the multiple reaction type video, the multiple reaction type video generation file It is generated by dividing it into a certain number of detail cells based on the generation conditions of the virtual layer contained in A virtual layer is provided on the basic image. The number of detailed cells into which the virtual layer is divided is determined by the number of detailed cells. Determined by the number of video frames to be matched included in the layer generation conditions. For example, the user can specify multiple reaction image generation conditions (i.e., virtual layer generation conditions) Therefore, the multi-reaction type image processing is performed so that n frames are dynamically reproduced (i.e., manipulated and reproduced). When generating an image, a computer can divide a particular area into n detail cells.

[0088] In another embodiment, the basic image stores image frames according to the spatial positions of the object. In the case where the image is a combination of a plurality of image frames, the computer receives a specific A condition setting for matching the frame to each point on the touch screen is received.

[0089] Specifically, the computer generates a reactive image based on multiple image frames in the basic image. In one embodiment, the computer receives input from a user to define a region in which the image is to be created. Receive input from a user to set a responsive region in a particular video frame. The computer extracts a specific image frame from the basic image and provides it on the screen, and the user You can specify the range of the target object. The position of the camera and the target object in the basic image is Since it is fixed, the computer can provide any image frame and then select the area of ​​the object. In another embodiment, the user can set the number of times by touching the screen. The system extracts images of objects that are present in multiple frames of the basic video from the user. In addition, the method receives a command to generate a reactive generation region. According to the method, a computer tracks the movement of a user's operating object (e.g., a hand) and The range including the moving path of the operating object (for example, a hand) is embodied as a reactive generation area. The device receives an instruction to

[0090] The computer then receives a setting of the density at which the touch operation is input from the user. That is, the computer receives the number of frames that match the responsive region. The base image is composed of L (number of time frames) x M (number of event frames) x N (number of depth frames). If the flame density is less than or equal to this, a flame density can be applied to the reactive generation area. This allows the computer to select the density based on the set density when playing back the multi-reaction video. The reactive generation region is divided, and image frames corresponding to the plurality of detailed cells constituting the reactive generation region are generated. The frame is matched to each detailed cell to create a multi-responsive image.

[0091] In another embodiment, a frame corresponding to a user's operation is provided. When the user inputs a specific playback condition, the computer prompts the user to input the playback condition. The playback can be set to continue or move to a specific point when the condition is met. It means to manifest.

[0092] For example, the computer may select a particular input condition, i.e., The input is then processed by pressing the button, dragging or pinching a specific area, or The computer receives input of a playback condition that occurs when the corresponding input condition is reached. The data is used to play a specific playback range (i.e., to move to a specific video frame and play it, The section from the first image frame to the second image frame can be set to play when the input conditions are reached. The computer can also provide a specific link when the content reaches a specific playback range. You can set it to merge or replace all or part of the frame with another image. Cut.

[0093] In another embodiment, the computer provides multiple multi-reaction images on one screen. For example, a connection between two multi-reaction images is created. When forming a connection relationship, the computer determines whether the first multiple reaction type image and the second multiple reaction type image are connected. The final multi-reaction image is formed by combining the multiple reaction images, and the user's operation on a specific multi-reaction image is Not only does the corresponding multiple reaction video generate a reaction (i.e., an action), but also other multiple reactions The first multiple reaction type video also generates actions according to the connection relationship. The second multiple reaction type image is an image for the face image of the user. When the image shows only the skin area of ​​the skin, the computer receives a second multiple response from the user. The input is received by repeating drag operations similar to applying makeup to a molded image. When the user inputs the multiple response type image, the computer plays the first multiple response type image linked with the second multiple response type image. To embody the action of makeup (for example, from a face image without makeup (The video changes from the original image to the image of a face with makeup on.) Depending on the type of operation input to the image, the image is divided into a first multiple reaction type image and a second multiple reaction type image. The types of actions that are generated can vary.

[0094] However, there is no limit to the number of multi-reaction videos that can form a link. A connection relationship can be formed with multiple multi-responsive images. For example, a computer can The screen is divided into 16 parts, and 16 individual multi-reaction images are provided. You can form relationships.

[0095] The computer determines the conditions for generating a multi-reaction image in various ways (e.g., In one embodiment, the computer sets the input conditions and the playback conditions for the multiple reaction type image. The computer receives input of conditional functions directly from the user, which can respond to the image. For example, you can directly input a function code that implements a reaction. When a frame set including a first multiple reaction type image and a second multiple reaction type image is provided to the screen (i.e., When the images are combined, the computer receives two inputs of multiple response image functions from the user. Receive.

[0096] In another embodiment, the computer includes a program for implementing a multi-reaction image generating file. Using the system, the multiple reaction type image generation conditions input by the user are directly input to the basic image. The computer generates a multi-reaction image by It runs the image realization program and can load specific basic images according to user operations. After that, the computer receives the generation conditions (i.e., input) to be embodied as a multi-reaction image from the user. and receives operations that correspond to the input conditions, playback conditions, etc., and The generation application generates a function that embodies the corresponding generation conditions.

[0097] As described below, a multi-reaction type image generation file that is played together with one or more basic images is If there is another file, the computer uses the generation conditions input by the user to generate a file. The image is stored in a file that generates multiple reactions through the current program. For example, stores the multi-reaction type image realization function code corresponding to the generation conditions as a separate file. The computer receives operations on the basic image (e.g., touch operations, mouse operations, etc.) ,and the corresponding conditions (e.g., action type, the playback range in which the action is entered, The action to be taken when the condition is reached can be recorded on the multi-reaction image generation file. do.

[0098] In another embodiment, the multi-reaction type image generation condition is that a specific input operation reaches a specific condition. When this is reached, a specific action (e.g., a specific part of the footage included in the basic footage) is played back. If the condition is generated, the computer receives a specific input operation type from the user, The type of action that occurs when the action is reached (for example, the playback point that is moved within the basic video), The condition value to be set is received.

[0099] In another embodiment, the multi-reaction type image generation condition is framed by one basic image. In the case where multiple regions in the In this case, the computer asks the user to set a playback range for splitting or cropping, The user is asked to set the area to be divided or cropped within the range. Then, the computer The user inputs video information to be played back individually in the areas to be divided or cropped. Example For example, if the basic image is an image of water being poured into two cups placed on the left and right, The frame is separated based on the dividing line where the cups are separated, and both are embodied independently and responsively. This allows a variety of multi-reaction type images to be produced using a single basic image. Since it is possible to realize the above, the capacity of the multi-reaction type image can be reduced, and It is also easy to shoot basic footage.

[0100] A computer applies the generation conditions to the compressed image to generate a multi-reaction image (S 800). The computer applies the multiple reaction type image generation conditions and generates multiple reaction type image data. and store it.

[0101] In one embodiment, the computer performs compression of a plurality of elementary images and input manipulation for each elementary image. The final multi-reaction video file is generated based on the results of the work. The data merges multiple compressed regions according to the user's input operation, and creates a multi-reaction image. A file is constructed with the format in which a particular action can be reproduced in the image.

[0102] In another embodiment, the user may directly input the multi-reaction image generation conditions in the form of a function. When subjected to a force, the computer generates a multi-reaction image that is used in conjunction with one or more basic images. The input function is stored in the image generation file as is. Using a production program (or generation program) for reactive video generation files, When a specific input operation is directly received in the basic image, the computer executes That is, the computer generates and stores a function that calculates the basic image based on the input by the user. From the input multiple reaction type image generation conditions, the frame, the range within the corresponding frame, the reaction (i.e., Data such as the action type can be extracted and stored in the form of a function.

[0103] In this way, the user can download the multi-reaction type image generation file in which the multi-reaction type image generation conditions are stored. By using the icon, a specific image can be easily realized as a multi-reaction image. If you want to play the basic video itself, you can play it without the multi-reaction video generation file. If you want to create a multi-reaction video, you can create a basic video file and a multi-reaction video file. By playing the composed files together, a multi-reaction video can be played.

[0104] In addition, the computer stores the stack structure based on the relationship between the sections of the compressed image. For example, the computer may generate a frame or Multiple regions can be constructed in a stack structure. That is, the computer A number of regions are generated for video compression within the frame range (i.e., two-dimensional range) of the video. are stacked into one or more stacks to generate a multi-reactive video file.

[0105] Specifically, when a user inputs an operation, the computer detects that a specific extraction region is The set of positions to be provided is set to the display range of the corresponding extracted area. For example, the background area is ,Because ,the ,input ,operation ,must ,be ,displayed ,at ,all ,locations ,provided, ,the ,computer , The entire frame is set as the display range of the background area. Then the computer uses pressure sensing at each position. Changes in the intensity or duration of the touch can be stored in a stack.

[0106] In addition, when implementing multiple actions at different positions in one multi-reaction image, The data creates a stack for each action implemented at multiple locations. However, while playing multiple reaction images, you can input various operations at once to realize various actions. In this case, the computer extracts an extraction region from the stack to which each input operation is applied. By merging, it is possible to output an image that reflects movements resulting from multiple input operations at once.

[0107] For example, it contains both the first action of opening the mouth and the second action of moving food to the mouth. In the case of a multiple reaction type image, the first input operation for the user to open the mouth (e.g., the position of the upper and lower lips) with two fingers and then open the mouth), and touch and drag food towards your mouth. If a second action is input at the same time, the computer will start the action of opening the mouth. The first extracted region was merged and the operation of moving the food was input at the same time. The second extracted region extracted from the stack of positions is merged to generate the output image.

[0108] This allows the computer to generate different outputs depending on the degree of input of the first input operation and the second operation. For example, if only the first input operation is input, the computer will open its mouth. When only the second input operation is input, the output image is changed to one that moves the food toward the mouth. When the first and second input operations are input simultaneously, the mouth is opened and the food is put into the mouth. The computer also provides an output image of the first input operation and the second input operation. It is also possible to provide different output images depending on the applied pattern.

[0109] As shown in FIG. 5, each extraction region (first extraction region and second extraction region) is different. For example, the first stack, represented by a solid line, and a second stack represented by a dashed line in each extraction region. Based on the position where the user inputs the first operation into each extraction area, the first stack and the second stack are The stack may be embodied as determining which stack is executed in the block.

[0110] Furthermore, as shown in Figure 5, the first and second events in each extraction region contain overlapping pixels. The computer can then create a stack for the first event and a stack for the second event. Only one of the overlapping pixels can be left. Even if the region contains only one piece of data for overlapping pixels, the next operation by the user (e.g. For example, the first event and the second event are determined according to the change in the direction of the touch operation movement or the change in the applied pressure. The stack of either one of the two events can be determined. This allows the computer to Compressed video can be generated using only a minimal amount of data.

[0111] A method for a user to use a multiple reaction image will now be described.

[0112] According to an embodiment of the present invention, a method for playing and using a multi-reaction video is provided. A step of loading a multi-reaction type image and receiving a user's operation on the multi-reaction type image. and a step of calculating and outputting a reaction to the user's operation (a reaction output step). nothing.

[0113] In the reaction output step, a computer (i.e., a client device for playing back a multi-reaction type image) The touch screen is a place where you can see the direction, speed, and angle of the touch input. , input time length, pressure intensity, etc. are calculated.

[0114] For example, when a user who plays the multiple reaction type video (hereinafter, a second user) plays the multiple reaction type video, When applying pressure vertically to the screen of the client (hereafter referred to as the second client), Different cells of different details can be selected when applying pressure diagonally. When you press it in the direction, it goes in vertically, and when you press it diagonally, it goes in diagonally. ,In reactive video, even when a second user applies pressure to the same ,point, to provide a sense of realism. It is necessary to reproduce different image frames depending on how the button is pressed, to embody different movements of the target object. There is.

[0115] For this reason, the second client can distinguish the pressurization method in various ways. For example, The client may then determine the cross-sectional shape of the finger contact on the screen (e.g., the number of pixels touched by the finger and The pressure application method can be determined based on the pixel distribution.

[0116] In addition, for example, the second client can determine the pressure method based on the pressure distribution on the screen. That is, the second client can be entirely added to the range where the touch operation is input. Depending on whether the pressure applied is uniform or varies from part to part, The type of pressure being applied to the screen can be determined by the user.

[0117] Furthermore, for example, when the second client presses the screen with an operating object (for example, a finger), It can measure the minute movements of your finger on the screen and determine the direction of pressure.

[0118] If the second client determines that the pressure method is to press the object obliquely, The information is changed to change the direction of the pressure, and the position of the two-dimensional space is changed. Specifically, when the screen is pressed diagonally, the second client 2. After providing a video frame of the point where the user's finger touches the screen, the pressure applied to the screen is high. Indeed, the system extracts and provides detailed cells that correspond to the extension direction of the finger tilt.

[0119] In another embodiment of the present invention, when a request for playing a basic video is received, the computer and loading the multi-reaction image generating file together with the multi-reaction image generating file, and implementing the multi-reaction image. For example, the computer may store multiple reaction type images in a folder in which the basic images are stored. Image generation files are included together, or the corresponding multi-reaction image generation files are included in the database. If the files are matched, the multi-reaction image generation file will be displayed when the basic image is played. They can be played together to create a multi-reaction video.

[0120] Furthermore, another embodiment of the present invention is a computer that receives input from a user for a multiple reaction type image. The data includes the number of operations that can be performed, the range of operations within the frame, and the strength of pressure applied within the frame. For example, the computer may further include a step of acquiring multiple reaction image generation file data. The details of the input operations input to the multi-reaction type video are recorded. Companies that use video for marketing purposes are focusing on marketing to the subjects in the multi-reaction video. The effect of ting can be confirmed.

[0121] In another embodiment, a user may input an input operation while using a multiple reaction image. In this case, the computer stores the input operation pattern provided by the user from a specific multiple reaction image. Furthermore, the computer stores the output image data and the input operation pattern in a single file. This allows the computer to perform deep learning. By inputting each user's input operation and output image data, the user's tendency can be understood. For example, it is possible to determine which object in a multi-reaction image the user inputs the most input operations to. Depending on the input pattern, the input operation can be used to You can gauge the level of interest.

[0122] Specifically, the system understands user behavior based on the user's input operations input into the multi-reaction video. A specific example of an interaction data analysis method for this purpose will be described below. For example, in content related to cats, the computer "uses the agent to move slowly" "Repeatedly drawing a trajectory while applying weak force" and "fast, strong force with a short time lag" The difference between "repeatedly touching the object" and "reacting to the object" is whether the user is touching the object with affection or not. This allows us to distinguish whether the user is touching the screen with a sense of discomfort or negative emotion. In addition, the system can be used to create user operation patterns that reflect the characteristics of each user. It can be hyper-personalized by providing turn-taking so that the computer can learn from the user's operational patterns. (i.e., interaction data) is converted into user-distinguishing identification data (e.g., operation pattern instructions) It can also be used as a gesture action that reflects the user's emotions. It can also be used as a message reply.

[0123] In another embodiment, the computer generates responsive video content in response to a user request. The method may further include providing an interactive image in the image data. It receives information about the relevant sections from the metadata and converts them into multi-reaction images. The data is the form of user operation input to the multiple reaction type video data (for example, The computer can output different responses depending on the angle at which the object is struck. Multiple trajectories of agents interacting with the content (e.g., user manipulation patterns, types, etc.) Analyze and predict in real time to understand the meaning of the action and respond accordingly The computer can match events and output them according to the form of the reaction. The mapping data can be rearranged in real time according to the input.

[0124] The method for generating a multi-reaction image generation file according to an embodiment of the present invention is A program (or application) that is executed in conjunction with a computer that is hardware. The information may be embodied in a program (such as a program application) and stored on a medium.

[0125] The above-mentioned program is implemented by the computer by reading the program. In order to execute the method, the processor (CPU) of the computer C, C++, JAVA, read through computer device interface, It can contain code coded in a computer language such as machine code. Such code may include associated functions that define the functionality required to perform the method. The functional code may include a function that is The execution procedure related constraints necessary for the processor of the computer to execute the specified procedure Such code may include control code for implementing the functions on the computer. additional information or media necessary for the processor to execute the program internal to said computer or memory reference related commands for which location (address) in external memory should be referenced Further, the processor of the computer may further include a program for executing the functions. In order to do so, communication with any other remote computer or server is required. If necessary, the code can be used to communicate with any other computer at a remote location using the computer's communication module. How to communicate with other computers and servers, and what information or media to use during communication. The communication code may further include communication related code for whether media should be sent or received, etc.

[0126] The storage medium is a register, a cache, a memory, etc. It is not a medium for storing data, but a medium for storing data semi-permanently and reading it by equipment. g) A medium capable of storing data. Specifically, examples of the medium on which data is stored include ROM, AM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. However, the present invention is not limited to this. That is, the program may be used to communicate with various servers to which the computer can be connected. The various recording media on the server or the various recording media on the user's computer The medium may be distributed among computer systems connected by a network. A computer readable code may be stored in a distributed manner.

[0127] First, the multi-reaction video generation file can be created by combining general videos or multiple video frames. By playing them together, a variety of actions (i.e., reactions) can be applied.

[0128] Secondly, by setting specific conditions for the image using the multi-reaction image generation file, Unlike existing media that is simply limited by the time axis, Therefore, a multi-reaction image with various different outputs applied can be provided to the user.

[0129] Third, you can apply video splitting or cropping to the video frames to get the best possible results. The effect is that it allows you to embody a variety of actions based on the video.

[0130] Fourth, the operation details of a specific user on a video by using a multi-reaction video generation file By recording the user's reactions to the video, it is possible to understand the user's reactions to the video. For example, The number of touch operations on the screen, the frames on which the touch operations were performed, and the objects in the frames You can understand how.

[0131] The embodiments of the present invention have been described above with reference to the accompanying drawings. A person skilled in the art would understand that the present invention can be applied to other products without changing the technical idea or essential features of the present invention. It will be understood that the present invention can be embodied in specific forms. The examples should be considered in all respects as illustrative and not restrictive.

Claims

1. A touch screen that displays responsive images; a processor for controlling a display operation of the responsive image; The responsive image includes a first image including a first pose of a target object and a second image changing from the first pose to a second pose, The first image is displayed first when the responsive image is displayed, The second image is mapped to a touch gesture having a specific pattern; When the touch gesture is received on the touch screen on which the first image is displayed, the processor controls the first image to be switched to the second image and displayed; The processor, Obtaining a first image including the object by photographing; generating the second image including only a movement of the object to be implemented in response to a touch gesture of a user based on the first image; When the touch gesture is received, the received touch gesture is mapped onto the second image to generate the responsive image. The processor, Dividing the first image into a first section and a second section around a specific reference time point; A center position of a motion path of the object in the first section is set to a start point of the second image; An electronic device that generates the second image such that the object changes to the second pose based on the starting time.

2. 2. The electronic device of claim 1, wherein the change from the first pose to the second pose includes at least one of a change in head rotation of the subject and a change in facial expression.

3. the touch gesture includes a drag touch gesture; the processor controls a switching from the first image to the second image based on a first attribute of the drag touch gesture; The electronic device of claim 1 , wherein the first attribute includes at least one of a drag direction, a drag speed, and a touch-hold time.

4. 4. The electronic device of claim 3, wherein the processor switches the second image to the first image when a second attribute of the drag touch gesture opposite to the first attribute is received while the second image is displayed.

5. The electronic device of claim 1 , wherein the first pose comprises a pose in which the subject is facing forward.

6. The processor, The electronic device of claim 1 , further comprising: deleting at least one frame that is not responsively implemented in the first image by dividing an image section or recognizing a similarity between image frames.

7. The processor, The electronic device according to claim 1 , further comprising a setting for playing back a specific section of the second image in a specific playback mode when a specific reaction type generation condition is achieved by a user operation.

8. The electronic device of claim 1 , wherein the reference time point comprises a time point in the first image at which a pose of the object is greater than a reference value.

9. A responsive image display control method performed by an electronic device, comprising: displaying, by a processor of the electronic device, a responsive image on a touch screen; and controlling, by the processor, a display operation of the responsive image; The responsive image includes a first image showing an initial first pose of a target object and a second image showing a change from the first pose to a second pose, The first image is displayed first when the responsive image is displayed, The second image is mapped to a touch gesture having a specific pattern; When the touch gesture is received on the touch screen on which the first image is displayed, the processor controls the first image to be switched to the second image and displayed; The processor, Obtaining a first image including the object by photographing; generating the second image including only a movement of the object to be implemented in response to a touch gesture of a user based on the first image; When the touch gesture is received, the received touch gesture is mapped onto the second image to generate the responsive image. The processor, Dividing the first image into a first section and a second section around a specific reference time point; A center position of a motion path of the object in the first section is set to a start point of the second image; generating the second image such that the object changes to the second pose based on the starting time point.

10. 10. The method of claim 9, wherein the change from the first pose to the second pose includes at least one of a change in head rotation and a change in facial expression of the subject.

11. the touch gesture includes a drag touch gesture; the processor controls a switching from the first image to the second image based on a first attribute of the drag touch gesture; The method of claim 9 , wherein the first attribute includes at least one of a drag direction, a drag speed, and a touch-hold time.

12. 12. The method of claim 11, wherein the processor switches the second image to the first image when a second attribute of the drag touch gesture opposite to the first attribute is received while the second image is displayed.

13. 10. The method of claim 9, wherein the first pose comprises a front facing pose of the subject.

14. The processor, The method of claim 9, further comprising deleting at least one frame that is not responsively implemented in the first image by dividing an image section or recognizing a similarity of image frames.

15. The processor, The method according to claim 9 , further comprising setting a specific section image of the second image to be played in a specific playback manner when a specific reactive generation condition is achieved by a user's operation.

16. The method of claim 9 , wherein the reference time point comprises a time point in the first image at which a pose of the object is greater than a reference value.

Images