Electronic device and method for reproducing responsive images based on the intention and emotion of input operations for the responsive images

Abstract

The present disclosure relates to an electronic device and a method for reproducing a responsive image based on the intention and emotion of an input operation for the responsive image. The electronic device according to the present disclosure includes a touch screen that displays the responsive image, and a processor that controls the reproducing operation of the responsive image, wherein the processor receives an input operation for one screen of the responsive image via the touch screen, identifies at least one of the intention and emotion of the input operation based on at least one of the characteristics, speed, and pressure of the input operation, and identifies a responsive image based on at least one of the intention and emotion of the input operation.

Description

[Technical Field]

[0001] The present disclosure relates to reactive picture More specifically, the present disclosure relates to an electronic device and method for regenerating reactive picture Responsive based on the intention and emotion of the input operation picture The present invention relates to an electronic device and method for reproducing the same. [Background technology]

[0002] Recently, videography technology has advanced dramatically. Camcorder High-resolution images can now be captured not only by digital cameras but also by mobile devices such as smartphones. 360-degree cameras and 3D video cameras are also becoming available.

[0003] Video is captured by a video capture device, saved in a specific format, and played back by a playback-enabled terminal. picture Playback is a way to connect with viewers. Interaction In other words, viewers can only experience visual sensations through the images being played. Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure relates to reactive picture Reactive type that identifies the intention and / or emotion of the user's input operation and performs various condition playback based on that. picture The present invention aims to provide an electronic device for playing back the above-mentioned music.

[0005] The problem that the present disclosure aims to solve is: before The present invention is not limited to the above problems, and other problems not mentioned will become apparent to those skilled in the art from the following description. Clearly It can be understood. [Means for solving the problem]

[0006] In order to achieve the above technical objectives, the present disclosure Person in charge The electronic devices are reactive picture a touch screen that displays the The aforementioned Reactive picture a processor for controlling the playback operation of The aforementioned The processor The aforementioned Touch screen General do The aforementioned Reactive picture receiving input operations for one screen of The aforementioned At least one of the characteristics, speed, and pressure of the input operation one At least one of the intention and emotion of the input operation is determined based on the one and identifying the intention and emotion of the input operation. home at least one Based on one The aforementioned Reactive picture Identify playback type and playing the responsive video based on the identified playback type. .

[0007] In addition, a reactive type electronic device according to the present disclosure for achieving the above technical object is provided. picture Responsive based on the intention and emotion of the input operation picture How to play The aforementioned Responsive on the touchscreen of an electronic device picture Display and Reactive picture When an input operation for one screen is received, The aforementioned Input characteristics, speed, and pressure home at least one Based on one The aforementioned At least the intention and emotion of the input operation one Identify one and Intentional emotion of input operation home at least one Based on the reaction type picture Identify the playback type of and Based on the identified playback type The aforementioned Reactive picture Play The steps may include:

[0008] In addition to this, This disclosure How to Realize ItA computer-readable recording medium having a computer program for executing the above may further be provided. [Effects of the Invention]

[0009] According to the above-described means for solving the problems of the present disclosure, a reactive type of playback based on the intention and emotion of the input operation is provided. picture Interactive by playing (interactive) Na side This can improve the user experience.

[0010] The effects of the present disclosure are as described above. mentioned Effects not limited to, other effects not mentioned include: description from Regular technician to Clearly understood obtain . [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing the configuration of an electronic device for identifying the intention or emotion of a user input according to the present disclosure. [Figure 2] FIG. 2 is a flowchart illustrating the operation of an electronic device that plays back a responsive image based on the intention or emotion of an input operation according to the present disclosure. [Figure 3] FIG. 3 shows a screen shot of a responsive video according to the present disclosure. [Figure 4A] FIG. 4A illustrates a method for measuring the speed of an input operation according to the present disclosure. [Figure 4B] FIG. 4B illustrates a method for indicating emotions of input operations according to the present disclosure. [Figure 5A] FIG. 5A illustrates a method for measuring the pressure of an input operation according to the present disclosure. [Figure 5B] FIG. 5B illustrates a method for measuring the pressure of an input operation according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] This disclosure The whole of Throughout, Same The reference number is Same This disclosure refers to a component. example It is not intended to describe all elements of the present disclosure, but rather to provide a general description or implementation in the technical field to which the present disclosure pertains. example The terms "part, module, component, block" used in this specification refer to software or hardware. embodiment can be carried out example Depending on the situation, multiple "parts, modules, components, blocks" One As two components It is embodied in one It is also possible for one "part, module, member, or block" to include multiple components.

[0013] Also When a part is said to "comprise" certain elements, this means that it may further include other elements, rather than excluding other elements, unless specifically stated to the contrary.

[0014] The singular expression includes the plural expression unless the context clearly indicates otherwise. The identification symbols in each step are used for the convenience of explanation, and the identification symbols do not describe the order of each step, and each step may be performed in a different order from that specified unless the context clearly indicates a specific order.

[0015] The principles and implementation of the present disclosure will be described with reference to the accompanying drawings. Example form Before describing the state, some terminology will be explained as follows.

[0016] The content may include various visually provided content, such as video, still images, holograms, etc., and may also include various audio, gustatory, olfactory, etc., but examples are not limited thereto. Furthermore, the content may be provided in virtual reality (VR), but the implementation example is limited to this It is not something .

[0017] Objects included in the content (target body ) may be included in part of the content or may include the entire content, for example, if the content is a video, various images located within all or some frames of the video. objects It can also mean the video itself. too can.

[0018] Responsive content is a type of content that responds to the objects it contains. reaction, feedback When a command (which can be called an input operation, and is a reserved command including, for example, a touch operation, a sound command, a motion command, etc.) that triggers an action (such as an action) is input, various contents related to the corresponding object can be included. Related Responsive content is responsive picture This disclosure will be explained assuming that Related Types of responsive content picture It is not limited to being.

[0019] Here, the reaction is command (Input operation) depending on the object movement, object shape / shape The examples may include, but are not limited to, a change in the content, the occurrence of a specific event, and / or the occurrence of a change in the content.

[0020] Reactive picture is the user's (i.e., viewer's) command (e.g. touch operation) Appropriate For example, responsive video is a video that is played in a way that responds to the user's actions. picture When a user touches a specific object (e.g., a pillow) on the touch screen, the object of It can also mean an image that is played back in response to touching. picture is the user ByWhen a user operation in the form of pressing a specific object is applied to the touch screen, the object is pressed and then restored after the user operation is reproduced. picture can mean:

[0021] "Triggering a reaction" to an object included in the content command " (input operation) is a reactive picture This may include user interaction with content received through computer input means that provide The aforementioned User operations are performed using input means such as a mouse or touch screen. General and specific in the content earth Operations that can be input to a point or area (e.g., click operation, drag operation, touch operation for a specific period of time, Force Touch The touch operation may include, for example, applying a specific pressure to a touch screen or touch pad. The user The operation may include the position or movement of the terminal itself, which can be acquired using a sensor (for example, an acceleration sensor, a gyro sensor, etc.) provided in the computer (or terminal) as an input means. reaction for triggering command This can be done by detecting the movement of the device worn or by operating the device such as a joystick. example is limited to this It is not something that is done do not have.

[0022] In the following, reactive picture How to generate explanation Reactive picture The following description will be given on the assumption that the generation of is performed by a processor of a device (a computer, for example).

[0023] The processor 1410 one More than 100 originals picture to trigger reactions of objects contained in command can be determined, where Original footage teeth Basic Video and Say it , Original footage teeth Reactive realization For example, Original footage It may be a photographed content, and the positional frames of the object in space keep The frame combination may include multiple frames. Original footage is collected through communication death The content may be a moving image, a three-dimensional image, or a VR image, but the embodiment is not limited thereto. It is something that do not have.

[0024] The processor 1410 Original footage It can receive input specifying the frame interval of Ruga , the frame interval is Original footage of whole React in the frame Realized in mold It can include a specific section that is used for various purposes. Through The frame interval can be set. In , the processor 1410 receives from the user Original footage The start frame of the (i.e., reactive) picture in production the first frame in the time domain to be processed) to the final frame (i.e., reactive picture in production (the last frame in the time domain) can be In the embodiment, the user may of designation You can also receive .

[0025] Processor 1410 is reactive picture to Concatenation and to trigger the object's reaction. command can be received directly from the user. For example, the processor 1410 is a device equipped with a touch screen, and receives a specific input operation from the user. will be Provide a process and Oiteta objects moving on the touch screen depending on specific commandcan be received.

[0026] Also , the processor 1410 is a reactive picture to Concatenation will be command Type from user of Make a choice Well received , The command in question Instead of type Riel It can receive operations, e.g., responsive on devices with touchscreens. picture When using a computer (including a VR device) that does not have a touch screen while generating the image, the computer receives mouse operations instead of touch operations on the touch screen, i.e., a responsive picture can be generated.

[0027] To trigger an object's reaction command is the frame interval Inside Matches the movement of the objects contained in or Corresponding to the movement of the object can To trigger an object's reaction command The position or area where the value is set to be input is an area corresponding to the movement of the object within the frame included in the frame interval. Applicable possible.

[0028] The processor 1410 processes the object and the object of To trigger a reaction command To concatenate the Original footage Within the specified frame interval Each frame It is possible to apply a method of generating a virtual layer to the entire area or a specific area. The virtual layer can receive user input without being visually represented on the screen. Original footage It can refer to a layer that overlays the frame that constitutes it.

[0029] The processor 1410 reactionThe command to trigger the Move Route) Move Operation (e.g., mouse operation) Through Mouse cursor of move ,or First on the touch screen point From the second point If the drag operation is Quantity details Consists of cells Virtual Layer can be generated on the frame.

[0030] Also The processor 1410 generates a plurality of details Consists of cells Virtual Layer The processor 1410 generates a Number of frames Calculate the value of the frame interval. Number of frames of Number of detail cells can be applied as, Each detail cell within the frame interval Each frame can be matched in order.

[0031] For example, if the processor 1410 is to generate content such that n frames are variably played (i.e., manipulated) according to commands to trigger a reaction of an object, the processor 1410 may assign a particular region to n frames. details It can be divided into cells.

[0032] Then, the processor 1410 Each detail In the cell Match each frame ,identification Details When a cell is selected or specified Matched Frame so that That is, it is possible to detect an object (e.g., a hand) in a specific direction. Move In the path of the object Virtual layers accordingly is generated, the processor 1410 determines the first time that the object starts to move. Location details Within the frame interval, starting from the cell Each frame to matching It is possible.

[0033] Also , the processor 1410 Virtual Layer Multiple details Cells are different Size Or it can be generated at intervals. In the original video The object is Move If the speed changes, the virtual layer Size of details Dividing into cells allows you to control the position and orientation of objects on the frame. details Therefore, the processor 1410 adjusts the cell position to match the object's movement. details Cell Size Or the interval can be changed. In other words, the speed can be changed at the same time interval when playing video content. Move Gets the object's frame, so it's fast Move In the slow interval, the interval between object positions in successive frames is large, and in the slow interval, the interval between object positions in successive frames is small. Like this Multiple objects can be placed in the frame to match the object spacing. details Generate Cell If , the input operation that the user inputs (object reaction for triggering command ) and the object position in the frame. matching It can be done.

[0034] Also , the processor 1410 Virtual Layer The length of the In the examples , the processor 1410 calculates the pixel value of each object (or a specific pixel value of an object) in the frame interval. specific point ) and the object is Move The processor 1410 can recognize the path. The relevant The length including the path Virtual Layer Further, the processor 1410 may form Virtual Layers and Details The morphology of the cells can be determined.

[0035] Reactive picture has been photographed in advance keep The content may be Original footage to Addition For example, the reactive video can include moving images, still images, holograms, etc., and the additional content can be original When playing the video, original Turn your video into a responsive video make It is possible.

[0036] Also ,Reactive video is multi-reactive picture May contain It is possible The multi-responsive video responds to specific input operations by the user (i.e., the viewer) watching the content. Appropriate The content is change It can also mean that a film is being shot or played back. Original footage The user's input operations corresponding to the specific movements of the In the video The object In motion It is played like this picture can mean:

[0037] In the examples ,compression picture is the foundation picture as a reactive video embodiment In order to of Compressed by movement picture For example, the basic picture If the same movement is repeated, the compression picture teeth Repeated Remove Movement And one Only the foundation remains. picture If the movement includes both movement from the first position to the second position and movement from the second position to the first position, then compression picture moves from the first position to the second position. motion <Basics picture Only the base is left, and the movement from the second position to the first position is left picture can be played backwards.

[0038] Also ,Multiple reaction type image generation file is multiple basis picture is compressed and generated, and responds to user operations. Various It is a content file that can play an action, or one The above basics Movie It means metadata that can be embodied in a multi-responsive video by being played back together with the video. In the examples , the processor 1410 compresses even if overlapping is allowed. picture Reactive without generating picture can be generated.

[0039] In the examples , the processor 1410 compresses picture without using or removing repeated movements all Use it as is and get the basics picture (Basic picture is reactive picture (possibly reactive) picture can be generated or output.

[0040] In the following, in this disclosure Related Multiple reaction type picture Explains how to generate and picture Assume that:

[0041] Processor 1410 is the foundation picture You can acquire the basics. picture is based on the user's operation. responded Reactive Trying to embody Includes object movement Original footage It can be reactive. Video creator (e.g., content providers or individual users) A video containing a reactive action to be realized You can take a photo of it.

[0042] In the examples , the processor 1410 may process various movements of the same object from the user. Video for After obtaining the multiple reaction type picture of formFor example, if the object is a user's hand, the control module 1500 (190) can generate the following with the user's index finger extended: Various In the direction Move it or Bending Multiple picture can be obtained.

[0043] Also, reactions according to specific operations as Reactive type that allows the user to rotate their head up and down, left and right, and change their facial expression picture Produced to try In this case, the user can capture footage that includes both the desired head movements and facial expressions.

[0044] In addition, water balloons are created according to the user's input. Breaking , from the floor Jump up Kuru reaction type picture To create a video, a user can sequentially shoot a first video of a water balloon of the same color and size being dropped and bursting, and a second video of the water balloon bouncing up without bursting.

[0045] Also, after performing a specific movement, repeating an existing movement do not have Different events occur one The basics picture That is, the processor 1410 can obtain the event information when multiple events occur for an object. picture Based on picture It can be obtained as.

[0046] The processor 1410 performs compression based on the base image. picture Compression can be generated. picture is responsive and responds to user actions. Responsive Realization It may also include only the movement of the object being considered. In the examples ,compression picture Instead of duplicates Forgiveness Also applies May be .

[0047] The processor 1410 Regarding the video Multiple reaction type picture A creation condition can be received. The aforementioned Multiple reaction type picture The generation conditions are The aforementioned compression picture The inputs may be multiple operation inputs corresponding to reactions that can be generated.

[0048] The processor 1410 compresses picture It is possible to generate a stack structure of It is possible ,for each extracted region (e.g., No. 1 extraction area and second An extraction region can contain multiple stacks for different events. For example, No. 1 The stack and the dotted line represent 2 stacks The processor 1410 may include the following in each extraction region based on the position where the first operation is input from the user to each extraction region: First Stack and In the second stack Determine the stack that runs on Realized by It is possible.

[0049] Also , in each extracted region First event and Second event teeth Overlapping pixels The processor 1410 may include: For the first event Stack and Overlapping pixels in the stack for the second event Of one Only the compressed image can be left. picture is the overlap in a specific extraction region One piece of data for a pixel Even if only the first event and the second event are included, the first event and the second event may be determined depending on the user's next operation (for example, a change in the direction of the touch operation or the applied pressure). One of them This allows the computer to determine the minimum amount of data only Compressed with picture can be generated.

[0050] In the following, One Example Reactive type picture This section explains the user interface for generating the responsive type. picture is the above multiplex type Reactive Video andMultidimensional Reaction Type picture may include:

[0051] FIG. 1 is a block diagram of a device according to the present disclosure. Related Electronics for identifying the intent or sentiment of user input Device 1 is a block diagram showing the configuration of the electronic device. The electronic device can be understood as an example of a computer in this specification.

[0052] one In the examples The electronic device 1400 includes a processor 1410, a memory 1420, a user input 1430, and at least one Sensor 1440, and display section 1450. The components shown in FIG. Related Electronic device 1400 In realizing Although not required, the electronic device 1400 described herein may include more than the components listed above. mosquito, Or it may have fewer components.

[0053] one In the examples The processor 1410 executes an algorithm or a program that reproduces an algorithm for controlling the operation of the components in the device. against Data keep memory, and To memory keep The data use do As mentioned above At least perform the operation one On the processor embodiment In this case, the memory and the processor are each on separate chips. embodiment Alternatively, the memory and processor can be on a single chip. embodiment This may be done.

[0054] Also , the processor 1410 may be configured to perform the functions described in the present disclosure below. Related Various Example on this device embodiment To do this, we use the components we saw above. one Alternatively, a combination of multiple controls can be used.

[0055] one In the examples The memory 1420 stores data supporting the various functions of the device and programs for the operation of the processor 1410. keep can be, Input / Output Data to be stored (e.g., music files, still image , videos, etc.) Can be saved , a plurality of devices driven by this device application program or application (application) ), the operation of this device Data for command name of This can be saved. Like Among the application programs At least in part, wireless communication Through It can be downloaded from an external server.

[0056] Such memory 1420 may be of the flash memory type ( flash memory type ), hard disk type ( hard disk type ), SSD type (Solid State Disk type), SDD type (Silicon Disk Drive type), Multimedia Card Micro type ( Multimedia card micro type e), card-type memory (e.g. SD or XD memory, etc.) ,RAM (random access memory; RAM), SRAM (static random access memory), ROM (read-only memory; ROM), EEPROM (electrically erasable programmable read-only memory), PROM (programmable read-only memory ), magnetic memory, magnetic disk, and Optical disc home at least One The memory 1420 may also be a database separate from the device but connected via wire or wirelessly.

[0057] one In the examples , the memory 1420 stores the machine learning model 1425 It can include. Machine learning model 1425 is a deep nerve membrane Neural Networks (Deep Neural Network) Deep learning based on (Deep Learning) For example, the machine learning model 1425 may be a convolutional neural network. (Convolution Neural Network, CNN) It may be based on a formula.

[0058] one In the examples The user input unit 1430 is for inputting information from the user. Through Once the information is entered, the processor 1410 can control the operation of the device in accordance with the entered information. this Such a user input unit 1430 may be implemented by a hardware physical key (for example, a key on the front or rear of the device). and Side home at least one Buttons and dome switches located on (dome switch) , jog wheel, jog switch, etc.) and The touch keys may include software touch keys. Software Processing Through Touch screen type Display section Virtual keys displayed in (virtual key) , softkey (soft key) ,or visual key or touch keys located on a part other than the touch screen (touch key) On the other hand, The virtual The keys or visual keys can be displayed on the touch screen in various forms, for example, graphics. (graphic) ,text (text) ,icon (icon) ,video (video) , or a combination thereof.

[0059] one In the examples ,at least one The sensor 1440 collects internal information of the device, information on the surrounding environment surrounding the device, and User Information home at least one of detection and corresponding Sensing Signal Generate The processor 1410 this Like Sensing Based on the signal, the device drives or controls the operation of the device or Application ProgramIt is possible to perform data processing, functions or operations related to the

[0060] As mentioned above ,at least one The sensor 1440 may include a proximity sensor, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, a gravity sensor (G-sensor), a gyroscope sensor, a motion sensor (infrared sensor), RGB sensor, infrared sensor (IR sensor), Finger scan sensor, ultrasonic sensor, optical sensor (e.g., camera), microphone ,environmental sensors (e.g., barometer, hygrometer, thermometer, radioactivity sensing Sensor, Heat sensing Sensors, Gases sensing Sensor home at least one ), chemical sensors (e.g., The sensor may include at least one of the following: a healthcare sensor, a biometric sensor, etc. On the other hand, this device Like this At least two of the sensors Detected in Combining the information Utilization It is possible.

[0061] one In an embodiment, a display unit 1450 is a touch sensor Interactive Layers Does it have a structure? 、 or Integrated By forming a touch screen embodiment Such a touch screen can function as a user input unit that provides an input interface between the device and the user, and can also provide an output interface between the device and the user. and display section 1450 is integrated with each other and realized as a touch screen do It is possible.

[0062] Display section 1450 displays (outputs) information processed by this device. For example, Display section 1450 is driven by this device Application Program (For example,) execution screen information of an application, or UI (User Interface) or GUI (Graphical User Interface) information corresponding to such execution screen information can be displayed.

[0063] one In an embodiment, a display unit 1450 as an input method use For example, the user can Display section 1450 Through Specific in the video point Or operations that can be input into the area (for example, click operations, drag operations, contact Touch operation, Four Staff Touch operation (i.e., specific to the touchscreen or touchpad) of It is possible to perform input operations such as touch operations that apply pressure.

[0064] one In the examples , the processor 1410 Display section 1450 Through Reactive picture For example, The first screen teeth , a screen for receiving input operations from a user. picture At least depending on the input operation, one The playback type may include:

[0065] one In the examples ,The processor 1410 determines the characteristics, speed, and Pressure home at least one Based on the input operation intention and Emotional home at least one The processor 1410 can identify The aforementioned identification was Intention of input operation and Emotional home at least one Based on Reactive Video Any of the playback types one Identify the The aforementioned Identified playback type Display section 1450 Through It can be played. said input A method for identifying at least one of the intention and emotion of an operation will be described later.

[0066] one In the examples , the processor 1410 inputs the above characteristics, velocity, pressure information, and The input intent identified according to Reach and emotional information home at least one of use and train machine learning model 1425 to make The processor 1410 can output the learning result to the machine learning model 1425 after the learning is completed. said input Enter the operation, said input Intention of operation and Emotional home at least one The information indicating the above can be obtained as an output value.

[0067] At least, corresponding to the performance of the components shown in Figure 1 one Components can be added or removed. Also ,The relative positions of the components can be changed depending on the performance or structure of the system. The technology This will be readily understood by those of ordinary skill in the art.

[0068] On the other hand, each component shown in Figure 1 is a software and / or Field Programmable Gate Arrays ( Field Programmable Gate Array (FPGA) and custom semiconductors (ASIC "Application Specific Integrated Circuit" means a hardware component such as a processor, processor module, or application specific integrated circuit (API).

[0069] Figure 2 shows In this disclosure Related Responsive based on the intent or emotion of the input picture Regenerating electrons Device 2 is a flowchart illustrating the operation of the electronic device 1400. In FIG. 2, the operation of the electronic device 1400 is substantially performed by a processor 1410. be able to understand .

[0070] In operation 1510, the processor 1410 Display section 1450 Through Reactive picture can be displayed. The aforementioned Reactive video requires at least one one For example, Display section 1450 may display a screen such as screen 1600 in FIG.

[0071] In operation 1520, the processor 1410 inputs the user input 1430 Through An input operation on one screen of the responsive video can be received. The aforementioned The input operation may include, for example, a touch input, a swipe input, or a pinch in / out input. The input operation is exemplary and may include various inputs not disclosed herein. In operation 1520, the input operation is one This can be understood to refer to objects contained in the screen.

[0072] Referring to Figure 3, the reactive picture One screen of 1600 is at least one The input operation of the user can include objects (e.g., tomatoes) 1610 and 1620. Target It can be understood that it is for operating Reactive video is 1600 per screen against Based on the input operation, at least one For example, the user's input operation can include at least one of the following playback types: one of Target When the user swipes 1610 and 1620 from top to bottom, a playback type in which the tomato is cut vertically can be played under the control of the processor 1410. For example, when the user inputs at least One objectWhen 1610 and 1620 are swiped from left to right, a playback type in which tomatoes are cut horizontally can be played under the control of the processor 1410.

[0073] Referring again to FIG. 2, in operation 1530, the processor 1410 may determine the characteristics, speed, or pressure of the input operation. home At least One more Based on the intention or emotion of the input operation home at least one can be identified.

[0074] In one embodiment The characteristics of the input operation depend on the user's input operation. Linkage Understand that can be The processor 1410 can identify the user's intent based on the characteristics of the input operation. For example, reactive picture In Target is input by the user (e.g., swipe) one point If the input operation has the characteristic of moving the object, the processor 1410 can recognize the intention of the input operation as the movement of the object.

[0075] In one embodiment , the processor 1410 Input each You can set the execution range for the operation in advance. The execution range is The relevant Input actions are recognized required for Input operation range and understanding can be For example, swipe input Recognition To be executed, the input operation is Display section 1450 may be set to receive over a specified distance.

[0076] one In the examples , the processor 1410 may: The relevant Input operations with characteristics Degree of execution If the input operation is performed at a specified level or more, the processor 1410 can identify The relevant Input operation The relevantIt can be recognized as an intentional input operation. For example, Target of one point If the user does not perform an input operation (e.g., a swipe) to move the cursor to the position indicated by the arrow, the processor 1410 The relevant The input operation is executed at the specified level ( example: 80% or more Executed If the input operation is performed at a specified level or more, the processor 1410 The relevant It can be determined that an input operation with intent has been received. Conversely, if the input operation is at a specified level ( example: If the input is executed at less than 80%, the processor 1410 can prevent unintentional malfunction by ignoring the corresponding input operation.

[0077] one In the examples , the specified level may be preset by the electronic device 1400. In the examples The specified level may be determined statistically. For example, the processor 1410 may Pre-set During the period one screen of Target added to Input operation record Collect and The aforementioned Collected input operations record The designated level can be determined based on the statistical value of

[0078] one In the examples The processor 1410 determines the intention of the input operation based on the speed of the input operation. and Strength home at least one can be identified.

[0079] one In the examples 4A, the processor 1410 can acquire the speed of the input operation. The processor 1410 can identify the intention of the input operation based on the speed of the input operation. For example, the processor 1410 For the target If the swipe is held down for a preset time ( example: 1 second) InsideIf the strength of the input operation 1700 is greater than the strength of the input operation 1710 when the input operation is performed for a period of time exceeding the preset time, thing The processor 1410 can identify different playback types based on the strength of the input operation. to make It is possible.

[0080] one In the examples The processor 1410 determines the emotion of the input operation based on the speed of the input operation. (emotion) The emotion of the input operation can be identified as positive. (positive) or negation (negative) The degree of the difference can be expressed numerically as shown in FIG. Target Predefined multiple ( example: 2) touch input for a preset time ( example: 1 second) Inside If the input operation continues for more than the preset time, was carried out The processor 1410 may select different playback types based on the emotion of the input operation. to make It is possible.

[0081] one In the examples , the processor 1410 Display section The method for measuring the speed of an input operation can be changed depending on the physical size and characteristics of the 1450. The method for measuring the speed of an input operation may differ between a smartphone and a kiosk. For example, Display section If the size and number of pixels of 1450 are different, the processor 1410 determines whether the input operation has moved. pixel The speed of the input operation can be measured based on the pixel distance. Specifically, the processor 1410 calculates the speed of the input operation based on the pixel distance. Size Normalized proportionally according to (normalize) Then, based on the normalized value The relevant Intention of input operation and and / or be able to identify emotions.

[0082] In one embodiment,The processor 1410 determines the intent of the input operation based on the magnitude of the pressure. and Able to identify emotions.

[0083] one In the examples , at least one of the electronic devices 1400 one The sensor 1440 may include a pressure sensor. Through a pressure sensor As shown in FIG. 5A, the magnitude of the pressure applied by the input operation can be identified. For example, twist For large input operations, the processor 1410 Target The strength of the input operation is high thing For example, pressure More For large input operations, the processor 1410 Target The sentiment towards input operations is more negative. thing The processor 1410 can identify the strength of the input operation. and Play different playback types based on emotions to make It is possible.

[0084] one In the examples ,at least one If the sensor 1440 does not include a pressure sensor, the processor 1410 determines the intention of the input operation based on the width of the input operation point, as shown in FIG. 5B. and Able to identify emotions.

[0085] one In the examples The width of the input operation point is the vertical length of the input area. Horizontal length Information Through (w*h) can be measured. In the examples The size of the input operation point is determined by the radius information of the input area. Through It can be measured.

[0086] one In the examples , the processor 1410 Display section The method of measuring the pressure of the input operation can be changed depending on the characteristics of 1450. For example, the processor 1410 can change the size of the input area. pixel The input area size is obtained in units of Display sectionThe width of the input operation can be measured by comparing it with the physical size (dpi) of the display 1450. In this case, the processor 1410 pixel of the input area measured at Size The screen Size Normalize proportionally according to the input value, and determine the input operation intent based on the normalized value. and Emotions can be identified. In this case, the normal distribution table for calculating the normalized value is Puristic Alternatively, the normal distribution table may be statistical values ​​that are constructed by assuming that the collected input operation data is normally distributed.

[0087] one In the examples The processor 1410 determines the intention of the input operation. and Machine learning model 1425 to identify emotions use For example, the processor 1410 may use the characteristics, speed, and Pressure home at least One, and The intention of the input operation identified from it and Emotional information use and train machine learning model 1425 to make The processor 1410 inputs the input operation into the machine learning model 1425 that has completed learning, and determines the intention of the input operation from the output value. and You can get emotions.

[0088] Referring again to FIG. 2, in operation 1540 The processor 1410 may identify a playback type of the responsive image based on at least one of the intention or emotion of the input operation. In one embodiment, one screen of the responsive image may include a balloon as an object. The processor 1410 balloon For example, if the intensity of the touch input is strong or the emotion is negative, the processor 1410 may Video of balloons bursting can be identified as a playback type. To name a few: If the touch input has a low intensity or a positive emotion, the processor 1410 Video of a balloon being flattened can be identified as a playback type.

[0089] At operation 1550, the processor 1410 converts the identified playback type into Display section1450 Through It can be played.

[0090] On the other hand, the disclosed Example is a command that can be executed by the computer. keep In the form of a recording medium embodiment The command name can be Save as which when executed by a processor produces program modules to implement the disclosed Example The recording medium is a computer-readable recording medium. Realized in It is possible.

[0091] The computer-readable recording medium includes Decryption This includes any type of recording medium on which possible command names are stored, such as Read Only Memory (ROM), Random Access Memory (RAM), magnetic tape, magnetic disk, flash memory, and optical data storage devices.

[0092] As described above, the present invention is disclosed with reference to the accompanying drawings. Example A person skilled in the art to which the present disclosure pertains would be able to change the technical idea or essential features of the present disclosure. Even if you don't , disclosed Example The present disclosure may be implemented in other forms than those described above. Understanding It will be disclosed. Example of implementation are illustrative and should not be construed as limiting.

Claims

1. a touchscreen that displays responsive images; a processor for controlling the reproduction of the responsive image; The processor: receiving an input operation for one screen of the responsive image through the touch screen; Identifying at least one of an intention and an emotion of the input manipulation based on at least one of a characteristic, a velocity, and a pressure of the input manipulation; Identifying a playback type of the responsive image based on at least one of the intention and emotion of the input operation; An electronic device that reproduces the reactive image based on the identified reproduction type.

2. The electronic device of claim 1 , wherein the responsive image is a multi-responsive image.

3. The processor: The electronic device of claim 2 , further comprising: identifying a characteristic of the input operation based on a degree of execution of the input operation.

4. The processor: recording a plurality of input operations on the one screen; determining a designated level based on statistical values ​​for the plurality of input operations; The electronic device of claim 3 , wherein the degree of execution of the input operation is compared with the level to identify the characteristics of the input operation.

5. The processor: normalizing the pixel distance moved by the input operation based on the size of the display unit; The electronic device of claim 4 , wherein the speed of the input operation is identified based on the normalized value.

6. the processor identifies a pressure of the input operation based on a size of an input area on which the input operation is applied; The electronic device according to claim 5 , wherein the size of the input area is measured based on widthwise length information of the input area or the radius information of the input area.

7. further comprising a pressure sensor; The electronic device of claim 5 , wherein the processor identifies the magnitude of the pressure applied via the pressure sensor.

8. further comprising a memory with a machine learning model; The processor: training the machine learning model using a plurality of input manipulations having at least one of characteristics, velocity, and pressure and at least one of intent and emotion information of the plurality of input manipulations; The electronic device according to claim 7 , wherein the input operation is input to the machine learning model, and at least one of an intention and an emotion of the input operation is obtained as an output.

9. A method performed by an electronic device, comprising: displaying a responsive image on a touchscreen of an electronic device; When an input operation is received for one screen of the responsive image, identifying at least one of an intention and an emotion of the input operation based on at least one of a characteristic, a speed, and a pressure of the input operation; Identifying a playback type of a responsive image based on at least one of the intention and emotion of the input operation; and reproducing a responsive image based on the intention and emotion of an input operation on the responsive image, the method comprising:

10. A computer-readable recording medium storing a program for executing the method according to claim 9 in combination with a computer.

Images