Electronic device for editing and plyaing media and operating mehtod thereof

The electronic device addresses the challenge of accommodating flexible displays by obtaining user inputs for playback environments and animation effects, enabling enhanced multimedia content editing and playback across different display types.

KR102997178B1Active Publication Date: 2026-07-29SAMSUNG ELECTRONICS CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
SAMSUNG ELECTRONICS CO LTD
Filing Date
2021-10-27
Publication Date
2026-07-29

AI Technical Summary

Technical Problem

Applications designed for flat displays face difficulties in accommodating the playback environment of flexible displays, and vice versa, limiting the ecosystem of multimedia content that utilizes the characteristics of flexible displays.

Method used

An electronic device that obtains user inputs for setting playback environments and animation effects, generating metadata to adjust these effects based on display transformations, and playing content accordingly.

Benefits of technology

Provides a content editing environment that accommodates various display environments, enhancing the multimedia content ecosystem for flexible displays.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 112021123679331-PAT00009_ABST
    Figure 112021123679331-PAT00009_ABST
Patent Text Reader

Abstract

An electronic device is disclosed comprising a processor; and a memory for storing instructions, wherein, when the instructions are executed by the processor, the electronic device obtains a first user input for setting a playback environment of a type of display on which the content is played, obtains a second user input for identifying a target of an animation, obtains a third user input for setting an effect of the animation applied to the identified target, and generates metadata for the content such that the degree of the effect of the animation changes according to a transformation of the type of display. In addition to this, various embodiments as identified from the specification are possible.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The various embodiments disclosed in this document relate to an electronic device for editing and playing media and a method of operating the same. Background Technology

[0003] Electronic devices such as smartphones or tablet PCs are used as devices for consuming multimedia content, and can also be used for producing multimedia content. The problem to be solved

[0005] Applications for the production or editing of multimedia content, or applications for playback, can be developed based on a flat display.

[0006] Since applications for editing multimedia content are designed based on flat displays, it may be difficult for the creator to consider the playback environment of electronic devices employing types of displays other than flat displays (e.g., flexible displays).

[0007] Similarly, as applications for playing multimedia content are designed based on flat displays, consumers with electronic devices that use flexible displays may find it difficult to encounter content that utilizes the characteristics of flexible displays.

[0008] To expand the ecosystem of content utilizing the characteristics of flexible displays, applications that take into account various display environments are required. means of solving the problem

[0010] An electronic device according to one embodiment disclosed in this document comprises: a processor; and a memory for storing instructions, wherein the instructions may be configured such that, when executed by the processor, the electronic device obtains a first user input for setting a playback environment of a type of display on which the content is played, obtains a second user input for identifying a target of an animation, obtains a third user input for setting an effect of the animation applied to the identified target, and generates metadata for the content such that the degree of the effect of the animation changes according to a transformation of the type of display.

[0011] An electronic device according to another embodiment disclosed herein includes a display; a processor; and a memory for storing instructions, wherein, when the instructions are executed by the processor, the electronic device identifies a request for playback of content and identifies a first effect associated with a variation of the display among at least one effect of an animation set by metadata of the content, and while playing the content through the display: based on the variation of the display, the value of the first effect of the animation set by metadata is changed, and based on the changed value, the animation showing the first effect is played.

[0012] A method of operation of an electronic device according to an embodiment disclosed in this document may include: acquiring a first user input for setting a type of display on which content is played; acquiring a second user input for identifying a target of an animation; acquiring a third user input for setting an effect of the animation applied to the identified target; and generating metadata for the content such that the degree of the effect of the animation changes according to a transformation of the display of the type.

[0013] The technical problems to be solved in the various embodiments of this document are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art to which this disclosure belongs from the description below. Effects of the invention

[0015] The various embodiments disclosed in this document can provide a content editing environment that takes into account various display environments.

[0016] The effects obtainable from the various embodiments of the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure pertains from the description below. Brief explanation of the drawing

[0018] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure. FIG. 2 illustrates electronic devices that change shape according to one embodiment of the present disclosure. FIG. 3 illustrates electronic devices that change shape according to one embodiment of the present disclosure. FIG. 4a illustrates the media viewing state of an electronic device according to one embodiment of the present disclosure. FIG. 4b illustrates the media viewing state of an electronic device according to one embodiment of the present disclosure. FIG. 5a is a block diagram of an electronic device according to one embodiment of the present disclosure. FIG. 5b illustrates a variation of a display of an electronic device according to one embodiment of the present disclosure. FIG. 5c illustrates the operation of an electronic device playing an image according to one embodiment of the present disclosure. FIG. 6a illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 6b illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 6c illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 7a illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 7b illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 8a illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 8b illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 8c illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 8d illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 8e illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 8f illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 8g illustrates a screen displayed by an electronic device according to one embodiment of the present disclosure. FIG. 9 illustrates an image displayed by an electronic device according to one embodiment of the present disclosure. FIG. 10 illustrates an editing operation of an electronic device according to one embodiment of the present disclosure. FIG. 11 illustrates the regeneration operation of an electronic device according to one embodiment of the present disclosure. FIG. 12 illustrates the regeneration operation of an electronic device according to one embodiment of the present disclosure. FIG. 13 illustrates the guide information output operation of an electronic device according to one embodiment of the present disclosure. FIG. 14 illustrates a meta-information setting operation of an electronic device according to one embodiment of the present disclosure. FIG. 15 shows an example of a physical animation according to one embodiment of the present disclosure. FIG. 16 shows an example of a hinge animation according to one embodiment of the present disclosure. FIG. 17 shows an example of dynamic animation according to one embodiment of the present disclosure. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Specific details for implementing the invention

[0019] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0020] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0021] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0022] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0023] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0024] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0025] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0026] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0027] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0028] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0029] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0030] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0031] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0032] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0033] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0034] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0035] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0036] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0037] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0038] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0039] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0040] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0042] FIG. 2 illustrates electronic devices whose shape changes according to one embodiment.

[0043] In one embodiment, the electronic device (101A, 101B, or 101C) (e.g., the electronic device (101) of FIG. 1) may include a display (161A, 160B, or 160C) (e.g., the display module (160) of FIG. 1) that is flexible in at least a portion.

[0044] In one embodiment, the electronic device (101A, 101B, or 101C) (e.g., the electronic device (101) of FIG. 1) may be physically transformed by bending (or, folding) / flattening (or, unfolding). Centered on the folding portion (191A, 192B, 193B, or 194C) of the electronic device (101A, 101B, or 101C), the electronic device may be folded (e.g., closed) or unfolded (e.g., open). For example, the folding portion (191A, 192B, 193B, or 194C) of the electronic device (101A, 101B, or 101C) may be referred to as a hinge portion. The folding part (191A, 192B, 193B, or 194C) refers to a part (e.g., a hinge) or area where the shape of the electronic device (101A, 101B, or 101C) can be changed, and is not limited to a specific structure.

[0045] In one embodiment, the electronic device (101A) may include a display (162A) (e.g., the display module (160) of FIG. 1) placed on a side facing in the opposite direction to the side on which the display (161A) is placed. In one embodiment, at least a portion of the display (161A) of the electronic device (101A) may be flexible. In one embodiment, at least a portion of the display (161A) corresponding to the fold portion (191A) may be flexible.

[0046] In one embodiment, the electronic device (101A) can be folded left and right. For example, the electronic device (101A) can be folded around at least one folding portion (191A) of the housing (120A). The electronic device (101A) can be folded or unfolded around the folding portion (191A). FIG. 2 shows the second display (162A) occupying part of one side of the housing (120A), but according to another embodiment, the second display (162A) may occupy the entire side of the housing (120A).

[0047] In FIG. 2, the electronic device (101A) is illustrated as an in-fold electronic device that folds inward with the first display (161A), but embodiments of the present document are not limited thereto. For example, the electronic device (101A) may be an out-fold electronic device in which the first display (161A) folds outward, or an electronic device that supports both in-fold and out-fold.

[0048] In one embodiment, the electronic device (101B) may include a display (160B) (e.g., the display module (160) of FIG. 1). In one embodiment, at least a portion of the display (160B) of the electronic device (101B) may be flexible. In one embodiment, the display (160B) may be flexible in a portion corresponding to at least the fold portions (192B, 193B).

[0049] In one embodiment, the electronic device (101B) may be folded around a plurality of axes. For example, the electronic device (101B) may be folded left and right around the folding portion (192B) and / or folding portion (193B) of the housing (120B). In FIG. 2, the electronic device (101B) is shown as an out-fold electronic device in which the display (160B) folds outward, but the embodiments of this document are not limited thereto. For example, the electronic device (101B) may be in-folded at the folding portion (192B) and / or folding portion (193B). In another example, the electronic device (101B) may be capable of both in-folding and out-folding at the folding portion (192B) and / or folding portion (193B).

[0050] In one embodiment, the electronic device (101C) may include a display (160C) (e.g., the display module (160) of FIG. 1). In one embodiment, at least a portion of the display (160C) of the electronic device (101C) may be flexible. In one embodiment, the display (160C) may be flexible in a portion corresponding to at least a fold portion (194C).

[0051] In one embodiment, the electronic device (101C) can be folded vertically. The electronic device (101C) can be folded vertically around the folding portion (194C). In FIG. 2, the electronic device (101C) is shown as an in-fold electronic device that folds inward toward the display (160C), but the embodiments of this document are not limited thereto. For example, the electronic device (101C) may be an out-fold electronic device that folds outward toward the display (160C). In another example, the electronic device (101C) may be an electronic device that supports both in-fold and out-fold.

[0052] The physical shape change of the electronic device (e.g., 101A, 101B, and 101C) illustrated in FIG. 2 is exemplary and the embodiments of this document are not limited thereto. For example, the electronic device (e.g., 101A, 101B, and 101C) may be folded or unfolded around any axis. As another example, any area of ​​the display (161A, 160B, or 160C) of the electronic device (e.g., 101A, 101B, and 101C) may be bent.

[0053] FIG. 3 illustrates electronic devices whose shape changes according to one embodiment.

[0054] According to one embodiment, the shape of an electronic device (101D, 101E, or 101F) (e.g., electronic device (101) of FIG. 1) may be physically transformed by extending and / or retracting the housing of the electronic device. For example, the electronic device (101D, 101E, or 101F) may include a housing (120D, 120E, 121F, or 122F) and / or a display (160D, 160E, or 160F) (e.g., display module (160) of FIG. 1) to which at least a portion may be extended. For example, a portion of the electronic device (101D, 101E, or 101F) may be slid or rolled so that the electronic device may be extended (e.g., open) or retracted (e.g., closed). The extension (181D, 181E, or 181F) refers to a part or region corresponding to the difference between the first form and the second form when the form of the electronic device changes from the first form to the second form, and is not limited to a specific structure.

[0055] According to one embodiment, the electronic device (101D) may include an extension (181D) that extends and / or retracts vertically. For example, at least a portion of the housing (120D) of the electronic device (101D) may include an extension (181D) that can extend upward from the electronic device (101D). For example, the extension (181D) may extend the housing (120D) of the electronic device (101D) by moving upward relative to another portion of the housing (120D) as part of the housing (120D). The extension (181D) may move independently of the display (160D). For example, the extension (181D) may be moved upward relative to the display (160D). For another example, the extension (181D) may be positioned downward relative to the display (160D).

[0056] According to one embodiment, the electronic device (101E) may include an extension (181E) that extends and / or contracts to the left and right. For example, at least a portion of the housing (120E) of the electronic device (101E) may include an extension (181E) that can extend to the right of the electronic device (101E). For example, the extension (181E) may move independently of the display (160E). In this case, the extension (181E) may be moved to one side relative to the display (160E) of the portion of the housing (120E). In another example, the extension (181E) may move together with the display (160E). In this case, the display (160E) may be extended by moving the extension (181E) to one side of the housing (120E) together with the display (160E).

[0057] According to one embodiment, the electronic device (101F) may include an extension (181F) that extends and / or retracts laterally. For example, the display (160F) of the electronic device (101F) may be a rollable display. For example, at least a portion of the display (160F) may be rolled and housed within a first housing (121F). For example, the display (160F) may extend between the first housing (121F) and the second housing (122F) by being unrolled. The extension (181F) may include the rolled portion of the display (160F).

[0058] The physical shape change of the electronic device (101D, 101E, and 101F) illustrated in FIG. 3 is exemplary and the embodiments of this document are not limited thereto. For example, the electronic device (101D, 101E, and 101F) may be extended or contracted in any direction. As another example, any area of ​​the display (160D, 160E, or 160F) of the electronic device (101D, 101E, and 101F) may be bent.

[0059] FIGS. 4a and 4b illustrate media viewing states (401A, 401B, 401C, 401D, 401E, 401F, 401G, and 401H) of an electronic device (101) according to one embodiment.

[0060] In one embodiment, the media viewing state may be used to determine display transformation information to be reflected in the metadata of the animation included in the media. The media viewing state may be based on at least one of the folding position, folding area, folding angle, rotation angle, mounting state, or gripping state of the display. The media viewing state may be based on the expansion and / or contraction of the display due to sliding or rolling. The folding, sliding, and rolling of the display may be based on the examples described in FIGS. 2 and 3. In one embodiment, the media viewing state may be identified based on a sensor module (176). For example, the electronic device (101) may identify at least one of the folding position or folding angle of the display through a Hall sensor, and identify the media viewing state based on the data identified through the Hall sensor. In another example, the electronic device (101) may identify at least one of the folding position or folding angle of the display through an ultrasonic sensor and / or a proximity sensor, and identify the media viewing state based on the data identified through the ultrasonic sensor and / or the proximity sensor. In another example, the electronic device (101) may identify whether the electronic device (101) is being held through at least one of a touch sensor or a pressure sensor, and identify the media viewing state based on the identified data. In another example, the electronic device (101) may identify at least one of the folding angle or mounting state through a motion sensor (e.g., a gyroscope sensor and / or an accelerometer sensor), and identify the media viewing state based on the identified data. Additionally, the electronic device (101) may identify at least one of the folding position, folding area, folding angle, rotation angle, mounting state, or gripping state of the display using a sensor other than those described herein, and identify the media viewing state based on the identified data.

[0061] FIG. 4a illustrates media viewing states (401A, 401B, 401C, and 401D) of an electronic device (101) in which the display can be folded around one axis (A1).

[0062] The media viewing state (401A) may be in an unfolded state of the electronic device (101). The media viewing state (401B) may be in a folded state of the electronic device (101). The media viewing states (401A and 401B) may be in a state where the electronic device (101) is held by a user, and / or the electronic device (101) is mounted.

[0063] The media viewing state (401C) may be a state in which the electronic device (101) is folded at a predetermined angle. The media viewing state (401C) may be a state in which the electronic device (101) is held by a user.

[0064] The media viewing state (401D) may be a state in which the electronic device (101) is folded at a predetermined angle. The media viewing state (401D) may be a state in which the electronic device (101) is mounted.

[0065] FIG. 4b illustrates media viewing states (401E, 401F, 401G, and 401H) of an electronic device (101) in which the display can be folded around a plurality of axes (B1, B2).

[0066] The media viewing state (401E) may be a state where the electronic device (101) is unfolded. The media viewing state (401E) may be a state where the electronic device (101) is held by a user, and / or a state where the electronic device (101) is mounted.

[0067] The media viewing state (401F) may be a state in which the electronic device (101) is folded at a predetermined angle through a plurality of axes (B1, B2). The media viewing state (401F) may be a state in which the electronic device (101) is held by a user, and / or a state in which the electronic device (101) is mounted. In the media viewing state (401F) of FIG. 4b, the electronic device (101) may be folded so that the region (411F) and the region (413F) face each other. In another embodiment, the electronic device (101) may be folded at a predetermined angle through a plurality of axes (B1, B2) so that the region (411F) and the region (413F) do not face each other. For example, regions (411F) and (412F) can be folded outward with respect to the axis (B1), and regions (412F) and (413F) can be folded outward with respect to the axis (B2).

[0068] The media viewing state (401G) may be a state in which the electronic device (101) is folded at a predetermined angle through the axis (B1). The media viewing state (401G) may be a state in which the electronic device (101) is unfolded on the axis (B2). The media viewing state (401G) may be a state in which the electronic device (101) is mounted.

[0069] The media viewing state (401H) may be a state in which the electronic device (101) is folded in a first direction through the axis (B1) and folded in a second direction through the axis (B2). The first direction and the second direction may be different directions. The media viewing state (401H) may be a state in which the electronic device (101) is mounted.

[0071] FIG. 5a is a block diagram of an electronic device (101) according to one embodiment of the present disclosure. FIG. 5b illustrates a transformation of the display (580) of the electronic device (101) according to one embodiment of the present disclosure. FIG. 5c illustrates an operation in which the electronic device (101) according to one embodiment of the present disclosure plays an image (555).

[0072] Referring to FIG. 5a, the electronic device (101) may include a media editor (510) and / or a media player (540). In one embodiment, the electronic device (101) may include only the media editor (510). In another embodiment, the electronic device (101) may include only the media player (540). In yet another embodiment, the electronic device (101) may include both the media editor (510) and the media player (540).

[0073] In one embodiment, the media editor (510) and / or media player (540) may be implemented in the form of hardware or software.

[0074] For example, all components of the media editor (510) may be implemented in the form of hardware. As another example, all components of the media editor (510) may be implemented in the form of software. As yet another example, some components of the media editor (510) may be implemented in the form of hardware, and the remaining components may be implemented in the form of software.

[0075] For example, all components of the media player (540) may be implemented in the form of hardware. As another example, all components of the media player (540) may be implemented in the form of software. As yet another example, some components of the media player (540) may be implemented in the form of hardware, and the remaining components may be implemented in the form of software.

[0076] For example, the media editor (510) and / or media player (540) may be implemented in the form of an application-specific integrated circuit (ASIC). As another example, the media editor (510) and / or media player (540) may be implemented as software comprising one or more stored instructions executable by the processor (120). Hereinafter, the media editor (510) and / or media player (540) are exemplified as being implemented as software.

[0077] In one embodiment, the media editor (510) may include a display model generator (520) and a metadata generator (530).

[0078] In one embodiment, the media editor (510) can edit media data (501) using a display model generator (520) and a metadata generator (530). In one embodiment, the media editor (510) can generate edited media data (502) based on the media data (501).

[0079] In one embodiment, the media editor (510) may output a user interface for editing media data (501). In one embodiment, the user interface for editing media data (501) may include a display area in which an image (555) (e.g., still image, video) corresponding to the data (501) is displayed.

[0080] In one embodiment, the display model generator (520) can select a display type in which an image (555) according to media data (502) is to be displayed. In one embodiment, the display type may include a flat, a horizontally foldable, a vertically foldable, a horizontally rollable, a vertically rollable, or a combination thereof.

[0081] In one embodiment, the display model generator (520) may select a display type in which an image (555) is to be displayed based on user input. In one embodiment, user input may be obtained through a user interface. In one embodiment, the display model generator (520) may also select a type of display (580) of the electronic device (101) as the display type in which the image (555) is to be displayed.

[0082] In one embodiment, the display model generator (520) can display features according to the display type in the display area where the image (555) is displayed. For example, in one embodiment, the display model generator (520) can display a bending position according to the display type in the display area.

[0083] In one embodiment, the metadata generator (530) may generate metadata (503) for media data (501). In one embodiment, the data included in the metadata (503) may include a base schema, a display schema, a target schema, an animation schema, or a combination thereof.

[0084] In one embodiment, the base schema may be a layer that constitutes a value structure frequently used in metadata (503). In one embodiment, the base schema may include identification information having information about an ID (identification) and variable type (e.g., integer, array, float), information about a value for representing the editing environment of an image (555), and / or transform information of a target.

[0085] In one embodiment, information regarding values ​​may include an initial value of a field, a first flag indicating whether the initial value is used, an upper value, a lower value, and a second flag indicating whether the upper value and / or lower value is used. In one embodiment, transform information may include information regarding position, rotation, scale, or a combination thereof. In one embodiment, information regarding position may include information regarding the movement of a target along the X, Y, and Z axes. In one embodiment, information regarding rotation may include information regarding a quaternion composed of values ​​for the X, Y, and Z axes of the target and a value for W representing roll. In one embodiment, information regarding scale may include information regarding a scaling factor for the X, Y, and Z axes of the target.

[0086] In one embodiment, the display schema of the metadata (503) may be a layer that constitutes a structure for common characteristics, foldable characteristics, flexible characteristics, or a combination thereof. In one embodiment, the display schema of the metadata (503) may set possible variations of the display.

[0087] In one embodiment, common characteristics may include information regarding a gyroscope, temperature, illuminance, touch pressure, gravity, humidity, number of displays, or a combination thereof. In one embodiment, the number of displays may represent the number of detachable areas of the displays.

[0088] In one embodiment, the foldable characteristics may include information regarding a folding direction, a folding angle, a folding angular velocity, or a combination thereof. In one embodiment, the foldable characteristics may set at least one of the folding direction, the folding angle, or the folding angular velocity as a possible variation of the display.

[0089] In one embodiment, the flexible characteristic may inherit the foldable characteristic. In one embodiment, the flexible characteristic may include information about an inflection point, an inflection line, or a combination thereof. In one embodiment, the flexible characteristic may set at least one of a folding direction, a folding angle, a folding angular velocity, an inflection point, or an inflection line as a possible variation of the display.

[0090] In one embodiment, the display schema of the metadata (503) may include recommendation information from the editor of the media data (501). In one embodiment, the recommendation information may include a guide to common characteristics of the display schema (e.g., the number of displays recommended by the editor). In one embodiment, the recommendation information may include a guide to foldable characteristics of the display schema (e.g., folding direction, folding angle, or folding acceleration recommended by the editor). In one embodiment, the recommendation information may include a guide to flexible characteristics of the display schema (e.g., inflection points or inflection lines recommended by the editor).

[0091] In one embodiment, the target schema of the metadata (503) may be a layer representing the target of the responsive animation. In one embodiment, the target schema of the metadata (503) may include video, audio, decoration, or a combination thereof.

[0092] In one embodiment, the schema for the image may include transform information of the image, size information of the image (e.g., height, width), orientation information of the image, attribute information, or a combination thereof. In one embodiment, the attribute information of the image may include information on color, brightness, saturation, contrast, highlight, color temperature, hue, or a combination thereof.

[0093] In one embodiment, the schema for the audio may include transform information, attribute information, or a combination thereof. In one embodiment, the attribute information of the audio may include information regarding audio channels, audio volume, audio playback speed, audio pitch, or a combination thereof.

[0094] In one embodiment, the schema for the decoration may include transform information, size information of the decoration (e.g., height, width), attribute information, or a combination thereof. In one embodiment, the attribute information of the decoration may include a flag regarding whether to update per frame.

[0095] In one embodiment, the animation schema of the metadata (503) may be a layer representing the effect of a reactive animation. In one embodiment, the animation schema may include information about at least one target, transition information for applying a screen transition effect to the target, physical information for applying a physical effect by an external force to the target, dynamic information for applying a dynamic change to the target, hinge information for applying an effect specified in a specific area of ​​the display, common information, or a combination thereof. In one embodiment, the animation schema may also be referred to as the playback attribute of the animation.

[0096] In one embodiment, information for at least one target of the animation schema may be information for specifying an image, audio, decoration, or a combination thereof.

[0097] In one embodiment, the transition information of the animation schema may be information for specifying a transition animation of a specified target (e.g., slide out, slide in, dissolve in, dissolve out, fade in, fade out, wipe in, wipe out, or a combination thereof). For example, the transition animation may include an animation in which a first target (e.g., image, or decoration) fades out while a second target (e.g., image, or decoration) fades in.

[0098] In one embodiment, the physical information of the animation schema may be information for indicating the change (e.g., movement) that a specified object undergoes due to an external force (e.g., gravity, attraction, or repulsion) toward a specific point (or direction).

[0099] In one embodiment, the dynamic information of the animation schema may be information for moving a specified target from a starting point to an ending point.

[0100] In one embodiment, the hinge information of the animation schema may be information for indicating an effect (e.g., hidden) applied to a specified target when the specified target is located in a specific area (e.g., a hinge part of a display, an overlapping part between displays, or a part specified on a display).

[0101] In one embodiment, common information of the animation schema may include information about a start value and / or an end value. For example, in the case of dynamic animation, the start value may indicate a start speed and the end value may indicate an end speed.

[0102] In one embodiment, the common information of the animation schema may include information regarding the start time and / or end time. For example, the start time may be the first time during the playback time of the video (555) when the animation is performed, and the end time may be the last time during the playback time of the video (555) when the animation is performed.

[0103] In one embodiment, the common information of the animation schema may include repetition information. In one embodiment, the repetition information may indicate whether the animation is repeated.

[0104] In one embodiment, the common information of the animation schema may include information regarding whether dynamic information is changed. In one embodiment, if it is set to dynamically change the information, the information of the animation schema may be updated every frame. In one embodiment, if it is set not to dynamically change the information, the information of the animation schema may be fixed based on the initial playback time of the animation.

[0105] In one embodiment, the common information of the animation schema may include information for specifying the targets of the animation input and output. For example, the animation input may be a display schema, and the animation output may be transform information of the target. For example, the animation input may be the folding angle of the display, and the animation output may be the positional movement of the target.

[0106] In one embodiment, common information of the animation schema may include information for indicating whether a guide for an optimal display environment is provided. For example, the guide for an optimal display environment may include a guide for a folding direction, a folding angle, a folding angular velocity, an inflection point, an inflection line, or a combination thereof.

[0107] In one embodiment, the metadata generator (530) may generate metadata (503) for media data (501) based on the display type. In one embodiment, the metadata generator (530) may configure a display schema based on the display type. In one embodiment, the metadata generator (530) may configure a display schema based on inputs. In one embodiment, the inputs may include information indicating a deformation of the display (580) identified through the sensor module (176), and / or user inputs. For example, if the display (580) is deformed from a flat state (581) to a bent state (585) at two points, the metadata generator (530) may configure a display schema based on information indicating the deformation of the display (580). In one embodiment, the information indicating the deformation of the display (580) may include the deformation location, curvatures (591, 593) at the deformation location, the deformation rate, or a combination thereof.

[0108] In one embodiment, the metadata generator (530) can generate metadata (503) for media data (501) based on input.

[0109] In one embodiment, the metadata generator (530) can construct a target schema based on input. In one embodiment, the metadata generator (530) can select a target for a reactive animation based on user input. In one embodiment, the target for the reactive animation may include video, audio, decoration, or a combination thereof. In one embodiment, the decoration may include stickers, text, drawings, or a combination thereof that can be attached to the video.

[0110] In one embodiment, the metadata generator (530) can construct a schema for images, audio, decorations, or a combination thereof based on input.

[0111] In one embodiment, the metadata generator (530) can configure an animation schema based on input. In one embodiment, the metadata generator (530) can select a type of animation based on user input. In one embodiment, the type of animation may include transition, physical, dynamic, hinge, or a combination thereof.

[0112] In one embodiment, the metadata generator (530) can set the start time, end time, and / or duration of the animation when configuring the animation schema.

[0113] In one embodiment, the metadata generator (530) can set whether to repeat playback of the animation when configuring the animation schema.

[0114] In one embodiment, the metadata generator (530) may set whether to update the animation schema when playing the animation in relation to the configuration of the animation schema. In one embodiment, the data generator (530) may configure the animation schema to play the animation based on the initial animation schema. In another embodiment, the data generator (530) may update the animation schema for every frame and configure the animation schema to play the animation based on the updated animation schema.

[0115] In one embodiment, the metadata generator (530) may set the animation to continue during the playback of the video (555) when configuring the animation schema. In another example, the metadata generator (530) may set the animation to continue from a first point in time to a second point in time of the video (555) when configuring the animation schema.

[0116] In one embodiment, the metadata generator (530) can determine the type of animation (e.g., transition, dynamic, physical, hinge) and the attribute to be applied to the end (e.g., velocity, acceleration, direction, force, torque, gravity, mass) when configuring the animation schema.

[0117] In one embodiment, the metadata generator (530) may link a specified schema as input when configuring an animation schema. In one embodiment, the metadata generator (530) may link an attribute defined in a specified schema as input when configuring an animation schema. For example, the metadata generator (530) may link information about the folding angle of a display schema as input when configuring an animation schema.

[0118] In one embodiment, the metadata generator (530) can link a specified schema as an output when configuring an animation schema. In one embodiment, the metadata generator (530) can link an attribute defined in a specified schema as an output when configuring an animation schema. For example, the metadata generator (530) can link information about the location of a target schema as an output when configuring an animation schema.

[0119] In one embodiment, the attributes of the schema linked to the output may be changed according to the attributes of the schema linked to the input. For example, the position of the target schema may be changed according to the folding angle of the display schema. For example, in the case of an animation in which the decoration (551) moves a specified length from the left end to the right end of the display (580) for a specified time (e.g., 2 seconds) in a bent state (585), the decoration (551) may move from the left end to the right end of the display (580) at different speeds depending on the regions (561, 563, 565) rather than at a uniform speed. For example, the decoration (551) may move at a relatively slow speed in the first region (561) and the third region (565), and at a relatively fast speed in the second region (563). Here, the movement of the decoration (551) may take a specified time (e.g., 2 seconds). For example, the location of the decoration (551) in the regions (561, 563, 565) can be determined by the following mathematical formulas 1, 2, and 3.

[0121]

[0122]

[0123]

[0125] In mathematical formula 1, I t1 ε can be a position correction value based on the angle at time t1. α can be a coefficient for converting the angle to a position. D t0 ≠ may be the angle of the display (580) at time t0. D t0 ☐ may be the angle of the display (580) where the decoration (551) is located at time t0. D t1 ≠ the angle of the display (580) at time t1. D t1The angle of the display (580) where the decoration (551) is located at time point t1 may be the angle of the display (580). Time point t0 may be a time point prior to time point t1. For example, time point t0 may be a time point one frame length prior to time point t1.

[0126] In mathematical formula 2, S0 can be a value obtained by dividing a specified time by a specified length.

[0127] In mathematical equation 3, P t1 The decoration (551) at time t1 can indicate the location. P t0 The decoration (551) at time t0 can indicate the location.

[0128] In one embodiment, the metadata generator (530) can store the generated metadata (503) together with the media data (502). In one embodiment, the metadata generator (530) can store the generated metadata (503) together with the media data (502) by setting at least one schema.

[0129] In one embodiment, the media player (540) may include a metadata descriptor (550), a reactive overlay generator (560), and a display transformation detector (570).

[0130] In one embodiment, the media player (540)) can play media data (502) using a metadata descriptor (550), a reactive overlay generator (560), and a display deformation detector (570). In one embodiment, the media player (540)) can play media data (502) based on metadata (503).

[0131] In one embodiment, the metadata descriptor (550) can read the metadata (503) of the media data (502). In one embodiment, the metadata descriptor (550) can input a value into at least one schema of the metadata (503).

[0132] In one embodiment, the metadata descriptor (550) can input a value into at least one schema of the metadata (503) based on the output of the display deformation detector (570). In one embodiment, the metadata descriptor (550) can input a value into the display schema based on the output of the display deformation detector (570). For example, the metadata descriptor (550) can input a value into the display schema based on the characteristics of the display detected by the display deformation detector (570) (e.g., number of displays, folding direction, folding angle, folding angular velocity, inflection point, inflection line, or a combination thereof). In one embodiment, the display deformation detector (570) can detect the transformation of the display (580) based on the sensor module (176).

[0133] In one embodiment, the metadata descriptor (550) can change the value entered in the metadata (503) in real time based on information set in the metadata (503) (e.g., whether the animation schema is updated). For example, the metadata descriptor (550) can change the value entered in the metadata (503) in real time for every frame. For example, the metadata descriptor (550) can change the value entered in the metadata (503) in real time for every frame based on the output of the display deformation detector (570).

[0134] In another embodiment, the metadata descriptor (550) may not change the value initially entered in the metadata (503) based on the information set in the metadata (503).

[0135] In one embodiment, the reactive overlay generator (560) can generate an overlay (553) according to metadata (503). In one embodiment, the reactive overlay generator (560) can generate an overlay (553) based on metadata (503) containing values ​​input by a metadata descriptor (550). For example, the reactive overlay generator (560) can generate an overlay (553) that includes an animation in which a decoration (551) moves a specified length from the left end to the right end of a display (580) for a specified time (e.g., 2 seconds) in a bent state (585).

[0136] In one embodiment, the electronic device (101) can display a screen (557) on a display (580) in which an image (555) according to an overlay (553) and media data (502) is combined.

[0138] FIGS. 6a, 6b, and 6c illustrate a screen displayed by an electronic device (101) according to one embodiment of the present disclosure. FIGS. 6a, 6b, and 6c may be described with reference to FIGS. 1, 5a, 5b, and 5c.

[0139] Referring to FIG. 6a, the electronic device (101) may display a screen (601). The screen (601) may display a display area (610) for displaying an image (555) (e.g., still image, video) according to media data (502) and at least one icon (621, 623, 625, 627) for editing the image (555).

[0140] In one embodiment, the electronic device (101) can edit an image (555) based on input (e.g., touch input) for at least one icon (621, 623, 625, 627).

[0141] In one embodiment, when input for an icon (621) is identified, the electronic device (101) may display a screen (602) including a user interface (631) for selecting a display type in which an image (555) is to be displayed. Referring to FIG. 6b, the user interface (631) may include items for selecting at least one of display types (e.g., flat, foldable (horizontal), foldable (vertical)).

[0142] In one embodiment, when at least one of the display types is selected, the electronic device (101) may display a screen (603) including a guide object (632) that indicates a deformable position according to the selected type. Referring to FIG. 6c, when foldable (horizontal) is selected, the electronic device (101) may display a guide object (632) that indicates a deformable position according to the foldable (horizontal). In one embodiment, the guide object may be an image based on a line (e.g., a solid line or a dotted line). However, the guide object is not limited to a line. For example, the guide object may be an image based on a polygon (e.g., a rectangle) to indicate an area containing a deformable position.

[0143] In one embodiment, the electronic device (101) may display additional guide objects based on additional input. For example, the electronic device (101) may display guide objects representing the axes (B1, B2) of FIG. 4b based on additional input. In one embodiment, the electronic device (101) may display guide objects representing the axes (B1, B2) at a location in a display area (610) corresponding to the location of the axis of the electronic device (101). In one embodiment, mapping data representing the relationship between the location of the axis and the location in the corresponding display area (610) may be constructed based on sensing data obtained through the sensor module (176) of the electronic device (101).

[0144] In one embodiment, the electronic device (101) can adjust the position of the guide object (632) based on additional input. For example, based on an input (e.g., drag) to move the position of the guide object (632), the electronic device (101) can adjust the position of the guide object (632).

[0145] In one embodiment, the electronic device (101) can determine that the folding of the display to which the image (555) is to be displayed can be performed at an adjusted position of the guide object (632).

[0146] In one embodiment, the electronic device (101) can adjust the angle of the guide object (632) based on additional input. For example, based on an input (e.g., rotation input) for adjusting the angle of the guide object (632), the electronic device (101) can adjust the angle of the guide object (632). For example, based on a rotation input for adjusting the angle of the guide object (632) by 45 degrees, the electronic device (101) can adjust the angle of the guide object (632) by 45 degrees.

[0147] In one embodiment, the electronic device (101) can determine that the folding of the display to which the image (555) is to be displayed can be performed according to the adjusted angle of the guide object (632).

[0149] FIGS. 7a and 7b illustrate a screen displayed by an electronic device (101) according to one embodiment of the present disclosure. FIGS. 7a and 7b may be described with reference to FIGS. 1, FIGS. 5a, FIGS. 5b, FIGS. 5c, and FIGS. 6c.

[0150] Referring to FIG. 7a, the electronic device (101) may display a screen (701) including a user interface (711) for selecting decorations to add to an image (555). In one embodiment, when an input for an icon (623) is identified while the screen (603) is displayed, the electronic device (101) may display a screen (701) including a user interface (711).

[0151] In one embodiment, the user interface (711) may include an item for selecting at least one of a sticker, text, or drawing.

[0152] Referring to FIG. 7b, when a decoration to be added is selected, the electronic device (101) can display a screen (702) containing a decoration object (720) corresponding to the selected decoration.

[0153] In one embodiment, the electronic device (101) may further display a decoration object (720) based on additional input.

[0154] In one embodiment, the electronic device (101) can adjust the position of the decoration object (720) based on additional input. For example, based on an input (e.g., drag) to move the position of the decoration object (720), the electronic device (101) can adjust the position of the decoration object (720).

[0155] In one embodiment, the electronic device (101) can adjust the angle of the decoration object (720) based on additional input. For example, based on an input (e.g., rotation input) for adjusting the angle of the decoration object (720), the electronic device (101) can adjust the angle of the decoration object (720). For example, based on a rotation input for adjusting the angle of the decoration object (720) by 30 degrees, the electronic device (101) can adjust the angle of the decoration object (720) by 30 degrees.

[0156] In FIGS. 7a and 7b, the decoration object (720) is selected after the display type to which the image (555) will be displayed is determined, but this is merely an example. In other embodiments, the electronic device (101) may determine the display type to which the image (555) will be displayed after selecting the decoration object (720).

[0158] FIGS. 8a, FIGS. 8b, FIGS. 8c, FIGS. 8d, FIGS. 8e, FIGS. 8f, and FIGS. 8g illustrate a screen displayed by an electronic device (101) according to one embodiment of the present disclosure. FIGS. 8a, FIGS. 8b, FIGS. 8c, FIGS. 8d, FIGS. 8e, FIGS. 8f, and FIGS. 8g may be described with reference to FIGS. 1, FIGS. 5a, FIGS. 5b, FIGS. 5c, FIGS. 6c, and FIGS. 7b.

[0159] Referring to FIG. 8a, the electronic device (101) may display a screen (801) including a user interface (811) for determining an animation schema of a decoration object (720). In one embodiment, when an input for an icon (625) is identified while the screen (702) is displayed, the electronic device (101) may display a screen (801) including a user interface (811).

[0160] In one embodiment, the user interface (811) may include an item for determining at least one of the start position, end position, playback type, or playback option of the decoration object (720). In one embodiment, the user interface (811) may include a time bar for determining the playback time of the decoration object (720).

[0161] Referring to FIG. 8b, the electronic device (101) may display a screen (802) including a user interface (821) for determining the end position of a decoration object (720). In one embodiment, when the screen (801) is displayed and an input for an icon ('To') for determining the end position is identified, the electronic device (101) may display a screen (802) including the user interface (821).

[0162] In one embodiment, the electronic device (101) may display a guide image indicating an end position (830). In one embodiment, when input for a confirmation button ('OK') is identified while displaying a user interface (821) for determining the end position of a decoration object (720), the electronic device (101) may return to a previous state. For example, the electronic device (101) may display a screen (801) including a user interface (811).

[0163] Referring to FIG. 8c, the electronic device (101) may display a screen (803) including a user interface (831) for determining the playback type of a decoration object (720). In one embodiment, when the screen (801) is displayed and an input for an icon ('Type') for determining the playback type is identified, the electronic device (101) may display a screen (803) including a user interface (831).

[0164] The user interface (831) may include items for selecting at least one of the playback types (e.g., dynamic, physical, hinged).

[0165] In one embodiment, when an input selecting dynamic among playback types (e.g., dynamic, physical, hinge) is identified while the screen (803) is displayed, the electronic device (101) may display a screen (804) including a user interface (833). Referring to FIG. 8d, the electronic device (101) may display a screen (804) including a user interface (833) for determining details of the selected playback type.

[0166] The electronic device (101) can enable the user to select at least one of the details (e.g., speed, acceleration, direction) through the user interface (833).

[0167] In one embodiment, when an input selecting acceleration among details (e.g., speed, acceleration, direction) is identified while the screen (804) is displayed, the electronic device (101) may display a screen (805) including a user interface (835). Referring to FIG. 8e, the electronic device (101) may display a screen (805) including a user interface (835) for determining deformation features of the display (e.g., angle, bending direction, angular velocity) associated with details of the selected playback type.

[0168] The electronic device (101) can enable the user to select at least one of the deformation features of the display (e.g., angle, bending direction, angular velocity) through the user interface (835).

[0169] In one embodiment, when an input is identified selecting at least one of the deformation features of the display (e.g., angle, bending direction, angular velocity) through the user interface (835), the electronic device (101) can return to a previous state. For example, the electronic device (101) can display a screen (801) including the user interface (811).

[0170] Referring to FIG. 8f, the electronic device (101) may display a screen (806) including a user interface (841) for determining playback options for a decoration object (720). In one embodiment, when the screen (801) is displayed and input for an icon (or menu, text) (e.g., 'Option') for determining playback options is identified, the electronic device (101) may display a screen (806) including a user interface (841).

[0171] The user interface (841) may include a combo box that allows selecting whether to block and whether to use a user guide.

[0172] In one embodiment, when input for an icon ('more') related to whether a user guide is displayed is identified while the screen (806) is displayed, the electronic device (101) may display a screen (807) including a user interface (842). Referring to FIG. 8g, the electronic device (101) may display a screen (806) including a user interface (842) for determining a user guide condition.

[0173] The electronic device (101) may enable the user to set a reference value, a reference lower limit value, and a reference upper limit value in the user interface (842). The reference value, reference lower limit value, and reference upper limit value displayed in the user interface (842) may be the reference value, reference lower limit value, and reference upper limit value of the deformation feature (e.g., angle, bending direction, angular velocity) of the display selected through the user interface (835).

[0175] FIG. 9 illustrates an image displayed by an electronic device (101) according to one embodiment of the present disclosure. FIG. 9 may be described with reference to FIG. 1, FIG. 5a, FIG. 5b, FIG. 5c, FIG. 6c, FIG. 7b, FIG. 8b, FIG. 8f, and FIG. 8g.

[0176] In one embodiment, the electronic device (101) can identify metadata such that, to play an image (555), the animation type of the decoration object (720) is dynamic, the input linked to the animation schema is the angle of the display, and the linked output is acceleration.

[0177] In one embodiment, the electronic device (101) can play an image (555). In one embodiment, while playing the image (555), the electronic device (101) can determine whether it is the point in time for playing an animation.

[0178] In one embodiment, when it is the playback point of an animation, the electronic device (101) can identify deformation information of the display. The electronic device (101) can identify the folding angle of the display.

[0179] Referring to FIG. 9, in a situation (901) where the folding angle of the display is 0 degrees, the electronic device (101) can play an animation in which a decoration object (910) moves at a constant speed.

[0180] In a situation (903) where the folding angle of the display is 30 degrees, the electronic device (101) can play an animation in which a decoration object (920) moves with acceleration in the first part (921) and moves at a constant speed in the second part (925).

[0181] In a situation (905) where the folding angle of the display exceeds 60 degrees, the electronic device (101) can display a user interface (940) indicating that the recommended angle is 30 degrees without moving the decoration object (930). Subsequently, when the folding angle of the display changes to above a reference lower limit value and below a reference upper limit value, the electronic device (101) can play an animation of moving the decoration object (930).

[0183] FIG. 10 illustrates an editing operation of an electronic device (101) according to one embodiment of the present disclosure. The operations of FIG. 10 can be performed by a processor (120) of the electronic device (101).

[0184] Referring to FIG. 10, in operation 1010, the electronic device (101) can select a target for the reactive animation. In one embodiment, the electronic device (101) can select an image, audio, decoration, or a combination thereof as a target for the reactive animation.

[0185] In one embodiment, the electronic device (101) can identify a setting for a selected target.

[0186] In one embodiment, when the selected object is an image, the electronic device (101) can identify settings for transform information of the image, size information of the image (e.g., height, width), orientation information of the image, attribute information, or a combination thereof. In one embodiment, the attribute information of the image may include information on color, brightness, saturation, contrast, highlight, color temperature, hue, or a combination thereof.

[0187] In one embodiment, when the selected target is audio, the electronic device (101) can identify settings for transform information, attribute information, or a combination thereof of the audio. In one embodiment, the attribute information of the audio may include information for audio channels, audio volume, audio playback speed, audio pitch, or a combination thereof.

[0188] In one embodiment, when the selected target is a decoration, the electronic device (101) can identify settings for the transformation information of the decoration, the size information of the decoration (e.g., height, width), attribute information, or a combination thereof. In one embodiment, the attribute information of the decoration may include a flag regarding whether to update per frame.

[0189] In operation 1020, the electronic device (101) can identify the settings of the display. In one embodiment, the electronic device (101) can identify the settings for the common characteristics, foldable characteristics, flexible characteristics, or a combination thereof of the display.

[0190] In one embodiment, the electronic device (101) may set editor's recommendation information when setting the display. In one embodiment, the recommendation information may include a guide to display characteristics (e.g., the number of displays recommended by the editor), a guide to foldable characteristics (e.g., the folding direction, folding angle, or folding acceleration recommended by the editor), a guide to flexible characteristics (e.g., the inflection point or inflection line recommended by the editor), or a combination thereof.

[0191] In operation 1030, the electronic device (101) can set playback attributes of the reactive animation. In one embodiment, the playback attributes may include information about at least one target, transition information for applying screen transition effects to the target, physical information for applying physical effects by external force to the target, dynamic information for applying dynamic changes to the target, hinge information for applying effects specified in a specific area of ​​the display, common information, or a combination thereof.

[0192] In one embodiment, information regarding at least one target may be information for specifying an image, audio, decoration, or a combination thereof.

[0193] In one embodiment, the transition information may be information for specifying a transition animation of a specified target (e.g., slide out, slide in, dissolve in, dissolve out, fade in, fade out, wipe in, wipe out, or a combination thereof).

[0194] In one embodiment, the physical information may be information indicating a change (e.g., movement) that a designated object undergoes due to an external force (gravity, attraction, or repulsion) toward a specific point (or direction).

[0195] In one embodiment, the hinge information may be information for indicating an effect (e.g., hiding) applied to a specified target when the specified target is located in a specific area (e.g., a hinge part of a display, an overlapping part between displays, or a part designated on a display).

[0196] In one embodiment, the common information may include information regarding a start value and / or an end value. In one embodiment, the common information may include information regarding a start time and / or an end time. In one embodiment, the common information may include repetition information. In one embodiment, the common information may include information regarding whether dynamic information is changed. In one embodiment, the common information may include information for specifying the targets of the animation input and output.

[0197] In operation 1040, the electronic device (101) can generate metadata. In one embodiment, the electronic device (101) can generate metadata based on set information. In another embodiment, if previously stored metadata exists, the electronic device (101) can update the metadata based on set information.

[0198] In one embodiment, the electronic device (101) can store generated metadata. In another embodiment, if previously stored metadata exists, the electronic device (101) can store updated metadata based on set information.

[0199] The order between operation 1010 and operation 1020 may be changed. For example, operation 1020 may be performed first, and then operation 1010 may be performed.

[0201] FIG. 11 illustrates a regeneration operation of an electronic device (101) according to one embodiment of the present disclosure. The operations of FIG. 11 can be performed by a processor (120) of the electronic device (101).

[0202] Referring to FIG. 11, in operation 1110, the electronic device (101) can load metadata for media data.

[0203] In operation 1120, the electronic device (101) can play media data.

[0204] In operation 1130, the electronic device (101) can determine whether it is the playback point of the reactive animation.

[0205] In operation 1130, if it is the playback time of the reactive animation (YES), the electronic device (101) can perform operation 1140. In operation 1130, if it is not the playback time of the reactive animation (NO), the electronic device (101) can perform operation 1130 again.

[0206] In operation 1140, the electronic device (101) can play a reactive animation. In one embodiment, the electronic device (101) can play a reactive animation based on metadata with input values. In one embodiment, the electronic device (101) can play a reactive animation by generating an overlay based on metadata with input values ​​and outputting the generated overlay.

[0207] Operation 1120, operation 1130, and operation 1140 can be performed in parallel. Operation 1130 and operation 1140 can be performed while operation 1120 is being performed.

[0209] FIG. 12 illustrates a regeneration operation of an electronic device (101) according to one embodiment of the present disclosure. The operations of FIG. 12 can be performed by a processor (120) of the electronic device (101).

[0210] The operations of Fig. 12 may be included in operation 1140.

[0211] Referring to FIG. 12, in operation 1210, the electronic device (101) can identify deformation information of the display. In one embodiment, the electronic device (101) can identify deformation information of the display based on the folding direction, folding angle, folding angular velocity, inflection point, and inflection line.

[0212] In operation 1220, the electronic device (101) can reflect deformation information of the display in metadata related to the reactive animation. In one embodiment, the electronic device (101) can input a value identified based on the deformation information of the display into the metadata. For example, the electronic device (101) can input a value identified based on the deformation information of the display into the display schema.

[0213] In operation 1230, the electronic device (101) can play a reactive animation based on reflected metadata. In one embodiment, the electronic device (101) can play a reactive animation based on metadata with input values. In one embodiment, the electronic device (101) can play a reactive animation by generating an overlay based on metadata with input values ​​and outputting the generated overlay.

[0214] Operation 1220 has been described as being included in Operation 1140 of FIG. 11, but this is merely an example. In another embodiment, Operation 1220 may be included in Operation 1110 of FIG. 11. In yet another embodiment, Operation 1220 may be performed between Operation 1110 and Operation 1130 of FIG. 11.

[0216] FIG. 13 illustrates a guide information output operation of an electronic device (101) according to one embodiment of the present disclosure. The operations of FIG. 13 can be performed by a processor (120) of the electronic device (101).

[0217] The operations of FIG. 13 may be included in operation 1140. In one embodiment, the operations of FIG. 12 and the operations of FIG. 13 may be performed in parallel.

[0218] Referring to FIG. 13, in operation 1310, the electronic device (101) can determine whether the user guide is activated. In one embodiment, the electronic device (101) can determine whether the user guide is activated based on metadata. In one embodiment, the electronic device (101) can identify whether a guide for an optimal display environment is provided based on common information of an animation schema.

[0219] In operation 1310, if the user guide is enabled (YES), the electronic device (101) can perform operation 1340. In operation 1310, if the user guide is not enabled (NO), the electronic device (101) can perform operation 1320.

[0220] In operation 1320, the electronic device (101) can reflect deformation information of the display in metadata related to the reactive animation. In one embodiment, the electronic device (101) can input a value identified based on the deformation information of the display into the metadata. For example, the electronic device (101) can input a value identified based on the deformation information of the display into the display schema.

[0221] In operation 1330, the electronic device (101) can play a reactive animation based on reflected metadata. In one embodiment, the electronic device (101) can play a reactive animation based on metadata with input values. In one embodiment, the electronic device (101) can play a reactive animation by generating an overlay based on metadata with input values ​​and outputting the generated overlay.

[0222] In operation 1340, the electronic device (101) can determine whether the deformation of the display deviates from the deformation setting. In one embodiment, the electronic device (101) can determine whether the deformation of the display differs from the deformation of the display set in the metadata (e.g., a specified folding direction). In one embodiment, the electronic device (101) can determine whether the deformation of the display deviates from the deformation range of the display set in the metadata (e.g., a specified folding angle range).

[0223] For example, the electronic device (101) can determine whether the folding direction of the display is different from the folding direction set in the metadata. For example, the electronic device (101) can determine whether the folding direction of the display is different from the folding direction set in the metadata. For example, the electronic device (101) can determine whether the folding angle of the display is different from the folding angle set in the metadata. For example, the electronic device (101) can determine whether the folding angular velocity of the display is different from the folding angular velocity set in the metadata. For example, the electronic device (101) can determine whether the inflection point of the display is different from the inflection point set in the metadata. For example, the electronic device (101) can determine whether the inflection line of the display is different from the inflection line set in the metadata.

[0224] In operation 1340, if the deformation of the display deviates from the deformation setting (YES), the electronic device (101) can perform operation 1350. In operation 1340, if the deformation of the display does not deviate from the deformation setting (NO), the electronic device (101) can perform operation 1320.

[0225] In operation 1350, the electronic device (101) can output guide information. In one embodiment, the electronic device (101) can output a guide containing information about an optimal display environment. In one embodiment, the electronic device (101) can output guide information about a folding direction, folding angle, folding angular velocity, inflection point, inflection line, or a combination thereof set by an editor.

[0227] FIG. 14 illustrates a meta-information setting operation of an electronic device (101) according to one embodiment of the present disclosure. The operations of FIG. 14 can be performed by a processor (120) of the electronic device (101).

[0228] Referring to FIG. 14, in operation 1410, the electronic device (101) can determine whether a real-time change is set. In one embodiment, the electronic device (101) can determine whether a real-time change of metadata is set based on metadata. In one embodiment, the electronic device (101) can determine whether a real-time change of metadata is set based on information indicating whether an animation schema is updated.

[0229] In operation 1410, if real-time change is set (YES), the electronic device (101) can perform operation 1440. In operation 1410, if real-time change is not set (NO), the electronic device (101) can perform operation 1420.

[0230] In operation 1420, the electronic device (101) can reflect deformation information of the display in metadata related to the reactive animation. In one embodiment, the electronic device (101) can input a value identified based on the deformation information of the display into the metadata. For example, the electronic device (101) can input a value identified based on the deformation information of the display into the display schema.

[0231] In operation 1430, the electronic device (101) can play a reactive animation based on reflected metadata. In one embodiment, the electronic device (101) can play a reactive animation based on metadata with input values. In one embodiment, the electronic device (101) can play a reactive animation by generating an overlay based on metadata with input values ​​and outputting the generated overlay.

[0232] In operation 1440, the electronic device (101) can identify whether the display is deformed. In one embodiment, the electronic device (101) can identify whether the display is deformed by comparing the display deformation information from a previous point in time with the display deformation information from a current point in time. In one embodiment, the electronic device (101) can identify whether the display is deformed by comparing the display deformation information applied to a previous frame with the display deformation information to be applied to a current frame. The previous frame may be the frame immediately preceding the current frame.

[0233] In operation 1450, the electronic device (101) can reflect the deformation information of the new display in the metadata related to the reactive animation. In one embodiment, the electronic device (101) can input a value identified based on the deformation information of the new display into the metadata. For example, the electronic device (101) can input a value identified based on the deformation information of the new display into the display schema.

[0235] FIG. 15 shows an example of a physical animation according to one embodiment of the present disclosure.

[0236] Referring to FIG. 15, when an electronic device (101) plays a video in a folded state (1501) at a specific angle (e.g., 60 degrees), an animation such as an object falling along an inclined plane may be applied. In this case, the speed of movement of the object may vary depending on the position of the object. For example, the speed of movement of the object in a first section (1510) on the display having a specific angle (e.g., 60 degrees) relative to the horizontal plane may be faster than the speed of movement of the object in a second section (1530) on the display parallel to the horizontal plane.

[0237] In one embodiment, the movement speed of the object may decrease as the angle with respect to the horizontal plane decreases. In another embodiment, the movement speed of the object may increase as the angle with respect to the horizontal plane increases.

[0239] FIG. 16 shows an example of a hinge animation according to one embodiment of the present disclosure.

[0240] Referring to FIG. 16, when an electronic device (101) plays a video in a state (1601) that is folded at a specific angle, an animation such as the object falling along an inclined surface may be applied.

[0241] In one embodiment, when an object moves in the first section (1620) and encounters the folding axis (1610), an animation may be applied in which the object is hidden by the folding axis (1610). In one embodiment, when a time has elapsed considering the width set on the folding axis (1610) and the movement speed of the object, an animation may be applied in which the object moves out of the folding axis (1610). Subsequently, an animation may be applied in which the object moves through the second section (1640).

[0243] FIG. 17 shows an example of dynamic animation according to one embodiment of the present disclosure.

[0244] Referring to FIG. 17, when the electronic device (101) plays an image in a flat state (1701), an animation may be applied in which the target moves at a constant speed in each segment (1711, 1721, 1715). When the electronic device (101) plays an image in a bent state (1703) on at least two axes, an animation may be applied in which the target moves at a relatively slow speed in the segments (1721, 1725) and moves at a relatively fast speed in the segment (1723).

[0246] An electronic device (101) according to one embodiment comprises a processor (120); and a memory (190) for storing instructions, and the instructions may be configured to generate metadata for the content such that when executed by the processor (120), the electronic device (101) obtains a first user input for setting the type of display on which the content is played, obtains a second user input for identifying the target of the animation, obtains a third user input for setting the effect of the animation applied to the identified target, and the degree of the effect of the animation is changed according to the transformation of the display of the type.

[0247] In one embodiment, when the instructions are executed by the processor (120), the electronic device (101) is configured to generate metadata that sets possible variations of the display associated with the type of the display, the type including a flat display, a foldable display, a flexible display, or a combination thereof, and if the type is the foldable display, the possible variations associated with the type include a folding direction, a folding angle, a folding angular velocity, or a combination thereof, and if the type is the flexible display, the possible variations associated with the type may include an inflection point and / or an inflection line.

[0248] In one embodiment, a display device is further included, and the value of the possible variation associated with the type can be identified based on the variation of the display device.

[0249] In one embodiment, when the instructions are executed by the processor (120), the electronic device (101) is configured to generate metadata that sets whether to guide the recommended value of the possible variation associated with the type of the display, and the recommended value can be identified based on the variation of the display device.

[0250] In one embodiment, when the instructions are executed by the processor (120), the electronic device (101) is configured to generate metadata that determines the type of animation and sets at least one characteristic of the effect associated with the determined type of animation, and the type of animation may include transition animation, dynamic animation, physics animation, hinge animation, or a combination thereof.

[0251] In one embodiment, the at least one characteristic of the effect may be set to change according to a variation of the display of the type.

[0252] In one embodiment, the instructions may be configured to generate metadata that, when executed by the processor (120), allows the electronic device (101) to set whether a value input to the at least one characteristic can be changed during playback of the content.

[0253] In one embodiment, the object may include an image of the content, an audio of the content, a decoration, or a combination thereof.

[0254] An electronic device (101) according to one embodiment comprises a display (160); a processor (120); and a memory (101) for storing instructions, wherein when the instructions are executed by the processor (120), the electronic device (101) identifies a request for playback of content and identifies a first effect related to a variation of the display among at least one effect of an animation set by the metadata of the content, and while playing the content through the display: based on the variation of the display, the value of the first effect of the animation set by the metadata is changed, and based on the changed value, the animation showing the first effect is played.

[0255] In one embodiment, the metadata sets possible variations associated with the type of the display, the type includes a flat display, a foldable display, a flexible display, or a combination thereof, and if the type is the foldable display, the possible variations associated with the type include a folding direction, a folding angle, a folding angular velocity, or a combination thereof, and if the type is the flexible display, the possible variations associated with the type may include an inflection point and / or an inflection line.

[0256] In one embodiment, the instructions may be configured such that when executed by the processor (120), the electronic device (101) changes the value of the first effect based on the identification of a variation specified for the first effect among the possible variations associated with the type.

[0257] In one embodiment, the instructions may be configured to guide a recommended value of the specified variation in response to the electronic device (101) identifying that the specified variation for the first effect is outside the reference range when executed by the processor (120).

[0258] In one embodiment, the object may include an image of the content, an audio of the content, a decoration, or a combination thereof.

[0259] A method of operation of an electronic device (101) according to one embodiment may include: acquiring a first user input for setting a type of display on which content is played; acquiring a second user input for identifying a target of an animation; acquiring a third user input for setting an effect of the animation applied to the identified target; and generating metadata for the content such that the degree of the effect of the animation changes according to a transformation of the display of the type.

[0260] In one embodiment, the operation of generating the metadata includes the operation of generating the metadata for setting possible variations of the display associated with the type of the display, wherein the type includes a flat display, a foldable display, a flexible display, or a combination thereof, and if the type is the foldable display, the possible variations associated with the type include a folding direction, a folding angle, a folding angular velocity, or a combination thereof, and if the type is the flexible display, the possible variations associated with the type may include an inflection point and / or an inflection line.

[0261] In one embodiment, the value of the possible variation associated with the type can be identified based on the variation of the display device of the electronic device.

[0262] In one embodiment, the operation of generating the metadata includes the operation of generating the metadata that sets whether to guide the recommended value of the possible variation associated with the type of the display, and the recommended value can be identified based on the variation of the display device.

[0263] In one embodiment, the operation of generating the metadata includes the operation of determining the type of the animation and the operation of generating the metadata that sets at least one characteristic of the effect associated with the determined type of the animation, and the type of the animation may include transition animation, dynamic animation, physics animation, hinge animation, or a combination thereof.

[0264] In one embodiment, the at least one characteristic of the effect may be set to change according to a variation of the display of the type.

[0265] In one embodiment, the operation of generating the metadata may include the operation of generating the metadata that sets whether a value input to the at least one characteristic can be changed during the playback of the content.

[0267] The electronic device according to the various embodiments disclosed in this document may be a device of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0268] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, each of phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as “first,” “second,” or “first” or “second” may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicationally,” it means that said component may be connected to said other component directly (e.g., wired), wirelessly, or through a third component.

[0269] As used in the various embodiments of this document, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0270] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0271] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0272] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

Claim 1 In an electronic device, a processor; The electronic device includes a memory for storing instructions, wherein when the instructions are executed by the processor, the electronic device: in response to the execution of an editing function for applying an animation object to a playback screen of content, provides a list of animation objects applicable to the playback screen of content, identifies a target animation object to be applied to the playback screen of content among the applicable animation objects included in the list, sets a first animation effect including at least one of a position, direction of movement, or speed of movement for the target animation object displayed through an unfolded display when the content to which the target animation object is applied is played, sets a second animation effect including at least one of a position, direction of movement, or speed of movement for the target animation object displayed through a first folded display that is folded within an angle range specified based on a folding axis when the content to which the target animation object is applied is played, and is configured to store the first animation effect and the second animation effect in association with the content to which the target animation object is applied, wherein the second animation effect is on the target animation object displayed through either a first area or a second area of ​​the display separated based on the folding axis An electronic device comprising an effect for and an effect for the animation object displayed through another area among the first area and the second area. Claim 2 In claim 1, the electronic device, when the instructions are executed by the processor, sets the display of a guide object guiding the first folding state when the content to which the target animation object is applied is played through a display of a second folding state that is folded beyond the specified angle range with respect to the folding axis. Claim 3 In claim 1, at least a portion of the effect on the target animation object displayed through the first area of ​​the display and the effect on the animation object displayed through the second area of ​​the display are different electronic devices. Claim 4 An electronic device according to claim 1, wherein the second animation effect includes an effect on the target animation object displayed at the boundary between the first region and the second region. Claim 5 In claim 1, the display is an electronic device comprising a flexible display. Claim 6 The electronic device according to claim 1, wherein the display comprises a foldable display. Claim 7 An electronic device according to claim 1, comprising a display, wherein, when the instructions are executed by the processor, the electronic device outputs a user interface through the display that enables the designation of the first animation effect and the second animation effect, and is configured to set the first animation effect and the second animation effect based on input to the user interface. Claim 8 An electronic device according to claim 1, wherein, when the instructions are executed by the processor, the electronic device outputs a user interface through the display that enables the electronic device to specify the specified angle range, and is configured to set the specified angle range based on input to the user interface. Claim 9 An electronic device comprising: a flexible display; a processor; and a memory for storing instructions, wherein when the instructions are executed by the processor, the electronic device identifies a request for playback of content, and if the content is content to which an animation object is applied, obtains an animation effect including at least one of a position, a direction of movement, or a speed of movement for the animation object displayed through the flexible display, and is configured to display the animation object based on the animation effect while the content is being played through the flexible display, wherein the animation effect includes a first animation effect for the animation object displayed through the flexible display in an unfolded state and a second animation effect for the animation object displayed through the flexible display in a folded state, wherein the second animation effect includes an effect for the animation object displayed through either a first area or a second area of ​​the flexible display separated by a folding axis and an effect for the animation object displayed through the other area of ​​the first area and the second area. Claim 10 A method of operating an electronic device, comprising: providing a list of animation objects applicable to the playback screen of the content in response to the execution of an editing function that applies an animation object to the playback screen of the content; identifying a target animation object to be applied to the playback screen of the content among the applicable animation objects included in the list; setting a first animation effect including at least one of a position, direction of movement, or speed of movement for the target animation object displayed through a display in an unfolded state when the content to which the target animation object is applied is played; and setting a second animation effect including at least one of a position, direction of movement, or speed of movement for the target animation object displayed through a display in a first folded state that is folded within an angle range specified with respect to a folding axis when the content to which the target animation object is applied is played, wherein the second animation effect includes an effect for the target animation object displayed through either a first area or a second area of ​​the display separated with respect to the folding axis, and an effect for the animation object displayed through the other area among the first area and the second area. Claim 11 delete Claim 12 delete Claim 13 delete Claim 14 delete Claim 15 delete Claim 16 delete Claim 17 delete Claim 18 delete Claim 19 delete Claim 20 delete