Method for providing information on basis of repetitive content, and electronic device supporting same
Patent Information
- Application Number
- PCT/KR2026/004257
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-06-20
- Filing Date
- 2026-03-16
- Publication Date
- 2026-10-01
Smart Images

Figure KR2026004257_01102026_PF_FP_ABST
Abstract
Description
Method for providing repeatable content-based information and electronic device supporting the same
[0001] Various embodiments of this document relate to an electronic device capable of providing new information using stored content.
[0002] Portable electronic devices, such as smartphones, support a wide range of functions in addition to calling, including internet browsing, file storage, photography, task scheduling, and alarms. Users utilize these versatile portable devices to collect and store diverse information across their daily lives.
[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.
[0004] An electronic device according to one embodiment of the present invention comprises a display, at least one processor, and a memory for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to check for repeatability of a plurality of contents stored in the memory in response to a specified condition, generate a first recommended content based on the plurality of contents having repeatability, and output information related to the first recommended content to the display in response to a set output condition.
[0005] An electronic device according to one embodiment of the present invention comprises a display, at least one camera, at least one processor, and a memory for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to determine whether a specified condition is met, and if it is determined that the specified condition is met, select two or more image data corresponding to the specified condition from at least one of the image data stored in the memory or image data stored in a server to which access by the electronic device is permitted, generate at least one new image data corresponding to the specified condition in addition to the previously captured image data, generate an image data group including the two or more selected image data corresponding to the specified condition and the generated new image data, and display a notification through the display indicating that the image data group has been created.
[0006] A method for providing information of an electronic device according to one embodiment of the present invention may include: determining whether a specified condition is met; when it is determined that the specified condition is met, selecting two or more image data corresponding to the specified condition from at least one of image data stored in a memory included in the electronic device or image data stored in a server accessible to the electronic device; generating at least one new image data corresponding to the specified condition in addition to the previously captured image data; generating an image data group including the two or more selected image data corresponding to the specified condition and the generated new image data; and displaying a notification through the display indicating that the image data group has been created.
[0007] FIG. 1 is a block diagram of an exemplary electronic device (100) capable of performing the operations described in this document.
[0008] FIG. 2 is a front view of an electronic device according to one embodiment.
[0009] FIG. 3 is a plan view of the rear direction of an electronic device according to one embodiment.
[0010] FIG. 4 is a partially exploded perspective view of the electronic device of FIG. 2 and FIG. 3 including a hinge device according to one embodiment.
[0011] FIG. 5 is a diagram showing an example of an information provision system environment according to one embodiment.
[0012] FIG. 6 is a diagram showing an example of a content-based information provision system with repeatability according to one embodiment.
[0013] FIG. 7 is a diagram showing an example of a personal data construction system according to one embodiment.
[0014] FIG. 8a is a diagram showing an example of a content creation system having repeatability according to one embodiment.
[0015] FIG. 8b is a diagram showing another example of a content creation system having repeatability according to one embodiment.
[0016] FIG. 9 is a diagram showing an example of a recommended content generation and additional module configuration according to one embodiment.
[0017] FIG. 10 is a drawing illustrating the generation of recommended content according to one embodiment.
[0018] FIG. 11 is a diagram showing an example of a screen interface related to story output according to one embodiment.
[0019] FIG. 12 is a diagram showing an example of generating recommended content according to one embodiment.
[0020] FIG. 13 is a diagram showing an example of providing a story including recommended content according to one embodiment.
[0021] FIG. 14 is a drawing showing an example of providing a story guide according to one embodiment.
[0022] FIG. 15a is a diagram illustrating an example of recommendation content generation and story provision according to one embodiment.
[0023] FIG. 15b is a diagram showing another example of recommendation content generation and story provision according to one embodiment.
[0024] FIG. 16 is a diagram showing an example of utilizing a story guide function according to one embodiment.
[0025] FIG. 17 is a diagram illustrating an example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0026] FIG. 18 is a diagram showing another example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0027] FIG. 19 is a diagram showing another example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0028] FIG. 20 is a diagram illustrating an example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0029] FIG. 21 is a diagram illustrating an example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0030] Hereinafter, various embodiments of this document are described with reference to the attached drawings.
[0031] Various embodiments of the present document below present a method for providing information based on repeatable content that supports providing information of interest to a user by utilizing content collected and stored through an electronic device, and an electronic device that supports the same.
[0032] One or more selected features of any one embodiment described in this disclosure may be combined with one or more selected features of any other embodiment described in this disclosure, and such alternative combination of features is possible if it at least partially alleviates one or more technical problems discussed in this disclosure or at least partially alleviates technical problems discernible from this disclosure by a person skilled in the art, and furthermore, such combination is possible if the specific combination or permutation of the embodiment features thus formed is not understood by a person skilled in the art to be incompatible.
[0033] In any described example implementation, two or more physically distinct components may alternatively be integrated into a single component if such integration is possible, provided that the same function is performed by the single component thus formed. Conversely, a single component of any embodiment described in this disclosure may alternatively be implemented by two or more distinct components that achieve the same function, where appropriate.
[0034] Other intended purposes according to the embodiments described herein will be mentioned as necessary during the process of explaining each embodiment. For example, various purposes and effects through a content-based information provision method with repeatability according to various embodiments and an electronic device supporting the same may be mentioned according to the embodiments of the detailed description.
[0035] FIG. 1 is a block diagram of an exemplary electronic device (100) capable of performing the operations described in this document.
[0036] Referring to FIG. 1, the electronic device (100) may be one of various forms of electronic devices, such as a notebook (190), smartphones (191) having various form factors (e.g., a bar-type smartphone (191-1), a foldable-type smartphone (191-2), or a sliderable (or rollable)-type smartphone (191-3)), a tablet (192), a cellular phone (not shown), and other similar computing devices (not shown). The components, their relationships, and their functions illustrated in FIG. 1 are illustrative only and are not intended to limit the implementations described or claimed herein. The electronic device (100) may be referred to as a mobile device, a user device, a multifunction device, a portable device, or a server.
[0037] The electronic device (100) may include components comprising at least one processor (110) (hereinafter referred to as processor (110)), at least one memory (120) (hereinafter referred to as memory (120)), at least one display (140) (hereinafter referred to as display (140)), at least one image sensor (150) (hereinafter referred to as image sensor (150)), at least one communication circuit (160) (hereinafter referred to as communication circuit (160)), and / or at least one sensor (170) (hereinafter referred to as sensor (170)). The components are merely exemplary. For example, the electronic device (100) may include other components (e.g., power management integrated circuitry (PMIC), audio processing circuit, antenna, rechargeable battery, or input / output interface). For example, some components may be omitted from the electronic device (100). For example, some components may be integrated into a single component.
[0038] The processor (110) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (110) may include at least one electrical circuit and may process instructions (or programs, data, etc.) stored in memory (120) individually or collectively in a distributed manner. The processor (110) may include a processor assembly comprising one or more processing circuits. The processor (110) may include any processing circuit that is operative to control the performance and operations of one or more components of the electronic device (100) (e.g., memory (120), display (140), image sensor (150), communication circuit (160), and / or sensor (170)). For example, the processor (110) (e.g., application processor (AP)) may be implemented as a system on chip (SoC) (e.g., a single chip or chipset). For example, the processor (110) may be implemented with a plurality of cores (or at least one core circuit), a plurality of chips, or a plurality of chipsets. For example, the processor (110) may include one or more processing circuits. For example, the processor (110) may include one or more processing circuits configured to perform the various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (110) may be included in a first chip of the electronic device (100), and at least another portion of the processor (110) may be included in a second chip of the electronic device (100) different from the first chip of the electronic device (100).
[0039] For example, the processor (110) may include a central processing unit (111), a graphics processing unit (112), a neural processing unit (113), an image signal processor (114), a display controller (115), a memory controller (116), a storage controller (117), a communication processor (118), and / or a sensor interface (119). These components of the processor (110) are merely exemplary. For example, the processor (110) may include other components. For example, some components of the processor (110) may be omitted from the processor (110). For example, some components of the processor (110) may be included as separate components of the electronic device (100) outside of the processor (110). For example, some components of the processor (110) (e.g., memory controller (116)) may be included in other components (e.g., at least part of memory (120), an interface (e.g. available for connection to at least one component of the electronic device (100)), a display (140) and / or an image sensor (150)).
[0040] The processor (110) may cause other components of the electronic device (100) to perform various operations by executing instructions stored in memory (120). The CPU (111) (or central processing circuit) may be configured to control the components of the processor (110) based on the execution of instructions stored in memory (120) (e.g., volatile memory (121) and / or non-volatile memory (122)). The GPU (112) (or graphics processing circuit) may be configured to execute parallel operations (e.g., rendering). The NPU (113) (or neural processing circuit, or AI (artificial intelligence) chip) may be configured to execute operations for an artificial intelligence model (e.g., convolution computation). An ISP (114) (or image signal processing circuit) may be configured to process a raw image acquired through an image sensor (150) into a format suitable for a component within the electronic device (100) or a component of the processor (110). A display controller (115) (or display control circuit, or DPU (display processing unit)) may be configured to process an image acquired from a CPU (111), GPU (112), ISP (114), or memory (120) (e.g., volatile memory (121)) into a format suitable for a display (140). A memory controller (116) (or memory control circuit) may be configured to control reading data from the volatile memory (121) and writing data to the volatile memory (121). A storage controller (117) (or storage control circuit) may be configured to control reading data from the non-volatile memory (122) and writing data to the non-volatile memory (122).The CP (118) (communication processing circuit) may be configured to process data obtained from a component of the processor (110) into a format suitable for transmitting to another electronic device via the communication circuit (160), or to process data obtained from another electronic device via the communication circuit (160) into a format suitable for processing by the component of the processor (110). For example, the communication circuit (160) may include one or more communication circuits. The sensor interface (119) (or sensing data processing circuit, sensor hub) may be configured to process data regarding the state of the electronic device (100) and / or the state around the electronic device (100), obtained through the sensor (170), into a format suitable for the component of the processor (110).
[0041] Memory (120) may include one or more storage media (or one or more storage devices). For example, memory (120) may include a memory assembly comprising one or more storage media. For example, the one or more storage media may include a hard drive, a permanent memory such as flash memory, read-only memory (ROM) (e.g., non-volatile memory (122)), a semi-permanent memory such as random access memory (RAM) (e.g., volatile memory (121)), any other suitable type of storage (or storage assembly), or any combination thereof. Memory (120) may include a cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (100). As an example not limited to, the cache memory may be included within the processor (110). The memory (120) may be fixedly embedded within the electronic device (100) or incorporated into one or more suitable types of components (e.g., a SIM (subscriber identity module) card and / or an SD (secure digital) card) that can be repeatedly inserted into and removed from the electronic device (100).
[0042] For example, memory (120) may store one or more software applications, such as operating system (or system) software applications, firmware software applications, driver software applications, plugin (e.g., add-in, add-on, and / or applet) software applications, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (110). For example, memory (120) may store instructions that can be called by an application programming interface (API). For example, memory (120) may store instructions within a library.
[0043] FIG. 2 is a front perspective view of an electronic device according to one embodiment. FIG. 3 is a rear plan view of an electronic device according to one embodiment.
[0044] The electronic device (200) described in FIGS. 2 and 3 is an exemplary representation of one type of electronic device (100) described in FIG. 1. For example, the electronic device (200) is an example of a foldable type smartphone (191-2) described in FIG. 1, and the repeatable content-based information provision function according to the embodiment of the present description is not limited to the structure of the electronic device. For example, the electronic device (200) shown in FIGS. 2 and 3 is an electronic device having a repeatable content-based information provision function according to the embodiment of the present description, and can be replaced with various types of smartphones (e.g., the bar-type smartphone (191-1) of FIG. 1 or the sliderable (or rollable) type smartphone (191-3)).
[0045] Referring to FIGS. 2 and 3, the electronic device (200) may include a first housing (210) (e.g., a first housing structure) comprising a first side member (213) (e.g., a side bezel) and a second housing (220) (e.g., a second housing structure) comprising a second side member (223) (e.g., a side bezel), which are foldably joined to each other with respect to a folding axis (F) through at least one hinge device (240, 240-1) (e.g., a hinge module or a hinge structure) with respect to a folding axis (F). For example, the first housing (210) and the second housing (220) may be configured as a foldable housing (e.g., a housing structure). For example, the electronic device (200) may include a first display (230) (e.g., a flexible display, a foldable display, or a main display) (e.g., the display (140) of FIG. 1) positioned to be supported by a first housing (210) and a second housing (220). For example, the first housing (210) may include a first surface (211) and a second surface (212) facing in the opposite direction of the first surface (211) (e.g., the -z axis direction). For example, the second housing (220) may include a third surface (221) and a fourth surface (222) facing in the opposite direction of the third surface (221) (e.g., the -z axis direction). For example, the first housing (210) may include a first rear cover (214) coupled with a first side member (213). For example, the second housing (220) may include a second rear cover (224) combined with a second side member (223). For example, when the electronic device (200) is in a fully unfolded first state (e.g., unfolded state or unfolded state), the first surface (211) and the third surface (221) may be operated so that they face substantially the same direction (e.g., z-axis direction).For example, when the electronic device (200) is in a completely folded second state (e.g., a folded state or a folded state), the first side (211) and the third side (221) may be operated to face each other or face in opposite directions. For example, the electronic device (200) may be operated to maintain a third state (e.g., an intermediate state) between the first state and the second state.
[0046] According to one embodiment, the electronic device (200) may include a receiver (201) disposed on a first surface (211) of a first housing (210), at least one sensor module (204) (e.g., an ambient light sensor) and / or at least one first camera module (205) (e.g., a UDC, under display camera). For example, the electronic device (200) may include at least one key (206) disposed on a first side member (213). For example, the electronic device (200) may include a second display (231) (e.g., a sub-display), at least one second camera module (208) and / or a flash (209) disposed on a second surface (212) (e.g., a first rear cover (214)) of the first housing (210). For example, the second display (231) may be disposed to be visible from the outside through at least a portion of the first rear cover (214). For example, the electronic device (200) may include a speaker (202), a microphone (203), or a connector port (207) disposed on the second side member (223). At least some of the aforementioned plurality of components may be repositioned to the first housing (210) and / or the second housing (220).
[0047] According to one embodiment, the first display (230) (e.g., flexible display) may include a first region (230a) (e.g., first planar portion) corresponding to at least a portion of the first surface (211), a second region (230b) (e.g., second planar portion) corresponding to at least a portion of the third surface (221), and a third region (230c) (e.g., flexible portion) connecting the first region (230a) and the second region (230b), wherein the electronic device (200) is deformed in a second state (e.g., folding state) and / or a third state (e.g., intermediate state). For example, the third region (230c) may be positioned so as to overlap at least partially with at least one hinge device (240, 240-1) when the first display (230) is viewed from above (e.g., in the z-axis direction). For example, the first display (230) may be positioned so as not to be seen from the outside in the second state, with the first surface (211) and the third surface (221) facing each other (e.g., inward-fold type). For example, the first display (230) may be positioned so as to be seen from the outside in the second state, with the first surface (211) and the third surface (221) facing in opposite directions (e.g., outward-fold type).
[0048] FIG. 4 is a partially exploded perspective view of the electronic device of FIG. 2 and FIG. 3 including a hinge device according to one embodiment.
[0049] Referring to FIG. 4, the electronic device (200) may include at least one hinge device (240, 240-1) (e.g., hinge module or hinge structure) connecting the first housing (210) and the second housing (220) below the first display (230) (e.g., in the -z axis direction). For example, the at least one hinge device (240, 240-1) may include a first hinge device (240) and a second hinge device (240-1) spaced apart from the first hinge device (240) along a direction parallel to the folding axis (F) (e.g., in the ± y axis direction). For example, at least one hinge device (240, 240-1) may be supported by a first support member (2131) extending from a first side member (213) into a first space (2101) of a first housing (210) and a second support member (2231) extending from a second side member (223) into a second space (2201) of a second housing (220). For example, at least one hinge device (240, 240-1) may be positioned between the first housing (210) and the second housing (220) so as not to be seen from the outside through a hinge housing (250) (e.g., a hinge cover).
[0050] According to one embodiment, the first hinge device (240) may include a first rotation member (241) (e.g., a first arm or a first rotator) disposed on a first support member (2131) of a first housing (210), a second rotation member (242) (e.g., a second arm or a second rotator) disposed on a second support member (2231) of a second housing (220), and a gear assembly (243) connected to the first rotation member (241) and the second rotation member (242) so that the first housing (210) and the second housing (220) rotate symmetrically with respect to each other. For example, the gear assembly (243) may include a plurality of gears (e.g., spur gears and / or worm gears) that are geared to each other. For example, the gear assembly (243) may include a cam coupling structure for providing a free stop at various folding angles, which presses the first housing (210) and the second housing (220) with respect to each other in a direction intended to transition from a first state (e.g., unfolded state) to a second state (e.g., folded state) or from a second state to a first state. For example, the second hinge device (240-1) may be substantially symmetric to or have substantially the same configuration as the first hinge device (240).
[0051] According to one embodiment, the electronic device (200) may be coupled with at least one hinge device (240, 240-1) and may include at least one detent module (244) for providing a stopping sensation at various angles. For example, at least one hinge device (240, 240-1) and / or detent module (244) may form substantially the same plane as the first support member (2131) and the second support member (2231) when the electronic device (200) is in a first state. For example, the second hinge device (240-1) may be substantially symmetric to the first hinge device (240) or have substantially the same configuration.
[0052] FIG. 5 is a diagram showing an example of an information provision system environment according to one embodiment.
[0053] Referring to FIGS. 1 to 5, a repeatable content-based information provision system environment (10) according to one embodiment may include an electronic device (300) (or user terminal), a network (50), and a server device (400).
[0054] The above network (50) may include at least one network hardware capable of forming a communication channel between an electronic device (300) and a server device (400), and software required to operate the network hardware. This network (50) is configured to support the communication function of the electronic device (300) in the process of supporting the information provision function of the electronic device (300), and is not limited to specific elements such as type, size, or location. The above network (50) is configured to perform signal processing related to the formation of a communication channel of the electronic device (300), and is not limited to a specific communication method or communication generation. For example, if the electronic device (300) is a mobile communication terminal, the network (50) may include a base station capable of supporting the communication connection of the mobile communication terminal, a base station control device, and a core network supporting the internet connection of the electronic device (300). According to one embodiment, the network (50) may form at least one of a wireless communication channel or a wired communication channel with the server device (400) in relation to supporting the communication function of the server device (400).
[0055] The electronic device (300) may include at least one of the electronic device (100) or electronic device (200) described above in FIGS. 1 to 4. As an example, the electronic device (300) may form a communication channel with a server device (400) through a network (50). The electronic device (300) may provide at least one content or a plurality of content (e.g., two or more video data, or images, or image data) to the server device (400) and receive information generated based on the plurality of content (e.g., recommendation information, recommendation content, new content, or new video data) from the server device (400). The electronic device (300) may output the information received from the server device (400) (e.g., recommendation information, recommendation content, or new video data) or output the received information (e.g., recommendation information, recommendation content, or new video data) together with the plurality of content delivered to the server device (400). The received information above may include recommended content (or new video data, new content, or recommendation information) generated by a generative AI model based on the plurality of contents.
[0056] According to one embodiment, the electronic device (300) can generate a story based on at least some of the plurality of contents and output the generated story. The electronic device (300) can generate a story based on contents in which at least some of the following are similar: similarity of the creation time of the plurality of contents, similarity of the creation location of the contents, identity or similarity between objects included in each of the output information of the contents, similarity of the subject included in the description information of the contents, or similarity of the composition included in the description information of the contents. Alternatively, the electronic device (300) may select a plurality of contents according to a preset condition or a random method and generate a story using the selected plurality of contents.
[0057] According to one embodiment, the electronic device (300) may output the recommended content together (or separately) in the story output operation. For example, when the electronic device (300) receives the recommended content from the server device (400), it may output the received recommended content alone or together with the story. Alternatively, the electronic device (300) may output the recommended content alone or together with the story depending on the current location of the electronic device (300) or the activation of a set application or hardware device (e.g., camera device). As an example, the electronic device (300) may generate the recommended content directly.
[0058] According to one embodiment, the electronic device (300) may upload content (or captured video, captured image, or video data) collected through a camera to a server device (400) at a set period or in real time. Alternatively, the electronic device (300) may provide at least some of the stored content that satisfies specified conditions to the server device (400). The electronic device (300) may receive recommended content (or recommendation information, new content) from the server device (400) at a set period or within a set time after content transmission. The electronic device (300) may output the received recommended content (or recommendation information) at a time when the set conditions are satisfied.
[0059] According to one embodiment, the electronic device (300) may acquire two or more contents having repeatability (or continuity) (e.g., image data) from the memory of the electronic device (300) (or the database of the electronic device (300), or the database of the server device (400)) and transmit the multiple contents having repeatability acquired from the memory to the server device (400). If at least one of the content description information (or attributes) (e.g., creation location, creation time, objects included in the content (e.g., people), composition of the content, or content content) of the two or more contents is shared in common, the two or more contents may be described as having repeatability (or continuity, connection, relevance, hereinafter referred to as repeatability). For example, contents whose creation locations are the same or similar within a certain category may be considered as contents having repeatability. Alternatively, if the content consists of video data, the content may be repetitive if at least some of the objects included within the video data (e.g., people, objects, animals, buildings, or terrain) are identical or similar within a certain category. Alternatively, the content may be repetitive if the subject matter of the content (e.g., the theme of the video data in the case of video data) is in the same or similar category. Alternatively, the content may be repetitive if the creation time of the content is in the same or similar category. Alternatively, the content may be repetitive if the composition of the content is in the same or similar category. Alternatively, the content may be repetitive if the subject matter is in the same or similar category.
[0060] The electronic device (300) may receive recommendation content corresponding to a plurality of repeatable contents transmitted to the server device (400) from the server device (400), or receive a story (or story content, integrated content) that integrates the plurality of contents and the recommendation content from the server device (400). The electronic device (300) may output at least some of the received recommendation content (or recommendation information), the transmitted plurality of contents, or the story at a set time.
[0061] According to one embodiment, the electronic device (300) may include a repeatability of a specified condition among a plurality of stored contents (e.g., a common feature among content description information describing the attributes or characteristics of each content). The content description information may include at least one part of the content description information that includes at least one of the creation location of the content having repeatability compared to other content, the creation time of the content, an object included in the content, the composition of the content, or the subject of the content, and may extract content having repeatability, and may generate recommended content (or recommendation information) based on the extracted content. The electronic device (300) may independently perform the operation of outputting the generated recommended content (or recommendation information) and at least some of the content having repeatability of the specified condition.
[0062] In this regard, the electronic device (300) may include a communication circuit, memory, a processor, a display, an audio processing unit (e.g., at least one of a speaker and a microphone), or a camera. The electronic device (300) may collect a plurality of contents (e.g., video data) using the communication circuit or the camera. The memory of the electronic device (300) stores a plurality of contents collected through the communication circuit or the camera, and the processor of the electronic device (300) (e.g., the processor (110) of FIG. 1, hereinafter referred to as the processor (110)) may extract contents having repeatability of specified conditions from among the plurality of contents stored in the memory, generate recommended content (or recommendation information) based on the extracted contents, and then output at least some of the recommended content (or recommendation information) and the repeatable contents through the display of the electronic device (300). According to one embodiment, the electronic device (300) may display a story, recommended content, or at least some of the repeatable contents in response to a request to execute a set application (e.g., a gallery app). According to one embodiment, the electronic device (300) may provide guidance on at least one of creating a new story or creating recommended content through a notification (or alert) (e.g., displaying on a display or outputting a notification audio signal). The notification (or alert) is provided through a alert or a pop-up window, and when user input occurs instructing the selection of the alert or pop-up window or the execution of an application related to the notification, the electronic device (300) may output at least some of the created story and recommended content.
[0063] Here, the electronic device (300) can play an audio file set through an audio processing unit and output the played audio. As an example, the memory of the electronic device (300) can store a plurality of commands set to extract content having repeatability of a specified condition among a plurality of stored content, generate recommended content (or recommendation information) based on the extracted content, and then display output at least some of the recommended content (or recommendation information) and the repeatable content (or story).
[0064] The server device (400) can support a function of providing information based on repetitive content through the network (50). For example, the server device (400) may include a cloud server device that forms a communication channel with the electronic device (300) and receives and stores various content from the electronic device (300). The server device (400) can check whether repetitive content is included among the various content provided by the electronic device (300) according to specified conditions. The server device (400) can generate recommended content (or recommendation information) based on some repetitive content among the plurality of content provided by the electronic device (300), and provide the generated recommended content (or recommendation information) to the electronic device (300). Alternatively, the server device (400) can integrate (or combine) the recommended content (or recommendation information) and the repetitive content to generate a new story (or an integrated story including the recommended content), and provide the generated new story (or integrated story) to the electronic device (300).
[0065] According to various embodiments, the server device (400) may store various contents collected by the electronic device (300) and support the electronic device (300) in performing at least one of searching, editing, or deleting the contents. In this regard, the server device (400) may include a server communication circuit capable of forming a communication channel with a network (50), a server memory for storing a plurality of contents provided by the electronic device (300), and a server processor that extracts contents having repeatability under specified conditions from among the stored plurality of contents, generates recommended content (or recommendation information) based on the extracted contents, and then provides at least some of the contents having repeatability with the recommended content (or recommendation information) to the electronic device (300). As an example, the server memory may store a plurality of commands configured to extract contents having repeatability under specified conditions from among the plurality of contents stored in the server memory, generate recommended content (or recommendation information) based on the extracted contents, and then provide at least some of the contents having repeatability with the recommended content (or recommendation information) to the electronic device (300). For example, server memory may store a story generated based on multiple contents and recommended content generated by referencing said story. For example, said recommended content may include a composite image in which at least part of the background and characters of the contents included in the story are combined.
[0066] According to one embodiment, the server device (400) can generate at least a portion of recommended content using generative AI. For example, the server device (400) can generate at least a portion of the image portion of the recommended content by referencing images included in content having a story or repetitiveness using generative AI. For example, the server device (400) can include at least a portion of the objects of content having a story or repetitiveness in the recommended content using generative AI. According to one embodiment, the server device (400) can generate an image related to the content of the recommended content and reflect it in the recommended content. For instance, in the process of generating recommended content that recommends visiting a specific amusement park (e.g., Disneyland or Everland), the server device (400) can generate a background with an image feel (or image style) corresponding to the amusement park (e.g., Disneyland or Everland) using generative AI and provide recommended content including the generated background. According to one embodiment, the entire recommended content can be generated through generative AI. For example, the server device (400) can generate recommended content by combining at least some of the amusement park background and the story or repetitive content objects using generative AI.
[0067] FIG. 6 is a diagram showing an example of a generative artificial intelligence system according to one embodiment.
[0068] At least a portion of the generative artificial intelligence system (600) described in FIG. 6 may be included in the electronic device (e.g., 100, 200, or 300) described above in FIG. 1 through 5. Alternatively, at least a portion of the generative artificial intelligence system (600) described in FIG. 6 may be included in the server device (400) described above in FIG. 5. Alternatively, a portion of the generative artificial intelligence system (600) may be included in the electronic device (300), and another portion may be included in the server device (400) described above in FIG. 5.
[0069] Referring to FIGS. 1 through 6, a generative artificial intelligence system (600) may include a user interface part (630), an AI framework part (640), knowledge repositories part (650) (or memory or database of an electronic device, or a database of a server device), an application and service part (660), and / or a generative AI model part (670). Each component of the generative artificial intelligence system may be operated on one or more of an electronic device (100), an external electronic device (200 or 300), or a server (400). For example, the user interface part (630) and the AI framework part (640) may be operated on the electronic device (300), and the knowledge repositories (650) and the generative AI model (670) may be operated on the server (400).
[0070] According to one embodiment, the user interface portion (630) may receive user input (e.g., user query). User input may be received in the form of text, images, voice (e.g., natural language), video, menu selection, or a combination thereof. The user interface portion (630) may include various content description information (e.g., running application or user location) related to the generative artificial intelligence system (600) at the time the user input is received, in addition to or instead of the user input. The user interface portion (630) may provide the user input or the various content description information to the AI framework portion (640) and provide the result of processing therefrom to the user (e.g., electronic device (300)) through the AI framework portion (640), for example. According to one embodiment, in addition to user input, the electronic device (300) may provide content description information obtained using information included on the screen to the AI framework portion (640). The above results may be provided in the form of text, images, voice, video, actions requested by the user (e.g., launching a specified function or app), or a combination thereof.
[0071] According to one embodiment, the user interface portion (630) may include a user query / response interface. The user interface portion (630) may include the electronic device (300) described above in FIGS. 1 to 5. The user interface portion (630) may be configured to collect user queries and output a response corresponding to the collected user queries. Alternatively, the user interface portion (630) may include an interface (e.g., a screen interface) configured such that a server device (400) collects user queries from the electronic device (300) and provides a response to the collected user queries.
[0072] According to one embodiment, the content description information may include the creation of specific contents having repetitiveness, the use of specific contents, and at least a portion of the content of specific contents. For example, if the specific contents are captured images, the content description information may include the location where the captured images were created, the time of creation of the captured images, information on objects included in the captured images, the composition of the captured images, and at least a portion of the content of the captured images. Such content description information may include repetitiveness (or continuity) with other contents. For example, the first content may include first content output information output through an electronic device (300) and first content description information related to the first content output information. The first content output information may include at least a portion of an image or video displayed on a display, an audio signal output through an audio device, vibration, and a lamp. The first content description information may include, for example, the location where the content was created, the time of creation of the content, object information of objects included in the first content output information (e.g., an image), composition information of the image, or content information describing the image. In the same or similar manner, the second content may include second content output information output through the electronic device (300) and second content description information related to the second content output information. The second content description information may include, for example, a place where the content was created, a time when the content was created, object information (e.g., if the first content output information output through the electronic device (300) includes image information, information on objects included in the image), composition information of the image, and at least some of the content information describing the image.
[0073] According to one embodiment, if the creation location of the first content and the creation location of the second content are the same or similar, the generative artificial intelligence system (600) may determine that the first content and the second content have content description information corresponding to the repetition of the location. For example, if at least a part of the creation time of the first content and the creation time of the second content are the same or similar, the generative artificial intelligence system (600) may determine that the first content and the second content have content description information corresponding to the repetition of the time. For example, if at least one person object (or first specific object object) included in the first content and at least one person object (or second specific object object) included in the second content are the same or similar, the generative artificial intelligence system (600) may determine that the first content and the second content have content description information corresponding to the repetition of the object. For example, if the shooting composition of the first content and the shooting composition of the second content are identical or similar, the generative artificial intelligence system (600) may determine that the first content and the second content have content description information corresponding to the repetition of the composition.
[0074] According to one embodiment, the content description information may include information about the application currently being used by the user through the electronic device (300) or the user's location information. As an example, the user input may include a form in which at least some of the aforementioned natural language, images, sounds, or content description information are mixed. As an example, the user input may include a non-natural language form that includes an operation of the electronic device (300), such as an action of selecting a menu or a specific icon through the electronic device (300). The user interface portion (630) may operate to output a result generated by the generative AI model portion (670) through the electronic device (300). The result may include at least one of a natural language form, a specific content form, or an action form requested by the user of the electronic device (300).
[0075] According to one embodiment, the user interface portion (630) may operate to transmit at least one content stored in the memory of the electronic device (300) to the server device (400) in response to scheduling information set in the electronic device (300). The user interface portion (630) may operate to store in the electronic device (300) or output through a display a recommendation content (or recommendation information) generated based on repetitive content received from the server device (400), a plurality of contents including the recommendation content (or recommendation information), or a story (e.g., video content, or slide content) formed by the recommendation content (or recommendation information) and the plurality of contents. In this regard, the user interface portion (630) may be placed in at least one of the electronic device (300) and the server device (400).
[0076] According to one embodiment, the AI framework part (640) can identify (e.g., estimate) user intent based on at least part of user input or content description information received from the user interface part (630), control each of the related modules (e.g., 641, 462, or 643) to perform a function or action corresponding to the identified user intent, and coordinate collaboration between two or more modules. The AI framework part (640) may include a prompt design part (641) (prompt design module) (or prompt generator, or prompt design module), an API management part (643) (APIs / plugins management module) (or API management module), or an output modification part (642) (output modification module or refiner module) (or output modification module). The AI framework part (640) can receive user input collected by the user interface part (630), identify user intent based on user queries included in the user input, and support the generation of results according to the user intent. In this regard, the AI framework part (640) can coordinate and control the transmission and reception of signals between the prompt design part (641), the API management part (643), the output modification part (642) (output modification module or refiner module), the knowledge repository part (650), and / or the application / service part (660).
[0077] According to one embodiment, the prompt design part (641) can generate a prompt to be input into a generative AI model (670) based at least partially on user input or content description information received from the user interface part (630). For example, the prompt design part (641) can generate a prompt using user preferences, a prompt library, or prompt examples stored in a knowledge repository (650) based at least partially on user input or content description information. As an example, the prompt design part (641) can be used to generate a prompt suitable for inputting user input into a Large Language Model (LM) or a Large Multimodal Model (LMM). The prompt design part (641) may be an AI component that uses a machine learning algorithm or a neural network to develop better prompts over time. The prompt design part (641) can generate a prompt by accessing a knowledge repository (650) containing user preference data, a prompt library, and prompt examples based on user input, and can transmit the generated prompt to the LLM or LMM.
[0078] According to one embodiment, the API management module (643) may communicate, for example, via an API, with various resources (e.g., a knowledge repository (650)) that provide said additional information when there is a request for said additional information in relation to user input. Additionally or generally, when a specified action (e.g., a function, app, or service) is performed in response to said user input, the API management module (643) may request the application / service part (660) to perform said specified action via a corresponding API. The API management module (643) may provide information obtained from the knowledge repository (650), the application / service part (660), or another external resource to the prompt design part (641). According to one embodiment, the API management part (643) (API / Plug-in management module) may perform the role of communicating with the outside when there is a request for said additional information when the user input is transmitted as input to the generative AI model part (670). For example, the API management section (643) establishes a channel for communicating with the outside world through an API (Application Programming Interface), and can access various data sources (e.g., knowledge repositories) through the established channel. Additionally, if the API management section (643) needs to perform an action that ultimately executes user input rather than an intermediate result in an application or service, it can request that action from the application / service section (660) via the API. Information obtained from external resources may be used to generate prompts in the prompt design section (641) along with user input, or it may be passed as input to the generative AI model section (670).
[0079] According to one embodiment, the output modification part (642) can fine-tune the results obtained through the generative AI model (670) as at least part of the response to user input (e.g., user query). For example, the output modification part (642) can determine whether the content of the response obtained through the generative AI model (670) is appropriate as a response to a request made by the user input. For example, the output modification part (642) can determine the degree of relevance, degree of bias (e.g., political or social bias), or degree of harmfulness (e.g., sexual or profanity) of the difference between the response obtained through the generative AI model (670) and the user input. For example, the output modification part (642) can verify whether the content generated through the LLM and / or LMM is irrelevant, does not contain biased content, or does not contain harmful content. Additionally, the output modification part (642) can determine the extent to which the result matches what the user wants, and if additional processing is required, proceed with the process. The output modification part (642) may additionally configure and provide a hint to the user to avoid unwanted output. Additionally or generally, the output modification part (642) may request that additional AI processing be performed on the acquired response, or provide a hint to the user to avoid unwanted output. For example, the response may be re-acquired through the generative AI model (670) by generating an additional prompt through the prompt design part (641).
[0080] According to one embodiment, the generative AI model part (670) may refer to an artificial intelligence neural network that generates new forms of data based on user input information. The generative AI model part (670) may include a model that generates images and / or a model that generates language. Models that generate images include, typically, GANs (generative adversarial networks) and VAEs (variational auto encoders), and may include diffusion-based generative models that use VAEs and Transformer structures. Models that generate language are models trained to output the statistically most appropriate output value based on input values, and may include, for example, models such as CHAT-GPT 3 or CHAT-GPT 4. Additionally, language generation models may include LMMs (large multimodal models), LLMs (large language models), LVMs (large vision models), or LAMs (large action models) that can recognize various forms of data input, such as text, images, or voice, and generate new data corresponding to them. LAM can automatically generate actions for an environment (e.g., a robot, a car, an electronic device (300) or a program). Additionally, for at least some AI models (e.g., LLM), there may be a low-rank adaptation (LoRA) adaptor fine-tuned, for example, for a specific task or specific situation.
[0081] A generative artificial intelligence system (600) having the configuration described above may be configured to generate content using a generative AI model part (670). A generative artificial intelligence system (600) according to one embodiment may receive multiple contents through a user interface part (630) and store them in a knowledge storage part (650), extract content with repeatability from the multiple contents stored in the knowledge storage part (650) using an AI framework part (640), and provide the extracted content to the generative AI model part (670). The AI framework part (640) may receive recommended content (or recommendation information) from the generative AI model part (670), provide the recommended content (or recommendation information) to an electronic device (300) for output, or generate a story containing the recommended content (or recommendation information) and provide it to the electronic device (300).
[0082] FIG. 7 is a diagram showing an example of a personal data construction system according to one embodiment.
[0083] Referring to FIGS. 1 through 7, the personal data building system (700) may include an APP data collection module (710), a Usage data collection module (720), a System data collection module (730), a Data Platform (740), and / or a Personal Data storage (750). According to one embodiment, the APP data collection module (710), the Usage data collection module (720), or the System data collection module (730) may be implemented as at least one hardware processor or as a software module executed by at least one hardware processor. For example, at least one of the APP data collection module (710), the Usage data collection module (720), or the System data collection module (730) may be implemented in a server device (400) to perform related operations on the server device (400).
[0084] According to one embodiment, at least a portion of the personal data building system (700) may be included in a content-based information provision system with repeatability as described above (e.g., the generative artificial intelligence system (600) of FIG. 6) or may be functionally (or operationally) connected to the generative artificial intelligence system (600). For example, at least a portion of the personal data building system (700) may be included in an electronic device (300) or in a server device (400).
[0085] The above app data collection module (710) may include a module that collects data resulting from the operation of an application executed by a user through an electronic device (300). In this regard, the electronic device (300) may store and install at least one application and execute at least one application in response to user operation.
[0086] The above user data collection module (720) may include a module for collecting data of a user using the electronic device (300). For example, the user data collection module (720) may include location information of the user using the electronic device (300) or information on the user's usage pattern of the electronic device (300). The above system data collection module (730) may collect data generated from the system of the electronic device (300). For example, it may collect at least some of the data related to the battery operation of the electronic device (300), data related to the use of communication services of the electronic device (300), or data collected by various sensors installed in the electronic device (300). The above data platform (740) may control data writing and reading operations of the personal data storage (750). For example, the data platform (740) can acquire app data collected by the app data collection module (710), user data collected by the user data collection module (720), or system data collected by the system data collection module (730), standardize the acquired data into a form that can be stored in the personal data storage (750), and then store the standardized data in the personal data storage (750). For example, the data platform (740) can perform indexing on the collected data and store it in the personal data storage (750).
[0087] For example, the data platform (740) may perform an analysis operation for generating personal data. For instance, the data platform (740) may analyze multiple contents to collect at least some of the following: time information of acquiring the multiple contents, location information of the creation or acquisition of the multiple contents, content information of each of the multiple contents (e.g., information of objects included in the content, composition information of the content, or information describing the content), and surrounding information related to the acquisition of the multiple contents, and may store at least some of the collected information together with the multiple contents in the personal data storage (750). According to one embodiment, the data platform (740) may acquire multiple contents (e.g., video content, video data, image, still image, or video) collected by the app data collection module (710) upon the execution of a camera application, and may store the acquired multiple contents in the personal data storage (750). Additionally or generally, the data platform (740) can analyze the collected multiple contents and store the analyzed information in the personal data storage (750) in association with the collected multiple contents.
[0088] According to one embodiment, a data platform (740) can access an external server device (e.g., social-network service, SNS server) capable of obtaining at least one content using a communication circuit, and can collect at least one content listed on the external server device. The data platform (740) can further obtain additional information including text or other images listed on the external server device in relation to the collected at least one content, and can store at least some of the at least one content and additional information in a personal data storage (750).
[0089] The above personal data storage (750) can store content transmitted from the data platform (740). As an example, the personal data storage (750) can store data collected by at least one of the app data collection module (710), the user data collection module (720), or the system data collection module (730). According to one embodiment, the personal data storage (750) can classify the collected data according to established criteria. For example, the personal data storage (750) can group and store content having the same or similar range of attributes according to the content description information of multiple contents. Such a personal data storage (750) may replace the operation of the data platform (740).
[0090] FIG. 8a is a diagram showing an example of a content creation system having repeatability according to one embodiment.
[0091] Referring to FIGS. 1 through 8a, in one embodiment, a content creation system (801) may include a gallery (814), a context analysis module (830), a story search module (840), a story processing module (855) (e.g., a story creation module (850) and a recommended content creation and addition module (860)), or a context-based notification module (870). The content creation system (801) may include at least some components of the generative artificial intelligence system (600) described above in FIG. 6, or may be functionally (or operationally) connected to the generative artificial intelligence system (600). At least some of the components of the above-mentioned content creation system (801), such as the context analysis module (830), story search module (840), story processing module (855), or context-based notification module (870), may be implemented as at least one hardware processor of the electronic device (300) (or external server device) or as at least one software module that is computed by at least one hardware processor of the electronic device (300) (or external server device).
[0092] According to one embodiment, the gallery (814) may be stored in a part of the memory of the electronic device (300) or in a part of the memory of a separate external server device. The gallery (814) may include a plurality of contents (814a). The plurality of contents (814a) may be acquired, for example, through a camera of the electronic device (300) or received from an external server device or another electronic device connected to the electronic device (300) via a communication channel to transmit and receive content. The gallery (814) may include a story (814b). The story (814b) may include a story generated based on the plurality of contents (814a) included in the gallery (814). Alternatively, the story (814b) included in the gallery (814) may include a story received from an external server device or another electronic device.
[0093] According to one embodiment, the context analysis module (830) may analyze at least some of the contents (814a) (e.g., still images or videos) and stories (814a) included in the gallery (814), and transmit the analyzed information to the story search module (840), the story processing module (855), and the context-based notification module (870). The context analysis module (830) may search for repetitive content among the contents (814a) in response to specified conditions. For example, the specified conditions may include at least some of the following conditions: a condition in which the electronic device (300) is located at a specific point (or a point within a certain radius or range relative to the specific point), a condition in which a specific time arrives, a condition in which new content is collected, a condition in which user input requesting context analysis occurs, or a condition in which a specific application related to context analysis is executed. The above context analysis module (830) can transmit descriptive information of the contents (814a) and context information of the story (814b) to the story search module (840).
[0094] According to one embodiment, the story search module (840) can search whether there are contents (814a) that have recurrence with the story (814b). According to one embodiment, the story search module (840) can search for a plurality of contents (814a) and / or stories (814b) that have relevance (or recurrence) to personal data stored in the personal data storage (750). For example, the story search module (840) can search for a plurality of contents (814a) that have recurrence, a plurality of contents (814a) that have relevance to personal data, and / or stories (814b) when a condition occurs that a certain amount of time has arrived and the electronic device (300) is located at a designated point (or a certain range based on the point). The story search module (840) can transmit the searched results to the story processing module (855).
[0095] According to one embodiment, the story processing module (855) may include a story generation module (850) and a recommended content generation and addition module (860). The recommended content generation and addition module (860) may include two modules, such as a recommended content generation module and a recommended content addition module. The story generation module (850) may generate a story (814b) based on at least some of the repetitive content among a plurality of content (814a). Alternatively, the story generation module (850) may generate a story (814b) based on a plurality of content (814a) that has relevance (or repetitiveness) to personal data stored in a personal data storage (750) and / or at least some of the plurality of content (814a) that have repetitiveness among themselves.
[0096] According to one embodiment, the additional content generation and addition module (860) may generate recommended content based on a plurality of repetitive contents (814a). Alternatively, the recommended content generation and addition module (860) may generate recommended content for at least one story (814b) that does not have separate recommended content. The additional content generation and addition module (860) may add the generated recommended content to the related story. When the recommended content is generated based on a plurality of repetitive contents (814a) without a story related to the recommended content, the recommended content generation and addition module (860) may request the story generation module (850) to generate a story (814b). In response, the story generation module (850) may generate a story (814b) using the contents (814a) stored in the gallery (814). When a new story is generated, the recommended content generation and addition module (860) may add recommended content to the newly generated story. The story processing module (855) can transmit at least some of the creation of a new story, the creation of additional content, or the creation of a story including additional content to the context-based notification module (870).
[0097] According to one embodiment, the context-based notification module (870) may perform a notification operation based on at least some of the information transmitted by the story processing module (855), the information transmitted by the context analysis module (830), the information stored in the gallery (814), and the personal data stored in the personal data storage (750). For example, the context-based notification module (870) may perform at least one of a new story creation notification, a recommended content creation notification, and a story notification including recommended content. The context-based notification module (870) may output a notification (or message) and / or a pop-up window in relation to the notification operation, and when user input selecting the notification and / or pop-up window occurs, it may output information related to the notification and / or pop-up window (e.g., at least one of a new story, recommended content, or a story including recommended content).
[0098] FIG. 8b is a diagram showing another example of a content creation system having repeatability according to one embodiment.
[0099] Referring to FIGS. 1 through 8b, the content creation system (800) may include a database (810), a context analysis module (830), a story search module (840), a story creation module (850), a recommended content creation and addition module (860) (or a module divided into a recommended content creation module and an addition module), and / or a context-based notification module (870). The content creation system (800) may include at least some components of the generative artificial intelligence system (600) described above in FIG. 6, or may be functionally (or operationally) connected to the generative artificial intelligence system (600). At least some of the components of the above-mentioned content creation system (800), such as the context analysis module (830), story search module (840), story creation module (850), recommended content creation and addition module (860), or context-based notification module (870), may be implemented as at least one hardware processor of the electronic device (300) (or external server device) or as at least one software module that is computed by at least one hardware processor of the electronic device (300) (or external server device).
[0100] According to one embodiment, the new content (820) may include content that was previously stored in the database (810) or content that is currently collected. For example, the new content (820) may include content that can be stored in the database (810). For example, the new content (820) may include content newly acquired through the camera of the electronic device (300) or content downloaded from an external server device. According to one embodiment, the new content (820) may include new content output information (821) and new content description information (822) (or description information of the new content (820)).
[0101] The above new content output information (821) may include at least one of a photograph, image, video, audio file, or vibration output through an electronic device (300). The above new content description information (822) may include content description information that describes the new content output information (821). For example, the new content description information (822) may include at least one of a place related to the new content (820) (e.g., the place where the new content (820) was created or acquired), a time (e.g., the time when the new content (820) was created or acquired), an object (e.g., at least some of the number of objects included in the new content output information (821), the shape of the object, or the attributes of the object), content describing the new content output information (821), or composition information of the new content output information (821). The new content description information (822), which includes at least one of the above-mentioned place, time, object, content, or composition, can be used to verify repeatability with other content (e.g., at least one content (811) stored in the database (810)). Accordingly, at least a portion of the new content description information (822) may include information defining repeatability. According to one embodiment, among the new content (820), the new content (820) having repeatability with the content (811) stored in the database (810) can be stored in the database (810) as target content.
[0102] The above database (810) can store various data related to the operation of the generative artificial intelligence system (600). For example, the database (810) may correspond to at least one of the knowledge storage portion (650) of FIG. 6, the personal storage (750) of FIG. 7, the memory of the electronic device (300), the server memory of the server device (400), and / or the gallery (814) of FIG. 8a. According to one embodiment, the database (810) may include a memory that supports the gallery function of the electronic device (300) (e.g., a function to store photos or videos). Alternatively, the database (810) may include the server memory of an external server device in which content related to the gallery function is stored. According to one embodiment, the database (810) may store a plurality of contents (811). The plurality of contents (811) may include content output information (811a) and content description information (811b) (or description information of the contents (811)). The above content output information (811a) may include at least one of an image and text that can be displayed on the display of the electronic device (300), at least a portion of an audio signal that can be output through the speaker of the electronic device (300), a vibration pattern, and / or at least one of a lamp light emission pattern. The above content description information (811b) may include information describing the contents (811). For example, the above content description information (811b) may include at least one of the creation location of the content (811), the creation time of the content (811), an object included in the content (811), the composition of the content output information (811a) if the content output information (811a) includes an image or video, or the subject of the content output information (811a) (or content describing the content output information (811a)).The above content description information (811b) may be the same or similar to the new content description information (822) when the new content (820) is stored in the database (810) as target content.
[0103] According to one embodiment, the plurality of contents (811) may include target content that has recurrence among the new contents (820) (or with the content (811) stored in the previous database (810)). Alternatively, the plurality of contents (811) may include at least one target content that has relevance to personal data stored in the personal data storage (750) among the new contents (820). According to one embodiment, the content (811) may include, for example, specific content that has recurrence with other content stored in the database (810) among the content acquired through the camera of the electronic device (300) (e.g., captured image, video data, image data, still image, or video). Alternatively, the content (811) may include specific content that has recurrence with other content (811) stored in the database (810) among the content acquired from an external electronic device connected via a communication circuit (e.g., photo image or video image uploaded to the external electronic device). The above content description information (811b) may include description information related to the content output information (811a) stored in the database (810). For example, the above content description information (811b) may include the location where the content output information (811a) stored in the database (810) was acquired, the time of acquisition of the content output information (811a), information on the device that acquired the content output information (811a), information describing the content of the content output information (811a), composition information of the content output information (811a), or surrounding information at the time of acquisition of the content output information (811a) (e.g., surrounding audio information, media information received from the surroundings, or at least some of app data, system data, or user data at the time of acquisition of the content (811)).
[0104] The above database (810) can store a story (812). The story (812) may be formed from a plurality of image data. According to one embodiment, the story (812) may include story output information (812a) and story context information (812b). The story output information (812a) may include at least some of an image, text, audio signal, vibration, and / or lamp output pattern output through an output means of an electronic device (300) (e.g., at least one of a display, speaker, vibration, and / or lamp). The story context information (812b) may include content description information related to the story output information (812a) or common (or repeated) description information of each content (811) constituting the story (812). For example, the story context information (812b) may include information of attributes that are common to each other among the content description information of a plurality of content (811) constituting the story (812). For example, the story (812) is formed of repetitive content (811) and may include video content or slide content in which output information (811a) of the content (811) is output for a specified time when the story (812) is played. According to one embodiment, the story (812) may include content in which a single screen is divided into multiple parts and repetitive content is placed on the divided screens. The story context information (812b) may be composed of parts of the content description information (811b) of the repetitive content (811) or may be composed of the whole.
[0105] According to one embodiment, the story (812) may be used interchangeably with terms such as video data group, photo group, content group, integrated content, continuous content, content including repetition, story content, gallery recommendation content, or gallery auto-generated content. For example, the story context information (812b) may include at least some of the following: a time period in units of year, month, and day corresponding to the repetition of the content (811) included in the story (812); a place of the same or similar location of the content (811) included in the story (812); an object of the same or similar object (or person object, same or similar object object) of the content (811) included in the story (812); a composition of the same or similar composition of the content (811) included in the story (812); an explanatory content of the same or similar content (811) included in the story (812); and / or a background of the same or similar background of the content (811) included in the story (812). The same or similar time periods of the contents (811) included in the story (812) may include, for example, designated time periods for daily, monthly, or yearly use. The same or similar place of the contents (811) included in the story (812) may include the same or similar place where the contents (811) were obtained. The same or similar person of the contents (811) included in the story (812) may include cases where the contents (811) are images and the person included in the images is the same or similar person. The same or similar composition of the contents (811) included in the story (812) may include cases where the composition of the contents (811) (e.g., photos obtained through a camera or photos uploaded to an external server device) is the same or similar. The same or similar background of the contents (811) included in the story (812) may include cases where the background of the contents (811) (e.g., images) is the same or similar.For example, if a user of the electronic device (300) visits a specific mountain each year and collects video data, the electronic device (300) can store the collected video data as content (811) in a database (810) and generate a yearly mountain visit story (812). Alternatively, the electronic device (300) can generate a story (812) containing multiple content (811) (or video data) taken at a specific mountain. For example, the electronic device (300) can generate a related story (812) if the number of content (811) (or video data) obtained by visiting a specific mountain is greater than or equal to a set number, and / or if the number of content (811) (or video data) taken at a specific mountain is greater than or equal to a set number. The electronic device (300) can generate recommended content (or recommended page) by referring to content (811) (e.g., mountain visit story) whose repeatability has been confirmed, and can add the generated recommended content to a related story (812).
[0106] According to one embodiment, when new content (820) is acquired, the context analysis module (830) can search for content (811) or story (812) that has recurrence with the new content (820). The context analysis module (830) can select new content (820) that has recurrence with specific content (811) stored in the database (810) among the new content (820), and can store the selected new content (820) in the database (810) as target content. In this operation, the context analysis module (830) can compare new content description information (822) and content description information (811b) to match new content (820) that has recurrence with content (811) and store them in the database (810). According to one embodiment, the context analysis module (830) can compare new content description information (822) and story context information (812b) to match new content (820) and stories (812) that have recurrence and store them in the database (810). The context analysis module (830) can transmit the new content description information (822) to the story search module (840) in relation to searching for new content (820) and stories (812) that have recurrence. The context analysis module (830) can transmit the analysis results to the story search module (840), the story creation module (850), the recommended content creation and addition module (860), and / or the content-based notification module (870). The story context information may be in the form of a vector embedded.
[0107] The story search module (840) can search and select whether there is a story among the stories (812) in the database (810) that is associated with the new content (820) to be added. For example, the story search module (840) may use a similarity-based matching model. The similarity-based matching model can compare the new content description information (822) of the new content (820) with the story context information (812b) (or context vector) of the previously created stories (812) to select at least one story (812) (or the most similar story) whose similarity to the new content description information (822) is greater than or equal to a set threshold value. The story search module (840) can search for content that has repetition among the content (811) stored in the database (810) in response to specified conditions and transmit it to the story creation module (850). Alternatively, the story search module (840) may search for new content (820) and content (811) stored in the database (810) that has repeatability in response to specified conditions and transmit them to the story creation module (850).
[0108] The story creation module (850) can create a new story (812) based on the result value of the story search module (840), or add or concatenate new content (820) to a story (812) stored in the previous database (810). For example, when the new content (820) selected as target content is stored in the database (810), the story creation module (850) checks whether the number of contents (811) having the same or similar repeatability as the new content (820) exceeds a set number, and can create a new story based on the contents (811) that exceed the set number. Alternatively, when the new content (820) selected as target content is stored in the database (810), the story creation module (850) can select a story (812) that has a repeatability relationship with the new content (820) selected as target content, and update the story by adding the new content (820) to the selected story (812). According to one embodiment, the story generation module (850) receives recommended content generated by the recommended content generation and addition module (860), and can add the received recommended content to a previous story or to a new story or an updated story (e.g., a story in which new content (820) has been added to a previous story).
[0109] The above recommendation content generation and addition module (860) generates recommendation content using at least some of the story context information (812b) and personal data of the stored story (812) as input, and can add the generated recommendation content to any one of a new story newly created based on new content (820), an updated story to which the new content (820) has been added, or a previously stored story (812). As an example, the above recommendation content generation and addition module (860) may include the configuration illustrated in FIG. 9 in relation to the generation of recommendation content. According to one embodiment, the above recommendation content generation and addition module (860) may be divided into a recommendation content generation module that performs recommendation content generation and an addition module (860) that adds the generated recommendation content to the story.
[0110] The context-based notification module (870) can refer to at least one story (812) stored in the database (810) and use the user's personal data stored in the personal data storage (750) as an input value to check whether a specific story (e.g., an updated story with new content added as target content among new content (820), an integrated story with recommended content added, or at least one of the stories (812) stored in the database (810)) satisfies a set condition. If the specific story (812) stored in the database (810) satisfies the set condition, the context-based notification module (870) can output the story (812) that satisfies the set condition to the electronic device (300) (or user) through a specified method. For example, the context-based notification module (870) can output a notification or pop-up message related to the story (812), and if user input requesting story playback occurs through the notification or pop-up message, it can output story output information (812a) of the story (812). As an example, a context-based notification module (870) can output a story (812) in response to user input that activates a gallery function, a scheduler function, a work and summary function, or other specific user functions of the electronic device (300).
[0111] According to one embodiment, the processor (110) of the electronic device (300) (or the server processor of the server device (400), described below based on the processor (110) of the electronic device (300)) may perform the operation of extracting at least one content description information (e.g., at least one information among new content description information (822), content description information (811b), or story context information (812b)) among contents (811), stories (812), or new content (820) within the database (810) (or the memory of the electronic device (300)) in relation to context analysis and storage, defining and managing relationship information between the new content (820), contents (811), and / or stories (812), and storing the relationship information again within the database (810). Regarding the definition of the relationship between the new content (820), the contents (811) and / or the story (812), the processor (110) of the electronic device (300) may determine whether a story composition having repetition with the new content (820) is required based on at least one of personal data stored in the personal data storage (750) (e.g., Profile (relationship information of the user of the electronic device (300)), Preference (information regarding the user's tastes, objects of intimacy, events, or preferred places), content description information (data analyzed by the location where the electronic device (300) is located, the user's behavior, or the user's regularity), and activities (e.g., the user's travel, or exercise), content description information (811b) stored in the database (810), or story context information (812b). If the processor (110) of the electronic device (300) determines that a new story composition including repetition is required, it may generate recommended content.
[0112] According to one embodiment, the processor (110) of the electronic device (300) may generate recommended content associated with the specific story (812) if it analyzes the story context information (812b) of a specific story stored in the database (810) and determines that there is repeatability of the set conditions. The processor (110) may perform the operation of adding the generated recommended content to the specific story. In connection with this operation, the processor (110) of the electronic device (300) may ask the user to generate the recommended content (e.g., a request for confirmation of generating recommended content via a notification or pop-up window), and upon user confirmation, generate the recommended content and create an updated story containing the recommended content.
[0113] According to one embodiment, the processor (110) of the electronic device (300) can determine whether there is content description information (811b) having repetition with at least a portion of the new content description information (822) of the new content (820) in the database (810). If there is content description information (811b) having repetition with the new content description information (822) of the new content (820) in the database (810), the processor (110) can select at least one content (811) in the database (810) based on personal data (or personal data provided by the electronic device (300)) related to the new content (820), and / or at least a portion of the new content description information (822). According to one embodiment, the processor (110) can generate a new story including the new content (820) having repetition with the content (811) selected in the database (810). According to one embodiment, the processor (110) of the electronic device (300) can generate recommended content by processing at least a portion of new content description information (822) and personal data as input to an AI module, and can generate an integrated story by adding the generated recommended content to the new story. In connection with this operation, the processor (110) of the electronic device (300) may ask the user to generate recommended content, and if the user allows it, generate recommended content. The processor (110) may ask the user whether to add the generated recommended content to the new story, and if the user allows it, generate an integrated story including the recommended content.
[0114] According to one embodiment, the processor (110) of the electronic device (300) can perform context information-based notifications. For example, the processor (110) of the electronic device (300) can check whether the user's personal data satisfies specific conditions by referring to story context information (812b) stored in the database (810). If specific conditions are satisfied, the processor (110) of the electronic device (300) can control the display of information associated with at least one of a stored story, an updated story, a new story, or an integrated story including recommended content (e.g., displaying or popping up according to user input after providing guidance via a notification regarding the story (812)).
[0115] FIG. 9 is a diagram showing an example of a recommended content generation and additional module configuration according to one embodiment.
[0116] Referring to FIGS. 1 through 9, a recommendation content generation and addition module (860) according to one embodiment may include at least one of an information vector module (861), a recommendation system module (862) (or a recommendation module), recommendation information (863) generated by the recommendation system module (862), a prompt generator (864), a generative AI model (865), or AI content (866) (or an AI image, an image, a recommendation image). As an example, each of the recommendation content generation and addition modules illustrated in FIG. 9 may be composed of AI modules. Alternatively, the recommendation content generation and addition module illustrated in FIG. 9 may be included in a single AI module. Alternatively, some components of the recommendation content generation and addition module (860) described in FIG. 9 may be composed of a rule-based software module, and the remaining components may constitute a single AI module, or each may be composed of AI modules. According to one embodiment, the recommendation content generation and addition module (860) and the story generation module (850) may constitute a single AI module, or each may be composed of AI modules. According to one embodiment, the prompt generator (864) may generate a prompt based on at least some of the recommendation information (863) and / or personal data and transmit it to the generative AI module (865). The generative AI module (865) may generate a result corresponding to the transmitted prompt and provide it to the user.
[0117] As an example, at least one of the information vector module (861), recommendation system module (862), prompt generator (864), or generative AI model (865) may be implemented as at least one hardware processor of the electronic device (300) (or external server device), or as at least one software module that is computed by at least one hardware processor of the electronic device (300) (or external server device).
[0118] The information vector module (861) can perform the operation of obtaining context information. In this regard, the recommendation content creation and addition module (860) can obtain story context information (812b) stored in a database (e.g., the database (810) of FIG. 8b or the memory of the electronic device (300) or the server memory of the server device (400), described below based on the database (810)) from the context analysis module (830).
[0119] The operation of the above recommendation system module (862) (Recommendation System, RecSys) can perform recommendation tasks by utilizing at least one of the database (810), new content (820), and / or personal data of the device that provided the new content (820) (e.g., electronic device (300) or server device (400)). When recommendation information (863) is generated through the operation of the recommendation system module (862), the generated recommendation information (863) can be transmitted to the prompt generator (864) for the operation of the prompt generator (864). Additionally, the recommendation information (863) can be transmitted to the story generation module (850). In relation to the operation of the above recommendation system module (862), deep learning-based models such as neural collaborative filtering (NCF), hybrid models such as LightFM, generative AI models, or LLM may be applied.
[0120] In relation to the operation of the above prompt generator (864), the prompt generator (864) can generate an appropriate prompt by utilizing at least some of the database (810), new content (820), and personal data and / or recommendation information (863) related to the new content (820). For example, the prompt generator (864) can generate a prompt requesting the creation of recommended content based on at least some of the new content description information (822) selected as target content and at least some of the background included in the new content output information (821) of the new content (820) selected as target content. As an example, the prompt generator 864 may generate a prompt such as "Here are some information of several photos provided by the user. Analyze the patterns or common characteristics across these photos and identify any recurring styles or themes. Based on this analysis, suggest new photo ideas or styles that align with or enhance the user's preferences. Photo descriptions: [Photo information 1], [Photo information 2], [Photo information 3], What new photo concepts or styles would you recommend based on this analysis?" there is.
[0121] The operation of the prompt generator (864) may mean a rule-based system for generating prompts, or it may mean an LLM. An LLM that generates prompts may include, for example, GPT-4.
[0122] In relation to the operation of the generative AI model (865) above, the generative AI model (865) (generative AI, GenAI) receives a prompt from the prompt generator (864) that performs the operation of the prompt generator (864), and can generate AI content (866) using the received prompt. For example, the model that creates new AI content (866) may include Stable Diffusion or DALL-E3. The generative AI model (865) may receive various images and text data as input. The AI content (866) generated through the operation of the generative AI model (865) can be delivered to the story generation module (850).
[0123] According to one embodiment, the processor (110) of the electronic device (300) can analyze repetitiveness (or context information corresponding to a repetitive pattern) and determine whether to provide a story with repetitiveness. In this regard, the processor (110) of the electronic device (300) can determine that a new content (820) having content description information (new content description information (822)) that is identical or similar to the content description information (811b) of a plurality of contents (811) stored in the database (810) or the story context information (812b) of a story (812) has repetitiveness and select it as a target content. The processor (110) of the electronic device (300) can embed the repetitiveness (or rule, repeating pattern) of the content description information (811b) and / or story context information (812b) in the database (810) into a context vector. For example, when at least one new content (820) is acquired and stored in a temporary storage (e.g., a separate storage distinct from the database (810)), the processor (110) of the electronic device (300) can check the repetitiveness (or repetitive pattern) between the new content description information (822) (e.g., the time of shooting of the video, the location of shooting, objects included in the video (e.g., human objects), content describing the video, or at least one of the composition of the video) of the at least one new content (820) stored in the temporary storage and the content description information (811b) or story context information (812b) stored in the database (810).According to one embodiment, the processor (110) of the electronic device (300) may perform an operation to determine whether it is necessary to create and provide a story related to the acquired new content (820) to the user based on story context information (812b) (or content description information (811b) of a plurality of contents (811)), personal data (e.g., Profile (e.g., relationships), Preference (e.g., intimacy, events, or preferred places, etc.), Context (e.g., places, behaviors, or regularities), or Activity (e.g., travel, or exercise).
[0124] The above personal data (e.g., Profile, Preference, Context, or Activity) may include information such as the user's schedule, notes, contacts, and story save and delete history. The processor (110) of the electronic device (300) may use the personal data to determine whether to provide more personalized stories. According to one embodiment, the processor (110) of the electronic device (300) may create a new story if repetition (or a repeating pattern, information having repetition with other content description information (811b) among the new content description information (822)) is identified. Alternatively, the processor (110) of the electronic device (300) may check whether there is repetition (or a repeating pattern) between the new content (820) and the stories (812) that were previously created and stored in the database (810). According to one embodiment, the new content (820) and the recurring story (812) may include stories corresponding to tasks, operations, or events that the user of the electronic device (300) is likely to perform or is performing periodically or repeatedly with intent, such as a story of the user visiting the same place every year, a story of the user visiting various places at the same time every year, an anniversary story, or a story of a child's growth.
[0125] According to one embodiment, when the processor (110) of the electronic device (300) determines that a repetitive story formation is necessary while new content (820) is acquired, it may perform an operation to check whether a story associated with the new content (820) exists (a story having a repetitive relationship with the new content (820)). For example, the processor (110) may extract new content description information (822) and search within the database (810) for a story having story context information (812b) that has a repetitive relationship with at least a part of the extracted new content description information (822). When the processor (110) of the electronic device (300) finds the story, it may create an updated story by adding the new content (820) to the found story.
[0126] According to one embodiment, when at least one new content (820) is added to an amusement park story as target content (e.g., content having story context information and content description information having repetition), the processor (110) of the electronic device (300) can generate and provide recommended content (e.g., a new amusement park that has not been visited) based on the description information of the target content (or target content description information) and at least one of the existing amusement park stories. According to one embodiment, when the processor (110) of the electronic device (300) detects in personal data that the user of the electronic device (300) has removed their own image (e.g., a selfie) more than a certain number of times in previous stories, the processor (110) can remove the user's selfie from the selected target content among the new content (820) and add the target content from which the user's selfie has been deleted to the story.
[0127] For example, a user of the electronic device (300) may visit various amusement parks with family members in the spring before 2024, wear a commemorative headband each time, and take family photos, and store the photos as a story. According to one embodiment, when repetitive photos (e.g., family photos taken by visiting various amusement parks with family members in a specific season) (or new content) are collected, the electronic device (300) may automatically generate a story about the collected photos or in response to a user request, and store the generated story.
[0128] In response to this, the processor (110) of the electronic device (300) may store an amusement park story composed of contents including at least one of spring, amusement park, headband, or family as descriptive information. In this state, if the user of the electronic device (300) visits the amusement park again with their family in the spring of 2024 and takes at least one photo, the processor (110) of the electronic device (300) may select at least one photo (or new content) as target content. The descriptive information of the selected target content may include information that can embed a repeating pattern related to the story as a vector, such as a place (amusement park), time (spring), or combination of people (person 1, person 2, person 3, person 4). When target content is selected, the processor (110) of the electronic device (300) can generate recommendation content including recommendation information related to the commemorative headband (e.g., information recommending wearing the commemorative headband when using the amusement park) or advertising information related to purchasing or searching for the commemorative headband, and output the generated recommendation content alone, together with the target content, together with the amusement park story, and / or together with the amusement park story to which the target content has been added.
[0129] According to one embodiment, when amusement park stories, hiking stories, or last summer beach stories (812) are stored in a database (810), the processor (110) of the electronic device (300) can search for and select a stored story that has repetition (or identical / similar similarity) with the new content description information (822) of the acquired new content (820) when new content (820) is acquired. For example, the processor (110) of the electronic device (300) can use a similarity-based matching model in the process of searching for a story that has repetition with the new content (820). The similarity-based matching model can compare the new content description information (822) converted into a vector with the stored story context information (812b) (or context vector) to select the story context information (812b) that is most similar to the new content description information (822) (or the story context information (812b) that has similarity greater than or equal to a set threshold value).
[0130] According to one embodiment, the processor (110) of the electronic device (300) can generate recommendation content by inputting context information (or story) of the story stored in the database (810) and / or at least a portion of the personal data of the electronic device (300). The processor (110) of the electronic device (300) can perform the operation of generating an integrated story by adding the generated recommendation content to the story. The recommendation content may include information such as text, images, or videos.
[0131] According to one embodiment, if there is no story in the database (810) that has a repeating relationship with the new content (820), the processor (110) of the electronic device (300) can search for content description information of at least one content (811) in the database (810) that has a repeating relationship with the content description information of the new content (820). If content (811) that has a repeating relationship with the new content (820) is found among the content stored in the database (810), the processor (110) of the electronic device (300) can generate a new story based on the found content and the new content (820).
[0132] Additionally or generally, the processor (110) of the electronic device (300) may perform the operation of generating recommended content associated with new content (820) selected as target content and adding the generated recommended content to a new story. For example, the processor (110) of the electronic device (300) may generate recommended content based on at least a portion of the new content (820), story (812), and / or personal data, and add the generated recommended content to the story to generate an integrated story. According to one embodiment, the recommended content may be generated using a generative AI model (865).
[0133] According to one embodiment, in an operation to determine whether to provide a repetitive story, the recommendation system module (862) can predict recommendation information by analyzing at least one of a tendency, a trend change, or a pattern, by inputting story context information, descriptive information of new content (820) selected as target content, and personal data (e.g., data including at least a portion of App data, Usage data, and / or System data). The prompt generator (864) can provide a prompt for creating AI content (866) (or AI image) that the user is likely to prefer, by inputting the predicted (or inferred) recommendation information, the database (810), new content (820) selected as target content, descriptive information of new content (820) selected as target content, or personal data. The generative AI model (865) can generate AI content (866) that the user is likely to add next, by inputting the prompt received from the prompt generator (864).
[0134] According to one embodiment, the processor (110) of the electronic device (300) may simultaneously perform a search operation for new content (820) and a repetitive story (812) and a search operation for new content (820) and a repetitive content (811), and may stop the search operation for content (811) when the repetitive story (812) is searched first. If the repetitive content (811) is searched first, the processor (110) of the electronic device (300) may wait until the search for story (812) is completed.
[0135] According to one embodiment, the recommendation content generation and addition module (860) can generate recommendation content by combining recommendation information inferred from the recommendation system module (862), prompts, and AI content output from the generative AI model (865). For example, if there is a story related to an amusement park, the context analysis module (830) can receive the amusement park story as input and extract story context information. For example, the story context information extracted from the amusement park story may include a form in which repeating patterns such as a place (amusement park), time (spring), or combinations of people (person 1, person 2, person 3, person 4) are embedded as vectors. Personal data may include accommodation reservation history, weather information, or deletion history of images within the story recorded by the electronic device (300). The recommendation system module (862) takes the extracted story context information and personal data as input to analyze the repetition (or tendency, or pattern) that the user visits amusement park 1, amusement park 2, or amusement park 3 every spring, including a specific combination of people, and based on the analysis, can predict amusement park 4 (recommendation / suggestion information) as the place the user is likely to visit next. Taking the predicted recommendation information, database (810), content description information (or new content description information) of new content (820) selected as target content, and personal data as input, the prompt generator (864) can provide a prompt to create AI content (866) (or AI image) that the user is likely to accept. For example, the prompt is "Every spring, a user takes family photos at amusement park. Based on the previous photos provided, generate an image predicting the next family photo in <Amusement Park 4>."Note: It may include "Ensure attention to detail and context to produce the best possible result." The generative AI model (865) can generate AI content acceptable to the user using the aforementioned prompt as input.
[0136] According to one embodiment, the recommendation content generation and addition module (860) can form recommendation content by combining personal data, the inferred recommendation information, prompts, and AI content. For example, the recommendation content may include at least some of recommendations for new places, weather information for the place, or recommendations for types of accommodations frequently booked by users located near the place. According to one embodiment, when generating the recommendation content, the recommendation content generation and addition module (860) can generate recommendation content by utilizing social network service (SNS) app data among the personal data and using information that is trending at the time of recommendation content generation (or receiving attention from a certain number of users or exposed to users a certain number of times). For example, the recommendation content generation and addition module (860) can identify the user's preference (e.g., liking bread) through personal data, and if there are many bakeries along the user's travel route (or payment information), it can include trending information related to bread (e.g., Sungsimdang, or White Strawberry Siru) from the SNS app data in the recommendation content (e.g., bread pilgrimage recommendation content).
[0137] According to one embodiment, regarding the generation of recommendation content related to a user's preferred product, such as bread, the processor (110) of the electronic device (300) may detect the repetition of visiting food stores to purchase the food preferred by the user (e.g., bread) based on at least some of the purchase information, user movement information, or content stored in the database (810). For example, the user may purchase a first type of food at a first food store on a first specific date, purchase a first type of food at a second food store on a second specific date, and purchase a first type of food at a third food store on a third specific date. During the process of purchasing the first type of food mentioned above, the user may use the camera of the electronic device (300) to take a picture including the purchased product (e.g., the first type of food) or the food store. If the processor (110) of the electronic device (300) detects a history of purchasing the first type of food for a certain period, it may determine that the user prefers the first type of food and enter the user preference information into the database (810). When the recommendation content generation and addition module (860) obtains user preference information, it can generate recommendation content related to said user preference based on content stored in the database (810) (e.g., photos of product purchases or photos taken at food stores). According to one embodiment, when the story generation module (850) obtains user preference information, it can generate a story related to said user preference (e.g., a pilgrimage story) based on content stored in the database (810) (e.g., photos of product purchases or photos taken at food stores). According to one embodiment, the story generation module (850) can include the recommendation content generated by the recommendation content generation and addition module (860) in the story and output it. Alternatively, the story generation module (850) can output the recommendation content according to conditions specified before or after the story output.According to one embodiment, the output of recommended content may be processed by the recommended content generation and addition module (860) depending on the story output situation of the story generation module (850). Alternatively, the story generation module (850) may process the story output related to the recommended content depending on the recommended content output situation generated by the recommended content generation and addition module (860).
[0138] According to one embodiment, the recommendation content generation and addition module (860) may obtain information on a fourth food store selling a first type of food corresponding to user preference information through internet advertising information, news information, or social network service (SNS), and generate recommendation content (e.g., content suggesting a visit to the fourth food store) based on the obtained information. The recommendation content generation and addition module (860) may output the recommendation content by including it in a story related to user preference (or a pilgrimage story), or output it in response to the satisfaction of separately specified conditions. According to one embodiment, the recommendation content generation and addition module (860) transmits the generated recommendation content to the story generation module (850), and the story generation module (850) may output the transmitted recommendation content together with the story, or before or after the story output, according to specified conditions. According to one embodiment, the story generation module (850) may generate an integrated story by adding the generated recommendation content to an already stored story, and output the integrated story according to specified conditions.
[0139] According to one embodiment, the recommendation content generation and addition module (860) may collect other user reviews regarding a fourth food store that sells a first type of food corresponding to user preference information, and generate recommendation content including a review that ranks a certain number among the collected user reviews. For example, the story generation module (850) may generate an integrated story by adding the recommendation content generated based on the reviews to a story related to the user preference information. According to one embodiment, if there is no story related to the user preference information, the story generation module (850) may generate a new story based on the content related to the user preference information and generate an integrated story by adding the recommendation content generated based on the reviews.
[0140] According to one embodiment, the recommendation content generation and addition module (860) can acquire information that allows purchasing a first type of food corresponding to user preference information (e.g., information that allows ordering a first type of food online) and generate recommendation content (e.g., link information that allows ordering a first type of food) based on the acquired information. The story generation module (850) can generate an integrated story by adding the recommendation content containing the link information to a story related to the user preference information. According to one embodiment, if there is no food-related story, the story generation module (850) can generate an integrated story based on the food-related content stored in the database (810) and the recommendation content.
[0141] According to one embodiment, the recommendation content generation and addition module (860) and the story generation module (850) may be composed of a single AI module. The processor (110) of the electronic device (300) may generate content (e.g., at least one of video, text, or audio signals for generating recommendation content) and a prompt in relation to the generation of recommendation content, and may provide the content and the prompt to the AI module to receive recommendation content and a story containing recommendation content (e.g., a new story containing recommendation content or an integrated story with added recommendation content) from the AI module. As an example, the processor (110) of the electronic device (300) may search for and obtain multiple contents (e.g., images or videos) related to user preference information (e.g., food information) in a gallery. The processor (110) of the electronic device (300) may generate a prompt related to the searched content and / or user preference information (e.g., a prompt suggesting a visit to a third keyword along with a second keyword at the time of a first keyword). The prompt may be, for example, "Here are some information of several photos provided by the user. Analyze the patterns or common characteristics across these photos and identify any recurring styles or themes. Based on this analysis, suggest new photo ideas or styles that align with or enhance the user's preferences.It may be composed of: Photo descriptions: [Photo information 1] [Photo information 2] [Photo information 3] What new photo concepts or styles would you recommend based on this analysis? Provide an appropriate image for the recommended content and extract one keyword each for the categories [context1], [context2], and [context3]. Output these keywords along with the image." As an output of a generative AI module that inputs the above prompt, it may include three keywords and one image. The above context may include, for example, a combination of place, time, or person.
[0142] The processor (110) of the electronic device (300) supplies the generated prompt and the searched content to a story generation support AI module and can receive from the AI module a new story generated in relation to user preference information, an updated story (e.g., a story in which new content is added to a previous story), and / or an integrated story (e.g., a story in which recommended content is added to a story). The AI module may include an AI module that generates recommended content based on the content and the prompt, and an AI module that generates a new story based on the recommended content and the searched content, or generates an integrated story in which the recommended content is added to a story generated based on existing user preference information. According to one embodiment, the AI module may be configured as an AI module configured in the form of an external server.
[0143] FIG. 10 is a drawing illustrating the generation of recommended content according to one embodiment.
[0144] Referring to FIGS. 1 through 10, a processor (110) of an electronic device (300) (or a server processor of a server device (400), described below based on the processor (110) of the electronic device (300)) can acquire a plurality of contents (1001, 1002, 1003). For example, the processor (110) can acquire contents related to a gallery function from memory (or a database (810)) (or acquire from an external server device, or acquire content captured through a camera (e.g., captured images). The plurality of contents (1001, 1002, 1003) may correspond to a plurality of contents (811) stored in the database (810). The plurality of contents (1001, 1002, 1003) may include contents that have a history of generating a specific story (or content grouped into a video data group). Alternatively, the plurality of contents (1001, 1002, 1003) may include content description information (811b) that includes at least one (or at least part of at least one) of the place where the contents were created (or acquired), the time when the contents were created (or acquired), an object (e.g., an object included in the contents), a recurring event (e.g., a recurring event entered in the scheduler or calendar of the electronic device (300)), a shooting angle (e.g., a shooting angle of the contents), and content describing the contents (e.g., photos taken at an amusement park, photos taken in a mountain, photos taken at an art gallery, a museum, or a specific type of event venue, including content in which the attributes of the contents are identical or similar). Alternatively, the plurality of contents (1001, 1002, 1003) may include content selected (or designated) by the user of the electronic device (300) for story creation while executing the gallery function.
[0145] The processor (110) may transmit the acquired multiple contents (1001, 1002, 1003) to a context analysis module (830), a recommendation system module (862), or a prompt generator (864). The context analysis module (830) may analyze content description information for the multiple contents (1001, 1002, 1003) and transmit context analysis information generated according to the analysis to a recommendation system module (862) and a story generation module (850). The context analysis information may include, for example, information indicating repeatability (or repeating pattern) among the information of each of the multiple contents (1001, 1002, 1003). The above repeatability may include, for example, at least one or at least two or more identical or similar characteristics among the time (e.g., the creation time or acquired time of the content (1001, 1002, 1003)), place (e.g., the place where the content (1001, 1002, 1003) was created), object (e.g., objects included in the content (1001, 1002, 1003)), and composition (e.g., the shooting composition of the content (1001, 1002, 1003)) included in the content description information (811b) of the plurality of content (1001, 1002, 1003). According to one embodiment, the processor (110) checks content description information (811b) stored on an external server or in a database (810) to detect content in which a family consisting of similar individuals within the same or certain category (e.g., detection of objects included in the content and identification of family members through a phonebook or user's SNS) periodically visits an amusement park (or amusement park) (e.g., identification through location or map information).
[0146] The processor (110) can classify content having content description information (e.g., description information having repetition) that commonly includes amusement parks and families into content having repetition. According to one embodiment, the processor (110) can check content description information (or information based on object analysis included in content output information) stored in an external server or database (810) to detect content that repeatedly includes a family composed of similar individuals within the same or certain category (e.g., detection of objects included in content and identification of family members through phonebooks or user SNS) at a designated time. The processor (110) can classify content having content description information that commonly includes a designated time and a family into content having repetition. The story generation module (850) can generate a story based on content having content description information that commonly includes the classified family and the designated time. Alternatively, the processor (110) may classify content that includes family, designated time, and amusement park in common in the content description information into repetitive content, and the description information of the repetitive content may be stored as context information of the story.
[0147] According to one embodiment, the story generation module (850) can generate a story based on content having classified families and amusement parks as common content description information. The story generation module (850) can generate a story based on content having classified families and designated times as common content description information. The story generation module (850) can generate a story based on content having classified families, designated times, and amusement parks as common content description information. In the story generation operation, the story generation module (850) can store content description information having repeatability as context information of the story.
[0148] According to one embodiment, the recommendation system module (862) can generate recommendation information based on the plurality of contents (1001, 1002, 1003) and context analysis information provided by the context analysis module (830). The recommendation system module (862) can transmit the generated recommendation information to a prompt generator (864) and / or a story generation module (850). Additionally or generally, the recommendation system module (862) can generate recommendation information using the contents (1001, 1002, 1003), information, and personal data. According to one embodiment, the recommendation system module (862) can generate information to be included in the recommended content based on descriptive information (or story context information) of the classified contents (or stories). Referring to the illustrated drawing, the recommendation system module (862) may generate and provide to the story generation module (850) guidance information indicating that a family, a designated time (e.g., spring), or a place (e.g., an amusement park) is a situation with recurrence, and recommendation information recommending a place that is different from the place of the content included in the story (or the place of the classified content) but has the same or similar attributes. The recommendation information may include information necessary for using the place during the designated time. For example, the recommendation information may include at least one of accommodation reservation information near the place (e.g., an amusement park, a recreational forest, or an event venue), restaurant reservation information near the place, weather information near the place, and travel route information near the place. The story generation module (850) may generate recommendation content (e.g., 1010a) including the guidance information and recommendation information. According to one embodiment, the story generation module (850) may generate recommendation content including at least some of the recommendation information.
[0149] According to one embodiment, the prompt generator (864) can generate a prompt based on the plurality of contents (1001, 1002, 1003) and recommendation information provided by the recommendation system module (862). The prompt generator (864) can transmit the generated prompt to a generative AI model (865). If the generative AI model (865) is located on an external server device, the prompt generator (864) can transmit the prompt to the external server device.
[0150] According to one embodiment, the generative AI model (865) can generate AI content (1004) (or AI image) (e.g., AI content (866) of FIG. 9) based on a prompt delivered by the prompt generator (864). The generative AI model (865) can deliver the generated AI content (1004) to the story generation module (850). For example, the prompt generator (864) can generate a prompt requesting the creation of an image of an amusement park at a specific location visited with family at a certain time. For instance, the prompt generator (864) can generate a prompt including at least some of the following: a phrase related to the time, a phrase related to the composition of the characters, a phrase related to the location, a phrase related to the target of the creation request, and an image or audio file and / or text that may serve as the background of the target of the creation request, and deliver the generated prompt to the generative AI model (865). The generative AI model (865) can generate AI content (1004) based on the received prompt. The above AI content (1004) (e.g., AI content (866) of FIG. 9) is an image generated by a generative AI model (865) according to a prompt transmitted by a prompt generator (864), and may include a background image extracted from content other than the plurality of contents (1001, 1002, 1003) (e.g., an image of a place included in recommendation information provided by a recommendation system module (862)) or a composite image of background images extracted from other content. Alternatively, the AI content (1004) may include at least one background image among the plurality of contents (1001, 1002, 1003) or a composite image formed by synthesizing at least a part of the contents.
[0151] According to one embodiment, the story generation module (850) can generate at least one recommended content based on context analysis information transmitted by the context analysis module (830), recommendation information provided by the recommendation system module (862), AI content (1004) provided by the generative AI model (865), and a plurality of contents (1001, 1002, 1003). According to one embodiment, the generative AI model (865) can generate at least one recommended content based on the context analysis information, the recommendation information, the AI content (1004), and / or a plurality of contents (1001, 1002, 1003) on behalf of the story generation module (850) or independently of the story generation module (850).
[0152] According to one embodiment, the story generation module (850) can check whether a first story, which has already been generated based on the plurality of contents (1001, 1002, 1003), exists in the memory of the electronic device (300) (or the server memory of an external server device). If the first story does not exist, the story generation module (850) can generate at least one new story (e.g., a second story) based on the context analysis information transmitted by the context analysis module (830) and the plurality of contents (1001, 1002, 1003). According to one embodiment, the story generation module (850) checks whether a first story generated based on the plurality of contents (1001, 1002, 1003) exists before generating recommended content, and if the first story does not exist, it can generate a new story based on the plurality of contents (1001, 1002, 1003). Alternatively, the story generation module (850) may check whether a first story generated based on the plurality of contents (1001, 1002, 1003) exists after generating recommended content, and if the first story does not exist, it may generate a new story based on the plurality of contents (1001, 1002, 1003).
[0153] According to one embodiment, a story generation module (850) may generate a first recommended content (1010a) based on AI content (1004) containing first context analysis information (1010_inf), recommendation information (1010_rec), or a context object (1010_ob). In the first recommended content (1010a), the first context analysis information (1010_inf) may include text describing at least some of the repetition (or repetition of information describing the content) of a plurality of contents (1001, 1002, 1003) used to generate the first recommended content (1010a). The recommendation information (1010_rec) may include recommendation content related to the repetition. Alternatively, the recommendation information (1010_rec) may include recommendation content and the reason for generating the recommendation information. The above context object (1010_ob) may include objects commonly included in the plurality of contents (1001, 1002, 1003) (e.g., a plurality of photos, or a plurality of videos) or at least one object included in the plurality of contents (1001, 1002, 1003).
[0154] According to one embodiment, the recommendation system module (862) can transmit a plurality of recommendation information (1010_rec1, 1010_rec2, 1010_rec3, 1010_rec4) to the story generation module (850). The story generation module (850) can generate a second recommendation content (1010b) based on the plurality of recommendation information (1010_rec1, 1010_rec2, 1010_rec3, 1010_rec4) transmitted by the recommendation system module (862). According to one embodiment, the story generation module (850) may generate at least one of a first recommended content (1010a) and / or a second recommended content (1010b) based on a plurality of recommended information (1010_rec1, 1010_rec2, 1010_rec3, 1010_rec4) and AI content (1004). Additionally or generally, a generative AI model (865) may generate at least one of the first recommended content (1010a) and / or a second recommended content (1010b) based on a plurality of recommended information (1010_rec1, 1010_rec2, 1010_rec3, 1010_rec4) and AI content (1004).
[0155] For example, the second recommended content (1010b) may include a first recommended information (1010_rec1), a second recommended information (1010_rec2), a third recommended information (1010_rec3), and / or a fourth recommended information (1010_rec4). The first recommended information (1010_rec1) may include, for example, a recommendation related to a location among the repetitions of the plurality of contents (1001, 1002, 1003) (or at least one of text or an image containing the recommendation). The second recommended information (1010_rec2) may support a function to add the second recommended content (1010b) to a related story (e.g., a story generated from the plurality of contents (1001, 1002, 1003)). When the second recommendation information (1010_rec2) is selected, the second recommended content (1010b) may be included in a story (or video data group) generated based on the plurality of contents (1001, 1002, 1003). The third recommendation information (1010_rec3) may include first additional information related to the recommended content recommended in the first recommendation information (1010_rec1). For example, if the first recommendation information (1010_rec1) includes location content, the first additional information may include weather information related to the location. According to one embodiment, the first additional information may include weather information collected by referencing time during the repetition of the plurality of contents (1001, 1002, 1003). The fourth recommendation information (1010_rec4) may include second additional information related to the recommended content included in the first recommendation information (1010_rec1). For example, if the recommendation content of the first recommendation information (1010_rec1) includes place content, the second additional information may include information related to the place and accommodation (e.g., link information for booking accommodation available for stay, or advertising information related to accommodation).
[0156] The story generation module (850) may add at least one of the first recommended content (1010a) or the second recommended content (1010b) to the first story (e.g., a saved story) or the second story (e.g., a new story). Alternatively, the story generation module (850) may request confirmation from the user of the electronic device (300) regarding whether to add at least one of the first recommended content (1010a) or the second recommended content (1010b) to the first story (e.g., a saved story) or the second story (e.g., a new story), and may add it if user input for addition is received.
[0157] Meanwhile, at least one of the above-described context analysis module (830), recommendation system module (862), prompt generator (864), generative AI model (865), or story generation module (850) may be implemented with at least one hardware processor. Alternatively, at least one of the context analysis module (830), recommendation system module (862), prompt generator (864), generative AI model (865), or story generation module (850) may include a software module executed through the operation of one (or multiple) hardware processors.
[0158] According to one embodiment, at least some of the generated recommended content (1010a, 1010b) may be added to various locations within the story. For example, the recommended content (1010a, 1010b) may be added to the last or first page of a story formed by multiple pages corresponding to multiple contents. Alternatively, if it is determined that there is information that needs to be filled in the middle of a repetitive story, the recommended content (1010a, 1010b) may be added in the middle of the story. For example, in a situation where recommended content is added to a story related to the Jeju Island Trail, if the previous story contains photos of the Trail courses 1, 2, 3, and 5, recommended content suggesting a visit to Course 4 may be added in the middle of the story. According to one embodiment, the recommended content may include multiple pages. For example, when a user is in a specific location (e.g., Course 8 of the walking trail) and a story is provided, the processor (110) of the electronic device (300) can generate recommendation content recommending a visit to Courses 4, 6, 7, and 8 and add it to the story.
[0159] According to one embodiment, regarding story notifications, if the processor (110) of the electronic device (300) determines that at least some of the content description information of the new content (820) and the story context information (812b) in the database (810) are identical or similar, the new content (820) is determined to be a target content with repeatability, and a notification may be provided while adding the new content (820) to the story. Alternatively, if the processor (110) of the electronic device (300) determines that personal data is similar to the story context information (812b) in the database (810), a notification regarding story playback may be provided.
[0160] As an example, the processor (110) of the electronic device (300) may determine the timing of providing a notification by utilizing personal data. For instance, the processor (110) of the electronic device (300) may provide a notification at the time of analysis when the content description information of the content stored in the database (810) and the content description information of the newly entered content (820) (e.g., time of creation or acquisition of the content, place of creation or acquisition of the content (or type or category of the place), objects included in the content (e.g., combination of people included in the content), at least part of the content's description of the content) are analyzed to be identical or similar within a certain range.
[0161] For example, a user of the electronic device (300) may go to a yoga studio every Monday morning and create yoga content (e.g., images of yoga activities). The processor (110) of the electronic device (300) may create a story based on multiple yoga contents when multiple yoga contents have a specified repeatability, and may store the created story. According to one embodiment, the processor (110) of the electronic device (300) may determine whether the user is at the yoga studio on Monday morning based on personal data, and at that time, provide a notification regarding the story stored in relation to the yoga content to guide the user to update the story. According to one embodiment, the processor (110) of the electronic device (300) may create recommendation information recommending the creation of yoga content when the user's location and time satisfy specified conditions (e.g., when the user satisfies the condition of being at the yoga studio on Monday morning), and may output at least one of a notification regarding the created recommendation information or a notification regarding a story containing the recommendation information according to the specified conditions.
[0162] According to one embodiment, when a new content with a composition identical or similar to that of a specific content stored in a database (810) is acquired, the processor (110) of the electronic device (300) may use the user's personal data (e.g., screen time) to add the new content with the corresponding composition to a related story at a time when gallery usage is at its maximum, and provide the user with a notification regarding at least one of creating and / or playing the story with the added new content. Based on this, the processor (110) of the electronic device (300) may provide the user with meaningful story information or provide an opportunity to add meaningful content to the story.
[0163] According to one embodiment, if the electronic device (300) is a wearable device such as smart glasses (e.g., head mount device, HMD), the electronic device (300) can acquire surrounding information (e.g., image acquired through the camera of the wearable device, an object or background included in the image, or at least some audio information acquired from the surroundings) through at least one of the camera and microphone of the wearable device, and can generate a story based on the acquired surrounding information. In this operation, the electronic device (300) can provide the generated story alarm through an output device (e.g., speaker, display, or image output device) included in the wearable device. As an example, the electronic device (300) can analyze the image collected by the camera of the smart glasses to determine information about an object included in the image. If the object included in the image represents a girlfriend, the electronic device (300) can generate and output a notification regarding a story generated in relation to the girlfriend (e.g., a first story or a second story). If the above notification is selected, the electronic device (300) can output a story generated in relation to the girlfriend through the wearable device.
[0164] According to one embodiment, the electronic device (300) may have at least some of the text information of the proposed story and the images included in the story differ depending on the object or surrounding information confirmed through the smart glasses. For example, among similar travel-related stories, if the surrounding information obtained through the smart glasses includes a specific person or a specific landscape, the electronic device (300) may generate a story centered on the specific person or a story centered on the specific landscape and provide a notification regarding the creation of the story.
[0165] According to one embodiment, in relation to the operation of determining the time of outputting a generated story, the processor (110) of the electronic device (300) determines whether the current usage situation of the electronic device (300) meets the specified conditions, and if it is determined that the usage situation meets the specified conditions, it may select two or more image data corresponding to the specified conditions from at least one of the image data (or contents) stored in the memory or the image data (or contents) stored in a server to which access by the electronic device is permitted. The processor (110) of the electronic device (300) may generate at least one new image data corresponding to the specified conditions in addition to the image data that has already been captured, generate an image data group including the two or more image data corresponding to the selected specified conditions and the generated new image data, and display a notification through the display indicating that the image data group has been generated.
[0166] According to one embodiment, the specified conditions may include at least one condition or at least two or more conditions among a first condition in which the electronic device (300) enters a location within a geographical range, a second condition in which the electronic device is detected to be within a specified distance from at least one object, a fourth condition in which the at least one object is included among the subjects reflected in the camera of the electronic device (300), a fifth condition in which another electronic device related to the at least one object and allowed to be connected to the electronic device (300) is detected to be within a specified distance from the electronic device (300), or a sixth condition in which a repetitive event is detected.
[0167] According to one embodiment, two or more image data corresponding to the specified conditions may include image data acquired (or captured) by the electronic device (300) at a location within a certain range, previously captured image data including at least one object, image data including at least one object among subjects reflected by the camera of the electronic device (300), and image data captured within a certain range of time based on the time when the repetitive event occurred.
[0168] According to one embodiment, the electronic device (300) may change the display time based on surrounding information (e.g., surrounding objects or surrounding circumstances) and at least some of the creation dates of images or videos included in the generated story. For example, if a photo taken long before a set standard is included in the story, the electronic device (300) may collect current status information of a person included in the long-ago photo or current status information of a background included in the long-ago photo, and perform at least one of story output, story deletion, story modification, or update according to the collected status information.
[0169] FIG. 11 is a diagram showing an example of a screen interface related to story output according to one embodiment.
[0170] Referring to FIGS. 1 to 11, the electronic device (300) may include a foldable electronic device, a bar-type electronic device, a sliding-type electronic device, as well as the smart glasses or HMD device described above. Accordingly, the screen interface (or screen) described below may be provided not only through a display included in the electronic device (300), but also through an image output device that outputs from the electronic device (300).
[0171] According to one embodiment, a user of the electronic device (300) may take photos (or content) including the family while repeatedly visiting amusement parks (or the same amusement park) located at different places with other members of the family. In this case, the processor (110) of the electronic device (300) may store content taken in relation to the amusement park in a database (810), and when new content taken in relation to the amusement park is acquired, it may perform at least one of story generation and / or recommendation content generation. The content taken in relation to the amusement park and stored in the database (810) corresponds to a plurality of contents (811) described above in FIG. 8b, and the new content taken in relation to the amusement park may correspond to new content (820).
[0172] According to one embodiment, the processor (110) of the electronic device (300) detects (or extracts) the repetitiveness (e.g., at least one of a set time (e.g., a certain period or a designated time, a time when new content is acquired, a time when new content corresponding to target content is acquired, a time when the electronic device (300) is located at a designated place, a time when a specific application is executed, a time when a repetitive event occurs, a time when a designated subject enters the field of view during camera shooting, and / or a time when another electronic device (300) approaches within a designated distance) of a plurality of contents (1001, 1002, 1003) related to an amusement park stored in a database (810) (e.g., content description information having a repetitive attribute with other content description information among content description information), and can generate recommendation information (1110) based on the detected repetitiveness. The recommendation information (1110) may include at least a portion of the content of the repetitiveness.
[0173] According to one embodiment, when new content corresponding to newly filmed content is input (or collected), the processor (110) of the electronic device (300) can determine whether the input new content (or information of the new content) is related to a specific story and repetition (or has common content description information). If the new content is related to the repetition of a specific story, the processor (110) determines the new content as target content having repetition with the story and, while adding the new content to the specific story, can generate recommendation information (1110) based on at least some of the content description information of the new content and the repetition (or context information) of the specific story. The processor (110) of the electronic device (300) can generate a notification page (1101) containing the recommendation information (1110). As an example, the notification page (1101) may include a notification guiding the generation of recommendation information (1110). For example, a notification guiding the creation of recommendation information (1110) is displayed on the display of the electronic device (300), and when user input selecting the notification occurs, a popup containing at least a portion of the recommendation information (1110) may be displayed. For example, the notification page (1101) may be displayed after the notification guidance. For example, the notification page (1101) may include a screen in which text containing recommendation information (1110) is displayed on the home screen. According to one embodiment, the notification page (1101) may include information guiding that a new story has been created (e.g., amusement park with family), a virtual button for playing the new story (e.g., view), or an item set to guide the creation of a new story again after a certain period of time (e.g., reminder or add schedule).According to one embodiment, after a notification related to a notification page (1101) is displayed, if the notification is selected by user input, a story (or a gallery function related to the story function) may be executed and displayed.
[0174] According to one embodiment, the processor (110) of the electronic device (300) may output the notification page (1101) to a display according to preset conditions. The preset conditions may include, for example, conditions corresponding to content description information (or repeatability) of a plurality of contents (1001, 1002, 1003) that contributed to the creation of the notification page (1101). For example, when a time identical or similar to the time at which the plurality of contents (1001, 1002, 1003) were acquired arrives, or when the electronic device (300) is located in a place identical or similar to the place where the plurality of contents (1001, 1002, 1003) were acquired or created within a certain range, the processor (110) of the electronic device (300) may output the notification page (1101). According to one embodiment, the processor (110) may determine 10:00 PM on this day as the time to output the notification page (1101) if a plurality of contents (1001, 1002, 1003) are acquired around 10:00 PM on a specific day of a specific month. According to one embodiment, the processor (110) may determine the timing to output the notification page (1101) if the place where the plurality of contents (1001, 1002, 1003) are acquired is a first point, and a user (or electronic device (300) is located within a certain distance relative to the first point.
[0175] According to one embodiment, the processor (110) of the electronic device (300) may collect ambient noise using a microphone and output the notification page (1101) to the display when the ambient noise is greater than or equal to a set threshold value (or less than the set threshold value). Alternatively, the processor (110) of the electronic device (300) may collect ambient audio signals using a microphone and output the notification page (1101) to the display when a specified audio signal is collected. Alternatively, the processor (110) of the electronic device (300) may control the output of the notification page (1101) to the display while a specific pre-specified application among the installed applications is active. Alternatively, the processor (110) of the electronic device (300) may control the output of the notification page (1101) to the display when there is no user operation for a set period of time (or when user operation is maintained for a set period of time). The output conditions of the above notification page (1101) may also be applied to at least one of the output conditions of the recommended content or the story containing the recommended content described in this description, or the story stored in the database (810).
[0176] When an item for playing a story (e.g., View) included in the above notification page (1101) is selected, the processor (110) of the electronic device (300) can output an integrated story to the display, including a plurality of contents (1001, 1002, 1003) and recommended content (1010a), as illustrated. According to one embodiment, the processor (110) of the electronic device (300) can sequentially output the first to third contents (1001, 1002, 1003) at regular time intervals, and control the output of the recommended content (1010a) to the display after the output of the third content (1003). Alternatively, the recommended content (1010a) may be displayed before the first to third content (1001, 1002, 1003) is displayed, or at some point between the first to third content (1001, 1002, 1003) being displayed.
[0177] According to one embodiment, the first content (1001) may include first context analysis information (1001_inf) (e.g., amusement park with family - Lotte World), first background information (1001_bg), or first object information (1001_ob). According to one embodiment, at least some of the indications included in the first context analysis information (1001_inf) may be omitted. For example, in the first context analysis information (1001_inf), at least one of the information "amusement park with family" and / or "Lotte World" may be omitted and not indicated.
[0178] According to one embodiment, the first context analysis information (1001_inf) may include text created based on place information corresponding to the first background information (1001_bg) and person information corresponding to at least some of the first object information (1001_ob). The first context analysis information (1001_inf) may include, for example, place name information. The first context analysis information (1001_inf) may be generated based on at least some of the description information of repetitive content.
[0179] According to one embodiment, the first background information (1001_bg) may include a background where the people corresponding to the first object information (1001_ob) are located at the time the first content (1001) is acquired. Alternatively, the first background information (1001_bg) may include a specific background of a location corresponding to the place name information. For example, the first background information (1001_bg) may include background information captured at a specific point in Lotte World. The first background information (1001_bg) may be included in at least a part of the content output information of the first content (1001). The first object information (1001_ob) may include information on each of the people included in the first content (1001). The first object information (1001_ob) may be analyzed based on the user's personal data (e.g., person images, names, or relationship information entered in a phone book). For example, the first object information (1001_ob) may include information regarding Person 1, Person 2, or Person 3 corresponding to a family. The first object information (1001_ob) may correspond to description information regarding objects included in the content output information of the first content (1001) and objects included in the content description information.
[0180] According to one embodiment, the second content (1002) may include second context analysis information (1002_inf) (e.g., amusement park with family - Everland), second background information (1002_bg), or second object information (1002_ob). The second context analysis information (1002_inf) may be generated based on at least a portion of the content description information of the second content (1002) or may include at least a portion of the content description information. The second background information (1002_bg) may be included in at least a portion of the content output information of the second content (1002). The second object information (1002_ob) may correspond to the objects included in the content output information of the second content (1002) and the description information regarding the objects included in the content description information.
[0181] According to one embodiment, at least some of the markings included in the second context analysis information (1002_inf) may be omitted. For example, the second context analysis information (1002_inf) may include at least some information identical to the first context analysis information (1001_inf). For example, the second context analysis information (1002_inf) may include information defining the second content (1002) and place name information of the place where the second content (1002) was acquired. The information defining the second content (1002) may include, for example, place-Everland, or object-family. The second background information (1002_bg) may include background information captured at the place where the second content (1002) was acquired. For example, the second background information (1002_bg) may include background information captured at a specific point in Everland. The second object information (1002_ob) may be identical or similar in at least part to the first object information (1001_ob). Alternatively, the second object information (1002_ob) may include the appearance of the individuals included in the first object information (1001_ob) after a certain period of time has elapsed. For example, the second object information (1002_ob) may include family information including Person 1, Person 2, or Person 3 at the time when the second content (1002) is acquired. The second object information (1002_ob) may be defined as family information even if a specific person (e.g., Person 1 corresponding to the mother or Person 3 corresponding to the father) is excluded or a new person (e.g., a new family member) is added.
[0182] According to one embodiment, the third content (1003) may include third context analysis information (1003_inf) (e.g., Family Amusement Park - Tokyo Disneyland), third background information (1003_bg), or third object information (1003_ob). The third context analysis information (1003_inf) may be generated based on at least a portion of the content description information of the third content (1003) or may include at least a portion of the content description information. The third background information (1003_bg) may be included in at least a portion of the content output information of the third content (1003). The third object information (1003_ob) may correspond to the objects included in the content output information of the third content (1003) and the description information regarding the objects included in the content description information.
[0183] For example, the third context analysis information (1003_inf) may include at least some information identical to the first context analysis information (1001_inf) and the second context analysis information (1002_inf). For example, the third context analysis information (1003_inf) may include information defining the third content (1003) and place name information of the location where the third content (1003) was acquired. The information defining the third content (1003) may include the location - Tokyo Disneyland, or the object - family. The third background information (1003_bg) may include background information captured at the location where the third content (1003) was acquired. For example, the third background information (1003_bg) may include background information captured at a specific point in Tokyo Disneyland. The third object information (1003_ob) may be at least partially identical or similar to the first object information (1001_ob) or the second object information (1002_ob). Alternatively, the third object information (1003_ob) may include the appearance of the persons included in the second object information (1002_ob) after a certain period of time has elapsed. For example, the third object information (1003_ob) may include family information including Person 1, Person 2, or Person 3 at the time when the third content (1003) is acquired. According to various embodiments, if a new Person 4 (e.g., younger sibling) is added at the time of acquiring the third content (1003), the processor (110) may refer to personal data to define Person 1 to Person 4 as a family and include them in the third object information (1003_ob).
[0184] According to one embodiment, a processor (110) of an electronic device (300) generates AI content (e.g., AI content (866) of FIG. 9) based on a plurality of contents (1001, 1002, 1003), and can generate recommended content (1010a) based on at least some of the content description information of the plurality of contents (1001, 1002, 1003) and the generated AI content. According to one embodiment, a generative AI model (670) can generate AI content (866) based on at least some of the recommendation information (1110) provided by a recommendation system module (862) and / or the prompts delivered by a prompt generator (864). Additionally or generally, the generative AI model (670) may generate recommended content (1010a) based on at least some of the content description information of the plurality of contents (1001, 1002, 1003) and recommendation information (1110). Additionally or generally, the processor (110) of the electronic device (300) may generate recommended content (1010a) based on at least some of the recommendation information (1110), the content description information of the plurality of contents (1001, 1002, 1003), and personal data of the electronic device (300).
[0185] For example, the recommended content (1010a) may include recommendation context information (1010_inf) (e.g., amusement park with family), story recommendation information (1010_rec), recommendation background information (1010_bg), or recommendation object information (1010_ob).
[0186] For example, the recommendation context information (1010_inf) may be identical or similar to the first to third context analysis information (1001_inf, 1002_inf, 1003_inf) described above. As an example, the recommendation context information (1010_inf) may include at least some information of a place-recommended place or an object-family.
[0187] For example, the story recommendation information (1010_rec) may include at least some similar or identical information to the recommendation information (1110) of the notification page (1101). For example, the story recommendation information (1010_rec) may include information recommending to the user of the electronic device (300) based on content description information of a plurality of contents (1001, 1002, 1003) and personal data. For example, the story recommendation information (1010_rec) may include information recommending other locations excluding the location where the plurality of contents (1001, 1002, 1003) were obtained. The location on the display where the story recommendation information (1010_rec) is displayed or the display form of the story recommendation information (1010_rec) may be changed in various ways or adjusted by user selection. For example, the story recommendation information (1010_rec) may be displayed as a popup with a specified transparency (e.g., 20 to 90%, or a specific amount of transparency) so that at least a portion of the background content is identifiable. Alternatively, the story recommendation information (1010_rec) may be displayed at a location that does not overlap with at least a portion of the background content (e.g., a location that does not overlap with at least one person included in the background content).
[0188] For example, the recommended background information (1010_bg) may include background information related to the place recommended in the story recommendation information (1010_rec). For example, the recommended background information (1010_bg) may include at least one of a photo or image, video, or thumbnail related to the place recommended in the story recommendation information (1010_rec).
[0189] For example, the recommended object information (1010_ob) may be identical or similar to at least some of the first to third object information (1001_inf, 1002_inf, 1003_inf). According to one embodiment, the processor (110) of the electronic device (300) may generate and provide a story to the user when the user is visiting an amusement park with family at the same time as the content description (e.g., place, behavior, or regularity) stored in the database (810). In this case, the processor (110) of the electronic device (300) may provide information related to a suggestion to update the story generated by visiting the amusement park with family. For example, the processor may detect content description information related to repetition (e.g., two repeating patterns (every spring, same person combination)) from personal data (a user who travels to amusement parks nationwide or overseas with family every spring) and automatically generate a new related story. In this process, the processor can generate and provide recommendation content (1010a) related to a new place using a generative AI model (865).
[0190] According to one embodiment, the aforementioned plurality of contents (1001, 1002, 1003) and recommended content (1010a) can be played as an updated story. The processor (110) of the electronic device (300) can output a virtual button (1103) for playing the updated story to the display.
[0191] FIG. 12 is a diagram showing an example of generating recommended content according to one embodiment.
[0192] Referring to FIGS. 1 through 12, the processor (110) of the electronic device (300) can acquire a plurality of contents (1201, 1202, 1203) stored in a database (810) (or memory) in relation to the generation of recommended content. In this regard, the user of the electronic device (300) can visit a certain location related to hiking and acquire at least one photograph (e.g., a plurality of contents (1201, 1202, 1203)) by using the electronic device (300), including a camera, at the visited mountain. For example, the user of the electronic device (300) can repeatedly acquire contents by visiting the same or similar location at the same or similar time. As an example, the user of the electronic device (300) can acquire a plurality of contents (1201, 1202, 1203) by visiting Bukhansan Mountain every spring (or a specific season) and taking photographs at a designated location. As another example, a user of the electronic device (300) may visit various mountains every spring (or a specific season) and take photos at a specific location on the visited mountain to obtain multiple contents (1201, 1202, 1203). According to one embodiment, a user of the electronic device (300) may repeatedly visit a specific mountain (e.g., Bukhansan) in various seasons and take photos at a designated location on the specific mountain to obtain multiple contents (1201, 1202, 1203). According to one embodiment, a user of the electronic device (300) may visit various mountains in various seasons and take photos at a specific location on the various mountains to obtain multiple contents (1201, 1202, 1203). Accordingly, the first content (1201), the second content (1202), and / or the third content (1203) described below may be examples of content taken or obtained in relation to the mountain. The above plurality of contents (1201, 1202, 1203) may correspond to the contents (814a) described in FIG. 8a or the contents (811) described in FIG. 8b.
[0193] As an example, the processor (110) of the electronic device (300) can obtain the plurality of contents (1201, 1202, 1203) from the database (810) in connection with generating recommendation content for the plurality of contents (1201, 1202, 1203) when the first content (1201) and the second content (1202) are stored in the database (810), the third content (1203) is collected, and at least a portion of the content description information of the third content (1203) is common with (or has a repetitive relationship with) at least a portion of the content description information of the first and second contents (1201, 1202). Alternatively, when the processor (110) of the electronic device (300) receives multiple contents (1201, 1202, 1203) from an external electronic device or an external server device, it may generate recommended content for the multiple contents (1201, 1202, 1203). Alternatively, after the multiple contents (1201, 1202, 1203) are stored in the database (810), when a set time arrives, the processor (110) of the electronic device (300) may obtain the multiple contents (1201, 1202, 1203) from the database (810) in relation to generating recommended content for the multiple contents (1201, 1202, 1203). Alternatively, the processor (110) of the electronic device (300) may obtain the multiple contents (1201, 1202, 1203) from the database (810) when a specific time corresponding to the content description information of the multiple contents (1201, 1202, 1203) arrives, or when it is located at a place corresponding to the content description information of the multiple contents (1201, 1202, 1203), or when it is located at a designated specific place. Among the content description information of the multiple contents (1201, 1202, 1203), description information having a repetitive relationship may be included in the context information and may be stored as story context information of a story generated based on the multiple contents (1201, 1202, 1203).
[0194] According to one embodiment, the first content (1201) may include, for example, first context analysis information (1201_inf) (e.g., autumn foliage viewing 1), first background information (1201_bg), or first object information (1201_ob). For example, the first context analysis information (1201_inf) may include text information describing autumn foliage viewing. Additionally, or generally, the first context analysis information (1201_inf) may further include song information related to autumn foliage viewing. While the first content (1201) is being played as story content (or story) along with other content (1202, 1203), the song information included in the first context analysis information (1201_inf) may be output. In the story content, at least one of the first context analysis information (1201_inf) (e.g., Autumn foliage viewing 1), the first context analysis information (1202_inf) (e.g., Autumn foliage viewing 2), and the third context analysis information (1203_inf) (e.g., Autumn foliage viewing 3) may be omitted. The first background information (1201_bg) may include an image of a mountain visited by the user. The first object information (1201_ob) may include person information (e.g., the user) included in the first content (1201).
[0195] According to one embodiment, the second content (1202) may include second context analysis information (1202_inf) (e.g., Autumn foliage viewing 2), second background information (1202_bg), or second object information (1202_ob). The second context analysis information (1202_inf) may be at least partially identical to the first context analysis information (1201_inf). For example, the second context analysis information (1202_inf) may include text and song information identical to the first context analysis information (1201_inf). The second background information (1202_bg) may include a background image taken at the same (or similar) location as the first background information (1201_bg) (e.g., the same mountain as the location where the first content (1201) was obtained). The second background information (1202_bg) may include an image taken with the same or similar composition as the first background information (1201_bg). The time of shooting of the second background information (1202_bg) and the time of shooting of the first background information (1201_bg) may include the same or similar time. For example, the first background information (1201_bg) may include a mountain image taken at the location of the first point on a specific day of a specific month in the autumn of 2024, and the second background information (1202_bg) may include a mountain image taken at the location of the first point on a specific day of a specific month in the autumn of 2025. Alternatively, the first content (1201) and the second content (1202) may include the same (or similar) location and the same (or similar) composition, but the time of shooting may be different. For example, the first background information (1201_bg) may include a background photographed at a first location with a first composition in early autumn 2024, and the second background information (1202_bg) may include a background photographed at a first location with a first composition in mid-autumn 2024. The first content (1201) and the second content (1202) may have a content relationship in which the location and composition are repeated.For example, the second object information (1202_ob) may include the same person as the first object information (1201_ob). However, the second object information (1202_ob) may include an image of clothing or equipment different from that of the first object information (1201_ob).
[0196] According to one embodiment, the third content (1203) may include third context analysis information (1203_inf) (e.g., Autumn foliage viewing 3), third background information (1203_bg), or third object information (1203_ob). The third context analysis information (1203_inf) may be at least partially identical or similar to the first context analysis information (1201_inf) or the second context analysis information (1202_inf). According to various embodiments, at least one of the first context analysis information (1201_inf), the second context analysis information (1202_inf), or the third context analysis information (1203_inf) may be determined or modified by user input. The third background information (1203_bg) may include a background image taken at the same or similar location (e.g., the same mountain) as the first background information (1201_bg) and the second background information (1202_bg). For example, the third background information (1203_bg) may include an image taken with the same or similar composition as the first background information (1201_bg) and the second background information (1202_bg). The time of shooting of the third background information (1203_bg), the time of shooting of the first background information (1201_bg), and the time of shooting of the second background information (1202_bg) may be the same or different. For example, the third background information (1203_bg) may include a background taken with the first composition at the location of the first point in late autumn of 2024. As an example, the first content (1201), second content (1202), and third content (1203) may have a content relationship in which the location and composition are repeated. The third object information (1203_ob) may include the same person as the first object information (1201_ob) or the second object information (1202_ob). Meanwhile, although the above description exemplifies content with different backgrounds, this description is not limited thereto.For example, the background information captured in the above multiple contents (1201, 1202, 1203) may include background information captured at the same time while having a mountain as the background (e.g., a different mountain, a different location, or a different composition).
[0197] According to one embodiment, when a plurality of contents (1201, 1202, 1203) are obtained, the processor (110) of the electronic device (300) may generate at least one of a first recommended content (1210a) or a second recommended content (1210b) based on the plurality of contents (1201, 1202, 1203). For example, the processor (110) may generate the first and second recommended content (1210a, 1210b) using at least a portion of the images included in the plurality of contents (1201, 1202, 1203) and the information (e.g., content description information) stored in a database (810) that is mapped to each of the plurality of contents (1201, 1202, 1203). Alternatively, the processor (110) of the electronic device (300) may search the database (810) for a story generated based on the plurality of contents (1201, 1202, 1203) and generate at least one of the first and second recommended contents (1210a, 1210b) based on story context information (or explanatory information related to repetition) included in the story, the plurality of contents (1201, 1202, 1203), and at least some of the personal data.
[0198] The first recommended content (1210a) may include, for example, first recommended context analysis information (1210a_inf), first story recommendation information (1210a_rec), first recommended background information (1210a_bg), and first recommended object information (1210a_ob). According to one embodiment, the first recommended context analysis information (1210a_inf) may be omitted from the first recommended content (1210a). For example, the first recommended context analysis information (1210a_inf) may be formed identically to any one of the first to third context analysis information (1201_inf, 1202_inf, 1203_inf). For example, the first recommendation context analysis information (1210a_inf) may include location information and time information (e.g., time, season, or seasonal information) where at least one of the multiple contents (1201, 1202, 1203) was obtained (or created). As an example, the first recommendation context analysis information (1210a_inf) may be determined as autumn foliage viewing (e.g., information related to hiking) in autumn (e.g., seasonal information). The first recommendation context analysis information (1210a_inf) may include at least a portion of the content description information of the first content (1201) or be generated based on at least a portion of the content description information of the first content (1201).
[0199] The first story recommendation information (1210a_rec) may include at least some content of text and images recommending a visit to a specific mountain (e.g., at least one of a mountain the user has visited in the past or a mountain the user has not visited in the past). The first story recommendation information (1210a_rec) may include recommendation information recommended by an AI model with at least one of a place and time related to a plurality of contents (1201, 1202, 1203) as input. Alternatively, the first story recommendation information (1210a_rec) may be generated based on repetitiveness detected in the information of the plurality of contents (1201, 1202, 1203) or story context information included in a story generated by the plurality of contents (1201, 1202, 1203). Alternatively, the first story recommendation information (1201a_rec) may include at least some of the story context information.
[0200] For example, the first recommended background information (1210a_bg) may include a background image related to a location different from the location where the plurality of contents (1201, 1202, 1203) were obtained (e.g., a different mountain). The background image may be obtained, for example, through an external server device or an internet search. The first recommended background information (1210a_bg) may include at least some of the content output information of the first to third object information (1201_ob, 1202_ob, 1203_ob). The first recommended background information (1210a_bg) may also be generated by a generative AI model.
[0201] The first recommended object information (1210a_ob) may include at least some of the objects included in the content output information of the first to third object information (1201_ob, 1202_ob, 1203_ob). Alternatively, the first recommended object information (1210a_ob) may include object information taken with an acquaintance or girlfriend.
[0202] According to one embodiment, the second recommended content (1210b) may include second recommended information (1210b_rec) or second recommended background information (1210b_bg). According to one embodiment, the second recommended information (1210b_rec) may be guided via a notification or displayed via a pop-up window. According to one embodiment, the second recommended information (1210b_rec) may be displayed via a quick panel (e.g., a panel output to a display in response to a drag input that drags from one side (e.g., upper side) of the display of the electronic device (300) to the other side (e.g., lower side). According to one embodiment, the second recommended information (1210b_rec) may be displayed during the story output related to the second recommended content (1210b). According to one embodiment, the second recommendation information (1210b_rec) may be displayed through the AI scheduling function (e.g., Now brief) of a portable communication device. According to one embodiment, the second recommendation information (1210b_rec) may be displayed through a gallery function (or photo album function) activation screen. Correspondingly, the second recommendation background information (1210b_bg) may include at least a part of at least one screen among a quick panel screen, a story screen, an AI scheduling function screen, and a gallery function screen.
[0203] For example, the second recommendation information (1210b_rec) may include content identical or similar to the first story recommendation information (1210a_rec) described above. Alternatively, the second recommendation information (120b_rec) may include at least some of the first recommendation context analysis information (1210a_inf) and the first story recommendation information (1210a_rec). Alternatively, the second recommendation information (1210b_rec) may further include text with content substantially identical to the first story recommendation information (1210a_rec), an item instructing story playback, and / or a reminder addition item. The second recommendation background information (1210b_bg) may include various background screens output by the processor (110) of the electronic device (300). As an example, the second recommendation background information (1210b_bg) may include a home screen. As another example, the second recommended content (1210) may be provided in the form of a pop-up window containing only second recommended information (1210b_rec) and may be displayed on the display of the electronic device (300) in response to whether a set condition is satisfied.
[0204] According to one embodiment, the processor (110) of the electronic device (300) can generate and provide a story to the user when the user visits the same time and place as defined in the content stored in the personal data. The personal data may include at least some of a profile (e.g., relationships), a preference (e.g., intimacy, events, or preferred places), content description information (e.g., places, behaviors, repetitions, or regularities), or an activity (e.g., travel, or exercise).
[0205] According to one embodiment, the processor (110) of the electronic device (300) may induce a user to visit a set location and take a photo of the specific composition so as to update a story related to a set location and a specific composition, and may provide recommended content (1210a, 1210b) generated based on the story or story context information. The plurality of contents (1201, 1202, 1203) described in FIG. 12 may include, for example, content description information corresponding to the same or similar time (e.g., autumn), location (e.g., mountain), and composition in three repetitions (or repetition patterns). The content description information that the plurality of contents (1201, 1202, 1203) have in common may be related to repetition. The processor (110) of the electronic device (300) may automatically generate a story based on the plurality (e.g., three) of content description information that the plurality of content description information have in common. The above story may have the above multiple (e.g., three) content description information as context information of the story. The processor (110) of the electronic device (300) may induce user behavior (e.g., induce autumn hiking) by generating the above multiple contents (1201, 1202, 1203) and / or recommended content related to the story (e.g., 1210a, 1210b) and outputting it alone, or by including it in a story generated based on the multiple contents (1201, 1202, 1203) and outputting it.
[0206] FIG. 13 is a diagram showing an example of providing a story including recommended content according to one embodiment.
[0207] Referring to FIGS. 1 through 13, the second recommendation content (1210b) described above in FIG. 12 can be displayed on the display of the electronic device (300). For example, the second recommendation content (1210b) may include second recommendation information (1210b_rec) and / or second background information (1210b_bg). Alternatively, the second recommendation content (1210b) may include only second recommendation information (1210b_rec), and the second recommendation information (1210b_rec) may be displayed as a background on a specific screen of the electronic device (300) (e.g., a home screen, or a specific application execution screen). According to one embodiment, regarding at least a portion of the second recommended content (1210b) (e.g., second recommended information (1210b_rec)), the processor (110) of the electronic device (300) outputs a notification related to the second recommended content (1210b) in a designated notification area of the display, and when user input selecting the notification occurs, outputs a popup window containing at least a portion of the second recommended content (1210b) to the display. According to one embodiment, the processor (110) of the electronic device (300) may output a notification related to the creation and / or output of the second recommended content (1210b) through at least one of vibration, sound, or a lamp. According to one embodiment, the processor (110) of the electronic device (300) may output a notification (or notification, or popup) related to the creation and / or output of the second recommended content (1210b) through another electronic device connected via a communication channel. According to one embodiment, the processor (110) of the electronic device (300) can output a notification (or notification, or popup) related to the creation and / or output of the second recommended content (1210b) through a virtual studio technology (VST) or smart glass (or augmented reality glass).
[0208] According to one embodiment, at least a portion of the second recommended content (1210b) (e.g., second recommendation information (1210b_rec)) may be displayed through a pop-up window. According to one embodiment, at least a portion of the second recommended content (1210b) (e.g., second recommendation information (1210b_rec)) may be displayed through at least one screen among a quick panel screen, a story output screen, an AI scheduling function screen, and / or a gallery function screen.
[0209] According to one embodiment, when a story view item (1210b_rec_S) (e.g., "View") included in the second recommendation information (1210b_rec) is selected, the processor (110) of the electronic device (300) may output a plurality of contents (1201, 1202, 1203) and a first recommendation content (1210a) according to a set method as illustrated. Alternatively, the processor (110) may output a story generated based on the plurality of contents (1201, 1202, 1203) and the first recommendation content (1210a) (or an integrated story in which the first recommendation content (1210a) is added to a story generated based on the plurality of contents (1201, 1202, 1203).
[0210] According to one embodiment, in relation to the integrated story output (or output of a plurality of contents (1201, 1202, 1203) and a first recommended content (1210a)), the processor (110) of the electronic device (300) may output the first recommended content (1210a) first, and after a first time has elapsed, sequentially output the first to third contents (1201, 1202, 1203) for a second time at a fixed time interval. The processor (110) of the electronic device (300) may set the time (e.g., first time, second time) during which the first recommended content (1210a) and the plurality of contents (1201, 1202, 1203) are output to the display to be the same. Alternatively, the processor (110) of the electronic device (300) may set the first time for which the first recommended content (1210a) is output to be longer than the time for which the first content (1201) (or the second content (1202), or the third content (1203)) is output (e.g., the second time) to more strongly present the hiking recommendation suggested in the first recommended content (1210a). Alternatively, the processor (110) of the electronic device (300) may set the first time for which the first recommended content (1210a) is output to be shorter than the time for which the first content (1201) (or the second content (1202), or the third content (1203)) is output (e.g., the second time) to arouse user curiosity about the recommended place.
[0211] The first recommended content (1210a) provided as an integrated story may include first recommended context analysis information (1210a_inf), first story recommendation information (1210a_rec), first recommended background information (1210a_bg), or first recommended object information (1210a_ob), as previously described in FIG. 12. The plurality of contents (1201, 1202, 1203) provided as an integrated story may each include context analysis information (1201_inf, 1202_inf, 1203_inf), identical to the contents previously described in FIG. 12, and may each include background information and object information. When playback of the integrated story for a set period of time is terminated, the processor (110) of the electronic device (300) may output a virtual button (1103) for additional playback of the integrated story including the first recommended content (1210a) to the display.
[0212] FIG. 14 is a drawing showing an example of providing a story guide according to one embodiment.
[0213] Referring to FIGS. 1 through 14, a user of the electronic device (300) may perform a repetitive event (e.g., various exercise classes such as yoga, craft classes related to leather or woodworking, instrument classes for playing, or painting classes), and may take photos of themselves and / or other people (or class results) performing the repetitive event during the performance of the repetitive event. Photos taken during the performance of the repetitive event may be stored as content in a database (810). As an example, content description information for photos taken related to the repetitive event may include the location where the repetitive event is performed, the time when the repetitive event is performed, the object performing the repetitive event (e.g., an object or person), the shooting angle for taking photos of the people performing the repetitive event or class results, and at least some of the content of the repetitive event. While the user of the electronic device (300) is performing the repetitive event, the posture of the user's specific movements, playing skills, or work results may be gradually improved. In this regard, if the repetitive event of the electronic device (300) is included in the schedule, automatic shooting (e.g., automatic shooting when the electronic device (300) is mounted at a specific location) can be performed at the time the repetitive event is executed.
[0214] The processor (110) of the electronic device (300) may provide a story guide that enhances the repetitive event (e.g., guides the repetitive event to be continuously maintained and progressed) based on at least a portion of the content obtained during the performance of the repetitive event. The story guide may be provided through at least one screen among the home screen, camera screen, story playback screen, gallery screen, or scheduling function screen. By checking the story guide, the user can check their status of change in the repetitive event or their proficiency status regarding the repetitive event. In the following description, a yoga class will be described as an example of a repetitive event.
[0215] According to one embodiment, the recommendation information (1410b_rec) may include, for example, content describing repetitiveness extracted from personal data (or repetitiveness extracted from multiple contents). For example, when generating the recommendation information (1410b_rec), the processor (110) of the electronic device (300) may generate the recommendation information (1410b_rec) based on at least some of the date, time, place, person, time schedule information, or class content. For example, if the user of the electronic device (300) periodically conducts yoga classes, the conduct of yoga classes may be included in the repetitiveness. The processor (110) may determine whether the user conducts yoga classes based on the name of the place where the yoga class is conducted, or personal data related to the conduct of yoga classes (e.g., yoga class payment information), and generate recommendation information (1410b_rec) regarding yoga classes (e.g., 2024 Yoga Journey Guide). The processor (110) can determine the date on which the yoga class is to be held based on the recommendation information by obtaining the date from personal data (e.g., a scheduling table provided by a yoga studio or schedule information entered by the user).
[0216] According to one embodiment, regarding the generation of recommendation information (1410b_rec), the processor (110) collects information regarding a user's activity (or personal data) (e.g., location or place, time, person, or type of task), and if the activity performed by the user is determined to be a task requiring a recommendation guide due to its repetitiveness, it sets a recommendation goal and can generate recommendation information (1410b_rec) based on the set recommendation goal. According to one embodiment, the processor (110) may collect information regarding user activity and provide information regarding user activity to an AI model that generates recommendation information (1410b_rec), and may obtain recommendation information (1410b_rec) from the AI model.
[0217] According to one embodiment, the recommendation information (1410b_rec) may include a viewing item (1410b_rec_S) (e.g., "View") which allows viewing a story generated based on a plurality of contents. When the viewing item (1410b_rec_S) is selected, the processor (110) may output at least one of the recommended content generated in relation to the 2024 yoga journey or a story related to the user's yoga class progress. The recommendation information (1410b_rec) may include a story guide item (1410b_rec_A) (e.g., "Add from Camera").
[0218] According to one embodiment, when the story guide item (1410b_rec_S) is selected, the processor (110) of the electronic device (300) can automatically activate the camera and output guide screen information (1410c) including guide background information (1410c_bg) obtained through the camera to the display of the electronic device (300).
[0219] According to one embodiment, when recommended content (1410b) includes guide information (e.g., posture information) that guides a recurring event, when user input corresponding to confirmation of recommended content (1410b) occurs, the processor (110) of the electronic device (300) can execute a story guide function and automatically activate the camera. The processor (110) of the electronic device (300) can support a guide function based on the activated camera function. The guide function may include a function to automatically capture video data of the subject when the subject captured through the camera assumes a designated posture. Additionally or generally, the guide function may include a function to output a voice that induces the subject's movement so that the subject captured through the camera assumes a designated posture, and a function to automatically capture video data of the subject when the subject assumes a designated posture. According to one embodiment, when a user input selecting recommended content (1410b) is received, the processor (110) of the electronic device (300) can activate the camera to output a preview screen and display an item that can turn on or turn off (activate or deactivate) the guide function. When the guide function is turned on (activated), the processor (110) can perform the guide function described above.
[0220] According to one embodiment, the processor (110) collects information regarding correct yoga postures as recommendation information and compares the correct yoga posture with the yoga posture currently taken by the user to provide recommendation content that can improve the yoga posture (e.g., included in a part of a story guide or output separately). As an example, the processor (110) may generate a prompt saying "Analyze previous posture images and create yoga posture images that can be improved," provide the generated prompt to a generative AI model (865), receive recommendation content from the generative AI model (865), and output it to a display. The recommendation content may be output via the camera's preview screen or guide screen information (1410c).
[0221] In this regard, the guide screen information (1410c) may include guide background information (1410c_bg) (e.g., shooting information acquired in real-time by the camera, or preview information, or information captured by user input), a control area (1410c_con) related to camera shooting control, a story guide object (1410c_gd), or a story guide off item (1410c_off). The story guide object (1410c_gd) may include a person object (or silhouette of a person object) of a specific content among a plurality of yoga-related contents stored in the database (810). Alternatively, the story guide object (1410c_gd) may include a silhouette of a person object that takes a yoga pose identical or similar to the yoga pose of a person object included in the plurality of yoga-related contents stored in the database (810), while taking a pose that is more difficult or better than the pose of the person object in the contents. Alternatively, the story guide object (1410c_gd) may include a yoga pose of a person searched by the user as a goal for a yoga journey (or a silhouette of the searched person's yoga pose). According to one embodiment, the story guide object (1410c_gd) may be generated based on a yoga pose of a specified person.
[0222] According to one embodiment, when the story guide off item (1410c_off) is selected, the processor (110) of the electronic device (300) can control the removal of the story guide object (1410c_gd) from the guide screen information (1410c) and output only the video screen (e.g., preview screen) captured through the camera to the display. When the story guide off item (1410c_off) is selected, the processor (110) of the electronic device (300) can control the output of the story guide on item to the guide screen information (1410c) so that the story guide object (1410c_gd) can be output again. The user of the electronic device (300) can receive encouragement for the yoga class through the guide screen information (1410c). The processor (110) can provide at least one of the following: matching a story guide object (1410c_gd) with a user's yoga pose, extracting differences based on the pose matching, and information regarding yoga pose correction based on the extracted differences.
[0223] FIG. 15a is a diagram illustrating an example of recommendation content generation and story provision according to one embodiment.
[0224] Referring to FIGS. 1 through 15a, as an example, when a plurality of contents (1501, 1502, 1503) are stored in a database (810) in relation to a recurring event (e.g., an exercise class such as yoga), the processor (110) of the electronic device (300) can generate a story (e.g., corresponding to the story (812) of FIG. 8b) related to the plurality of contents (1501, 1502, 1503) (e.g., corresponding to the contents (811) of FIG. 8b). The processor (110) can generate recommended content (e.g., recommended content (1410b) of FIG. 14) based on the generated story in response to specified conditions. The processor (110) can output at least one of the generated story and / or recommended content. According to one embodiment, the processor (110) of the electronic device (300) may output recommended content (e.g., recommended content 1410b of FIG. 14) after playing a story (e.g., a story including multiple contents (1501, 1502, 1503)) according to specified conditions. Alternatively, the story including the recommended content (1410b) may be output together, or the story may be output after the recommended content (1410b).
[0225] According to one embodiment, the processor (110) of the electronic device (300) may collect new content related to a repeating event after outputting recommended content (or a story containing recommended content). For example, if a user takes a photo related to a repeating event after playing recommended content (1410b), the electronic device (300) may acquire new content (1500_tg) corresponding to the photo (or video, image) taken by the user. According to one embodiment, when the processor (110) of the electronic device (300) acquires new content (1500_tg) that includes content description information having the same attributes as at least some of the content description information of a plurality of contents (1501, 1502, 1503) (or when new content (1500_tg) related to a repeating event is acquired), it may generate an updated story based on the previously stored story and the newly acquired new content (1500_tg), and output the updated story according to specified conditions. According to one embodiment, the processor (110) of the electronic device (300) may generate new recommendation content (1510) including a praise message based on the acquisition of new content (1500_tg). In this process, the processor (110) may generate at least one of an update story based on a story containing a plurality of stored contents (1501, 1502, 1503) and new content (1500_tg), an integrated update story based on a story containing a plurality of contents (1501, 1502, 1503) and recommendation content (1410b) and new content (1500_tg), or an integrated update story based on a story containing a plurality of contents (1501, 1502, 1503) and new content (1500_tg) and new recommendation content (1510).
[0226] According to one embodiment, when a viewing item (1410b_rec_S) (e.g., View) that allows viewing a story in FIG. 14 is selected, the processor (110) of the electronic device (300) may output an updated story or an integrated story including recommended content (1410b) of FIG. 14, which includes a plurality of contents (1501, 1502, 1503) as illustrated (or a story including a plurality of contents (1501, 1502, 1503)) and new content (1500_tg) as target content (e.g., content including content description information that is the same as or similar within a certain category as at least some of the content description information of the plurality of contents (1501, 1502, 1503)).
[0227] For example, the plurality of contents (1501, 1502, 1503) (or stories) may include a first content (1501) comprising a first context analysis information (1501_inf) (e.g., 2024 Yoga Journey 1), a first background information (1501_bg), and a first object information (1501_ob), a second content (1502) comprising a second context analysis information (1502_inf) (e.g., 2024 Yoga Journey 2), a second background information (1502_bg), and a second object information (1502_ob), or a third content (1503) comprising a third context analysis information (1503_inf) (e.g., 2024 Yoga Journey 3), a third background information (1503_bg), and a third object information (1503_ob). The plurality of contents (1501, 1502, 1503) (or stories) may include content filmed on different days or dates, or at the same or similar time zones. According to one embodiment, the plurality of contents (1501, 1502, 1503) (or stories) may include content filmed a certain amount of time prior to a set point in time (e.g., the current point in time). The new content (1500_tg) may include content filmed at the current point in time (or content acquired at the current point in time).
[0228] According to one embodiment, the first to third context analysis information (1501_inf, 1502_inf, 1503_inf) may include text (or images) of substantially the same content. For example, the first to third context analysis information (1501_inf, 1502_inf, 1503_inf) may include text regarding a yoga journey in 2024. Additionally or generally, the first to third context analysis information (1501_inf, 1502_inf, 1503_inf) may further include song information related to yoga. As the plurality of contents (1501, 1502, 1503) include the same song information, the same song may be output as background music while the story generated by the plurality of contents (1501, 1502, 1503) is being played. Additionally or generally, the first to third context analysis information (1501_inf, 1502_inf, 1503_inf) may include information on the date or day of the week when the yoga class was conducted. Alternatively, the first to third context analysis information (1501_inf, 1502_inf, 1503_inf) may include information on the yoga class instructor (e.g., instructor name).
[0229] According to one embodiment, the first to third background information (1501_bg, 1502_bg, 1503_bg) may include images corresponding to the same background when the yoga class is performed in the same location. However, depending on the shooting composition or shooting angle, each of the first to third background information (1501_bg, 1502_bg, 1503_bg) may include a different image even if they are included in content shot in the same location. Alternatively, if the yoga class is moved outdoors or the location is changed, the first to third background information (1501_bg, 1502_bg, 1503_bg) may include different background images.
[0230] According to one embodiment, the first to third object information (1501_ob, 1502_ob, 1503_ob) may include information on the same person conducting a yoga class. For example, the first to third object information (1501_ob, 1502_ob, 1503_ob) may include a person object corresponding to a user of the electronic device (300), a person object analyzed by the first to third context analysis information (1503_inf), or a target object being photographed by the user of the electronic device (300). Alternatively, the first to third object information (1501_ob, 1502_ob, 1503_ob) may include information on a person conducting a yoga class at the same (or similar) location or the same (or similar) time (or time) extracted from the content description information of a plurality of contents (1501, 1502, 1503). At least one of the first to third object information (1501_ob, 1502_ob, 1503_ob) may include a plurality of person objects. The processor (110) may include in the object information only the recognition of a person whose face is recognizable in each of the contents (1501, 1502, 1503) or a person whose face is recognizable and who corresponds to the person information stored in the memory (or database (810)) of the electronic device (300).
[0231] As previously described, the new content (1500_tg) may include content captured at the current time (or within a certain time period based on the current time) or content acquired at the current time (or within a certain time period based on the current time) (e.g., acquired from an external device or server device (400)). According to one embodiment, the new content (1500_tg) may include content acquired after the output of a story and recommendation content (e.g., recommendation content 1410b of FIG. 14) generated based on a plurality of contents (1501, 1502, 1503). According to one embodiment, the new content (1500_tg) may include target content having at least some similarity to the plurality of contents (1501, 1502, 1503). For example, the new content (1500_tg) may include target content that has content description information (e.g., place, time, person, content describing the content, or composition of at least some of the content descriptions of multiple contents (1501, 1502, 1503)) that is identical or similar within a certain category, and may include content acquired at the current time (or content acquired within a certain time from the current time or after the output of the story and recommended content (1410b)). As an example, the new content (1500_tg) may include new background information (1500_tg_bg) and new object information (1500_tg_ob). According to one embodiment, the new background information (1500_tg_bg) may include a place or composition that is identical or similar within a certain range to the first to third background information (1501_bg, 1502_bg, 1503_bg). The new object information (1500_tg_ob) may include person information identical to the first to third object information (1501_ob, 1502_ob, 1503_ob).Alternatively, the new object information (1500_tg_ob) may include an object of a person different from the person included in the first to third object information (1501_ob, 1502_ob, 1503_ob). In terms of repeatability (or repeating pattern), the object included in the new content (1500_tg) may include a similarity in posture with the object included in the plurality of contents (1501, 1502, 1503). Alternatively, in terms of repeatability (or repeating pattern), at least one of the place, time, or person where the new content (1500_tg) was acquired may be identical to or similar within a certain range to at least one of the place, time, or person where the plurality of contents (1501, 1502, 1503) were acquired.
[0232] According to one embodiment, the processor (110) of the electronic device (300) can generate new recommended content (1510) related to the new content (1500_tg) after the story generated based on a plurality of contents (1501, 1502, 1503) and the story-related recommended content (1410b) are output, and the new content (1500_tg) is obtained within specified conditions. According to one embodiment, the processor (110) of the electronic device (300) can receive user input selecting a story guide item (1410b_rec_A) or user input selecting a content add button (1500_ad) after playing the story (or after playing the story containing the plurality of contents (1501, 1502, 1503) and the recommended content (1410b). When a processor (110) collects new content (1500_tg) related to the user's repetitive event performance using an activated camera in response to user input (e.g., new content as target content having repetition with multiple contents (1501, 1502, 1503) (or story)), the processor (110) can generate new recommended content (1510) based on the collected new content (1500_tg). According to one embodiment, the processor (110) of the electronic device (300) can generate an updated story based on the new recommended content (1510) and a story including the multiple contents (1501, 1502, 1503), or generate an integrated updated story based on a story generated based on the multiple contents (1501, 1502, 1503), the new content (1500_tg), and the new recommended content (1510) (e.g., including encouragement or praise messages).
[0233] According to one embodiment, the new recommended content (1510) may include recommendation context analysis information (1510_inf), recommendation background information (1510_bg), story recommendation information (1510_rec) and recommendation object information (1510_ob), or recommendation link information (1510_link). The new recommended content (1510) is generated upon acquisition of new content (1500_tg) and may be output including a message related to praise or encouragement for performing a repetitive event.
[0234] According to one embodiment, the recommendation context analysis information (1510_inf) may include information identical or similar to the first to third context analysis information (1501_inf, 1502_inf, 1503_inf) (e.g., 2024 yoga journey, or song information). The recommendation background information (1510_bg) may include information combining the new background information (1500_tg_bg) of the new content (1500_tg) with any one of the first to third background information (1501_bg, 1502_bg, 1503_bg), or information combining the new background information (1500_tg_bg) with at least a part of the first to third background information (1501_bg, 1502_bg, 1503_bg). The processor (110) of the electronic device (300) may apply a new background image found through the internet as the recommended background information (1510_bg).
[0235] According to one embodiment, the story recommendation information (1510_rec) may include information guiding the addition of new content. The recommended object information (150_ob) may include object information identical to any one of the new object information (1500_tg_ob) or the first to third object information (1501_ob, 1502_ob, 1503_ob). The recommended link information (1510_link) may include a story view item. When the story view item is selected, the processor (110) of the electronic device (300) may output an integrated story based on at least one of the already created story, new content (1500_tg), and new recommended content (1510) based on the plurality of contents (1501, 1502, 1503).
[0236] According to one embodiment, the processor (110) of the electronic device (300) may output a story including the new recommended content (1510) and the plurality of contents (1501, 1502, 1503) in response to user operation (or user input) or satisfaction of a set condition. Alternatively, the processor (110) of the electronic device (300) may output a story including the plurality of contents (1501, 1502, 1503), new content (1500_tg), and the new recommended content (1510) in response to user operation (or user input) or satisfaction of a set condition. The above-described set conditions may include, for example, a condition in which a time identical (or similar) to the time at which a plurality of contents (1501, 1502, 1503) are acquired arrives, a condition in which an electronic device (300) is located in a place identical (or similar) to the place where a plurality of contents (1501, 1502, 1503) are acquired (or created), a condition in which ambient noise is greater than or equal to a set threshold value, a condition in which a designated audio signal is collected, a condition in which a pre-designated specific application is activated, or a condition in which there is no user operation for a set period of time. At least some of the above-described set conditions may be used as conditions for outputting a story in embodiments described in connection with other drawings of the present invention.
[0237] According to one embodiment, the processor (110) of the electronic device (300) can provide a story recording the progress of yoga movements. In this regard, the processor (110) of the electronic device (300) can generate and provide a story based on a plurality of captured contents (1501, 1502, 1503) when a user visits a specific place, such as a yoga studio, and takes a photo with a specific composition according to personal data (at least some data among Profile (e.g., relationships), Preference (e.g., intimacy, events, or preferred places), Context (e.g., places, behaviors, or regularities), and Activity (e.g., travel, activities, or exercise). In this operation, the processor (110) can generate recommended content (1410b) related to the plurality of contents (1501, 1502, 1503) and output it together with the story. When a user visits a yoga studio and films new content (1500_tg), the processor (110) of the above electronic device (300) determines the new content (1500_tg) resulting from the visit to the yoga studio (or GG Yoga School) as target content, updates the story based on the new content (1500_tg), and outputs the updated story depending on whether the output conditions are satisfied. Alternatively, when a new content (1500_tg) (e.g., a target content in which at least part of the content description information is identical or similar to the content description information of a plurality of contents (1501, 1502, 1503)) is obtained, the processor (110) of the electronic device (300) may generate a new recommended content (1510) based on at least part of the plurality of contents (1501, 1502, 1503) (or a story including the plurality of contents (1501, 1502, 1503)) and the new content (1500_tg), and generate (or integrate) a story including the new recommended content (1510) and provide it to the user.
[0238] According to one embodiment, the processor (110) of the electronic device (300) can automatically generate a new story by detecting two recurring patterns (same place and same composition, same place and similar object posture, same place and same time) from content (e.g., photos taken) obtained in relation to a user taking a yoga pose at a yoga studio. When a photo of the same composition is obtained at the time the user visits the yoga studio, the processor (110) can generate an updated story by adding the obtained photo to the automatically generated new story. According to one embodiment, after the automatic generation of the new story, the processor (110) can automatically output the story guide described in FIG. 14 when the electronic device (300) is located at the yoga studio. The processor (110) of the electronic device (300) can play a role in guiding or inducing the user to achieve their goals by adding and presenting encouragement / praise messages to the story in response to the acquisition of new content (1500_tg).
[0239] As described above, the processor (110) of the electronic device (300) according to one embodiment can provide an automated story generation function that automatically analyzes the repetitiveness (or continuity) of content beyond simple information such as the date, location, background, or person of photos and videos, and binds them into a more meaningful story without separate user action, and can strengthen the repetitiveness of the story by automatically reflecting new photos and videos into the story after the time of story generation. In addition, the processor (110) of the electronic device (300) according to one embodiment can promote the continuous formation of stories and suggest future content by using a generative AI model (865) to predict and suggest photos or videos that the user may take in the future. Furthermore, the processor (110) of the electronic device (300) according to one embodiment can enrich the user experience through various additional functions, such as a function to compare images generated through the generative AI model (865) with actual images, a photo-taking reminder, or commercial suggestions (e.g., booking accommodation at a travel destination).
[0240] FIG. 15b is a diagram showing another example of recommendation content generation and story provision according to one embodiment.
[0241] Referring to FIGS. 1 to 15b, the processor (110) of the electronic device (300) may generate at least one of a first recommended content (1504) and / or a second recommended content (1505) corresponding to a plurality of contents (1501, 1502, 1503). Each of the plurality of contents (1501, 1502, 1503) may include context analysis information (1501_inf, 1502_inf, 1503_inf), object information (1501_ob, 1502_ob, 1503_ob), and / or background information (1501_bg, 1502_bg, 1503_bg). Context analysis information (1501_inf, 1502_inf, 1503_inf) in the above plurality of contents (1501, 1502, 1503) may be omitted. The processor (110) may generate and store a story including the plurality of contents (1501, 1502, 1503). The processor (110) may collect and store new content.
[0242] The first recommended content (1504) may be generated based on the background information (1504_bg) (or output information of the first new content) and the first story guide information (1504_rec) of the first new content. As an example, the first recommended content (1504) may include context analysis information (1504_inf), background information (1504_bg) of the first new content, and first story guide information (1504_rec). The background information (1504_bg) of the first new content may include background information and object information. The context analysis information (1504_inf) may be omitted in the first recommended content (1504). In relation to the generation of the first recommended content (1504), the background information (1504_bg) of the first new content may be replaced with other information. For example, the first recommended content (1504) may include, instead of the background information (1504_bg) of the first new content, new background information generated by a generative AI module based on the background information (1504_bg) of the first new content, and / or new background information generated by a generative AI module based on at least some of the plurality of contents (1501, 1502, 1503) and at least one of the background information (1504_bg) of the first new content.
[0243] The background information (1504_bg) of the first new content may include image data (e.g., still image or video) obtained through a camera of the electronic device (300) or image data received from an external electronic device. When the processor (110) of the electronic device (300) receives the background information (1504_bg) of the first new content, it may generate the first recommended content (1504) by adding the first story guide information (1504_rec) to the background information (1504_bg) of the first new content, and generate the first integrated story by adding the first recommended content (1504) to a story generated based on a plurality of contents (1501, 1052, 1503). The first story guide information (1504_rec) may include content that suggests or induces the performance of repetitive events (e.g., yoga class) related to the plurality of contents (1501, 1502, 1503).
[0244] According to one embodiment, when the processor (110) of the electronic device (300) receives the second new content (1505_bg), it may generate the second recommended content (1505) by adding the second story guide information (1505_rec) to the background information (1505_bg) of the second new content (or the output information of the second new content, or background information generated by a generative AI module based on the background information of the second new content), and may generate an integrated story by adding the second recommended content (1505) to a story generated based on a plurality of contents (1501, 1052, 1503). Alternatively, the processor (110) may generate an integrated updated story by adding the second recommended content (1505) to an integrated story that includes a plurality of contents (1501, 1052, 1503) and the first recommended content (1504). The above second story guide information (1504_rec) may include information that allows adding background information (1505_bg) of the second new content to any of specific applications (e.g., camera, gallery, or reminder). When a specific item is selected in the second story guide information (1504_rec), the processor (110) may save the background information (1505_bg) of the second new content to the selected application execution screen or together with the selected application. For example, when the 'Add from gallery' item is selected, the processor (110) may output the gallery function execution screen and output the background information (1505_bg) of the second new content on the gallery function execution screen. According to one embodiment, when the 'Add from camera' item is selected, the processor (110) may activate the camera and output a preview image to be used as recommended background information on the camera's preview screen.
[0245] According to one embodiment, the background information (1504_bg) of the first new content and the background information (1505_bg) of the second new content may be the same content. For example, when the background information (1504_bg or 1505_bg) of one new content is obtained through a camera or an external electronic device, the processor (110) may generate at least one of the first recommended content (1504) and / or the second recommended content (1505) based on the obtained background information (1504_bg or 1505_bg) of the new content.
[0246] FIG. 16 is a diagram showing an example of utilizing a story guide function according to one embodiment.
[0247] Referring to FIGS. 1 through 16, an electronic device (1600) according to one embodiment may include a first housing (1610), a second housing (1620), a hinge device (1630), and a flexible display (1660) (or display) comprising a first display area (1660a) and a second display area (1660b). The electronic device (1600) shown in FIG. 16 may include the same or similar configurations as the foldable electronic device (200) described above in FIGS. 2 through 4. The hinge device (1630) may include the hinge device (240, 240-1) described above in FIG. 2. The flexible display (1660) may be folded or unfolded based on the area where the hinge device (1630) is placed.
[0248] In relation to the operation of the electronic device (1600), the processor (110) of the electronic device (1600) may output a designated screen to the display (1660) in response to user operation or user input. For example, in relation to the execution of a story guide function, the processor (110) of the electronic device (1600) may output a story guide object (1600_gd) to the first display area (1660a). In relation to the execution of the story guide function, the processor (110) may activate a camera (e.g., camera module, 205, 208 of FIG. 2) and output an image obtained through the camera to the second display area (1660b). In this regard, a shooting object (1600_me) may be displayed in the second display area (1660b). Regarding the display of a captured object (1600_me), the processor (110) may activate a camera located on the opposite side of the side where the foldable flexible display (1660) is placed (e.g., the second camera module (208) of FIG. 2) and output an image acquired by the camera (e.g., a preview image) to the second display area (1660b). Alternatively, the processor (110) may activate a camera located on the side where the flexible display (1660) is placed (e.g., the first camera module (205) of FIG. 2) and output an image acquired in the form of a selfie camera to the second display area (1660b). The captured object (1600_me) may include content that was previously captured and stored in the memory of the electronic device (1600). The processor (110) can output the specified content and the story guide object (1600_gd) to one screen to support a comparison between the objects included in the specified content and the story guide object (1600_gd).
[0249] According to one embodiment, the processor (110) of the electronic device (1600) may use a camera to capture the user activity situation at a designated location while the user performs a specific activity (or action) (e.g., yoga movements) and may store the captured content in a database (810) (or memory). As an example, the processor (110) may store the video captured using the camera in the memory of the electronic device (1600) or in an external server device connected to the electronic device (1600) via a communication channel. When the processor (110) of the electronic device (1600) receives user input requesting to output the captured content to a display (1660), it may output the captured content to the display (1660), wherein, as illustrated, the story guide object (1600_gd) may be output to a first display area (1660a) and the captured object (1600_me) may be output to a second display area (1660b).
[0250] According to one embodiment, when new shooting content is collected, the processor (110) of the electronic device (1600) may store the newly collected shooting content as new content in memory (e.g., a storage area related to the gallery function). As previously described, if the new content has a repetitive relationship with at least one content previously stored in the database (810) (e.g., a storage area distinct from the storage area related to the gallery function) (e.g., at least some of the content description information of the new content is identical to or similar within a certain category to at least some of the content description information of the stored at least one content), the processor (110) may determine the new content as target content and update a story or create a new story based on the new content and at least one content stored in the database (810). While the processor (110) outputs a story guide object (1600_gd) to the first display area (1660a), it may output a story (or story content) to the second display area (1660b). In response to this, new content and at least one piece of content may be displayed in the second display area (1660b) in the form of a video or a slide.
[0251] According to one embodiment, when new captured content is collected, the processor (110) of the electronic device (1600) may update a story or create a new story based on the captured content (e.g., content having content description information that is identical to or similar within a certain range to at least a portion of the content description information of at least one previously stored content) and at least one previously stored content. Additionally, the processor (110) may create recommended content based on the new content and at least one content. While the processor (110) outputs a story guide object (1600_gd) to the first display area (1660a), it may output a story (or story content) including recommended content to the second display area (1660b). The electronic device (1600) can output a story guide object (1600_gd) to a first display area (1660a) and output a story to a second display area (1660b) in a flex mode (e.g., a state in which the first housing (1610) and the second housing (1620) are folded at a certain angle greater than 0 degrees and less than 180 degrees). In relation to the generation of the recommendation content, the processor (110) can construct the recommendation content by combining at least some of the inferred recommendation information and prompts, image information output from a generative AI model (865), corresponding content description information (e.g., repeatability or common content description information), or personal data. The recommendation content may include various information such as text, images, or videos, and the recommendation content may be linked to a reminder or a specific application. For example, if the content description information includes location information corresponding to "Tokyo Disneyland," the recommended content may include information related to flight booking apps to Tokyo, Tokyo hotel booking apps, or schedule management apps.
[0252] According to one embodiment, while a user wears an HMD device (or VST device) and views a specific story (e.g., a summer sea trip story), the processor (110) can provide content that allows the user to view the sea of a recommended travel destination as recommended content.
[0253] FIG. 17 is a diagram illustrating an example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0254] Referring to FIGS. 1 through 17, in relation to an information provision method according to one embodiment, in operation 1701, a processor (110) of an electronic device (300) can check the repeatability of contents (814a in FIG. 8a or 811 in FIG. 8b, and a plurality of contents described in other drawings). For example, the processor (110) can check the repeatability of a plurality of contents stored in a database (810) when a specified condition is satisfied. The specified condition may include, for example, a condition in which the electronic device (300) is located at a specific point (or a point within a certain radius or range relative to the specific point), a condition in which a specific time arrives, a condition in which new content is collected, a condition in which a user input requesting content repeatability check occurs, or a condition in which a specific application related to content repeatability analysis is executed. Alternatively, the processor (110) can activate a recommended content generation function when a story is generated according to the set condition. The set conditions related to the above story generation may include conditions in which multiple contents having repeatability are stored in memory (e.g., database (810)). In relation to verifying the repeatability of the contents, the processor (110) can check the content description information of the contents (e.g., content description information (811b) of FIG. 8b) to determine whether at least some parts are common (or whether they have more than a specified number of commonalities). For example, the processor (110) can determine that the contents have repeatability if the place of acquisition or creation of the first content among the multiple contents is the same or similar to the place of acquisition or creation of the second content within a certain range. Alternatively, the processor (110) can determine whether the contents have repeatability by checking the same or similarity of the time of acquisition or creation of the content among the multiple contents, the same or similarity of the object included in the content, and the same or similarity of the content describing the output information of the content (e.g., composition information of the content output information).
[0255] When multiple contents having repetitiveness are identified (or searched, or detected), in operation 1703, the processor (110) can generate recommended content related to the multiple contents. For example, the processor (110) can generate recommended content based on at least some of the information having repetitiveness among the content description information of the multiple contents, and / or at least some of the personal data of the user of the electronic device (300). The generation of the recommended content can be performed according to at least some of the contents described above in FIGS. 5 to 16.
[0256] In operation 1705, the processor (110) may generate an integrated story containing the generated recommended content. For example, the processor (110) may generate an integrated story by linking multiple contents and the recommended content together. The integrated story may include, for example, content output information included in multiple contents and data (or information) set to output the recommended content according to specified conditions. As an example, the integrated story may include information set to output the recommended content after outputting the content output information of multiple contents in a slide manner according to specified time intervals. The operation 1705 may be modified or omitted. For example, the processor (110) may perform an operation to output only the recommended content. Alternatively, the processor (110) may output an integrated story containing the recommended content (a story containing the recommended content in the previous story) according to a change in settings.
[0257] In operation 1707, the processor (110) may display information related to the integrated story output. For example, the processor (110) may output a notification related to the integrated story output to the display of the electronic device (300), and if user input requesting integrated story playback occurs through the notification, the integrated story may be output to the display. Alternatively, the processor (110) may output a pop-up window related to the integrated story output to the display of the electronic device (300), and if user input requesting integrated story playback occurs through the pop-up window, the integrated story playback may be performed. If operation 1705 is omitted, operation 1707 may also be omitted.
[0258] According to one embodiment, the integrated story generation operation in operation 1705 and the integrated story output related information display operation in operation 1707 may be omitted or replaced with other operations. For example, the processor (110) of the electronic device (300) may generate recommended content according to a specified first condition and, by replacing operation 1705 without generating a separate integrated story, output a notification or pop-up window guiding the generation of recommended content to the display of the electronic device (300) according to a specified second condition. The specified first condition may include, for example, a condition in which the electronic device (300) is not used based on personal data, and / or a condition in which an app related to the recommended content (e.g., a gallery app) is activated based on screen time (e.g., the user's usage history of the electronic device (300)). The designated second condition may include at least one of the following conditions: a condition in which a specific application related to viewing recommended content based on personal data is executed (e.g., a condition in which a gallery app is primarily active); a condition in which the electronic device (300) reaches a specific location or a specific time arrives; a condition in which a specific subject is included within the camera's field of view; and / or a condition in which another designated electronic device around the electronic device (300) approaches within a designated distance via short-range communication. When user input requesting playback of recommended content occurs via a notification or pop-up window, the processor (110) may output the recommended content to the display of the electronic device (300). According to one embodiment, in the operation of outputting recommended content, the processor (110) may output at least some of the content among a plurality of contents together with the recommended content.
[0259] FIG. 18 is a diagram showing another example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0260] Referring to FIGS. 1 through 18, in relation to an information provision method according to one embodiment, in operation 1801, the processor (110) of the electronic device (300) may perform content repeatability checks. For example, the processor (110) may check whether there is repeatability for a plurality of contents stored in a database (810) in response to a specified condition. For example, the processor (110) may perform content repeatability checks when a specified time arrives or when the electronic device (300) reaches a specified location. For example, the processor (110) may check the time when the user of the electronic device (300) is asleep or the time when the electronic device (300) is not used (e.g., time spent at home after work) through personal data (e.g., the user's electronic device (300) usage pattern or the user's lifestyle pattern), and when the corresponding specified time arrives, perform content repeatability checks. Alternatively, the processor (110) may receive new content from an external electronic device (or external server device) using a communication circuit. Alternatively, the processor (110) can use a camera to acquire content (e.g., captured image, captured video, captured content, video, or still image) containing a specific background or specific object according to user input as new content.
[0261] In operation 1803, the processor (110) of the electronic device (300) can check whether there is a story related to the repetition of multiple contents stored in the database (810). For example, the processor (110) can check the content description information of the contents stored in the memory (or database (810)) of the electronic device (300) and check whether there is a story that has the same story context information for a set portion or more among the information included in the content description information. The story includes a video data group formed of multiple contents, and the story may include content in which multiple contents are output in a video playback method or a slide playback method for a specified time at a specified time interval.
[0262] In the case where there is no story related to repetition, in operation 1805, the processor (110) of the electronic device (300) can perform the creation of a new story. For example, the processor (110) can create a new story based on a plurality of contents having repetition. In this operation, the processor (110) can create a new story according to the new story creation operation described above in at least one of FIGS. 5 to 16.
[0263] According to one embodiment, in relation to the operation of generating a new story based on the collection of new content, the processor (110) may determine the output order of the content included in the story based on the creation time of at least one content having repetition with the newly acquired content. For example, the processor (110) may determine the output order so that the content included in the new story is output in order from the oldest content to the most recently created content. Alternatively, the processor (110) may determine the output order of the content included in the new story (e.g., new content and at least one content having repetition with the new content among the content stored in the database (810)) so that the most recently created content is output first.
[0264] If the above story exists, in operation 1807, the processor (110) of the electronic device (300) can generate recommended content. In relation to the generation of recommended content, the processor (110) can generate recommended content based on at least some of the recommended content generation method described in operation 1703 of FIG. 17 or the recommended content generation method described in FIG. 5 to FIG. 16.
[0265] Regarding the generation of recommended content above, the operation of generating recommended content based on the collection of new content may include an operation of generating recommended content based on at least a portion of content description information corresponding to the repeatability of new content and / or at least one stored content, a background image different from the background of at least one content and / or new content, or image data having a person object identical to a person object included in at least one content and / or new content. Alternatively, the operation of generating recommended content may include an operation of generating recommended content based on at least one of a background image related to a recommended place related to at least one content and / or new content, or advertising information related to a recommended place. The advertising information may include various link information related to accommodation, food, amusement facilities, or product purchase related to the recommended place.
[0266] In operations 1809 and 1811, the processor (110) of the electronic device (300) may perform operations identical or similar to operations 1705 and 1707 described above in FIG. 17. Accordingly, operations 1809 and 1811 may be replaced or supplemented by at least some description of operations 1705 and 1707 described above.
[0267] FIG. 19 is a diagram showing another example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0268] Referring to FIGS. 1 through 19, in relation to an information provision method according to one embodiment, in operation 1901, the processor (110) of the electronic device (300) can check the repeatability of the contents according to the satisfaction of a specified condition. For example, the processor (110) checks the condition that a specified time arrives, that the electronic device (300) is located at a specified point, or that new content is received from an external electronic device (or server device (400)) or that new content is acquired through a camera, and when the condition is satisfied, the repeatability of the contents can be checked.
[0269] When repetitive content is identified, in operation 1903, the processor (110) of the electronic device (300) can provide the repetitive content identified to an AI model. The AI model may be stored in the memory of the electronic device (300) or stored in a separate external server device. The AI model can generate recommended content based on content description information of the repetitive content and at least some of the personal data related to the user of the electronic device (300). The generation of recommended content may be performed according to at least some methods of generating recommended content described in FIGS. 5 to 16. When recommended content is generated, the AI model can provide the generated recommended content to the electronic device (300). In this operation, the AI model can provide story information related to the recommended content to the electronic device (300). If the electronic device (300) does not store the story related to the recommended content, the AI model can generate a new story based on the repetitive content and provide the recommended content to the electronic device (300) along with the new story.
[0270] In operation 1905, the processor (110) of the electronic device (300) may receive recommended content from an AI model (or an external electronic device that operates the AI model). When recommended content is received from the AI model, in operation 1907, the processor (110) of the electronic device (300) may output the received recommended content. In this operation, the processor (110) may search for a story corresponding to the recommended content based on the story information received from the AI model, and may output the searched story and the recommended content to a display according to specified conditions. When the processor (110) receives a new story and recommended content together from the AI model, or when it receives a story containing recommended content, it may output the recommended content along with story playback. Alternatively, when the processor (110) receives only recommended content, it may output the recommended content in response to set output conditions.
[0271] FIG. 20 is a diagram illustrating an example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0272] Referring to FIGS. 1 through 20, in relation to an information provision method according to one embodiment, in operation 2001, the processor (110) of the electronic device (300) can check whether a specified condition is satisfied (or whether the specified condition is met) in operation 2001. The specified condition may include at least one of a first condition in which the electronic device (300) enters a location within a geographical range, a second condition in which the electronic device (300) is detected to be within a specified distance of at least one object (e.g., a condition in which the at least one object among the subjects reflected in the camera of the electronic device (300) is recognized by the electronic device (300), or a condition in which another electronic device related to the at least one object and allowed to be connected to the electronic device is detected to be within a specified distance of the electronic device), and a third condition in which a repetitive event is detected.
[0273] In accordance with the satisfaction of the specified conditions above, in operation 2003, the processor (110) of the electronic device (300) may select a plurality of image data (e.g., two or more contents) stored in the database (810). As an example, the processor (110) may select a plurality of image data among the image data stored in the database (810) in which at least some of the content description information is common to each other (e.g., has repeatability). For instance, the processor (110) may select image data where the place of creation (or acquisition) is the same or similar, image data where the time of creation (or acquisition) is the same or similar, image data where at least some of the objects included in the output information of the image data are the same or similar, image data where at least some of the description information describing each of the image data is the same or similar, and image data where at least some of the composition of the image confirmed through the output information of the image data is the same or similar.
[0274] In operation 2005, the processor (110) of the electronic device (300) can generate new image data (e.g., recommendation content) based on a plurality of selected image data. In relation to the generation of new image data, the processor (110) can generate new image data according to at least some of the recommendation content generation methods described above in FIGS. 5 to 16. For example, the processor (110) can generate new image data based on at least some of the images included in the selected image data, at least some of the objects included in the selected image data, at least some of the content description information of the selected image data, and at least some of the content describing the selected image data. Alternatively, the processor (110) may generate new image data based on other images that are related to the selected image data. Alternatively, the processor (110) may generate new image data using a generative AI model.
[0275] In operation 2007, the processor (110) of the electronic device (300) can create a group of video data (e.g., a story) and perform a notification thereon. For example, the processor (110) can create an integrated story that outputs selected video data and new video data in a slide format. The processor (110) can control to output at least one of a notification, a pop-up window, and / or a message guiding the creation of the story. When user input requesting story playback occurs, the processor (110) can control to play the integrated story containing new video data and output it to a display.
[0276] FIG. 21 is a diagram illustrating an example of a content-based information provision method having repeatability of an electronic device according to one embodiment.
[0277] Referring to FIGS. 1 through 21, in operation 2101, the processor (110) of the electronic device (300) can check whether the contents have repeatability. In this regard, the processor (110) can check whether specified conditions are met. For example, the processor (110) can check whether the usage situation of the electronic device (300) meets the specified conditions described in FIG. 20 above. If the current situation of the electronic device (300) meets the specified conditions, the processor (110) can check whether repeatability is included by comparing the information of the contents stored in the database (810) (e.g., content description information). According to one embodiment, when new content is acquired, the processor (110) can check whether repeatability exists between the information of the new content (e.g., content description information) and the information of the contents stored in the database (810) (e.g., content description information).
[0278] When the repetitiveness of the contents is confirmed, in operation 2103, the processor (110) of the electronic device (300) may obtain personal data related to the contents. The personal data may include at least some of the following: a profile of the multiple contents for which repetitiveness has been obtained (e.g., relationship information of the user of the electronic device (300)), a preference (e.g., information related to the user of the electronic device (300)’s taste, objects of intimacy, events, or preferred places), content description information (e.g., the location where the electronic device (300) is located, the user’s behavior, or the user’s regularity), or an activity (e.g., the user’s travel, or exercise).
[0279] In operation 2105, the processor (110) of the electronic device (300) can perform recommendation information generation and recommendation image generation. For example, the processor (110) can generate recommendation information based on the repeatability of the content identified in operation 1901 and at least some of the content-related personal data obtained in operation 1905. For example, the recommendation information may include at least some of the content describing the repeatability and at least some of the information included in the personal data of the content. In relation to the generation of recommendation images, the processor (110) may include images related to the repeatability included in the content, excluding the images included in the content. In this regard, the processor (110) may search for images related to repeatability via the internet and select a specific image among the obtained images according to a set condition (e.g., a condition excluding images included in the content used to obtain repeatability).
[0280] In operation 2107, the processor (110) of the electronic device (300) can perform recommendation content generation. For example, the processor (110) can generate recommendation content by combining the recommendation information on the recommendation image. Alternatively, the processor (110) can generate recommendation content that includes only recommendation information. Alternatively, the processor (110) can generate recommendation content by collecting information linked to the information related to the repetition and including the collected linked information in the recommendation image along with the recommendation information. The linked information may include, for example, at least some of information linked to a place included in the repetition (or advertising information), information linked to a time included in the repetition (or advertising information), or information linked to a person included in the repetition (or advertising information).
[0281] When recommended content is generated, in operation 2109, the processor (110) of the electronic device (300) may generate a reconstructed integrated story including the recommended content. Alternatively, if there is a stored story related to the content used to generate the recommended content, the processor (110) may reconstruct the integrated story by adding the recommended content to the stored story. According to one embodiment, the processor (110) may output the generated recommended content independently of the story. For example, the processor (110) may output information related to the recommended content (e.g., a notification or popup guiding the generation of recommended content), and when user input requesting playback of the recommended content (e.g., checking the notification or selecting specific link information in the popup window) is received, the recommended content may be output to the display. As an example, the recommended content may include a link that can request playback of the related story. When user input selecting the recommended content or a link included in the recommended content occurs, the processor (110) may play the story related to the recommended content. According to one embodiment, the processor (110) may automatically play a story related to the recommended content after a specified time has elapsed since the playback of the recommended content. In the operation described above, if there is no story related to the recommended content, the story (110) may create a new story based on multiple contents involved in the creation of the recommended content. According to one embodiment, at least some of the descriptions regarding at least one method of providing information in FIGS. 17 to 19 described above may be supplemented or replaced by at least some of the contents of the embodiments described in FIGS. 5 to 16.
[0282] As described above, an electronic device (300) according to one embodiment includes a display (e.g., display 140 of FIG. 1), at least one processor (e.g., processor (110) of FIG. 1), a memory for storing instructions (e.g., memory (120) of FIG. 1, database (810) of FIG. 8b), and when the instructions are executed individually or collectively by the at least one processor, the electronic device is configured to check for repeatability of a plurality of contents stored in the memory in response to a specified condition, generate a first recommended content based on the plurality of contents having repeatability, and output information related to the first recommended content to the display in response to a set output condition.
[0283] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device is configured to check repeatability by comparing content description information of a plurality of contents stored in the memory when a specified time arrives, or by comparing content description information of a plurality of contents stored in the memory when the electronic device is located within a certain range relative to a specified point, or by comparing content description information of the new content with content description information of a plurality of contents stored in the memory when new content is received from the outside.
[0284] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device is configured to check whether a story related to the plurality of contents is stored in the memory, and if a story related to the plurality of contents exists, to add the first recommended content to the story to create an integrated story, and to output the integrated story in response to the set output condition.
[0285] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device is configured to output a notification related to the recommended content, receive user input requesting playback of the recommended content through the notification, and output the plurality of contents included in the integrated story and the recommended content in a specified order.
[0286] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device is configured to provide the new content, which includes the content description information of the new content, to a generative AI (artificial intelligence) model in connection with acquiring a story having at least some of the same or similar story context information as the content description information of the new content.
[0287] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device is configured to acquire at least one content having repeatability with the new content when the new content is received, generate a new story based on the acquired at least one content and the new content, generate the first recommended content based on at least some of the content included in the new story, and output the first recommended content in response to the set output condition.
[0288] According to one embodiment, the set output condition is characterized by including at least one of the following conditions: a condition in which a set time arrives; a condition in which the electronic device is located within a certain range based on a set location; a condition in which a specific object is detected within the field of view of the camera of the electronic device; a condition in which a designated application of the electronic device is executed; a condition in which a user input requesting the output of the first recommended content is received; or a condition in which a designated audio signal is received.
[0289] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device is configured to check whether a story related to the plurality of contents is stored in the memory, and if no story related to the plurality of contents exists, to generate a new story based on the plurality of contents, to generate an integrated story by adding a first recommended content to the new story, and to output the integrated story in response to the set output condition.
[0290] According to one embodiment, the first recommended content is characterized by including at least one of the following: recommendation information suggesting a visit to a place of the same or similar type within a certain range as the place where the plurality of repetitive contents were obtained or generated; recommendation information suggesting a visit to a place and time period that is the same or similar as the place and time period where the plurality of repetitive contents were obtained; or advertising information related to the place.
[0291] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device is configured to output a second recommended content praising the collection of video data when video data of the conditions guided by the first recommended content is collected after the integrated story output.
[0292] According to one embodiment, the first recommended content is characterized by including an image generated through a generative AI model.
[0293] According to one embodiment, the first recommended content is characterized by including information that presents a similar experience related to a plurality of contents having the repeatability, and information that guides a shooting composition related to the similar experience.
[0294] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device is configured to check whether at least one or more of the following conditions are satisfied: a first condition in which the electronic device enters a location within a geographical range, a second condition in which the electronic device is detected to be within a specified distance of at least one object, and a third condition in which a repetitive event is detected; and if at least one or more of the first to third conditions are satisfied, the electronic device is configured to output the first recommended content.
[0295] According to one embodiment, an electronic device (100, 200, 300, or 1600) according to an embodiment of the present description comprises a display (e.g., display 140 of FIG. 1), at least one camera (e.g., camera module, 205, 208 of FIG. 2), at least one processor (e.g., processor (110) of FIG. 1), and a memory for storing instructions (e.g., memory (120) of FIG. 1 or database (810) of FIG. 8b), wherein when the instructions are executed individually or collectively by the at least one processor, the electronic device determines whether they meet specified conditions, and if it determines that they meet specified conditions, image data stored in the memory (e.g., content-description information stored in the database (810) of FIG. 8b) or image data stored in a server to which access by the electronic device is permitted (e.g., content stored in the server memory of the server device (400) of FIG. 5) From at least one of the above, two or more video data (or multiple contents) corresponding to the specified conditions are selected, and in addition to the previously captured video data (e.g., multiple contents stored), at least one new video data (e.g., recommended content) corresponding to the specified conditions is created, and a video data group (e.g., story) is created including the two or more video data corresponding to the selected specified conditions and the newly created video data, and a notification (e.g., recommendation information or notification page) indicating that the video data group has been created is displayed through the display.
[0296] According to one embodiment, the specified condition is a first condition in which the electronic device enters a location within a geographical range, and two or more image data corresponding to the specified condition may include image data previously captured at a location within the range. For example, the first condition may include a condition in which the electronic device (300) enters the same location (or a similar location within the range) as the location where the two or more image data were acquired or generated.
[0297] According to one embodiment, the specified condition is a second condition in which the electronic device is detected to be within a specified distance from at least one object, and the two or more image data corresponding to the specified condition may include previously captured image data containing the at least one object. For example, the second condition may include a condition in which an object included in the two or more image data is within the specified distance from the electronic device (300), and may include a condition in which the object is detected as a subject during image capture through a camera included in the electronic device (300).
[0298] According to one embodiment, the case in which the electronic device is detected to be within a specified distance of the at least one object may include the case in which the at least one object among the subjects projected onto the camera is recognized by the electronic device, or the case in which another electronic device associated with the at least one object and allowed to be connected to the electronic device is detected to be within a specified distance of the electronic device.
[0299] According to one embodiment, the specified condition is a third condition in which a repetitive event is detected, and two or more image data corresponding to the specified condition may include image data that was previously captured within a certain range of time based on the time when the repetitive event occurred. The repetitive event may include an event in which a user of the electronic device (300) repeatedly visits a specific place, an event in which a user of the electronic device (300) repeatedly performs a specific action, or an event in which a user of the electronic device (300) repeatedly consumes a specific food, and an event in which a user's activity is repeatedly performed.
[0300] According to one embodiment, the specified conditions are at least two of the following: a first condition in which the electronic device enters a location within a geographical range; a second condition in which it is detected that the electronic device is in close proximity to at least one object within a specified distance; and a third condition in which a repetitive event is detected. The two or more image data corresponding to the first condition are image data (e.g., a photograph or video) that was previously captured at the location within the specified range. The two or more image data corresponding to the second condition are previously captured image data containing the at least one object (e.g., a person object included in the content). The two or more image data corresponding to the third condition are image data that was previously captured within a specified period based on the time when the repetitive event occurred. The two or more image data corresponding to the specified conditions may include image data that simultaneously corresponds to the at least two or more conditions.
[0301] A method for providing information by an electronic device according to an embodiment of the present invention may include: determining whether a specified condition is met; when it is determined that the specified condition is met, selecting two or more image data (e.g., multiple contents) corresponding to the specified condition from at least one of image data (e.g., contents (811)) stored in a memory (120) (or database (810)) included in the electronic device (300) or image data stored in a server to which access by the electronic device is permitted; generating at least one new image data (e.g., recommended content) corresponding to the specified condition in addition to the previously captured image data; generating an image data group (e.g., story) including the two or more selected image data corresponding to the specified condition and the generated new image data; and displaying a notification through the display indicating that the image data group has been created.
[0302] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device, display; At least one processor; and Includes memory for storing instructions; and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Checking the repeatability of multiple contents stored in the memory in response to specified conditions, and Generates a first recommended content based on multiple repetitive contents, and An electronic device characterized by being configured to output information related to the first recommended content to the display in response to set output conditions.
2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When a designated time arrives, verify repeatability by mutually comparing the content description information of multiple contents stored in the memory, or When the above electronic device is located within a certain range based on a designated point, it verifies repeatability by mutually comparing content description information of multiple contents stored in the memory, or An electronic device characterized by being configured to verify repeatability by comparing the content description information of the new content with the content description information of a plurality of contents stored in the memory when new content is received from the outside.
3. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Check whether a story related to the above multiple contents is stored in the memory, and if a story related to the above multiple contents exists, add the first recommended content to the story to create an integrated story, An electronic device characterized by being configured to output the integrated story in response to the above-set output conditions.
4. In Paragraph 3, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Display a notification related to the above recommended content, and Receive user input requesting playback of the recommended content through the above notification, and An electronic device characterized by being configured to output the plurality of contents included in the integrated story and the recommended content in a specified order.
5. In Paragraph 2, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device characterized by being configured to provide the new content, which includes the content description information of the new content, to a generative AI (artificial intelligence) model in relation to acquiring a story having at least some identical or similar story context information with respect to the content description information of the new content.
6. In Paragraph 2, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When the above new content is received, at least one content having repeatability with the above new content is obtained, and A new story is generated based on at least one of the above-mentioned acquired content and the above-mentioned new content, and Generate the first recommended content based on at least some of the content included in the new story above, and An electronic device characterized by being configured to output the first recommended content in response to the above-set output conditions.
7. In Paragraph 1, The output conditions set above are, Condition for the set time to arrive, Condition in which the electronic device is located within a certain range based on a set location, Condition in which a specific object is detected within the field of view of the camera of the above electronic device, Conditions under which a specified application of the above electronic device is executed, Conditions under which user input requesting the output of the first recommended content is received, or An electronic device characterized by including at least one of at least one of the conditions for receiving a specified audio signal.
8. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, It is checked whether a story related to the aforementioned multiple contents is stored in the memory, and if no story related to the aforementioned multiple contents exists, a new story is created based on the aforementioned multiple contents, and a first recommended content is added to the new story to create an integrated story. An electronic device characterized by being configured to output the integrated story in response to the above-set output conditions.
9. In Paragraph 8, The above first recommended content is Recommendation information suggesting a visit to a place of the same or similar type within a certain range as a place where multiple contents having the above-mentioned repeatability were obtained or generated, Recommendation information that recommends a visit to a place and time identical or similar to the place and time where multiple contents having the above-mentioned repeatability were obtained, or An electronic device characterized by including at least one piece of information among advertising information related to the above-mentioned place.
10. In Paragraph 8, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, After the above integrated story output, if video data meeting the conditions guided by the above first recommended content is collected, An electronic device characterized by being configured to output a second recommended content that praises the above-mentioned video data collection.
11. In Paragraph 1, The above first recommended content is An electronic device characterized by including an image generated through a generative AI model.
12. In Paragraph 1, The above first recommended content is An electronic device characterized by including information that presents a similar experience related to a plurality of contents having the above-mentioned repeatability, and information that guides a shooting composition related to the above-mentioned similar experience.
13. In Paragraph 12, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Checking whether at least one or at least two of the following conditions are satisfied: a first condition in which the electronic device enters a location within a geographical range, a second condition in which it is detected that the electronic device is in close proximity to at least one object within a specified distance, and a third condition in which a repetitive event is detected. An electronic device characterized by being configured to output the first recommended content when at least one or at least two of the first to third conditions are satisfied.
14. In electronic devices, display; At least one camera; At least one processor; and Includes memory for storing instructions; and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Determine whether it meets the specified conditions, and When it is determined that the above specified conditions are met, two or more image data corresponding to the above specified conditions are selected from at least one of the image data stored in the memory or the image data stored in the server to which access by the electronic device is permitted, and In addition to the previously captured video data, at least one new video data corresponding to the specified conditions is generated, and A group of image data is generated that includes two or more image data corresponding to the selected specified conditions and the newly generated image data, and An electronic device that displays a notification through the display indicating that the above image data group has been created.
15. In Paragraph 14, The above-mentioned specified conditions include at least one of a first condition in which the electronic device enters a location within a geographical range, a second condition in which it is detected that the electronic device is in close proximity to at least one object within a specified distance, and a third condition in which a repetitive event is detected. An electronic device in which two or more image data corresponding to the above specified conditions are image data previously captured at a location within the above specified range, image data previously captured including at least one object, or image data previously captured within a certain range period based on the time when the above repetitive event occurred.