Electronic device for displaying content related to living characteristics of user, and methods thereof

Abstract

An electronic device is disclosed. The electronic device comprises: at least one sensor; a memory for storing a plurality of programs; a communication unit for communicating with at least one external device; a display; and a processor. The processor: acquires a knowledge graph for living characteristics of a user on the basis of respective execution histories of the plurality of programs, a communication history showing communications using the communication unit, and a sensing value of the at least one sensor, and stores the knowledge graph in the memory; on the basis of the knowledge graph, analyzes each of the physical activity, the social activity, and living patterns of the user for a predetermined period; controls the display so as to display content containing at least one graphic object for expressing the physical activity, the social activity, and the living patterns; and if at least one among the physical activity, the social activity, and the living patterns changes, controls the display so as to change and display at least one feature of the content on the basis of the changed information.

Description

Electronic devices and methods for displaying content related to user's lifestyle characteristics

[0001] The present invention relates to an electronic device and a method for displaying content related to a user's lifestyle characteristics.

[0002] Thanks to advancements in electronic technology, various types of electronic devices are now used in our daily lives. Among these devices are mobile phones, which display a variety of content.

[0003] For example, a user's mobile phone can sense the distance and time traveled, providing information such as whether the user has exercised appropriately. However, with only information about specific areas, it's difficult to grasp the results of a comprehensive analysis of life and the corresponding recommendations at a glance.

[0004] Therefore, a method was needed to display content that would provide a comprehensive analysis of the user's life over a certain period of time and provide recommendations at a glance.

[0005] According to at least one embodiment of the present disclosure, an electronic device includes at least one sensor, a memory storing a plurality of programs, a communication unit for performing communication with at least one external device, a display, and a processor. The processor includes:

[0006] A knowledge graph about the user's lifestyle characteristics is acquired and stored in the memory based on the execution history of each of the plurality of programs, the communication history communicated using the communication unit, and the sensing value of the at least one sensor, and the physical activity, social activity, and lifestyle pattern of the user for a preset period of time are analyzed based on the knowledge graph, and the display is controlled to display content including at least one graphic object for expressing the physical activity, the social activity, and the lifestyle pattern, and when at least one of the physical activity, the social activity, and the lifestyle pattern changes, the display is controlled to change and display at least one characteristic of the content based on the changed information.

[0007] In addition, according to at least one embodiment of the present disclosure, a display method of an electronic device including at least one sensor includes the steps of: obtaining a knowledge graph about a user's life characteristics based on an execution history of each of a plurality of programs stored in the electronic device and a sensing value of the at least one sensor; analyzing physical activity, social activity, and life pattern of the user for a preset period of time based on the knowledge graph; displaying content including at least one graphic object for expressing the physical activity, the social activity, and the life pattern; and, when at least one of the physical activity, the social activity, and the life pattern changes, changing and displaying at least one feature of the content based on the changed information.

[0008] In addition, a non-transitory readable recording medium according to at least one embodiment of the present disclosure stores a program for performing the display method, including the steps of: obtaining a knowledge graph about a user's life characteristics based on an execution history of each of a plurality of programs stored in the electronic device and a sensing value of the at least one sensor; analyzing physical activity, social activity, and life pattern of the user for a preset period of time based on the knowledge graph; displaying content including at least one graphic object for expressing the physical activity, the social activity, and the life pattern; and, when at least one of the physical activity, the social activity, and the life pattern changes, changing and displaying at least one characteristic of the content based on the changed information.

[0009] FIG. 1 is a diagram for explaining an operation of collecting information on lifestyle characteristics of various users in electronic devices according to at least one embodiment of the present disclosure.

[0010] FIG. 2 is a block diagram illustrating a configuration of an electronic device according to at least one embodiment of the present disclosure.

[0011] FIG. 3 is a diagram illustrating an operation of an electronic device according to at least one embodiment of the present disclosure to obtain a knowledge graph about a user's lifestyle characteristics.

[0012] FIG. 4 is a diagram illustrating an example of content displayed on an electronic device according to at least one embodiment of the present disclosure.

[0013] FIGS. 5 and 6 are diagrams illustrating examples of collecting data about a user or other users in an electronic device according to at least one embodiment of the present disclosure and changing content according to the changed data.

[0014] FIGS. 7 and 8 are diagrams showing examples of content displaying recommendation information for improving a user's condition in an electronic device according to at least one embodiment of the present disclosure.

[0015] FIG. 9 is a diagram illustrating an example of content displayed by adding content to a selected program screen on an electronic device according to at least one embodiment of the present disclosure.

[0016] FIG. 10 is a diagram illustrating an example of content that informs an electronic device of the latest information on a user's field of interest according to at least one embodiment of the present disclosure.

[0017] FIG. 11 is a flowchart illustrating a method of displaying content related to a user's lifestyle characteristics according to at least one embodiment of the present disclosure.

[0018] The terms used in the various embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should be defined based on the meaning of the terms and the overall content of this disclosure, rather than simply their names.

[0019] It should be understood that the various embodiments of the present disclosure and the terminology used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, but include various modifications, equivalents, or substitutes of the embodiments.

[0020] In connection with the description of the drawings, similar reference numerals may be used for similar or related components.

[0021] The singular form of a noun corresponding to an item may include one or more of said items, unless the relevant context clearly indicates otherwise.

[0022] In this disclosure, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof.

[0023] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not limit the components in any other respect (e.g., importance or order).

[0024] When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0025] Terms such as "include" or "have" are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the present disclosure, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0026] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.

[0027] When we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.

[0028]

[0029] *The term "and / or" includes any combination of multiple related described components or any one of multiple related described components.

[0030] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor (150), excluding any "modules" or "parts" that need to be implemented in specific hardware.

[0031] In this disclosure, the term user (1-1 to 1-n) may refer to a person using an electronic device or a device used by the person.

[0032] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0033] FIG. 1 is a drawing for explaining an operation of collecting information on lifestyle characteristics of various users (1-1 to 1-n) in electronic devices (100-1 to 100-n) according to at least one embodiment of the present disclosure.

[0034] Each electronic device (100-1 to 100-n) can identify the lifestyle characteristics of its user (1-1 to 1-n) and display corresponding content. For convenience of explanation, the following description assumes that one of the electronic devices (100-1 to 100-n) illustrated in FIG. 1 (hereinafter referred to as "1") collects information about one user (hereinafter referred to as "1").

[0035] In FIG. 1, the electronic device (100) is depicted as a smartphone, but the electronic device (100) may be implemented as a mobile device such as a tablet PC, laptop PC, smart watch, smart gear, or other wearable device. However, the present invention is not limited thereto, and the electronic device (100) may be implemented as various devices such as a TV, PC, kiosk, or other home appliances.

[0036] An electronic device (100) can communicate with other electronic devices (100-1 to 100-n) and other external devices using a network (300). As the electronic device (100) communicates, it can obtain information about the communication history.

[0037] Communication history may include the number of times or times a user (1) used the SNS service, information about other users with whom the user communicated, phone call time, number of calls, message transmission and reception history, call content, message content, etc.

[0038] The network (300) may include various wired and wireless networks. Wired networks include cable networks or telephone networks, and wireless networks may include any network that transmits and receives signals via radio waves. Wired and wireless networks may be interconnected.

[0039] The network (300) may include a wide area network (WAN) such as the Internet, a local area network (LAN) formed around an access point (AP), and a short-range wireless network that does not use an access point (AP). The short-range wireless network may include, but is not limited to, Bluetooth (Bluetooth™, IEEE 802.15.1), Zigbee (Zigbee, IEEE 802.15.4), Wi-Fi Direct, Near Field Communication (NFC), Z-Wave, etc.

[0040] Additionally, the electronic device (100) may store various programs. For example, various programs may be stored, such as a web browser that can access an external server device via the Internet, a calling application for performing calling functions, and a communication application that can send and receive text messages or messengers. The electronic device (100) may acquire information about the execution history of a program as it is executed.

[0041] The program execution history may be information related to the execution of each program stored in the electronic device (100). For example, the program execution history may be information about the type of program executed, the number of executions of each program, the execution cycle, the total accumulated execution time, and the execution time period (e.g., daytime, nighttime, etc.).

[0042] Program execution history may be described in various terms such as device usage data, device execution information, program execution information, application execution history, program usage data, etc., but in this disclosure, it is described as program execution history.

[0043] Additionally, the electronic device (100) may include various sensors. The electronic device (100) may detect the user's movement based on the sensing values ​​of the sensors.

[0044] The electronic device (100) can analyze the user's lifestyle characteristics based on such information, specifically, communication history, program execution history, sensing values, etc.

[0045] Specifically, the electronic device (100) can organize and store information collected about the user (1) into a knowledge graph. The electronic device (100) can analyze lifestyle characteristics based on the knowledge graph. Specific lifestyle characteristics may include information such as physical activity, social activity, and lifestyle patterns. Methods for acquiring each type of information will be described in the following sections.

[0046] The electronic device (100) can compose and display content representing analyzed information. Accordingly, users can intuitively understand various information, such as their lifestyle habits, activity levels, regularity, exercise level, and hobbies, through the content.

[0047] Hereinafter, an electronic device (100) that displays content about a user's lifestyle characteristics, a method for obtaining a knowledge graph, a method for displaying content, etc., according to various embodiments of the present disclosure are specifically described.

[0048] FIG. 2 is a block diagram illustrating the configuration of an electronic device (100) according to at least one embodiment of the present disclosure.

[0049] Referring to FIG. 2, the electronic device (100) includes a communication unit (110), at least one sensor (120), a memory (130), a display (140), and a processor (150).

[0050] The communication unit (110) is configured to communicate with various types of external devices.

[0051] The communication unit (110) may include at least one wireless communication module, at least one wired communication module, etc. Each communication module may be implemented in the form of at least one hardware chip. For example, the wireless communication module may include at least one module among a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules. In addition, the communication unit (110) may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc. The wired communication module may include, for example, at least one among a LAN (Local Area Network) module, an Ethernet module, a pair cable, a coaxial cable, a fiber optic cable, or a UWB (Ultra Wide-Band) module.

[0052] In addition, the communication unit (110) may further include at least one wired input / output interface among HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (Dsubminiature), and DVI (Digital Visual Interface).

[0053] The communication unit (110) can receive various data and signals stored by connected external devices.

[0054] At least one sensor (120) is a sensor for detecting the status of the electronic device (100), the user's location movement, the environment surrounding the electronic device (100), etc. Specifically, at least one sensor (120) may include various sensors such as an acceleration sensor, a gyroscope sensor, a geomagnetic sensor, a heart rate sensor, a GPS sensor, etc.

[0055] The sensing value of at least one sensor (120) may be provided to the processor (150), etc. The processor (150) may detect the movement state of the electronic device (100) based on the sensing value of the at least one sensor (120). Assuming that the user is moving while holding the electronic device (100), the movement state of the electronic device (100) may be identical to the movement state of the user. Accordingly, the processor (150) may detect the user's location, exercise state, surrounding environment, health state, etc. based on the sensed movement state. For example, if the processor (150) determines that the user's current location information has changed based on the sensing value of the geomagnetic sensor, the processor (150) may calculate the movement distance by comparing the location before and after the change and count the time taken to calculate the movement speed. The processor (150) may compare the movement speed with a person's typical walking speed, running speed, vehicle movement speed, etc. to identify whether the user is walking, running, or riding in a vehicle.

[0056] Additionally, the processor (150) can identify whether the user is exercising based on the sensing value of the heart rate sensor.

[0057]

[0058] *In addition, the processor (150) can compare the user's current location with map information to identify where the user is currently located (e.g., a gym, a movie theater, a school, a bar, an art gallery).

[0059] The memory (130) is configured to store multiple programs and various data. The memory (130) can store the execution history of each of the multiple programs, communication history, sensing values ​​of at least one sensor (120), information on user lifestyle characteristics, and other various information, data, commands, etc. required for the operation of the electronic device (100).

[0060] The memory (130) may be implemented as at least one of various memories, such as volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD).

[0061] In FIG. 2, one memory (130) is illustrated, but the memory (130) may be implemented to include a plurality of memories (130) that each store different types of data or each store data generated at different stages, and at least one of these memories (130) may be implemented as a single chip integrated with the processor (150).

[0062] The memory (130) can store data on the lifestyle characteristics of other users received from each external device via the communication unit (110), the latest information related to the user's areas of interest, etc. In addition, the memory (130) can store a program that can generate recommended information for improving the user's condition based on a knowledge graph of the user's lifestyle characteristics included in the knowledge graph, and data used therein. For example, the memory (130) can store a program that can generate, manage, and store a knowledge graph. The knowledge graph is described in more detail in FIG. 3.

[0063] The display (140) is a configuration for displaying various screens. For example, the processor (150) controls the display (140) to display content for representing the user's lifestyle characteristics. The display (140) can be implemented in various forms, such as a liquid crystal display (LCD), an organic light emitting diode (OLED), a liquid crystal on silicon (LCoS), a digital light processing (DLP), a quantum dot (QD) display panel, a quantum dot light-emitting diodes (QLED), a micro light-emitting diodes (μLED), a mini LED, etc. Meanwhile, the display (140) can also be implemented as a touch screen combined with a touch sensor, a flexible display, a rollable display, a 3D display, a display in which a plurality of display modules are physically connected, etc.

[0064] The processor (150) is a component for controlling the overall operation of the electronic device (100). The processor (150) can control components of the electronic device (100) by executing a program stored in the memory (130).

[0065] The processor (150) may be implemented as a digital signal processor (DSP), a microprocessor, a GPU (Graphics Processing Unit), an AI (Artificial Intelligence) processor, an NPU (Neural Processing Unit), etc. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a MCU (Micro Controller Unit), an MPU (micro processing unit), a controller, an application processor (AP), a communication processor (CP), an ARM processor, or may be defined by the relevant term. In addition, the processor (150) may be implemented as a SoC (System on Chip), an LSI (Large Scale Integration) having a built-in processing algorithm, or may be implemented in the form of an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array).

[0066] The processor (150) can perform various functions by executing computer executable instructions stored in the memory (130). In FIG. 2, only one processor (150) is illustrated, but the number of processors (150) may be implemented in multiple numbers.

[0067] The processor (150) may execute at least one program to perform various operations such as obtaining a knowledge graph, analyzing the user's physical activity, analyzing the user's social activity, analyzing the user's lifestyle pattern, and generating recommended information to improve the user's condition.

[0068] Physical activity refers to information indicating the degree to which a user (1) carrying an electronic device (100) is physically active. The processor (150) may obtain at least one piece of information from among the user's (1) moving distance, moving time, moving speed, visited locations, and number of moves based on the sensing values ​​of at least one sensor (120), and may quantify the physical activity based on this information.

[0069] The level of physical activity can be determined based on the user's (1) physical movement distance and activity status. For example, a higher value can be assigned to a longer distance traveled. The processor (150) can distinguish the activity method based on the movement status (walking, cycling, vehicle, etc.) and assign a higher value to an activity method with high energy consumption. In addition, even if the processor (150) does not detect much movement, if the user stays in the gym for a certain period of time and a change such as an increase in heart rate is detected, the processor (150) can determine that the user is in a state of consuming calories (strength training, treadmill, etc.). Even in such cases, the processor (150) can assign a higher value.

[0070] Social activity is information indicating the extent to which a user (1) performs social activities. When a program for providing an SNS service is executed among the programs stored in the memory (130), the processor (150) can count the execution time and execution frequency of the program to identify the usage time and frequency of the SNS service. In addition, the processor (150) can obtain information on other users with whom the user (1) of the electronic device (100) has communicated based on information received from an external server device providing the SNS service. In addition, the processor (150) can collect various communication histories, such as phone call history, message transmission / reception history, call content, message content, and program execution history. As described above, the processor (150) can quantify the extent of the user's (1) social activity based on the various collected data.

[0071] The level of social activity can be determined based on the content of communication with other users, the number of interactions, and the number of other users with whom the user interacts. For example, the processor (150) may assign a higher value to content performing social functions or work-related content. In this case, the processor (150) may exclude instances of spam messages and calculate the value using only data related to actual social activity. Additionally, a higher value may be assigned to a greater number of interactions with other users and the number of users with whom the user interacts.

[0072] A lifestyle pattern is information indicating the degree of regularity in a user's (1) life. A lifestyle pattern can also be referred to as regularity information. A lifestyle pattern can be analyzed based on at least one of the user's (1) wake-up time, bedtime, commuting time, commuting time, exercise time, hobby time, and activity regularity. A lifestyle pattern can be determined based on the degree of variation in the user's (1) daily life. When a change in the user's location is detected by at least one sensor (120), the processor (150) can identify whether the user is commuting to work or returning home based on the time of change or distance traveled. If the same movement pattern is repeatedly recognized, the processor (150) can determine a high degree of regularity. Conversely, if the movement pattern is recognized as irregular, the processor (150) can determine a low degree of regularity. For example, the processor (150) can assign a lower value to different commuting times each day. Meanwhile, weekdays and weekends (holidays) can be categorized differently, and regularity can be determined only between dates within the same category.

[0073] As described above, the processor (150) can analyze the user's (1) lifestyle characteristics from various aspects.

[0074] The processor (150) can generate content including at least one graphic object for representing the analyzed results. The at least one graphic object can be an avatar representing a person, an object representing an object, a background, a border, text, a still image, a video, etc. The processor (150) can control the display (140) to display the generated content.

[0075] When physical activity, social activity, lifestyle patterns, and other lifestyle characteristics change, the processor (150) changes and displays the characteristics of the content based on the changed information. The processor (150) can individually change the content so that changes in each lifestyle characteristic do not affect the portion representing other lifestyle characteristics.

[0076] For example, if physical activity changes while the remaining characteristics remain within a similar range, the processor (150) may only change the portions that reflect the change in the user's physical activity. The specific content format and change status will be further described in detail in the following sections.

[0077] Meanwhile, the processor (150) can transmit a control signal based on data transmitted from each external device through the communication unit (110). For example, assuming that the electronic device (100) of FIG. 2 is one (100-1) of the electronic devices (100-1 to 100-n) of FIG. 1 and communicates with the electronic device (100-2) of another user (1-2), the processor (150) can receive the lifestyle characteristics of the other user (1-2) from the electronic device (100-2) through the communication unit (110). In this way, the processor (150) can collect the lifestyle characteristics of the other users (1-2 to 1-n) received and store them in the memory (130).

[0078] The processor (150) can obtain information on general lifestyle characteristics, i.e., reference information, by averaging the collected lifestyle characteristics. For example, if the average daily exercise time of other users is calculated to be 1 hour, the processor (150) can set the reference information for the exercise time to 1 hour and store it in the memory (130). However, this is not limited to this, and the processor (150) can also store reference information directly set by the user in the memory (130). For example, the reference information may include the average sleep time of other users, the average work hours, the exercise time input by the user, the leisure time input by the user, etc.

[0079] The processor (150) may use the reference information stored in the memory (130) to provide recommendation information for improving the user's condition. That is, the recommendation information may be information that compares the reference information stored in the memory (130) with the user's lifestyle characteristics included in the knowledge graph and recommends changes to characteristics that differ significantly from the reference information. For example, if the reference information for exercise time is 1 hour and the user's exercise time is 30 minutes, the processor (150) may generate recommendation information recommending exercising 30 minutes more per day. The processor (150) may control the display (140) to display the generated recommendation information. Specific examples of recommendation information for improving the user's condition are described in detail with reference to FIGS. 7 and 8 .

[0080] Meanwhile, the processor (130) can obtain a knowledge graph about the user's lifestyle characteristics by using information collected in various ways and store it in the memory (130).

[0081] FIG. 3 is a diagram for explaining an operation of an electronic device (100) according to at least one embodiment of the present disclosure to obtain a knowledge graph (200) about a user's lifestyle characteristics.

[0082] In the present disclosure, the knowledge graph (200) regarding the user's lifestyle characteristics may be a knowledge graph (200) generated by an electronic device (100), but is not necessarily limited thereto, and one of the server devices (e.g., 10-1) that collects information from various electronic devices (100-1 to 100-n) may generate the knowledge graph (200). In one embodiment, the knowledge graph (200) regarding the user's lifestyle characteristics may be updated periodically or aperiodically.

[0083] A knowledge graph (200) about user life characteristics can be generated based on the user's life characteristics, which represent relationships between specific entities. For example, if a user of a first electronic device (100-1) performs a specific action (e.g., playing the guitar) in a specific situation (e.g., leaving work), an entity representing the specific situation and an entity representing the specific action can be linked. If a structure (e.g., an RDF structure) in which entities representing the specific situation and entities representing the specific action are linked in time series is repeated, the first electronic device (100-1) can acquire this repeated structure as the user's life characteristics. The knowledge graph (200) about user life characteristics can mean information about the generated user's life characteristics expressed in the form of a knowledge graph (200) having a node-edge-node configuration.

[0084] When an electronic device is connected to multiple server devices (10-1 to 10-m) via a network (300) as shown in FIG. 3, users of each electronic device (100-1 to 100-n) can utilize services provided by each server device (10-1 to 10-m). Specifically, users can perform Internet searches, view multimedia content, use SNS services, upload content, etc.

[0085] Each electronic device (100-1 to 100-n) of FIG. 3 can individually generate and manage its own knowledge graph (200-1, 200-2, 200-3, 200-n, etc.) based on the data it stores as well as information provided by each server device (10-1 to 10-m). For example, the first electronic device (100-1) can generate the first knowledge graph (200-1) based on the execution history of each of the plurality of programs of the first electronic device (100-1), the communication history communicated using the communication unit (110), and the user's lifestyle characteristics based on the sensing value of at least one sensor (120).

[0086] If Server 1 (10-1) is a web server providing a portal website, and the first electronic device (100-1) accesses Server 1 (10-1) and frequently searches for a specific keyword (e.g., "guitar"), the first electronic device (100-1) can infer that the user's main interest is guitar. In this state, if the first electronic device (100-1) determines that the user frequently visits the location of a guitar academy based on the sensing value of the sensor, the first electronic device (100-1) can strongly infer that the user is learning to play the guitar. In this way, the first electronic device (100-1) can analyze that the user is engaging in a social activity of learning to play the guitar based on a knowledge graph (200-1) that combines information acquired from various sources.

[0087] FIG. 4 is a diagram illustrating an example of content displayed on an electronic device (100) according to at least one embodiment of the present disclosure. According to FIG. 4 , the content (400) may be configured in a form in which at least one graphic object is arranged according to a preset layout. The layout, shape, size, etc. of the content may be varied.

[0088] When information on various lifestyle characteristics is acquired, the processor (150) generates content to express that information. Content generation may be performed by executing a program that provides information on the user's lifestyle characteristics. The processor (150) may execute the program and generate its execution screen according to the user's selection, but is not necessarily limited to this. That is, if the program is set as the default program, the processor (150) may control the display (140) to constantly display the content (400) of FIG. 4 on one side of the execution screen of another program.

[0089] The content (400) may include at least one graphic object for expressing physical activity, social activity, and lifestyle patterns.

[0090] At least one graphic object may include at least one of an avatar (410) representing a person, an object (410, 420, 430) representing an object, a background (450), and a border (440). Although the city is omitted in FIG. 4, an avatar representing a pet may also be included. In addition, text may be included within the content (400), or a display area in which multimedia content such as still images or videos are displayed may be included.

[0091] Specifically, an avatar (410) representing a person can be expressed in various ways according to various display options, such as facial expressions, hairstyles, facial shapes or colors, postures, and gender. In addition, clothing or accessories (glasses, hats, headsets, necklaces, earrings, etc.) worn by the avatar (410) can be added or deleted in various ways.

[0092] For example, if the user is an office worker, the processor (150) may include an avatar (410) wearing office attire, such as a tie, in the content (400), and include a graphic object, such as a bag (420), on one side of the avatar (410).

[0093] Additionally, if the user's occupation is an accountant, an object such as a calculator (430) can be included in the graphic object to be expressed.

[0094] The border (440) or background (450) may be modified to a form suitable for indicating the user's current location. For example, if the user is at home, the processor (150) may include a background (450) in the shape of a house's wallpaper and a border (440) in the shape of a house in the content (400).

[0095]

[0096] *If the processor (150) identifies that at least one of physical activity, social activity, and life pattern or other life characteristics has changed, it can change at least one of the number, size, display position, shape, brightness, saturation, and transparency of at least one graphic object corresponding to each of the physical activity, social activity, and life pattern.

[0097] For example, if the amount of exercise, which is one of the pieces of information related to physical activity, has increased, the processor (150) may change the avatar's (410) clothing to sportswear or increase the size of the avatar (410).

[0098] If the user's sleep time is longer than the standard time, the processor (150) can change the display position and shape of the avatar (410) to display it lying on the floor.

[0099] In relation to social activity, if the user has not groomed their hair for a long time, the processor (150) may display the avatar's (410) hair length as gradually increasing. The processor (150) may identify whether the user has groomed their hair based on the user's location, card usage history, etc.

[0100] Alternatively, the processor (150) may add an effect to indicate that the user's activity has been reduced by lowering the brightness of the background (450) or making it blurry or translucent.

[0101] If the user has additional hobby activities, the processor (150) may add graphic objects accordingly.

[0102] If the user's lifestyle pattern is determined to be irregular, the processor (150) may add an effect to indicate that the user is in an unstable state by changing the shape of the border (440), deleting it, or flashing it.

[0103] Meanwhile, the processor (150) can determine a graphic object that can independently express the characteristic without being affected by changes in information about other life characteristics when expressing or changing information about each life characteristic. For example, if the shape of the border (440) among the graphic objects is set to be angular as the user's life pattern becomes more regular, even if there is a change in the user's social activity, it may not affect the shape of the border (440) but only affect the graphic object representing the social activity (e.g., the avatar's clothing, an object representing the avatar's occupation, etc.).

[0104] Graphic objects corresponding to each lifestyle characteristic can be displayed in different spaces, or they can overlap or be included in one space. Furthermore, information regarding two or more lifestyle characteristics can be applied in a composite manner to a single graphic object. For example, if a user has traveled more distance and has increased work-related calls compared to the past week, the processor (150) can change the avatar (410) to a running pose while holding a smartphone.

[0105] If the user's exercise level increases, the processor (150) may change the avatar's (410) outfit to sportswear. Furthermore, if the user has not groomed their hair for a long period of time, the processor (150) may display the user's hair length as gradually increasing. The processor (150) may identify whether the user has groomed their hair based on the user's location, card usage history, etc.

[0106] If the user has additional hobby activities, the processor (150) may add graphic objects (e.g., a guitar) accordingly.

[0107] According to this embodiment, information about the user's physical activity, social activity, and lifestyle patterns, as well as the user's areas of interest, can be included in a single content, so that information about the user's lifestyle characteristics and areas of interest can be intuitively determined at a glance.

[0108] FIGS. 5 and 6 are diagrams showing examples of content in which data about a user or another user is collected in an electronic device (100) according to at least one embodiment of the present disclosure and the content is changed according to the changed data.

[0109] When at least one of physical activity, social activity, and life pattern changes, the electronic device (100) can change and display at least one feature of the content based on the changed information.

[0110] The content (500) illustrated in FIG. 5 includes a first avatar (510) representing a user and at least one second avatar (501, 502, 503, 504, 505, 506) representing other users. Other users may be people who have a social relationship with the user.

[0111] The processor (150) may determine the number of second avatars (501, 502, 503, 504, 505, 506) differently based on the number of users making calls, sending and receiving messages, sending and receiving messengers, etc., the number of users connected through SNS services, the number of contact information stored in the memory (130), etc. For example, if the total number is less than a certain threshold, the second avatars (501, 502, 503, 504, 505, 506) may not be displayed or may be displayed in a minimum number (e.g., two). If the total number is greater than or equal to the threshold, the processor (150) may increase the number of second avatars (501, 502, 503, 504, 505, 506) step by step or gradually depending on the number.

[0112] In addition, the processor (150) can change the shape of the second avatar (501, 502, 503, 504, 505, 506) from an abstract shape to a concrete shape based on the degree of interaction with other users or activity information of other users. Activity information of other users can be received from other electronic devices (100-1 to 100-n) or server devices (300-1 to 300-m).

[0113] Specifically, if the amount of data collected about the user or other users interacting with the user exceeds a preset size, the processor (150) may change the form of the first avatar or the second avatar into a specifically expressed form based on the amount of data. For example, if information is obtained that a specific other user is male and has a large travel frequency, the processor (150) may change the abstract second avatar (501) into a specific form (501'), such as a male carrying a backpack.

[0114] The processor (150) can express the second avatar (501, 502, 503, 504, 505, 506) representing another user as being closer to the first avatar (510) as the other user has a greater degree of interaction with the user. The degree of interaction with the user can be determined based on data such as the number of encounters, number of calls, call time, and number of messages.

[0115] Also, as the number of other users with whom the user interacts increases, the number of second avatars (501, 502, 503, 504, 505, 506) expressed in the content may increase. For example, if the number of other users whose interaction level exceeds a preset level increases from 2 to 6, the number of second avatars expressed in the content may also increase from 2 (501', 502) to 6 (501', 502', 503', 504 505, 506). FIG. 5 illustrates a state where two abstract second avatars (501, 502) are initially displayed, and then one of them is changed to a concrete second avatar (501'), and then a total of six second avatars (501', 502', 503', 504, 505, 506) are added.

[0116] The processor (150) can change the shape of the first avatar representing the user as well as the second avatar.

[0117] According to FIG. 6, when the processor (150) obtains a large number of travel frequency data from the user's leisure activities, it changes the avatar (610) representing the user to an avatar (610') holding a backpack.

[0118] The avatars shown in Figures 4 to 6 are depicted as still graphic images, but the processor (150) may also express them as moving graphic images by applying animation effects. In addition, the processor (150) may also express text indicating the current characteristics by adding a speech bubble to the side of the avatar.

[0119] Meanwhile, the processor (150) can not only inform the user of the user's lifestyle characteristics, but can also provide information to improve the condition.

[0120] FIG. 7 and FIG. 8 are diagrams showing examples of content that displays recommendation information for improving the status of a user (411) in an electronic device (100) according to at least one embodiment of the present disclosure.

[0121] Specifically, if the average daily sleep time of the user (410) over the past week is less than the average sleep time of other users (e.g., 5 hours), the processor (150) can change the facial expression (411) of the avatar (410) to an expression (411') such as a downward mouth corner, to express a change in status. In this case, the processor (150) can also inform the current user of the status, such as "The average daily sleep time over the past week is less than 5 hours. Increase your sleep time", and display recommended information (710) for improving the status. The above-described change in status of the avatar and the display of recommended information for status improvement can be expressed as dynamic images that are repeatedly displayed at regular intervals. That is, the processor (150) can control the display (140) to sequentially change and display the three contents illustrated in FIG. 7 at regular time intervals (e.g., 5 seconds).

[0122] In another embodiment, if the user's working hours for the past week are less than the hours entered and saved by the user (e.g., 5 hours), the processor (150) may express the change in status as an object change (420'), such as deleting a briefcase (420) representing the user's work activities. In this case, the processor (150) may inform the user of the current work status, such as "The average working hours for the past week are less than 5 hours per day. Work schedule management is required.", and may also display recommended information (810) for status improvement. Similar to FIG. 7, the status change of the avatar described above and the display of recommended information for status improvement may be expressed as a dynamic image that is repeatedly displayed at regular intervals.

[0123] In the above, the processor (150) has been described and illustrated as including content in the execution screen of a program that provides content informing the user of the user's lifestyle characteristics, but the processor (150) may also frequently display the various contents described above to the execution screen of another application.

[0124] FIG. 9 is a diagram illustrating an example of content displayed by adding content to a selected program screen in an electronic device (100) according to at least one embodiment of the present disclosure.

[0125] When a program stored in an electronic device (100) is executed, an execution screen (800) is generated, and content (400) regarding the user's lifestyle characteristics can be added to the execution screen (800) to display a modified execution screen. Fig. 9 illustrates an example of an execution screen when a messenger program is executed. In Fig. 9, the processor (150) can also display content (400) regarding the user's lifestyle characteristics by adding it to a profile screen (800) that displays the user's photo, etc.

[0126] In the case of a messenger program, an option is provided to set a profile picture or background image as one of the pictures stored in the memory (130). The processor (150) stores the generated content (400) in the memory (130) and sets the storage address of the content as the profile picture option of the messenger program, thereby allowing expression as shown in FIG. 9.

[0127] Programs that can be expressed by adding content (400) may include not only messenger programs, but also personality analysis applications, contact applications, SNS applications, etc.

[0128] FIG. 10 is a diagram illustrating an example of content (400) that informs an electronic device (100) of the latest information on a user's field of interest according to at least one embodiment of the present disclosure.

[0129] Specifically, when one of the multiple programs stored in the memory (130) is executed, the processor (150) can control the display (140) to display an execution screen of the program. For example, when a web browser is executed, the processor (150) can access a web server device set as default and display a website provided by the web server device. The user can input various user inputs on this execution screen. The user inputs may include keywords, etc.

[0130] The processor (150) can store information about the user's input in the memory (130). When this information is accumulated, the processor (150) can determine the user's area of ​​interest based on the accumulated information. For example, if it is determined that the user has entered real estate-related keywords a certain number of times or enters them periodically, the processor (150) can set real estate as the area of ​​interest and store it in the memory (130).

[0131] Meanwhile, the present invention is not limited thereto, and the processor (150) may control the display (140) to display a UI screen that can directly receive an area of ​​interest from the user, and may store information about the area of ​​interest input through the UI screen in the memory (130).

[0132] The processor (150) can periodically access a web server device or other external source through the communication unit (1100) to search for the latest information related to the user's field of interest. When the latest information is searched, the processor (150) can additionally display an icon (910) notifying the search result on one side of the content (400). The user can touch the icon (910) or select it using various other input methods. When the icon is selected, the processor (150) can display the latest information (e.g., latest articles, latest papers, etc.) (920) related to the user's field of interest.

[0133] FIG. 11 is a flowchart illustrating a method of displaying content related to a user's lifestyle characteristics according to at least one embodiment of the present disclosure.

[0134] According to FIG. 11, the electronic device acquires a knowledge graph about the user's lifestyle characteristics based on the execution history of each of a plurality of previously stored programs and the sensing value of at least one sensor (S1110).

[0135] The electronic device analyzes the user's physical activity, social activity, and lifestyle pattern for a preset period of time based on the knowledge graph (S1120).

[0136] The electronic device displays content including at least one graphic object for expressing physical activity, social activity, and life patterns (S1130).

[0137] When at least one of physical activity, social activity, and life pattern changes, the electronic device changes and displays at least one feature of the content based on the changed information (S1140).

[0138] Since the method of an electronic device acquiring a knowledge graph and displaying content related to the user's lifestyle characteristics has been described in the various embodiments described above, a redundant description will be omitted.

[0139] The display method described in FIG. 11 can be performed by an electronic device having the configuration of FIG. 2 described above, but is not necessarily limited thereto, and may also be performed by another electronic device in which some configurations are added, changed, or deleted.

[0140] The various embodiments described above may be implemented as a single embodiment, or at least one of the embodiments may be combined in whole or in part to be implemented together in one device.

[0141] According to the various embodiments described above, users can receive comprehensive analysis results of their lifestyle characteristics and recommendations for improving their health. Furthermore, by utilizing a knowledge graph to perform inferences based on the user's personal information, users can receive personalized lifestyle analysis and feedback, thereby enhancing convenience.

[0142] Various embodiments of the present disclosure may be implemented as software stored in a machine-readable storage media that can be installed or connected to a smartphone, a user terminal device, or other various electronic devices (e.g., a computer).

[0143] Specifically, a non-transitory readable storage medium may be provided in which software is stored for sequentially performing the steps of: obtaining a knowledge graph about a user's lifestyle characteristics based on the execution history of each of a plurality of programs stored in advance and the sensing value of at least one sensor; analyzing the user's physical activity, social activity, and lifestyle pattern for a preset period of time based on the knowledge graph; displaying content including at least one graphic object for expressing the physical activity, social activity, and lifestyle pattern; and changing and displaying at least one characteristic of the content based on changed information when at least one of the physical activity, social activity, and lifestyle pattern changes.

[0144] Here, the step of analyzing the user's physical activity, social activity, and life pattern, respectively, may include a step of analyzing the user's physical activity based on at least one piece of information among the user's movement distance, movement time, movement speed, visited places, and movement count among the information collected in the knowledge graph while carrying the electronic device, a step of analyzing the user's social activity based on at least one piece of information among the user's use time of a social network service, the number of uses, information about other users with whom the user communicated, phone call history, message transmission / reception history, call content, and message content among the information collected in the knowledge graph, and a step of analyzing the user's life pattern based on at least one piece of information among the user's wake-up time, bedtime, commuting time, commuting time, exercise time, hobby time, and activity regularity among the information collected in the knowledge graph.

[0145] A device equipped with such a non-transitory readable medium can perform various operations, such as obtaining a knowledge graph, analyzing a user's physical activity, etc., and displaying content including graphic objects, as described in the various embodiments described above.

[0146] In the context of non-transitory readable storage media, 'non-transitory' means that the storage medium does not contain signals and is tangible, but does not distinguish between whether data is stored semi-permanently or temporarily on the storage medium.

[0147] Alternatively, a program for performing the method according to the various embodiments described above may be distributed online through an application store. In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a storage medium, such as a manufacturer's server, an application store's server, or a memory (130) of a relay server.

[0148] Each component (e.g., a module or a program) according to various embodiments may be composed of one or more entities, and some of the aforementioned sub-components may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., a module or a program) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration. Operations performed by a module, program, or other component according to various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0149] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, At least one sensor; Memory for storing multiple programs; A communication unit for performing communication with at least one external device; display; and including a processor; The above processor, A knowledge graph about the user's lifestyle characteristics is acquired and stored in the memory based on the execution history of each of the plurality of programs, the communication history using the communication unit, and the sensing value of at least one sensor. Based on the above knowledge graph, the user's physical activity, social activity, and lifestyle pattern are analyzed for a preset period of time, respectively. Controlling the display to display content including at least one graphic object for expressing the physical activity, the social activity and the life pattern; An electronic device that controls the display to change and display at least one feature of the content based on the changed information when at least one of the physical activity, the social activity, and the lifestyle pattern changes.

2. In paragraph 1, At least one graphic object above, Contains at least one of an avatar representing a person, an object representing an object, a background, a border, text, a still image, and a video. The above processor, An electronic device that changes at least one of the number, size, display position, shape, brightness, saturation, and transparency of at least one graphic object corresponding to each of the physical activity, the social activity, and the life pattern when at least one of the physical activity, the social activity, and the life pattern changes.

3. In paragraph 2, The above processor, Include a first avatar representing the user in the content, If the above social activity satisfies the threshold condition, at least one second avatar representing another user with whom the user has a social relationship is included in the content together with the first avatar, An electronic device that increases the number of said second avatars as said social activity increases.

4. In paragraph 3, The above processor, An electronic device that changes at least one of the size, shape, display position, facial expression, posture, clothing, accessories, gender, and distance between avatars of at least one of the first avatar and the second avatar based on the amount of data when the amount of data collected in the knowledge graph exceeds a preset size.

5. In paragraph 1, The above processor, Controls the display to display content; When condition information is entered through the above content, the period is determined based on the time until the condition information is satisfied, An electronic device that acquires data for the determined period from among the data collected by the knowledge graph, and analyzes the physical activity, social activity, and lifestyle pattern of the user for the determined period based on the acquired data.

6. In paragraph 1, The above processor, Based on the reference information stored in the memory and the user's lifestyle characteristics included in the knowledge graph, recommendation information for improving the user's condition is generated, and the display is controlled to display the recommendation information. The above criteria information is, An electronic device, wherein the reference information is transmitted by averaging the lifestyle characteristics of other users from at least one external device or the reference information is input by the user.

7. In paragraph 1, The above processor, An electronic device that controls the display to display a modified execution screen by executing the selected program when one of the plurality of programs is selected, adding the content within the execution screen, and generating the execution screen.

8. In paragraph 1, The above processor, When one of the above multiple programs is executed, the display is controlled to display the execution screen of the program, Determine the user's area of ​​interest based on the user input entered through the above execution screen, Controls the display to search for the latest information related to the user's field of interest through the communication unit and to additionally display an icon notifying the search results on the execution screen; An electronic device that controls the display to display the latest information when the above icon is selected.

9. In paragraph 1, The above processor, Among the information collected in the knowledge graph, the physical activity of the user carrying the electronic device is analyzed based on at least one of the following information: moving distance, moving time, moving speed, visited places, and number of moves. Among the information collected in the above knowledge graph, the user's social activity is analyzed based on at least one of the following information: usage time of the social network service, number of usages, information on other users with whom the user communicated, phone call history, message transmission / reception history, call content, and message content. An electronic device that analyzes the user's lifestyle pattern based on at least one of the user's wake-up time, bedtime, commuting time, commuting time, exercise time, hobby activity time, and activity regularity among the information collected in the knowledge graph.

10. A display method of an electronic device including at least one sensor, A step of obtaining a knowledge graph about the user's lifestyle characteristics based on the execution history of each of the plurality of programs stored in the electronic device and the sensing value of at least one sensor; A step of analyzing the user's physical activity, social activity, and lifestyle pattern for a preset period of time based on the above knowledge graph; A step of displaying content including at least one graphic object for expressing the physical activity, the social activity and the life pattern; and A display method, comprising: a step of changing and displaying at least one feature of the content based on the changed information when at least one of the physical activity, the social activity, and the lifestyle pattern changes.

11. In paragraph 10, At least one graphic object above, Contains at least one of an avatar representing a person, an object representing an object, a background, a border, text, a still image, and a video. The step of changing and displaying at least one feature of the above content is as follows: A display method comprising: a step of changing at least one of the number, size, display position, shape, brightness, saturation, and transparency of at least one graphic object corresponding to each of the physical activity, the social activity, and the life pattern, when at least one of the physical activity, the social activity, and the life pattern changes; 12. In paragraph 11, The steps for displaying the above content are: A step of displaying the content including a first avatar representing the user; A step of displaying at least one second avatar representing another user with whom the user has a social relationship together with the first avatar when the social activity satisfies a threshold condition; The step of changing and displaying at least one feature of the above content is as follows: A display method comprising: a step of increasing the number of second avatars when the social activity increases; 13. In paragraph 12, The step of changing and displaying at least one feature of the above content is as follows: A display method, comprising: a step of changing at least one of the size, display position, facial expression, posture, clothing, accessories, gender, and distance between avatars of at least one of the first avatar and the second avatar based on the amount of data when the amount of data collected in the knowledge graph exceeds a preset size; 14. A non-transitory readable recording medium storing a program for performing a display method of an electronic device including at least one sensor, The above display method is, A step of obtaining a knowledge graph about the user's lifestyle characteristics based on the execution history of each of the plurality of programs stored in the electronic device and the sensing value of at least one sensor; A step of analyzing the user's physical activity, social activity, and lifestyle pattern for a preset period of time based on the above knowledge graph; A step of displaying content including at least one graphic object for expressing the physical activity, the social activity and the life pattern; and A non-transitory readable recording medium, comprising: a step of changing and displaying at least one characteristic of the content based on the changed information when at least one of the physical activity, the social activity, and the life pattern changes; 15. In paragraph 14, The steps of analyzing the physical activity, social activity, and lifestyle patterns of the above users are as follows: A step of analyzing the physical activity of the user based on at least one piece of information among the movement distance, movement time, movement speed, visited places, and number of movements of the user carrying the electronic device, among the information collected in the knowledge graph; A step of analyzing the social activity of the user based on at least one of the information collected in the knowledge graph, the usage time of the social network service, the number of times used, information on other users communicated with, phone call history, message transmission / reception history, call content, and message content; and A non-transitory readable recording medium, comprising: a step of analyzing the user's lifestyle pattern based on at least one piece of information among the user's wake-up time, bedtime, commuting time, commuting time, exercise time, hobby activity time, and activity regularity, among the information collected in the knowledge graph.

Images