Terminal device for implementing well-being in life

Abstract

The present invention relates to a terminal device for implementing, in life, not only wellness but also well-being by using a health management system. During execution of an application for accumulating biometric data indicating biometric information about a user and managing a health condition of the user, the terminal device displays, on an application screen, handwritten content generated through a handwritten operation of the user or derived content derived from the handwritten content. Accordingly, it is possible to visually integrate non-digitized content into a list of digitized dry data indicating the biometric information, and provide the user with a new experience and even added value through a synergistic effect by fusing wellness and well-being.

Description

Terminal device for implementing well-being in daily life

[0001] The present invention relates to a terminal device for implementing well-being in daily life.

[0002] In recent years, health management systems that utilize IT (Information Technology) technologies such as smartphone apps or web services have become widespread. The health management system can hold and make available biometric data indicating the amount of exercise and activity measured by IoT (Internet of Things) devices such as smartwatches or smart rings. By checking the health indicators shown by the biometric data, users can work on improving their health.

[0003] Japanese Patent Application Laid-Open No. 2024-096429 discloses a health support system that stores health indicators including a user's weight, number of steps, exercise distance, calories burned, and heart rate, and displays charts and messages corresponding to the health indicators to the user.

[0004] Japanese Patent Application Laid-Open No. 2024-096429

[0005] However, the system disclosed in Japanese Patent Application Laid-Open No. 2024-096429 merely presents a list of digitized and dry data, and while it provides the value of so-called "wellness" to the user, it has the problem that it cannot provide further added value.

[0006] The present invention has been made in view of the above problems, and an object thereof is to provide a terminal device for implementing not only wellness but also well-being in daily life through the use of a health management system.

[0007] During the execution of an application for storing biometric data indicating a user's biometric information and managing the user's health state, the terminal device according to the present invention displays handwritten content generated through the user's handwritten operation or derived content derived from the handwritten content on the screen of the application.

[0008] In this way, by displaying handwritten or derived content on the application screen while the application for managing health status is running, it is possible to visually integrate non-digital content with the dry, digitized data representing biometric information. Through the synergistic effect of the fusion of "wellness" and "well-being," it is possible to provide users with a new experience and added value. For example, it can provide users with an opportunity to gain awareness and reflect on well-being and a good life. In this way, not only wellness but also well-being can be implemented in daily life through the use of the health management system.

[0009] Furthermore, the handwritten content may also be a one-line diary in which the user reflects on the events of the day in a single line. Through the accumulation of these handwritten one-line diaries, it is possible to overlay the appearance of everyday life (for example, events, emotions, etc.) onto the application screen.

[0010] Furthermore, the derived content may be a pictogram, which is a set of points or a trajectory in a feature space for representing the drawing state of the handwritten content. This allows a user-specific pictogram to be overlaid on the application screen.

[0011] Furthermore, the derived content may be displayed together with the calendar to which the handwritten content is associated. Alternatively, the derived content may be displayed together with a calendar showing the measurement history of the biometric information. By overlaying the derived content on the calendar, it may be possible to give the user some kind of insight.

[0012] Furthermore, the application screen may include a calendar showing the measurement history of the biometric information, and when the application accepts an operation to specify a date in the calendar, the handwritten content or derived content corresponding to the date may be displayed. By viewing the handwritten content or derived content, the user can review the date they specified.

[0013] According to the present invention, wellness and well-being can be implemented in daily life through the use of a health management system.

[0014] This is an overall configuration diagram of a health management system incorporating a terminal device according to one embodiment of the present invention. This is a diagram showing an example of the calendar screen displayed on the terminal device in Figure 1. This is a diagram showing an example of the handwriting input screen displayed on the terminal device in Figure 1. This is a diagram showing an example of a pictogram generated from the one-line diary in Figure 3. This is a diagram showing an example of the reflection screen displayed on the terminal device in Figure 1. This is a diagram showing an example of user behavior before and after going to sleep.

[0015] Embodiments of the present invention will be described below with reference to the attached drawings. To facilitate understanding of the description, the same reference numerals are used for identical components in each drawing whenever possible, and redundant explanations are omitted.

[0016] [Description of Terminal Device 12] Figure 1 is an overall configuration diagram of a health management system 10 incorporating a terminal device 12 in one embodiment of the present invention. The health management system 10 is provided to offer a "health management service" for managing the user's health status through the accumulation of biometric information. Specifically, the health management system 10 comprises a terminal device 12, an electronic pen 14, a smartwatch 15, a smart ring 16, and a digital ink server 18. In the example of Figure 1, the terminal device 12 is communicated with the digital ink server 18 via a network NT.

[0017] The terminal device 12 is a computer owned by a user of the health management service, and consists of a smartphone, tablet, personal computer, or wearable device. Specifically, the terminal device 12 includes a processor 21, memory 22, communication chip 23, display unit 24, touch sensor 25, and EMR (Electro-Magnetic Resonance) sensor 26.

[0018] The processor 21 is composed of a processing unit including a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an MPU (Micro-Processing Unit). By reading programs and data stored in the memory 22, the processor 21 performs various information processing, including not only the execution of the health management application, but also the generation process for generating handwritten content and the rendering process for displaying desired content.

[0019] Memory 22 stores programs and data necessary for the processor 21 to control each component. Memory 22 is non-transient and consists of a computer-readable storage medium. For example, memory 22 stores biometric data D1, digital ink D2, and pictogram data D3, all of which will be described later.

[0020] The communication chip 23 has a communication function that enables wired or wireless communication with external devices. As a result, the terminal device 12 exchanges biometric data D1 with, for example, a smartwatch 15 or a smart ring 16, and exchanges digital ink D2 and pictogram data D3 with a digital ink server 18.

[0021] The display unit 24 is capable of visually displaying content including images or videos, and is composed of, for example, a liquid crystal panel, an organic EL (Electro-Luminescence) panel, or electronic paper. By making the display unit 24 flexible, the user can perform various handwriting operations while the touch surface of the terminal device 12 is curved or bent.

[0022] The touch sensor 25 is a capacitive sensor comprising multiple sensor electrodes arranged in a planar configuration. This touch sensor 25 is composed of, for example, multiple X-line electrodes for detecting the position along the X axis of the sensor coordinate system and multiple Y-line electrodes for detecting the position along the Y axis. Alternatively, the touch sensor 25 may be a self-capacitive sensor in which block-shaped electrodes are arranged in a two-dimensional grid, instead of the mutual-capacitive sensor described above.

[0023] The EMR sensor 26 is a planar sensor of the electromagnetic induction method (hereinafter also referred to as the "EMR method") that receives an induction signal generated by the electronic pen 14 under the action of an alternating magnetic field from a plurality of detection coils arranged in a planar manner. In the example shown in Figure 1, the EMR sensor 26 is provided separately from the other components, but part or all of it may be provided integrally with other components (for example, the display unit 24).

[0024] The electronic pen 14 is a pen-shaped pointing device configured to communicate with the terminal device 12 in one direction or bidirectionally. This electronic pen 14 is, for example, an electromagnetic induction (EMR) stylus or an active electrostatic coupling (AES) stylus. The user can write pictures, letters, etc., on the terminal device 12 by holding the electronic pen 14 and moving the pen tip against the touch surface of the terminal device 12.

[0025] The smartwatch 15 is a wristwatch-type computer that has various calculation functions in addition to its timekeeping function. The smart ring 16 is a ring-type computer that has various calculation functions in addition to its decorative function. The smartwatch 15 and smart ring 16 have built-in biosensors (not shown) for measuring the user's biometric information. The smartwatch 15 and smart ring 16 generate biometric data D1 by associating the biometric information obtained through the biosensors with the measurement time, and supply the biometric data D1 to the terminal device 12 via wireless communication.

[0026] Examples of biosensors include heart rate sensors, pulse rate sensors, GPS (Global Positioning System) sensors, accelerometers, gyroscopes, geomagnetic sensors, barometric pressure sensors, blood glucose sensors, blood pressure sensors, temperature sensors, or sensors combining these (e.g., pedometers and activity trackers).

[0027] The digital ink server 18 is a server computer that performs overall control over the data processing of the digital ink D2 generated by the terminal device 12, and may be either cloud-based or on-premise. Here, the digital ink server 18 is shown as a single computer, but the digital ink server 18 may instead be a group of computers that form a distributed system.

[0028] Biometric data D1 includes the user's biometric information. Each biometric data entry is linked to user information about the user and measurement information related to the measurement of the biometric data. Examples of biometric data include heart rate / pulse, steps taken, exercise level, blood glucose level, blood pressure, and body temperature.

[0029] Digital ink D2 contains stroke data that indicates the shape of multiple strokes. Examples of "ink description languages" for describing digital ink D2 include WILL (Wacom Ink Layer Language), InkML (Ink Markup Language), and ISF (Ink Serialized Format). Handwritten content may include letters, symbols, illustrations, or drawings. In particular, handwritten content that describes a day with a relatively small number of characters, such as a single line, is called a "one-line diary."

[0030] The pictogram data D3 includes pictograms 54 (Figure 4) defined in the feature space or processed pictograms. These "pictograms" are patterns unique to handwritten content and correspond to a set of points or a trajectory in the feature space for representing N state features. The number of dimensions N is an integer of 3 or more, preferably on the order of several hundred. Examples of "processed pictograms" include pictograms with reduced dimensions (i.e., cross-sectional views) and pictograms with reduced points. An example of a method for generating pictograms 54 is the artificial intelligence technology disclosed in Japanese Patent Publication No. 7320157.

[0031] Figure 2 shows an example of a calendar screen 30 displayed on the terminal device 12 in Figure 1. The calendar screen 30 is one of the application screens displayed on the display unit 24 when the terminal device 12 is running a health management application. Multiple icons are arranged in a row on the calendar screen 30. The multiple icons are classified into [1] normal icons consisting of numbers indicating the date and [2] decorative icons 32 in which the numbers of the date are decorated. The decorative icons 32 are arranged so that a number icon 34 indicating the date and a pictogram icon 36 indicating a pictogram 54 (Figure 4) overlap.

[0032] For example, by tapping the regular icon corresponding to "Today," specifically the "20" in the "SEP 2024" field, the displayed app screen transitions from the calendar screen 30 in Figure 2 to the handwriting input screen 40 in Figure 3.

[0033] Figure 3 shows an example of a handwriting input screen 40 displayed on the terminal device 12 in Figure 1. The handwriting input screen 40 is one of the application screens displayed on the display unit 24 while the terminal device 12 is running the health management application. The handwriting input screen 40 includes a date information field 42, a question information field 44, a free-form entry field 46, a button 48 labeled [OK], and a conversion icon 50 that represents a confused state.

[0034] The date information field 42 displays the date specified by the user (in this case, September 20, 2024). The question information field 44 displays a question for the user (in this case, "How was your day today?"). The free-form text field 46 is a blank area for accepting handwritten input using the electronic pen 14.

[0035] The user uses the electronic pen 14 to write a one-line diary entry 52 (in this case, "I had a wonderful dinner with my friends!") in the free-writing field 46, and then performs a pen operation by tapping the [OK] button 48. After the pen operation is accepted, each stroke that makes up the one-line diary entry 52 is drawn into the conversion icon 50, and digital ink D2 is generated to represent the one-line diary entry 52.

[0036] Subsequently, the digital ink server 18 acquires the digital ink D2 from the terminal device 12 and performs a generation process to generate a pattern 54 corresponding to the digital ink D2. By having the digital ink server 18 hold the digital ink D2 and the pattern data D3, the terminal device 12 can utilize the digital ink D2 and the pattern data D3 on demand.

[0037] Figure 4 shows an example of a pictogram 54 generated from the one-line diary 52 in Figure 3. For ease of illustration, the feature space is represented in a planar coordinate system with the first and second components as two axes. This pictogram 54 represents the series of writing processes from the start to the end of writing the one-line diary 52. ​​More specifically, the pictogram 54 is a collection of representative points calculated for each stroke operation. In the example in Figure 4, the pictogram 54 is represented as a set of points in the feature space, but instead, it may be a single line (i.e., a trajectory) formed by sequentially connecting each point.

[0038] After finishing writing the one-line diary 52 in Figure 3, the "normal icon" corresponding to "Today" on the calendar screen 30 in Figure 2 changes to a "decorative icon 32". By tapping the decorative icon 32 on the calendar screen 30 in Figure 2, the currently displayed app screen transitions from the calendar screen 30 in Figure 2 to the review screen 60 in Figure 5. Alternatively, by tapping the conversion icon 50 on the handwriting input screen 40 in Figure 3, the currently displayed app screen transitions from the handwriting input screen 40 in Figure 3 to the review screen 60 in Figure 5.

[0039] Figure 5 shows an example of a review screen 60 displayed on the terminal device 12 in Figure 1. The review screen 60 is one of the application screens displayed on the display unit 24 while the terminal device 12 is running the health management application. The review screen 60 has a date information field 62, an emblem information field 64, and a diary information field 66.

[0040] The date information field 62 displays the date specified by the user (in this case, September 20, 2024). The pictogram information field 64 displays a moving image of the pictogram 54, which shows the writing process of the one-line diary 52. ​​The diary information field 66 displays the one-line diary 52 that was handwritten in the free-form entry field 46 in Figure 3.

[0041] Figure 6 shows an example of a user's actions before and after going to sleep. The user goes to the bedroom carrying their terminal device 12 (22:00), sits on the bed and starts the health management application, and writes a one-line diary 52 via the handwriting input screen 40 of the terminal device 12 (22:10). The user looks at the reflection screen 60 of the terminal device 12 and reflects on the day (22:15), and falls asleep with a sense of "happiness and satisfaction with daily life," "self-evaluation of life," and "emotions such as joy, anger, sadness, and happiness" (22:30).

[0042] [Summary of Embodiments] As described above, in this embodiment, while an application is running that stores biometric data D1 indicating the user's biometric information to manage the user's health status, the terminal device 12 displays handwritten content generated through the user's handwriting operation (for example, a one-line diary 52) or derived content derived from the handwritten content (for example, emoji icons 36 and 54) on the application screen (here, the calendar screen 30 and the retrospective screen 60).

[0043] In this way, by displaying handwritten or derived content on the application screen while the application for managing health status is running, it becomes possible to visually integrate non-digital content with the dry, digitized data representing biometric information. Through the synergistic effect of combining "wellness" and "well-being," it is possible to provide users with a new experience and added value. For example, it can provide users with an opportunity to gain awareness and reflect on well-being and a good life. As a result, not only wellness but also well-being can be implemented in daily life through the use of the health management system 10.

[0044] Further, the handwritten content may be a one-line diary 52 in which the user reviews the events of the day and writes them in one line. By stacking the one-line diaries 52 written by hand, the ordinary aspects of daily life (e.g., events, emotions, etc.) can be overlaid on the screen of the application.

[0045] Further, the derived content may be a picture pattern 54 that is a set of points or a locus in the feature space for expressing the drawing state of the handwritten content. Thereby, the picture pattern 54 unique to the user can be overlaid on the screen of the application.

[0046] Further, the screen of the application (here, the calendar screen 30) includes a calendar showing the measurement history of the biological information, and the derived content (here, the picture pattern icon 36) may be displayed so as to overlap the date in the calendar to which the handwritten content is associated. By overlaying the picture pattern icon 36 on the date of the calendar, some awareness can be given to the user.

[0047] Further, the screen of the application (here, the calendar screen 30) includes a calendar showing the measurement history of the biological information, and when an operation for designating a date in the calendar is received, the handwritten content (here, the one-line diary 52) or the derived content (here, the picture pattern 54) corresponding to the date may be displayed. By visually recognizing the handwritten content or the derived content, the user can look back on the day he / she designated.

[0048] [Modification Example] Note that the present invention is not limited to the above-described embodiments, and it is needless to say that it can be freely changed without departing from the gist of this invention. Alternatively, each configuration may be arbitrarily combined as long as there is no technical contradiction.

[0049] In the above-described embodiment, the case where the terminal device 12 holds the biological data D1 has been described as an example. Instead, a separate storage device (e.g., a cloud server) may be configured to hold the biological data D1.

[0050] In the embodiments described above, the case in which the smartwatch 15 and smart ring 16 generate biometric data D1 was used as an example, but the number or type of IoT devices is not limited thereto. Furthermore, if the terminal device 12 is equipped with a biosensor, the terminal device 12 may generate and store the biometric data D1 itself.

[0051] In the embodiment described above, the example given was the case in which a one-line diary 52 is written using an electronic pen 14, but the handwritten content is not limited to this. Examples of handwritten content include [1] a memorable quote encountered today, [2] a word of gratitude to be conveyed today, [3] a self-reflection for today, or [4] a short comment to accompany "Today's Picture (photo or painting)".

[0052] In the embodiment described above, the case in which the derived content is an emblem 54 was used as an example, but the form of the derived content is not limited to this. Examples of derived content include [1] a group of words as state features, [2] another abstract representation of the words included in this group of words (for example, a symbol indicating the strength of the feature), or [3] another euphemistic representation of the words included in this group of words (for example, another word with high similarity).

[0053] [Explanation of Symbols] 10...Health management system, 12...Terminal device, 14...Electronic pen, 15...Smartwatch, 16...Smart ring, 18...Digital ink server, 21...Processor, 22...Memory, 23...Communication chip, 24...Display unit, 25...Touch sensor, 26...EMR sensor, 30...Calendar screen, 32...Overlay icon, 34...Number icon, 36...Picture icon (derived content), 40...Handwriting input screen, 52...One-line diary (handwriting content), 54...Picture (derived content), 60...Reflection screen, D1...Biometric data, D2...Digital ink, D3...Picture data

Claims

1. A terminal device that, while an application is running for managing the user's health status by accumulating biometric data indicating the user's biometric information, displays handwritten content generated through the user's handwriting operation or derived content derived from the handwritten content on the screen of the application.

2. The terminal device according to claim 1, wherein the handwritten content is a one-line diary in which the user reflects on the events of the day in one line.

3. The terminal device according to claim 1, wherein the derived content is a pictogram which is a set of points or a trajectory in a feature space for representing the drawing state of the handwritten content.

4. The terminal device according to claim 1, wherein the derived content is displayed together with the calendar to which the handwritten content is associated.

5. The terminal device according to claim 1, wherein the derived content is displayed together with a calendar showing the measurement history of the biometric information.

6. The terminal device according to claim 1, wherein the application screen includes a calendar showing the measurement history of the biometric information, and when an operation to specify a date in the calendar is received, the handwritten content or derived content corresponding to the date is displayed.

Images