Intake support system, computer program used therein, and control method

Abstract

This invention provides an intake support system that can utilize the position of the object to be ingested, placed within a designated area, to acquire information. [Solution] Server 2 (intake support system) identifies the placement location 5 where the object 7 (supplement) is placed among the multiple placement locations 5, based on captured image BI of a placement area 6 having multiple placement locations 5 that are distinguishable from each other, with the object 7 (supplement) placed there. Based on the identified placement location 5, it obtains support information to support the intake of the object 7 (for example, whether the placement is appropriate, or answers to questions).

Description

Technical Field

[0004] , , , , , ,

[0001] The present invention relates to an intake support system and the like that supports the intake of an object by notifying information related to the object to be ingested via an output device.

Background Art

[0002] There is a system that supports the intake of an object by notifying information related to the object to be ingested via an output device. For example, there is known a medication management system that reads specific medication information described in a medication information providing document and records the information obtained from the image data in association with the read specific medication information (see, for example, Patent Document 1). In addition, Patent Documents 2 to 6 and Non-Patent Document 1 exist as prior art documents related to the present invention.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

Patent Document 5

Patent Document 6

Non-Patent Documents

[0004]

Non-Patent Document 1

[0005] In the system described in Patent Document 1, a series of actions leading up to the administration of medication are recorded as video data. Various information is then obtained through this video data. For example, the appropriateness of the medication is judged based on the video data, and if the wrong medication is about to be administered, information such as a warning is sent. However, the medication to be taken is simply placed in the palm of the hand and administered, and information regarding the position where the medication is placed is not utilized. The same applies to the servers described in Patent Documents 2 to 6.

[0006] For example, Patent Document 2 discloses a server that can determine whether a drug is genuine or not. Patent Document 3 discloses a computer that assists in taking medication according to a schedule. Patent Document 4 discloses a medication support device that can track whether medications that need to be taken continuously at predetermined intervals have been missed. Patent Document 5 discloses a clinical trial support system that ensures the reliability of data on medication intake by subjects in clinical trials, acquires biometric values ​​at a time close to the time of administration, and also tracks the symptoms of subjects after the drug is launched on the market. Patent Document 6 discloses a medication management device that allows patients to easily check the timing, type, and dosage of each dispensed medication when they take it. However, none of Patent Documents 2 to 6 utilize information about the location where the medication is placed at the time of administration.

[0007] On the other hand, consistency (habit formation) is often required not only for taking medication but also for taking other supplements, and maintaining that consistency is often a challenge. Non-patent document 1 discloses research on behavioral change that utilizes ICT technology to alter people's behavior. Applying such research on behavioral change to medication use may make it possible to achieve habit formation. However, in order to lead to behavioral change, additional actions such as inputting information not directly related to medication use may be required. In this case, it may actually hinder habit formation. Therefore, there is a need to facilitate the acquisition of information related to behavioral change. Furthermore, various types of information are acquired in systems such as those described in patent documents 1 to 6. Therefore, there is a need to facilitate the acquisition of various types of information related to medication use, not limited to information related to behavioral change.

[0008] Therefore, the present invention aims to provide an intake support system, etc., that can utilize the position of the object to be ingested, which is placed in the placement area, for acquiring information. [Means for solving the problem]

[0009] The present invention provides an intake support system that supports the intake of an object by notifying information about the object to be ingested via an output device, and comprises: a position determination means for determining an object placement position among a plurality of placement positions, which are distinguishable from each other, based on a captured image taken of a plurality of placement positions in which the object is placed; and an information acquisition means for acquiring support information to support the intake of the object based on the object placement position.

[0010] Furthermore, the computer program of the present invention is configured to cause the computer to function as one of the means of the above-described intake support system.

[0011] Furthermore, the control method of the present invention causes a computer incorporated in an intake support system that supports the intake of an object by notifying information regarding the object of intake via an output device, to perform a position determination procedure for determining a target arrangement position as the arrangement position where the object is arranged among the plurality of arrangement positions, based on a captured image of an arrangement area having a plurality of arrangement positions that are distinguishable from each other with the object arranged therein, and an information acquisition procedure for acquiring support information for supporting the intake of the object based on the target arrangement position.

Brief Description of the Drawings

[0012] [Figure 1] FIG. 8 shows an example of the overall configuration of a network system to which an intake support system according to one embodiment of the present invention is applied. [Figure 2] An explanatory diagram for explaining an example of the procedure of an intake support service. [Figure 3] An explanatory diagram for explaining an overview of the configuration of an intake support service. [Figure 4] FIG. 17 shows a diagram of the configuration of a main part of the control system of a network system. [Figure 5] An explanatory diagram for explaining an example of a procedure for acquiring an arrangement instruction on a support screen. [Figure 6] An explanatory diagram for explaining an example of character growth. [Figure 7] An explanatory diagram for explaining an example of analysis of a captured image. [Figure 8] An explanatory diagram for explaining an example of an overview of an action variation stage. [Figure 9] An explanatory diagram for explaining an example of conditions for determining each state in an operational action variation. [Figure 10] An explanatory diagram for explaining an example of the relationship between an action variation stage and an explanatory text. [Figure 11] FIG. 38 shows a diagram showing examples of a cultivation-based text and an action-based text. [Figure 12] FIG. 41 shows a diagram of an example of the configuration of log data. [Figure 13]A flowchart showing an example of the procedure of configuration indication processing. [Figure 14] A flowchart showing an example of the procedure of log acquisition processing. [Figure 15] A flowchart showing an example of the procedure of text display processing. [Figure 16] A flowchart showing an example of the procedure of point assignment processing.

Mode for Carrying Out the Invention

[0013] (Overall Configuration) Hereinafter, one form of the intake support system of the present invention will be described. The intake support system of this form is configured as a part of a network system that provides an intake support service. First, the outline of the network system will be described below, and then the configuration related to the intake support service will be described. As shown in FIG. 1, the network system 1 includes a server 2.

[0014] The server 2 is configured as a logical server system in which a plurality of server units 2A, 2B... (hereinafter, may be represented by reference numeral 2) are combined, and functions as the intake support system of the present invention in the network system 1. The server units 2 may be collectively installed at a specific position on the network NT, or may be provided so as to constitute a so-called cloud-type server system by being installed dispersedly on the network NT using cloud computing.

[0015] A user terminal device 3 is connected to server 2 via network NT. User terminal device 3 is a device used for the user's daily use and is a computer device (information and communication terminal device) equipped with information and communication functions via network NT. A mobile terminal device such as a smartphone or tablet with communication and calling capabilities may be used as user terminal device 3. User terminal device 3 may also be a PC (abbreviation for personal computer). The following describes an example where a smartphone is used as user terminal device 3.

[0016] User terminal device 3 functions as a service terminal that provides intake support services via a predetermined application (software). In other words, in the network system 1, intake support services are provided to the user via a predetermined application (hereinafter sometimes referred to as a support application) on user terminal device 3. Intake support services are services that support the intake of the target substance.

[0017] Specifically, the intake support service is configured to support intake by utilizing a placement area 6 where the target object is to be placed. The placement area 6 may be configured as appropriate, for example, by an image displayed on a tablet's display device. In the example in Figure 1, a base sheet 4 is used, which has a placement area 6 and an explanatory area AA. The placement area 6 may have an appropriate number of placement positions 5 that are distinguishable from each other, and in the example in Figure 1, there are 14 placement positions 5 (some of the symbols). Each placement position 5 is distinguished by identification information for identifying each placement position 5. Various types of information may be used as identification information as appropriate. In the example in Figure 1, each placement position 5 is assigned identification information such as nine letters from "a" to "f" or five symbols from "i" to "v" to distinguish them from each other.

[0018] Explanation area AA is an area where information explaining each type of placement position 5 is displayed. Explanation area AA may be formed as appropriate according to each type of placement position 5. In the example in Figure 1, it is divided into two areas, one containing "placement" information indicating nine placement positions 5 assigned letters, and the other containing "question" information indicating five placement positions 5 assigned symbols.

[0019] The type of base sheet 4 (placement area 6) may be one or more types. For example, multiple types of base sheets 4 may be used. Each base sheet 4 may be distinguished as appropriate. Each base sheet 4 may be distinguished according to elements such as the form (including shape, size, position, etc.) of each placement position 5 and placement area 6, or the number of each placement position 5. These base sheets 4 may be used appropriately depending on the application, such as differences in the number of objects to be ingested. In the example in Figure 1, both the placement area 6 and each placement position 5 are formed in a rectangular shape. In addition, each base sheet 4 is provided with an identification section MP for identifying the type. The identification section MP may be configured as appropriate as long as it can identify the type. In the example in Figure 1, it is configured as four AR markers having different patterns from each other and is placed at the four corners of the placement area 6.

[0020] In the intake support service, the base sheet 4 is photographed by a camera CA installed on the user terminal device 3 when the target object is placed in the placement area 6. The photographic results are transmitted to the server 2 via the support application. The server 2 plays a role in supporting the intake of the target object by notifying the support information obtained from the photographic results via the support application (user terminal device 3). The intake support service will be described further below.

[0021] Network NT may be configured as appropriate, as long as it allows user terminal device 3 to communicate with server 2. For example, network NT is configured to achieve network communication using the TCP / IP protocol. Typically, network NT is configured by combining the internet as a WAN and an intranet as a LAN. In the example in Figure 1, server 2 is connected to network NT via router NTr, and user terminal device 3 is connected to network NT via access point AP.

[0022] (Overview of Intake Support Services) Next, with reference to Figures 2 and 3, an overview of the intake support service will be provided. The intake support service is a service that obtains support information to support the intake of the target object from the shooting results of the base sheet 4, and provides various support based on that support information. Figure 2 is an explanatory diagram illustrating an example of the procedure (flow) of the intake support service. As shown in the example in Figure 2, the intake support service includes steps F1 to F7.

[0023] Specifically, in the intake support service, information regarding placement instructions is provided to the user via the support application on the user terminal device 3 (F1). The placement instructions indicate the placement locations 5 on the base sheet 4 where the object to be ingested 7 should be placed. The placement instructions may include appropriate information regarding placement, and in the example in Figure 2, they include designation information and question information. The designation information specifies the placement location 5 where the object 7 should be placed via identification information. Therefore, the designation information includes identification information corresponding to the placement location 5 where the object 7 should be placed. The question information indicates questions for the user.

[0024] The object of intake 7 can be any type of substance, including medicine (medication). In the example in Figure 2, four tablets of supplement are shown as the object of intake 7. Therefore, the designated information includes information instructing the intake of four tablets of object 7. Specifically, the designated information includes the information "3 tablets → c, g, i" and "1 tablet → answer".

[0025] "3 tablets → c, g, i" is information that instructs the placement of a total of 3 object tablets 7, one at each of "c," "g," and "i" among the nine placement positions 5A (hereinafter sometimes referred to as simple placement positions 5A) identified by alphabetical identification information. "1 tablet → answer" is information that instructs the placement of 1 object tablet 7 at placement position 5, which corresponds to the user's answer to the question in the question information, among the five placement positions 5B (hereinafter sometimes referred to as answer placement positions 5B) identified by symbolic identification information. In other words, the user's answer to the question is instructed through the placement of object 7 at one of the answer placement positions 5B. In this example, each of the simple placement positions 5A and one of the answer placement positions 5B corresponding to "c," "g," and "i" functions as a designated placement position of the present invention. Furthermore, the five answer placement positions 5B function as multiple candidate placement positions of the present invention.

[0026] Next, the user places the target object 7 to be ingested on the backing sheet 4 according to the placement instructions (F2). In the example in Figure 2, four target objects 7 (supplements) are placed in a total of four placement positions 5: three simple placement positions 5A corresponding to "c", "g", and "i", and an answer placement position 5B corresponding to the answer "i", according to the placement instructions. After placing the target objects 7 on the backing sheet 4, the user takes a picture of the backing sheet 4 in that state with the user terminal device 3 (camera CA) (F3) and sends the captured image to the server 2 (F4). In this example, the three simple placement positions 5A corresponding to "c", "g", and "i" function as target placement positions of the present invention. In addition, among the five answer placement positions 5B, the answer placement position 5B corresponding to "ii", where the target object 7 is placed, functions as a candidate placement position of the present invention.

[0027] When a captured image is transmitted from the user terminal device 3, the server 2 acquires it and analyzes the captured image (F5). This analysis includes determining whether the object 7 is placed at the designated location 5 as instructed in the specified information (i.e., whether the placement of the object 7 is appropriate). If the placement of the object 7 is inappropriate (for example, if the object 7 is not placed at the designated location 5, or if there is an excess or deficiency in the specified number of tablets, such as 3 tablets instead of 4, or 5 tablets), the server 2 may simply record this fact (information indicating a mismatch with the designated location 5), or it may notify the user via the user terminal device 3 (support application) of the appropriate announcement. As an example, the server 2 notifies the user of an error (inappropriate placement) and prompts them to retake the image with the object in the appropriate placement. In the retake, steps F2 to F5 are executed again.

[0028] On the other hand, if the placement of object 7 is appropriate (object 7 is placed at the instructed placement position 5), server 2 provides the first service (F6) and the second service (F7) in order. The first service is a service that acquires and records support information based on the captured image. The support information may appropriately include various information regarding the intake of object 7. For example, the support information may include information on the intake status such as the number of tablets taken (intake), date and time, cumulative intake, number of consecutive days of intake, and intake interval. Furthermore, if the placement instruction includes question information, the support information may include answer information indicating the answer to the question through the placement of object 7 at the answer placement position 5B (including not the answer itself, but various analysis results such as awareness derived from the answer). Note that the result of whether or not the placement of object 7 is appropriate may also function as one of the support information.

[0029] The second service provides behavioral change information based on the support information provided in the first service. This behavioral change information encourages the user to consume (change their behavior) the target substance 7. The behavioral change information may include various types of information related to behavioral change as appropriate. For example, the behavioral change information may include character-related information and text-related information. The consumption support service may include elements for developing a predetermined character from the perspective of gamification and design principles. Character-related information is information related to the development of the predetermined character. In other words, the character-related information changes the motivation to consume the target substance 7 to the motivation to develop the character, indirectly encouraging the consumption of the target substance 7. Text-related information is information related to persuasive texts that encourage behavioral change. The consumption support service provides various candidate persuasive texts that encourage the consumption of the target substance 7. The text-related information includes information on persuasive texts selected from the candidates based on the support information. In other words, the persuasive texts in the text-related information directly encourage the consumption of the target substance 7. Details of character development and persuasive texts will be described later.

[0030] Figure 3 is an explanatory diagram illustrating the general configuration of the intake support service. In the intake support service, the mounting sheet 4 may be distributed (purchased) for a fee, but the example in Figure 3 shows that it is distributed free of charge. As shown in Figure 3, the user terminal device 3 is equipped with an image acquisition unit 33. The image acquisition unit 33 acquires the image of the mounting sheet 4 and transmits it to the server 2.

[0031] Server 2 is equipped with an analysis unit 23, a log data LD, a work-in-progress management unit 24, and a document management unit 25. The analysis unit 23 acquires the shooting results transmitted from the image acquisition unit 33 and performs analysis of the shooting results (captured images). This analysis may be performed as appropriate as possible, as long as the placement location 5 where the object 7 is placed can be identified, and may be performed using AI, for example. As an example, this analysis is performed by an image comparison algorithm. Then, the analysis unit 23 acquires support information from the captured images based on the analysis results and records it in the log data LD. In other words, it provides the first service in the example shown in Figure 2. Details of the image comparison algorithm (analysis) will be described later.

[0032] The work-in-progress management unit 24 performs processing related to character development. For example, the work-in-progress management unit 24 calculates the points that should be awarded to user U based on log data LD, and performs processing to grow the character (e.g., changing various abilities including appearance). Points are information that shows an example of the value for developing a character. The document management unit 25 performs processing related to document information. For example, the document management unit 25 performs processing to select (determine) a persuasive document to present to user U from a list of candidate persuasive documents based on log data LD. As a result, the second service is provided by the work-in-progress management unit 24 and the document management unit 25.

[0033] Meanwhile, the user terminal device 3 provides a support screen 50 for providing intake support services via a support application. The support screen 50 is equipped with an operation unit 51 and an information display unit 52. The operation unit 51 is where various operations on the support screen 50 are performed. The information display unit 52 is where various information is displayed. For example, the persuasive text selected and provided by the text management unit 25 is displayed on the information display unit 52. The support screen 50 also includes a character screen for checking the details of the character being trained. Points and other information awarded by the progress management unit 24 are notified to the user U via the character screen. In other words, behavioral change information, such as character-related information (e.g., character images) and text-related information (e.g., persuasive text), is provided to the user U through the support screen 50. This behavioral change information then encourages an increase in the motivation to continue consuming the target substance 7.

[0034] (Configuration of key components of the control system) Next, the configuration of the main components of the control system of network system 1 will be described with reference to Figure 4. Figure 4 is a diagram showing the configuration of the main components of the control system of network system 1. As shown in Figure 4, server 2 comprises a control unit 21 and a storage unit 22.

[0035] The control unit 21 is configured as a computer combining a processor unit that performs various calculations and operation controls according to a predetermined computer program, and internal memory and other peripheral devices necessary for its operation. The processor unit may appropriately include units such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an NPU (Neural Network Processing Unit) (including cases where each processor unit is integrated as appropriate, such as when a GPU is incorporated into the CPU). Input devices such as a keyboard and output devices such as a monitor may be appropriately connected to the control unit 21. However, their illustrations have been omitted.

[0036] The storage unit 22 is connected to the control unit 21. The storage unit 22 is a storage device implemented by a unit that includes a non-volatile storage medium (computer-readable storage medium) such as a hard disk array. The storage unit 22 may be configured to hold all data within a single unit, or it may be configured to distribute and store data across multiple units. The server program PG1 and the server data SD are recorded in the storage unit 22.

[0037] The server program PG1 is a computer program that instructs the control unit 21 to execute various processes necessary to provide various services to the user. The server data SD is data that is referenced in conjunction with the execution of the server program PG1. The server data SD may contain various types of data as appropriate. In the example in Figure 3, document data CD, log data LD, and question data QD are shown as examples of server data SD.

[0038] Log data LD is data that records support information for each user. This support information includes various types of information that support consumption, such as information about the character being trained or information about the consumption status of the target item 7. Log data LD is used to generate behavioral change information that should be provided to user U, such as character-related information or text-related information. Details of log data LD will be described later.

[0039] The text data CD is data for managing persuasive texts. The text data CD contains information on candidate persuasive texts. The question data QD is data for managing candidate questions and candidate answers that should be included in the question information. The server data SD may also include other information as appropriate, such as image data for displaying various images of predetermined characters, or audio data for playing various sounds.

[0040] The control unit 21 is equipped with a logical device realized by a combination of the hardware resources of the control unit 21 and the server program PG1 as software. The control unit 21 may be equipped with any appropriate logical device. In the example in Figure 4, an analysis unit 23, a work-in-progress management unit 24, a document management unit 25, and an instruction management unit 26 are shown as examples of such logical devices.

[0041] The analysis unit 23 is a logical device that performs various processes related to the analysis of captured images in the intake support service. For example, the analysis unit 23 performs processes such as acquiring captured images from the user terminal device 3 as described above, and identifying the placement location 5 where the object 7 is placed from the captured image based on an image comparison algorithm. The analysis unit 23 also performs processes such as acquiring support information based on the analysis results of the captured images, and generating (updating) log data LD that records that support information. For example, the processes performed by the analysis unit 23 include log acquisition processing. The analysis unit 23 may perform log acquisition processing independently, but as an example, it performs it in cooperation with the image acquisition unit 33 of the user terminal device 3. Details of the log acquisition processing procedure will be described later.

[0042] The progress management unit 24 is a logical device that executes various processes related to character development. For example, the progress management unit 24 calculates the points that should be awarded to user U as described above, and performs processes to grow the character based on those points. The processes executed by the progress management unit 24 include, for example, the point awarding process. Details of the point awarding process will be described later.

[0043] The document management unit 25 is a logical device that performs various processes related to document information. For example, as described above, the document management unit 25 performs processes such as selecting a persuasive document to present to the user from a list of candidate documents and providing that document to the user via a support application. For example, the processes performed by the document management unit 25 include document display processing. The document management unit 25 may perform document display processing independently, but as an example, it performs it in cooperation with the display control unit 34 of the user terminal device 3. Details of the procedure for document display processing will be described later.

[0044] The instruction management unit 26 is a logical device that performs various processes related to placement instructions. The instruction management unit 26 generates designation information and question information that should be included in the placement instructions, and performs processes such as transmitting (notifying via the user terminal device 3) the placement instructions containing them. The processes performed by the instruction management unit 26 include, for example, placement instruction processing. The instruction management unit 26 may perform placement instruction processing independently, but as an example, it performs it in cooperation with the display control unit 34 of the user terminal device 3. Details of the procedure for placement instruction processing will be described later.

[0045] The user terminal device 3 is equipped with a control unit 31 as a computer and a storage unit 32. The control unit 31 is configured as a computer combining a processor unit that performs various calculations and operation controls according to a predetermined computer program, and internal memory and other peripheral devices necessary for its operation. The processor unit may appropriately include units such as a CPU, GPU, and NPU (including cases where each processor unit is integrated as appropriate, such as when a GPU is incorporated into the CPU).

[0046] The storage unit 32 is a storage device implemented by a unit that includes a non-volatile storage medium (computer-readable storage medium) such as a hard disk or a semiconductor storage device. The storage unit 32 may be configured to hold all data on a single unit, or it may be configured to distribute and store data across multiple units. The storage unit 32 stores the terminal program PG2 and the terminal data TD. The terminal program PG2 is a computer program that causes the control unit 31 to execute the processing necessary to provide various services. The terminal program PG2 may include various programs (software) as appropriate. For example, the terminal program PG2 includes a program for implementing a support application.

[0047] Terminal data TD is data referenced during the execution of terminal program PG2. Terminal data TD may contain various types of data as appropriate. For example, terminal data TD may contain various data for implementing a support application. Terminal data TD may also contain other data such as image data for displaying various images of predetermined characters, or audio data for playing various sounds. Terminal data TD may be recorded in storage unit 32 as appropriate. For example, it may be pre-installed in storage unit 32, or it may be provided by server 2 to include the necessary parts.

[0048] The control unit 31 is equipped with a logical device realized by a combination of the hardware resources of the control unit 31 and the terminal program PG2 as software. The control unit 31 may be equipped with any appropriate logical device. In the example in Figure 4, an image acquisition unit 33 and a display control unit 34 are shown as examples of such logical devices.

[0049] The image acquisition unit 33 is a logical device that performs various processes related to the acquisition of captured images. For example, the image acquisition unit 33 performs processes such as acquiring the shooting results of the mounting sheet 4 from the camera CA as described above, and controlling the operation of the camera CA for that purpose. The image acquisition unit 33 may also perform processes to display various information generated in conjunction with the operation of the camera CA (for example, analysis results by the analysis unit 23) on the support screen. For example, the image acquisition unit 33 performs log acquisition processing in cooperation with the analysis unit 23 of the server 2.

[0050] The display control unit 34 is a logical device for controlling various types of information, such as text or images, displayed on the support screen. For example, the display control unit 34 performs processing to display various types of information transmitted from the server 2. The information transmitted from the server 2 includes, for example, behavior change information transmitted via the work-in-progress management unit 24. Therefore, the processing performed by the display control unit 34 includes processing to display the analysis results or behavior change information obtained from the server 2 on the support screen. The display control unit 34 performs text display processing and placement instruction processing in cooperation with, for example, the document management unit 25 or the instruction management unit 26 of the server 2.

[0051] Various other input and output devices may be connected to the control unit 31. In the example shown in Figure 4, a monitor MO, a touch sensor TS, and a camera CA are shown as examples. The monitor MO, touch sensor TS, and camera CA are all general-purpose hardware installed in information and communication terminals such as smartphones. For example, the monitor MO is an output device (display device) for displaying support screens etc. in response to signals from the control unit 31. The touch sensor TS is an input device positioned to cover the monitor MO and detects user touch operations (operations by touching with a finger). The touch sensor TS detects touch operations at positions corresponding to various instructions and inputs signals corresponding to the position of the touch operation as various instructions to the control unit 31. The camera CA is an optical device that operates to take pictures in response to signals from the control unit 31. In addition, the user terminal device 3 may be appropriately equipped with various other devices such as a speaker, gyro sensor, acceleration sensor, and location information (e.g., GPS information) receiving device. In this example, the monitor MO functions as the output device of the present invention.

[0052] (Support screen) Next, the support screen will be described with reference to Figure 5. Figure 5 is an explanatory diagram illustrating an example of the procedure for obtaining placement instructions on the support screen 50. In the example in Figure 5, an example of the support screen 50 is schematically shown when the support application is configured as one of the messaging applications. In this case, as shown in Figure 5, the support screen 50 includes an operation unit 51 and an information display unit 52. The operation unit 51 is the part where various operations on the support screen 50 are performed, and the information display unit 52 is the part for displaying various information. As an example, the information display unit 52 displays message M0 prompting the transmission of a photographed image of the base sheet 4 when the support screen 50 is launched. Note that the support application may be an application dedicated to the intake support service, or it may be a general-purpose application that provides the intake support service as one of various services. In other words, the messaging application (support application) in the example in Figure 5 may be an application dedicated to the intake support service, or it may be a general-purpose application of the SNS (Social Networking Service) type used for exchanging messages.

[0053] The operation unit 51 and the information display unit 52 may be configured as appropriate. In the example shown in Figure 5, the operation unit 51 includes a record button 51A, a character details button 51B, a log button 51C, and a Tips button 51D. The record button 51A, character details button 51B, log button 51C, and Tips button 51D are all configured as virtual push buttons that indicate the location where a touch operation should be performed. Specifically, the record button 51A is a virtual push button where a touch operation to instruct recording the intake log of the object 7 should be performed.

[0054] When the record button 51A is touched, the information display unit 52 displays an operation guidance message M1, a layout information button 52A, a shooting button 52B, and a photo selection button 52C. The operation guidance message M1 is a message that guides the user to perform the next operation. In the example in Figure 5, the user is guided to select one of the following: the layout information button ("Learn Layout") 52A, the shooting button ("Shoot") 52B, or the photo selection button ("Select Photo") 52C.

[0055] The placement information button 52A, the shooting button 52B, and the photo selection button 52C are all configured as virtual push buttons that indicate the location where a touch operation should be performed. For example, the placement information button 52A is a virtual push button on which a touch device that instructs notification of placement instructions should be executed. Placement instructions may be notified as appropriate. In the example in Figure 5, it is notified by a placement instruction message M2. Specifically, when a touch operation is performed on the placement information button 52A, the information display unit 52 displays a placement instruction message M2 containing information about the placement instructions.

[0056] The identification information included in the placement instructions may be updated at an appropriate frequency. For example, if the intake interval (timing) of the object 7 is once a week, it may be updated weekly, or it may be updated each time the support app is launched. The example in Figure 5 shows a case where the object 7 (supplement) is taken once a day. In this case, the identification information in the placement instructions, that is, the placement location 5 where the object 7 should be placed, is updated daily (timing of intake). In addition, the identification information to be displayed in the daily update may be determined as appropriate, for example, according to a predetermined rule. As an example, the identification information to be displayed is determined randomly by lottery. In other words, the placement instruction message M2 displays information about the placement location 5 that is randomly determined (specified) from nine simple placement locations 5A each day as placement instructions (specified information).

[0057] Although omitted in the example in Figure 5, placement instructions include question information in addition to specification information. Therefore, placement instruction message M2 may include question information. Question information may be displayed at an appropriate frequency; for example, it may be displayed daily, similar to the specification information. As an example, question information may be displayed once a week on a predetermined day (or time), such as every Monday. Therefore, placement instructions include question information once a week, and answers to the questions are required once a week.

[0058] The shooting button 52B is a virtual push button on which a touch operation should be performed to request an opportunity to take a picture of the mounting sheet 4. When the shooting button 52B is touched, the camera CA's shooting function is activated and an opportunity to take a picture is granted. The photo selection button 52C is also a virtual push button on which a touch operation should be performed to request an opportunity to select a photo (captured image) to send to the server 2. The shooting result (captured image) from the shooting opportunity may be automatically sent to the server 2, but as an example, the captured image (photo) selected via the photo selection button 52C is sent to the server 2. Therefore, after receiving the placement instruction message M2 by touching the placement information button 52A, the user is sequentially requested to touch the shooting button 52B and then the photo selection button 52C. Specifically, the user is sequentially requested to take a picture of the mounting sheet 4 on which the object 7 is placed using the shooting opportunity granted by touching the shooting button 52B, and then select the shooting result via touching the photo selection button 52C.

[0059] The Character Details button 51B, Log button 51C, and Tips button 51D are virtual push buttons used to display details of the character being trained, a log of support information (achievements), and Tips (text-related information such as app explanations and persuasion texts), respectively. Touching these buttons will display a character screen to check character details, a log screen to check the log of support information, or a Tips screen to check various tips. The character screen, log screen, and Tips screen are all types of support screens 50.

[0060] (Character development) Next, we will explain character development with reference to Figure 6. Figure 6 is an explanatory diagram illustrating an example of character development. Information regarding character development may be provided as appropriate on the support screen 50. As an example, it may be provided through the character screen 60. The character screen 60 may be appropriately configured to include various information regarding character development. In the example in Figure 6, an example of the character screen 60 is schematically shown. As shown in Figure 6, the character screen 60 includes, for example, a character image 61. The character image 61 is an image showing the character being developed.

[0061] The character image 61 includes multiple types of images, each corresponding to one of several appearances. The character image 61 may include any appropriate type of image (appearance). In the example in Figure 6, four types of character images 61 are shown, each corresponding to one of four appearances in which the character gradually grows. These are used to simulate the gradual growth in accordance with points awarded in response to the consumption of the object 7. In other words, the character image 61 for each appearance is displayed on the character screen 60 so that it changes (grows) as the character continues to consume the object 7.

[0062] More specifically, a level is set as one of the parameters that define each character. Each character may also have various other parameters, some of which may change according to the level. The appearance (or the type of character image 61 corresponding to the character being trained) changes according to the level, as one example. In other words, the character being trained has a level that increases according to the amount of points the user has earned, and the appearance of each character changes as it grows through leveling up. The character screen 60 then displays a character image 61 with an appearance corresponding to the level. The character screen 60 may also display various other information about the character, such as the amount of points earned and the points required to level up. In other words, character-related information (behavior change information) is provided to the user via the character screen 60. In this example, the character image 61 functions as the object of the present invention. The character's level functions as a parameter of the present invention. Furthermore, points function as a predetermined value of the present invention.

[0063] (Analysis of captured images) Next, the analysis of the captured image will be explained with reference to Figure 7. The analysis of the captured image may be implemented as appropriate, and as an example, it can be implemented by an image comparison algorithm. Figure 7 is an explanatory diagram illustrating an example of the analysis of a captured image BI by an image comparison algorithm. As shown in Figure 7, the image comparison algorithm includes three steps in order: (i) identification of the mounting sheet 4, (ii) cutting out the placement area 6, and (iii) determining the placement position (difference method). In the example in Figure 7, images of the identification unit MP etc. contained therein are shown via the captured image BI, but for the sake of explanation, these images will be described using the same symbols as the identification unit MP etc.

[0064] Specifically, as shown in (i), the image acquisition unit 33 first identifies the patterns (AR markers) of the four identification units MP included in the captured image BI and identifies the type of sheet 4 that was photographed from the types of sheet 4 that were registered in advance. As mentioned above, the server 2 is equipped with various types of sheet 4 that can be used depending on the purpose. In the example in Figure 4, one example is shown: a captured image BI of a sheet 4 in which a total of four tablets are placed, with one tablet for the answer and three tablets for the alphabet.

[0065] Furthermore, the intake support service may include a preparatory service for registering the correct type of form 4 to be used. This registration is performed by the user in advance through a support app, for example, along with inputting necessary information such as the supplement to be taken, the frequency of intake, and the dosage. The use of form 4 according to the registered information is then recommended. The registration of the correct form 4 is not limited to one type; multiple types may be registered depending on the type of supplement, etc. If multiple types of form 4 are registered, an opportunity to select the form 4 to be used may be provided.

[0066] The image acquisition unit 33 identifies the type of mounting sheet 4 included in the captured image BI, and as shown in (ii), extracts a portion of the placement area 6 BIa (hereinafter sometimes referred to as the placement portion image BIa) based on the positions of the four identification units MP. Subsequently, as shown in (iii), the image acquisition unit 33 identifies the coordinates where the object 7 is placed by comparing the extracted placement portion image BIa with a previously registered placement portion image BIa (before the object 7 is placed) and detecting the difference using the difference method. Then, based on the identified coordinates, it determines the placement position 5 (including the answer to the question) where the object 7 is placed. As an example, the image acquisition unit 33 performs the analysis of the captured image BI using this procedure.

[0067] (Details of the persuasive text) Next, we will explain the details of the persuasive text with reference to Figures 8 to 11. The intake support service includes stages (hereinafter sometimes referred to as behavioral change stages) as a concept for classifying users into multiple categories. The behavioral change stages include multiple stages (classifications), and the persuasive text is determined from multiple candidates based on the stage to which the user belongs.

[0068] Figure 8 is an explanatory diagram illustrating an example of the behavioral change stages. As shown in Figure 8, in the behavioral change stages, each user is classified based on two axes: (A) mental change and (B) behavioral change. These two axes may be configured as appropriate to classify each user in various ways. In the example in Figure 8, the ingested substance may be related to the ingestor's immunity, that is, the efficacy of the supplement is related to immunity. In this case, mental change is configured to classify each user based on their interest in immunity. On the other hand, behavioral change is configured to classify each user according to their intake of the substance 7. Note that efficacy refers to the physical or mental state of the ingestor after taking the supplement, which is expected as a result of taking the supplement.

[0069] Specifically, as shown in Figure 8(A), the question data QD includes information on “items,” “questions,” and “answers.” “Questions” is information indicating candidate questions to be included in the placement instructions, and “items” is information indicating the item to which each candidate question belongs. “Answers” ​​are candidate answers for each question. The questions included in the placement instructions may be appropriately determined from the candidate questions in the question data QD, for example, based on a predetermined order or a predetermined rule such as the degree of each user's interest in immunity. As an example, the questions included in the placement instructions are randomly determined daily from the candidate questions. Therefore, the placement instructions include one of the candidate questions and a candidate answer for it as question information, and each user is required to select one of the candidate answers by placing the object 7 at the answer placement position 5B. In the mental transformation, each user is classified as either interested in immunity or not based on their answer. Note that the supplements taken are not limited to those with immune-related effects, but may have various effects. Questions and other information corresponding to the effects of the supplements taken may be prepared and notified to the user. In the example in Figure 8, the five answer candidates i to v included in “Answer” function as multiple answer candidates according to the present invention.

[0070] On the other hand, as shown in Figure 8(B), behavioral change involves six steps: “indifference,” “interest,” “start,” “continue,” “behavioral change,” and “habituation.” Furthermore, “indifference” and “interest” are distinguished as initial states, “start” and “continue” as intermediate states, and “behavioral change” and “habituation” as late states. These three states can be positioned as appropriate. In the example in Figure 8, the initial state is positioned as the state in which the user consciously begins to consume the object 7, and the intermediate state is positioned as the state in which the user consciously continues. Similarly, the late state is positioned as the state in which the user can continue without difficulty. Each user is then classified into one of the initial, intermediate, or late states depending on their consumption status. Furthermore, the “interest” state can be described as, for example, the state in which the building of triggers for awareness begins, the “continue” state as, for example, the state in which the manifested desire is satisfied, and the “habituation” state as, for example, the state in which the fundamental desire is satisfied.

[0071] Figure 9 is an explanatory diagram illustrating an example of the conditions for determining each state in behavioral change. As shown in Figure 9, each user is determined to be in the initial, middle, or late stage based on promotion and demotion conditions. Specifically, in behavioral change, each user starts in the initial state, and is promoted to the middle stage if they meet the promotion conditions in the initial state. The initial promotion conditions can be set as appropriate, and as an example, the condition is met when the intake rate over the past 15 days (the percentage of days in which the target substance 7 was consumed out of 15 days) is 50% or more (8 days or more out of 15 days).

[0072] The intermediate state has both promotion and demotion conditions. The promotion condition is the condition for promoting each user classified as intermediate to the later state. On the other hand, the demotion condition is the condition for demoting each user classified as intermediate to the initial state. The promotion and demotion conditions may be set as appropriate. In the example in Figure 9, the promotion condition is set to be met when the intake rate over the past 30 days (which may be counted from after promotion to the intermediate state, but in the example in Figure 9, it is the entire period from the start of intake, including the initial state) is 80% or higher (24 days or more out of 30). On the other hand, the demotion condition is set to be met when the user does not take the supplement for 4 consecutive days (4 consecutive days without taking the supplement 7).

[0073] Demotion conditions are set for the later stages. These demotion conditions are the conditions that demote (return) each user classified as being in the later stages to the intermediate stage. The demotion conditions for the later stages may also be set as appropriate. In the example in Figure 9, the condition is set to be met if the user does not drink for three consecutive days. As an example, in behavioral change, each user is classified into one of the initial, intermediate, or later stages according to these conditions.

[0074] Figure 10 is an explanatory diagram illustrating an example of the relationship between behavioral change stages and persuasive texts. In the example in Figure 10, the behavioral change stages are shown in a graph format with mental change and operational behavioral change as the vertical and horizontal axes, respectively. As shown in Figure 10, the behavioral change stages are classified into six categories based on two classifications related to the interest in immunity in mental change and three classifications of states in operational behavioral change. Candidate persuasive texts may be prepared as appropriate, and as an example, they include persuasive texts that involve raising a character (hereinafter sometimes referred to as "nurturing texts") and persuasive texts related to health behaviors (hereinafter sometimes referred to as "behavioral texts"). These nurturing texts and behavioral texts are then used according to the six classifications to which each user belongs (is classified). Note that in the example in Figure 10, the classification granularity is 2 x 3 (six levels), but this is not limited to this and may be changed as appropriate.

[0075] Specifically, in terms of mental transformation, each user is classified into two categories based on their interest in immunity (answers to questions): no interest or interest. Furthermore, users classified as having no interest in immunity in terms of mental transformation are further classified into one of three stages in behavioral change: early, middle, or late. Similarly, users classified as having interest in immunity in terms of mental transformation are also classified into one of three stages in behavioral change: early, middle, or late. In this case, the most desirable stage in behavioral change is having an interest in immunity and being in the late stage, which corresponds to the desired outcome. Persuasive text is then provided to the user that guides them to this desired outcome (stage).

[0076] Nurturing texts are associated with interest in immunity, with a higher frequency of use as persuasive texts the lower the user's interest in immunity. Therefore, users classified as having an interest in immunity in terms of mental transformation will have a higher proportion of nurturing texts compared to users classified as having no interest in immunity. On the other hand, behavioral texts are associated with the intake status of the target substance 7, with a higher proportion of use as persuasive texts in the order of early, middle, and late stages of the state. Therefore, the higher the rank of the behavioral transformation, the higher the proportion of behavioral texts.

[0077] For example, in the initial stage with no interest in immunity, developmental texts are presented for all seven days of the week. In other words, the ratio of developmental texts to behavioral texts presented per week is 7 days for developmental texts and 0 days for behavioral texts. Similarly, in the case of mental transformation classified as no interest in immunity, the ratio of developmental texts to behavioral texts presented per week is 5 days and 2 days, respectively, in the intermediate stage, and 4 days and 3 days, respectively, in the late stage.

[0078] On the other hand, when a person is classified as having an interest in immunity in terms of mental transformation, the ratio of nurturing texts to action-oriented texts presented per week is 3 days and 4 days, respectively, in the initial stage. In the same case, the ratio of nurturing texts to action-oriented texts presented per week is 2 days and 5 days, respectively, in the intermediate stage, and 0 days and 7 days, respectively, in the late stage. In other words, when a person has an interest in immunity and is in the late stage, action-oriented texts are presented for all 7 days of the week, the opposite of when a person has no interest in immunity and is in the initial stage. As an example, by using nurturing texts and action-oriented texts in this way, it is possible to provide persuasive texts that guide the person to the desired stage.

[0079] Figure 11 shows examples of character development text and action-oriented text. The character development text and action-oriented text in the example in Figure 11 are written and managed in the text data PD. As shown in Figure 11, character development text (text related to character development) includes text that promotes character development, such as "Collecting points will help your character grow." The use of each character development text may be permitted without restriction, or it may be permitted under appropriate conditions regarding its use, such as at an appropriate time. In the example in Figure 11, the remarks column shows conditions such as "Display when there are 〇 points left until level up," "Link with log," "Text displayed when level up," and "Presented at the beginning."

[0080] The conditions "Displayed when there are X points left until level up," "Level up text," and "Presented at the start" all limit the timing of display. For example, the persuasive text (training text) "You'll be able to meet a new character soon" corresponding to "No. 1" is displayed when the character being trained is X points away from leveling up, and is not displayed at any other time. Similarly, the persuasive text corresponding to "No. 17" is displayed when the character being trained levels up, and the persuasive text corresponding to "No. 29" is displayed when the user is in the initial state, and is not displayed at any other time.

[0081] On the other hand, behavioral texts (texts related to health behaviors) include texts that present information on behaviors that are thought to have a positive impact on health, such as, "Boost your immunity by eating a balanced diet. A balance of vegetables, fruits, and protein is important." In addition, each behavioral text may be associated with information such as "immunity," "health," or "food intake." This information may be the usage conditions for each behavioral text, or it may simply be a classification. As an example, such developmental texts and behavioral texts are written in text data PD and used according to each user's stage of behavioral change, etc. In this example, the developmental texts and behavioral texts in text data PD function as multiple candidate texts of the present invention. Among these, the persuasive text provided to the user as behavioral change information functions as the text information of the present invention.

[0082] (Log data structure) Next, we will explain the details of the log data LD with reference to Figure 12. Figure 12 is a diagram showing an example of the configuration of the log data LD. As shown in Figure 12, the log data LD includes a log record LDR for managing support information for each user. The log record LDR may appropriately include various types of information depending on the content of the support information to be managed. As an example, the support information includes information on the intake status of object 7 and information about the character. In this case, the log record LDR includes information such as "User ID", "Intake Status", "Response", "Points Earned", and "Character Level".

[0083] "User ID" is information that indicates a unique user ID for each user to identify each user of the intake support service. "Intake Status" is information that indicates each user's intake status. The intake status may include various information about the intake of the target substance 7 as appropriate. For example, the intake status may include information such as the number of tablets taken, the date and time, the cumulative number taken, the number of consecutive days taken, and the interval between taking the substance (this may be only a part of it as appropriate). "Answers" is information that indicates the answers to the questions included in the placement instructions. "Answers" may include answers for an appropriate period depending on the need to determine interest in immunity, etc. For example, if question information is presented daily, information on answers for one week may be described. As an example, "Answers" will include information on the answer to the most recent question (for example, the question presented on the most recent Monday).

[0084] "Points Earned" and "Character Level" are examples of information related to a character. "Points Earned" indicates the points earned by each character. "Character Level" indicates the level of the character that each character is currently leveling up. This information is recorded in the log record LDR in a way that allows it to be correlated with other information. However, the log record LDR may not be limited to these, and may include other information as appropriate depending on the content of the support information, etc. Alternatively, the above information may be omitted as appropriate.

[0085] (Network system processing) Next, with reference to Figures 13 to 16, the placement instruction processing, log acquisition processing, text display processing, and point awarding processing will be explained. The placement instruction processing is the process of notifying the user of the support application of placement instructions. As an example, the placement instruction processing is realized through the cooperation of the instruction management unit 26 of server 2 and the display control unit 34 of user terminal device 3. In Figure 13, the processing mainly executed by the instruction management unit 26 is shown as server 2, and the processing mainly executed by the display control unit 34 is shown as user terminal device 3.

[0086] When the user terminal device 3 (display control unit 34) touches the placement information button 52A on the support screen 50, it starts the placement instruction process shown in Figure 13 and first requests a placement instruction from the server 2 (step S101).

[0087] When a placement instruction is requested from the user terminal device 3, the server 2 (instruction management unit 26) starts the placement instruction processing shown in Figure 13 and first acquires the request (step S201). Next, the server 2 generates a placement instruction to be notified to the user (step S202). This generation includes the generation of specification information and question information. For example, the server 2 randomly determines the placement locations where the object 7 should be placed this time (today) according to the number of object 7 to be ingested, and generates specification information including identification information for the placement locations corresponding to the determination result. The server 2 also determines the question and answer candidates for this time while referring to the question data QD. This determination may be performed as appropriate. As an example, it is performed to be determined randomly. Then, a placement instruction including this specification information and question information is generated. However, the generation of question information is limited to a predetermined date (for example, every Monday). Outside of the predetermined date, the generation of question information is omitted, and the placement instruction does not include question information. After generating the placement instructions, Server 2 sends the generated placement instructions to User Terminal Device 3 (step S203), and then terminates the placement instruction processing.

[0088] When a placement instruction is sent from server 2, user terminal device 3 acquires the placement instruction (step S102). Subsequently, user terminal device 3 displays the acquired placement instruction on the information display unit 52 of the support screen 50. Specifically, user terminal device 3 displays a placement instruction message M2, which includes the acquired placement instruction, on the information display unit 52. After this display, user terminal device 3 terminates the placement instruction processing for this time. As a result, a placement instruction is generated that is randomly determined daily based on the touch operation of the placement information button 52A (however, question information is generated once a week), and this placement instruction is notified to the user via the placement instruction message M2 on the information display unit 52.

[0089] The log acquisition process is a process for obtaining support information based on the captured image BI of the mounting sheet 4. The log acquisition process is implemented, for example, through the collaboration of the analysis unit 23 of server 2 and the image acquisition unit 33 of user terminal device 3. In Figure 14, the processes mainly executed by the analysis unit 23 are shown as server 2, and the processes mainly executed by the image acquisition unit 33 are shown as user terminal device 3.

[0090] When the user terminal device 3 (image acquisition unit 33) touches the photo selection button 52C on the support screen 50, it starts the log acquisition process shown in Figure 14 and first gives the user an opportunity to select the photo to be sent (captured image BI) (step S301). Next, the user terminal device 3 determines whether or not a photo to be sent has been selected during the selection opportunity (step S302). If no photo to be sent has been selected during the selection opportunity (for example, if no photo has been selected and the selection opportunity is instructed to end) (step S302: No), the user terminal device 3 skips the subsequent processing and terminates the log acquisition process. On the other hand, if a photo to be sent has been selected during the selection opportunity (step S302: Yes), the user terminal device 3 sends the selected photo to be sent (image data) to the server 2 (step S303).

[0091] When a photograph is sent from the user terminal device 3, the server 2 (analysis unit 23) starts the log acquisition process shown in Figure 14 and first acquires the sent photograph (image data) (step S401). Next, the server 2 performs analysis of the acquired photograph (step S402). This analysis is performed using an image comparison algorithm, as an example, following the procedure shown in Figure 7.

[0092] Next, Server 2 determines the answer to the question based on the analysis results of step S402 (step S403). This determination is achieved by determining the answer placement location 5B which is included in the placement location 5 where the object 7 determined by the analysis in step S402 is placed. Next, Server 2 determines whether the placement location 5 where the object 7 is placed is appropriate or not based on the analysis results of step S402 (step S404). This determination is performed while referring to the designation information for today included in the placement instructions. Specifically, Server 2 determines whether the placement location 5 where the object 7 is placed is appropriate or not depending on whether it corresponds to the designated placement location 5.

[0093] If the placement location is appropriate (the placement location 5 where the object 7 is placed corresponds to the specified placement location 5) (Step S404: Yes), Server 2 obtains support information such as the date and time of intake and the response (Step S405). Then, Server 2 updates (including generation) the log data LD to reflect the obtained support information (Step S406).

[0094] On the other hand, if the placement location is inappropriate (the placement location 5 where the object 7 is placed does not correspond to the specified placement location 5) (step S404: No), or after updating the log data LD in step S406, server 2 sends the result to user terminal device 3 (step S407). If the placement location is inappropriate, the result includes information indicating an error (mismatch with the specified placement location 5). On the other hand, if the log data LD has been updated, the result includes information indicating the acquisition of support information such as completion of recording. After sending the result, server 2 terminates the log acquisition process.

[0095] Meanwhile, when the results are sent from the server 2, the user terminal device 3 acquires the results and displays them on the information display unit 52 of the support screen 50 (step S304). Specifically, the user terminal device 3 displays a message on the information display unit 52 that includes the result, such as an error or completion of recording. After this display, the user terminal device 3 terminates the log acquisition process. This allows the system to determine, based on the photograph (captured image BI) sent by the user, whether the object 7 is placed in the placement area 6 of the base sheet 4 according to the placement instructions. If the placement is incorrect, an error is notified, and the user is prompted to make the correct placement. If the placement is correct, various support information, such as answers to questions, is acquired and recorded in the log data LD.

[0096] The text display process is for displaying persuasive text according to the behavioral change stage. The persuasive text may be presented at appropriate times, for example, at predetermined times such as the first launch of the support app every Monday, or when various conditions are met, such as when a change in the behavioral change stage occurs due to the fulfillment of demotion conditions. The example in Figure 15 shows a case where persuasive text is presented to the user each time the log acquisition process in the example in Figure 14 is executed based on the captured image BI corresponding to appropriate intake. Furthermore, the text display process is realized, as an example, through the cooperation of the text management unit 25 of server 2 and the display control unit 34 of user terminal device 3. In Figure 15, the process mainly executed by the text management unit 25 is shown as server 2, and the process mainly executed by the display control unit 34 is shown as user terminal device 3.

[0097] When Server 2 (text management unit 25) finishes the log acquisition process for the example in Figure 14 based on the captured image BI corresponding to appropriate intake, it starts the text display process in Figure 15 and first acquires the latest log data LD (step S501). Next, Server 2 refers to the “answers” ​​in the acquired log data LD and determines the target user’s interest in immunity (step S502). The determination of whether or not there is interest in immunity based on the answers may be performed as appropriate. For example, answer candidates “i” to “ii” are classified as no interest, and “iii” to “v” are classified as interested. Then, each user is classified into the category (interested or not interested) to which their most recent (latest) answer belongs. If the question is presented daily, for example, if there are many answers classified as interested in a week, the user may be determined as interested, and if there are many answers classified as not interested, the user may be determined as not interested.

[0098] Next, Server 2, while referring to the “Intake Status” in the log data LD, determines the state of behavioral change to which the target user belongs (Step S503). This determination is performed according to the promotion or demotion conditions for determining the state in behavioral change. For example, Server 2 refers to the intake rate for the past 15 days and the intake rate for the past 30 days to determine whether the promotion conditions to the medium-term or late-term stage are met. Server 2 also refers to the number of consecutive days of intake, such as 4 consecutive days or 3 consecutive days, to determine whether the demotion conditions are met. Based on these promotion and demotion conditions, Server 2 determines the state to which the user belongs.

[0099] Next, Server 2 determines the behavioral change stage to which the target user belongs based on the determination results of steps S502 and S503 (step S504). This determination is performed according to two axes, as shown in Figure 10 as an example: interest in immunity (mental change) and the status of intake of the target substance 7 (behavioral change). Specifically, the behavioral change stages are classified into six stages based on two classifications: having interest in immunity and not having interest, and three states from the early to the late stage. Therefore, Server 2 determines which of these six stages the target user belongs to. Note that, as mentioned above, the classification is not limited to six, and may be set up as appropriate, for example, seven.

[0100] Next, Server 2 selects a persuasive text to present from the candidate persuasive texts in the text data PD, according to the behavioral change stage to which the target user belongs (step S505). This selection includes the selection of text types, such as developmental texts and behavioral texts, and the selection of specific targets for each type.

[0101] The selection of text types is carried out according to the distinction between developmental and behavioral texts for each of the six stages shown in Figure 10. For example, if there is no interest in immunity and the patient belongs to the initial stage, the ratio of developmental texts to behavioral texts presented per week will be set to 7 days and 0 days, respectively. The same applies to the other stages.

[0102] Furthermore, the selection of specific targets for each type, such as the specific training text to be presented when training texts are used, may also be carried out as appropriate. For example, the selection may be made according to predetermined rules, such as a predetermined order set in advance for each candidate. As an example, the selection of a specific target is carried out randomly from the candidates. In other words, Server 2 selects the type of text according to the behavioral change stage to which the target user belongs, and randomly selects a persuasive text for a specific target from the selected type of text.

[0103] Next, Server 2 sends the persuasive text selected in step S505 to User Terminal Device 3 (step S506). After this transmission, Server 2 terminates the text display process.

[0104] On the other hand, when a persuasive message is sent from server 2, user terminal device 3 starts the message display process shown in Figure 15 and first retrieves the persuasive message (step S601). Next, user terminal device 3 displays the retrieved persuasive message on the information display unit 52 of support screen 50 (step S602). Specifically, user terminal device 3 displays a message containing the retrieved persuasive message on the information display unit 52. After this display, user terminal device 3 terminates the message display process. As a result, the persuasive message to be presented is determined based on the behavioral change stage (classification according to two axes: interest in immunity and intake status) and presented to the user.

[0105] The point granting process is a process for granting points to level up the character according to the intake status of the target object 7. Points may be granted at appropriate times, for example, at the first launch of the support app every Monday, or each time the support app is launched. The example in Figure 16 shows a case where points are granted to the user each time the log acquisition process in the example in Figure 14 is executed based on the captured image BI corresponding to appropriate intake. The example in Figure 16 also shows a case where the character level is increased by updating the "character level" of the log data LD referenced in the display of the character screen 60.

[0106] When the progress management unit 24 finishes the log acquisition process for the example in Figure 14 based on the captured image BI corresponding to appropriate intake, it starts the point allocation process in Figure 16 and first acquires the latest log data LD (step S701). Next, the progress management unit 24 calculates the points to be awarded to the target user according to the intake status of the target substance 7, while referring to the "intake status" in the log data LD (step S702). The calculation of points according to the intake status may be implemented as appropriate. For example, points may be calculated according to the cumulative number of days of intake, or according to the number of consecutive days. Also, the stage of behavioral change may be reflected in the calculation of points. As an example, a predetermined amount of points is awarded for each intake of the target substance 7. For this reason, the progress management unit 24 calculates the predetermined amount of points to be awarded for the intake of the target substance 7 in the current instance, while referring to the "intake status" in the log data LD.

[0107] Next, the work-in-progress management unit 24 awards the points calculated in step S702 to the target user (step S703). This awarding is achieved by updating the "points earned" in the log data LD. Therefore, in step S703, the work-in-progress management unit 24 updates the log data LD to reflect a predetermined increase in "points earned".

[0108] Next, the task management unit 24 determines whether the amount of points earned by the target user meets the growth conditions for character growth (leveling up) (step S704). If the amount of points earned does not meet the growth conditions (step S704: No), the task management unit 24 skips the subsequent processing and terminates the point awarding process.

[0109] On the other hand, if the amount of points earned meets the growth conditions (step S704: Yes), the progress management unit 24 performs a level-up (change of level parameters) of the character being trained by the target user (step S705). A character level-up is achieved, for example, by updating the "character level" in the log data LD. Therefore, in step S705, the progress management unit 24 updates the log data LD to reflect a one-level increase in "character level" (not limited to one level; an appropriate number of levels may increase depending on how points are awarded, etc.). After this update (level-up), the progress management unit 24 terminates the point awarding process.

[0110] According to the procedure shown in Figure 16, points are awarded based on the intake of object 7, and the character levels up (grows) according to the amount of points earned. In other words, the intake of object 7 is reflected in the character's growth. This level-up (the "character level" in the log data LD) is referenced when displaying the character image 61 on the character screen 60, etc., and is shared with the user via the character image 61.

[0111] As explained above, in this configuration, the placement position 5 of the object 7 is determined based on the captured image BI of the placement area 6 in which the object 7 is placed, and support information is obtained based on that placement position 5. Therefore, the position of the object 7 to be ingested placed in the placement area 6 can be used to obtain support information. In other words, the position of the object 7 placed in the placement area 6 can be associated with secondary (ambiguous) information for obtaining support information. This makes it easier to obtain support information compared to cases where separate information input for support information is required.

[0112] For example, the placement area 6 is provided with an answer placement position 5B, and through placement there, an answer to a question is obtained as an example of support information. In other words, information as an answer to a question can be attached to the position of the object 7 placed in the placement area 6. This makes it possible to obtain various information about the user using the question and answer. Furthermore, through placement instructions that include question information, questions that reflect other circumstances such as intake status can be notified. Therefore, it is possible to obtain answers that reflect other circumstances. For example, it is possible to obtain information necessary for behavioral changes regarding the intake of the object, and in turn, promote the continuation (habituation) of intake of the object 7.

[0113] Furthermore, the object 7 is placed based on placement instructions that include designation information specifying the placement location 5 where it should be placed. In this case, the designation information can be further utilized to obtain supporting information. Specifically, since the placement location 5, which changes randomly every day, is notified as designation information, it is possible to determine whether the captured image BI is from the current day by comparing the designation information with the placement location 5 where the object 7 is placed in the captured image BI. This helps to suppress the use of inappropriate captured image BIs, such as reusing the previous captured image BI, and ultimately promotes the continuation of appropriate intake.

[0114] For example, in typical support services, intake records are obtained through user self-reporting. Therefore, it is often difficult to obtain information regarding false reports or dosage errors (e.g., taking only 3 tablets instead of the required 4). In contrast, intake support services obtain information such as the appropriateness of the image BI or the appropriateness of the intake quantity through specified information and captured image BI. This provides motivation for the user to place the target object 7 on the form 4. This, in turn, promotes intake and improves its appropriateness.

[0115] Furthermore, support information is used to provide behavioral change information. This allows users to be encouraged to consume the target substance 7 through behavioral change information. Specifically, for example, a predetermined amount of points is awarded each time that consumption of the target substance 7 is confirmed as support information (determined to be appropriate consumption based on the captured image BI). Then, character development is carried out according to the amount of points earned. In other words, behavioral change information (character-related information), such as points or character growth, is provided to the user. This allows the motivation to consume the target substance 7 to be converted into motivation to grow (develop) the character through points.

[0116] Similarly, based on their intake of support information, each user is classified into one of six behavioral change stages, and persuasive texts corresponding to that classification are provided to each user as behavioral change information (text-related information). This not only allows for direct behavioral change to be encouraged through the persuasive texts, but also allows the user's responses and intake status of the target product to be reflected in the content of the persuasive texts. As a result, more appropriate persuasive texts can be provided as behavioral change information. Consequently, this behavioral change information can encourage continued intake of the target product 7.

[0117] In the above configuration, the analysis unit 23 of server 2 functions as the location determination means and information acquisition means of the present invention by executing the process shown in Figure 14. Specifically, the analysis unit 23 functions as the location determination means by executing the procedure in step S402 of Figure 14, and as the information acquisition means by executing step S405. In addition, the instruction management unit 26 of server 2 functions as the designation notification means and question notification means of the present invention by executing step S203 of Figure 13. Furthermore, the document management unit 25 or the work-in-progress management unit 24 of server 2 functions as the information provision means of the present invention by executing step S506 of Figure 15 or step S703 of Figure 16. Similarly, the document management unit 25 functions as the document selection means of the present invention by executing step S505 of Figure 15, and the work-in-progress management unit 24 functions as the object change means of the present invention by executing step S705 of Figure 16.

[0118] The present invention is not limited to the above-described embodiment and may be implemented in a modified or altered form as appropriate. Furthermore, the present invention may be implemented in a form obtained by appropriately combining various technical means included in the above-described embodiment and the modified or altered forms described below. For example, in the above-described embodiment, the answer placement position 5B is provided in the placement area 6 separately from the simple placement position 5A. However, the present invention is not limited to this embodiment. For example, the placement area 6 may have multiple placement positions without distinction between the answer placement position 5B and the simple placement position 5A. In this case, the answer may be determined by the placement pattern of the object 7, for example, the placement pattern corresponding to the answer "i" and the placement pattern corresponding to the answer "ii". In other words, the simple placement position 5A may function as the answer placement position 5B.

[0119] In the above-described configuration, the placement instructions include question information, and answers to the questions included in the question information are required. However, the present invention is not limited to this configuration. Answers to the questions may be omitted. In other words, the analysis of the captured image BI may simply determine the appropriateness of the placement of the object 7. Furthermore, only the suppression of reuse of the captured image BI may be attempted.

[0120] In the above-described form, character development is provided from the perspective of mechanism design and gamification. However, the present invention is not limited to this form. Motivation can be transformed as appropriate. For example, various elements (interesting aspects), such as games or bonuses, may be provided depending on the consumption situation. In other words, motivation for consumption may be transformed into motivation for various elements such as games.

[0121] In the above-described configuration, Server 2 (including cases where it is composed of multiple server devices) functions as the intake support system of the present invention on its own within Network System 1. However, the present invention is not limited to this configuration. For example, User Terminal Device 3 may perform all or part of the role (various processes) of Server 2. If User Terminal Device 3 performs all of the role (for example, the processes in Figures 13 to 16), User Terminal Device 3 may function as the intake support system of the present invention on its own. In this case, User Terminal Device 3 may be used independently without being connected to Network NT. Furthermore, Server 2 may be omitted. Alternatively, if part of the role of Server 2 is performed by User Terminal Device 3, the combination of User Terminal Device 3 and Server 2 (including Network System 1) may function as the intake support system of the present invention.

[0122] Various aspects of the present invention derived from the embodiments and modifications described above are described below. In the following description, corresponding components shown in the accompanying drawings are indicated in parentheses to facilitate understanding of each aspect of the present invention, but this does not mean that the present invention is limited to the illustrated forms.

[0123] The present invention provides an intake support system (2) that supports the intake of an object by notifying information about the object to be ingested via an output device (MO), and comprises: a position determination means (23) that determines the object placement position (5) among the plurality of placement positions, which is the placement position where the object is placed, based on a captured image (BI) taken of a placement area (6) having a plurality of mutually distinguishable placement positions (5) with the object placed thereon; and an information acquisition means (23) that acquires support information for supporting the intake of the object based on the object placement position.

[0124] According to the present invention, the object placement position is determined based on a captured image of the placement area in which the object is placed, and support information is acquired based on that object placement position. Therefore, the position of the object to be ingested placed in the placement area can be used to acquire support information. In other words, the position of the object placed in the placement area can be associated with secondary (ambiguous) information for acquiring support information. This makes it easier to acquire support information compared to cases where separate information input for support information is required.

[0125] The placement location where an object should be placed may or may not be specified (it may be any location). For example, if user-selectable information is associated with each placement location, the placement location where the object should be placed may be at the user's discretion. If the placement location where the object should be placed is specified in advance, the specified placement location may be determined as appropriate. For example, the specified placement location may be determined according to various predetermined rules, such as a predetermined order. Alternatively, the specified placement location may be determined randomly. Furthermore, the specification of the placement location may be implemented as appropriate. For example, it may be specified by an image showing the placement area in which the object is placed, and instructions may be given to place it according to that image. Alternatively, if identification information is set for each placement location, it may be specified via that identification information.

[0126] Specifically, for example, in one embodiment of the intake support system of the present invention, the system includes a designation notification means (26) that notifies designation information specifying a part of the plurality of placement locations via the output device, and the information acquisition means determines whether the target placement location corresponds to a designated placement location (5) as a part of the placement location specified by the designation information, and acquires the support information if the target placement location corresponds to the designated placement location, while notifying information indicating a mismatch if the target placement location does not correspond to the designated placement location. In this embodiment, the designated placement location may be randomly selected from the plurality of placement locations for each time the target object is ingested. Furthermore, in the embodiment in which the designation information is notified, the plurality of placement locations may each be associated with identification information for identifying each other, and the identification information associated with the designated placement location may be used as the designation information. In these cases, the designation information can be further utilized to acquire support information. For example, if the placement location that changes with each intake time is notified as designation information, it is possible to determine whether or not the image is a photograph taken at the time of intake based on the designation information and the target placement location. This helps to suppress the use of inappropriate images, such as reusing images from previous shoots, and ultimately promotes the continued use of appropriate intake.

[0127] Each placement position may be configured as appropriate and may be associated with various types of information. For example, in one embodiment of the intake support system of the present invention, the plurality of placement positions include a plurality of candidate placement positions (5B) corresponding to a plurality of candidate answers to a predetermined question, and the information acquisition means may determine the answer to the question based on the partial candidate placement position when the target placement position includes a part of the plurality of candidate placement positions, and acquire the answer as at least part of the support information. In this case, the position of the object placed in the placement area can be associated with information as an answer to the question. This makes it possible to acquire various types of information about the user using the question and answer. For this reason, for example, it is possible to acquire information necessary for behavioral changes regarding the intake of the object, and thereby promote the continuation (habituation) of intake of the object.

[0128] Questions may be prepared in advance or notified. The subject matter may be any suitable ingestible substance. For example, it may be a drug or a supplement. The questions and answers may also be of appropriate content related to these various substances. For example, if the subject matter is a supplement, the questions may concern the efficacy of that supplement. Supplements may have appropriate efficacy depending on their type, etc. Therefore, the questions may also be of appropriate content corresponding to the efficacy of the supplement. For example, the questions may concern immunity. The questions may include various aspects of immunity, and may include not only knowledgeable (informational) elements but also psychological elements of the user such as interest. For example, in an embodiment in which multiple candidate placement positions are provided, an embodiment may be adopted in which a question notification means (26) that notifies the questions via the output device is provided. In this embodiment, a supplement is used as the subject matter, and the question notification means may notify a question concerning the efficacy of the supplement as the question. Furthermore, in this embodiment, the question notification means may notify a question concerning immunity as the efficacy of the supplement. In these cases, questions that reflect other circumstances, such as intake status, can be sent, allowing for responses that reflect those other circumstances.

[0129] Any suitable material may be used as the placement area. For example, the placement area may be formed on various materials such as paper, board, or iron. Alternatively, the placement area may be formed on the display surface of a display device. In other words, the placement area may be formed electronically as an image. Furthermore, various materials (including images) on which the placement area is formed may be provided to the user as appropriate. For example, the paper on which the placement area is formed may be distributed to the user free of charge or purchased by the user for a fee. For example, in one embodiment of the intake support system of the present invention, a base sheet (4) on which the plurality of placement areas are provided may be used as the placement area.

[0130] Support information may be used as appropriate. For example, support information may be recorded and managed simply as an intake log. Support information may also be used to encourage behavioral change in the user. For example, in one embodiment of the intake support system of the present invention, an information providing means (24, 25) may be adopted which provides behavioral change information, which is information that encourages the user (U) to take the target substance based on the support information, via the output device. In this case, since the user can be encouraged to take the target substance via the behavioral change information, the continuation of taking the target substance can be promoted.

[0131] Behavioral change information may be various types of information that can encourage users to consume the target object (behavioral change). For example, if a user's psychological state is understood by color, pattern, etc., and that psychological state is related to the consumption of the target object, then each placement location may be distinguished by color, etc. The psychological state may be determined by the color, etc., of the placement location where the target object is placed, and information corresponding to that psychological state may be provided as behavioral change information. Alternatively, behavioral change information may be gamified information that converts the motivation to consume the target object into other elements (e.g., collection of points, etc.). Similarly, behavioral change information may be information such as text that directly encourages behavioral change. For example, in a configuration in which support information is used to provide behavioral change information, the behavioral change information may include at least one of the following: information of a predetermined value assigned according to the support information, and text information that encourages the consumption of the target object.

[0132] The predetermined value may be utilized as appropriate. For example, the predetermined value may simply be a value to be collected. Alternatively, the predetermined value may be a value used to purchase other elements. Similarly, the predetermined value may be utilized as a value for nurturing various objects. For example, as a manner in which behavioral change information is provided, an object change means (24) may be provided, which is connected to a display device (MO) that displays an object (61), and when the behavioral change information includes information on the predetermined value, changes the parameters that define the object according to the amount of the predetermined value owned by the user. In this case, the motivation to consume the object can be converted into motivation to change the object through the predetermined value.

[0133] The text used to encourage behavioral change may be any text appropriate to the user. For example, it may be a single, fixed text (which may be changed periodically). Alternatively, it may be a text selected from multiple options. If selected from multiple options, the selection may be made as appropriate. For example, the text provided to the user may be randomly selected from multiple options, or it may be selected according to predetermined rules such as a set order. In addition, other factors such as the user's answers to questions or their intake status of the substance may be considered when selecting the text provided to the user. Intake status may be any appropriate information regarding the intake of the substance. For example, intake status may include information such as the number of times the substance was consumed, the date and time, the cumulative number of times consumed, the number of consecutive days of consumption, and the interval between consumption.

[0134] Specifically, for example, in an embodiment in which behavioral change information is provided, the system may include a text selection means (25) for selecting a text from a plurality of candidate texts when the behavioral change information includes the text information, the support information may include answers to pre-prepared questions and information on the intake status of the target substance, and the text selection means may select the text from the plurality of candidate texts based on two axes: the answers and the intake status. In this embodiment, the intake status may include at least a part of the number of times the target substance is consumed, the date and time, the cumulative number of times it is consumed, the number of consecutive days it is consumed, and the intake interval. In these cases, the text as behavioral change information can reflect the user's answers and the intake status of the target substance. Therefore, more appropriate text can be provided as behavioral change information.

[0135] Furthermore, the computer program of the present invention is configured to cause the computer (21) to function as each of the means of the above-described intake support system.

[0136] Furthermore, the control method of the present invention causes a computer (21) incorporated into an intake support system (2) that supports the intake of an object by notifying information about the object to be ingested via an output device (MO) to execute a position determination procedure for determining the object placement position (5) among the multiple placement positions, based on an image (BI) taken of a placement area (6) having a plurality of mutually distinguishable placement positions (5) with the object placed thereon, and an information acquisition procedure for acquiring support information to support the intake of the object based on the object placement position. The intake support system of the present invention can be realized by executing the computer program or control method of the present invention. [Explanation of symbols]

[0137] 2. Server (Intake Support System) 4. Mounting board 5 Location 6 Placement area 7. Object 20 Resource Recovery Systems 21. Control Unit (Computer) 23 Analysis unit (position determination means, information acquisition means) 24. Work-in-Progress Management Department (Information Provisioning Means, Object Change Means) 25. Document Management Department (Information Provision Methods, Document Selection Methods) 26 Instructions and management department (designated notification means, question notification means) 5B Answer placement position (candidate placement position) U User MO monitor (output device, display device)

Claims

1. An intake support system that supports the intake of an object by notifying information about the object to be ingested via an output device, A position determination means for determining the target placement position among the multiple placement positions, which is the placement position where the target object is placed, based on a captured image taken of a placement area having multiple mutually distinguishable placement positions with the target object placed in it, Information acquisition means for acquiring support information to support the intake of the object based on the object placement position, An intake support system equipped with the following features.

2. The system includes a designation notification means that notifies designation information specifying a portion of the plurality of placement locations via the output device, The intake support system according to claim 1, wherein the information acquisition means determines whether the target placement location corresponds to a designated placement location as a part of the placement location specified by the designated information, and acquires the support information if the target placement location corresponds to the designated placement location, while notifying information indicating a mismatch if the target placement location does not correspond to the designated placement location.

3. The intake support system according to claim 2, wherein the designated placement position is randomly selected from the plurality of placement positions for each time the target object is ingested.

4. The aforementioned multiple placement locations are each associated with identification information for identifying each other. The intake support system according to claim 2, wherein the identification information associated with the designated placement location is used as the designated information.

5. The aforementioned plurality of placement positions include a plurality of candidate placement positions corresponding to a plurality of answer candidates for a predetermined question, The intake support system according to claim 1, wherein the information acquisition means determines an answer to the question based on the partial candidate placement location when the target placement location includes a part of the plurality of candidate placement locations, and acquires the answer as at least a part of the support information.

6. The intake support system according to claim 5, further comprising a question notification means for notifying the question via the output device.

7. Supplements are used as the subject matter. The intake support system according to claim 6, wherein the question notification means notifies a question concerning the efficacy of the supplement as the question.

8. The intake support system according to claim 7, wherein the question notification means notifies the user of questions related to immunity as an efficacy of the supplement.

9. The intake support system according to any one of claims 1 to 8, wherein a base sheet having the plurality of arrangement areas is used as the arrangement area.

10. The intake support system according to any one of claims 1 to 8, further comprising an information providing means that provides behavioral change information, which is information that encourages the user to take the target substance based on the support information, via the output device.

11. The intake support system according to claim 10, wherein the behavioral change information includes at least one of information of a predetermined value assigned in accordance with the support information, and information of text that encourages the intake of the target object.

12. The intake support system according to claim 11, further comprising an object changing means connected to a display device that displays an object, which changes parameters defining the object according to the amount of the predetermined value owned by the user when the behavioral change information includes information of the predetermined value.

13. The system includes a text selection means for selecting the text from a plurality of candidate texts when the behavioral change information includes the text information. The aforementioned support information includes answers to pre-prepared questions and information on the consumption status of the subject matter. The intake support system according to claim 11, wherein the text selection means selects the text from a plurality of candidate texts based on two axes: the answer and the intake status.

14. The intake support system according to claim 13, wherein the intake status includes at least a portion of the number of times the target substance is consumed, the date and time, the cumulative number of times it is consumed, the number of consecutive days it is consumed, and the interval between times it is consumed.

15. A computer program configured to cause a computer to function as one of the means of an intake support system according to any one of claims 1 to 8.

16. A computer incorporated into an intake support system that supports the intake of an object by notifying information about the object to be ingested via an output device, A position determination procedure for determining the target placement position among the multiple placement positions, which is the placement position where the target object is placed, based on a captured image taken of a placement area having multiple mutually distinguishable placement positions with the object placed in it, An information acquisition procedure for acquiring support information to support the intake of the object based on the object placement location, A control method to execute something.

Images