Control Method, Control Device, and Program

Abstract

This control method acquires identification information for specifying a user, and genetic information about the user associated with the identification information; determines the physical constitution of the user on the basis of the acquired genetic information; determines, on the basis of the determined physical constitution, a presentation control program that controls the presentation of content to be presented on an apparatus; and associates and transmits the acquired identification information and control information that causes the apparatus to execute the determined presentation control program.

Description

Control method, control device, program, and device

[0001] The present disclosure relates to a technique for controlling information presented on a device.

[0002] In recent years, research has been conducted into technologies for presenting information suited to individual users to users. For example, Patent Literature 1 discloses an information providing system that acquires user attribute information relating to a user's age, sex, occupation, hobbies, preferences, interests, consumption behavior, etc. from a user attribute information recording device, selects information to be provided according to the user attribute information, and provides the selected information to a user terminal device.

[0003] However, the technology of Patent Document 1 does not take into consideration the constitution of each individual user, and therefore further improvement is required to enable each individual user to recognize content with high accuracy.

[0004] Japanese Patent Application Laid-Open No. 2002-351910

[0005] An object of the present disclosure is to provide a technology that enables each user to recognize content with high accuracy.

[0006] A control method according to one aspect of the present disclosure is a method for controlling a device that presents content, in which a computer acquires identification information for identifying a user and genetic information of the user associated with the identification information, determines a constitution of the user based on the acquired genetic information, determines a presentation control program for controlling the presentation of the content based on the determined constitution, and transmits the acquired identification information in association with control information that causes the device to execute the determined presentation control program.

[0007] According to the present disclosure, it is possible to allow each user to recognize content with high accuracy.

[0008] 1 is a diagram showing an example of the overall configuration of a control system according to embodiment 1 of the present disclosure. FIG. 2 is a block diagram showing an example of the configuration of a cell collection device. FIG. 3 is a block diagram showing an example of the configuration of a server. FIG. 4 is a block diagram showing an example of the configuration of a device. FIG. 5 is an explanatory diagram of SNPs. FIG. 6 is an explanatory diagram of SNP types. FIG. 7 is a flowchart showing an example of processing when the control system according to embodiment 1 of the present disclosure determines a presentation control program. FIG. 8 is a flowchart showing an example of processing when the device executes the presentation control program. FIG. 9 is a diagram showing an example of an augmented reality screen displayed on a display device. FIG. 10 is a diagram showing an augmented reality screen according to another example of the present disclosure. FIG. 11 is a diagram showing an augmented reality screen according to yet another example of the present disclosure. FIG. 12 is a flowchart showing an example of processing when the device in embodiment 2 of the present disclosure executes a presentation control program.

[0009] (Background to One Aspect of the Present Disclosure) In recent years, the speed and cost of technologies for analyzing human genes have increased. Accordingly, users can now easily undergo genetic testing at home or elsewhere. Genetic testing is a test that examines the base sequence of DNA, which contains A (adenine), T (thymine), C (cytosine), and G (guanine). DNA base sequences vary from person to person, and these differences create diversity in human constitutions. Therefore, by examining differences in DNA base sequences, it is possible to determine a person's constitution. Furthermore, by controlling the presentation of content taking into account the determined constitution, it is possible to allow each user to recognize the content with high accuracy.

[0010] However, conventionally, there has been no technique for determining a user's constitution from genetic information such as DNA base sequences and controlling the presentation of content presented on a device based on the determined constitution. For example, in the above-mentioned Patent Document 1, when providing information to a user, the user's age, gender, occupation, hobbies, preferences, interests, and consumption behavior are taken into consideration, but the user's constitution is not taken into consideration. Furthermore, while Patent Document 1 provides information according to the user's attributes, it does not control the presentation of that information. Therefore, conventional techniques are insufficient to allow individual users to accurately recognize content.

[0011] Therefore, the inventors have come up with the idea that if the presentation of content is controlled taking into account the user's constitution obtained from the analysis results of the user's genetic information, it will be possible to allow individual users to accurately recognize the content, and have thus come up with the various aspects of the present disclosure.

[0012] A control method according to one aspect of the present disclosure is a method for controlling a device that presents content, in which a computer acquires identification information for identifying a user and genetic information of the user associated with the identification information, determines a constitution of the user based on the acquired genetic information, determines a presentation control program for controlling the presentation of the content based on the determined constitution, and transmits the acquired identification information in association with control information that causes the device to execute the determined presentation control program.

[0013] According to this configuration, a user's constitution is determined based on genetic information, allowing the user's constitution to be accurately determined. Then, a presentation control program for controlling the presentation of content is determined based on the determined constitution, and control information for causing the device to execute the determined presentation control program and identification information are transmitted. This allows the device to identify the presentation control program corresponding to the identification information. This allows the device to accurately recognize content for each individual user.

[0014] In the above control method, the constitution may be a constitution related to at least one of the user's attention and memory.

[0015] According to this configuration, the presentation control program is selected based on at least one of the attention and memory of each individual user, so that each individual user can recognize the content with higher accuracy.

[0016] In the above control method, the judgment may involve determining whether the attention is low or high based on the genetic information, and the presentation control program determined when the attention is determined to be low may be a program that changes at least one of the display manner and display method of the content to make it stand out more than the presentation control program determined when the attention is determined to be high.

[0017] According to this configuration, when it is determined that the user's attention is low, the content is displayed in a more prominent display mode and / or display method than when it is determined that the user's attention is high, thereby improving the accuracy of content recognition for users with low attention.

[0018] In the above control method, the judgment may determine whether the attention is low or high, and the presentation control program determined when the attention is determined to be high may be a program that changes at least one of the display mode and display method of the content so that it does not stand out as much as the presentation control program determined when the attention is determined to be low.

[0019] According to this configuration, when it is determined that the user's attention is high, the content is displayed in a less conspicuous display mode and / or display method than when it is determined that the user's attention is low. Therefore, the content can be recognized by a highly attentive user without being bothersome.

[0020] In the above control method, the judgment may determine whether the memory is low or high, and the presentation control program determined when the memory is determined to be high may be a program that changes at least one of the display mode and display method of the content so as to increase the user's memory retention compared to the presentation control program determined when the attention is determined to be low.

[0021] According to this configuration, when it is determined that a user has a poor memory, the content is displayed in a display mode and / or a display method that promotes memory retention compared to when it is determined that the user has a good memory, thereby enabling a user with a poor memory to more reliably remember the content.

[0022] In the above control method, the change in the display mode may include at least one of a change in contrast of the content and a change in size of the content.

[0023] According to this configuration, the contrast and / or size of the content is changed, so that the content can be displayed in a way that suits the user's constitution.

[0024] In the above control method, the change in the display method may include at least one of a change in the display position of the content, a change in the display time of the content, and a change in the number of times the content is displayed.

[0025] According to this configuration, at least one of the display position, display time, and number of times of display of the content is changed, so that the content can be displayed in a manner suited to the user's constitution.

[0026] In the above control method, the device may be an augmented reality device.

[0027] According to this configuration, in an augmented reality device where the user's viewing angle is limited, it is possible to accurately present the user with appropriate information according to the user's constitution.

[0028] In the above control method, the genetic information may include information indicating a base sequence of the user's nucleic acid.

[0029] According to this configuration, the genetic information is information that indicates the base sequence of the user's nucleic acid, so that the user's constitution can be determined with high accuracy.

[0030] In the above control method, the determination may include detecting a single nucleotide polymorphism in the genetic information, and determining the constitution based on the detection result.

[0031] According to this configuration, the user's constitution is determined based on a single nucleotide polymorphism in the genetic information, so that the user's constitution can be determined with higher accuracy.

[0032] In the above control method, the control information may include the presentation control program.

[0033] According to this configuration, since the presentation control program is transmitted, it is possible to cause the device to execute the presentation control program even if the presentation control program is not stored in the device in advance.

[0034] In the above control method, the control information may include information for causing the device having a plurality of presentation control programs to execute the determined presentation control program.

[0035] According to this configuration, it is possible to cause the device to execute the presentation control program without transmitting the presentation control program.

[0036] Another aspect of the present disclosure provides a device that presents content, and includes a receiving unit that receives control information that controls the execution of a presentation control program that controls the presentation of the content, and user identification information associated with the control information; a memory that stores the control information and the identification information in association with each other, the presentation control program being determined based on the user's constitution determined from the user's genetic information; a sensor that detects surrounding users; an identification unit that identifies the identification information of the surrounding users from detection data of the sensor; and an execution unit that identifies control information corresponding to the identified identification information from the memory, and executes the presentation control program corresponding to the identified control information.

[0037] According to this configuration, control information for controlling the execution of a presentation control program determined based on a user's constitution and identification information of the user associated with the control information are stored in memory in association with each other. Then, identification information of users around the device is identified from sensor detection data, control information corresponding to the identified identification information is identified from memory, and the presentation control program corresponding to the identified control information is executed. Therefore, the device can accurately allow users around the device to recognize content.

[0038] The present disclosure can also be realized as a program that causes a computer to execute each of the characteristic configurations included in such a control method, or as a system operated by this program. Needless to say, such a computer program can be distributed on a computer-readable non-transitory recording medium such as a CD-ROM or via a communication network such as the Internet.

[0039] Note that each of the embodiments described below represents a specific example of the present disclosure. The numerical values, shapes, components, steps, and step orders shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in the independent claims that represent the highest concept are described as optional components. Furthermore, in all of the embodiments, the respective contents can be combined.

[0040] (Embodiment 1) FIG. 1 is a diagram showing an example of the overall configuration of a control system 1 according to embodiment 1 of the present disclosure. The control system 1 includes a cell collection device 100, a server 200, and an instrument 300. The cell collection device 100, the server 200, and the instrument 300 are connected to each other so that they can communicate with each other via a network NT. The network NT is, for example, a public communication line such as the Internet. The network NT may also be a local area network. The cell collection device 100 is installed, for example, in a user's home.

[0041] The cell collection device 100 is configured, for example, as a sequence decoding device also known as a DNA sequencer. The cell collection device 100 is a device that collects a user's cells and extracts the user's genetic information. The genetic information includes information indicating the base sequence of DNA contained in the user's cells. The cell collection device 100 associates the extracted genetic information with a user ID, which is the user's identification information, and transmits the information to the server 200.

[0042] The server 200 is configured as, for example, a cloud server including one or more computers. The server 200 determines the constitution of the user based on the genetic information transmitted from the cell collection device 100, determines a presentation control program suitable for the constitution, and transmits the determined presentation control program to the device 300 in association with the user ID.

[0043] The device 300 is configured as a device that presents content. The device 300 executes a presentation control program transmitted from the server 200. In this embodiment, the device 300 is configured as an augmented reality device that displays augmented reality images. In this case, the content includes the augmented reality images. The augmented reality device is, for example, a head-up display, a head-mounted display, smart glasses, or smart contact lenses. Note that these are merely examples, and the device 300 may be any device equipped with a display device that displays content, such as a smartphone, a tablet terminal, a television, or a personal computer. The device 300 may also be an electrical device equipped with a display panel (e.g., a cooking appliance). In the following description, the device 300 is assumed to be a head-up display mounted on a vehicle such as an automobile.

[0044] When the device 300 is installed in a vehicle, the cell collection device 100 may be installed in the vehicle. Alternatively, the cell collection device 100 may be installed in the device 300. Alternatively, the cell collection device 100 may be installed in an external facility that performs genetic testing.

[0045] The above is the overall configuration of the control system 1. Next, details of each component of the control system 1 will be described. Figure 2 is a block diagram showing an example of the configuration of the cell collection device 100. The cell collection device 100 includes a communication unit 110, an extraction unit 120, a collection unit 130, a memory 140, and a user ID acquisition unit 150.

[0046] The communication unit 110 is composed of a communication circuit that connects the cell collection device 100 to the network NT. The communication unit 110 transmits the genetic information extracted by the extraction unit 120 to the server 200 in association with the user ID of the user who provided the genetic information.

[0047] The collection unit 130 collects cells from the user and supplies the collected cells to the extraction unit 120 .

[0048] The extraction unit 120 includes a labeling unit, a light source, an image sensor, and a processor. The labeling unit labels the DNA of the cells collected by the collection unit 130 with fluorescent labels for each type of base (A, T, G, C). The light source irradiates the fluorescently labeled DNA with light. The image sensor detects fluorescence emitted from the DNA in response to the light from the light source. The processor generates genetic information including information indicating the base sequence of the DNA based on the fluorescence detected by the image sensor.

[0049] The memory 140 is configured as a rewritable nonvolatile storage device such as a flash memory, etc. The memory 140 stores, for example, a user ID.

[0050] The user ID acquisition unit 150 includes, for example, a communication interface for communicating with the user recognition device 400, and acquires the user ID of the user who provided the genetic information. Alternatively, the user ID acquisition unit 150 may acquire the user ID from the memory 140. Alternatively, the user ID acquisition unit 150 may acquire the user ID input by the user using an operation device (not shown).

[0051] For example, if the cell collection device 100 is implemented in an electrical device (e.g., an electric toothbrush) used by an individual user, the memory 140 can store the user ID of the user who provides the genetic information. In this case, the user ID acquisition unit 150 can acquire the user ID stored in the memory 140 as the user ID of the user who provides the genetic information.

[0052] For example, the cell collection device 100 may be mounted on an operation switch of a lighting device or the like that is frequently touched by a user. In this case, the cell collection device 100 may acquire a user ID from a user recognition device 400 provided around the operation switch.

[0053] When the user recognition device 400 detects that a user has touched an operation switch, it transmits the user ID of the user who touched the operation switch to the user ID acquisition unit 150. The user recognition device 400 may detect the user who touched the operation switch using, for example, image recognition processing. Specifically, the user recognition device 400 includes a camera, a communication unit, and a processor. The camera constantly captures images of the area around the operation switch. The processor performs image processing on the image data captured by the camera to detect whether a certain user has touched the operation switch. When the processor detects that a certain user has touched the operation switch, it executes face recognition processing to determine which user among pre-registered users the user corresponds to, and detects the user ID of the determined user as the user ID of the user who touched the operation switch. The communication unit may input the user ID detected by the processor to the user ID acquisition unit 150.

[0054] Alternatively, the user recognition device 400 may detect the user ID by fingerprint authentication. In this case, the user recognition device 400 is configured with a fingerprint authentication device provided on an operation switch.

[0055] Alternatively, the user recognition device 400 may be implemented in the device 300. In this case, the user recognition device 400 may detect the user whose cells were collected by the cell collection device 100 in response to a request for obtaining a user ID output from the user ID acquisition unit 150, and input the user ID of the user to the user ID acquisition unit 150.

[0056] When the cell collection device 100 is implemented in an electric toothbrush, the collection unit 130 can collect saliva from the user and collect cells from the collected saliva.When the cell collection device 100 is implemented in an operation switch, the collection unit 130 can collect sweat from the user and collect cells from the collected sweat.

[0057] 3 is a block diagram showing an example of the configuration of the server 200. The server 200 includes a processor 210, a memory 220, and a communication unit 230 (an example of a transmission unit). The processor 210 is configured, for example, by a CPU. The processor 210 includes an acquisition unit 211, a determination unit 212, and a decision unit 213. The acquisition unit 211 to the decision unit 213 may be realized by the processor 210 executing a predetermined program, or may be configured by dedicated hardware circuits.

[0058] The acquisition unit 211 acquires the user ID and genetic information transmitted by the cell collection device 100 via the communication unit 230. The acquisition unit 211 assigns a timestamp to the acquired genetic information, associates the time-stamped genetic information with the user ID, and stores it in the memory 220. As a result, time-series data of the genetic information for each user is accumulated in the memory 220.

[0059] The determination unit 212 determines the constitution of the user who provided the genetic information based on the genetic information acquired by the acquisition unit 211. Here, the determination unit 212 detects single nucleotide polymorphisms (SNPs) in the base sequence indicated by the genetic information and the type of the SNP, and determines the constitution of the user based on the detection results. Specifically, the determination unit 212 determines whether or not an SNP appears at a predetermined locus in the base sequence associated with the constitution to be determined. If an SNP appears at the predetermined locus, the determination unit 212 identifies the type of the SNP. Then, the determination unit 212 determines the constitution to be determined based on the identified type. For example, the determination unit 212 may determine the type of the SNP from the base pattern of the SNP located at the same locus in homologous chromosomes.

[0060] Human base sequences are 99.9% identical, with 0.1% differences present. These differences result in differences in appearance, abilities, constitution, and the like. When a difference in a base sequence occurs at a frequency of 1% or more in a human population, the difference in the base sequence is called a polymorphism. When a difference in a base sequence occurs at a frequency of 1% or less, the difference in the base sequence is called a mutation or rare variation. There are various types of polymorphisms, but one in which one base is replaced with another is an SNP. It is estimated that an SNP exists at a probability of 1 in 500 to 1,000 bases, and that there are approximately 10 million SNPs.

[0061] Fig. 5 is an explanatory diagram of SNP. In the example of Fig. 5, A in the normal gene sequence (wild type) has been mutated to G.

[0062] Humans inherit one gene sequence from each parent, and there are three possible combinations. Therefore, one SNP can have three types. Figure 6 is an explanatory diagram of SNP types. For example, in the example of Figure 5, the SNP mutation A-G has three SNP types: AA, AG, and GG.

[0063] For example, if both parents have the AG SNP type, their child will inherit one A sequence and one G sequence from each parent. Therefore, an A-G SNP mutation can have three types: AA, AG, and GG, as shown in Figure 6.

[0064] There are many SNPs, but specific SNPs have been shown to be associated with specific diseases. SNPs associated with specific diseases are called "disease-associated SNPs."

[0065] An example of a disease-associated SNP is a "metabolic-associated SNP." A "metabolic-associated SNP" is an SNP related to "metabolic syndrome." Depending on the type of this "metabolic-associated SNP," it is possible to determine whether a person has a "body constitution that is prone to gaining weight" or a "body constitution that is resistant to gaining weight."

[0066] Another example of a disease-associated SNP is an SNP related to the alcohol decomposition enzyme. The combination of GG SNP types related to the alcohol decomposition enzyme is called the GG homotype. People with this SNP type are tolerant to alcohol. The combination of AG SNP types related to the alcohol decomposition enzyme is called the AG heterotype. People with this SNP type are naturally tolerant to alcohol. The combination of AA SNP types related to the alcohol decomposition enzyme is called the AA homotype. People with this SNP type have no alcohol metabolic activity and are naturally unable to drink alcohol.

[0067] In this way, if a specific SNP and the type of that SNP are known for a certain person, the constitution of that person can be determined.

[0068] In this embodiment, the determination unit 212 determines the user's constitution, particularly the constitution related to attention and the constitution related to memory. Attention refers to the ability to concentrate on one thing and is a concept that includes concentration. Examples of genes related to attention include KIBRA and SLC6A2. KIBRA is a gene that produces a type of phosphorylated protein. When this gene is TT type or TC type, people tend to have high attention. Therefore, the determination unit 212 determines that the attention is high when KIBRA is TT type or TC type. On the other hand, when the type of KIBRA is other than TT type or TC type, the determination unit 212 determines that the attention is low.

[0069] SLC6A2 is a gene that produces a type of protein that transports neurotransmitters, and is known to be involved in the recycling of the neurotransmitter norepinephrine. When SLC6A2 is of the TT type or TC type, attention tends to be low. Therefore, the determination unit 212 determines that attention is low when SLC6A2 is of the TT type or TC type. On the other hand, the determination unit 212 determines that attention is high when SLC6A2 is of a type other than the TT type or TC type.

[0070] The determination unit 212 may perform a step-by-step evaluation of focus and concentration based on the respective determination results of KIBRA and SLC6A2. For example, if both KIBRA and SLC6A2 indicate low attentiveness, the determination unit 212 may set the evaluation value V1 of attentiveness to V1=1. Alternatively, if one of KIBRA and SLC6A2 indicates high attentiveness but the other indicates low attentiveness, the determination unit 212 may set the evaluation value V1 to V1=2. Furthermore, if both KIBRA and SLC6A2 indicate high attentiveness, the determination unit 212 may set the evaluation value V1 to V1=3.

[0071] Here, the determination unit 212 determines memory ability using both KIBRA and SLC6A2, but this is just an example, and attention may be determined using one of them. Furthermore, if there is another gene involved in attention, attention may be determined using that gene.

[0072] Genes related to memory include KIBRA, DTNBP1, and PAH. When KIBRA is TT type or TC type, people tend to have high memory. Therefore, the determination unit 212 determines that when KIBRA is TT type or TC type, the memory is high. On the other hand, when KIBRA is other than TT type or TC type, the determination unit 212 determines that the memory is low.

[0073] DTNBP1 is a gene involved in the formation of intracellular organelles. When DTNBP1 is GG type, humans tend to have poor memory. Therefore, the determination unit 212 determines that when DTNBP1 is GG type, memory is poor. On the other hand, when DTNBP1 is other than GG type, memory is good.

[0074] PAH is a gene that produces phenylalanine hydroxylase. When PAH is GG type, people tend to have poor memory. Therefore, the determination unit 212 determines that when PAH is GG type, the memory is poor. On the other hand, when PAH is other than GG type, the determination unit 212 determines that the memory is good.

[0075] The determination unit 212 may perform a stepwise evaluation of memory ability based on the respective determination results of KIBRA, DTNBP1, and PAH. For example, if all of KIBRA, DTNBP1, and PAH indicate poor memory ability, the determination unit 212 may set the evaluation value V2 of memory ability to V2 = 1. Alternatively, if any two of KIBRA, DTNBP1, and PAH indicate poor memory ability and the remaining one indicates good memory ability, the determination unit 212 may set the evaluation value V2 to V2 = 2. If any one of KIBRA, DTNBP1, and PAH indicates poor memory ability and the remaining two indicate good memory ability, the determination unit 212 may set the evaluation value V2 to V2 = 3. If KIBRA, DTNBP1, and PAH all indicate a high memory ability, the determination unit 212 may set the evaluation value V2 to V2=4.

[0076] Here, the determination unit 212 determines memory ability using all of KIBRA, DTNBP1, and PAH, but this is just one example, and memory ability may be determined using any one or two of these. Furthermore, if there are other genes involved in memory ability, memory ability may be determined using those genes.

[0077] The determination unit 213 determines one presentation control program from among a plurality of presentation control programs for controlling the presentation of content based on the constitution determined by the determination unit 212. The determination unit 213 associates the determined one presentation control program with the user ID and transmits it to the device 300 via the communication unit 230.

[0078] When the judgment unit 212 judges that the attention level is low, the determination unit 213 determines a presentation control program that changes at least one of the display mode and display method of the content so that it stands out more than when the attention level is judged to be high.

[0079] In other words, when the judgment unit 212 judges that the attention level is high, the determination unit 213 determines a presentation control program that changes at least one of the display mode and display method of the content so that it is less noticeable than when the attention level is judged to be low.

[0080] Specifically, the determination unit 213 determines a presentation control program that changes at least one of the display mode and display method of the content so that the degree of prominence increases as the value of the evaluation value V1 set by the judgment unit 212 decreases.

[0081] In addition, when the judgment unit 212 judges that the memory ability is low, the determination unit 213 determines a presentation control program that changes at least one of the display mode and display method of the content to make it stand out more than when the judgment unit 212 judges that the memory ability is high.

[0082] Specifically, the determination unit 213 determines a presentation control program that changes at least one of the display mode and display method of the content so that the degree of prominence increases as the value of the evaluation value V2 set by the judgment unit 212 decreases.

[0083] The change in the display mode includes, for example, at least one of a change in the contrast of the content and a change in the size of the content. For example, the contrast of the content against the background is set to be higher as the evaluation value V1 or V2 decreases. For example, the size of the content is set to be larger as the evaluation value V1 or V2 decreases.

[0084] The change in the display mode may be, for example, the length of the displayed character string. As described above, for example, the contrast of the content is set so that the contrast against the background becomes higher as the evaluation value V1 or the evaluation value V2 becomes lower. Also, for example, the size of the content is set so that the size becomes larger as the evaluation value V1 or the evaluation value V2 becomes lower. In addition to these, the length of the character string is set shorter as the evaluation value V1 or the evaluation value V2 becomes lower. For example, "Please be careful" is set to be shorter as "Caution".

[0085] The change in the display method includes, for example, at least one of a change in the display position of the content, a change in the display time of the content, and a change in the number of times the content is displayed. For example, the display position of the content is changed so as to be closer to the center of the user's field of view as the evaluation value V1 or V2 decreases. For example, the display time of the content is changed so as to be longer as the evaluation value V1 or V2 decreases. For example, the number of times the content is displayed is changed so as to be more frequent as the evaluation value V1 or V2 decreases.

[0086] For example, a distinction may be made between content in which at least one of the display mode and the display method is changed depending on attention and content in which at least one of the display mode and the display method is changed depending on memory. Note that this distinction may overlap for some content.

[0087] If device 300 is an in-vehicle device such as a head-up display, the content may include, for example, content related to the distance between the vehicle ahead and the vehicle itself, the vehicle's traveling speed, engine RPM, and the remaining distance to the destination. Furthermore, the content may include, for example, content guiding the driver to change lanes, content notifying the driver of road directions, and content guiding the driver to turn right or left while navigating to the destination. These contents are examples of augmented reality images.

[0088] The memory 220 is configured with a storage device such as a hard disk drive or a solid state drive. The memory 220 stores a plurality of presentation control programs. Here, the memory 220 stores the presentation control programs in association with constitution information indicating constitutions. Specifically, the memory 220 stores a plurality of presentation control programs prepared in advance according to combinations of the evaluation values ​​V1 and V2, in association with the combinations of the evaluation values ​​V1 and V2. For example, in the above example where the evaluation values ​​V1 have three values, 1 to 3, and the evaluation values ​​V2 have four values, 1 to 4, there are 12 types of presentation control programs. In this case, the 12 types of presentation control programs are stored in the memory 220 in association with the combinations of the evaluation values ​​V1 and V2. Note that the information indicating the combinations of the evaluation values ​​V1 and V2 is an example of constitution information.

[0089] Therefore, the determination unit 213 may determine a presentation control program corresponding to the combination of the evaluation value V1 and the evaluation value V2 determined by the determination unit 212 as one presentation control program.

[0090] The communication unit 230 is configured with a communication circuit that connects the server 200 to the network NT. The communication unit 230 associates the presentation control program determined by the determination unit 213 with the user ID of the user corresponding to the determined presentation control program, and transmits them to the device 300.

[0091] 4 is a block diagram showing an example of the configuration of the device 300. The device 300 includes a communication unit 310 (an example of a receiving unit), a memory 320, a sensor 330, a display device 340, a speaker 350, and a control unit 360. The communication unit 310 is configured with a communication circuit for connecting the device 300 to the network NT. The communication unit 310 receives a presentation control program and a user ID transmitted from the server 200.

[0092] The memory 320 is configured with a rewritable nonvolatile storage device such as a flash memory. The memory 320 stores the presentation control program and the user ID received by the communication unit 310 from the server 200 in association with each other. Furthermore, the memory 320 stores one or more pre-registered user features in association with the user ID. The user features include, for example, facial features and voice features.

[0093] The sensor 330 is a sensor for detecting surrounding users. In this embodiment, since the device 300 is a head-mounted display, the sensor 330 is configured by an image sensor or a microphone provided in the driver's seat of the vehicle.

[0094] The display device 340 is configured as a projection device that projects content onto the windshield of the vehicle. The display device 340 displays various content when the execution unit 362 executes a presentation control program. If the device 300 is not configured as a head-up display, the display device 340 is configured as a liquid crystal panel, an organic EL panel, or the like.

[0095] The speaker 350 outputs content made up of various sounds as a result of the execution unit 362 executing the presentation control program. That is, in this embodiment, the content includes not only images but also sounds.

[0096] The control unit 360 is configured with a processor such as a CPU, and includes an identification unit 361 and an execution unit 362. The identification unit 361 detects a user from the detection data of the sensor 330, and identifies the user ID of the detected user.

[0097] For example, if the sensor 330 is an image sensor, the identification unit 361 detects a user by performing a predetermined image recognition process on the image data, which is the detected data. The identification unit 361 then sequentially compares the facial features registered in the memory 320 with the facial images included in the image data, and identifies the user ID whose similarity is equal to or greater than a threshold and corresponds to the largest feature as the user ID of the user included in the image data.

[0098] For example, if the sensor 330 is a microphone, the identification unit 361 detects the user's voice by performing a voice recognition process on the detected sound data. Then, the identification unit 361 sequentially compares the sound data with one or more pre-registered voice features of users to identify the user ID.

[0099] Here, the process of identifying a user ID using feature amounts pre-registered in memory 320 is shown, but this is just one example. For example, the identification unit 361 may identify a user ID by inputting the detection data of the sensor 330 into a user identification model that has been generated in advance through machine learning such as a neural network.

[0100] The execution unit 362 retrieves from the memory 320 a presentation control program corresponding to the user ID identified by the identification unit 361, and executes the presentation control program, thereby presenting content in a display mode and a display method suited to the user's constitution.

[0101] 7 is a flowchart illustrating an example of a process performed by the control system 1 according to the first embodiment of the present disclosure when determining a presentation control program. For ease of explanation, this flowchart illustrates an example of a process in which one presentation control program is determined for one device 300.

[0102] In step S101, the collection unit 130 of the cell collection device 100 collects cells from a user. In step S102, the user ID acquisition unit 150 acquires the user ID of the user who collected the cells. For example, as described above, the user ID acquisition unit 150 may acquire a user ID stored in advance in the memory 140, may acquire a user ID from the user recognition device 400, or may acquire a user ID input by the user.

[0103] In step S103, the extraction unit 120 extracts genetic information from the collected cells. In step S104, the communication unit 110 associates the user ID acquired in step S102 with the genetic information extracted in step S103 and transmits them to the server 200.

[0104] In step S201, the communication unit 230 of the server 200 receives a user ID and genetic information. In step S202, the determination unit 212 determines the constitution of the user who provided the genetic information from the genetic information received in step S201. For example, the determination unit 212 may identify the user's constitution from SNPs and SNP types as described above. Here, the determination unit 212 calculates an evaluation value V1 that evaluates the constitution related to attention and an evaluation value V2 that evaluates the constitution related to memory, as described above.

[0105] In step S203, the determination unit 213 determines one presentation control program corresponding to the constitution determined in step S202 from among a plurality of presentation control programs predetermined for the device 300. Here, the determination unit 213 determines one presentation control program corresponding to the combination of the evaluation value V1 and the evaluation value V2 calculated by the determination unit 212.

[0106] In step S204, the communication unit 230 transmits the presentation control program determined in step S203 and the user ID received in step S201 to the device 300 in association with each other.

[0107] In step S301, the communication unit 310 of the device 300 receives the presentation control program and the user ID.

[0108] In step S302, the communication unit 310 associates the presentation control program and the user ID received in step S301 with each other and stores them in the memory 320.

[0109] In this way, the device 300 can acquire a presentation control program suited to the individual user's constitution.

[0110] 8 is a flowchart showing an example of processing when the device 300 executes the presentation control program. In step S401, the identification unit 361 detects a user from detection data of the sensor 330. If a user is detected (YES in step S401), the processing proceeds to step S402, and if a user is not detected (NO in step S402), the processing returns to step S401.

[0111] In step S402, the identification unit 361 identifies the user ID of the user detected in step S401. In step S403, the execution unit 362 obtains from the memory 320 a presentation control program corresponding to the user ID identified in step S402.

[0112] In step S404, the execution unit 362 executes the presentation control program acquired in step S403.

[0113] FIG. 9 is a diagram showing an example of an augmented reality screen 900 displayed on the display device 340. FIG. 10 is a diagram showing an example of an augmented reality screen 1000 displayed on the display device 340. The augmented reality screen 900 is a screen displayed for users with low attention and memory (hereinafter referred to as attention, etc.). The augmented reality screen 1000 is a screen displayed for users with high attention, etc. The augmented reality screens 900, 1000 are images in which content is superimposed on real space. Here, an augmented reality screen in which content is superimposed on real space reflected on the windshield of a vehicle is shown.

[0114] The augmented reality screens 900 and 1000 show a scene immediately before entering a left curve. In this scene, the host vehicle is traveling in the right lane of a two-lane road, and a leading vehicle is traveling ahead in the right lane. The augmented reality screen 900 includes speed content 901, following distance content 902 and 903, road direction content 904, lane guidance content 905, and guard content 906.

[0115] The speed content 901 is a numerical image indicating the value of the traveling speed of the own vehicle. The inter-vehicle distance content 902 is a numerical image indicating the value of the inter-vehicle distance between the own vehicle and a preceding vehicle. The inter-vehicle distance content 903 is composed of a plurality of rectangular object images arranged according to the inter-vehicle distance. The road direction content 904 is an object image representing the shape of the road around the current location as viewed from above. In this case, since there is a left curve ahead, the road direction content 904 includes a road image with a tip curved to the left. The lane guidance content 905 is a curved arrow image urging the driver to change lanes. In this case, an arrow image guiding the driver to change lanes from the right lane to the left lane is displayed as the lane guidance content 905. The guard content 906 is content indicating that the own vehicle is approaching a curve. In this case, since the own vehicle is approaching a left curve, a wall-like image standing on the right side of the road and conforming to the shape of the road is displayed as the guard content 906.

[0116] These contents are also displayed on the augmented reality screen 1000. The augmented reality screen 900 is a screen displayed for users with low attention spans, etc. Therefore, the speed content 901, the following distance content 902, and the road direction content 904 are displayed in a larger size and closer to the center of the user's field of view than on the augmented reality screen 1000. Note that, since the driver's field of view on the windshield can be known in advance, the presentation control program can adjust the display position of the content according to the field of view by specifying the display position of the content.

[0117] Furthermore, the following distance content 903, the road direction content 904, and the guard content 906 are displayed in colors that have a higher contrast with the background than the augmented reality screen 1000. However, this is just one example, and all of the content included in the augmented reality screen 900 may be displayed in colors that have a higher contrast with the background than the augmented reality screen 1000.

[0118] In this way, on the augmented reality screen 900, the content is displayed in a larger size overall, closer to the center of the field of view, and with high contrast, compared to the augmented reality screen 1000. This allows a user with low attention span to accurately recognize the content.

[0119] On the other hand, on the augmented reality screen 1000, the content is displayed in a smaller size overall, closer to the edge of the field of view, and with lower contrast than on the augmented reality screen 900. This allows a user with high levels of attention to be able to recognize the content while minimizing annoyance.

[0120] In Figures 9 and 10, there is no distinction between content (hereinafter referred to as first content) whose display mode and display method (hereinafter referred to as display mode, etc.) change depending on attention and content (hereinafter referred to as second content) whose display mode, etc. change depending on memory ability, but the first content and the second content may be distinguished.

[0121] For example, the first content may be the following distance content 903, the road direction content 904, the lane guidance content 905, and the guard content 906, and the remaining content may be the second content. In this case, the display mode, etc. of the first content is changed according to the evaluation value V1, and the display mode, etc. of the second content is changed according to the evaluation value V2.

[0122] Since the second content relates to memory, it may be content that contains a large amount of information and is difficult to remember intuitively, such as text. For example, a task list that displays tasks that the user should perform when returning home may be adopted as the second content.

[0123] Furthermore, an image showing vehicle shaking may be displayed as content on the augmented reality screens 900 and 1000. In this case, the image showing vehicle shaking may be displayed more frequently when the level of attention is low than when the level of attention is high. An example of content whose display count may be changed is content that prompts the driver to turn left or right while navigating to a destination. When the level of attention is low, the content that prompts the driver to turn left or right is displayed more frequently than when the level of attention is high.

[0124] Furthermore, if the guard content 906 is content that is displayed for a certain period of time just before entering a curve, the guard content 906 may be displayed for a longer period of time when the driver's attention level is low compared to when the driver's attention level is high. This mode of changing the display time is not limited to the guard content 906, but can be applied to any content that is displayed for a certain period of time at a certain timing depending on the driving scene. For example, suppose that content that encourages the driver to turn left or right is displayed during navigation to a destination. In this case, this content may be displayed for a longer period of time when the driver's attention level is low compared to when the driver's attention level is high.

[0125] Fig. 11 is a diagram illustrating an augmented reality screen 1100 according to another example of the present disclosure. Fig. 12 is a diagram illustrating an augmented reality screen 1200 according to yet another example of the present disclosure. The augmented reality screens 1100 and 1200 are screens displayed when the device 300 is smart glasses or smart contact lenses. The augmented reality screens 1100 and 1200 show a scene in which a user wearing smart glasses or smart contact lenses is riding a bicycle. In this scene, another bicycle is riding ahead on the right side.

[0126] The augmented reality screen 1100 includes heart rate content 1101, incline content 1102, calorie content 1103, and remaining distance content 1104. The heart rate content 1101 is a numerical image indicating the user's current heart rate. The incline content 1102 is a numerical image indicating the incline angle of the road on which the user is traveling. The calorie content 1103 is a numerical image indicating the calories burned from the start of traveling to the present. The remaining distance content 1104 is a numerical image indicating the remaining distance to the destination. These contents are also displayed on the augmented reality screen 1200. The augmented reality screen 1100 is a screen displayed for users with low attention levels, etc. The augmented reality screen 1200 is a screen displayed for users with high attention levels, etc. Therefore, on the augmented reality screen 1100, the heart rate content 1101, incline content 1102, calorie content 1103, and remaining distance content 1104 are displayed larger and closer to the center of the user's field of view than on the augmented reality screen 1200. Since the user's main viewpoint on the smart glasses or smart contact lenses can be known in advance, the presentation control program can adjust the display position of the content according to the field of view by specifying the display position of the content.

[0127] On the other hand, on the augmented reality screen 1200, the content is displayed in a smaller size overall and closer to the edge of the field of view than on the augmented reality screen 1100. This allows a user with a high level of attention to be able to recognize the content while minimizing annoyance.

[0128] As described above, according to the present embodiment, the user's constitution is determined based on genetic information, allowing the user's constitution to be accurately determined. Then, based on the determined constitution, one presentation control program is selected from among multiple presentation control programs that control the presentation of content presented on device 300, and the selected presentation control program and the user ID are transmitted to device 300. This allows device 300 to identify the presentation control program corresponding to the user ID. This allows device 300 to accurately recognize content for each individual user.

[0129] (Embodiment 2) In embodiment 1, the server 200 transmits the presentation control program to the device 300 in association with a user ID. In embodiment 2, the server 200 transmits control information for executing the presentation control program to the device 300. Note that in this embodiment, the same components as those in embodiment 1 are given the same reference numerals, and descriptions thereof will be omitted. Also, the block diagram in embodiment 1 is reused.

[0130] See Fig. 3. In this embodiment, the determination unit 213 of the server 200 determines one presentation control program from among the plurality of presentation control programs based on the constitution determined by the determination unit 212, and transmits control information for executing the determined presentation control program to the device 300 via the communication unit 230 in association with the user ID. The control information includes, for example, constitution information indicating the constitution of the user determined by the determination unit 212. The constitution information includes information combining an evaluation value V1 related to attention and an evaluation value V2 related to memory calculated by the determination unit 212.

[0131] 4. In this embodiment, the memory 320 of the device 300 stores a plurality of presentation control programs each associated with constitutional information in advance. The memory 320 further stores the control information (including constitutional information) transmitted from the server 200 in association with the user ID.

[0132] The execution unit 362 acquires from the memory 320 a presentation control program associated with the constitution information corresponding to the user ID identified by the identification unit 361, and executes the acquired presentation control program.

[0133] 13 is a flowchart illustrating an example of processing performed by the control system 1 according to the second embodiment of the present disclosure. In this flowchart, the same processes as those in FIG. 7 are denoted by the same reference numerals, and descriptions thereof will be omitted.

[0134] In step S1101 following step S203, the communication unit 230 transmits to the device 300 the control information for executing the presentation control program determined in step S203 and the user ID.

[0135] In step S1102, the communication unit 310 of the device 300 receives the user ID and control information. In step S1103, the communication unit 310 stores the received user ID and control information in the memory 320 in association with each other.

[0136] 14 is a flowchart illustrating an example of processing when the device 300 according to the second embodiment of the present disclosure executes a presentation control program. In FIG. 14, the same processing steps as those in FIG. 8 are denoted by the same processing numbers, and descriptions thereof will be omitted.

[0137] In step S1201 following step S402 , the execution unit 362 obtains, from the memory 320 , control information corresponding to the user ID identified by the identification unit 361 .

[0138] In step S1202, the execution unit 362 obtains from the memory 320 a presentation control program corresponding to the constitution information included in the control information, and executes the obtained presentation control program.

[0139] Thus, according to the second embodiment, multiple presentation control programs are stored in advance in the device 300 in association with constitution information, and therefore the server 200 can cause the device 300 to execute a presentation control program suitable for the user's constitution without transmitting the presentation control program to the device 300.

[0140] (Modifications) The present disclosure can employ the following modifications.

[0141] (1) In the first and second embodiments, the device 300 is an in-vehicle device, but the present disclosure is not limited to this. The device 300 may also be a work support device that provides various guidance to workers on a factory production line. In this case, the content may include, for example, a marker image indicating the installation position of an assembly part, a guidance image indicating a work procedure, a guidance message indicating the work procedure, or an alert image indicating an error in the work procedure. Furthermore, if the device 300 is configured as a mobile terminal such as a smartphone, the device 300 may be used to navigate a walking route for a pedestrian.

[0142] 9 to 12, all objects displayed on the augmented reality screen are subject to control, but the present disclosure is not limited to this, and only some of the objects may be subject to control. Furthermore, the number of contents whose display modes and display methods are changed may be increased as attention decreases.

[0143] (3) In the first and second embodiments, the presentation control program associated with a constitution such as low attention span may output sound content from the speaker 350 in addition to image content. For example, when informing a user of a left or right turn during navigation to a destination, the presentation control program may output a voice message or sound effect instructing the user to turn left or right in addition to an image of content indicating a left or right turn for a user with low attention span and low memory. On the other hand, for a user with high attention span and high memory, only the image of content indicating a left or right turn may be displayed.

[0144] (4) In the first and second embodiments, the server 200 acquires genetic information from the cell collection device 100 installed in the user's home, but the present disclosure is not limited to this. For example, the server 200 may acquire the user's genetic information measured by an external organization together with the user's user ID.

[0145] (5) In the present disclosure, the method for determining SNPs and SNP types is not limited to the above-described methods, and may include, for example, RFLP (Restriction Fragment Length Polymorphism), SSCP (Single Strand Conformation Polymorphism), SSCP, TaqMan PCR, SNaP Shot, Invader, mass spectrometry, and methods using DNA microarrays. When these methods are used, the genetic information may include information indicating the SNPs and the SNP types.

[0146] For example, when a method using a DNA microarray is employed, the cell collection device 100 is configured with a DNA microarray. In this case, the cell collection device 100 transmits information regarding specific SNPs and the type of SNPs from the collected cells as genetic information to the server 200. The determination unit 212 of the server 200 determines the constitution of the user from the SNPs and the type of SNPs included in the genetic information.

[0147] (6) Although the cell collection device 100, the server 200, and the device 300 are separate devices in the present disclosure, they may be configured as a single device. In this case, "transmitting the acquired identification information and control information for causing the device to execute the determined presentation control program in association with each other" means that the identification information and control information are transmitted in association with each other within the single device.

[0148] (7) In the first and second embodiments, one presentation control program is selected from a plurality of presentation control programs. However, the present disclosure is not limited to this.

[0149] According to the present disclosure, the presentation of content is controlled according to the user's physical constitution, which is particularly useful for augmented reality devices with limited field of view.

Claims

1. A method for controlling a device that presents content, comprising: a computer acquiring identification information for identifying a user and genetic information of the user associated with the identification information; determining a constitution of the user based on the acquired genetic information; determining a presentation control program for controlling the presentation of the content based on the determined constitution; and transmitting the acquired identification information in association with control information for causing the device to execute the determined presentation control program.

2. The control method according to claim 1, wherein the constitution is a constitution relating to at least one of the user's attention and memory.

3. The control method of claim 2, wherein the determination involves determining whether the attention is low or high based on the genetic information, and the presentation control program determined when the attention is determined to be low is a program that changes at least one of the display mode and display method of the content to make it stand out more than the presentation control program determined when the attention is determined to be high.

4. A control method as described in claim 2 or 3, wherein the judgment determines whether the attention is low or high, and the presentation control program determined when the attention is determined to be high is a program that changes at least one of the display mode and display method of the content so that it does not stand out as much as the presentation control program determined when the attention is determined to be low.

5. A control method according to any one of claims 2 to 4, wherein the determination determines whether the memory is low or high, and the presentation control program determined when the memory is determined to be high is a program that changes at least one of the display mode and display method of the content so as to increase the user's memory retention compared to the presentation control program determined when the attention is determined to be low.

6. A control method according to any one of claims 3 to 5, wherein the change in the display mode includes at least one of a change in the contrast of the content and a change in the size of the content.

7. A control method according to any one of claims 3 to 6, wherein the change in the display method includes at least one of a change in the display position of the content, a change in the display time of the content, and a change in the number of times the content is displayed.

8. The control method according to any one of claims 1 to 7, wherein the device is an augmented reality device.

9. A control method according to any one of claims 1 to 8, wherein the genetic information includes information indicating the base sequence of the user's nucleic acid.

10. The control method according to any one of claims 1 to 9, wherein the determination comprises detecting a single nucleotide polymorphism in the genetic information, and determining the constitution based on the detection result.

11. A control method according to any one of claims 1 to 10, wherein the control information includes the presentation control program.

12. A control method according to any one of claims 1 to 11, wherein the control information includes information for causing the device having a plurality of presentation control programs to execute the determined presentation control program.

13. A control device for a device that presents content, wherein a computer is provided with: an acquisition unit that acquires identification information for identifying a user and genetic information of the user associated with the identification information; a judgment unit that determines the constitution of the user based on the acquired genetic information; a decision unit that determines a presentation control program that controls the presentation of the content based on the determined constitution; and a transmission unit that associates the acquired identification information with control information that causes the device to execute the determined presentation control program and transmits the associated information.

14. A program for causing a computer to execute a method for controlling a device that presents content, the program causing the computer to: acquire identification information for identifying a user and genetic information of the user associated with the identification information; determine a constitution of the user based on the acquired genetic information; determine a presentation control program for controlling the presentation of the content based on the determined constitution; and transmit the acquired identification information in association with control information for causing the device to execute the determined presentation control program.

15. A device for presenting content, comprising: a receiving unit that receives control information for controlling the execution of a presentation control program that controls the presentation of the content and user identification information associated with the control information; the presentation control program being determined based on the user's constitution determined from the user's genetic information; a memory that stores the control information and the identification information in association with each other; a sensor for detecting surrounding users; an identifying unit that identifies the identification information of the surrounding users from detection data of the sensor; and an executing unit that identifies control information corresponding to the identified identification information from the memory and executes the presentation control program corresponding to the identified control information.

Images