Necklace-type terminal and data processing system

Abstract

We provide a necklace-type terminal and data processing system that maintain a comfortable surrounding environment for the user. [Solution] The necklace-type terminal comprises a data collection unit that collects the wearer's biometric data and environmental data including the temperature, light intensity, and color tone of the wearer's surroundings; a processing unit that performs specific processing using the biometric data, environmental data, and a specific algorithm that evaluates the wearer's comfort level with respect to the surrounding environment, including the air conditioning and brightness around the wearer; and a communication unit that transmits the results of the specific processing to an air conditioning device that provides air conditioning for the indoor space where the wearer is located and a lighting device that illuminates the indoor space. The processing unit performs processing to calculate air conditioning settings and lighting settings that take into account the wearer's physical condition, temperature, light intensity, and color tone as specific processing, and the communication unit transmits control signals corresponding to the air conditioning settings and lighting settings to the air conditioning device and lighting device as a result of the specific processing.

Description

Technical Field

[0001] The technology of the present disclosure relates to a necklace-type terminal and a data processing system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, there is room for improvement in maintaining a comfortable ambient environment for the user.

Means for Solving the Problems

[0005] A first aspect of the technology of this disclosure is a necklace-type terminal comprising: a data collection unit that collects the wearer's biometric data and environmental data including temperature, light intensity, and color tone around the wearer; a processing unit that performs a specific processing using the biometric data, the environmental data, and a specific algorithm that evaluates the wearer's comfort level with respect to the surrounding environment, including air conditioning and brightness around the wearer; and a communication unit that transmits the results of the specific processing to an air conditioning device that provides air conditioning for the indoor space where the wearer is located and a lighting device that illuminates the indoor space, wherein the processing unit performs a process to calculate air conditioning settings and lighting settings that take into account the wearer's physical condition, temperature, light intensity, and color tone as the specific processing, and the communication unit transmits control signals corresponding to the air conditioning settings and lighting settings to the air conditioning device and the lighting device as the result of the specific processing.

[0006] A second aspect of the technology of the present disclosure is a necklace-type terminal of the first aspect, wherein the processing unit calculates the air conditioning settings and lighting settings by inputting a prompt message to a generating AI model instructing it to calculate the air conditioning settings and lighting settings based on the biometric data and environmental data, taking into account the wearer's physical condition, temperature, light intensity, and color tone.

[0007] A third aspect of the technology of the present disclosure is a necklace-type terminal of the first aspect, comprising an emotion engine that estimates emotions contained in speech uttered by the wearer toward the surrounding environment, wherein the processing unit calculates the air conditioning settings and lighting settings taking into account the emotions, the wearer's physical condition, the temperature, the amount of light, and the color tone.

[0008] A fourth aspect of the technology of this disclosure is a necklace-type terminal of the third aspect, wherein the processing unit inputs a prompt message to a generating AI model instructing it to propose air conditioning settings and lighting settings suitable for the wearer's physical condition based on the biometric data and the environmental data, thereby determining the content of the utterance that proposes the air conditioning settings and lighting settings suitable for the wearer's physical condition, and the communication unit generates information to reproduce the determined utterance.

[0009] A fifth aspect of the technology of the present disclosure is a necklace-type terminal of the fourth aspect, wherein the processing unit uses a generating AI model to adjust the speech content based on the emotions contained in the speech made by the wearer regarding the air conditioning settings and lighting settings after the speech content has been reproduced, and the communication unit generates information for reproducing the adjusted speech content.

[0010] A sixth aspect of the technology of the present disclosure is a data processing system comprising: an input unit that inputs biometric data of a wearer wearing the necklace-type terminal, detected by a sensor included in the necklace-type terminal, and environmental data including temperature, light intensity, and color tone around the wearer; a processing unit that performs a specific processing using the biometric data, the environmental data, and a specific algorithm that evaluates the wearer's comfort level with respect to the surrounding environment, including air conditioning and brightness around the wearer; and an output unit that transmits the results of the specific processing to an air conditioning device that provides air conditioning for the indoor space where the wearer is located and a lighting device that illuminates the indoor space, wherein the processing unit performs a process to calculate air conditioning settings and lighting settings considering the wearer's physical condition, temperature, light intensity, and color tone as the specific processing, and the output unit transmits control signals corresponding to the air conditioning settings and lighting settings to the air conditioning device and the lighting device as the result of the specific processing.

[0011] A seventh aspect of the technology of this disclosure is a data processing system of the sixth aspect, wherein the processing unit calculates the air conditioning settings and lighting settings by inputting a prompt message to a generating AI model instructing it to calculate the air conditioning settings and lighting settings based on the biometric data and environmental data, taking into account the wearer's physical condition, the temperature, the light intensity, and the color tone.

[0012] An eighth aspect of the technology of the present disclosure is a data processing system of the sixth aspect, comprising an emotion engine that estimates emotions contained in speech uttered by the wearer toward the surrounding environment, wherein the processing unit calculates the air conditioning settings and lighting settings taking into account the emotions, the wearer's physical condition, the temperature, the light intensity, and the color tone.

[0013] A ninth aspect of the technology of this disclosure is a data processing system of the eighth aspect, wherein the processing unit inputs a prompt message to a generating AI model instructing it to propose air conditioning settings and lighting settings suitable for the wearer's physical condition based on the biometric data and the environmental data, thereby determining the content of the utterance that proposes the air conditioning settings and lighting settings suitable for the wearer's physical condition, and the output unit generates information to reproduce the determined utterance.

[0014] A tenth aspect of the technology of this disclosure is a data processing system of the ninth aspect, wherein the processing unit uses a generating AI model to adjust the speech content based on the emotions contained in the speech made by the wearer regarding the air conditioning settings and lighting settings after the speech content has been reproduced, and the output unit generates information for reproducing the adjusted speech content. [Brief explanation of the drawing]

[0015] [Figure 1] Figure 1 is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] Figure 2 is a conceptual diagram showing an example of the main functions of a data processing device and a necklace-type terminal according to the first embodiment. [Figure 3] Figure 3 is a side view showing the configuration of a necklace-type terminal according to the first embodiment. [Figure 4] Figure 4 is a top view showing the configuration of a necklace-type terminal according to the first embodiment. [Figure 5] Figure 5 is a schematic diagram showing the functional configuration of the control unit of the necklace-type terminal according to the first embodiment. [Figure 6]FIG. 6 is a diagram schematically showing a functional configuration of a specific processing unit of a data processing apparatus according to the first embodiment. [Figure 7] FIG. 7 is a diagram schematically showing an example of an operation flow of specific processing by the data processing apparatus according to the first embodiment. [Figure 8] FIG. 8 is a conceptual diagram showing an example of a configuration of a data processing system according to the second embodiment. [Figure 9] FIG. 9 is a conceptual diagram showing an example of main functions of a data processing apparatus and a necklace-type terminal according to the second embodiment. [Figure 10] FIG. 10 is a diagram schematically showing a functional configuration of a control unit of a necklace-type terminal according to the second embodiment. [Figure 11] FIG. 11 is a diagram showing a sequence chart of specific processing by the data processing apparatus according to the second embodiment. [Figure 12] FIG. 12 is a conceptual diagram showing an example of a configuration of a data processing system according to the third embodiment. [Figure 13] FIG. 13 is a conceptual diagram showing an example of main functions of a data processing apparatus and a necklace-type terminal according to the third embodiment. [Figure 14] FIG. 14 is a diagram schematically showing a functional configuration of a control unit of a necklace-type terminal according to the third embodiment. [Figure 15] FIG. 15 is a diagram showing a sequence chart of specific processing by the data processing apparatus according to the third embodiment. Embodiments for Carrying Out the Invention

[0016] Hereinafter, an example of an embodiment of a data processing apparatus, a data processing method, and a program according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), or an APU (Accelerated Processing Unit).

[0019] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0020] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0023] [First Embodiment] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 may include a data processing device 12 and a necklace-type terminal 14. An example of the data processing device 12 is a server. In the first embodiment, the data processing device 12 is an example of a "data processing device" according to the technology of this disclosure, and the necklace-type terminal 14 is an example of a "necklace-type terminal" according to the technology of this disclosure.

[0025] The data processing device 12 may include a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 may include a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 may be connected to a bus 34. The database 24 and the communication interface 26 may also be connected to the bus 34. The communication interface 26 may be connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The necklace-type terminal 14 may include a computer 36, a microphone 38, a sensor 39, a speaker 40, a camera 42, and a communication interface 44. The computer 36 may include a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 may be connected to a bus 52. The microphone 38, speaker 40, and camera 42 may also be connected to a bus 52.

[0027] The user 20 wearing the necklace-type terminal 14 may be, for example, a patient whose health condition is being diagnosed, or a regular user.

[0028] The microphone 38 picks up the voice emitted by the user 20, who is wearing the necklace-type terminal 14, as well as sounds around the user 20. The microphone 38 also receives instructions from the user 20 by receiving the voice emitted by the user 20. The microphone 38 captures the voice emitted by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 40 outputs audio according to the instructions from the processor 46. The speaker 40 is, for example, a directional speaker and outputs audio towards the user 20's ears.

[0029] Sensor 39 is a sensor that detects biometric data of user 20, the wearer of the necklace-type terminal. For example, sensor 39 is a heart rate sensor or a blood oxygen sensor. Sensor 39 may also detect environmental data. Environmental data may include, for example, the color tone of light and at least one of the light intensity. For example, if user 20 is reading in the living room of a house, sensor 39 may detect the color tone and light intensity of the light emitted from the lighting device illuminating user 20 and the area around user 20. The color tone may be detected by, for example, a color sensor, which may output color data consisting of each signal component of RGB as environmental data. The light intensity may be detected by a light intensity sensor that detects the light intensity of the photographic light as the measured light intensity in the photographic optical system.

[0030] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0031] Communication I / F 44 may be connected to network 54. Communication I / F 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the necklace-type terminal 14.

[0033] As shown in Figure 2, in the data processing device 12, specific processing is performed by the processor 28. The storage 32 stores a specific processing program 56. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58. The data generation model 58 is used for specific processing in the specific processing unit 290. The storage 32 also includes a data storage unit 54.

[0035] In the necklace-type terminal 14, data acquisition processing is performed by the processor 46. The storage 50 stores the data acquisition program 60. The processor 46 reads the data acquisition program 60 from the storage 50 and executes the read data acquisition program 60 on the RAM 48. The data acquisition processing is realized by the processor 46 operating as a control unit 46A according to the data acquisition program 60 executed on the RAM 48.

[0036] As shown in Figures 3 and 4, the necklace-type terminal 14 may include a plurality of microphones 38, a plurality of sensors 39, a plurality of speakers 40, and a plurality of cameras 42. Figures 3 and 4 show an example in which two microphones 38 are positioned on the front side of the user 20 when the user 20 wears the necklace-type terminal 14. Also shown is an example in which two sensors 39 are positioned on the right and left sides of the user 20 when the user 20 wears the necklace-type terminal 14. An example is shown in which two speakers 40 are positioned on the right rear and left rear sides of the user 20 when the user 20 wears the necklace-type terminal 14. An example is shown in which two cameras 42 are positioned on the right front and left front sides of the user 20 when the user 20 wears the necklace-type terminal 14. An example is shown in which two sensors 39 are positioned inside the necklace-type terminal 14 so as to contact the user 20's neck when the user 20 wears the necklace-type terminal 14.

[0037] Next, we will explain the processing of the control unit 46A when the necklace-type terminal 14 performs data collection processing to collect data.

[0038] In the data collection process of the first embodiment, the user's biometric data is collected in real time. In addition to biometric data, all surrounding environment data of the user is also collected. This makes it possible to detect early signs of conditions such as Alzheimer's disease and dementia. It also allows for monitoring of the user's health condition (e.g., heart disease).

[0039] The control unit 46A may include a data acquisition unit 100 and a communication unit 102, as shown in Figure 5.

[0040] The data acquisition unit 100 collects the outputs of the microphone 38, sensor 39, and camera 42, respectively.

[0041] The communication unit 102 transmits the outputs of the microphone 38, sensor 39, and camera 42, which are collected by the data acquisition unit 100, to the data processing unit 12.

[0042] Next, we will describe the processing of the specific processing unit 290 when the data processing device 12 performs specific processing to obtain a response corresponding to a user utterance.

[0043] In the specific processing in the first embodiment, a response corresponding to the user utterance picked up by the microphone 38 of the necklace-type terminal 14 is obtained using the data generation model 58.

[0044] The specific processing unit 290 may include an input unit 292, a processing unit 294, and an output unit 296, as shown in Figure 6.

[0045] The input unit 292 stores the outputs of the microphone 38, sensor 39, and camera 42, respectively, received from the necklace-type terminal 14, in the data storage unit 54.

[0046] The input unit 292 acquires user utterances received by the necklace-type terminal 14. Specifically, it acquires user utterances picked up by the microphone 38 of the necklace-type terminal 14.

[0047] The processing unit 294 performs specific processing using the data generation model 58. Specifically, it inputs a prompt including user utterances to the data generation model 58 and obtains a generation result. At this time, the outputs of the sensor 39 and camera 42 collected by the data acquisition unit 100 may also be included in the prompt.

[0048] The output unit 296 transmits the result of the specific processing to the necklace-type terminal 14. In the necklace-type terminal 14, the control unit 46A causes the speaker 40 to output the result of the specific processing. In this way, a response corresponding to the user utterance picked up by the microphone 38 is output to the user 20 by the speaker 40. The microphone 38 further acquires the user utterance in response to the result of the specific processing. The control unit 46A transmits the audio data indicating the user utterance acquired by the microphone 38 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the user utterance.

[0049] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0050] The outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 54 are used, for example, to diagnose the health status of user 20. In this case, the outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 54 may be transmitted to a terminal on the medical institution's side. Alternatively, the data processing device 12 may analyze the outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 54 to diagnose the health status of user 20.

[0051] Next, the operation of the data processing system 10 will be explained.

[0052] First, let's explain an example of the data collection process flow.

[0053] When user 20 is wearing the necklace-type terminal 14, the data acquisition unit 100 sequentially collects the outputs of the microphone 38, sensor 39, and camera 42. The communication unit 102 sequentially transmits the outputs of the microphone 38, sensor 39, and camera 42 collected by the data acquisition unit 100 to the data processing unit 12.

[0054] Next, an example of the flow of a specific process will be explained with reference to Figure 7. Here, the input unit 292 of the data processing device 12 sequentially acquires the outputs of the microphone 38, sensor 39, and camera 42 received from the necklace-type terminal 14 and stores them in the data storage unit 54.

[0055] In step S300, the processing unit 294 determines whether a predetermined trigger condition is met. Specifically, the trigger condition may be that the user utterance picked up by the microphone 38 contains a specific word (for example, the name of the agent installed in the necklace-type terminal 14) or a phrase (for example, "Hi! XX" (where XX is the name of the agent)).

[0056] If the trigger condition is met in step S300 (step S300; Yes), the data processing system 10 proceeds to step S301. On the other hand, if the trigger condition is not met in step S300 (step S300; No), the data processing system 10 terminates the specific processing.

[0057] In step S301, the processing unit 294 generates a prompt by adding an instruction to obtain the result of a specific process to the text representing the user utterance picked up by the microphone 38.

[0058] For example, a prompt such as "The user is speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech) can be generated. Alternatively, the outputs of sensor 39 and camera 42 can be added to the prompt to generate a prompt such as "This is biometric data representing the user's heart rate and video data representing the user's surroundings. The user is also speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech)

[0059] In step S303, the processing unit 294 inputs the generated prompt to the data generation model 58 and obtains the result of a specific process based on the output of the data generation model 58.

[0060] In step S304, the output unit 296 outputs the result of the specific processing to the necklace-type terminal 14 and terminates the specific processing.

[0061] [Second Embodiment] (Premise and problems of the second embodiment) The indoor environment that a user finds comfortable can vary greatly depending on the user's physical condition and surrounding environment at any given time. For example, it is said that the lighting before going to bed should not be too bright, and spending the 1-2 hours before going to bed with only soft lighting such as indirect lighting allows the parasympathetic nervous system to become dominant, making it easier to fall asleep. If there are no lighting fixtures suitable for sleep, such as indirect lighting, it is recommended to adjust the lighting to about half of the usual brightness by dimming the lights or turning off some of the lighting fixtures. On the other hand, it is said that the human body has a mechanism to allow the brain and body to rest by lowering the core body temperature in a short period of time when falling asleep. For example, even if the room temperature and humidity are set appropriately in the early morning or during the day when the user starts their activities, such an air-conditioned environment can interfere with the user's deep sleep. Therefore, if a user continues to live in an indoor environment with the same brightness as during the day, and in an air-conditioned environment that promotes sympathetic nervous system activity, right up until bedtime, they may have difficulty falling asleep or experience shallow sleep. However, if the user is provided with appropriate brightness and air conditioning before bedtime, they may be able to fall asleep more easily and achieve deeper sleep.

[0062] For example, while the bluish light of daylight can stimulate the brain and increase concentration, it is also said to be unsuitable for long hours of desk work or studying, as it can cause eye strain and migraines. On the other hand, regarding the air conditioning environment, the optimal room temperature and humidity for improving each user's work efficiency vary from person to person. Therefore, creating a comfortable environment with air conditioning tailored to each individual user is important for improving user performance in desk work, studying, etc. For these reasons, it is desirable to appropriately set the lighting color and air conditioning environment so that users can work comfortably during the day.

[0063] Conventional necklace-type devices have functions to monitor the user's health status, such as biometric data including heart rate, blood pressure, and blood oxygen levels. However, simply monitoring biometric data may not be enough to create a comfortable environment for the user, including air conditioning and lighting. Therefore, there is room for improvement in conventional necklace-type devices in maintaining a comfortable environment for the user.

[0064] In view of the above, the second embodiment describes an example configuration of a necklace-type terminal equipped with air conditioning management and lighting management functions to provide a comfortable surrounding environment for the user. The necklace-type terminal according to the second embodiment may be configured to perform comfortable air conditioning and lighting management for the user, in particular, using the user's biometric data, environmental data, and a specific program (evaluation program). In the second embodiment, functions, configurations, etc. that are the same as or equivalent to those in the first embodiment are denoted by the same reference numerals as in the first embodiment, and redundant explanations are omitted.

[0065] Figure 8 shows an example of the configuration of a data processing system 10-2 according to the second embodiment. The data processing system 10-2 may include a data processing device 12 and a necklace-type terminal 14-2. In the second embodiment, the data processing device 12 is an example of a "data processing device" according to the technology of this disclosure, and the necklace-type terminal 14-2 is an example of a "necklace-type terminal" according to the technology of this disclosure. An air conditioner 200 and a lighting device 300 may be connected to the network 54 so as to be able to communicate with the necklace-type terminal 14-2 and the data processing device 12.

[0066] (Air conditioning system 200) The air conditioning system 200 may include one or more air conditioners, dehumidifiers, humidifiers, ventilation equipment, electric heaters, floor heating, etc., installed in the residence where user 20 resides, in a private room at user 20's workplace, etc. The air conditioning system 200 may operate based on a control signal to achieve the set air conditioning environment, in order to operate the air conditioning system 200 with the air conditioning settings set by the necklace-type terminal 14-2.

[0067] For example, when the air conditioning system 200 receives a control signal to set the room temperature of the indoor space where user 20 is located to 29°C, it may detect the room temperature of the indoor space, and if the detected room temperature is 25°C, it may control the indoor unit fan, compressor, outdoor unit fan, etc. installed in the air conditioner to raise the room temperature by 4°C and maintain a room temperature of around 29°C.

[0068] Furthermore, for example, if the air conditioning system 200 receives a control signal to set the humidity of the indoor space where user 20 is present to 30%, it may detect the humidity of the indoor space, and if the detected humidity is 70%, it may control the indoor unit fan, compressor, outdoor unit fan, etc., installed in the air conditioner to lower the humidity by 40% and maintain a humidity of around 30%. The air conditioning system 200 may similarly control the air conditioning environment by combining air conditioners, dehumidifiers, humidifiers, ventilation equipment, electric heaters, floor heating, etc.

[0069] (Lighting device 300) The lighting device 300 may be interpreted as one or more lighting fixtures installed in the residence where user 20 lives, in a private room at user 20's workplace, etc. The lighting device 300 may include, for example, a stand light used in a corner of a room or on a side table, a downlight used embedded in the ceiling, a ceiling light mounted on the surface of the ceiling, a desk lamp placed on a desk, etc. The lighting device 300 may also include lighting fixtures installed on the ceiling of a bathroom, lighting fixtures installed in a study or bedroom, etc.

[0070] The lighting device 300 may be configured to allow adjustment of the brightness (dimming) and hue (color tone) of the emitted light. The degree of brightness of the emitted light may be interpreted as the total amount of luminous flux (luminous quantity) that passes through a certain surface within a certain time. Color tone may be interpreted as the degree of color intensity, brightness, and strength, as well as the hue or color temperature. The lighting device 300 may be adjusted to any color between approximately 2700 and 6500K (Kelvin), between incandescent, neutral white, and daylight. Color tone may include warm white with a calm brightness (3250K to 3800K in JIS standards), natural white with a color close to sunlight (defined as 3800K to 4500K in JIS standards), and bright neutral white close to natural light (4600K to 5500K in JIS standards).

[0071] The lighting device 300 may operate based on a control signal to create a set lighting environment, in order to operate the lighting device 300 with the lighting settings set by the necklace-type terminal 14-2. When the lighting device 300 receives a control signal to set at least one of the light intensity and color tone to a specific value, it may change at least one of the currently set light intensity and color tone to the set value. In this case, the lighting device 300 may change at least one of the light intensity and color tone to the set value at a specific time, or it may change at least one of the light intensity and color tone to the set value for a set amount of time from the specific time.

[0072] For example, even if user 20 in the study has set the downlight intensity to a high level and the color temperature to daylight white, the lighting device 300 may change the intensity and color temperature settings at a specific time based on the control signal. Specifically, at 10pm, the lighting device 300 may set the intensity of the downlights installed in the study to an intensity suitable for nighttime and set the color temperature to warm white. The lighting device 300 may similarly control the lighting environment by combining downlights, ceiling lights, desk lamps, etc.

[0073] The air conditioning system 200 and the lighting system 300 may operate simultaneously based on the control signal to achieve the set air conditioning and lighting environments.

[0074] The necklace-type terminal 14-2 may include a computer 36, a microphone 38, a sensor 39, a speaker 40, a camera 42, and a communication interface 44. The computer 36 may include a processor 46-2, RAM 48, and storage 50-2. The processor 46-2, RAM 48, and storage 50-2 may be connected to the bus 52. The microphone 38, speaker 40, and camera 42 may also be connected to the bus 52.

[0075] User 20, who is wearing the necklace-type terminal 14-2, may be interpreted as being subject to a comfortable air-conditioned and lighting environment provided by the data processing system 10-2.

[0076] Figure 9 shows an example of the main functions of the data processing device 12 and the necklace-type terminal 14-2. In the necklace-type terminal 14-2, data collection processing and specific processing are performed by the processor 46-2.

[0077] The processor 46-2 reads the data acquisition program 60-2 from the storage 50-2 and executes the read data acquisition program 60-2 on the RAM 48. The data acquisition process is realized by the processor 46-2 operating as a control unit 46A according to the data acquisition program 60-2 executed on the RAM 48.

[0078] The processor 46-2 reads a specific processing program 61 from the storage 50-2 and executes the read specific processing program 61 on the RAM 48. The specific processing is realized by the processor 46-2 operating as a specific processing unit 46B according to the specific processing program 61 executed on the RAM 48.

[0079] Storage 50-2 stores the data collection program 60-2, the identification processing program 61, the data generation model 62, the emotion identification model 63, and the evaluation program 64. The data generation model 62, the emotion identification model 63, and the evaluation program 64 are used for identification processing in the identification processing unit 46B.

[0080] The data generation model 62 is a so-called generative AI. An example of the data generation model 62 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 62 is obtained by performing deep learning on a neural network. The data generation model 62 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 62 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0081] The emotion identification model 63 can be interpreted as an emotion engine that estimates the emotions contained in the utterances made by the user 20, who is the wearer, regarding the air conditioning environment and lighting environment.

[0082] The evaluation program 64 may be interpreted as a program containing a specific algorithm for evaluating the user 20's comfort level with respect to the air conditioning and lighting environment. The evaluation program 64 may be interpreted as a program containing a specific algorithm for evaluating the user 20's comfort level with respect to the surrounding environment, including the air conditioning and brightness around the user 20.

[0083] In the specific processing using the evaluation program 64, for example, the room temperature, humidity in the space where user 20 is present, and user 20's attributes (gender, age, nationality, etc.) may be considered to calculate, for example, the room temperature, temperature, and atmospheric pressure that user 20 finds comfortable when in normal health, and the room temperature, temperature, and atmospheric pressure that user 20 may find comfortable even when in abnormal health (e.g., when feeling unwell). In the specific processing using the evaluation program 64, for example, the amount of light and color tone in the space where user 20 is present, user 20's attributes (gender, age, nationality, etc.), and user 20's state may be considered to calculate the amount of light and color tone that user 20 finds comfortable, and the amount of light and color tone that is considered appropriate for user 20's state. User 20's state may be interpreted as user 20's lifestyle habits, and may include, for example, work, reading, sleeping, exercise, eating, bathing, etc.

[0084] Alternatively, instead of the evaluation program 64, the data generation model 62 may be used to calculate the air conditioning and lighting environments. Specifically, as a specific process, a prompt statement may be input to the generating AI model (data generation model 62) instructing it to calculate air conditioning settings that take into account the wearer's physical condition, the room temperature, the light intensity of the lighting, and the color tone of the lighting, based on biological data and environmental data, thereby calculating the air conditioning settings. Alternatively, as a specific process, a prompt statement may be input to the generating AI model (data generation model 62) instructing it to calculate lighting settings that take into account the wearer's physical condition, the room temperature, the light intensity of the lighting, and the color tone of the lighting, based on biological data and environmental data, thereby calculating the lighting settings.

[0085] Next, the functions of the control unit 46A and the specific processing unit 46B will be described with reference to Figure 10. The control unit 46A may include a data acquisition unit 100-2 and a communication unit 102-2. The specific processing unit 46B may include an input unit 103 and a processing unit 104.

[0086] The data acquisition unit 100-2 may collect the outputs of the microphone 38, sensor 39, and camera 42 shown in Figure 8. As mentioned above, the sensor 39 may include biological data and environmental data, and the data acquisition unit 100-2 may collect this data.

[0087] The data collection unit 100-2 may collect biometric data such as heart rate, blood oxygen saturation, and body temperature. The biometric data is not limited to these and may include, for example, the number of steps taken by user 20, the number of stairs climbed and descended by user 20, and the walking speed of user 20.

[0088] The data acquisition unit 100-2 may collect environmental data such as the color tone and light intensity of light emitted from the user 20 and the lighting devices illuminating the user 20, and may also collect the temperature, humidity, etc., around the location where the user 20 is located. The environmental data is not limited to these, and may also include, for example, the altitude (elevation, sea level, etc.) of the location where the user 20 is located, and climate information of the location where the user 20 is located (cloudy, sunny, cloudy, far-infrared radiation amount, ultraviolet radiation amount, etc.). The biometric data and environmental data may include data detected by the necklace-type terminal 14-2, and may also include data detected by terminal devices other than the necklace-type terminal 14-2.

[0089] The data collected by the data acquisition unit 100-2 may be input to the processing unit 104 via the input unit 103. The processing unit 104 may perform specific processing using the biological data, environmental data, and evaluation program 64.

[0090] (First example of specific processing by processing unit 104) Since user 20's body temperature tends to be high immediately after exercise, user 20 who has exercised outdoors may feel uncomfortable entering a room with a high room temperature. However, if user 20 enters a room with low humidity and a moderately low room temperature, user 20 may find the indoor air-conditioned environment comfortable. For example, if user 20, who has exercised outdoors and has a high body temperature, returns to a room where the air conditioner is set to 27°C, the processing unit 104 evaluates user 20's comfort level using biometric data, environmental data, and the evaluation program 64. For example, if user 20's body temperature is around 37°C, heart rate is around 80-120, blood oxygen saturation is within the normal range, and walking speed during a certain period before returning home is equal to running speed, the processing unit 104 may determine that user 20 has just exercised and may set the air conditioning environment to be comfortable for user 20 immediately after exercise. For example, it may be set to a room temperature of 24°C and humidity of 40%. The processing unit 104 may transmit a command to the communication unit 102-2 to operate the air conditioning unit 200 with the set air conditioning settings. The communication unit 102-2 may then transmit a control signal corresponding to the air conditioning settings to the air conditioning unit 200 as a result of the specific processing. The control signal corresponding to the air conditioning settings may also be transmitted to a management device that oversees the operation of the air conditioning unit 200. The space to which the air conditioning environment settings are applied is not particularly limited and may be interpreted as, for example, the user 20's home or a private room at the user 20's workplace.

[0091] In the first example of a specific process, the processing unit 104 may set the lighting environment in addition to the air conditioning environment, or it may set the lighting environment instead of the air conditioning environment. Immediately after exercise, the user 20's body is likely to be in a state where the sympathetic nervous system is dominant over the parasympathetic nervous system. This state of sympathetic nervous system dominance can interfere with falling asleep. Therefore, for example, to enable user 20, who has finished exercising at a gym after work, to fall asleep quickly, the processing unit 104 may control the lighting device 300 to provide a lighting environment that promotes parasympathetic nervous system dominance. Specifically, if the processing unit 104 detects that user 20 has been exercising several hours before bedtime by using biometric data, it may use environmental data to control the light intensity and color tone of the room lighting a certain time before bedtime. In this case, for example, the processing unit 104 may normally set the light intensity to half of the amount set by user 20, and also change the color tone from cool to warm.

[0092] (Second example of specific processing by processing unit 104) If a user 20 spends time outdoors in cold winter temperatures and then enters a room without air conditioning or heating, the user 20, with their lower body temperature, may find the indoor environment uncomfortable, even if the room temperature is higher than the outside temperature. For example, if a user 20 who has spent a long time (several tens of minutes to several hours) outdoors and has a low body temperature returns home to a room where the air conditioning is turned off in winter, the processing unit 104 evaluates the user 20's comfort level using biometric data, environmental data, and the evaluation program 64. For example, if the user 20's body temperature is around 36.6°C, their heart rate is around 80-120, their blood oxygen saturation is within the normal range, their walking speed during a certain period before returning home is equal to their normal walking speed, the outside temperature is 15°C or lower, and the user 20's time spent outdoors is, for example, 30 minutes or more, the processing unit 104 may determine that the user 20 spent a long time outdoors and may set the indoor air conditioning environment to a level that the user 20 would find comfortable. For example, it may set the room temperature to 29°C and the humidity to 30%. The processing unit 104 may send a command to the communication unit 102-2 to operate the air conditioning unit 200 with the set air conditioning settings. As a result, the communication unit 102-2 may send a control signal corresponding to the air conditioning settings to the air conditioning unit 200 as a result of specific processing.

[0093] In the second example of the specific processing, the processing unit 104 may set the lighting environment in addition to the air conditioning environment, or it may set the lighting environment instead of the air conditioning environment. Cool-toned lighting is said to be less warming than warm-toned lighting. Warm-toned lighting is said to be warming and is often used to create a cheerful and fun image. For example, if the indoor lighting is set to a cool tone during the cold winter months, the processing unit 104 may control the lighting device 300 to provide warm-toned lighting that makes the user feel warm and bright. Specifically, the processing unit 104 may use environmental data to consider the season, outdoor temperature, weather (cloudy, snowy, etc.) and change the color tone of the lighting illuminating the user 20 and their surroundings from a cool tone to a warm tone. In this case, in addition to the color tone, the processing unit 104 may also set the light intensity to a higher level than the light intensity normally set by the user 20.

[0094] (Third example of specific processing by processing unit 104) For user 20, who is unwell due to a cold, has a slight fever, and is coughing, even if the room temperature and humidity are set appropriately, the room temperature may feel low and the air may feel dry. For example, if user 20 who is unwell returns home to a room where the humidifier is turned off in winter, or if user 20 stays in a room where the humidifier is turned off in winter for a certain period of time, the processing unit 104 evaluates user 20's comfort level using biometric data, environmental data, and the evaluation program 64. For example, if user 20's body temperature is around 37.5°C, heart rate is around 80-100, and blood oxygen saturation is lower than the normal range, the processing unit 104 may determine that user 20 has a cold and set the air conditioning environment to a level that user 20 will find comfortable in the room. For example, it may set the room temperature to 30°C and the humidity to 60%. The processing unit 104 may send a command to the communication unit 102-2 to operate the air conditioning device 200 with the set air conditioning settings. As a result, the communication unit 102-2 may transmit a control signal corresponding to the air conditioning setting to the air conditioning device 200 as a result of the specific processing.

[0095] In the third example of specific processing, the processing unit 104 may set the lighting environment in addition to the air conditioning environment, or it may set the lighting environment instead of the air conditioning environment. It is known that the parasympathetic nervous system is dominant at night. When the parasympathetic nervous system is dominant, it acts on the muscles surrounding the trachea, causing the bronchi to constrict and suppressing breathing. Furthermore, it is said that the bronchi become more sensitive to exposure to cold air, making coughing more likely. For example, when user 20 who has a cold goes to sleep, they are more likely to cough. Furthermore, it is said that if the throat dries out due to mouth breathing during sleep and the effects of air conditioning, the mucous membrane of the bronchi is stimulated, making coughing even more likely. For example, if the processing unit 104 determines, using biometric data, that user 20 has a cold, it may operate a humidifier at bedtime to suppress air dryness.

[0096] Furthermore, the processing unit 104 may set the air conditioner temperature a few degrees higher than the normal bedtime temperature to prevent the parasympathetic nervous system from becoming excessively dominant. The processing unit 104 may also set the night light of the lighting device 300 to be on.

[0097] Furthermore, the processing unit 104 may use environmental data to change the light intensity and color tone of the lighting during sleep. For example, the processing unit 104 may turn off the night light of the lighting device 300 installed in the bedroom where the user 20 is located until a certain period of time has elapsed since the user fell asleep, so that the user 20 can fall asleep quickly. After a certain period of time has elapsed, the night light may be turned on to prevent the parasympathetic nervous system from becoming excessively dominant.

[0098] (Fourth example of specific processing by processing unit 104) It is said that the human body has a mechanism to allow the brain and body to rest by lowering core body temperature when falling asleep. For example, even if the room temperature and humidity are set appropriately in the early morning or during the day when user 20 starts their activities, such an air-conditioned environment may interfere with user 20's deep sleep. For example, when user 20 sets a bedtime in advance, or at a specific time before that time, the processing unit 104 uses biometric data, environmental data, and evaluation program 64 to evaluate user 20's comfort level during sleep. For example, if user 20's body temperature is high, around 37.5°C, because they have just taken a bath, their heart rate is around 80, and their blood oxygen saturation is within the normal range, the processing unit 104 may set the air-conditioned environment to allow user 20 to fall into deep sleep by lowering user 20's body temperature. For example, it may be set to a room temperature of 23°C and humidity of 40%. Furthermore, for example, if user 20's body temperature is low, around 36.2°C, because some time has passed since user 20 took a bath, the room temperature and humidity may be changed to temporarily raise user 20's body temperature and then lower it while the user sleeps. The processing unit 104 may send a command to the communication unit 102-2 to operate the air conditioning unit 200 with the set air conditioning settings. As a result, the communication unit 102-2 may send a control signal corresponding to the air conditioning settings to the air conditioning unit 200 as a result of specific processing.

[0099] (Another example of processing by processing unit 104 1) The processing unit 104 may, as a specific process, input a prompt message to the generating AI model instructing it to calculate air conditioning and lighting settings that take into account the wearer's physical condition, temperature, light intensity, and color tone, based on biometric data and environmental data, thereby calculating air conditioning and lighting settings.

[0100] (Another example of processing by processing unit 104 2) The processing unit 104 may estimate the emotions contained in the utterances made by the user 20 in relation to the surrounding environment and perform specific processing using the user's emotions. Specifically, the processing unit 104 may calculate air conditioning and lighting settings that take into account the emotions estimated by the emotion identification model 63, which is an emotion engine, as well as the user's physical condition, temperature, light intensity, and color tone.

[0101] For example, if user 20 says "It's a little hot," the processing unit 104 may generate a command to lower the room temperature by about 2°C. If user 20 says "It's very cold," the processing unit 104 may generate a command to raise the room temperature by about 5°C. If user 20 says "It's humid and hot," the processing unit 104 may generate a command to lower the room temperature by about 3°C ​​and lower the humidity by 10%.

[0102] For example, if user 20 says "It's a little too bright," the processing unit 104 may generate a command to reduce the light intensity by about 20%. If user 20 says "It's too bright," the processing unit 104 may generate a command to reduce the light intensity by about 50%. If user 20 says "It's a little too dark," the processing unit 104 may generate a command to increase the light intensity by about 20%. If user 20 says "It's very dark," the processing unit 104 may generate a command to increase the light intensity by about 50%.

[0103] (Another example of processing by processing unit 104 3) The processing unit 104 may input a prompt message to the generating AI model instructing it to suggest air conditioning and lighting settings appropriate to the wearer's physical condition based on biometric data and environmental data, thereby determining the content of the utterance that suggests air conditioning and lighting settings appropriate to the wearer's physical condition (user 20). In this case, the communication unit 102-2 may generate information to reproduce the utterance determined by the processing unit 104. Based on the generated information, the speaker 40 may output sound according to instructions from the processor 46-2.

[0104] For example, the processing unit 104 may decide to say, "You may have a cold. Shall we raise the room temperature by 3°C?" in order to inform user 20, who is unwell with a cold and has a slight fever, of the air conditioning settings that user 20 finds comfortable indoors and the reason why.

[0105] For example, the processing unit 104 may decide to inform user 20, who is unwell with a cold and has a slight fever, about the lighting environment settings that prevent the parasympathetic nervous system from becoming excessively dominant in order to suppress coughing, and the reason for doing so, by deciding on the content of the statement, "You may have a cold. Would you like to turn on the night light to suppress coughing while you sleep?"

[0106] (Another example of processing by processing unit 104 4) The processing unit 104 may use the generation AI model to adjust the speech content after playback of the aforementioned speech content, based on the emotions contained in the speech made by the user 20, the wearer, regarding the air conditioning environment and lighting settings. In this case, the communication unit 102-2 may generate information to play back the adjusted speech content. Based on the generated information, the speaker 40 may output sound according to instructions from the processor 46-2.

[0107] For example, if user 20, whose body temperature tends to be high immediately after exercise, is notified by processing unit 104 with the suggestion, "Shall we lower the room temperature by 3°C?" as a setting for an air conditioning environment that user 20 finds comfortable indoors, and then user 20 responds with, for example, "Lower it a little more," processing unit 104 may adjust the response to something like, "Shall we lower the room temperature by 5°C?"

[0108] For example, if the processing unit 104 detects that user 20 has been exercising several hours before bedtime, and user 20 tends to have a higher body temperature immediately after exercise, the processing unit 104 may, a certain amount of time before bedtime, suggest setting the lighting environment to help with falling asleep quickly by asking, "Shall I dim the lights to about 20%?" If user 20 responds, for example, "Down it a little more," the processing unit 104 may adjust the response to "Shall I dim the lights to about half?" Similarly, if the processing unit 104 suggests setting the lighting environment to help with falling asleep quickly by asking, "Shall I make the lights warmer?", and user 20 responds, for example, "This is fine," the processing unit 104 may adjust the response to "I will cancel the change."

[0109] Next, with reference to Figure 11, an example of operation related to specific processing by the data processing system 10-2 according to the second embodiment will be described.

[0110] In step S401, the control unit 46A may collect biometric data and environmental data detected by at least one of the terminal device, such as a smartphone, and the necklace-type terminal 14-2.

[0111] In step S402, the processing unit 104 may perform specific processing to evaluate the user 20's comfort level with respect to the air conditioning environment and lighting environment using the biological data, environmental data, and evaluation program 64.

[0112] In step S403, the processing unit 104 may, as a result of specific processing, send a command to the communication unit 102-2 to operate the air conditioning unit 200 with the set air conditioning settings, and send a command to the communication unit 102-2 to operate the lighting device 300 with the set lighting settings. The communication unit 102-2 may send control signals corresponding to the air conditioning settings and lighting settings to the air conditioning unit 200 and the lighting device 300.

[0113] In step S404, the air conditioning unit 200, upon receiving a control signal corresponding to the air conditioning settings, operates to achieve the set air conditioning environment. Similarly, the lighting unit 300, upon receiving a control signal corresponding to the lighting settings, operates to achieve the set lighting environment.

[0114] As described above, the data processing system 10-2 according to the second embodiment performs specific processing using biometric data, environmental data, and a specific algorithm for evaluating the user 20's comfort level with respect to the air conditioning and lighting environment. This enables appropriate air conditioning and lighting control for the user 20, taking into account the user 20's physical condition and the temperature, humidity, light intensity, and color tone of the user 20's surroundings. Because appropriate lighting control can be achieved for the user 20, for example, the strain on the user 20's vision when performing specific tasks for long periods in dark places can be reduced. Furthermore, the user 20's performance in desk work, studying, etc., can be improved. In addition, deep sleep for the user 20 can be achieved.

[0115] [Third Embodiment] (Premise and challenges of the third embodiment) The indoor environment that a user finds comfortable can vary greatly depending on the user's physical condition and surrounding environment at any given time. For example, it is said that the lighting before going to bed should not be too bright, and spending the 1-2 hours before going to bed with only soft lighting such as indirect lighting allows the parasympathetic nervous system to become dominant, making it easier to fall asleep. If there are no lighting fixtures suitable for sleep, such as indirect lighting, it is recommended to adjust the lighting to about half of the usual brightness by dimming the lights or turning off some of the lighting fixtures. On the other hand, it is said that the human body has a mechanism to allow the brain and body to rest by lowering the core body temperature in a short period of time when falling asleep. For example, even if the room temperature and humidity are set appropriately in the early morning or during the day when the user starts their activities, such an air-conditioned environment can interfere with the user's deep sleep. Therefore, if a user continues to live in an indoor environment with the same brightness as during the day, and in an air-conditioned environment that promotes sympathetic nervous system activity, right up until bedtime, they may have difficulty falling asleep or experience shallow sleep. However, if the user is provided with appropriate brightness and air conditioning before bedtime, they may be able to fall asleep more easily and achieve deeper sleep.

[0116] For example, while the bluish light of daylight can stimulate the brain and increase concentration, it is also said to be unsuitable for long hours of desk work or studying, as it can cause eye strain and migraines. On the other hand, regarding the air conditioning environment, the optimal room temperature and humidity for improving each user's work efficiency vary from person to person. Therefore, creating a comfortable environment with air conditioning tailored to each individual user is important for improving user performance in desk work, studying, etc. For these reasons, it is desirable to appropriately set the lighting color and air conditioning environment so that users can work comfortably during the day.

[0117] Conventional necklace-type devices have functions to monitor the user's health status, such as biometric data including heart rate, blood pressure, and blood oxygen levels. However, simply monitoring biometric data may not be sufficient to create a comfortable environment for the user, including air conditioning and lighting. Therefore, there is room for improvement in data processing systems, including conventional necklace-type devices, in maintaining a comfortable environment for the user.

[0118] In view of the above, the third embodiment describes an example configuration of a data processing system including a necklace-type terminal equipped with air conditioning management and lighting management functions in order to provide a comfortable surrounding environment for the user. The data processing system according to the third embodiment may be configured to perform air conditioning and lighting management that is comfortable for the user, in particular, using the user's biometric data, environmental data, and a specific program (evaluation program). In the third embodiment, functions, configurations, etc. that are the same as or equivalent to those in the first embodiment are denoted by the same reference numerals as in the first embodiment, and redundant explanations are omitted.

[0119] Figure 12 shows an example of the configuration of a data processing system 10-3 according to the third embodiment. The data processing system 10-3 may include a data processing device 12-3 and a necklace-type terminal 14. An example of the data processing device 12-3 is a server. In the third embodiment, the data processing device 12-3 is an example of a "data processing device" according to the technology of this disclosure, and the necklace-type terminal 14 is an example of a "necklace-type terminal" according to the technology of this disclosure.

[0120] The data processing device 12-3 may include a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a “computer” related to the technology of this disclosure. The computer 22 may include a processor 28-3, RAM 30, and storage 32. The processor 28-3, RAM 30, and storage 32 may be connected to a bus 34.

[0121] Network 54 may be connected to an air conditioning unit 200 and a lighting unit 300 so as to be able to communicate with a necklace-type terminal 14-2 and a data processing unit 12.

[0122] (Air conditioning system 200) The air conditioning system 200 may include one or more air conditioners, dehumidifiers, humidifiers, ventilation equipment, electric heaters, floor heating, etc., installed in the residence where user 20 resides, in a private room at user 20's workplace, etc. The air conditioning system 200 may operate based on a control signal to create the set air conditioning environment in accordance with the air conditioning settings set by the data processing device 12-3.

[0123] For example, when the air conditioning system 200 receives a control signal to set the room temperature of the indoor space where user 20 is located to 29°C, it may detect the room temperature of the indoor space, and if the detected room temperature is 25°C, it may control the indoor unit fan, compressor, outdoor unit fan, etc. installed in the air conditioner to raise the room temperature by 4°C and maintain a room temperature of around 29°C.

[0124] Furthermore, for example, if the air conditioning system 200 receives a control signal to set the humidity of the indoor space where user 20 is present to 30%, it may detect the humidity of the indoor space, and if the detected humidity is 70%, it may control the indoor unit fan, compressor, outdoor unit fan, etc., installed in the air conditioner to lower the humidity by 40% and maintain a humidity of around 30%. The air conditioning system 200 may similarly control the air conditioning environment by combining air conditioners, dehumidifiers, humidifiers, ventilation equipment, electric heaters, floor heating, etc.

[0125] (Lighting device 300) The lighting device 300 may be interpreted as one or more lighting fixtures installed in the residence where user 20 lives, in a private room at user 20's workplace, etc. The lighting device 300 may include, for example, a stand light used in a corner of a room or on a side table, a downlight used embedded in the ceiling, a ceiling light mounted on the surface of the ceiling, a desk lamp placed on a desk, etc. The lighting device 300 may also include lighting fixtures installed on the ceiling of a bathroom, lighting fixtures installed in a study or bedroom, etc.

[0126] The lighting device 300 may be configured to allow adjustment of the brightness (dimming) and hue (color tone) of the emitted light. The degree of brightness of the emitted light may be interpreted as the total amount of luminous flux (luminous quantity) that passes through a certain surface within a certain time. Color tone may be interpreted as the degree of color intensity, brightness, and strength, as well as the hue or color temperature. The lighting device 300 may be adjusted to any color between approximately 2700 and 6500K (Kelvin), between incandescent, neutral white, and daylight. Color tone may include warm white with a calm brightness (3250K to 3800K in JIS standards), natural white with a color close to sunlight (defined as 3800K to 4500K in JIS standards), and bright neutral white close to natural light (4600K to 5500K in JIS standards).

[0127] The lighting device 300 may operate based on a control signal to create a set lighting environment, in order to operate the lighting device 300 with the lighting settings set by the data processing device 12-3. When the lighting device 300 receives a control signal to set at least one of the light intensity and color tone to a specific value, it may change at least one of the currently set light intensity and color tone to the set value. In this case, the lighting device 300 may change at least one of the light intensity and color tone to the set value at a specific time, or it may change at least one of the light intensity and color tone to the set value for a set amount of time from the specific time.

[0128] For example, even if user 20 in the study has set the downlight intensity to a high level and the color temperature to daylight white, the lighting device 300 may change the intensity and color temperature settings at a specific time based on the control signal. Specifically, at 10pm, the lighting device 300 may set the intensity of the downlights installed in the study to an intensity suitable for nighttime and set the color temperature to warm white. The lighting device 300 may similarly control the lighting environment by combining downlights, ceiling lights, desk lamps, etc.

[0129] The air conditioning system 200 and the lighting system 300 may operate simultaneously based on the control signal to achieve the set air conditioning and lighting environments.

[0130] The user 20, who is wearing the necklace-type terminal 14, may be interpreted as being subject to a comfortable air-conditioned and lighting environment provided by the data processing system 10-3.

[0131] Figure 13 shows an example of the main functions of the data processing device 12-3 and the necklace-type terminal 14. As shown in Figure 13, in the data processing device 12-3, specific processing is performed by the processor 28-3. The storage 32 stores the specific processing program 56-3. The processor 28-3 reads the specific processing program 56-3 from the storage 32 and executes the read specific processing program 56-3 on the RAM 30. The specific processing is realized by the processor 28-3 operating as a specific processing unit 290-3 according to the specific processing program 56-3 executed on the RAM 30.

[0132] Storage 32 stores the specific processing program 56-3, as well as the data generation model 58-3, the emotion identification model 65, and the evaluation program 66. The data generation model 58-3, the emotion identification model 65, and the evaluation program 66 are used for specific processing in the specific processing unit 290-3.

[0133] Data generation model 58-3 is a so-called generative AI. An example of data generation model 58-3 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58-3 is obtained by performing deep learning on a neural network. The data generation model 58-3 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58-3 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0134] The emotion identification model 65 can be interpreted as an emotion engine that estimates the emotions contained in the utterances made by the user 20, who is the wearer, regarding the air conditioning environment and lighting environment.

[0135] Evaluation program 66 may be interpreted as a program containing a specific algorithm for evaluating the user 20's comfort level with respect to the air conditioning and lighting environment. Evaluation program 64 may be interpreted as a program containing a specific algorithm for evaluating the user 20's comfort level with respect to the surrounding environment, including the air conditioning and brightness around the user 20.

[0136] In the specific processing using the evaluation program 66, for example, the room temperature, humidity in the space where user 20 is present, and user 20's attributes (gender, age, nationality, etc.) may be considered to calculate, for example, the room temperature, temperature, and atmospheric pressure that user 20 finds comfortable when in normal health, and the room temperature, temperature, and atmospheric pressure that user 20 may find comfortable even when in abnormal health (e.g., when feeling unwell). In the specific processing using the evaluation program 66, for example, the amount of light and color tone in the space where user 20 is present, user 20's attributes (gender, age, nationality, etc.), and user 20's state may be considered to calculate the amount of light and color tone that user 20 finds comfortable, and the amount of light and color tone that is considered appropriate for user 20's state. User 20's state may be interpreted as actions related to user 20's lifestyle, and may include, for example, work, reading, sleeping, exercise, eating, bathing, etc.

[0137] Alternatively, instead of evaluation program 66, data generation model 58-3 may be used to calculate the air conditioning and lighting environments. Specifically, as a specific process, a prompt message may be input to the generating AI model (data generation model 58-3) instructing it to calculate air conditioning settings that take into account the wearer's physical condition, room temperature, light intensity, and color tone of the lighting, based on biological data and environmental data, thereby calculating the air conditioning settings. Alternatively, as a specific process, a prompt message may be input to the generating AI model (data generation model 58-3) instructing it to calculate lighting settings that take into account the wearer's physical condition, room temperature, light intensity, and color tone of the lighting, based on biological data and environmental data, thereby calculating the lighting settings.

[0138] Next, with reference to Figure 14, the functions of the specific processing unit 290-3 will be described. The specific processing unit 290-3 may include an input unit 292-3, a processing unit 294-3, and an output unit 296-3.

[0139] The input unit 292-3 may receive biometric data and environmental data. Biometric data and environmental data may be interpreted as, for example, data detected by the necklace-type terminal 14 and data detected by terminal devices other than the necklace-type terminal 14 owned by the user 20.

[0140] The input unit 292-3 may input biometric data such as heart rate, blood oxygen saturation, and body temperature. The biometric data is not limited to these and may include, for example, the number of steps taken by user 20, the number of stairs climbed or descended by user 20, and the walking speed of user 20.

[0141] The input unit 292-3 may collect environmental data, for example, the color tone and light intensity of light emitted from the user 20 and the lighting devices illuminating the user 20, and may also collect temperature, humidity, etc., around the location where the user 20 is located. The environmental data is not limited to these, and may also include, for example, the altitude (elevation, sea level, etc.) of the location where the user 20 is located, and climate information of the location where the user 20 is located (cloudy, sunny, cloudy, far-infrared radiation amount, ultraviolet radiation amount, etc.). The biometric data and environmental data may include data detected by the necklace-type terminal 14, and may also include data detected by terminal devices other than the necklace-type terminal 14.

[0142] The data input to the input unit 292-3 may be input to the processing unit 294-3. The processing unit 294-3 may perform specific processing using the biological data, environmental data, and evaluation program 66.

[0143] (First example of specific processing by processing unit 294-3) Since user 20's body temperature tends to be high immediately after exercise, user 20 who has exercised outdoors may feel uncomfortable entering a room with a high room temperature. However, if user 20 enters a room with low humidity and a moderately low room temperature, user 20 may feel comfortable with the indoor air conditioning environment. For example, if user 20, who has exercised outdoors and has a high body temperature, returns to a room where the air conditioner is set to 27°C, processing unit 294-3 evaluates user 20's comfort level using biometric data, environmental data, and evaluation program 66. For example, if user 20's body temperature is around 37°C, heart rate is around 80-120, blood oxygen saturation is within the normal range, and walking speed during a certain period before returning home is equal to running speed, processing unit 294-3 may determine that user 20 has just exercised and may set the air conditioning environment to be comfortable for user 20 immediately after exercise. For example, it may be set to a room temperature of 24°C and humidity of 40%. The processing unit 294-3 may transmit a command to the output unit 296-3 to operate the air conditioning unit 200 with the set air conditioning settings. The output unit 296-3 may then transmit a control signal corresponding to the air conditioning settings to the air conditioning unit 200 as a result of the specific processing. The control signal corresponding to the air conditioning settings may also be transmitted to a control device that oversees the operation of the air conditioning unit 200. The space to which the air conditioning environment settings are applied is not particularly limited and may be interpreted as, for example, the user 20's home or a private room at the user 20's workplace.

[0144] In the first example of a specific process, the processing unit 294-3 may set the lighting environment in addition to the air conditioning environment, or it may set the lighting environment instead of the air conditioning environment. Immediately after exercise, the user 20's body is likely to be in a state where the sympathetic nervous system is dominant over the parasympathetic nervous system. This state of sympathetic nervous system dominance can hinder falling asleep. Therefore, for example, to enable user 20, who has finished exercising at a gym after work, to fall asleep quickly, the processing unit 294-3 may control the lighting device 300 to provide a lighting environment that promotes parasympathetic nervous system dominance. Specifically, if the processing unit 294-3 detects that user 20 has been exercising several hours before bedtime by utilizing biometric data, it may use environmental data to control the light intensity and color tone of the room lighting a certain time before bedtime. In this case, for example, the processing unit 294-3 may normally set the light intensity to half of the amount set by user 20, and also change the color tone from cool to warm.

[0145] (Second example of specific processing by processing unit 294-3) If a user 20 who has spent time outdoors in cold winter temperatures enters a room without air conditioning or heating, the user 20, with their low body temperature, may find the indoor environment uncomfortable, even if the room temperature is higher than the outside temperature. For example, if a user 20 who has spent a long time (several tens of minutes to several hours) outdoors and has a low body temperature returns home to a room where the air conditioning is turned off in winter, the processing unit 294-3 evaluates the user 20's comfort level using biometric data, environmental data, and the evaluation program 66. For example, if the user 20's body temperature is around 36.6°C, their heart rate is around 80-120, their blood oxygen saturation is within the normal range, their walking speed during a certain period before returning home is equal to their normal walking speed, the outside temperature is 15°C or lower, and the user 20's time spent outdoors is, for example, 30 minutes or more, the processing unit 294-3 may determine that the user 20 has spent a long time outdoors and may set the indoor air conditioning environment to a level that the user 20 will find comfortable. For example, it may set the room temperature to 29°C and the humidity to 30%. The processing unit 294-3 may transmit a command to the output unit 296-3 to operate the air conditioning unit 200 with the set air conditioning settings. As a result, the output unit 296-3 may transmit a control signal corresponding to the air conditioning settings to the air conditioning unit 200 as a result of specific processing.

[0146] In the second example of the specific processing, the processing unit 294-3 may set the lighting environment in addition to the air conditioning environment, or it may set the lighting environment instead of the air conditioning environment. Cool-toned lighting is said to be less warming than warm-toned lighting. Warm-toned lighting is said to be warming and is often used to create a cheerful and fun image. For example, if the indoor lighting is set to a cool tone during the cold winter months, the processing unit 294-3 may control the lighting device 300 to provide warm-toned lighting that makes the user feel warm and bright. Specifically, the processing unit 294-3 may use environmental data to consider the season, outdoor temperature, weather (cloudy, snowy, etc.) and change the color tone of the lighting illuminating the user 20 and their surroundings from a cool tone to a warm tone. In this case, in addition to the color tone, the processing unit 294-3 may also set the light intensity to a higher level than the light intensity normally set by the user 20.

[0147] (Third example of specific processing by processing unit 294-3) For user 20, who is unwell due to a cold, has a slight fever, and is coughing, even if the room temperature and humidity are set appropriately, the room temperature may feel low and the air may feel dry. For example, if user 20 who is unwell returns home to a room where the humidifier is turned off in winter, or if user 20 stays in a room where the humidifier is turned off in winter for a certain period of time, processing unit 294-3 evaluates user 20's comfort level using biometric data, environmental data, and evaluation program 66. For example, if user 20's body temperature is around 37.5°C, heart rate is around 80-100, and blood oxygen saturation is lower than the normal range, processing unit 294-3 may determine that user 20 has a cold and set the air conditioning environment to a level that user 20 will find comfortable. For example, it may set the room temperature to 30°C and the humidity to 60%. Processing unit 294-3 may send a command to output unit 296-3 to operate the air conditioning unit 200 with the set air conditioning settings. As a result, the output unit 296-3 may transmit a control signal corresponding to the air conditioning setting to the air conditioning device 200 as a result of the specific processing.

[0148] In the third example of specific processing, the processing unit 294-3 may set the lighting environment in addition to the air conditioning environment, or it may set the lighting environment instead of the air conditioning environment. It is known that the parasympathetic nervous system is dominant at night. When the parasympathetic nervous system is dominant, it acts on the muscles surrounding the trachea, causing the bronchi to constrict and suppressing breathing. Furthermore, it is said that the bronchi become more sensitive to exposure to cold air, making coughing more likely. For example, when user 20 who has a cold goes to sleep, they are more likely to cough. Furthermore, it is said that if the throat dries out due to mouth breathing during sleep and the effects of air conditioning, the mucous membrane of the bronchi is stimulated, making coughing even more likely. For example, if the processing unit 294-3 determines, using biometric data, that user 20 has a cold, it may operate a humidifier at bedtime to suppress air dryness.

[0149] Furthermore, the processing unit 294-3 may set the air conditioner temperature a few degrees higher than the normal bedtime temperature to prevent the parasympathetic nervous system from becoming excessively dominant. The processing unit 294-3 may also set the night light of the lighting device 300 to be on.

[0150] Furthermore, the processing unit 294-3 may use environmental data to change the light intensity and color tone of the lighting during sleep. For example, the processing unit 294-3 may turn off the night light of the lighting device 300 installed in the bedroom where the user 20 is located until a certain period of time has elapsed since the user fell asleep, so that the user 20 can fall asleep quickly. After a certain period of time has elapsed, the night light may be turned on to prevent the parasympathetic nervous system from becoming excessively dominant.

[0151] (Fourth example of specific processing by processing unit 294-3) It is said that the human body has a mechanism to allow the brain and body to rest by lowering core body temperature when falling asleep. For example, even if the room temperature and humidity are set appropriately in the early morning or during the day when user 20 starts their activities, such an air-conditioned environment may interfere with user 20's deep sleep. For example, when user 20 sets a bedtime in advance, or at a specific time before that time, the processing unit 294-3 evaluates user 20's comfort level during sleep using biometric data, environmental data, and the evaluation program 66. For example, if user 20's body temperature is high, around 37.5°C, because they have just taken a bath, their heart rate is around 80, and their blood oxygen saturation is within the normal range, the processing unit 294-3 may set the air-conditioned environment to allow user 20 to fall into deep sleep by lowering user 20's body temperature. For example, it may set the room temperature to 23°C and the humidity to 40%. Furthermore, for example, if user 20's body temperature is low, around 36.2°C, because some time has passed since user 20 took a bath, the room temperature and humidity may be changed to temporarily raise user 20's body temperature and then lower it while the user sleeps. Processing unit 294-3 may send a command to output unit 296-3 to operate the air conditioner 200 with the set air conditioning settings. As a result, output unit 296-3 may send a control signal corresponding to the air conditioning settings to the air conditioner 200 as a result of specific processing.

[0152] (Another processing example by processing unit 294-3 1) The processing unit 294-3 may, as a specific process, input a prompt message to the generating AI model instructing it to calculate air conditioning and lighting settings that take into account the wearer's physical condition, temperature, light intensity, and color tone, based on biological data and environmental data, thereby calculating air conditioning and lighting settings.

[0153] (Another processing example by processing unit 294-3 2) The processing unit 294-3 may estimate the emotions contained in the utterances made by the user 20 in relation to the surrounding environment and perform specific processing using the user's emotions. Specifically, the processing unit 294-3 may calculate air conditioning and lighting settings that take into account the emotions estimated by the emotion identification model 63, which is an emotion engine, as well as the user's physical condition, temperature, light intensity, and color tone.

[0154] For example, if user 20 says "It's a little hot," the processing unit 294-3 may generate a command to lower the room temperature by about 2°C. If user 20 says "It's very cold," the processing unit 294-3 may generate a command to raise the room temperature by about 5°C. If user 20 says "It's humid and hot," the processing unit 294-3 may generate a command to lower the room temperature by about 3°C ​​and lower the humidity by 10%.

[0155] For example, if user 20 says "It's a little too bright," the processing unit 294-3 may generate a command to reduce the light intensity by about 20%. If user 20 says "It's too bright," the processing unit 294-3 may generate a command to reduce the light intensity by about 50%. If user 20 says "It's a little too dark," the processing unit 294-3 may generate a command to increase the light intensity by about 20%. If user 20 says "It's too dark," the processing unit 294-3 may generate a command to increase the light intensity by about 50%.

[0156] (Another processing example by processing unit 294-3 3) The processing unit 294-3 may input a prompt message to the generating AI model instructing it to suggest air conditioning and lighting settings appropriate to the wearer's physical condition based on biometric data and environmental data, thereby determining the content of the utterance that suggests air conditioning and lighting settings appropriate to the wearer's physical condition (user 20). In this case, the output unit 296-3 may generate information to reproduce the utterance determined by the processing unit 294-3. Based on the generated information, the speaker 40 may output sound according to instructions from the processor 46-2.

[0157] For example, the processing unit 294-3 may decide to say, "You may have a cold. Shall we raise the room temperature by 3°C?" in order to inform user 20, who is unwell with a cold and has a slight fever, of the air conditioning settings that user 20 finds comfortable indoors and the reason why.

[0158] For example, the processing unit 294-3 may decide to inform user 20, who is unwell with a cold and has a slight fever, about the lighting environment settings that prevent the parasympathetic nervous system from becoming excessively dominant in order to suppress coughing, and the reason for doing so, by deciding on the content of the statement, "You may have a cold. Would you like to turn on the night light to suppress coughing while you sleep?"

[0159] (Another processing example by processing unit 294-3 4) The processing unit 294-3 may use a generation AI model to adjust the speech content after playback of the aforementioned speech content, based on the emotions contained in the speech made by the user 20, the wearer, regarding the air conditioning environment and lighting settings. In this case, the output unit 296-3 may generate information to play back the adjusted speech content. Based on the generated information, the speaker 40 may output sound according to instructions from the processor 46-2.

[0160] For example, if user 20, whose body temperature tends to be high immediately after exercise, is notified by processing unit 294-3 with the suggestion, "Shall we lower the room temperature by 3°C?" as a setting for an air conditioning environment that user 20 finds comfortable indoors, and then user 20 responds with, for example, "Lower it a little more," processing unit 294-3 may adjust the response to something like, "Shall we lower the room temperature by 5°C?"

[0161] For example, if the processing unit 294-3 detects that user 20 has been exercising several hours before bedtime, and user 20 tends to have a higher body temperature immediately after exercise, it may, a certain amount of time before bedtime, suggest setting the lighting environment to aid in falling asleep quickly by asking, "Shall I dim the lights to about 20%?" If user 20 responds, for example, "Down it a little more," the processing unit 294-3 may adjust the response to "Shall I dim the lights to about half?" Similarly, if the processing unit 294-3 suggests setting the lighting environment to aid in falling asleep quickly by asking, "Shall I make the lights warmer?", and user 20 responds, for example, "This is fine," the processing unit 294-3 may adjust the response to "Cancel the change."

[0162] Next, with reference to Figure 15, an example of operation related to specific processing by the data processing system 10-3 according to the third embodiment will be described.

[0163] In step S501, the specific processing unit 290-3 may input biometric data and environmental data detected by at least one of the terminal devices, such as a smartphone, and the necklace-type terminal 14.

[0164] In step S502, the processing unit 294-3 may perform specific processing to evaluate the comfort level of the user 20, who is the wearer, with respect to the air conditioning environment and lighting environment, using the biological data, environmental data, and evaluation program 66.

[0165] In step S503, the processing unit 294-3 may, as a result of specific processing, send a command to the output unit 296-3 to operate the air conditioning unit 200 with the set air conditioning settings, and send a command to the output unit 296-3 to operate the lighting unit 300 with the set lighting settings. The output unit 296-3 may send control signals corresponding to the air conditioning settings and lighting settings to the air conditioning unit 200 and the lighting unit 300.

[0166] In step S504, the air conditioning unit 200, upon receiving a control signal corresponding to the air conditioning settings, operates to achieve the set air conditioning environment. Similarly, the lighting unit 300, upon receiving a control signal corresponding to the lighting settings, operates to achieve the set lighting environment.

[0167] As described above, the data processing system 10-3 according to the third embodiment performs specific processing using biometric data, environmental data, and a specific algorithm for evaluating the user 20's comfort level with respect to the air conditioning and lighting environment. This enables appropriate air conditioning and lighting control for the user 20, taking into account the user 20's physical condition and the temperature, humidity, light intensity, and color tone of the user 20's surroundings. Because appropriate lighting control can be achieved for the user 20, for example, the strain on the user 20's vision when performing specific tasks for long periods in dark places can be reduced. Furthermore, the user 20's performance in desk work, studying, etc., can be improved. In addition, deep sleep can be achieved for the user 20.

[0168] The system described above primarily focuses on the functions of data processing device 12-3, but the system described in this disclosure is not necessarily implemented on a server. The system described in this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer, or as an application that runs on a smartphone, etc. The method described in this disclosure may be provided to users in SaaS (Software as a Service) format.

[0169] In the embodiments described above, examples were given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing method for the specific process may be used, which may involve multiple computers, including computer 22.

[0170] In the embodiments described above, examples were given in which specific processing programs 56, 56-3, etc., are stored in storage devices 50-2, 32, but the technology of this disclosure is not limited thereto. For example, specific processing programs 56, 56-3, etc., may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. Specific processing programs 56, 56-3, etc., stored in the non-temporary storage medium are installed in the computer 22 of the data processing device 12. Processors 28, 28-3 execute specific processing according to the specific processing programs 56, 56-3, etc.

[0171] Alternatively, specific processing programs 56, 56-3, etc., may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing programs 56, 56-3, etc., may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0172] Furthermore, it is not necessary to store all of the specific processing programs 56, 56-3, etc. in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing programs 56, 56-3, etc. in the storage 32; it is acceptable to store only some of the specific processing programs 56, 56-3, etc.

[0173] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0174] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0175] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0176] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0177] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0178] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0179] Furthermore, the following additional information is disclosed regarding the above explanation.

[0180] (Note 1) A data acquisition unit that collects the wearer's biometric data and environmental data including temperature, light intensity, and color tone around the wearer, A processing unit that performs specific processing using the aforementioned biological data, the aforementioned environmental data, and a specific algorithm that evaluates the wearer's comfort level with respect to the surrounding environment, including air conditioning and brightness around the wearer. A communication unit transmits the results of the specified processing to an air conditioning device that provides air conditioning for the indoor space where the wearer is located, and to a lighting device that illuminates the indoor space. Equipped with, The processing unit performs the process of calculating air conditioning and lighting settings, taking into account the wearer's physical condition, temperature, light intensity, and color tone, as the specific processing. The communication unit is a necklace-type terminal that transmits control signals corresponding to the air conditioning settings and lighting settings to the air conditioning device and the lighting device as a result of the specific processing.

[0181] (Note 2) The necklace-type terminal as described in Appendix 1, wherein the processing unit calculates the air conditioning settings and lighting settings by inputting a prompt message to a generating AI model instructing it to calculate the air conditioning settings and lighting settings based on the biometric data and environmental data, taking into account the wearer's physical condition, the temperature, the light intensity, and the color tone.

[0182] (Note 3) The system includes an emotion engine that estimates the emotions contained in the speech the wearer makes in response to the surrounding environment. The processing unit calculates the air conditioning settings and lighting settings taking into account the emotions, physical condition, temperature, light intensity, and color tone, as described in Appendix 1, and is a necklace-type terminal.

[0183] (Note 4) The processing unit inputs a prompt message to the generating AI model instructing it to propose air conditioning and lighting settings appropriate to the wearer's physical condition, based on the biometric data and the environmental data, thereby determining the content of the utterance that proposes the air conditioning and lighting settings appropriate to the wearer's physical condition. The communication unit is a necklace-type terminal as described in Appendix 3, which generates information for reproducing the determined speech content.

[0184] (Note 5) The processing unit uses a generation AI model to adjust the speech content based on the emotions contained in the speech made by the wearer regarding the air conditioning settings and lighting settings after the speech content has been reproduced. The communication unit is a necklace-type terminal as described in Appendix 4, which generates information for reproducing the adjusted speech content.

[0185] (Note 6) An input unit that receives biometric data of the wearer wearing the necklace-type terminal, detected by a sensor contained in the necklace-type terminal, and environmental data including temperature, light intensity, and color tone of the wearer's surroundings. A processing unit that performs specific processing using the aforementioned biological data, the aforementioned environmental data, and a specific algorithm that evaluates the wearer's comfort level with respect to the surrounding environment, including air conditioning and brightness around the wearer. An output unit that transmits the results of the specified processing to an air conditioning device that provides air conditioning for the indoor space where the wearer is located, and to a lighting device that illuminates the indoor space. Equipped with, The processing unit performs the process of calculating air conditioning and lighting settings, taking into account the wearer's physical condition, temperature, light intensity, and color tone, as the specific processing. The output unit is a data processing system that transmits control signals corresponding to the air conditioning settings and lighting settings to the air conditioning device and the lighting device as a result of the specific processing.

[0186] (Note 7) The data processing system described in Appendix 1, wherein the processing unit calculates the air conditioning settings and lighting settings by inputting a prompt message into a generating AI model that instructs the AI ​​model to calculate the air conditioning settings and lighting settings based on the biometric data and environmental data, taking into account the wearer's physical condition, temperature, light intensity, and color tone.

[0187] (Note 8) The system includes an emotion engine that estimates the emotions contained in the speech the wearer makes in response to the surrounding environment. The processing unit is a data processing system as described in Appendix 6, which calculates the air conditioning settings and lighting settings taking into account the emotions, physical condition, temperature, light intensity, and color tone.

[0188] (Note 9) The processing unit inputs a prompt message to the generating AI model instructing it to propose air conditioning and lighting settings appropriate to the wearer's physical condition, based on the biometric data and the environmental data, thereby determining the content of the utterance that proposes the air conditioning and lighting settings appropriate to the wearer's physical condition. The output unit is a data processing system as described in Appendix 8, which generates information for reproducing the determined speech content.

[0189] (Note 10) The processing unit uses a generation AI model to adjust the speech content based on the emotions contained in the speech made by the wearer regarding the air conditioning settings and lighting settings after the speech content has been reproduced. The output unit is a data processing system as described in Appendix 9, which generates information for reproducing the adjusted speech content. [Explanation of Symbols]

[0190] 10, 10-2, 10-3 Data Processing Systems 12, 12-3 Data Processing Devices 14, 14-2 Necklace-type terminal 38 Microphones 39 Sensors 40 speakers 42 cameras 46A Control Unit 100, 100-2 Data Collection Unit 102, 102-2 Communications Department 290, 290-3 Specific Processing Unit 292, 292-3 Input section 294, 294-3 Processing Unit 296, 296-3 Output section< / url:> < / url:> < / url:>

Claims

1. A data acquisition unit that collects the wearer's biometric data and environmental data including temperature, light intensity, and color tone around the wearer, A processing unit that performs specific processing using the aforementioned biological data, the aforementioned environmental data, and a specific algorithm that evaluates the wearer's comfort level with respect to the surrounding environment, including air conditioning and brightness around the wearer. A communication unit transmits the results of the specified processing to an air conditioning device that provides air conditioning for the indoor space where the wearer is located, and to a lighting device that illuminates the indoor space. Equipped with, The processing unit performs the process of calculating air conditioning and lighting settings, taking into account the wearer's physical condition, temperature, light intensity, and color tone, as the specific processing. The communication unit is a necklace-type terminal that transmits control signals corresponding to the air conditioning settings and lighting settings to the air conditioning device and the lighting device as a result of the specific processing.

2. The necklace-type terminal according to claim 1, wherein the processing unit, as the specific processing, inputs a prompt message to a generating AI model instructing it to calculate the air conditioning settings and lighting settings based on the biometric data and the environmental data, taking into account the wearer's physical condition, the temperature, the light intensity, and the color tone, thereby calculating the air conditioning settings and lighting settings.

3. The system includes an emotion engine that estimates the emotions contained in the speech the wearer makes in response to the surrounding environment. The necklace-type terminal according to claim 1, wherein the processing unit calculates the air conditioning settings and lighting settings taking into account the emotions, physical condition, temperature, light intensity, and color tone.

4. The processing unit inputs a prompt message to the generating AI model, based on the biometric data and the environmental data, instructing it to propose air conditioning and lighting settings appropriate to the wearer's physical condition, thereby determining the content of the utterance that proposes the air conditioning and lighting settings appropriate to the wearer's physical condition. The necklace-type terminal according to claim 3, wherein the communication unit generates information for reproducing the determined speech content.

5. The processing unit uses a generation AI model to adjust the speech content based on the emotions contained in the speech made by the wearer regarding the air conditioning settings and lighting settings after the speech content has been reproduced. The necklace-type terminal according to claim 4, wherein the communication unit generates information for reproducing the adjusted speech content.

6. An input unit that receives biometric data of the wearer wearing the necklace-type terminal, detected by a sensor contained in the necklace-type terminal, and environmental data including temperature, light intensity, and color tone of the wearer's surroundings. A processing unit that performs specific processing using the aforementioned biological data, the aforementioned environmental data, and a specific algorithm that evaluates the wearer's comfort level with respect to the surrounding environment, including air conditioning and brightness around the wearer. An output unit that transmits the results of the specified processing to an air conditioning device that provides air conditioning for the indoor space where the wearer is located, and to a lighting device that illuminates the indoor space. Equipped with, The processing unit performs the process of calculating air conditioning and lighting settings, taking into account the wearer's physical condition, temperature, light intensity, and color tone, as the specific processing. The output unit is a data processing system that transmits control signals corresponding to the air conditioning settings and lighting settings to the air conditioning device and the lighting device as a result of the specific processing.

7. The data processing system according to claim 6, wherein the processing unit, as the specific processing, inputs a prompt message to a generating AI model instructing it to calculate the air conditioning settings and lighting settings based on the biometric data and the environmental data, taking into account the wearer's physical condition, the temperature, the light intensity, and the color tone, thereby calculating the air conditioning settings and lighting settings.

8. The system includes an emotion engine that estimates the emotions contained in the speech the wearer makes in response to the surrounding environment. The data processing system according to claim 6, wherein the processing unit calculates the air conditioning settings and lighting settings taking into account the emotions, physical condition, temperature, light intensity, and color tone.

9. The processing unit inputs a prompt message to the generating AI model, based on the biometric data and the environmental data, instructing it to propose air conditioning and lighting settings appropriate to the wearer's physical condition, thereby determining the content of the utterance that proposes the air conditioning and lighting settings appropriate to the wearer's physical condition. The data processing system according to claim 8, wherein the output unit generates information for reproducing the determined speech content.

10. The processing unit uses a generation AI model to adjust the speech content based on the emotions contained in the speech made by the wearer regarding the air conditioning settings and lighting settings after the speech content has been reproduced. The data processing system according to claim 9, wherein the output unit generates information for reproducing the adjusted speech content.

Images