Necklace-type terminal, data processing device, data processing system

Abstract

We provide a necklace-type terminal equipped with an environmental sensor device and a biosensor device. [Solution] The necklace-type terminal is worn by a mobile organism to collect data in an area where plants are grown. The necklace-type terminal includes a biosensor device, an environmental sensor device, an acoustic collector that detects acoustic vibrations including sound waves from outside the necklace-type terminal and sound waves emitted by the organism, a data collection unit that collects data signals from the biosensor device, the environmental sensor device, and the acoustic collector and generates output data, a first communication unit configured to receive output data from the data collection unit and capable of communicating with a data processing device located outside the necklace-type terminal, and an electroacoustic converter that converts electrical signals from the first communication unit into acoustic vibrations. The environmental sensor device includes an optical sensor device that detects light at the location of the necklace-type terminal.

Description

Technical Field

[0001] The present disclosure relates to a necklace-type terminal, a data processing device, and a data processing system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor. This method includes receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to the description of the chatbot's character, and encoding the prompt. The method also includes inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Patent Document 1 discloses an acceleration sensor and a gyro sensor in addition to an audio sensor and an image sensor. However, these sensors do not function sufficiently for collecting biometric data of the user of the persona chatbot. Accordingly, wearable devices, such as necklace-type terminals, should be developed focusing on functions that support the user's health condition and utterance.

[0005] Such wearable devices can be applied to health monitoring and speech support. For example, health monitoring can be extended to the user's living and working environments, and speech support can be extended to interactions between the user and external devices within the user's living and working environments. In this way, the application of wearable devices can be expanded to various new fields.

[0006] One new application is in the field of plant cultivation. Sensor devices for plant cultivation can, where possible, be incorporated into wearable devices, such as necklace-type terminals.

[0007] Plant cultivation requires various sensor devices to detect its environment. However, these sensor devices must be provided as dedicated devices. The functions of these sensor devices cannot be replaced by data from existing sensors such as accelerometers and gyroscopes.

[0008] Plant cultivation is inevitably related to the user's daily life, including their living environment and behavioral patterns. Demonstrating new applications may be facilitated by systems that link daily life with plant cultivation. Specifically, such systems would provide assistance to the user's actions to maintain a good growing environment, or supplement the user's knowledge to improve the growing environment. What is needed is to provide wearable devices applicable to plant cultivation, such as necklace-type terminals and data processing devices, as well as data processing systems including necklace-type terminals and data processing devices. [Means for solving the problem]

[0009] A first aspect of the present disclosure is a necklace-type terminal configured to be worn by a mobile organism and to collect data in an area where plants are grown, the necklace-type terminal comprising: a biosensor device configured to detect biological data of the organism; an environmental sensor device configured to detect environmental data outside the necklace-type terminal; an acoustic collector configured to detect sound waves from outside the necklace-type terminal and acoustic vibrations including sound waves emitted by the organism; a data collection unit configured to collect data signals from the biosensor device, the environmental sensor device, and the acoustic collector and generate output data; a first communication unit configured to receive the output data from the data collection unit and to communicate with a data processing device located outside the necklace-type terminal; and an electroacoustic converter device that converts electrical signals from the first communication unit into acoustic vibrations, wherein the environmental sensor device includes an optical sensor device that detects light at the location of the necklace-type terminal.

[0010] A second aspect of the present disclosure is a data processing device provided in an area for growing plants, the data processing device comprising: a second communication unit capable of communicating with a necklace-type terminal described in the first aspect; an input unit that receives the output data from the necklace-type terminal via the second communication unit; an output unit that sends a response to the necklace-type terminal generated based on the received output data to the second communication unit; a processor connected to the input unit and the output unit; and a memory configured to store program code and connected to the processor, wherein, when executed by the processor, the program code causes the processor to input a prompt to a data generation model that includes text indicating the content of an utterance generated from the acoustic data of the output data of the necklace-type terminal as a user utterance, and to obtain a response to the utterance using the output data of the data generation model.

[0011] A third aspect of this disclosure is a data processing system comprising a necklace-type terminal as described in the first aspect and a data processing device as described in the second aspect. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 is a schematic diagram illustrating an exemplary data processing system according to this embodiment. [Figure 2] Figure 2 is a schematic diagram illustrating the main functions of an exemplary data processing device and an exemplary necklace-type terminal. [Figure 3] Figure 3 is a schematic diagram illustrating an example necklace-type terminal. [Figure 4] Figure 4 is a schematic diagram illustrating another example necklace-type terminal. [Figure 5] Figure 5 is a schematic diagram showing a map of an area, such as a living room, where an exemplary data processing system according to this embodiment is installed. [Figure 6] Figure 6 is a schematic diagram illustrating an example of cultivation using an environmental sensor device in the living room shown in Figure 5. [Figure 7] Figure 7 is a schematic diagram illustrating an example of cultivation using an environmental sensor device in the living room shown in Figure 5. [Figure 8] Figure 8 is a schematic diagram illustrating an example of cultivation using an environmental sensor device in the living room shown in Figure 5. [Figure 9] Figure 9 is a schematic diagram illustrating an example of cultivation using an environmental sensor device in the living room shown in Figure 5. [Figure 10] Figure 10 is a diagram illustrating an exemplary user life model and development model, as well as the use of these models. [Figure 11] Figure 11 is a schematic diagram showing the functional configuration of the control unit of the necklace-type terminal. [Figure 12] Figure 12 is a schematic diagram showing the functional configuration of a specific processing module of a data processing device. [Figure 13]FIG. 13 is a drawing schematically showing an example of an operation flow of a specific process by a data processing device.

Embodiments for Carrying Out the Invention

[0013] Hereinafter, embodiments for implementing the present disclosure will be described with reference to the drawings. The same parts are denoted by the same reference numerals, and redundant descriptions will be omitted.

[0014] First, the terms used in the description of this case will be described.

[0015] In the following embodiments, the processor can be a single arithmetic unit or a combined arithmetic unit that is a combination of a plurality of arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of a plurality of types of arithmetic units. Exemplary arithmetic units can include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), or an APU (Accelerated Processing Unit).

[0016] In the following embodiments, the RAM (Random Access Memory) is a memory that can temporarily store information, and this memory is used as a work memory by the processor.

[0017] In the following embodiments, the storage is one or more non-volatile storage devices that store data such as programs providing various media and various parameters. Exemplary non-volatile storage devices can include SSDs (Solid State Drives) including flash memory, magnetic disks (e.g., hard disks), or memory devices such as magnetic tapes.

[0018] In the following embodiments, the communication interface (I / F) is an interface that includes communication devices such as a communication processor and an antenna. The communication interface enables communication between multiple computers. The communication interface can use wireless communication standards, including, as exemplary applicable communication standards, 5G mobile communication standards (5th Generation Mobile Communication System), various Wi-Fi® or Bluetooth® standards.

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0020] Figure 1 is a schematic diagram illustrating an exemplary data processing system according to an embodiment. A data processing system, data processing device, and wearable device relating to the technology of this disclosure will be described in accordance with the attached drawings.

[0021] Referring to Figure 1, the data processing system 10 comprises a data processing device 12 and a necklace-type terminal 14. The exemplary data processing device 12 may include a server. Subsequently, the exemplary data processing device 12 and the exemplary necklace-type terminal 14 are described. In the following description, the data processing device 12 is an example of a “data processing device” relating to the technology of this disclosure, and the necklace-type terminal 14 is an example of a “necklace-type terminal” relating to the technology of this disclosure. The data processing system 10, the data processing device 12 and the necklace-type terminal 14 are located in a room 61. Plants 70 to be grown are placed in the room 61.

[0022] The necklace-type terminal 14 is attached to an autonomously mobile organism and is configured to collect data using a sensor device in an area where plants 70 are grown (hereinafter referred to as the "growth area 69"). The collected data can be processed by the necklace-type terminal 14 and reflected in the operation of the necklace-type terminal 14. The collected data can also be sent to the data processing device 12, where it is processed and reflected in the operation of the data processing device 12. Furthermore, the collected data is processed by the data processing device 12, which generates processing results. These processing results are sent to the necklace-type terminal 14 and reflected in the operation of the necklace-type terminal 14. The necklace-type terminal 14 is an example of a wearable device. One new application of such wearable devices is in the field of plant cultivation.

[0023] From one perspective, plant cultivation requires various environmental sensor devices to detect its environment. Environmental sensor devices differ in function from audio sensors, image sensors, acceleration sensors, and gyroscope sensors. For this reason, environmental sensor devices are preferably provided as dedicated devices for the necklace-type terminal 14.

[0024] From another perspective, plant cultivation is related to the living environment and lifestyle of the plant grower (referred to as "User 20" in the following explanation, referring to the user of the wearable device). Accordingly, plant cultivation, specifically the cultivation of plants 70 in a living room 61, requires systems and devices that are integrated with User 20's daily life. Examples of what is required of the system and devices include enabling User 20 to maintain an optimal growing environment without effort, and / or assisting User 20's plant cultivation knowledge in preparing the growing environment. The user is both the wearer and the user of the wearable device.

[0025] From a further perspective, looking at user 20, their daily lives vary from person to person and are not standardized. Accordingly, wearable devices, especially for plant cultivation, use their onboard sensor devices, such as biosensors, to collect sensor data on user 20's behavior and lifestyle.

[0026] From the above perspective, a wearable device can acquire sensor data (specifically, environmental sensor data and biosensor data) from environmental sensor devices and biosensor devices. This sensor data is processed in at least one of the data processing system 10, data processing device 12, and necklace-type terminal 14, and such processing enables the desired collaboration.

[0027] These perspectives can be further elaborated as follows:

[0028] The wearable device will be able to collect user 20 behavioral data, specifically enabling real-time monitoring of user 20's activity status (e.g., daily activities such as travel, sleep, indoor activities, and outdoor activities). The wearable device is equipped with a biosensor device that acquires data on the user's behavior and activity status, and an environmental sensor device that acquires data on the state of the plant being grown and the environment surrounding that plant. This allows for the provision of data that links the user's lifestyle to the growth of the plant. An exemplary wearable device, specifically a necklace-type terminal, can be equipped with a biosensor device that acquires user 20 behavioral data and an environmental sensor device that acquires environmental data of plants being grown, in terms of the user 20's wearing position and shape. The coordination between plant cultivation and user behavior can be supported, for example, by using artificial intelligence (AI), including large language models (LLMs), through acoustic sensors such as sound collectors in wearable devices, and electroacoustic transducers such as speakers.

[0029] Artificial intelligence is installed in at least one of the data processing device 12 and the necklace-type terminal 14 to provide a learning function. Specifically, the artificial intelligence can learn the behavioral patterns of user 20 based on biosensor data from a biosensor device and construct a user lifestyle model. The artificial intelligence can also collect general plant cultivation data and construct a cultivation model using the collected data. Specifically, the artificial intelligence can learn the cultivation of plants 70 based on environmental sensor data from an environmental sensor device and construct a cultivation model. The user lifestyle model and cultivation model will be explained with reference to Figure 10.

[0030] To link user behavior with plant cultivation, the necklace-type terminal 14 collects user behavior data, and the collected behavior data is used to adjust the plant cultivation environment in the cultivation area 69 according to the user's lifestyle.

[0031] The link between plant cultivation and user behavior can be provided by the operation of the data processing system 10, and also by the operation of either the data processing device 12 or the necklace-type terminal 14, or a combination of both. For example, the necklace-type terminal 14 can use a biosensor device to identify the lifestyle of user 20, the absence of user 20 in the cultivation area 69, for example, user 20 going out. The data processing device 12 can detect, for example, a communication interruption between the biosensor device and the environmental sensor device to identify that user 20 is absent from the cultivation area 69, for example, user 20 going out. Accordingly, the data processing device 12 or the necklace-type terminal 14 can temporarily operate to create a cultivation environment in the cultivation area 69 that is more suitable for plant cultivation than user 20's living environment (for example, at least one of the appropriate lighting, humidity, and temperature for the plants at the current time).

[0032] The learning function operates in at least one of the data processing system 10, the data processing device 12, and the necklace-type terminal 14 to identify recurring patterns of user 20 behavior, such as going out and sleeping, or routine behaviors. In response to the identification of routine behaviors, such as going out, at least one of the data processing system 10, the data processing device 12, and the necklace-type terminal 14 constructs a suitable growing environment for the plant 70 in the growing area 69. This construction allows the plant to be returned from the growing environment to a suitable living environment at the expected end time of a routine behavior, such as going out.

[0033] The voice interface enables the user 20 to engage in interactive conversations with the necklace-type terminal 14 via acoustic devices such as a microphone and speaker. Specifically, the interactive conversations are conducted using spoken natural language.

[0034] The enhanced voice interface allows user 20 to query the necklace-type terminal 14 about the growth status and environment of plant 70 via voice commands. An example query is that user 20 can inquire about the growth status of plant 70 via voice commands. An example of interactive cultivation support is that the necklace-type terminal 14 responds in real time via voice to a voice query, for example, "What is the current state of the plant?" The response may include at least one of the current values ​​from the necklace-type terminal 14's sensor devices (e.g., the latest environmental data such as light intensity, temperature, and humidity). The response may also be generated by artificial intelligence. The acoustic device provides the response from the artificial intelligence, for example, via a speaker.

[0035] The automated response function is provided via an enhanced voice interface. This function enables artificial intelligence, including a large-scale language model, to provide answers to questions about plant cultivation by referencing values ​​from sensor devices. Such an enhanced voice interface can provide the user 20 with rapid, sequential responses, thereby enhancing their interest in and motivation for plant cultivation, and consequently improving cultivation efficiency.

[0036] The necklace-type terminal 14 can be equipped with environmental sensor devices. Exemplary environmental sensor devices may include a light sensor device, a humidity sensor device, a temperature sensor device, a carbon dioxide (CO2) concentration sensor device, and a soil moisture sensor device. The environmental sensor devices enable the real-time collection of plant growth environment data. The necklace-type terminal 14 is designed to mount the humidity sensor device and temperature sensor device in positions that minimize contact with the skin of living organisms. Furthermore, for growing aquatic plants, the exemplary environmental sensor device may include a temperature sensor device and an oxygen (O2) concentration sensor device separate from the necklace-type terminal 14.

[0037] The data processing device 12 and necklace terminal 14, capable of operating as described above, can be provided using exemplary hardware and exemplary computer code, which are described below. The following description describes exemplary hardware and exemplary computer code, which a person skilled in the art can modify based on the exemplary description to operate the data processing device 12 and necklace terminal 14 as described above.

[0038] The data processing device 12 includes a computer 22, a database 24, and a second communication unit including a communication interface 26, which can communicate with the necklace-type terminal 14 and external devices. The second communication unit can be configured to receive data from an external sensor device located outside the data processing device 12 and the necklace-type terminal 14, and can also be configured to transmit data to the external sensor device. The computer 22 is an example of a “computer” in the art of this disclosure. The computer 22 may include, for example, a processor 28, and memory such as RAM 30 and storage 32, the memory of which may be configured to store a map of the growing area 69. The processor 28, RAM 30, and storage 32 are connected to a bus 34. Similarly, the database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. The exemplary network 54 communicates via various wired or wireless telecommunication paths, such as a WAN (Wide Area Network) and / or LAN (Local Area Network), and wired or wireless optical communication paths.

[0039] The necklace-type terminal 14 includes a first communication unit, such as a computer 36 and a communication interface 44. The first communication unit can communicate wirelessly via telecommunications, using infrared light for optical communication, and / or ultrasonically via acoustic communication, for example, with a second communication unit and an external sensor device. The necklace-type terminal 14 may also include an acoustic collector, such as one or more microphones 38, one or more sensor devices 39, one or more speakers 40, and one or more cameras 42. The acoustic collector is configured to detect acoustic vibrations, including sound waves from outside the necklace-type terminal 14 and sound waves emitted by living organisms. The first communication unit is configured to receive data from an external sensor device located outside the necklace-type terminal 14 and can also be configured to transmit data to the external sensor device. The computer 36 may include, for example, a processor 46 and a storage unit, such as RAM 48 and storage 50. This storage unit can be configured to store a map of the rearing area 69. The processor 46, RAM 48, and storage 50 are connected to the bus 52. The microphone 38, speaker 40, and camera 42 are also connected to the bus 52.

[0040] An exemplary acoustic collector may include a microphone 38 and is configured to detect physical vibrations, including sound waves from outside the necklace-type terminal 14 and sound waves emitted by the wearer. The acoustic collector can collect sound waves in the frequency range of speech of living organisms. The acoustic collector can also collect sound waves in the frequency range of ultrasound emitted by plants. Ultrasound from plants can contain information about the presence and changes in plant stress.

[0041] An exemplary electroacoustic conversion device may include a speaker 40 and is configured to convert electrical signals from a second communication unit, such as the communication interface 44 of a necklace-type terminal 14, into physical vibrations.

[0042] The necklace-type terminal 14 is equipped with a microphone 38 and a speaker 40 as exemplary acoustic devices. Specifically, the microphone 38 receives the voice emitted by the user 20 and sounds from the user's surroundings. The microphone 38 can also receive the voice emitted by the user 20 and receives utterances including instructions from the user 20 via voice reception. The microphone 38 captures the voice emitted by the user 20, converts the captured voice into digital audio data, and provides it to the processor 46.

[0043] The speaker 40 outputs audio for instructions according to digital audio data from the processor 46. The speaker 40 can be, for example, a directional speaker that outputs audio towards the user 20's ears.

[0044] The sensor device 39 may include an environmental sensor device and a biosensor device. The biosensor device is configured to detect the wearer's biometric data. The environmental sensor device is configured to detect environmental data outside the necklace-type terminal 14.

[0045] Sensor devices 39, such as biosensor devices, can detect biometric data of the user 20, who is wearing the necklace-type terminal. For example, the biosensor device may include a heart rate sensor device and a blood oxygen sensor device. Accelerometers and gyroscopes on the necklace-type terminal 14 can provide sensor data indicating the wearer's movement. The biosensor device can communicate with the second communication unit of the data processing device 12. The data processing device 12 and the necklace-type terminal 14 can track the wearer's movement.

[0046] An exemplary biosensor device may include a motion sensor configured to detect moving objects over a certain area. The motion sensor on the necklace-type terminal 14 can detect the movement of the necklace-type terminal 14 as relative movement to surrounding objects.

[0047] Sensor devices 39, such as environmental sensor devices, can detect environmental data outside the necklace-type terminal 14.

[0048] An exemplary environmental sensor device may include an optical sensor device that detects light at the location of the necklace-type terminal 14. The exemplary optical sensor device may include a one-dimensional or two-dimensional visible light sensor and a one-dimensional or two-dimensional infrared light sensor. The exemplary optical sensor device may include a camera that detects light from the external environment of the necklace-type terminal 14. A field of the imaging device can function as both a visible light sensor and an infrared light sensor.

[0049] Sensor data from an exemplary visible light sensor can be analyzed to detect the amount of light at wavelengths that enable plant photosynthesis. Sensor data from an exemplary infrared light sensor can be analyzed to detect the amount of light at wavelengths that indicate the plant's growth status. This analyzed data allows for updating of the cultivation model.

[0050] The exemplary light sensor device can accurately measure the intensity and spectrum of light at the sensor location of the necklace-type terminal 14, and the sensor data from the light sensor device is used to determine the amount of light required for the plants in the growing area 69. The exemplary data processing device 12 can notify the necklace-type terminal 14 of at least one of insufficient light and additional light irradiation based on the sensor data, as well as at least one of excessive light and subsequent reduction in light irradiation. The exemplary necklace-type terminal 14 can notify the user of at least one of insufficient light and excessive light irradiation, as well as at least one of additional light and reduction in light irradiation, based on the sensor data, for example, as an alert.

[0051] An exemplary environmental sensor device may include at least one temperature sensor device that detects the temperature at the location of the necklace-type terminal 14.

[0052] The exemplary temperature sensor device can measure ambient temperature at the sensor location of the necklace-type terminal 14, and the sensor data from the temperature sensor device is used to determine the temperature required for plant growth in the growing area 69. The exemplary data processing device 12 notifies the necklace-type terminal 14 of at least one of low temperature and rising room temperature, as well as at least one of high temperature and falling room temperature, based on the sensor data. The exemplary necklace-type terminal 14 also notifies the user of at least one of low temperature and high room temperature, for example as an alert, and suggests to the user, for example as an alert, at least one of rising and falling room temperature.

[0053] An exemplary environmental sensor device may include a humidity sensor device that detects humidity at the location of the necklace-type terminal 14.

[0054] An exemplary humidity sensor device can measure humidity at the sensor location of the necklace-type terminal 14, and the sensor data from the humidity sensor device is used to determine the humidity required for plant growth in the growing area 69. The exemplary data processing device 12 uses the sensor data to notify the necklace-type terminal 14 of at least one of low humidity and dryness, e.g., humidification or ventilation, and at least one of excessive humidity and high humidity, e.g., dehumidification or ventilation. The exemplary necklace-type terminal 14 uses the sensor data to notify the user, for example, as an alert, of at least one of low humidity and dryness, e.g., humidification or ventilation, and at least one of excessive humidity and high humidity, e.g., dehumidification or ventilation.

[0055] An exemplary environmental sensor device may further include a carbon dioxide sensor device that detects the carbon dioxide concentration at the location of the necklace-type terminal 14.

[0056] An exemplary carbon dioxide sensor device can measure the concentration of carbon dioxide at the sensor location of the necklace-type terminal 14. Sensor data from the carbon dioxide sensor device is used to determine an appropriate carbon dioxide concentration for the growth of plants 70 in the growing area 69. At least one of the exemplary necklace-type terminal 14 and the data processing device 12 uses the sensor data to notify the user, for example, as an alert, of an environment that enables efficient photosynthesis of plants.

[0057] The second communication unit of the data processing device 12 can communicate with an environmental sensor device, the environmental sensor device includes at least one of a light sensor device, a humidity sensor device, a temperature sensor device, and a carbon dioxide sensor device.

[0058] An exemplary environmental sensor device may further include a soil sensor device capable of detecting at least moisture (e.g., moisture content, soil hydrogen ion concentration, pH). The exemplary soil sensor device may include a soil sensor protruding from the appearance of the necklace-type terminal 14, and a wireless communication unit connected to this soil sensor.

[0059] An exemplary soil sensor device can be configured to be detachable from the necklace-type terminal 14. When the wireless communication unit of the soil sensor device is separated from the necklace-type terminal 14, it can be configured to communicate with the first communication unit of the necklace-type terminal 14.

[0060] The soil moisture sensor device measures the moisture content of the soil in which plants are planted within the growing area 69. It provides the user with suggestions appropriate for plant growth, specifically root growth. At least one of the exemplary necklace-type terminal 14 and data processing device 12 uses the sensor data to suggest water replenishment in response to dryness, and to suggest soil drying or drainage, or stopping further water supply, in response to excessive moisture that can cause root rot.

[0061] The environmental sensor device may include at least one of the following: a light sensor device, a humidity sensor device, a temperature sensor device, a carbon dioxide sensor device, a soil sensor device, and a water-resistant water temperature sensor device capable of detecting at least water temperature.

[0062] An exemplary camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and a one-dimensional or two-dimensional image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor device or a CCD (Charge Coupled Device) image sensor device, which can capture images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the field of vision of a typical healthy person).

[0063] The communication interface 44 is connected to the network 54. The communication interface 44 and the communication interface 26 provide a communication path between the processor 46 and the processor 28 via the network 54, enabling the transmission and reception of data signals related to various information between the processor 46 and the processor 28.

[0064] Figure 2 is a diagram showing the main functional blocks of an exemplary data processing device and a necklace-type terminal according to an embodiment.

[0065] In the data processing device 12, the processor 28 can execute specific processing defined by one or more program codes. Exemplary program codes are stored in the storage 32 as one or more specific processing programs 56. The memory of the data processing device 12, for example, the storage 32, is connected to the processor 28 and is configured to store program codes.

[0066] Specifically, the processor 28 reads a specific processing program 56 from the storage 32 and loads the read specific processing program 56 into the RAM 30. The processor 28 then executes the specific processing program 56 in the RAM 30. The executed specific processing program 56 defines a specific process, which is provided as a specific processing module defined by the specific processing program 56 executed by the processor 28 in the RAM 30. The specific processing module (for example, the specific processing unit 290 in Figure 2) represents the specific processing module that is currently being executed.

[0067] Specifically, in the data processing device 12, when the program code is executed by the processor 28, the processor 28 can trigger the following processing of a specific processing module: inputting a prompt containing text representing the content of a speech generated from the acoustic data of the output data of the necklace-type terminal 14 as a user utterance into the data generation model 58, and obtaining a response to the utterance using the output data of the data generation model 58.

[0068] Furthermore, in the data processing device 12, when the program code is executed by the processor 28, the processor 28 can trigger at least one of the following modules: When the user utterance satisfies a predetermined trigger condition, input a prompt containing the user utterance to the data generation model 58, and obtain a response to the user utterance using the output result of the data generation model 598.

[0069] Furthermore, in the data processing device 12, when the program code is executed by the processor 28, the processor 28 may trigger the following exemplary module: determining the presence or absence of the necklace-type terminal 14 in the growth area 69.

[0070] In the data processing device 12, the program code for the processes already described and those to be described further can trigger the processor 28 to execute the respective processing modules.

[0071] The exemplary storage 32 can store a data storage unit 55 and a data generation model 58. The data generation model 58 is used by one or more modules of the specific processing unit 290. The data storage unit 55 can also store data generated by the execution of a module in association with that module.

[0072] Referring to Figure 2, in the necklace-type terminal 14, the storage 50 stores the data acquisition program 60. The processor 46 executes the data acquisition program 60 to perform data acquisition processing. Specifically, the processor 46 reads the data acquisition program 60 from the storage 50 and loads the read data acquisition program 60 into the RAM 48. The processor 46 executes the data acquisition program 60 on the RAM 48. The data acquisition processing is provided as a data acquisition module defined by the data acquisition program 60 executed by the processor 46 on the RAM 48. The control unit 46A in Figure 2 shows the data acquisition module in operation.

[0073] In the necklace-type terminal 14, the program code for the processes already described and those to be described further can trigger the processor 46 to execute the respective process modules.

[0074] The necklace-type terminal 14 may further include a secondary battery 16b and a power supply device 16c, the power supply device 16c being configured to supply power from the secondary battery 16b to the device within the necklace-type terminal 14.

[0075] Figure 3 is a schematic diagram illustrating the appearance of an exemplary necklace-type terminal. Figure 3 shows a side view of the exemplary necklace-type terminal. Figure 4 is a schematic diagram illustrating the appearance of another exemplary necklace-type terminal. Figure 4 shows a top view of the exemplary necklace-type terminal.

[0076] Referring to Figures 3 and 4, the necklace-type terminal 14 is equipped with one or more microphones 38, one or more sensor devices 39, one or more speakers 40, and one or more cameras 42. These are supported by a support 15 of the necklace-type terminal 14. The exemplary support 15 may include one or more arms (15b, 15c, 15d). At least a portion of the arms (15b, 15c, 15d) may include, for example, metal or a biocompatible flexible member.

[0077] The exemplary necklace-type terminal 14 in Figure 3 has a single arm 15b having one end and the other end. The single exemplary arm 15b(15) may be equipped with a single microphone 38, a single sensor device 39, a single speaker 40, and a single camera 42. The arm 15b of the necklace-type terminal 14 in Figure 3 has a microphone 38 mounted at one end, and the microphone 38 is positioned on the necklace-type terminal 14 so as to face forward of the user 20 wearing the necklace-type terminal 14. The arm 15b also has a speaker 40 mounted at the other end, and this speaker 40 is positioned so as to face upward of the user 20 wearing the necklace-type terminal 14. The microphone 38 and the speaker 40 can be positioned on the arm 15b so as to be spaced apart from each other. Furthermore, the arm 15b can be equipped with one or more cameras 42 on one of the opposing surfaces (front or back) extending from one end to the other, and these cameras 42 can be positioned on the arm 15b so as to face forward of the user 20 wearing the necklace-type terminal 14. Specifically, the arm 15b can be equipped with cameras 42 on both its front and back surfaces, making it possible to orient one of the cameras 42 toward the user 20. The arm 15b can be equipped with one or more sensor devices 39 between its one and other ends, and these sensor devices 39 can be positioned on the arm 15b so as not to move away from the user 20 wearing the necklace-type terminal 14.

[0078] The exemplary necklace-type terminal 14 in Figure 4 has a right arm 15c and a left arm 15d, each of which has one end and the other end. The right arm 15c and the left arm 15d can be connected at one end, for example, by a hinge or fastener, and their other ends are spaced apart. In the exemplary necklace-type terminal 14 in Figure 4, the right arm 15c and the left arm 15d are each equipped with a microphone 38, and the microphones 38 on these arms are positioned to face forward of the user 20 wearing the necklace-type terminal 14. The right arm 15c and the left arm 15d are each equipped with a speaker 40, and the speakers 40 on these arms are positioned to the right and left sides of the user 20 wearing the necklace-type terminal 14. The right arm 15c and the left arm 15d are each equipped with a camera 42, and these cameras 42 can be positioned on their respective arms to face forward of the user 20 wearing the necklace-type terminal 14. The right arm 15c and the left arm 15d are each equipped with a sensor device 39, and the sensor devices 39 on these arms are positioned to the right and left sides of the user 20 wearing the necklace-type terminal 14. For example, at least one of the sensor devices 39 on the right arm 15c and the left arm 15d can be positioned inside the right arm 15c and the left arm 15d so as to approach or contact the neck, for example, of the user 20 wearing the necklace-type terminal 14.

[0079] Figure 5 is a plan view showing an exemplary room in which an exemplary data processing system 10 can be operated. Figure 6 is a schematic diagram illustrating exemplary lighting control in the room of Figure 5. Figure 7 is a schematic diagram illustrating exemplary lighting control in the room of Figure 5. Figure 8 is a schematic diagram illustrating exemplary water supply in the room of Figure 5. Figure 9 is a schematic diagram illustrating exemplary soil moisture detection in the room of Figure 5.

[0080] The living room 61 in Figure 5 can be used by the user to carry out their daily activities. The user's living room 61 has a window 62 that can let in light from the outside, an entrance 63 that allows entry and exit to the living room 61, a sanitary area 64, a kitchen 65, walls 66, furniture for sleeping such as a bed 67, ventilation equipment 68 such as a ventilation fan (an exhaust fan 68b for exhausting to the outside and an intake fan 68c for drawing in air from the outside), and a "growth area 69", in other words, an area for growing plants 70. The arrangement of these main items can be stored as a map (map data) in the memory of the data processing device 12 and the necklace-type terminal 14. Alternatively, the map data can be provided in advance to the data processing system 10 by the user. Alternatively, the map data can be created by the data processing system 10 based on biosensor data and its stored data. The living room 61 is separated from the outside by the window 62, the entrance 63, and the walls 66. The arrows shown near the ventilation device 68 indicate the direction of rotation of the ventilation fan of the ventilation device 68.

[0081] The data processing device 12 and necklace-type terminal 14 of the data processing system 10 are located in an exemplary living room 61, as shown in Figure 5. The data processing device 12 can be connected to the external internet 53. The second communication unit of the data processing device 12 may be equipped with a communication interface 44 that connects to the internet 53. The double-arrow mark "80" indicates that communication is possible via the network 54.

[0082] As already explained, the data processing system 10 includes a data processing device 12 and a necklace-type terminal 14. In addition, the data processing system 10 may further include at least one of the following: a dimming device 71 (see Figure 6), a water supply device 72, a humidity control device 73, an external sensor device 74 such as a soil sensor, and an air conditioning device 76.

[0083] An exemplary dimming device 71 is configured to adjust the light to be provided to the growing area 69. An exemplary watering device 72 is capable of supplying the water to be provided to the plants 70. An exemplary humidity control device 73 (specifically, a humidifier and a dryer) is configured to adjust the humidity to be maintained in the growing area 69. An exemplary air conditioning device 76 is configured to adjust the temperature to be maintained in the growing area 69. An exemplary ventilation device 68 is configured to adjust the amount of carbon dioxide to be maintained in the growing area 69.

[0084] The humidity control device 73, such as a dehumidifier and a humidifier, can adjust the humidity of the living room 61. The humidity control device 73 can communicate with at least one of the data processing device 12 and the necklace-type terminal 14. In addition, the air conditioning device 76 can adjust the temperature and humidity of the living room 61. The air conditioning device 76 can communicate with at least one of the data processing device 12 and the necklace-type terminal 14.

[0085] Figures 6, 7, 8, and 9 are schematic diagrams illustrating an example of cultivation using environmental sensor devices in the living room shown in Figure 5.

[0086] Referring to part (a) of Figure 6, the plant 70 is placed against the wall (66) and is illuminated using a lighting fixture 75b (e.g., a downlight) installed on the ceiling of the living room 61 as a dimming device 71. This lighting fixture 75b can communicate with at least one of the data processing device 12 and the necklace-type terminal 14. The lighting fixture 75b can change the light intensity in steps or continuously. This allows the amount and duration of light irradiation to the plant 70 to be adjusted.

[0087] Referring to part (b) of Figure 6, the plant 70 is placed against the wall (66) and is illuminated using a light fixture 75c (e.g., an electric stand) placed on a support stand in the living room 61 as a dimming device 71. This light fixture 75c is capable of communicating with at least one of the data processing device 12 and the necklace-type terminal 14. The light fixture 75c can change the light intensity in steps or continuously. This allows for adjustment of the light intensity and illumination time of the light irradiated onto the plant 70.

[0088] Referring to section 6(c) of Figure 6, the plant 70 is placed on a support stand by the window (62) and can receive light from outside through the window 62. The plant 70 is illuminated using a dimming device 71 via a light shield 77 (for example, a device with adjustable light transmittance and shading) located on the support stand in the living room 61. This light shield 77 can communicate with at least one of the data processing device 12 and the necklace-type terminal 14. The light shield 77 can change the amount of light in steps or continuously.

[0089] Referring to parts 7(a) and 7(b) of Figure 7, the plant 70 is placed on a support stand by the window (62) and can receive light from outside through the window 62. The plant 70 is illuminated using a dimming device 71 via a light-shielding device 78 (e.g., a blind curtain device) mounted along the window 62. This light-shielding device 78 can communicate with at least one of the data processing device 12 and the necklace-type terminal 14. The light-shielding device 78 can change the amount of light in steps or continuously. Referring to part 7(a) of Figure 7, the plant 70 receives light from outside through the window 62 and the light-shielding device 78. Referring to part 7(b) of Figure 7, the light-shielding device 78 blocks some or all of the light from the window 62. This light-shielding device 78 can communicate with at least one of the data processing device 12 and the necklace-type terminal 14. The light-shielding device 77 can change the amount of light in steps or continuously.

[0090] Referring to parts (a), (b), and (c) of Figure 8, the plant 70 is placed against the wall (66) on a support stand in the living room 61. In part (a) of Figure 8, the plant 70 is watered using a watering can or similar device 79 by a person who has been notified of the need for watering via a necklace-type terminal 14.

[0091] In part 8(b) of Figure 8, the plants 70 are supplied with water using a watering device 81 (e.g., a sprayer) positioned on a support stand in the living room 61 as the watering device 72. This watering device 81 can communicate with at least one of the data processing device 12 and the necklace-type terminal 14. This allows for adjustment of the amount of water supplied to the plants 70, as well as the supply period and supply time. The sprayer can replenish the plants 70 with water in a form similar to moisture in the air.

[0092] Referring to section 8(c) of Figure 8, water is supplied using a water supply device 82 (e.g., a water dispenser) positioned on a support base in the living room 61 as the water supply device 72. This water supply device 82 can communicate with at least one of the data processing device 12 and the necklace-type terminal 14. This allows for adjustment of the amount of water supplied to the plants 70, as well as the supply period and supply time. The water dispenser can replenish water in the soil in which the plants 70 are planted.

[0093] Referring to parts 9(a) and 9(b), the plant 70 is placed on a support stand by the window (62) and receives light from outside through the window 62. Although a light shield 78 is not depicted on the window 62, a light shield 78 may be attached. Referring to part 9(a), the sensor 83 of a soil moisture sensor device is inserted into the soil of the plant 70. Sensor 83 is used as an example of an external sensor device 74. When removed from the soil, sensor 83 can be attached to the necklace-type terminal 14. Sensor 83 can communicate with the remaining necklace-type terminal 14. Referring to part 9(b), the sensor of a soil moisture sensor device 84 placed on a support stand is inserted into the soil of the plant 70. The soil moisture sensor device 84 is an example of an external sensor device 74 separate from the necklace-type terminal 14. The soil moisture sensor device 84 can communicate with the necklace-type terminal 14.

[0094] As already explained, artificial intelligence can provide the exemplary data processing system 10 with a trained user life model and a trained nurturing model. These trained models can be installed in at least one of the data processing device 12 and the necklace-type terminal 14.

[0095] Specifically, the artificial intelligence learns the user's behavioral patterns based on biosensor data from biosensor devices, and creates and updates a trained user life model. An exemplary user life model includes, but is not limited to, information on the dailyity and similarity of behaviors extracted over a period such as a day or a week. The trained user life model can provide predictive behaviors that follow dailyity and similarity, and can identify the peculiarities of behaviors that deviate from the trained user life model. The trained user life model can be updated based on new sensor data.

[0096] Furthermore, exemplary cultivation models include, but are not limited to, plant species, plant growth status, estimated calendar dates, plant placement within cultivation area 69, and planned maintenance of the cultivation environment, such as watering and light irradiation. Cultivation suggestions based on the trained cultivation model are provided to the user. These suggestions can be made according to user requests or the learning results of the cultivation model. The suggestions reduce the user's burden in managing plant cultivation, either partially or entirely. As a result, cultivation according to the suggestions provides high-quality plants. The trained cultivation model can be constructed to cultivate plants according to the user's lifestyle, as shown in the trained user lifestyle model. The trained cultivation model can be updated based on new sensor data.

[0097] Artificial intelligence can provide growth predictions tailored to the environment of the living space 61. Growth predictions are made using a trained cultivation model. Based on data collected from sensor devices, the growth predictions can forecast the growth of plants in the cultivation area 69. Specifically, the growth predictions can be corrected based on past plant growth data and current environmental data. Based on these predictions, at least one of the data processing device 12 and the necklace-type terminal 14 can notify the user 20 in advance of the timing for watering and fertilizing. The timing for watering and fertilizing can be determined based on a trained user lifestyle model.

[0098] This prediction can be made using collected data, as well as general plant cultivation information provided by artificial intelligence. The growth prediction allows users to be notified of the next plant care, flowering, and harvesting times.

[0099] Artificial intelligence can detect deviations from growth predictions. This deviation detection is performed by continuously monitoring the presence and magnitude of deviations in the actual plant growth based on a trained growth model. The magnitude of the deviation is compared to a threshold, and if the comparison indicates a large deviation, the user can be notified. Along with this notification, or at the user's request, the artificial intelligence will suggest appropriate countermeasures. This increases the likelihood of proper plant growth and development.

[0100] Figure 10 is a diagram illustrating the schedule for exemplary user life models and training models. The horizontal axis shows the passage of time, from Friday to the following Friday, in days, while the vertical axis shows the trained user life models and training models, as well as any changes made to these models.

[0101] Referring to Figure 10, specifically, the sleep period 85b and the outing period 86b of the trained user lifestyle model are shown, as well as the period of environmental change 87 (environmental change of the training area 69 87b) of the trained training model. Furthermore, the period of the modified environmental change 88, which is corrected from the trained training model based on data from the sensor device, and the timing of the proposed training model 89 based on the changed environmental change period are shown.

[0102] The user lifestyle model (85, 86) learned that user 20 goes to sleep and wakes up at regular times throughout the week, and leaves and returns home at regular times on weekdays. Accordingly, the nurturing model learned to make environmental changes 87b, such as adjusting the temperature of the nurturing area 69, during weekday hours when the user is absent.

[0103] Data from biosensor devices and environmental sensor devices detects that the user is regularly waking up and staying indoors on weekends, specifically Saturdays and Sundays. In response, the care model, on weekends, instead of changing the environment 87b (e.g., humidity) in the care area 69, provides voice suggestions (89b, 89c) to the user as planned. These suggestions (89b, 89c) may include providing natural language voice messages, such as "It's a little dry," when humidity is low.

[0104] Furthermore, data from biosensor devices and environmental sensor devices indicates that on a particular weekday, specifically Wednesday, the user does not leave the house at a regular time after waking up regularly. In response to this exceptional behavior, the nurturing model identifies the need to suspend environmental changes 87b (e.g., temperature) in the nurturing area 69 during the user's absence on weekdays. In response, the nurturing model provides the user with a voice suggestion (89d) instead of changing the environment 87b in the nurturing area 69 on weekdays with exceptional user behavior. The suggestion (89d) may include friendly natural language voice messages, such as "It's a little chilly" when the temperature is low.

[0105] Figure 11 is a schematic diagram illustrating the functions of an exemplary necklace-type terminal. This necklace-type terminal 14 performs exemplary data collection processing to collect data and communication control processing to communicate the collected data.

[0106] An exemplary control unit 46A includes a data acquisition module, indicated as a data acquisition unit 100, and a communication control module, indicated as a communication unit 102. In the necklace-type terminal 14, the program code for the processes described thereafter can be configured to cause the processor 46 to invoke the respective processing modules when executed by the processor 46.

[0107] The data acquisition unit 100 collects output data from various sensor devices mounted on the necklace-type terminal 14, including the microphone 38, sensor device 39, and camera 42.

[0108] Specifically, the necklace-type terminal 14 uses a biosensor device in its data collection process to collect the wearer's biometric data in real time. This real-time biometric data allows for the identification of the wearer's activity status, such as whether they are sleeping or awake. Furthermore, the necklace-type terminal 14 can periodically or irregularly collect various types of data indicating the wearer's surroundings, rather than their biometric data, using its built-in sensor device. Specifically, the necklace-type terminal 14 can collect various types of data indicating the wearer's surroundings, such as ambient data including images and sounds, as well as environmental data such as temperature, humidity, and carbon dioxide concentration, using its built-in sensor device. For example, image data from the camera 42 can be used to identify the presence and type of plants in a specific area.

[0109] The communication unit 102 transmits output data provided by sensor devices and bio-devices, as well as data collected by the data acquisition unit 100, such as output data from the microphone 38, sensor device 39, and camera 42, to the data processing unit 12. The communication unit 102 also receives data from the data processing unit 12. The received data includes response data generated by the data processing unit 12 in response to the transmitted data, and general data independently generated by the data processing unit 12.

[0110] The data processing device 12 can perform specific processing using the specific processing unit 290 to acquire a response to user utterance data from the necklace-type terminal 14.

[0111] In the example identification process, response data to user utterances collected by the microphone 38 of the necklace-type terminal 14 is generated using the data generation model 58.

[0112] Figure 12 is a schematic diagram illustrating the functions of a specific processing module of a data processing device. The exemplary specific processing module 290 comprises an input module shown as input unit 292, a processing module shown as processing unit 294, and an output module shown as output unit 296. The exemplary input unit 292 and output unit 296 are located within the processor 28. The input unit 292 is configured to receive output data from the necklace-type terminal 14, and the output unit 296 is configured to send generated data to be provided to the necklace-type terminal 14 in response to the received output data indicating voice.

[0113] The input module (input unit 292) performs the following control. Specifically, the input module acquires acoustic data, including user utterances, collected by the necklace-type terminal 14. The necklace-type terminal 14 collects acoustic data of user utterances picked up by the microphone 38 and sends it to the data processing device 12. The data processing device 12 provides the received acoustic data to the input module (input unit 292).

[0114] The input module receives output data from the necklace-type terminal 14, such as output data from the microphone 38, sensor device 39, and camera 42, and stores the received data in the data storage unit 55 (data storage area) of the storage 32.

[0115] The processing module (processing unit 294) performs the following control. Specifically, it performs specific processing using the data generation model 58. Specifically, the processing module (processing unit 294) inputs a prompt containing user utterance text data to the data generation model 58 and receives the generation result from the data generation model 58. The prompt used in this case may include not only text data but also output data from various sensor devices of the necklace-type terminal 14, for example, output data from the sensor device 39 and camera 42 collected by the data acquisition unit 100.

[0116] The output module (output unit 296) performs the following control. Specifically, the output module performs the process of transmitting the result data of a specific process in a format usable by the necklace-type terminal 14. The result data of the specific process reaches the necklace-type terminal 14, and the necklace-type terminal 14 outputs the result of the specific process from the speaker 40. The processing of the necklace-type terminal 14 is performed by the output processing module in the control unit 46A.

[0117] According to these modules, user utterances are collected by the microphone 38 and sent from the necklace-type terminal 14 to the data processing unit 12. The data processing unit 12 applies specific processing to the user utterance data and causes the data generation model 58 to generate a response. The result of the specific processing is output from the speaker 40, and the sound from the speaker 40 reaches the hearing of the user 20.

[0118] After the output of acoustic data from the speaker 40 of the necklace-type terminal 14 is complete, the microphone 38 is activated to collect further user utterances from the user 20. Specifically, the microphone 38 can further collect user utterances regarding the results of specific processing provided as audio from the speaker 40.

[0119] The necklace-type terminal 14 transmits voice data representing user utterances acquired by the microphone 38 to the data processing device 12, for example, using the control unit 46A. The voice data reaches the data processing device 12 and is processed by the specific processing unit 290 as voice data of user utterances.

[0120] The data generation model 58 can be considered a so-called generative AI. An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">It can be used in generative AI such as the following. The data generation model 58 is constructed by performing deep learning on a neural network. The data generation model 58 receives a prompt containing instructions indicating the data to be generated, and inference data such as audio data indicating speech, text data indicating text, and image data indicating images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompt, and outputs the inference results in various data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0121] As can be understood from the above description, the data generation model 58 can perform the following exemplary specific processing. The data generation model 58 receives visible light image data, including an image of a plant, from the necklace-type terminal 14. The data generation model 58 can also generate the results of specific processing, including the type of plant and / or the method of plant cultivation, based on the visible light image data, in response to prompts including instructions asking for the type of plant and / or the method of plant cultivation.

[0122] Once the data processing device 12 and the necklace-type terminal 14 receive the results of a specific process related to plants, such as the type of plant and / or the method of growing the plant, they can store this data in the data storage unit 55 and the storage 50.

[0123] The wearer communicates a question to the necklace-type terminal 14 by voice regarding the plant being grown or the plant they wish to grow. The result of a specific processing in response to this question is provided.

[0124] The wearer communicates a question about the condition of the plant being grown to the necklace-type terminal 14 through speech. The result of the specific processing in response to this question is provided. In response to this question, the necklace-type terminal 14 can attach data from sensor devices acquired immediately based on instructions from the wearer, such as visible light image data, infrared image data, ultrasonic acoustic data, and at least one value from an environmental sensor device, in real time. The result of a specific processing for this question is then provided.

[0125] The data processing device 12 and the necklace-type terminal 14 store output data from sensors such as a microphone 38, a sensor device 39, and a camera 42.

[0126] The necklace-type terminal 14 can collect ambient condition data such as images and sounds, as well as ambient environmental data such as temperature, humidity, and carbon dioxide concentration, using the sensor device 39. The necklace-type terminal 14 can acquire ambient environmental data periodically or irregularly. In response to the detection of at least one of the temperature, humidity, and carbon dioxide concentration levels that are unsuitable for the growing plant 70, the necklace-type terminal 14 provides a message audio from the speaker 40 without delay indicating this detection.

[0127] The necklace-type terminal 14 can send ambient environmental data acquired periodically or irregularly to the data processing device 12. The received ambient environmental data is stored in the data processing device 12. The data processing device 12 examines the stored ambient environmental data in chronological order and generates auxiliary data such as the duration of detection of inappropriate ranges of temperature, humidity, and carbon dioxide concentration, and / or the frequency of detection over a certain period in the past (e.g., one month). This auxiliary data is sent from the data processing device 12 to the necklace-type terminal 14, and the necklace-type terminal 14 provides a message voice from the speaker 40 indicating the content of the auxiliary data. This provision can be made, for example, without delay upon receipt of the auxiliary data or at a scheduled time.

[0128] The biosensor device of the exemplary sensor device 39 may include a heart rate sensor device and a motion sensor device. The motion sensor device may be configured to detect moving objects within at least a certain area of ​​the living space 61. The motion sensor device mounted on the necklace-type terminal 14 can detect the movement of the wearer wearing the necklace-type terminal 14 as relative movement of surrounding objects. The motion sensor device mounted on the data processing device 12 can detect the movement and absence of the wearer wearing the necklace-type terminal 14.

[0129] As already explained, the necklace-type terminal 14 may further include a secondary battery 16b and a power supply device 16c. The power supply device 16c manages the remaining charge of the secondary battery 16b. In response to a decrease in the remaining charge, the necklace-type terminal 14 can provide an alert indicating low charge, for example, from a speaker 40.

[0130] The necklace-type terminal 14 can send charge level data indicating the remaining charge to the data processing device 12. Based on the charge level data, the data processing device 12 can determine whether the necklace-type terminal 14 remains outside the communication area with the wearer when communication with the necklace-type terminal 14 is lost.

[0131] The data processing device 12 can communicate with the necklace-type terminal 14, but when it cannot detect a biological response from the data from the biosensor device, it determines that the necklace-type terminal 14 is not being worn by the user 20. After this determination, the necklace-type terminal 14 sends data from the sensor device (e.g., temperature, humidity, and carbon dioxide concentration detection data) and data from the biosensor device to the data processing device 12, which can store the received data in a time series. The time series data thus stored is input to, for example, the data generation model 58, along with a prompt instructing data analysis. The data generation model 58 can generate the results of specific processing, including data analysis.

[0132] The result of this specific processing can be sent from the data processing device 12 to the necklace-type terminal 14. This transmission can be made, for example, in response to the necklace-type terminal 14 sending data to the data processing device 12 indicating that it has been reattached by detection by its sensor device. The necklace-type terminal 14 can provide a message indicating the result of the specific processing, for example, from the speaker 40. This message may include a series of few words, for example, "Please replenish the water," "Please raise the room temperature," or "Please ventilate." Water supply alerts can be made based on data from the soil sensor device. Room temperature alerts can be made based on data from the temperature sensor device. Ventilation alerts can be made based on the humidity sensor device and / or the carbon dioxide concentration sensor device.

[0133] When the necklace-type terminal 14 identifies an utterance such as "I'm going out" as the voice of the wearer wearing the necklace-type terminal 14, this utterance data is identified by the data processing device 12 and identified by the data processing device 12 as a notification of the wearer's absence. In the time-series operation, the data processing device 12 can identify that the necklace-type terminal 14 is not being worn by the wearer when it cannot detect a biological response from the data from the biosensor device. After this identification of non-wearing, the data processing device 12 continues to identify that the necklace-type terminal 14 is not being worn when it receives data from the necklace-type terminal 14. After this identification, the necklace-type terminal 14 sends data from the sensor device (e.g., temperature, humidity, and carbon dioxide concentration detection data) and data from the biosensor device to the data processing device 12, and the received data can be associated with absence and stored chronologically by the data processing device 12. The data thus stored is input to, for example, the data generation model 58, along with prompts containing several words that instruct the analysis of the data. The data generation model 58 can generate the results of specific processing, including data analysis.

[0134] As can be understood from the above explanation, the data processing device 12 can respond to data received from the necklace-type terminal 14 and cause the data generation model 58 to execute specific processing corresponding to the received data.

[0135] In addition, the wearer of the necklace-type terminal 14 can provide the necklace-type terminal 14 with specific requests for specific processing as speech data through speech. The data processing device 12 can respond to the received data and requests for specific processing from the necklace-type terminal 14 and cause the data generation model 58 to execute the requested specific processing.

[0136] The data processing device 12 can provide the necklace-type terminal 14 with auxiliary data on cultivation methods specific to the plant being cultivated, depending on the type of plant being cultivated, such as spinach and komatsuna, in response to a request from the necklace-type terminal 14, or regardless of the request.

[0137] Figure 13 is a schematic diagram illustrating an exemplary operation flow of a specific process performed by the data processing device. The operation of the data processing system 10 will be explained with reference to Figure 13.

[0138] First, an example of the data collection process is shown below.

[0139] When user 20 is wearing the necklace-type terminal 14, the data acquisition unit 100 sequentially collects the outputs of the microphone 38, sensor device 39, and camera 42. The communication unit 102 sequentially transmits the outputs of the microphone 38, sensor device 39, and camera 42 collected by the data acquisition unit 100 to the data processing unit 12.

[0140] Next, an example of a specific processing flow will be explained with reference to Figure 13. The input module (input unit 292) of the data processing device 12 sequentially acquires output data received from the necklace-type terminal 14, such as the output data from the microphone 38, sensor device 39, and camera 42, and stores the acquired data in the data storage unit 55.

[0141] In operation S300, the processing module (processing unit 294) determines whether a predetermined trigger condition is met. Specifically, the trigger condition may be that the user utterance picked up by the microphone 38 contains a specific word (for example, the name of the agent installed in the necklace-type terminal 14) or a phrase (for example, "Hi! XX" (where "XX" is the name of the agent)).

[0142] If the trigger condition is met in operation S300 (operation S300; Yes), the data processing system 10 proceeds to operation S301. On the other hand, if the trigger condition is not met in operation S300 (operation S300; No), the data processing system 10 terminates the specific processing.

[0143] In operation S301, the processing module (processing unit 294) generates a prompt by adding an instruction to obtain the result of a specific process to the text representing the user utterance picked up by the microphone 38.

[0144] The generated prompt may include instructions such as, "The user is speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech.) Alternatively, the generated prompt may have output data from the sensor device 39 and the camera 42 added to it, and this additional data may include, for example, biometric data representing the user's heart rate and video data representing the user's surroundings. The generated prompt may also include instructions such as, "The user is speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech.)

[0145] In operation S303, the processing module (processing unit 294) inputs the generated prompt to the data generation model 58 and obtains the result of a specific process based on the output data of the data generation model 58.

[0146] In operation S304, the output module (output unit 296) outputs the result of the specific processing to the necklace-type terminal 14 and terminates the specific processing.

[0147] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure, but the system related to this disclosure is not limited to being implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer, or as an application that runs on a smartphone, etc. The method related to this disclosure may be provided to users in the form of SaaS (Software as a Service).

[0148] In the system according to the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing method for the specific process may be used, which includes computer 22 and multiple other computers.

[0149] In the system according to the above embodiment, an example was described in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0150] Furthermore, the specific processing program 56 can be stored in a storage device such as a server connected to the data processing device 12 via the network 54. The specific processing program 56 may also be downloaded and installed on the computer 22 upon request from the data processing device 12.

[0151] Furthermore, all of the specific processing programs 56 can be stored in a storage device such as a server connected to the data processing device 12 via the network 54. The storage 32 does not need to store all of the specific processing programs 56; it may store only a portion of them.

[0152] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0153] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0154] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0155] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0156] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0157] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0158] The necklace-type terminal of the first side according to this embodiment is a necklace-type terminal that is worn by a mobile organism and configured to collect data in an area where plants are grown, and comprises a biosensor device configured to detect biological data of the organism, an environmental sensor device configured to detect environmental data outside the necklace-type terminal, an acoustic collector configured to detect sound waves from outside the necklace-type terminal and acoustic vibrations including sound waves emitted by the organism, a data collection unit configured to collect data signals from the biosensor device, the environmental sensor device, and the acoustic collector and generate output data, a first communication unit configured to receive the output data from the data collection unit and capable of communicating with a data processing device located outside the necklace-type terminal, and an electroacoustic converter that converts electrical signals from the first communication unit into acoustic vibrations, wherein the environmental sensor device includes an optical sensor device that detects light at the location of the necklace-type terminal.

[0159] In the necklace-type terminal of the second side according to the first side of this embodiment, the environmental sensor device may further include at least a soil sensor device capable of detecting moisture.

[0160] In the necklace-type terminal of the third side according to the second side of this embodiment, the soil sensor device includes a soil sensor protruding from the external appearance of the necklace-type terminal and a wireless communication unit connected to the soil sensor, the soil sensor device is configured to be separable in the necklace-type terminal, and the wireless communication unit of the soil sensor device can be configured to communicate with the first communication unit of the necklace-type terminal when separated.

[0161] In the necklace-type terminal according to the first, second, or third side of this embodiment, the environmental sensor device may include a humidity sensor device that detects the humidity at the location of the necklace-type terminal.

[0162] In the necklace-type terminal of the first, second, third, or fifth side according to the first, second, third, or fourth side of this embodiment, the environmental sensor device may include at least one temperature sensor device that detects the temperature at the location of the necklace-type terminal.

[0163] In the necklace-type terminal of the first side, second side, third side, fourth side, or sixth side according to claim 5 of this embodiment, the environmental sensor device may further include a carbon dioxide sensor device for detecting the carbon dioxide concentration at the location of the necklace-type terminal.

[0164] The data processing device on the seventh side according to this embodiment is a data processing device provided in an area for growing plants, and comprises: a second communication unit capable of communicating with a necklace-type terminal described on any one of the first to sixth sides; an input unit that receives the output data from the necklace-type terminal via the second communication unit; an output unit that sends a response to the necklace-type terminal generated based on the received output data to the second communication unit; a processor connected to the input unit and the output unit; and a memory configured to store program code and connected to the processor, wherein when the program code is executed by the processor, it causes the processor to input a prompt to a data generation model that includes text indicating the content of an utterance generated from the acoustic data of the output data of the necklace-type terminal as a user utterance, and to obtain a response to the utterance using the output data of the data generation model.

[0165] In the data processing device of the eighth aspect according to the seventh aspect of this embodiment, when the program code is executed by the processor, it can cause the processor to learn using the environmental sensor data from the environmental sensor device as the output data of the necklace-type terminal and generate the plant growth model.

[0166] In the data processing device of the ninth aspect according to the seventh or eighth aspect of this embodiment, when the program code is executed by the processor, the processor can be prompted to learn using biosensor data from the biosensor device as output data of the necklace-type terminal to generate a user life model that shows the patterns of the user's behavior.

[0167] In the data processing device of the 10th aspect according to the 7th, 8th, or 9th aspect of this embodiment, the program code, when executed by the processor, can cause the processor to input a prompt including the user utterance to the data generation model when the user utterance satisfies a predetermined trigger condition, and to obtain a response to the user utterance using the output of the data generation model.

[0168] The data processing device for the 11th side according to the 7th, 8th, 9th, or 10th side of this embodiment may further include at least one of: a dimming device configured to adjust the light to be provided to the area; a watering device capable of supplying moisture to be provided to the plants; a humidity control device configured to adjust the humidity to be maintained in the area; a humidity control device configured to adjust the amount of carbon dioxide to be maintained in the area; and an air conditioning device configured to adjust the temperature to be maintained in the area.

[0169] The data processing system on the 12th side according to this embodiment comprises a necklace-type terminal described on any one of the first to sixth sides, and a data processing device described on any one of the seventh to eleventh sides.

[0170] The first embodiment of the present disclosure is a necklace-type terminal comprising a camera that photographs the area around the wearer, a sensor device that detects the wearer's biometric data, a microphone, and a collection unit that collects the outputs of the camera, the sensor device, and the microphone, respectively.

[0171] A second embodiment of the present disclosure is a necklace-type terminal of the first embodiment, further comprising a communication unit that transmits the outputs of the camera, the sensor device, and the microphone, respectively, collected by the collection unit, to a data processing unit.

[0172] The third embodiment of this disclosure is a necklace-type terminal of the second embodiment, further comprising a speaker that outputs a response corresponding to user speech collected by the microphone.

[0173] A fourth embodiment of the present disclosure is a data processing system including a necklace-type terminal of the third embodiment and a data processing device, wherein the data processing device includes an input unit for receiving user utterances collected by the microphone, a processing unit for inputting a prompt including the user utterances into a data generation model and obtaining a response to the user utterances using the output of the data generation model, and an output unit for outputting the obtained response to the necklace-type terminal.

[0174] A fifth embodiment of the technology of this disclosure is a data processing system of the fourth embodiment, wherein the processing unit inputs a prompt including the user utterance to the data generation model when the user utterance satisfies predetermined trigger conditions, and obtains a response to the user utterance using the output of the data generation model.

[0175] This disclosure is not limited to the embodiments described above, and can be implemented with various modifications without departing from the spirit of this disclosure. All such modifications are included in the technical concept of this disclosure. [Explanation of Symbols]

[0176] 10 Data processing systems, 12 Data processing devices, 14. Necklace-type terminal, 38 microphones, 39 Sensor devices, 40 speakers, 42 cameras, 46A Control Unit, 100 data collection unit, 102 Communications Department, 290 Specific Processing Unit, 292 Input section, 294 Processing Unit, 296 Output section.< / url:>

Claims

1. A necklace-type terminal, which is attached to a mobile organism and configured to collect data in an area where plants are grown, A biosensor device configured to detect the biological data of the aforementioned living organism, An environmental sensor device configured to detect environmental data outside the necklace-type terminal, An acoustic collector configured to detect acoustic vibrations, including sound waves from outside the necklace-type terminal and sound waves emitted by the living body, A data acquisition unit is configured to collect data signals from the biosensor device, the environmental sensor device, and the acoustic collector, and to generate output data for each. A first communication unit is configured to receive the output data from the data acquisition unit and is capable of communicating with a data processing device located on the outside of the necklace-type terminal. An electroacoustic conversion device that converts electrical signals from the first communication unit into acoustic vibrations, Equipped with, The environmental sensor device includes a light sensor device that detects light at the location of the necklace-type terminal. Necklace-type terminal.

2. The environmental sensor device further includes at least a soil sensor device capable of detecting moisture. A necklace-type terminal as described in claim 1.

3. The soil sensor device includes a soil sensor that protrudes from the appearance of the necklace-type terminal and a wireless communication unit connected to the soil sensor. The soil sensor device is configured to be detachable at the necklace-type terminal, The wireless communication unit of the soil sensor device is configured to communicate with the first communication unit of the necklace-type terminal when it is separated. The necklace-type terminal described in claim 2.

4. The environmental sensor device includes a humidity sensor device that detects humidity at the location of the necklace-type terminal. A necklace-type terminal as described in claim 1.

5. The environmental sensor device includes at least one temperature sensor device that detects the temperature at the location of the necklace-type terminal. A necklace-type terminal as described in claim 1.

6. The environmental sensor device further includes a carbon dioxide sensor device that detects the carbon dioxide concentration at the location of the necklace-type terminal. A necklace-type terminal as described in claim 1.

7. A data processing device installed in an area for growing plants, A second communication unit capable of communicating with a necklace-type terminal as described in any one of claims 1 to 6, An input unit that receives the output data from the necklace-type terminal via the second communication unit, An output unit that sends a response to the necklace-type terminal, generated based on the received output data, to the second communication unit, A processor connected to the input and output sections, A memory configured to store program code and connected to the processor, Equipped with, When the aforementioned program code is executed by the processor, the processor will, The process involves inputting a prompt containing text representing the spoken content generated from the acoustic data of the output data of the necklace-type terminal as a user utterance into a data generation model, and using the output data of the data generation model to obtain a response to the utterance. to cause Data processing device.

8. When the aforementioned program code is executed by the processor, the processor will, The necklace-type terminal is trained using environmental sensor data from the environmental sensor device as output data to generate a plant growth model. to cause The data processing device according to claim 7.

9. When the aforementioned program code is executed by the processor, the processor will, The necklace-type terminal uses biosensor data from the biosensor device as output data to perform learning and generate a user lifestyle model that shows the patterns of the user's behavior. to cause The data processing device according to claim 7.

10. When the aforementioned program code is executed by the processor, the processor will, When the user utterance satisfies a predetermined trigger condition, a prompt including the user utterance is input to the data generation model, and a response to the user utterance is obtained using the output of the data generation model. to cause The data processing device according to claim 7.

11. A dimming device configured to adjust the light to be provided to the aforementioned area, A water supply device capable of supplying water to be provided to the aforementioned plant, A humidity control device configured to adjust the humidity to be maintained in the aforementioned area, An air conditioning device configured to adjust the temperature to be maintained in the area, It further comprises at least one of the following: A data processing device according to claim 7.

12. A necklace-type terminal as described in any one of claims 1 to 6, A data processing device installed in the area where plants are grown, Equipped with, The aforementioned data processing device is A second communication unit capable of communicating with the aforementioned necklace-type terminal, An input unit that receives the output data from the necklace-type terminal via the second communication unit, An output unit that sends a response to the necklace-type terminal, generated based on the received output data, to the second communication unit, A processor connected to the input and output sections, A memory configured to store program code and connected to the processor, Equipped with, When the aforementioned program code is executed by the processor, the processor will, The process involves inputting a prompt containing text representing the spoken content generated from the acoustic data of the output data of the necklace-type terminal as a user utterance into a data generation model, and using the output data of the data generation model to obtain a response to the utterance. to cause Data processing system.

Images