Necklace-type terminal and data processing system

Abstract

We provide a necklace-type terminal and data processing system for collecting users' biometric data. [Solution] The necklace-type terminal includes a camera that photographs the wearer engineer's work environment, a sensor that detects the engineer's biometric data, a microphone, and a virtual display. The necklace-type terminal collects the outputs of the camera, sensor, and microphone, transmits the collected outputs to a data processing device, and displays the information received from the data processing device on the virtual display.

Description

Technical Field

[0001] The technology of the present disclosure relates to a necklace-type terminal and a data processing system for providing work support for engineers.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

[0003] On the other hand, in conventional engineering work, information acquisition and code review are performed by operating a personal computer or a smartphone.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, during engineering work, operating a personal computer or a smartphone for information acquisition and code review interrupts the work and reduces work efficiency. Also, in a project jointly carried out by multiple engineers, it is necessary to grasp the progress situation and perform appropriate role sharing.

[0006] This disclosure is made in light of the circumstances described above and aims to enable engineers to obtain various information related to their work without interrupting their work and to proceed with their work efficiently. Furthermore, this disclosure aims to monitor the progress of the work in progress and propose appropriate actions. [Means for solving the problem]

[0007] A first aspect of the technology of this disclosure is a camera that photographs the work environment of an engineer who is wearing the equipment, A sensor that detects the biometric data of the aforementioned engineer, Microphone and, Virtual display and Equipped with a processor, The aforementioned processor, The outputs of the camera, the sensor, and the microphone are collected. The outputs of the camera, the sensor, and the microphone collected are transmitted to the data processing device. This is a necklace-type terminal that displays information received from the data processing device on the virtual display.

[0008] A second aspect of the technology of this disclosure is a necklace-type terminal of the first aspect, further comprising a speaker. The processor outputs audio to the speaker in accordance with the information received from the data processing device.

[0009] A third aspect of the technology of this disclosure is a necklace-type terminal of the first or second aspect, A data processing system including a data processing device, The data processing device comprises a processor, The aforementioned processor, By inputting a prompt into the data generation model that includes at least one of the outputs of the camera, the sensor, and the microphone, task information obtained from a project management tool used by the engineer, and the code obtained from a code repository where the code created by the engineer is stored; A first process that derives the progress status of the engineer's work based on task information obtained from the project management tool used by the engineer, and transmits the progress status to the necklace-type terminal. A second process derives error information for the code based on the code obtained from the code repository where the code created by the engineer is stored. A third process that, based on the output from the necklace-type terminal, derives the information required by the engineer and transmits the derived information required by the engineer to the necklace-type terminal. A fourth process that derives relaxation information corresponding to the engineer's stress level based on the output from the necklace-type terminal, and A fifth process that derives progress information representing the progress status of each of the engineers' tasks, based on task information of multiple engineers obtained from a project management tool used by the aforementioned engineers. Perform a specific process that includes at least one of the following: The result of the aforementioned specific processing is output to the necklace-type terminal. [Brief explanation of the drawing]

[0010] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system. [Figure 2] This is a conceptual diagram showing an example of the main functions of a data processing device and a necklace-type terminal. [Figure 3] This is a side view showing the configuration of a necklace-type terminal. [Figure 4] This is a top view showing the configuration of a necklace-type terminal. [Figure 5] The functional configuration of the control unit of the necklace-type terminal is shown in general terms. [Figure 6] Schematically shows the functional configuration of a specific processing unit of a data processing device. [Figure 7] Schematically shows an example of an operation flow of specific processing by a data processing device according to a first embodiment. [Figure 8] Schematically shows an example of an operation flow of specific processing by a data processing device according to a second embodiment.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, an example of embodiments of a necklace-type terminal, a data processing device, a data processing method, and a data processing program according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0012] First, the terms used in the following description will be explained.

[0013] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), or an APU (Accelerated Processing Unit), etc.

[0014] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0015] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0016] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0017] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0018] Figure 1 shows an example of the configuration of a data processing system 10 according to the first embodiment of this disclosure.

[0019] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a necklace-type terminal 14. An example of the data processing device 12 is a server. In the first embodiment, the data processing device 12 is an example of a "data processing device" according to the technology of this disclosure, and the necklace-type terminal 14 is an example of a "necklace-type terminal" according to the technology of this disclosure.

[0020] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). An external device 70 is also connected to the network 54.

[0021] The necklace-type terminal 14 includes a computer 36, a microphone 38, a sensor 39, a speaker 40, a camera 42, a virtual display (VD) 43, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 38, speaker 40, camera 42, and VD 43 are also connected to the bus 52.

[0022] The user 20 wearing the necklace-type terminal 14 may be, for example, a patient whose health condition is being diagnosed, or a regular user.

[0023] The microphone 38 picks up the voice emitted by the user 20, who is wearing the necklace-type terminal 14, as well as sounds around the user 20. The microphone 38 also receives instructions from the user 20 by receiving the voice emitted by the user 20. The microphone 38 captures the voice emitted by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 40 outputs audio according to the instructions from the processor 46. The speaker 40 is, for example, a directional speaker and outputs audio towards the user 20's ears.

[0024] Sensor 39 is a sensor that detects biometric data of the user 20, who is wearing the necklace-type terminal. For example, sensor 39 may be a heart rate sensor or a blood oxygen sensor.

[0025] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0026] The VD43 is equipped with an optical system including a lens and a light source, and performs various displays by projecting various information transmitted from the data processing device 12 to the necklace-type terminal 14. The projection is performed on a table or wall surface near the user.

[0027] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0028] Figure 2 shows an example of the main functions of the data processing device 12 and the necklace-type terminal 14.

[0029] As shown in Figure 2, in the data processing device 12, specific processing is performed by the processor 28. The storage 32 stores a specific processing program 56. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores a data generation model 58. The data generation model 58 is used by the specific processing unit 290. The storage 32 also includes a data storage unit 55.

[0031] In the necklace-type terminal 14, data acquisition processing is performed by the processor 46. The storage 50 stores the data acquisition program 60. The processor 46 reads the data acquisition program 60 from the storage 50 and executes the read data acquisition program 60 on the RAM 48. The data acquisition processing is realized by the processor 46 operating as a control unit 46A according to the data acquisition program 60 executed on the RAM 48.

[0032] As shown in Figures 3 and 4, the necklace-type terminal 14 includes multiple microphones 38, multiple sensors 39, multiple speakers 40, multiple cameras 42, and multiple virtual displays (VDs) 43. Figures 3 and 4 show an example where two microphones 38 and two VDs 43 are positioned in front of the user 20 when the user 20 wears the necklace-type terminal 14. They also show an example where two sensors 39 are positioned to the right and left of the user 20 when the user 20 wears the necklace-type terminal 14. They also show an example where two speakers 40 are positioned to the right rear and left rear of the user 20 when the user 20 wears the necklace-type terminal 14. Finally, they show an example where two cameras 42 are positioned to the right front and left front of the user 20 when the user 20 wears the necklace-type terminal 14. This example shows two sensors 39 positioned inside the necklace-type terminal 14 so as to contact the user 20's neck when the user 20 wears the necklace-type terminal 14.

[0033] Next, we will explain the processing of the control unit 46A when the necklace-type terminal 14 performs data collection processing to collect data.

[0034] In the data collection process of the first embodiment, the user's biometric data is collected in real time. In addition to biometric data, all ambient data surrounding the user is also collected. This makes it possible to detect early signs of conditions such as Alzheimer's disease and dementia. It also allows for monitoring of the user's health status (e.g., heart disease).

[0035] As shown in Figure 5, the control unit 46A includes a data acquisition unit 100 and a communication unit 102.

[0036] The data acquisition unit 100 collects the outputs of the microphone 38, sensor 39, and camera 42, respectively.

[0037] The communication unit 102 transmits the outputs of the microphone 38, sensor 39, and camera 42, which are collected by the data acquisition unit 100, to the data processing unit 12.

[0038] Next, we will describe the processing of the specific processing unit 290 when the data processing device 12 performs specific processing to obtain a response corresponding to a user utterance.

[0039] In the specific processing in the first embodiment, a response corresponding to the user utterance picked up by the microphone 38 of the necklace-type terminal 14 is obtained using the data generation model 58.

[0040] As shown in Figure 6, the specific processing unit 290 includes an input unit 292, a processing unit 294, and an output unit 296.

[0041] The input unit 292 stores the outputs of the microphone 38, sensor 39, and camera 42, received from the necklace-type terminal 14, in the data storage unit 55. The input unit 92 also stores information acquired from the external device 70 in the data storage unit 55.

[0042] The input unit 292 acquires user utterances received by the necklace-type terminal 14. Specifically, it acquires user utterances picked up by the microphone 38 of the necklace-type terminal 14.

[0043] The processing unit 294 performs specific processing using the data generation model 58. Specifically, it inputs a prompt including user utterances to the data generation model 58 and obtains a generation result. At this time, the outputs of the sensor 39 and camera 42 collected by the data acquisition unit 100 may also be included in the prompt.

[0044] The output unit 296 transmits the result of the specific processing to the necklace-type terminal 14. In the necklace-type terminal 14, the control unit 46A causes the speaker 40 to output the result of the specific processing. In this way, a response corresponding to the user utterance picked up by the microphone 38 is output to the user 20 by the speaker 40. The control unit 46A may also cause the VD 43 to output the result of the specific processing. In this case, the result of the specific processing is projected onto a table or wall near the user. The microphone 38 further acquires the user utterance in response to the result of the specific processing. The control unit 46A transmits the audio data indicating the user utterance acquired by the microphone 38 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the user utterance.

[0045] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0046] In the first embodiment, the outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 55 are used, for example, to diagnose the health status of the user 20. In this case, the outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 55 may be transmitted to a terminal on the medical institution side. Alternatively, the data processing device 12 may analyze the outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 55 to diagnose the health status of the user 20.

[0047] Next, we will explain the operation of the data processing system 10. First, we will describe an example of the data collection process flow.

[0048] When user 20 is wearing the necklace-type terminal 14, the data acquisition unit 100 sequentially collects the outputs of the microphone 38, sensor 39, and camera 42. The communication unit 102 sequentially transmits the outputs of the microphone 38, sensor 39, and camera 42 collected by the data acquisition unit 100 to the data processing unit 12.

[0049] Next, an example of the flow of a specific process in the first embodiment will be described with reference to Figure 7. Here, the input unit 292 of the data processing device 12 sequentially acquires the outputs of the microphone 38, sensor 39, and camera 42 received from the necklace-type terminal 14 and stores them in the data storage unit 55.

[0050] In step S100, the processing unit 294 determines whether a predetermined trigger condition is met. Specifically, the trigger condition may be that the user utterance picked up by the microphone 38 contains a specific word (for example, the name of the agent installed in the necklace-type terminal 14) or a phrase (for example, "Hi! XX" (where XX is the name of the agent)).

[0051] If the trigger condition is met in step S100 (step S100; Yes), the data processing system 10 proceeds to step S101. On the other hand, if the trigger condition is not met in step S100 (step S100; No), the data processing system 10 terminates the specific processing.

[0052] In step S101, the processing unit 294 generates a prompt by adding an instruction to obtain the result of a specific process to the text representing the user utterance picked up by the microphone 38.

[0053] For example, a prompt such as "The user is speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech) can be generated. Alternatively, the outputs of sensor 39 and camera 42 can be added to the prompt to generate a prompt such as "This is biometric data representing the user's heart rate and video data representing the user's surroundings. The user is also speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech)

[0054] In step S102, the processing unit 294 inputs the generated prompt to the data generation model 58 and obtains the result of a specific process based on the output of the data generation model 58.

[0055] In step S103, the output unit 296 outputs the result of the specific processing to the necklace-type terminal 14 and terminates the specific processing.

[0056] Next, a second embodiment of this disclosure will be described. Since the configuration of the data processing system according to the second embodiment is the same as that of the data processing system according to the first embodiment, a detailed explanation of the configuration will be omitted here.

[0057] In the second embodiment, the data processing system 10 performs specific processing to provide various information about the engineer's work. Therefore, in the second embodiment, the user of the necklace-type terminal 14 is an engineer. Also in the second embodiment, the data processing system 10 performs specific processing to provide various information to multiple engineers.

[0058] In the second embodiment, the external device 70 connected to the network 54 of the data processing system 10 includes a project management tool for engineers and a code repository. The project management tool manages the tasks of the project performed by the engineers. The code repository stores the source code of the software application or project created by the engineers.

[0059] In the second embodiment, the data processing device 12 sequentially acquires task information and codes from the external device 70, stores them together with the user's biometric data in the data storage unit 55, and uses them for specific processing.

[0060] In the second embodiment, the processing unit 294 uses the data generation model 58 to perform specific processing on tasks performed by an engineer. Specifically, the data generation model 58 performs specific processing based on information acquired from the external device 70 and the outputs of the microphone 38, sensor 39, and camera 42 received from the necklace-type terminal 14 stored in the data storage unit 55, and generates information corresponding to the specific processing. The necklace-type terminal 14 outputs specific information from the speaker 40 and / or VD 43.

[0061] In the second embodiment, the processing unit 294 performs the following first to fifth processes.

[0062] The first process involves inputting a prompt to the data generation model 58 instructing it to derive the progress status of the engineer's work based on task information acquired from the project management tool used by the engineer, which is stored in the data storage unit 55. The data generation model 58 then derives the progress status of the engineer's work and transmits the progress information to the necklace-type terminal 14. In this case, the progress information may include information such as tasks that the engineer has not yet completed and the priority of those tasks according to their deadlines. If there are no tasks that are not yet completed, that information may also be included.

[0063] The second process involves inputting a prompt to the data generation model 58 instructing it to derive error information for the code based on the code obtained from the code repository stored in the data storage unit 55. The data generation model 58 then derives the error information for the code and transmits it to the necklace-type terminal 14. The error information includes information such as whether or not there is an error, the location of the error if there is one, and points for improvement of the error.

[0064] The third process involves inputting a prompt to the data generation model 58, instructing it to derive the information required by the engineer based on the output from the necklace-type terminal 14 stored in the data storage unit 55. The data generation model 58 then derives the information required by the engineer and transmits the derived information to the necklace-type terminal 14. The required information is the information that the engineer is expected to request depending on the progress.

[0065] The fourth process involves inputting a prompt to the data generation model 58 instructing it to derive relaxation information corresponding to the stress level based on the output from the necklace-type terminal 14 stored in the data storage unit 55. The data generation model 58 then derives relaxation information corresponding to the stress level and transmits the derived relaxation information to the necklace-type terminal 14. In the fourth process, relaxation information may be derived and transmitted to the necklace-type terminal 14 only when the stress level exceeds a threshold. Relaxation information includes music and images (still images, moving images, etc.) to relieve stress.

[0066] The fifth process involves inputting a prompt to the data generation model 58 instructing it to derive progress information representing the progress of work in a joint project, based on task information for a joint project performed by multiple engineers, which is stored in the data storage unit 55 and obtained from a project management tool used by engineers. The data generation model 58 then derives progress information representing the progress of work in the joint project and transmits the progress information to the necklace-type terminal 14. The progress information transmitted in the fifth process includes information on whether or not there are delays in the work of the members of the joint project, and actions to take in response to those delays. The progress information from the fifth process may be transmitted to each of the multiple engineers' necklace-type terminals 14, for example, or it may be transmitted only to the necklace-type terminal 14 of the leader of the multiple engineers.

[0067] Next, an example of the specific processing flow in the second embodiment will be described. The specific processing flow in the second embodiment is the same as the specific processing flow in the first embodiment, but the content of the prompt generated in step S101 shown in Figure 7 and the result of the specific processing obtained in step S102 differ from those in the first embodiment. The differences from the first embodiment will be described below. In the second embodiment as well, the input unit 292 of the data processing device 12 sequentially acquires the outputs of the microphone 38, sensor 39, and camera 42 received from the necklace-type terminal 14 and stores them in the data storage unit 55. In addition, the input unit 292 sequentially acquires task information and codes from the external device 70 and stores them in the data storage unit 55.

[0068] In the second embodiment, the processing unit 294 generates a prompt with the following content.

[0069] For example, it generates a prompt that reads, "The user is saying the following: XXX. Please respond as an agent." (XXX is the user's utterance.) It also adds the outputs of sensor 39 and camera 42 to the prompt to generate a prompt that reads, "This is biometric data representing the user's heart rate and video data representing the user's surroundings. The user is also saying the following: XXX. Please respond as an agent." (XXX is the user's utterance.) Furthermore, it adds task information obtained from the project management tool and code obtained from the code repository to the prompt to generate a prompt that reads, "This is task information for the project the user is working on and the code the user is creating. As an agent, please respond with progress information for each user, error information, information the user needs, and progress information for the collaborative project."

[0070] The processing unit 294 inputs the generated prompt to the data generation model 58 and obtains the result of a specific process based on the output of the data generation model 58. Figure 8 is a diagram showing the flow of obtaining the result of a specific process in the second embodiment.

[0071] The processing unit 294 derives progress information by performing a first process in step S201. The processing unit 294 derives error information by performing a second process in step S202. The processing unit 294 derives information required by engineers by performing a third process in step S203. The processing unit 294 derives relaxation information by performing a fourth process in step S204. The processing unit 294 derives the progress status of the joint project by performing a fifth process in step S205.

[0072] The processing unit 294 transmits the result of the specific processing derived in step S206 to the necklace-type terminal 14 and terminates the processing. The extension information for the joint project derived in the fifth processing is transmitted only to the leader of the joint project members.

[0073] In the second embodiment, the first, second, and third processes enable real-time monitoring of project progress and the quality of code created by engineers, and provide engineers with the necessary information. Therefore, the efficiency of engineers' work can be significantly improved.

[0074] Furthermore, the fifth process facilitates smoother communication among members of a joint project, enabling the project to be carried out more efficiently.

[0075] Furthermore, the fourth process makes it possible to reduce engineer stress and maintain their health.

[0076] In the second embodiment described above, all of the first to fifth processes are performed, but the embodiment is not limited thereto. At least one of the first to fifth processes may be performed.

[0077] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0078] In the embodiments described above, examples were given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing method for the specific process may be used, involving multiple computers, including computer 22.

[0079] In the embodiments described above, examples were given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0080] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0081] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0082] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0083] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0084] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0085] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0086] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0087] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference. [Explanation of Symbols]

[0088] 10 Data Processing Systems 12 Data Processing Devices 14 Necklace-type terminal 38 Microphones 39 Sensors 40 speakers 42 cameras 43. Virtual Display (VD) 46A Control Unit 100 Data Acquisition Unit 102 Communications Department 290 Specific Processing Unit 292 Input section 294 Processing Unit 296 Output section< / url:>

Claims

1. A camera that films the working environment of the engineer wearing the equipment, A sensor that detects the biometric data of the aforementioned engineer, Microphone and, Virtual display and Equipped with a processor, The aforementioned processor, The outputs of the camera, the sensor, and the microphone are collected. The outputs of the camera, the sensor, and the microphone collected are transmitted to the data processing device. The information received from the data processing device is displayed on the virtual display. Necklace-type terminal.

2. Equipped with additional speakers, The necklace-type terminal according to claim 1, wherein the processor outputs audio corresponding to the information received from the data processing device via the speaker.

3. A necklace-type terminal according to claim 1 or 2, A data processing system including a data processing device, The data processing device comprises a processor, The aforementioned processor, By inputting a prompt into the data generation model that includes at least one of the outputs of the camera, the sensor, and the microphone, task information obtained from a project management tool used by the engineer, and the code obtained from a code repository where the code created by the engineer is stored; A first process that derives the progress status of the engineer's work based on task information obtained from the project management tool used by the engineer, and transmits the progress status to the necklace-type terminal. A second process derives error information for the code based on the code obtained from the code repository where the code created by the engineer is stored. A third process that, based on the output from the necklace-type terminal, derives information required by the engineer and transmits the derived information required by the engineer to the necklace-type terminal. A fourth process that derives relaxation information corresponding to the engineer's stress level based on the output from the necklace-type terminal, and A fifth process that derives progress information representing the progress status of each of the engineers' tasks, based on task information of multiple engineers obtained from a project management tool used by the aforementioned engineers. Perform a specific process that includes at least one of the following: A data processing system that outputs the results of the specified processing to the necklace-type terminal.

Images