Data processing apparatus, data processing method, and data processing program

Abstract

To provide a data processing apparatus, a data processing method, and a program configured to conduct collision avoidance simulation between a mobile body and another mobile body.SOLUTION: A data processing apparatus includes: an input unit for receiving a user input; a processing unit which performs specific processing using a text generation model which generates a text according to an input text; and an output unit which outputs a result of the specific processing. The processing unit is configured to: determine whether a predetermined trigger condition is satisfied or not, the trigger condition indicating that an instruction for collision avoidance simulation between a predetermined mobile body and an arbitrary object has been input as the user input; and acquire, when the trigger condition is satisfied, a result of the specific processing, using an output of the text generation model that uses information obtained from the user input as the input text, the specific processing being a simulation process to avoid a collision between the object and the mobile body using a collision avoidance algorithm that uses an output of the text generation model.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The technology disclosed herein relates to a data processing device, a data processing method, and a data processing program. [Background technology]

[0002] Patent Document 1 discloses a moving object simulation system that simulates the movement of real moving objects by repeatedly calculating the positions of a plurality of virtual moving objects represented in a computer after the lapse of a unit time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-28877 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional techniques leave room for improvement in terms of executing simulations to avoid collisions between moving bodies such as autonomously driving automobiles and other objects such as other moving bodies, humans, and animals. [Means for solving the problem]

[0005] A first aspect of the technology disclosed herein is a data processing device that includes an input unit that accepts user input, a processing unit that performs a specific processing using a sentence generation model that generates a sentence according to the input sentence, and an output unit that outputs a result of the specific processing, wherein the processing unit determines whether a predetermined trigger condition is satisfied, the trigger condition being that an instruction regarding a simulation of collision avoidance between a specified moving body and an arbitrary object is input as the user input, and when the trigger condition is satisfied, the result of the specific processing is obtained using the output of the sentence generation model when information obtained from the user input is used as the input sentence, and the specific processing is a simulation process of avoiding a collision between the object and the moving body using a collision avoidance algorithm using the output of the sentence generation model.

[0006] A second aspect of the technique of the present disclosure is the data processing device according to the first aspect, wherein the processing unit feeds back a result of the simulation processing to the collision avoidance algorithm.

[0007] A third aspect of the technology disclosed herein is a data processing device according to the second aspect, wherein the processing unit feeds back a result of the simulation processing to the collision avoidance algorithm when the specified moving body collides with the arbitrary object during the simulation processing.

[0008] A fourth aspect of the technology disclosed herein is a data processing device according to the second aspect, wherein the processing unit feeds back a result of the simulation processing to the collision avoidance algorithm when, in the simulation processing, the specified moving body and the arbitrary object avoid a collision and the specified moving body takes an evasive action that induces a collision with another object or moving body.

[0009] A fifth aspect of the technology disclosed herein is a data processing device according to the first aspect, further including a cognitive database that stores information necessary for the moving body to avoid a collision, and the collision avoidance algorithm performs the simulation by referring to the information stored in the cognitive database.

[0010] A sixth aspect of the technology disclosed herein is a data processing device according to the first aspect, wherein the processing unit executes the specific process using each of the collision avoidance algorithm and another collision avoidance algorithm that does not use the output of the sentence generation model.

[0011] A seventh aspect of the technology disclosed herein is a data processing device according to the first aspect, in which the sentence generation model receives real-world information indicating at least one of weather, road conditions, environmental sensing information, etc. as input, and outputs the collision avoidance algorithm.

[0012] An eighth aspect of the technology disclosed herein is a data processing device according to the first aspect, wherein the processing unit controls the moving body to take collision avoidance action when there is a possibility of a collision with another moving body during the simulation processing.

[0013] A ninth aspect of the technology disclosed herein is a data processing method in which a processor executes processing including an input step of accepting user input, a processing step of performing a specific processing using a sentence generation model that generates a sentence according to the input sentence, and an output step of outputting a result of the specific processing, wherein the processing step includes a step of determining whether a predetermined trigger condition is satisfied, the trigger condition being that an instruction regarding a simulation of collision avoidance between a specified moving body and an arbitrary object is input as the user input, and the processing step further includes a step of, when the trigger condition is satisfied, obtaining a result of the specific processing using the output of the sentence generation model when information obtained from the user input is used as the input sentence, and the specific processing is a simulation process of avoiding a collision between the object and the moving body.

[0014] A tenth aspect of the technology disclosed herein is a data processing program that causes a computer to execute a process including an input step of accepting user input, a processing step of performing a specific processing using a sentence generation model that generates a sentence according to the input sentence, and an output step of outputting a result of the specific processing, wherein the processing step includes a step of determining whether a predetermined trigger condition is satisfied, the trigger condition being that an instruction regarding a simulation of collision avoidance between a specified moving body and an arbitrary object is input as the user input, and the processing step further includes a step of, when the trigger condition is satisfied, obtaining a result of the specific processing using the output of the sentence generation model when information obtained from the user input is used as the input sentence, and the specific processing is a simulation process of avoiding a collision between the object and the moving body. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a conceptual diagram illustrating an example of a configuration of a data processing system. [Diagram 2] FIG. 2 is a conceptual diagram showing an example of main functions of a data processing device and a smart device. [Figure 3A] The outline of the specific process is shown below. [Figure 3B] The outline of the specific process is shown below. [Figure 3C] The outline of the specific process is shown below. [Figure 4] 2 shows a schematic functional configuration of a specific processing unit of the data processing device. [Diagram 5] 13 illustrates an example of an operational flow of a specific process performed by a data processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, an example of an embodiment of a data processing device, a data processing method, and a program according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (Tensor Processing Unit).

[0019] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by the processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a code is an interface including a communication processor and an antenna. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the embodiment.

[0024] As shown in Fig. 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server. An example of the smart device 14 is a smartphone. In this embodiment, the data processing device 12 is an example of a "data processing device" according to the technology of the present disclosure.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (e.g., a pen or a finger) to receive user input by the touch of the pointer. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the person 20 by outputting the data in a form of expression that the person 20 can perceive (e.g., voice and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs voice according to instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor or a Charge Coupled Device (CCD) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Fig. 2, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32. The specific process program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific process program 56 from the storage 32, and executes the read specific process program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific process program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58. The data generation model 58 is used by the specific processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 62. The reception output program 62 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads out the reception output program 62 from the storage 50, and executes the read reception output program 62 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 62 executed on the RAM 48.

[0034] Next, the processing of the specific processing unit 290 will be described when the data processing device 12 performs specific processing to execute a simulation process for avoiding a collision between an arbitrary object and a specified moving body using a collision avoidance algorithm that uses the output of the data generation model 58, which is an example of a sentence generation model.

[0035] Although the number of traffic accidents caused by automobiles is decreasing due to the development of on-board sensors installed in automobiles, head-on collisions from blind spots still exist. Demonstrations in real environments to reproduce traffic accidents involve risks, and simulation environments for collision avoidance based on the cognitive behavior of objects are still in the development stage. In the future, in addition to self-driving cars, the number of objects such as drones and personal mobility such as electric kick scooters will increase, and the amount of compensation in the event of an accident is expected to increase.

[0036] Therefore, in the identification process in this embodiment, as shown in Fig. 3A to Fig. 3C, a simulation is performed by a collision avoidance algorithm using the output of the data generation model 58. Fig. 3A is a diagram showing a state in which a simulation is performed to avoid a collision between an automobile 310, which is an example of a moving body, and a cat 320, which is an example of an arbitrary object. For example, when a prompt such as "Please move like a cat" is sent from the smart device 14, the data generation model 58 simulates the movement of a cat and provides it to the collision avoidance algorithm.

[0037] The collision avoidance algorithm is an algorithm generated in advance using the data generation model 58, and is an algorithm for avoiding a collision between a moving body and another object. The collision avoidance algorithm specifies various parameters for an automatic driving operation of an automobile, such as a steering operation, an accelerator operation, and a brake operation. The collision avoidance algorithm also specifies actions for avoiding a collision with another object based on the output from the data generation model 58 according to the speed and acceleration of the object. A prompt for generating the collision avoidance algorithm may be, for example, "Please create a driving algorithm for an automatic driving vehicle to avoid a collision with a small animal when the small animal jumps out."

[0038] The collision avoidance algorithm performs a simulation for the automobile 310 to avoid a collision with the cat 320 based on the movement of the cat 320 generated by the data generation model 58 and the movement of the automobile 310 generated in advance. FIG. 3A shows a case where the distance between the automobile 310 and the cat 320 is sufficient. FIG. 3B shows a case where the distance between the automobile 310 and the cat 320 is closer than that in FIG. 3A. FIG. 3C shows a case where the cat 320 tries to avoid a collision with the automobile 310 because the distance between the automobile 310 and the cat 320 has become closer. In this case, the collision avoidance algorithm performs a simulation for avoiding a collision with the cat 320, such as operating the steering wheel or the brake, taking into consideration that the cat 320 will change direction with respect to the automobile 310. The collision avoidance algorithm may refer to a recognition database in which information necessary for an object to avoid a collision is stored. The recognition database may be stored in the storage 32, for example. The cognitive database is also a database in which information generated by the data generation model 58 is stored, and for example, in the case of a car, information is stored on the speed and acceleration at which the car can safely stop without colliding with an object detected several meters ahead. Note that, although the car 310 and the cat 320 are given as examples of moving objects here, the moving objects are not limited to these examples. Specifically, the moving objects may be, for example, pedestrians, bicycles, manned flying objects such as airplanes, unmanned flying objects such as drones, birds, ships, marine life such as fish, dolphins, and whales, etc.

[0039] Note that the data generation model 58 does not receive an input from the user, such as an instruction to take evasive action when a collision with an animal is imminent. If the result of the simulation shows that the automobile 310 collides with the cat 320, the data generation model 58 is instructed to tune parameters related to the operation of the automobile 310 in the collision avoidance algorithm. The parameters related to the operation of the automobile 310 may be determined according to the manufacturer and model of the automobile. Note that, although the above description has been given using an example in which the moving body is an automobile, in the case of a moving body other than an automobile, the parameters may be determined based on the type of moving body (for example, gender, age, and the presence or absence of a disability in the case of a person, species, age, and the presence or absence of a disability in the case of an animal, and type, size, and the presence or absence of a malfunction in the case of a ship).

[0040] The data processing device 12 uses the output of the data generation model 58 to perform a simulation for avoiding a collision between a moving body and another object, and generates a collision avoidance algorithm, which enables a moving body incorporating the collision avoidance algorithm, or a pedestrian carrying a smartphone or wearable device incorporating the collision avoidance algorithm, to take evasive action such as being triggered to take evasive action by issuing a warning just before a collision, or to avoid points where a collision is likely to occur, thereby significantly reducing the probability of an accident occurring.

[0041] As shown in FIG. 4, the specific processing unit 290 includes an input unit 292, a processing unit 294, and an output unit 296.

[0042] The input unit 292 acquires a user input accepted by the smart device 14. Specifically, the input unit 292 acquires a character input or a voice input of the user accepted by the smart device 14. For example, a user input such as "Please make it move like a cat. Please make it move like a car. Please perform a simulation to avoid a collision between a car and a cat" is sent from the smart device 14 to the data processing device 12.

[0043] The processing unit 294 performs specific processing using the data generation model 58 .

[0044] Specifically, the processing unit 294 determines whether a predetermined trigger condition is satisfied. More specifically, the trigger condition is that the input unit 292 receives a character input or a voice input related to the simulation from the user through the smart device 14 (for example, "Please make it move like a cat. Please make it move like a car. Please make a simulation of avoiding a collision between a car and a cat.").

[0045] Then, when a predetermined trigger condition is satisfied, the processing unit 294 inputs text representing an instruction for obtaining data for a specific process to the data generation model 58, and acquires a processing result based on the output of the data generation model 58. More specifically, when the processing unit 294 acquires a character input related to a simulation from the user from the smart device 14, the processing unit 294 inputs the character input from the user to the data generation model 58, and executes a simulation based on a collision avoidance algorithm based on the output of the data generation model 58. For example, the processing unit 294 generates a prompt such as "Make it move like a cat. Please perform a simulation of avoiding a collision between a car and a cat using a collision avoidance algorithm," and inputs the prompt to the data generation model 58.

[0046] When the result of the simulation based on the collision avoidance algorithm causes the moving body to collide with another object, the processing unit 294 may feed back the simulation result to the data generation model 58. By feeding back the simulation result to the data generation model 58, the processing unit 294 can perform a simulation based on the collision avoidance algorithm in which the moving body automatically avoids other objects without the user having to tune the parameters of the collision avoidance algorithm.

[0047] In addition, depending on the type of moving body, even if the moving body avoids a collision, the collision avoidance method may induce another collision with another object or moving body. In such a case, even if one collision can be avoided, another collision occurs, resulting in substantially the same result. For example, if the moving body is an automobile, avoiding a collision by sudden braking, sharp turning, etc. may induce another collision with another object or moving body. Therefore, when a collision is avoided by an avoidance action that may induce another collision, such as sudden braking or sharp turning, it is desirable to tune the parameters of the collision avoidance algorithm.

[0048] When the result of the simulation based on the collision avoidance algorithm shows that the moving body and another object have avoided a collision but the avoidance behavior is accompanied by a collision that may induce another collision with the other object or the moving body, the processing unit 294 may feed back the simulation result to the data generation model 58. By feeding back the simulation result to the data generation model 58, the processing unit 294 can perform a simulation based on the collision avoidance algorithm in which the moving body avoids other objects by a safe avoidance method, even without the user tuning the parameters of the collision avoidance algorithm.

[0049] The collision avoidance algorithm may execute a simulation by referring to information registered in the cognition database. If there is a difference between the result of a simulation performed by itself and the result of a simulation performed by referring to the information registered in the cognition database, the collision avoidance algorithm may adopt the result of the simulation performed by referring to the information registered in the cognition database. For example, if there is a difference of a predetermined threshold or more between the result of a simulation performed by itself and the result of a simulation performed by referring to the information registered in the cognition database, the collision avoidance algorithm may adopt the result of the simulation performed by referring to the information registered in the cognition database.

[0050] The processing unit 294 may combine the collision avoidance algorithm by the data generation model 58 with another collision avoidance algorithm. If the result of the other collision avoidance algorithm is better, the processing unit 294 may reflect the result of the other collision avoidance algorithm in the collision avoidance algorithm by the data generation model 58, or may use an intermediate result between the collision avoidance algorithm by the data generation model 58 and the other collision avoidance algorithm as the result of the collision avoidance algorithm by the data generation model 58.

[0051] To avoid how close a moving body and an object can get, information on position and acceleration must be shared between the moving body and the object. How far away an object needs to be to be a warning target for the cat is interpreted by a collision avoidance algorithm using a data generation model 58. For example, to determine which car is a warning target, the cat's line of sight can be used in addition to the car's position information.

[0052] Information on the real environment such as weather, road surface conditions, etc. may be provided to the collision avoidance algorithm generated by the data generation model 58. In this case, information on the real environment such as weather, road surface conditions, etc. may be provided to the collision avoidance algorithm by inputting an image showing the real environment such as weather, road surface conditions, etc., into the data generation model 58, by the user specifically inputting real environment information such as weather, road surface conditions, etc., by inputting the results of real environment sensing such as LiDAR, etc., etc.

[0053] The output unit 296 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0054] For example, the output unit 296 outputs the result of a simulation for avoiding a collision between a car and a cat, which is executed based on the collision avoidance algorithm output by the data generation model 58. The output unit 296 may output the result of the simulation as an animation. For example, the output unit 296 may output, as a result of the simulation, an animation of how the collision is avoided when the car approaches while the cat is moving. If the user sees the result of the simulation output by the output unit 296 and the car and the cat collide, the user may instruct the data processing device 12 to tune the parameters in the collision avoidance algorithm.

[0055] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0056] For example, when the processing unit 294 generates a prompt such as “Please make the cat move like a cat. Please perform a simulation of avoiding a collision between a car and a cat” based on user input, the processing unit 294 inputs the generated prompt into the data generation model 58.

[0057] Next, the operation of the data processing system 10 will be described.

[0058] An example of the flow of the identification process will be described with reference to Fig. 5. Note that the flow of the identification process shown in Fig. 5 is an example of a "data processing method" according to the technology of the present disclosure.

[0059] In step S300, the processing unit 294 determines whether a predetermined trigger condition is satisfied. For example, the trigger condition is that a character input or a voice input related to a simulation from a user through the smart device 14 (for example, "Please make it move like a cat. Please perform a simulation of avoiding a collision between a car and a cat.") is received.

[0060] If the trigger condition is met in step S300 (step S300; Yes), the data processing system 10 proceeds to step S301. On the other hand, if the trigger condition is not met in step S300 (step S300; No), the data processing system 10 ends the identification process.

[0061] In step S301, the processing unit 294 generates a prompt by adding an instruction sentence for obtaining a result of a specific process to the text representing the input. For example, the processing unit 294 generates a prompt such as "Please make the cat move like a cat. Please perform a simulation of avoiding a collision between a car and a cat using a collision avoidance algorithm."

[0062] In step S303, the processing unit 294 inputs the generated prompt to the data generation model 58, and acquires a result of the specific processing based on the output of the data generation model 58. In this embodiment, the processing unit 294 performs a simulation of avoiding a collision between a moving vehicle and a cat based on the collision avoidance algorithm output by the data generation model 58, as the specific processing.

[0063] In step S304, the output unit 296 outputs the result of the specific processing to the user terminal, and ends the specific processing. For example, the output unit 296 outputs the result of a simulation for avoiding a collision between a car and a cat, which is executed based on the collision avoidance algorithm output by the data generation model 58. The output unit 296 may output the result of the simulation as an animation. For example, the output unit 296 may output, as a result of the simulation, an animation of a state of collision avoidance when a car approaches while a cat is moving. If the user sees the result of the simulation output by the output unit 296 and the car and the cat collide, the user may instruct the data processing device 12 to tune the parameters in the collision avoidance algorithm.

[0064] Although the system according to the present disclosure has been described above mainly with respect to the function of the data processing device 290, the system according to the present disclosure is not necessarily implemented in a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program that runs on a personal computer, or an application that runs on a smartphone or the like. The method according to the present disclosure may be provided to a user in the form of SaaS (Software as a Service).

[0065] In addition, in this embodiment, a smartphone, a wearable terminal, or other mobile terminal incorporating the collision avoidance algorithm generated by the data processing device 12 is also provided. The mobile terminal incorporating the collision avoidance algorithm may be, for example, a smart device 14. The mobile terminal may communicate with a moving body such as an automobile and obtain information about the moving body, thereby controlling the moving body to perform a collision avoidance action based on the collision avoidance algorithm, or may prompt the moving body to perform a collision avoidance action. Specifically, for example, when a user holding the mobile terminal is likely to collide with another moving body, the mobile terminal can notify the user of an output for causing the user to perform a collision avoidance action based on the collision avoidance algorithm. The output for causing the user to perform a collision avoidance action may be text, voice, or a combination of text and voice. Furthermore, when a moving body with which the mobile terminal communicates is likely to collide with another moving body, the mobile terminal can control the moving body to perform a collision avoidance action based on the collision avoidance algorithm. By incorporating the collision avoidance algorithm generated by the data processing device 12 into a smartphone, wearable device, or other mobile device, a user who holds the smartphone, wearable device, or other mobile device can receive a notification from the smartphone, wearable device, or other mobile device when they are about to collide with a moving object in the city, and can avoid a collision with a car.

[0066] The processing unit 294 may control the moving object to perform a collision avoidance action when there is a possibility of collision with another moving object in the simulation process. In this embodiment, a smartphone, a wearable terminal, or other mobile terminal incorporating the collision avoidance algorithm generated by the data processing device 12 is also provided. The mobile terminal incorporating the collision avoidance algorithm may be, for example, a smart device 14. The mobile terminal communicates with a moving object such as an automobile and acquires information about the moving object, thereby notifying the user of the collision avoidance action based on the collision avoidance algorithm. By incorporating the collision avoidance algorithm generated by the data processing device 12 into the smartphone, wearable terminal, or other mobile terminal, a user who holds the smartphone, wearable terminal, or other mobile terminal can avoid a collision with an automobile when a collision with a moving object is likely to occur in the city by receiving a notification from the smartphone, wearable terminal, or other mobile terminal.

[0067] In the above embodiment, an example was given in which a specific process is performed by one computer 22, but the technology disclosed herein is not limited to this, and distributed processing of the specific process may be performed by multiple computers, including computer 22.

[0068] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable computer-readable non-transitory storage medium such as a Universal Serial Bus (USB) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[0069] In addition, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 upon request from the data processing device 12.

[0070] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[0071] As the hardware resource for executing the specific process, various processors as shown below can be used. An example of the processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing the specific process by executing software, i.e., a program. Another example of the processor is a dedicated electric circuit, which is a processor having a circuit configuration designed exclusively for executing the specific process, such as a Field-Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), or an Application Specific Integrated Circuit (ASIC). Each processor has a built-in or connected memory, and each processor executes the specific process by using the memory.

[0072] The hardware resource that executes the specific process may be one of these various processors, or may be a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific process may be a single processor.

[0073] As an example of a configuration using one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a configuration using a processor that realizes the functions of the entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[0074] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements. The specific processes described above are merely examples. It goes without saying that unnecessary steps may be deleted, new steps may be added, or the order of processes may be changed without departing from the spirit of the invention.

[0075] The above description and illustrations are detailed descriptions of the parts related to the technology of the present disclosure, and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, function, action, and effect is an example of the configuration, function, action, and effect of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above description and illustrations, within the scope of the gist of the technology of the present disclosure. In addition, in order to avoid confusion and to facilitate understanding of the parts related to the technology of the present disclosure, the above description and illustrations omit explanations of technical common sense that do not require explanation in order to enable the implementation of the technology of the present disclosure.

[0076] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or standard was specifically and individually indicated to be incorporated by reference. [Explanation of symbols]

[0077] 10 Data Processing System 12 Data Processing Device 14 Smart Devices 290 Specific Processing Department 292 Input section 294 Processing section 296 Output section

Claims

1. an input unit for accepting user input; A processing unit that performs a specific process using a sentence generation model that generates a sentence according to an input sentence; an output unit that outputs a result of the specific processing, The processing unit includes: determining whether a predetermined trigger condition is satisfied; the trigger condition being that an instruction regarding a simulation of collision avoidance between a predetermined moving body and an arbitrary object is input as the user input; When the trigger condition is satisfied, a result of the specific process is obtained by using an output of the sentence generation model when the information obtained from the user input is used as the input sentence; and The specific processing is a simulation processing for avoiding a collision between the object and the moving body by a collision avoidance algorithm using an output of the sentence generation model. Data processing device.

2. The data processing device according to claim 1 , wherein the processing unit feeds back a result of the simulation process to the collision avoidance algorithm.

3. 3 . The data processing device according to claim 2 , wherein the processing unit, when the predetermined moving body and the arbitrary object collide in the simulation process, feeds back a result of the simulation process to the collision avoidance algorithm.

4. 3. The data processing device according to claim 2, wherein the processing unit, when, in the simulation process, the predetermined moving body and the arbitrary object avoid a collision and the predetermined moving body takes an evasive action that induces a collision with another object or moving body, feeds back a result of the simulation process to the collision avoidance algorithm.

5. The vehicle further includes a perception database that stores information necessary for the vehicle to avoid collisions; The data processing apparatus according to claim 1 , wherein the collision avoidance algorithm executes the simulation by referring to information stored in the perception database.

6. The data processing device according to claim 1 , wherein the processing unit executes the specific process by using each of the collision avoidance algorithm and another collision avoidance algorithm that does not use an output of the sentence generation model.

7. The data processing device according to claim 1 , wherein the sentence generation model receives real-world information indicating at least one of weather, road surface conditions, and environmental sensing information as input, and outputs the collision avoidance algorithm.

8. The data processing apparatus according to claim 1 , wherein the processing unit controls the moving object to take a collision avoidance action when there is a possibility of a collision with another moving object in the simulation process.

9. The processor: an input step of accepting user input; A processing step of performing a specific process using a sentence generation model that generates a sentence according to an input sentence; and outputting a result of the specific processing. The processing step comprises: determining whether a predetermined trigger condition is satisfied; the trigger condition being that an instruction regarding a simulation of collision avoidance between a predetermined moving body and an arbitrary object is input as the user input; The processing step further includes a step of acquiring a result of the specific processing by using an output of the sentence generation model when the information obtained from the user input is the input sentence when the trigger condition is satisfied, The specific processing is a simulation processing for avoiding a collision between the object and the moving body. Data processing methods.

10. On the computer, an input step of accepting user input; A processing step of performing a specific process using a sentence generation model that generates a sentence according to an input sentence; and outputting a result of the specific processing. The processing step comprises: determining whether a predetermined trigger condition is satisfied; the trigger condition being that an instruction regarding a simulation of collision avoidance between a predetermined moving body and an arbitrary object is input as the user input; The processing step further includes a step of acquiring a result of the specific processing by using an output of the sentence generation model when the information obtained from the user input is the input sentence when the trigger condition is satisfied, The specific processing is a simulation processing for avoiding a collision between the object and the moving body. Data processing program.

Images