Improvement item detection device, improvement item detection method, and program

Abstract

An acquisition unit (210) acquires sensor information and crew member identification information from a crew member terminal (10). A detection unit (220) processes the sensor information to detect an item requiring improvement. The item requiring improvement is an item that should be improved by a crew member. A selection unit (230) selects a transmission destination for caution information using information relating to the item requiring improvement. For example, the selection unit (230) selects the transmission destination using, for example, the type of the detected item requiring improvement. A transmission unit (240) transmits the caution information to the transmission destination selected by the selection unit (230). The caution information is information that indicates that the item requiring improvement has been detected.

Description

[Technical field]

[0001] The present invention relates to an improvement item detection device, an improvement item detection method, and a program. [Background technology]

[0002] Various skills are required of the crew members (e.g., drivers) who ride in vehicles, and various technologies have been developed to assist the crew members.

[0003] For example, Patent Document 1 discloses the following. First, a terminal device is mounted on the moving object. This terminal device processes the acquired information to determine whether the moving object or the operator is engaged in special operation. Examples of special operation include speeding, sudden acceleration, and sudden deceleration. Then, when the terminal device determines that the operation is special, it transmits information about the special operation to the operation monitoring device. The operation monitoring device uses the information acquired from the terminal device to determine whether or not notification is required for the moving object or the operator. Then, when notification is required, the operation monitoring device transmits predetermined information to the terminal device.

[0004] Patent Document 2 discloses a driving guide system that calculates the degree of hindrance to safe driving by the driver and provides guidance to the driver according to the degree of hindrance. The degree of hindrance is calculated using information acquired from sensors mounted on the vehicle. Examples of the sensors include a camera that photographs the driver's face, a microphone that detects voices inside the vehicle, a vehicle speed sensor, and a satellite positioning system.

[0005] Patent Document 3 describes that the vehicle control device recognizes the sign contents of the sign objects around the vehicle and controls the running state of the vehicle according to the sign contents. Patent Document 3 also describes that an alarm sounds when the driver parks the vehicle and leaves the vehicle in a place where there is a "No Parking" sign. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2003-048447 A [Patent Document 2] JP 2020-064554 A [Patent Document 3] International Publication No. 2016 / 002276 Summary of the Invention [Problem to be solved by the invention]

[0007] As described above, vehicle drivers are required to have various skills. In order to acquire these skills, they need to be trained by experienced instructors. However, if the number of drivers who need training is large compared to the number of instructors, the instructors' workload increases. One example of an objective of the present invention is to reduce the workload of instructors who train vehicle drivers. [Means for solving the problem]

[0008] According to the present invention, an acquisition means for acquiring sensor information indicating a detection result of a sensor that detects at least one of an evaluation target, which is at least one of a vehicle and a crew member of the vehicle, and the surroundings of the evaluation target; A detection means for detecting an item that should be improved by the crew by processing the sensor information; a selection means for selecting a destination of a warning message indicating that the item to be improved has been detected, using the information regarding the item to be improved; a transmission means for transmitting the warning information to the destination selected by the selection means; An improvement item detection device is provided, comprising:

[0009] According to the present invention, a computer An acquisition process for acquiring sensor information indicating a detection result of a sensor that detects at least one of an evaluation target, which is at least one of a vehicle and a crew member of the vehicle, and the surroundings of the evaluation target; A detection process for detecting an item to be improved by the crew by processing the sensor information; a selection process for selecting a destination of a warning message indicating that the item to be improved has been detected, using the information regarding the item to be improved; a transmission process for transmitting the warning information to the destination selected by the selection means; A method for detecting improvements is provided.

[0010] According to the present invention, a computer includes: An acquisition function for acquiring sensor information indicating a detection result of a sensor that detects at least one of an evaluation target, which is at least one of a vehicle and a crew member of the vehicle, and the surroundings of the evaluation target; A detection function that detects an item that the crew should improve by processing the sensor information; a selection function for selecting a destination of a warning message indicating that the item to be improved has been detected, using the information regarding the item to be improved; a transmission function of transmitting the warning information to the destination selected by the selection means; A program will be provided to help students develop these skills. Effect of the Invention

[0011] According to the present invention, the burden on the instructor who instructs the vehicle drivers is reduced. [Brief description of the drawings]

[0012] The above objects, as well as other objects, features and advantages, will become more apparent from the following preferred embodiments and the accompanying drawings.

[0013] [Figure 1] FIG. 1 is a diagram for explaining a usage environment of an improvement item detection device according to a first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a functional configuration of a crew terminal. [Diagram 3] 13A and 13B are diagrams for explaining an example of how to use the crew terminal. [Figure 4] FIG. 2 is a diagram showing a modification of FIG. [Diagram 5] FIG. 2 illustrates an example of a functional configuration of an improvement item detection device. [Figure 6] 4 is a diagram for explaining an example of information stored in a target item storage unit; FIG. [Figure 7] 4 is a diagram for explaining an example of information stored in a target item storage unit; FIG. [Figure 8] 4 is a diagram for explaining an example of information stored in a target item storage unit; FIG. [Figure 9] FIG. 8 is a diagram showing a modification of FIG. 7. [Figure 10] FIG. 4 is a diagram showing an example of information stored in a crew information storage unit. [Figure 11] FIG. 2 illustrates an example of a hardware configuration of the improvement item detection device. [Figure 12] 13 is a flowchart illustrating an example of a process performed by an improvement item detection device. [Figure 13] FIG. 13 is a diagram showing a first example of a screen displayed by an instructor device. [Figure 14] FIG. 13 is a diagram showing a second example of a screen displayed by the instructor device. [Figure 15] FIG. 11 is a diagram illustrating a functional configuration of an improvement item detection device according to a second embodiment. [Figure 16] FIG. 11 is a diagram for explaining a usage environment of an improvement item detection device according to a third embodiment. [Figure 17] FIG. 13 is a diagram illustrating an example of a functional configuration of an improvement item detection device according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are given the same reference numerals and the description will be omitted as appropriate.

[0015] (First embodiment) FIG. 1 is a diagram for explaining a usage environment of an improvement item detection device 20 according to this embodiment. The improvement item detection device 20 is a device for improving the skills of a vehicle driver, and is used together with a driver terminal 10 (an example of a first device) and an instructor device 30 (an example of a second device). An example of a driver is a driver, but it may be someone else (for example, a tour conductor). In addition, the vehicle is, for example, a logistics vehicle (truck or delivery vehicle), but it may also be a taxi or a bus.

[0016] The crew terminal 10 is a portable communication terminal carried by the crew. The crew terminal 10 is, for example, a smartphone or a tablet terminal, but is not limited to these. The instructor device 30 is a communication terminal for a person who trains the crew (hereinafter, referred to as an instructor). The instructor device 30 may be a portable terminal or a fixed terminal.

[0017] The crew terminal 10 has various sensors, for example, an imaging unit. These sensors detect at least one of a vehicle and a crew member (hereinafter referred to as an evaluation target) and at least one of the surroundings of the evaluation target. For example, when the evaluation target is a vehicle, the detection target includes at least one of the vehicle and its surroundings (for example, in front of the vehicle). When the evaluation target is a crew member, the detection target includes the crew member and its surroundings (for example, objects or people in front of the crew member). The crew terminal 10 transmits information indicating the detection results of the sensors (hereinafter referred to as sensor information) to the improvement item detection device 20 in real time.

[0018] The improvement item detection device 20 detects items that the driver should improve (hereinafter, referred to as improvement-required items) by processing the sensor information in real time. As will be described in detail later, there are various items that need improvement. For example, the improvement items may be items related to the driving of the vehicle, items related to a pre-driving inspection of the vehicle, or items related to work performed when the vehicle is stopped. The work performed when the vehicle is stopped may be work to stop the vehicle in a safe state, or communication with others (e.g., customers).

[0019] When an improvement item is detected, the improvement item detection device 20 uses information about the improvement item to select a destination to which information indicating that an improvement item has been detected (hereinafter referred to as warning information) is to be sent. At this time, the improvement item detection device 20 selects a destination to which information indicating that an improvement item has been detected (hereinafter referred to as warning information) is to be sent, for example, by using the type of the detected improvement item and the seriousness or importance of the detected content. In addition, the destination to which the warning information is to be sent is selected from, for example, the crew terminal 10, the instructor device 30, or both the crew terminal 10 and the instructor device 30. The improvement item detection device 20 then transmits the warning information to the selected destination.

[0020] When the improvement item detection device 20 is used, multiple crew members can be assigned to one instructor. In this case, the number of crew terminals 10 connected to the improvement item detection device 20 is greater than the number of instructor devices 30 connected to the improvement item detection device 20. The improvement item detection device 20 may assign, for example, 10 or more (preferably 50 or less) crew terminals 10 to one instructor device 30.

[0021] 2 is a diagram showing an example of a functional configuration of the crew terminal 10. The crew terminal 10 includes a sensor 110, a communication unit 120, a notification processing unit 130, a display 141, and a speaker 142.

[0022] The sensor 110 detects the state and behavior of the detection target and generates sensor information. In the example shown in the figure, the sensor 110 has a first imaging unit 111, a second imaging unit 112, a sound recording unit 113, and an acceleration sensor 114.

[0023] The first imaging unit 111 and the second imaging unit 112 capture images of the surroundings of the crew terminal 10 to generate image data. The frame rate of this image data is, for example, 5 fps (frames per second) or more, but the optimal value varies depending on the application (for example, 10 fps or more). The first imaging unit 111 and the second imaging unit 112 have opposite imaging directions. For example, if the crew terminal 10 is a smartphone, the first imaging unit 111 is mounted on the back side, and the second imaging unit 112 is mounted on the front side. By processing the image data generated by the first imaging unit 111 and the second imaging unit 112, for example, the behavior and action of the crew, the moving state of the vehicle, the situation around the crew, and the situation around the vehicle can be identified.

[0024] The recording unit 113 generates voice data by recording sounds around the crew terminal 10. By processing this voice data, for example, the statements of the crew and those of people around the crew can be identified.

[0025] The acceleration sensor 114 generates acceleration data indicating the acceleration applied to the crew terminal 10. The acceleration can be determined by processing the acceleration data. If it is necessary to calculate the speed of the crew terminal 10, it is preferable that the sensor 110 includes a sensor for GPS.

[0026] The sensor 110 may further include other sensors. For example, the sensor 110 may include at least one of a temperature sensor, a brightness sensor, a vibration sensor, and a sensor for fingerprint authentication.

[0027] The communication unit 120 transmits the sensor information generated by the sensor 110 to the improvement item detection device 20. This transmission is preferably performed in real time. In this case, it is not necessary to provide the crew terminal 10 with a large-capacity storage.

[0028] In this transmission, the communication unit 120 also transmits information capable of identifying the crew member (hereinafter, referred to as crew member identification information) to the improvement item detection device 20. The crew member identification information may be an ID given to the crew member, or may be terminal identification information given to the crew member terminal 10. In addition, the communication unit 120 receives the above-mentioned warning information from the improvement item detection device 20.

[0029] When the communication unit 120 acquires the alert information, the notification processing unit 130 causes at least one of the display 141 and the speaker 142 to output information indicating the acquisition.

[0030] The communication unit 120 may suspend the transmission of the sensor information to the improvement item detection device 20 when a specific instruction is input via an input unit (e.g., a touch panel). This is done, for example, when a crew member takes a break. Then, when information to start transmission is further input, the communication unit 120 resumes the transmission of the sensor information. The timings for suspending and resuming transmission are stored in the improvement item detection device 20.

[0031] Furthermore, the improvement item detection device 20 may be configured to communicate with the instructor device 30 when a predetermined instruction is input via an input unit (e.g., a touch panel). This communication may be performed via the improvement item detection device 20, or may be performed directly between the crew terminal 10 and the instructor device 30. An example of this communication is a phone call. This function is used, for example, when the crew decides that they want to immediately contact the instructor.

[0032] Each diagram in Fig. 3 is a diagram for explaining an example of a method of using the crew terminal 10. In the example shown in the diagram, the crew terminal 10 has a first imaging unit 111 on one side and a second imaging unit 112 on the opposite side to the one side.

[0033] As shown in FIG. 3(A), while the crew member is in the vehicle, the crew terminal 10 is fixed inside the vehicle and in front of the windshield. In this state, the first imaging unit 111 images the front of the vehicle, and the second imaging unit 112 images the crew member. Therefore, by analyzing the image data generated by the first imaging unit 111, it is possible to determine the surroundings of the moving vehicle, the speed and acceleration of the vehicle, whether the vehicle is moving in accordance with traffic regulations, and whether there is a possibility that the vehicle may cause an accident. In addition, by analyzing the image data generated by the second imaging unit 112, it is possible to identify the state of the crew member in the vehicle (for example, the driver's posture and state while driving).

[0034] 3B, while the crew member is getting off the vehicle, the crew terminal 10 is put away in the crew member's breast pocket. However, the first imaging unit 111 is exposed from the breast pocket. Therefore, by analyzing the image data generated by the first imaging unit 111, it is possible to identify the work the crew member is doing while getting off the vehicle. In addition, when the crew member attends to a person, it is also possible to identify the condition (e.g., whether or not the person is normal) and behavior of the person whom the crew member attended to.

[0035] In both Fig. 3(A) and (B), the recording unit 113 of the crew terminal 10 may generate voice data. In this case, for example, in the example of Fig. 3(A), the state of the crew can be identified by analyzing the voice uttered by the crew. Also, in the example of Fig. 3(B), the contents of the conversation between the crew and the person whom the crew served can be identified.

[0036] FIG. 4 is a diagram showing a modified example of FIG. 1. In the example shown in this figure, the crew terminal 10 communicates with the in-vehicle device 40, and information acquired from the in-vehicle device 40 is also included in the sensor information. The information acquired from the in-vehicle device 40 indicates the detection results of the sensors mounted on the vehicle. The detection results include, for example, at least one of image data generated by an in-vehicle camera, speed data generated by a speedometer, and data indicating various operations performed by the driver on the vehicle. The crew terminal 10 communicates with the in-vehicle device 40 using, for example, short-range wireless communication.

[0037] 5 is a diagram showing an example of the functional configuration of the improvement item detection device 20. In the example shown in this figure, the improvement item detection device 20 includes an acquisition unit 210, a detection unit 220, a selection unit 230, and a transmission unit 240.

[0038] The acquisition unit 210 acquires the sensor information and the crew identification information from the crew terminal 10.

[0039] The detection unit 220 detects the above-mentioned improvement-required items by processing the sensor information. The detection unit 220 detects the improvement-required items by using, for example, a detection model. This detection model is generated by, for example, machine learning, and is stored in the target item storage unit 250.

[0040] Furthermore, the detection unit 220 may assign a score to the detected improvement-requiring items. This score is used when evaluating the crew member. Data for assigning this score is stored, for example, in the target item storage unit 250. As an example, the target item storage unit 250 stores a score for each item.

[0041] The selection unit 230 selects a destination to which the warning information is to be transmitted, using information on the improvement-requiring item. For example, the selection unit 230 selects a destination to which the warning information is to be transmitted, using the type of the detected improvement-requiring item.

[0042] As an example, for items that should be communicated to the crew on the spot, the transmission destination includes the crew terminal 10. In this case, the transmission destination may further include the instructor device 30. On the other hand, for items that should be communicated to the crew via an instructor, the transmission destination is the instructor device 30.

[0043] The selection unit 230 selects the destination by using information stored in the target item storage unit 250. The target item storage unit 250 stores information indicating the destination for each improvement-requiring item. Details of the information stored in the target item storage unit 250 will be described later with reference to other figures.

[0044] The selection unit 230 may also select a destination using the severity or importance of the detected content. For example, when the crew member is a driver and the vehicle speed exceeds a reference value, the selection unit 230 may select a destination according to the excess value. For example, when the excess value is equal to or less than the reference value, the selection unit 230 selects the instructor device 30 as the destination, and when the excess value is equal to or more than the reference value, the selection unit 230 selects both the crew terminal 10 and the instructor device 30 as the destination.

[0045] The transmitting unit 240 generates the above-mentioned warning information. The warning information includes, for example, information indicating the contents of the detected improvement-requiring item. The contents of the improvement-requiring item include, for example, the occurrence date and time of the improvement-requiring item, the occurrence location, the item name, and detailed information (for example, seriousness or urgency). At this time, the transmitting unit 240 may change at least a part of the information included in the warning information depending on the transmission destination. In this case, at least a part of one of the warning information transmitted to the crew terminal 10 and the warning information transmitted to the instructor device 30 is not included in the other. For example, the warning information transmitted to the instructor device 30 includes the crew member identification information, but the warning information transmitted to the crew terminal 10 may not include the crew member identification information. In this case, the instructor device 30 displays the crew member identification information (for example, the name of the crew member), but the crew terminal 10 does not display the crew member identification information.

[0046] The transmitting unit 240 then transmits the warning information to the destination selected by the selecting unit 230. The timing at which the transmitting unit 240 transmits the warning information is, for example, real time. In particular, when there is a serious problem with customer service or when a serious traffic violation has been committed, it is preferable to transmit the warning information immediately. However, this transmission timing may be a timing when the driver's work is expected to be completed, or may be set for each destination.

[0047] The acquisition unit 210 associates the acquired sensor information with a crew member and stores it in the crew information storage unit 260. Details of the information stored in the crew information storage unit 260 will be described later with reference to other figures.

[0048] In the example shown in the figure, the target item storage unit 250 and the crew information storage unit 260 are provided in the improvement item detection device 20. However, the target item storage unit 250 and the crew information storage unit 260 may be provided outside the improvement item detection device 20.

[0049] 6, 7, 8, and 9 are diagrams for explaining an example of information stored in the target item storage unit 250. The target item storage unit 250 stores information related to improvement-requiring items. The information related to the improvement-requiring items includes a detection model (not shown) for detecting the improvement-requiring items, data used in the detection model (referred to as analysis source in the figures), and information specifying a transmission destination. Here, the information specifying a transmission destination is stored for each improvement-requiring item.

[0050] Here, when a plurality of trainers use the improvement item detection device 20, the information for identifying the transmission destination may be set for each trainer. In this case, this setting is performed by each trainer.

[0051] 6, the improvement item is related to a vehicle inspection that should be performed by a driver before starting work. The presence or absence of an improvement item and the name of the item are identified, for example, by analyzing the image data generated by the first imaging unit 111 and the sound data generated by the sound recording unit 113.

[0052] Although not shown in the figure, the target item storage unit 250 may store data for calculating the score. For example, the target item storage unit 250 may store scores for each item. This also applies to Figs. 7, 8, and 9. Note that even for the same item, the seriousness or urgency may differ depending on the content. In this case, the target item storage unit 250 may store scores for each item and for each seriousness (or urgency).

[0053] In the example shown in Fig. 7, the items requiring improvement relate to the driver's skills and actions when driving a vehicle. For example, the items requiring improvement include the state of driving (whether the driver is concentrating on driving or not, for example, whether the driver is looking away from the road or not while driving), the length of idling, whether the driver points to check while driving (or when the driver starts driving), the degree of acceleration and deceleration, whether the driver has violated a traffic law (for example, speeding and violation of a stop sign), whether the driver keeps a sufficient distance between vehicles, whether the route from departure to the destination is appropriate, whether there is a problem with the tachograph, whether the driver is driving in a fuel-efficient manner, and whether the timing and length of breaks are appropriate.

[0054] The presence or absence of items requiring improvement and the names of those items are identified, for example, by analyzing at least one of the image data generated by the first imaging unit 111 (i.e., image data capturing an image of the front of the vehicle), the image data generated by the second imaging unit 112 (i.e., image data capturing an image of the driver), the audio data generated by the recording unit 113 (i.e., audio data from inside the vehicle and its surroundings), the acceleration data generated by the acceleration sensor 114 (i.e., vehicle acceleration data), and the position data generated by the position detection unit 115 (i.e., vehicle position data).

[0055] For example, the driving state and the presence or absence of pointing confirmation are identified by analyzing the image data and audio data generated by the second imaging unit 112. The idling duration is identified by analyzing the data and audio data generated by the first imaging unit 111. The degree of acceleration / deceleration is identified by analyzing the acceleration data.

[0056] The size of the inter-vehicle distance is determined by analyzing image data generated by the first imaging unit 111. The presence or absence of a traffic violation is determined using the position data and image data generated by the first imaging unit 111. The presence or absence of fuel-efficient driving is determined using image data (used, for example, when recognizing a speed limit) generated by the first imaging unit 111, acceleration data, and position data.

[0057] Furthermore, the presence or absence of a traffic violation and the fuel-efficient driving may be further determined using map data including traffic rules by location. The tachograph is determined using, for example, image data, acceleration data, and position data generated by the first imaging unit 111. The travel route of the vehicle is determined using the position data.

[0058] Moreover, whether or not the driver is taking a break is specified using the image data and position data generated by the second imaging unit 112. For example, the detection unit 220 determines that the driver is taking a break when the driver is in the vehicle but the vehicle is stopped for a period of time that exceeds a reference value. However, the detection unit 220 may further process the image data generated by the first imaging unit 111 to determine whether or not the driver is caught in traffic, and if caught in traffic, determine that the driver is not taking a break. Moreover, whether or not the driver is taking a break may be specified using a period during which the transmission of the detection result signal is interrupted.

[0059] In the example shown in FIG. 8, the improvement items are related to the driver's actions when the vehicle is stopped. As an example, the improvement items are the work performed when the vehicle is stopped (e.g., whether or not tire stops have been installed) and whether or not the vehicle is stopped in an appropriate position (e.g., whether or not the vehicle is stopped in a no-stopping zone). The driver may serve customers while getting off the vehicle. In this case, the improvement items include items related to customer service (e.g., customer service attitude). The presence or absence of these improvement items is identified using at least one of the image data generated by the first imaging unit 111 (i.e., an image of the driver's surroundings), the audio data generated by the audio recording unit 113 (i.e., the audio of the driver and his surroundings), and the position data generated by the position detection unit 115 (i.e., the vehicle's position data).

[0060] For example, the work performed while the vehicle is stopped is identified using image data generated by the first imaging unit 111. The stopping position is identified by analyzing the position data. The customer service attitude (e.g., language choice) is identified by analyzing the conversation included in the voice data.

[0061] FIG. 9 shows a modified example of FIG. 7. In this example, some items are set to a destination according to the seriousness (or urgency). For example, when the acceleration / deceleration is equal to or lower than a reference value (represented as seriousness 1 in the figure), the destination is either the crew terminal 10 or the instructor device 30. On the other hand, when the acceleration / deceleration exceeds a reference value (represented as seriousness 2 in the figure), the destination is either the crew terminal 10 or the instructor device 30. Also, when the seriousness of the traffic violation is relatively low (for example, when the speed limit is equal to or lower than a reference value (for example, 5 km / hour)), the destination is either the crew terminal 10 or the instructor device 30. On the other hand, when the seriousness of the traffic violation is high (for example, when the speed limit exceeds a reference value (for example, 5 km / hour)), the destination is either the crew terminal 10 or the instructor device 30.

[0062] 10 is a diagram showing an example of information stored in the crew information storage unit 260. The crew information storage unit 260 stores, for each crew member, crew member identification information (e.g., identification information given to the crew member), name, length of experience, sensor information, and information on the detected improvement-requiring items. The information on the improvement-requiring items includes the content of the improvement-requiring item (e.g., item name), the detection date and time, and the detection point. In addition, if the detection unit 220 has calculated a score for the improvement-requiring item, the information on the improvement-requiring item also includes this score.

[0063] The instructor can then view information (e.g., at least one of information related to the items requiring improvement and sensor information) stored in the driver information storage unit 260 via the instructor device 30. At this time, the instructor may input search conditions (e.g., at least one of driver identification information, item name of the items requiring improvement, detection date and time range, and detection point range) to the instructor device 30. The improvement item detection device 20 then reads out information that satisfies the search conditions from the driver information storage unit 260 and displays it on the instructor device 30.

[0064] 11 is a diagram showing an example of the hardware configuration of the improvement item detection device 20. The improvement item detection device 20 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0065] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0066] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0067] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0068] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the improvement item detection device 20 (e.g., the acquisition unit 210, the detection unit 220, the selection unit 230, and the transmission unit 240). The processor 1020 loads each of these program modules onto the memory 1030 and executes them to realize each function corresponding to the program module. The storage device 1040 also functions as a target item storage unit 250 and a crew information storage unit 260.

[0069] The input / output interface 1050 is an interface for connecting various input / output devices to the improvement item detection device 20. Note that, when the improvement item detection device 20 is a cloud server, the input / output interface 1050 may be omitted.

[0070] The network interface 1060 is an interface for connecting the improvement item detection device 20 to a network. This network is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The network interface 1060 may be connected to the network by wireless connection or by wired connection. The improvement item detection device 20 communicates with the crew terminal 10 and the instructor device 30 via the network interface 1060.

[0071] An example of the hardware configuration of the driver terminal 10 and the instructor device 30 is also as shown in FIG.

[0072] 12 is a flowchart showing an example of processing performed by the improvement item detection device 20. First, the crew terminal 10 repeatedly transmits sensor information in real time to the improvement item detection device 20. Then, the improvement item detection device 20 performs the processing shown in this figure in real time every time it acquires sensor information.

[0073] The acquisition unit 210 of the improvement item detection device 20 acquires sensor information (step S110). Next, the detection unit 220 processes the acquired sensor information to detect an item requiring improvement (step S120). If no item requiring attention is detected (step S130: No), the process returns to step S110.

[0074] If a caution item is detected (step S130: Yes), the selection unit 230 uses information about the detected caution item to select a destination to which the caution information is to be sent (step S140). The transmission unit 240 then generates caution information (step S150). At this time, the transmission unit 240 changes information included in the caution information depending on the destination, as necessary. The transmission unit 240 then transmits the generated caution information to the destination (step S160).

[0075] If the destination includes the crew terminal 10, the crew terminal 10 performs a process (e.g., output of a ringtone) to notify the crew that the warning information has been received. Then, the crew terminal 10 displays the warning information when the crew looks at the crew terminal 10. The warning information includes at least the contents of the items requiring attention.

[0076] On the other hand, if the instructor device 30 is included in the transmission destination, the instructor device 30 immediately displays the warning information. The warning information includes at least the contents of the items requiring attention and the driver identification information. When displaying the warning information, the instructor device 30 may include the name of the driver as part of the driver identification information. In this case, the name may be included in the warning information first transmitted by the improvement item detection device 20, or the instructor device 30 may request the name to the improvement item detection device 20 after receiving the warning information.

[0077] In addition to the process shown in Fig. 12, the improvement item detection device 20 may accumulate the score of the day for each driver, and when the accumulated value exceeds a standard, information indicating that fact may be immediately transmitted to the instructor device 30 for display. The standard used here may be set for each driver. As an example, the instructor device 30 may set this standard using the length of experience of the driver.

[0078] 12, the transmission unit 240 of the improvement item detection device 20 may always transmit at least one of the image data generated by the first imaging unit 111 and the image data generated by the second imaging unit 112, and the position data generated by the position detection unit 115 to the instructor device 30. In this case, the transmission unit 240 also transmits the driver identification information together with the image data. The instructor device 30 then displays the image data together with the driver identification information in real time.

[0079] FIG. 13 is a diagram showing a first example of a screen displayed by the instructor device 30. In the example shown in this figure, multiple crew members are assigned to one instructor. Therefore, multiple crew terminals 10 are linked to one instructor device 30. The instructor device 30 displays multiple image data generated by these multiple crew terminals 10 in real time. At this time, the instructor device 30 displays the image data in association with information (e.g., name) about the crew member corresponding to the image data. This allows the instructor to grasp the status of each crew member by looking at the instructor device 30.

[0080] 14 is a diagram showing a second example of a screen displayed by the instructor device 30. In the example shown in this figure, multiple crew members are assigned to one instructor. The instructor device 30 displays a map. On this map, the instructor device 30 may display a mark indicating that a caution item is frequently detected at a point. This mark may be changed depending on, for example, the type of caution item or the frequency of detection.

[0081] The instructor device 30 then displays the current location of each of the multiple drivers on the map. At this time, the instructor device 30 may further display other information. The information displayed here is customized by the instructor, for example, and includes at least one of the driving history (i.e., the route traveled), speed, and whether or not the driver is on a break for each of the multiple drivers. The driving history may include stopping locations and stopping times. In the case where the driver is a delivery person of a delivery vehicle, the stopping time corresponds to the time required for delivery.

[0082] When the instructor selects this current position, the instructor device 30 displays information (including at least a part of the sensor information) about the driver corresponding to the current position. The information displayed here may also be customized by the instructor.

[0083] As described with reference to FIG. 10, the instructor can view the information stored in the driver information storage unit 260 via the instructor device 30.

[0084] As described above, according to this embodiment, by using the improvement item detection device 20, information on a plurality of crew members can be displayed on one instructor device 30. At this time, the improvement item detection device 20 narrows down the information to be displayed on the instructor device 30. Therefore, the burden on the instructor is reduced.

[0085] Second embodiment 15 is a diagram showing the functional configuration of the improvement item detection device 20 according to this embodiment. The improvement item detection device 20 shown in this figure has the same functions as the improvement item detection device 20 according to the first embodiment, except that it has a report creation unit 270.

[0086] The report creation unit 270 generates report information for each crew member, and transmits this report information to at least one of the crew terminal 10 and the instructor device 30. The report information includes information regarding the detected items requiring improvement. The report information is generated at predetermined intervals (e.g., every day, week, or month). The instructor may also add information indicating the content that the crew member should improve (i.e., the content of the instruction from the instructor to the crew member) to the report information transmitted to the instructor device 30. In this case, the improvement item detection device 20 stores the added information in the crew information storage unit 260, and transmits the report information after the addition to the crew terminal 10.

[0087] This embodiment also reduces the burden on the instructor. In addition, the report creation unit 270 generates report information for each of a plurality of crew members, so that the burden on the instructor is further reduced.

[0088] Third embodiment Fig. 16 is a diagram for explaining the usage environment of the improvement item detection device 20 according to this embodiment. The improvement item detection device 20 has the same functions as any of the above-mentioned embodiments, except that the improvement items to be detected can be set using a setting terminal 50. The setting terminal 50 is managed by the company that employs the driver. The target item storage unit 250 of the improvement item detection device 20 stores the information shown in Figs. 6 to 10 for each company.

[0089] Fig. 17 is a diagram showing an example of the functional configuration of the improvement item detection device 20. In the example shown in this figure, the improvement item detection device 20 has the same configuration as the improvement item detection device 20 according to the first embodiment, except that it has a setting processing unit 280. Note that the improvement item detection device 20 according to the second embodiment may also have the setting processing unit 280.

[0090] The setting processing unit 280 causes the setting terminal 50 to display a setting screen. This setting screen is a screen for setting improvement-requiring items to be detected. The setting processing unit 280 then updates the target item storage unit 250 so that the items set using this screen become targets. Accordingly, the information included in the sensor information is also updated. Furthermore, the setting screen displayed on the setting terminal 50 may be capable of setting at least one of the day and time period on which the improvement item detection device 20 will perform processing. In this case, the improvement item detection device 20 operates on the set day and / or time period. The timing of updating the setting contents is arbitrary.

[0091] This embodiment also reduces the burden on the trainer. In addition, the trainer's burden is further reduced because the improvement item detection device 20 can narrow down the improvement items to be detected.

[0092] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted.

[0093] In addition, in the flowcharts used in the above description, multiple steps (processes) are described in order, but the order of execution of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the figures can be changed to the extent that the content is not affected. In addition, the above-mentioned embodiments can be combined to the extent that the content is not contradictory.

[0094] A part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. 1. An acquisition means for acquiring sensor information indicating a detection result of a sensor that detects at least one of an evaluation target, which is at least one of a vehicle and a crew member of the vehicle, and the surroundings of the evaluation target; A detection means for detecting an item that should be improved by the crew by processing the sensor information; a selection means for selecting a destination of a warning message indicating that the item to be improved has been detected, using the information regarding the item to be improved; a transmission means for transmitting the warning information to the destination selected by the selection means; An improvement item detection device comprising: 2. In the improvement item detection device according to the above item 1, The selection means selects the destination by using a type of the item to be improved. 3. In the improvement item detection device according to 1 or 2 above, The detection means determines a seriousness or urgency of the item to be improved for the crew member, The selection means selects the destination by using the degree of seriousness or the degree of urgency. 4. In the improvement item detection device according to any one of 1 to 3 above, The selection means is an improvement item detection device that selects the destination from among a first device for making the crew member aware of the warning information, a second device for making the crew member's instructor aware of the warning information, and both the first device and the second device. 5. In the improvement item detection device according to the above item 4, an improvement item detection device, wherein, when the first device is included in the transmission destination, the warning information transmitted to the first device includes a name of the item to be improved. 6. In the improvement item detection device according to 4 or 5 above, An improvement item detection device, wherein when the destination includes the second device, the warning information sent to the second device includes crew identification information that can identify the crew and the name of the item to be improved. 7. In the improvement item detection device according to any one of claims 4 to 6, An improvement item detection device, wherein, when the transmission destinations include the first device and the second device, at least a part of the warning information transmitted to the first device and the warning information transmitted to the second device is not included in the other. 8. In the improvement item detection device according to any one of claims 4 to 7, The sensor is mounted on a mobile terminal carried by the crew member, The first device is the mobile terminal, 9. In the improvement item detection device according to any one of 1 to 8 above, An improvement item detection device, wherein the sensor information indicates the results of detecting the driver and / or the driver's surroundings when the vehicle is stopped and the driver has disembarked. 10. In the improvement item detection device according to the above item 9, The driver is serving customers while alighting, The improvement item detection device, wherein the item to be improved is an item related to customer service. 11. In the improvement item detection device according to the above item 9, The crew performs work on the vehicle while disembarking, The improvement item detection device, wherein the item to be improved is an item related to the work. 12. In the improvement item detection device according to any one of 1 to 8 above, the sensor information indicates a position of the vehicle; The improvement item detection device, wherein the item to be improved relates to a stopping position of the vehicle. 13. In the improvement item detection device according to any one of 1 to 11 above, a setting processing means for displaying on a terminal a setting screen for setting the items to be improved that are to be detected by the detection means, The detection means detects items set using the setting screen. 14. The computer An acquisition process for acquiring sensor information indicating a detection result of a sensor that detects at least one of an evaluation target, which is at least one of a vehicle and a crew member of the vehicle, and the surroundings of the evaluation target; A detection process for detecting an item to be improved by the crew by processing the sensor information; a selection process for selecting a destination of a warning message indicating that the item to be improved has been detected, using the information regarding the item to be improved; a transmission process for transmitting the warning information to the selected destination; A method for detecting improvements. 15. In the improvement item detection method according to 14 above, In the selection process, the computer selects the destination by using a type of the item to be improved. 16. In the improvement item detection method according to 14 or 15 above, In the detection process, the computer determines a seriousness or urgency of the item to be improved for the crew, In the selection process, the computer selects the destination using the severity or urgency. 17. In the improvement item detection method according to any one of the above 14 to 16, An improvement item detection method in which, in the selection process, the computer selects the destination from among a first device for making the crew member aware of the warning information, a second device for making the crew member's instructor aware of the warning information, and both the first device and the second device. 18. In the improvement item detection method according to 17 above, A method for detecting an improvement item, wherein, when the first device is included in the destination of the warning information, the warning information transmitted to the first device includes a name of the item to be improved. 19. In the improvement item detection method according to 17 or 18 above, An improvement item detection method, in which, when the destination includes the second device, the warning information sent to the second device includes crew identification information capable of identifying the crew and the name of the item to be improved. 20. In the improvement item detection method according to any one of the above 17 to 19, An improvement item detection method, in which, when the destinations include the first device and the second device, at least a part of the warning information transmitted to the first device and the warning information transmitted to the second device is not included in the other. 21. In the improvement item detection method according to any one of the above 17 to 20, The sensor is mounted on a mobile terminal carried by the crew member, The improvement item detection method, wherein the first device is the mobile terminal. 22. In the improvement item detection method according to any one of the above 14 to 21, An improvement item detection method, wherein the sensor information indicates the results of detecting the driver and / or the driver's surroundings when the vehicle is stopped and the driver has disembarked. 23. In the improvement item detection method according to 22 above, The driver is serving customers while alighting, The improvement item detection method, wherein the item to be improved is an item related to customer service. 24. In the improvement item detection method according to 22 above, The crew performs work on the vehicle while disembarking, The improvement item detection method, wherein the item to be improved is an item related to the work. 25. In the improvement item detection method according to any one of the above 14 to 21, the sensor information indicates a position of the vehicle; The improvement item detection method, wherein the item to be improved relates to a stopping position of the vehicle. 26. In the improvement item detection method according to any one of the above 14 to 24, The computer includes: performing a setting process for displaying on a terminal a setting screen for setting the items to be improved that are to be detected in the detection process; The improvement item detection method, wherein the detection process targets items set using the setting screen. 27. To the computer, An acquisition function for acquiring sensor information indicating a detection result of a sensor that detects at least one of an evaluation target, which is at least one of a vehicle and a crew member of the vehicle, and the surroundings of the evaluation target; A detection function that detects an item that the crew should improve by processing the sensor information; a selection function for selecting a destination of a warning message indicating that the item to be improved has been detected, using the information regarding the item to be improved; a transmission function for transmitting the warning information to the destination selected by the selection function; A program that allows you to have 28. In the program according to 27 above, The selection function selects the destination using the type of the item to be improved. 29. In the program according to 27 or 28 above, The detection function determines a level of seriousness or urgency of the item to be improved for the crew, The selection function selects the destination using the severity or urgency, said program. 30. In the program according to any one of claims 27 to 29, The selection function is a program that selects the destination from among a first device for making the crew member aware of the warning information, a second device for making the crew member's instructor aware of the warning information, and both the first device and the second device. 31. In the program according to claim 30, When the first device is included in the destination of the warning information, the warning information transmitted to the first device includes a name of the item to be improved. 32. In the program according to 30 or 31 above, A program in which, when the second device is included in the destination, the warning information sent to the second device includes crew member identification information capable of identifying the crew member and the name of the item to be improved. 33. In the program according to any one of the above items 30 to 32, A program in which, when the destinations include the first device and the second device, at least a portion of one of the warning information transmitted to the first device and the warning information transmitted to the second device is not included in the other. 34. In the program according to any one of the above items 30 to 33, The sensor is mounted on a portable terminal carried by the crew member, The first device is the mobile terminal. 35. In the program according to any one of the above 27 to 34, The program, wherein the sensor information indicates the results of detecting the driver and / or the driver's surroundings when the vehicle is stopped and the driver has disembarked. 36. In the program according to 35 above, The driver is serving customers while alighting, The items to be improved are customer service-related items, program. 37. In the program according to 35 above, The crew performs work on the vehicle while disembarking, A program, wherein the items to be improved are items related to the work. 38. In the program according to any one of the above 27 to 34, the sensor information indicates a position of the vehicle; The item to be improved relates to the stopping position of the vehicle. 39. In the program according to any one of claims 27 to 37, a setting processing function for causing the computer to display on a terminal a setting screen for setting the items to be improved that are to be detected by the detection function; The detection function is a program that detects items set using the setting screen. [Explanation of symbols]

[0095] 10. Crew terminal 20 Improvement item detection device 30 Instructor device 40 Onboard equipment 50 Setting terminal 110 Sensors 111 First imaging unit 112 Second imaging unit 113 Recording Section 114 Acceleration Sensor 115 Position detection unit 120 Communications Department 130 Notification processing unit 141 Display 142 Speaker 210 Acquisition Department 220 Detection unit 230 Selection section 240 Transmitter 250 Target Item Memory Unit 260 Crew information storage unit 270 Report Writing Department 280 Setting Processing Section

Claims

1. An acquisition means for acquiring sensor information indicating a detection result of a sensor having as a detection target at least one of an evaluation target, which is at least one of a vehicle and a crew member of the vehicle, and an area around the evaluation target; A detection means for detecting an item that should be improved by the crew by processing the sensor information; a selection means for selecting a destination of a warning message indicating that the item to be improved has been detected, using the information regarding the item to be improved; a transmission means for transmitting the warning information to the destination selected by the selection means; Equipped with The detection means determines a seriousness or urgency of the item to be improved for the crew member, the selection means selects the destination from among a first device for making the crew recognize the warning information, a second device for making an instructor of the crew recognize the warning information, and both the first device and the second device, using a level of seriousness or urgency of the item to be improved for the crew; The selection means is When the acceleration / deceleration of the vehicle is equal to or less than a reference value, one of the first device and the second device is selected as the transmission destination, and when the acceleration / deceleration of the vehicle exceeds the reference value, both the first device and the second device are selected as the transmission destination. or When the speed limit of the traffic violation of the vehicle is equal to or less than a reference value, one of the first device and the second device is selected as the transmission destination, and when the speed limit of the traffic violation of the vehicle exceeds a reference value, both the first device and the second device are selected as the transmission destination. Improvement item detection device.

2. 2. The improvement item detection device according to claim 1, The sensor is mounted on a portable terminal carried by the crew member, The first device is the mobile terminal.

3. 3. The improvement item detection device according to claim 1, The improvement item detection device, wherein the sensor information indicates the results of detecting the driver and / or the driver's surroundings when the vehicle is stopped and the driver has disembarked.

4. 4. The improvement item detection device according to claim 3, The driver is serving customers while alighting, The improvement item detection device, wherein the item to be improved is an item related to customer service.

5. 4. The improvement item detection device according to claim 3, The crew performs work on the vehicle while disembarking, The improvement item detection device, wherein the item to be improved is an item related to the work.

6. 3. The improvement item detection device according to claim 1, the sensor information indicates a position of the vehicle; The improvement item detection device, wherein the item to be improved relates to a stopping position of the vehicle.

7. The improvement item detection device according to any one of claims 1 to 5, a setting processing means for displaying on a terminal a setting screen for setting the items to be improved that are to be detected by the detection means, The detection means detects items set using the setting screen.

8. The computer An acquisition process for acquiring sensor information indicating a detection result of a sensor that detects at least one of an evaluation target, which is at least one of a vehicle and a crew member of the vehicle, and the surroundings of the evaluation target; A detection process for detecting an item to be improved by the crew by processing the sensor information; a selection process for selecting a destination of a warning message indicating that the item to be improved has been detected, using the information regarding the item to be improved; a transmission process for transmitting the warning information to the selected destination; Do the following: In the detection process, the computer determines a seriousness or urgency of the item to be improved for the crew, In the selection process, the computer selects the destination from among a first device for making the crew recognize the warning information, a second device for making an instructor of the crew recognize the warning information, and both the first device and the second device, using a seriousness or urgency of the item to be improved for the crew; In the selection process, When the acceleration / deceleration of the vehicle is equal to or less than a reference value, one of the first device and the second device is selected as the transmission destination, and when the acceleration / deceleration of the vehicle exceeds the reference value, both the first device and the second device are selected as the transmission destination. or When the speed limit of the traffic violation of the vehicle is equal to or less than a reference value, one of the first device and the second device is selected as the transmission destination, and when the speed limit of the traffic violation of the vehicle exceeds a reference value, both the first device and the second device are selected as the transmission destination. Improvement item detection method.

9. On the computer, An acquisition function for acquiring sensor information indicating a detection result of a sensor that detects at least one of an evaluation target, which is at least one of a vehicle and a crew member of the vehicle, and the surroundings of the evaluation target; A detection function that detects an item that the crew should improve by processing the sensor information; a selection function for selecting a destination of a warning message indicating that the item to be improved has been detected, using the information regarding the item to be improved; a transmission function for transmitting the warning information to the destination selected by the selection function; Let them have The detection function determines a level of seriousness or urgency of the item to be improved for the crew, the selection function selects the destination from among a first device for making the crew recognize the warning information, a second device for making an instructor of the crew recognize the warning information, and both the first device and the second device, using a level of seriousness or urgency of the item to be improved for the crew; The selection function is When the acceleration / deceleration of the vehicle is equal to or less than a reference value, one of the first device and the second device is selected as the transmission destination, and when the acceleration / deceleration of the vehicle exceeds the reference value, both the first device and the second device are selected as the transmission destination. or When the speed limit of the traffic violation of the vehicle is equal to or less than a reference value, one of the first device and the second device is selected as the transmission destination, and when the speed limit of the traffic violation of the vehicle exceeds a reference value, both the first device and the second device are selected as the transmission destination. program.

Images