Information processing device and information processing method
The information processing device facilitates easy input of operational notes and memos by crew members, addressing the challenge of real-time communication in vehicles, enhancing feedback quality and frequency, and improving service efficiency.
Patent Information
- Application Number
- PCT/JP2024/007657
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-01
- Publication Date
- 2025-09-04
AI Technical Summary
Crew members in vehicles, such as buses and trains, face difficulties in easily inputting information about operational disruptions and qualitative feedback due to increased workload and the inability to communicate minor issues in real time, leading to neglected reports and difficulty in improving services.
An information processing device with a base screen acquisition unit, standard memo acquisition unit, and display screen generation unit that allows crew members to easily input notes and memos on a display screen, including stamps and text, which are then sent to a manager for real-time feedback.
Enables crew members to input information effortlessly, reducing workload and allowing frequent sharing of both qualitative and quantitative feedback, thereby preventing issues and improving operations by addressing minor concerns and providing positive feedback.
Smart Images

Figure JP2024007657_04092025_PF_FP_ABST
Abstract
Description
Information processing device and information processing method
[0001] The present disclosure relates to an information processing device and an information processing method.
[0002] BACKGROUND ART Conventionally, there is known a technique for a route bus driver to notify a manager who manages the operation of the route bus of the situation (see, for example, Patent Document 1).
[0003] In the technology disclosed in Patent Document 1, when a driver confirms the occurrence or resolution of an abnormal situation that could disrupt the normal operation of a route bus, the driver touches an abnormal operation status confirmation button displayed on the driver's seat display. The driver then inputs the abnormal event that occurred or was resolved, the location of the abnormality, and the level of operational disruption (operation delay or inability to continue operation) caused by the abnormality on an abnormal operation status input screen displayed on the driver's seat display. Examples of abnormal situations that could disrupt the normal operation of a route bus include traffic accidents, broken-down vehicles on the road, fires along the route, traffic congestion, and breakdowns. The driver can also specify the location of the abnormality on a map displayed on the driver's seat display.
[0004] JP 2011-227550 A
[0005] In this way, in the past, when monitoring the operation of a route bus or the like, crew members would report the situation to a manager when an abnormal situation that could disrupt normal operations occurred or was resolved, and there was a means for them to immediately report the abnormal event, the location where the abnormality occurred, and the level of operational disruption caused by the abnormality.
[0006] However, in the past, crew members could not easily input information. Therefore, even if the vehicle is capable of autonomous driving, it is difficult to input information while the vehicle is in operation. As a result, in the past, it was difficult for crew members to provide their qualitative feedback on the operation of the vehicle to the manager in real time.
[0007] Conventionally, crew members have been unable to easily input information, which has led to the following issues: First, there is the issue of increased workload when making contact while also performing other crew duties, such as attending to passengers. For example, there is the issue that "it is not easy to input information while talking to a customer." Another issue is that making contact while also performing other crew duties, such as attending to passengers, means that information cannot be shared frequently. For example, there is the issue that "reporting events other than those of a serious nature is neglected, making it impossible to prevent problems or improve services."
[0008] Conventionally, the inability to provide qualitative feedback to drivers on the job or to their operations has led to the following issues. First, there is the issue of being unable to prevent issues that could directly lead to problems. For example, it is not possible to communicate to managers things like, "There are no problems now, but if the trees are not cut down, it will lead to poor visibility during operation." Another issue is that it is difficult to pick up on detailed requests and concerns that drivers personally have, making it difficult to improve operations. For example, it is not possible to communicate to managers things like, "It's always too bright on this route at this time of day." Another issue is that when managers make changes to operations, it is difficult to recognize the effects and reactions on the ground. For example, it is not possible to communicate to managers things like, "We adjusted the schedule, but did it actually have a positive effect?"
[0009] The present disclosure has been made to solve the above-mentioned problems, and aims to provide an information processing device that allows crew members to input information easily and without hassle, as compared to conventional devices.
[0010] The information processing device according to the present disclosure is characterized by comprising a base screen acquisition unit that acquires a base screen related to a vehicle or the operation of the vehicle, a standard memo acquisition unit that acquires standard memos, a display screen generation unit that generates a display screen including a screen showing the base screen and the standard memo based on the base screen acquired by the base screen acquisition unit and the standard memo acquired by the standard memo acquisition unit, and a note acquisition unit that acquires, for the display screen generated by the display screen generation unit, standard memos selected by the vehicle's crew and an area on the base screen to which the standard memo is attached, as a note for the base screen.
[0011] According to the present disclosure, the above-described configuration allows crew members to input data easily and without hassle, as compared to the conventional technology.
[0012] 5 is a diagram showing an example of the configuration of an information processing system including an information processing device according to embodiment 1. FIG. 6 is a diagram showing an example of the configuration of an information processing device according to embodiment 1. FIG. 7 is a flowchart showing an example of the operation of the information processing device according to embodiment 1. FIG. 4A and FIG. 4B are diagrams showing an example of a base screen used in the information processing device according to embodiment 1, where FIG. 4A is a diagram showing a timetable screen, FIG. 4B is a diagram showing a vehicle screen, and FIG. 4C is a diagram showing a map screen. FIG. 6 is a diagram showing an example of a display screen used in the information processing device according to embodiment 1, showing the display screen in an initial state. FIG. 7 is a diagram showing an example of a display screen used in the information processing device according to embodiment 1, showing a state in which a predetermined stamp has been added by a crew member to a predetermined position on a base screen included in the display screen, as shown in FIG. 5. FIG. 8A and FIG. 8B are diagrams showing an example of the operation of the information processing device according to embodiment 2, where FIG. 8A is a diagram showing a case in which the crew member has added the same stamp twice in succession within a predetermined range on a base screen included in the display screen, and FIG. 8B is a diagram showing a case in which the crew member has added the same stamp three times in succession within a predetermined range on a base screen included in the display screen. 10A and 10B are diagrams showing an example of the configuration of an information processing device according to embodiment 3. The diagrams show an example of the operation of the information processing device according to embodiment 3, and show a case where a stamp indicating an event and a stamp indicating an emotion are added by a crew member within a predetermined range on a base screen included in a display screen. The diagrams show an example of the hardware configuration of an information processing device according to embodiments 1 to 3.
[0013] Hereinafter, embodiments will be described in detail with reference to the drawings. Embodiment 1. FIG. 1 is a diagram showing an example of the configuration of an information processing system including an information processing device 2 according to embodiment 1. The information processing system is a system for communicating information from a driver of a vehicle 10 to a manager who manages the operation of the vehicle 10. The vehicle 10 is particularly exemplified by vehicles such as buses and trains, but is not limited to these, and may also be other vehicles, such as automobiles or small mobility vehicles. Furthermore, the vehicle 10 may be either an autonomously driven vehicle or a non-autonomous driven vehicle.
[0014] This information processing system includes, for example, a sensor 1, an information processing device 2, and an operation control system 3, as shown in FIG.
[0015] The sensor 1 senses information relating to at least one of the inside and outside of the vehicle 10 targeted by the information processing system. The information sensed by the sensor 1 is output to the information processing device 2. Examples of the sensor 1 include an in-vehicle sensor provided inside the vehicle 10 and an outside-vehicle sensor provided outside the vehicle 10. Specific examples of the sensor 1 include a camera sensor, a microphone, a three-axis acceleration sensor, a position sensor (HDL), LiDAR, sonar, a communication device, or a driving control device.
[0016] 1 illustrates a case where the information processing system includes the sensor 1. However, the sensor 1 is not an essential component of the information processing system, and the information processing system does not necessarily need to include the sensor 1.
[0017] The information processing device 2 is a device that can notify a manager of information regarding the vehicle 10 or notes made by the crew regarding the operation of the vehicle 10 in response to an operation by the crew of the vehicle 10. If the information processing system has a sensor 1, the information processing device 2 can notify a manager of information regarding the vehicle 10 or notes made by the crew regarding the operation of the vehicle 10 in response to information from the sensor 1 and an operation by the crew of the vehicle 10. In FIG. 1 , the information processing device 2 is mounted on the vehicle 10. An example configuration of the information processing device 2 will be described later.
[0018] The traffic control system 3 is a system used by an administrator, and is a system that manages and controls the operation of the vehicle 10 based on the information notified by the information processing device 2.
[0019] 1 shows a case where the information processing system has a traffic control system 3 and the information processing device 2 communicates information to the traffic control system 3. However, the information processing system only needs to enable the crew of the vehicle 10 to communicate information to the manager, and it is not essential to send a notification to the traffic control system 3.
[0020] Next, a configuration example of the information processing device 2 according to the first embodiment will be described with reference to Fig. 2. The information processing device 2 according to the first embodiment includes, for example, a storage unit 201, a sensing information acquisition unit 202, an operation reception unit 203, a base screen type selection unit 204, a base screen acquisition unit 205, a fixed memo acquisition unit 206, a display screen generation unit 207, a memo range extraction unit 208, a memo acquisition unit 209, a related information extraction unit 210, and an information output unit 211, as shown in Fig. 2, for example.
[0021] The storage unit 201 stores various types of information handled by the information processing device 2. For example, the storage unit 201 stores information about a base screen and information about standard memos. Furthermore, for example, the storage unit 201 may also store information about a display screen generated by the display screen generation unit 207 and information about memos acquired by the memo acquisition unit 209. Furthermore, for example, the storage unit 201 may also store information about a range extracted by the memo range extraction unit 208 and information extracted by the related information extraction unit 210.
[0022] The base screen is a screen that serves as a base for the vehicle 10 or the operation of the vehicle 10. Types of this base screen include, for example, a timetable screen that shows the timetable of the vehicle 10, a vehicle screen that shows the internal configuration of the vehicle 10, or a map screen that shows a map of the area in which the vehicle 10 operates. The timetable screen is a time-based screen that allows the crew of the vehicle 10 to specify the time to add a note, and the vehicle screen and map screen are space-based screens that allow the crew of the vehicle 10 to specify the location to add a note.
[0023] The fixed memo includes at least one of a fixed stamp and a fixed text. The fixed memo is provided for each type of base screen. The stamps include, for example, stamps indicating events and stamps indicating emotions.
[0024] This storage unit 201 may be, for example, a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM), a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD (Digital Versatile Disc).
[0025] 2 illustrates a case where the storage unit 201 is provided inside the information processing device 2. However, the present invention is not limited to this, and the storage unit 201 may be provided outside the information processing device 2.
[0026] The sensing information acquisition unit 202 acquires information about at least one of the inside and the outside of the vehicle 10 from the sensor 1. The sensing information acquisition unit 202 acquires information from the sensor 1 constantly or periodically, thereby being able to acquire the latest information in real time.
[0027] 2 illustrates a case where the information processing device 2 includes the sensing information acquisition unit 202. However, the sensing information acquisition unit 202 is not an essential component of the information processing device 2, and the information processing device 2 does not necessarily have to include the sensing information acquisition unit 202.
[0028] The operation reception unit 203 receives operations by the crew of the vehicle 10. For example, if the display device described below is a touch panel type display device, the crew of the vehicle 10 can perform operations by directly touching the screen displayed on the display device, and the operation reception unit 203 receives this operation.
[0029] The base screen type selection unit 204 selects the type of base screen in response to the operation received by the operation reception unit 203 .
[0030] 2 illustrates a case where the information processing device 2 has a base screen type selection unit 204. However, the base screen type selection unit 204 is not an essential component of the information processing device 2, and the information processing device 2 does not need to have the base screen type selection unit 204. For example, if the information processing device 2 targets only one type of base screen, it is not necessary to select the type of base screen, and the information processing device 2 does not need the base screen type selection unit 204.
[0031] The base screen acquisition unit 205 acquires a base screen. If the information processing device 2 has a base screen type selection unit 204, the base screen acquisition unit 205 acquires a base screen based on the selection result by the base screen type selection unit 204. That is, the base screen acquisition unit 205 acquires a base screen corresponding to the type of base screen selected by the base screen type selection unit 204 based on the information stored in the storage unit 201.
[0032] The fixed memo acquisition unit 206 acquires a fixed memo. Note that, if the information processing device 2 has the base screen type selection unit 204, the fixed memo acquisition unit 206 acquires a fixed memo based on the selection result by the base screen type selection unit 204. That is, the fixed memo acquisition unit 206 acquires a fixed memo corresponding to the type of base screen selected by the base screen type selection unit 204 based on the information stored in the storage unit 201.
[0033] The display screen generation unit 207 generates a screen to be handled by the information processing device 2. The screen generated by this display screen generation unit 207 is displayed on a display device (not shown). The crew of the vehicle 10 then performs operations in accordance with the screen displayed on this display device. If the display device is a touch panel type display device, the crew of the vehicle 10 can perform operations by directly touching the screen displayed on the display device.
[0034] This display screen generation unit 207 generates a display screen including a screen showing the base screen acquired by the base screen acquisition unit 205 and the standard memo acquired by the standard memo acquisition unit 206, based on the base screen acquired by the base screen acquisition unit 205 and the standard memo acquired by the standard memo acquisition unit 206.
[0035] In this case, the display screen generating unit 207 may generate a screen that displays a list of the standard memos as the screen showing the standard memos. Furthermore, the display screen generating unit 207 may include a screen showing the information acquired by the sensing information acquiring unit 202 on the display screen based on the information.
[0036] Furthermore, when information about a memo acquired by the memo acquisition unit 209 is stored in the storage unit 201, the display screen generation unit 207 may also include information about the memo on the display screen. That is, when there is a memo previously input by a crew member of the vehicle 10, the display screen generation unit 207 may include information about the memo on the display screen.
[0037] On this display screen, the crew of the vehicle 10 first selects a desired standard memo from a screen showing standard memos included in the display screen. Then, the crew of the vehicle 10 selects an area on the base screen to which the selected standard memo will be attached, i.e., a position or time on the base screen to which the standard memo will be attached. For example, the crew selects the location to which the standard memo will be attached by moving the standard memo selected from the screen showing the standard memo to a desired position or time on the base screen. Then, in response to the operation accepted by the operation accepting unit 203, the display screen generating unit 207 displays the standard memo added by the crew of the vehicle 10 on the base screen included in the display screen.
[0038] Furthermore, for example, before generating the display screen, the display screen generation unit 207 may generate a selection screen for the crew of the vehicle 10 to select the type of base screen.
[0039] The memo range extraction unit 208 extracts a range where a fixed memo is expected to be attached from the base screen included in the display screen generated by the display screen generation unit 207, based on the acquisition result by the sensing information acquisition unit 202. In this case, the display screen generation unit 207 may display the range extracted by the memo range extraction unit 208 on the base screen included in the display screen.
[0040] 2 illustrates a case where the information processing device 2 includes the memo range extraction unit 208. However, the memo range extraction unit 208 is not an essential component of the information processing device 2, and the information processing device 2 does not necessarily have to include the memo range extraction unit 208.
[0041] In response to the operation accepted by the operation accepting unit 203, the memo acquiring unit 209 acquires, as a memo for the base screen, the fixed memo selected by the crew of the vehicle 10 and the area on the base screen to which the fixed memo is to be attached, for the display screen generated by the display screen generating unit 207. In this case, for example, the memo acquiring unit 209 may acquire information about the display screen itself generated by the display screen generating unit 207 as a memo.
[0042] The related information extraction unit 210 extracts information related to the memo from the information acquired by the sensing information acquisition unit 202, based on the memo acquired by the memo acquisition unit 209. In this case, the display screen generation unit 207 may display the information extracted by the related information extraction unit 210 on the display screen.
[0043] 2 illustrates a case where the information processing device 2 includes the related information extraction unit 210. However, the related information extraction unit 210 is not an essential component of the information processing device 2, and the information processing device 2 does not necessarily have to include the related information extraction unit 210.
[0044] The information output unit 211 outputs information related to the memo acquired by the memo acquisition unit 209 to the traffic control system 3. Furthermore, when information is extracted by the related information extraction unit 210, the information output unit 211 may output the information to the traffic control system 3.
[0045] 2 illustrates a case where the information processing device 2 includes the information output unit 211. However, the information output unit 211 is not an essential component of the information processing device 2, and the information processing device 2 does not necessarily have to include the information output unit 211.
[0046] Next, an example of the operation of the information processing device 2 according to the first embodiment shown in Fig. 2 will be described with reference to Fig. 3. The storage unit 201 stores various types of information handled by the information processing device 2. For example, the storage unit 201 stores information related to a base screen and information related to standard memos in advance. The operation reception unit 203 also receives operations performed by the driver of the vehicle 10.
[0047] In the operation example of the information processing device 2 according to the first embodiment shown in Fig. 2, first, as shown in Fig. 3, the sensing information acquisition unit 202 acquires information about at least one of the inside and the outside of the vehicle 10 from the sensor 1 (step ST101). The sensing information acquisition unit 202 acquires information from the sensor 1 constantly or periodically, thereby being able to acquire the latest information in real time.
[0048] The base screen type selection unit 204 selects the type of base screen in response to the operation received by the operation reception unit 203 (step ST102). At this time, for example, the display screen generation unit 207 may generate a selection screen for the crew of the vehicle 10 to select the type of base screen, and the crew of the vehicle 10 may select the type of base screen using this selection screen.
[0049] Next, the base screen acquisition unit 205 acquires a base screen based on the selection result by the base screen type selection unit 204 (step ST103). That is, the base screen acquisition unit 205 acquires a base screen corresponding to the type of base screen selected by the base screen type selection unit 204 based on the information stored in the storage unit 201.
[0050] 4A and 4B are diagrams showing examples of a base screen acquired by the base screen acquisition unit 205 in the first embodiment. Fig. 4A shows an example of a timetable screen, Fig. 4B shows an example of a vehicle screen, and Fig. 4C shows an example of a map screen. The timetable screen shown in Fig. 4 is a time-based screen that allows the crew of the vehicle 10 to specify the time to add a note, and the vehicle screen shown in Fig. 4B and the map screen shown in Fig. 4C are space-based screens that allow the crew of the vehicle 10 to specify the position to add a note.
[0051] Furthermore, the fixed memo acquisition unit 206 acquires a fixed memo based on the selection result by the base screen type selection unit 204 (step ST104). That is, the fixed memo acquisition unit 206 acquires a fixed memo corresponding to the type of base screen selected by the base screen type selection unit 204 based on the information stored in the storage unit 201. For example, when a map screen is selected as the type of base screen by the base screen type selection unit 204, the fixed memo acquisition unit 206 acquires a fixed memo linked to the map screen.
[0052] Next, the display screen generating unit 207 generates a display screen including a screen showing the base screen and the standard memo, based on the base screen acquired by the base screen acquiring unit 205 and the standard memo acquired by the standard memo acquiring unit 206 (step ST105). At this time, the display screen generating unit 207 may generate a screen showing a list of the standard memos as the screen showing the standard memos.
[0053] Furthermore, when information about a memo acquired by the memo acquisition unit 209 is stored in the storage unit 201, the display screen generation unit 207 may also include information about the memo on the display screen. That is, when there is a memo previously input by a crew member of the vehicle 10, the display screen generation unit 207 may include information about the memo on the display screen.
[0054] FIG. 5 is a diagram illustrating an example of a display screen generated by the display screen generating unit 207 in the first embodiment. In FIG. 5, the vehicle 10 is a route bus, and an example of a display screen in an initial state before a fixed memo is selected by the driver of the vehicle 10 is illustrated. As illustrated in FIG. 5, the display screen generating unit 207 generates a display screen including a base screen and a screen showing the fixed memo. In FIG. 5, reference numeral 11 indicates the base screen. In FIG. 5, a map screen is displayed as the base screen. Also, in FIG. 5, reference numeral 12 indicates a screen showing the fixed memo. In FIG. 5, a stamp icon indicated by reference numeral 121 is selected, and stamps are displayed in a list as fixed memos. In FIG. 5, stamps indicating "Unexpected Construction," "Problem," "False Detection of Vegetation," "Cause Unknown," and "Traffic Jam" are displayed. Note that, in this example, the stamps indicating "Unexpected Construction," "False Detection of Vegetation," "Cause Unknown," and "Traffic Jam" correspond to stamps indicating events, and the stamp indicating "Problem" corresponds to a stamp indicating an emotion. In FIG. 5, when the text icon indicated by the reference numeral 122 is selected, the display switches to a state in which text is displayed as a fixed memo.
[0055] The display screen shown in FIG. 5 also displays information such as the current route of the bus indicated by reference numeral 13, the current time indicated by reference numeral 14, the name of the driver indicated by reference numeral 15, and the number of passengers indicated by reference numeral 16.
[0056] For such a display screen, the crew of the vehicle 10 first selects a desired standard memo from a screen showing standard memos included in the display screen. Then, the crew of the vehicle 10 selects a position or time on the base screen to which the selected standard memo will be attached. For example, the crew selects the location to which the standard memo will be attached by moving the standard memo selected from the screen showing the standard memo to a desired position or time on the base screen. Here, if the base screen is a time-based screen such as a train schedule screen, the crew selects the time to attach the standard memo, and if the base screen is a space-based screen such as a train screen or a map screen, the crew selects the location to attach the standard memo.
[0057] Then, in response to the operation received by the operation receiving unit 203, the display screen generating unit 207 displays the standard memo added by the driver of the vehicle 10 on the base screen included in the display screen.
[0058] Fig. 6 is a diagram showing an example of a display screen generated by the display screen generating unit 207 in the first embodiment. In contrast to Fig. 5, Fig. 6 shows an example of a display screen in a state where a fixed memo has been selected by the crew of the vehicle 10. In Fig. 6, reference numeral 21 indicates a fixed memo selected by the crew of the vehicle 10 and added to the base screen. Fig. 6 shows a display screen in a case where a stamp indicating "unexpected construction work" has been selected by the crew and the stamp has been added to a predetermined position on the base screen.
[0059] The information processing device 2 may have a function of deleting a fixed memo attached to a base screen included in the display screen in response to an operation accepted by the operation accepting unit 203 .
[0060] Furthermore, the memo range extraction unit 208 may extract a range where a fixed memo is expected to be attached from the base screen included in the display screen generated by the display screen generation unit 207, based on the acquisition result by the sensing information acquisition unit 202. In this case, the display screen generation unit 207 may display the range extracted by the memo range extraction unit 208 on the base screen included in the display screen.
[0061] Next, in response to the operation accepted by the operation accepting unit 203, the memo acquiring unit 209 acquires, for the display screen generated by the display screen generating unit 207, the fixed memo selected by the crew of the vehicle 10 and the area on the base screen to which the fixed memo is to be attached, as a memo for the base screen (step ST106). For example, the memo acquiring unit 209 may acquire information about the display screen itself generated by the display screen generating unit 207 as a memo.
[0062] The related information extraction unit 210 may extract information related to the memo from the information acquired by the sensing information acquisition unit 202 based on the memo acquired by the memo acquisition unit 209. For example, if the memo acquisition unit 209 acquires that a stamp indicating "unexpected construction work" has been added to a predetermined area on the map screen as a memo, and the sensing information acquisition unit 202 acquires an image by a camera sensor, the related information extraction unit 210 can extract an image showing the "unexpected construction work" by extracting an image of a location corresponding to the predetermined area. In this case, the display screen generation unit 207 may display the information extracted by the related information extraction unit 210 on the display screen.
[0063] Next, the information output unit 211 outputs information about the memo acquired by the memo acquisition unit 209 to the traffic control system 3 (step ST107). Furthermore, when information is extracted by the related information extraction unit 210, the information output unit 211 may output the information to the traffic control system 3.
[0064] In this way, the information processing device 2 according to the first embodiment generates a display screen including a base screen and a screen showing a fixed memo corresponding to the base screen, and acquires the fixed memo selected by the crew of the vehicle 10 and the area on the base screen to which the fixed memo is attached as a memo for the base screen included in the display screen. This allows the crew to input information easily and without hassle compared to conventional methods. As a result, the information processing device 2 according to the first embodiment enables the crew to provide qualitative feedback on the crew's observations and operation during operation to the manager in real time.
[0065] That is, the information processing device 2 according to the first embodiment makes it possible to reduce the workload. For example, "it is possible to input information that can be done while doing other crew work in parallel." Furthermore, the information processing device 2 according to the first embodiment makes it possible to frequently share information. For example, "it is possible to easily post even trivial matters, which makes it possible to prevent problems before they occur and improve services."
[0066] Furthermore, the information processing device 2 according to the first embodiment makes it possible to prevent failures before they occur. That is, it is possible to "pre-emptively report minor concerns that may lead to problems." Furthermore, the information processing device 2 according to the first embodiment makes it possible to improve operations by picking up even interpretations and qualitative information. That is, it is possible to "report interpretations and qualitative information that the crew personally feels in addition to quantitative information such as video information inside and outside the vehicle, driving information, or weather information." Furthermore, the information processing device 2 according to the first embodiment makes it possible for the crew to provide feedback when making operational changes. In this case, it is possible to "report not only negative information but also positive content."
[0067] For example, the information processing device 2 according to the first embodiment can provide an early notification that "plants on the road are growing and, although not yet causing a problem, they may interfere with autonomous driving sensing in the future." Furthermore, for example, the information processing device 2 according to the first embodiment can provide an early notification that "in addition to the actual or predicted congestion data automatically detected, information that takes into account factors or background that only a driver would be able to notice, such as 'This overlaps with a transfer at Station X' or 'This overlaps with the return time of students from XX High School,' can be added to facilitate cause investigation or improvement." Furthermore, for example, the information processing device 2 according to the first embodiment can provide information that is difficult to pick up through automatic detection, such as 'Many people get the bus stop location wrong, so they move quickly when the bus arrives.' Furthermore, for example, the information processing device 2 according to the first embodiment can provide positive feedback that the bus schedule has improved, indicating that the bus is traveling more smoothly than before.
[0068] Furthermore, in the information processing device 2 according to embodiment 1, by including stamps as standard memos, it is possible to communicate a large amount of information in a shorter time in a more concise and easy-to-understand manner than before, and it is possible to convey even ambiguous emotions or situations that cannot be conveyed by text alone, making it easier for the administrator to consolidate the necessary information when dealing with a huge amount of information.
[0069] As described above, according to the first embodiment, the information processing device 2 includes the base screen acquisition unit 205 that acquires a base screen related to the vehicle 10 or the operation of the vehicle 10, the fixed memo acquisition unit 206 that acquires fixed memos, the display screen generation unit 207 that generates a display screen including the base screen and a screen showing the fixed memo based on the base screen acquired by the base screen acquisition unit 205 and the fixed memo acquired by the fixed memo acquisition unit 206, and the memo acquisition unit 209 that acquires fixed memos selected by the crew of the vehicle 10 and an area on the base screen to which the fixed memo is attached as a memo for the base screen for the display screen generated by the display screen generation unit 207. This allows the information processing device 2 according to the first embodiment to allow the crew to input information more easily and without hassle than conventional devices. As a result, the information processing device 2 according to the first embodiment allows the crew to provide a manager with qualitative feedback on the crew's observations and operation during operation in real time.
[0070] Moreover, according to the first embodiment, the information processing device 2 includes a base screen type selection unit 204 that selects the type of base screen, the base screen acquisition unit 205 acquires a base screen based on the selection result by the base screen type selection unit 204, and the fixed memo acquisition unit 206 acquires a fixed memo based on the selection result by the base screen type selection unit 204. This allows the crew to select an appropriate base screen depending on the situation, further improving convenience. In other words, the crew can select a time-based base screen or a space-based base screen depending on the situation.
[0071] Moreover, according to the first embodiment, the information processing device 2 includes a sensing information acquisition unit 202 that acquires information about at least one of the inside and the outside of the vehicle 10 from the sensor 1, and a memo range extraction unit 208 that extracts a range where a fixed memo is expected to be attached from a base screen included in a display screen generated by a display screen generation unit 207 based on the acquisition result by the sensing information acquisition unit 202, and the display screen generation unit 207 displays the range extracted by the memo range extraction unit 208 on the base screen included in the display screen. This makes it possible to further improve the convenience of operation by the crew in the information processing device 2 according to the first embodiment, and enables the crew to input information more quickly.
[0072] Moreover, according to the first embodiment, the information processing device 2 includes the sensing information acquisition unit 202 that acquires information about at least one of the inside and the outside of the vehicle 10 from the sensor 1, and the related information extraction unit 210 that extracts information related to the memo from the information acquired by the sensing information acquisition unit 202 based on the memo acquired by the memo acquisition unit 209. This makes it even easier for the crew or manager to understand the information in the information processing device 2 according to the first embodiment.
[0073] As described above, according to the first embodiment, the information processing method includes the steps of: the base screen acquisition unit 205 acquiring a base screen related to the vehicle 10 or the operation of the vehicle 10; the fixed memo acquisition unit 206 acquiring a fixed memo; the display screen generation unit 207 generating a display screen including the base screen and a screen showing the fixed memo based on the base screen acquired by the base screen acquisition unit 205 and the fixed memo acquired by the fixed memo acquisition unit 206; and the memo acquisition unit 209 acquiring, as a memo for the base screen, a fixed memo selected by the vehicle crew and an area on the base screen to which the fixed memo is attached, for the display screen generated by the display screen generation unit 207. This allows the information processing method according to the first embodiment to allow the crew to input information more easily and without hassle than conventional methods. As a result, the information processing method according to the first embodiment allows the crew to provide a manager with qualitative feedback on the crew's observations and operation during operation in real time.
[0074] Embodiment 2. Figure 7 is a diagram showing an example of the configuration of an information processing device 2 according to embodiment 2. In the information processing device 2 according to embodiment 2 shown in Figure 7, a count detection unit 212 is added to the information processing device 2 according to embodiment 1 shown in Figure 2, and the display screen generation unit 207 is changed to a display screen generation unit 207b. The other example of the configuration of the information processing device 2 according to embodiment 2 shown in Figure 7 is the same as the example of the configuration of the information processing device 2 according to embodiment 1 shown in Figure 2, and the same reference numerals are used and only the different parts will be described.
[0075] The fixed memo acquired by the fixed memo acquiring unit 206 in the second embodiment includes at least a fixed stamp.
[0076] The number detection unit 212 detects the number of times the stamp is applied when the same stamp is applied consecutively within a predetermined range by a crew member of the vehicle 10 on a base screen included in the display screen generated by the display screen generation unit 207 in response to an operation received by the operation reception unit 203.
[0077] In response to the operation accepted by the operation accepting unit 203, the display screen generating unit 207b changes the display format and displays the stamps added by the crew of the vehicle 10 on the base screen included in the display screen in accordance with the number of times detected by the number of times detecting unit 212.
[0078] At this time, for example, the display screen generating unit 207b may change the size of the stamp to be displayed on the base screen in accordance with the number of times detected by the number detection unit 212. Also, for example, the display screen generating unit 207b may change the color of the stamp to be displayed on the base screen in accordance with the number of times detected by the number detection unit 212. Also, for example, the display screen generating unit 207b may change the thickness of the border of the stamp to be displayed on the base screen in accordance with the number of times detected by the number detection unit 212. Also, for example, the display screen generating unit 207b may change the size of the stamp to be displayed on the base screen, the color of the stamp, and the thickness of the border of the stamp in combination in accordance with the number of times detected by the number detection unit 212.
[0079] The functions of the display screen generating unit 207b other than those described above are the same as those of the display screen generating unit 207 in the first embodiment.
[0080] Next, a specific example of the operation of the information processing device 2 according to the second embodiment will be described with reference to Fig. 8. Fig. 8A shows an example of stamp display in a case where roadside construction work is being carried out and is avoidable but requires some caution. Fig. 8B shows an example of stamp display in a case where large-scale construction work is being carried out and other vehicles need to be notified.
[0081] In Fig. 8A, the crew stamps the same stamp twice in succession at the same location on the base screen to notify the manager of roadside construction work. As shown on the right side of Fig. 8A, the display screen generation unit 207b displays the stamp in a larger format than when the stamp was stamped once. In Fig. 8B, the crew stamps the same stamp three times in succession at the same location on the base screen to notify the manager of large-scale construction work. As shown on the right side of Fig. 8B, the display screen generation unit 207b displays the stamp in a larger format than when the stamp was stamped once, with a thicker border.
[0082] In this way, in the information processing device 2 according to the second embodiment, the display form of the stamp is changed depending on the number of times the same stamp is applied consecutively by the crew of the vehicle 10. As a result, the information processing device 2 according to the second embodiment can add visual information to the stamp indicating the importance of the matter indicated by the stamp or the response by the crew or manager to the matter indicated by the stamp.
[0083] In the above description, the number of times detecting unit 212 detects the number of times the same stamp is applied consecutively in response to an operation accepted by the operation accepting unit 203. In contrast to this, if the information processing device 2 has a function of deleting a fixed memo applied to the base screen, the number of times detecting unit 212 may decrease the number of times in response to the deletion of a stamp.
[0084] As described above, according to the second embodiment, the fixed memo acquired by the fixed memo acquisition unit 206 includes a stamp, and when the same stamp is applied consecutively within a predetermined range by the crew of the vehicle 10 on a base screen included in the display screen generated by the display screen generation unit 207, the device is provided with a count detection unit 212 that detects the number of times the stamp has been applied, and the display screen generation unit 207 displays the stamp applied by the crew of the vehicle 10 on the base screen included in the display screen by changing the display format according to the number of times detected by the count detection unit 212. As a result, in the information processing device 2 according to the second embodiment, in addition to the effects of the first embodiment, the crew can easily convey information indicating the importance or response to a manager through intuitive input, and the response burden on the crew or manager can be reduced.
[0085] Embodiment 3. Figure 9 is a diagram showing an example of the configuration of an information processing device 2 according to embodiment 3. In the information processing device 2 according to embodiment 3 shown in Figure 9, the display screen generation unit 207 is changed to a display screen generation unit 207c in comparison with the information processing device 2 according to embodiment 1 shown in Figure 2. The other example of the configuration of the information processing device 2 according to embodiment 3 shown in Figure 9 is the same as the example of the configuration of the information processing device 2 according to embodiment 1 shown in Figure 2, and the same reference numerals are used and only the different parts will be described.
[0086] The standard memo acquired by the standard memo acquiring unit 206 in the second embodiment includes at least a stamp indicating a standard event and a stamp indicating a standard emotion.
[0087] In response to an operation received by the operation receiving unit 203, when a stamp indicating an event and a stamp indicating an emotion are added within a predetermined range by a crew member of the vehicle 10 to a base screen included in the display screen, the display screen generating unit 207c displays the stamp indicating the emotion integrated with the stamp indicating the event on the base screen.
[0088] In this case, for example, the display screen generation unit 207c may add a badge to the stamp indicating the event displayed on the base screen. Furthermore, the display screen generation unit 207c may display detailed information indicating that a stamp indicating an emotion has been added when the stamp indicating the event is selected by the crew of the vehicle 10. Also, for example, the display screen generation unit 207c may change at least one of the color or border thickness of the stamp indicating the event displayed on the base screen. Furthermore, the display screen generation unit 207c may display detailed information indicating that a stamp indicating an emotion has been added when the stamp indicating the event is selected by the crew of the vehicle 10.
[0089] The functions of the display screen generating unit 207c other than those described above are the same as those of the display screen generating unit 207 in the first embodiment.
[0090] Next, a specific example of the operation of the information processing device 2 according to the second embodiment will be described with reference to FIG. 10 . In FIG. 10 , the crew attaches a stamp indicating an event and a stamp indicating an emotion at the same position on the base screen. Then, as shown in the center of FIG. 10A , the display screen generation unit 207c displays a badge on the stamp indicating the event. This badge indicates that the stamp indicating the emotion is attached. Furthermore, as shown on the right side of FIG. 10A , when the crew of the vehicle 10 selects the stamp indicating the event, the display screen generation unit 207c can display detailed information indicating that a stamp indicating an emotion has been added to the stamp indicating the event. In FIG. 10A , the stamp indicating the event and the stamp indicating the emotion are displayed side by side as detailed information. Furthermore, as shown in the center of FIG. 10B , the display screen generation unit 207c displays the stamp indicating the event with a thicker border. 10B, as shown on the right side, the display screen generating unit 207c can display detailed information indicating that a stamp indicating an emotion has been added to the stamp indicating the event when the stamp indicating this event is selected by the crew member of the vehicle 10. In FIG. 10B, the stamp indicating the event and the stamp indicating the emotion are displayed side by side as detailed information.
[0091] In this way, in the information processing device 2 according to the third embodiment, when a stamp indicating an event and a stamp indicating an emotion are selected within a predetermined range, the stamp indicating the emotion is attached to and integrated with the icon indicating the event. This allows the information processing device 2 according to the third embodiment to visually convey more detailed information to the manager through intuitive input by the crew.
[0092] In the above description, the display screen generating unit 207c has shown a case where, when a stamp indicating an event and a stamp indicating an emotion are attached within a predetermined range, the stamp indicating the event and the stamp indicating the emotion are integrated and displayed. In contrast, when the information processing device 2 has a function for deleting a fixed memo attached to the base screen, if the stamp indicating an event or the stamp indicating an emotion is deleted from the integrated stamps, the display screen generating unit 207c may cancel the integration and return to the normal display.
[0093] In the above description, the information processing device 2 according to embodiment 1 has been described as adding the functions of the display screen generating unit 207c to the display screen generating unit 207. However, the present invention is not limited to this, and in the information processing device 2 according to embodiment 2, the functions of the display screen generating unit 207c may be added to the display screen generating unit 207b, and the same effects as those described above can be obtained.
[0094] As described above, according to the third embodiment, the fixed memo acquired by the fixed memo acquisition unit 206 includes a stamp indicating an event and a stamp indicating an emotion, and when the driver of the vehicle 10 applies a stamp indicating an event and a stamp indicating an emotion within a predetermined range to a base screen included in the display screen, the display screen generation unit 207 displays the stamp indicating the emotion integrated with the stamp indicating the event on the base screen. As a result, in addition to the effects of the first and second embodiments, the information processing device 2 according to the third embodiment can visually convey more detailed information to a manager through intuitive input by the driver.
[0095] Finally, an example of the hardware configuration of the information processing device 2 according to the first to third embodiments will be described with reference to Fig. 11. Note that, although an example of the hardware configuration of the information processing device 2 according to the first embodiment will be described below, the same applies to the example of the hardware configuration of the information processing device 2 according to the second and third embodiments. Each function of the sensing information acquisition unit 202, the operation acceptance unit 203, the base screen type selection unit 204, the base screen acquisition unit 205, the fixed memo acquisition unit 206, the display screen generation unit 207, the memo range extraction unit 208, the memo acquisition unit 209, the related information extraction unit 210, and the information output unit 211 in the information processing device 2 is realized by the processing circuit 501. The processing circuit 501 may be dedicated hardware as shown in FIG. 11A, or may be a CPU (also called a Central Processing Unit, central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, processor, or DSP (Digital Signal Processor)) 502 that executes a program stored in memory 503 as shown in FIG. 11B.
[0096] When the processing circuit 501 is dedicated hardware, the processing circuit 501 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof. The functions of each of the sensing information acquisition unit 202, the operation reception unit 203, the base screen type selection unit 204, the base screen acquisition unit 205, the fixed memo acquisition unit 206, the display screen generation unit 207, the memo range extraction unit 208, the memo acquisition unit 209, the related information extraction unit 210, and the information output unit 211 may be realized individually by the processing circuit 501, or the functions of each unit may be realized collectively by the processing circuit 501.
[0097] When the processing circuit 501 is a CPU 502, the functions of the sensing information acquisition unit 202, operation reception unit 203, base screen type selection unit 204, base screen acquisition unit 205, fixed memo acquisition unit 206, display screen generation unit 207, memo range extraction unit 208, memo acquisition unit 209, related information extraction unit 210, and information output unit 211 are realized by software, firmware, or a combination of software and firmware. The software and firmware are written as programs and stored in memory 503. The processing circuit 501 realizes the functions of each unit by reading and executing the programs stored in memory 503. In other words, the information processing device 2 includes a memory for storing a program that, when executed by the processing circuit 501, results in the execution of, for example, each step shown in FIG. 3 . It can also be said that these programs cause a computer to execute the procedures and methods of the sensing information acquisition unit 202, operation acceptance unit 203, base screen type selection unit 204, base screen acquisition unit 205, fixed memo acquisition unit 206, display screen generation unit 207, memo range extraction unit 208, memo acquisition unit 209, related information extraction unit 210, and information output unit 211. Here, the memory 503 may be, for example, a non-volatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, or EEPROM, a magnetic disk, a flexible disk, an optical disk, a compact disk, a minidisk, or a DVD.
[0098] It is to be noted that the functions of the sensing information acquisition unit 202, the operation reception unit 203, the base screen type selection unit 204, the base screen acquisition unit 205, the fixed memo acquisition unit 206, the display screen generation unit 207, the memo range extraction unit 208, the memo acquisition unit 209, the related information extraction unit 210, and the information output unit 211 may be partially implemented by dedicated hardware and partially implemented by software or firmware. For example, the function of the sensing information acquisition unit 202 may be implemented by the processing circuit 501 as dedicated hardware, and the functions of the operation reception unit 203, the base screen type selection unit 204, the base screen acquisition unit 205, the fixed memo acquisition unit 206, the display screen generation unit 207, the memo range extraction unit 208, the memo acquisition unit 209, the related information extraction unit 210, and the information output unit 211 may be implemented by the processing circuit 501 reading out and executing programs stored in the memory 503.
[0099] In this way, the processing circuitry 501 can realize each of the above-described functions by hardware, software, firmware, or a combination of these.
[0100] It should be noted that the embodiments may be freely combined, or any of the components in each embodiment may be modified, or any of the components in each embodiment may be omitted.
[0101] The information processing device according to the present disclosure allows crew members to input data easily and hassle-free compared to conventional devices, and is suitable for use in information processing devices and the like.
[0102] 1 Sensor, 2 Information processing device, 3 Traffic control system, 10 Vehicle, 201 Memory unit, 202 Sensing information acquisition unit, 203 Operation reception unit, 204 Base screen type selection unit, 205 Base screen acquisition unit, 206 Fixed memo acquisition unit, 207, 207b, 207c Display screen generation unit, 208 Memo range extraction unit, 209 Memo acquisition unit, 210 Related information extraction unit, 211 Information output unit, 212 Number of times detection unit, 501 Processing circuit, 502 CPU, 503 Memory.
Claims
1. An information processing device comprising: a base screen acquisition unit that acquires a base screen related to a vehicle or the operation of the vehicle; a standard memo acquisition unit that acquires standard memos; a display screen generation unit that generates a display screen including the base screen and a screen showing the standard memo based on the base screen acquired by the base screen acquisition unit and the standard memo acquired by the standard memo acquisition unit; and a memo acquisition unit that acquires, for the display screen generated by the display screen generation unit, standard memos selected by a driver of the vehicle and an area on the base screen to which the standard memo is attached, as a memo for the base screen.
2. An information processing device as described in claim 1, further comprising a base screen type selection unit that selects a type of base screen, wherein the base screen acquisition unit acquires a base screen based on the selection result by the base screen type selection unit, and the fixed memo acquisition unit acquires a fixed memo based on the selection result by the base screen type selection unit.
3. An information processing device as described in claim 1 or claim 2, characterized in that it comprises: a sensing information acquisition unit that acquires information relating to at least one of the inside and outside of the vehicle from a sensor; and a memo range extraction unit that extracts a range from a base screen included in a display screen generated by the display screen generation unit based on the results acquired by the sensing information acquisition unit, where a standard memo is expected to be attached, and the display screen generation unit displays the range extracted by the memo range extraction unit on the base screen included in the display screen.
4. An information processing device as claimed in any one of claims 1 to 3, characterized in that it comprises: a sensing information acquisition unit that acquires information relating to at least one of the inside and outside of the vehicle from a sensor; and a related information extraction unit that extracts information relating to the note from the information acquired by the sensing information acquisition unit based on the note acquired by the note acquisition unit.
5. An information processing device as claimed in any one of claims 1 to 4, characterized in that the standard memos acquired by the standard memo acquisition unit include stamps, and further comprising a count detection unit that detects the number of times the stamp is applied when the same stamp is applied consecutively within a predetermined range by the vehicle crew on a base screen included in the display screen generated by the display screen generation unit, and the display screen generation unit displays the stamp applied by the vehicle crew on the base screen included in the display screen by changing the display format depending on the number of times detected by the count detection unit.
6. An information processing device as claimed in any one of claims 1 to 5, characterized in that the standard memos acquired by the standard memo acquisition unit include stamps indicating events and stamps indicating emotions, and when a stamp indicating an event and a stamp indicating an emotion are added within a predetermined range by a vehicle crew member to a base screen included in the display screen, the display screen generation unit displays the stamp indicating the emotion integrated with the stamp indicating the event on the base screen.
7. An information processing method comprising the steps of: a base screen acquisition unit acquiring a base screen relating to a vehicle or the operation of the vehicle; a fixed memo acquisition unit acquiring a fixed memo; a display screen generation unit generating a display screen including a screen showing the base screen and the fixed memo based on the base screen acquired by the base screen acquisition unit and the fixed memo acquired by the fixed memo acquisition unit; and a memo acquisition unit acquiring, as a memo for the base screen, the fixed memo selected by the vehicle's crew and an area on the base screen to which the fixed memo is attached, for the display screen generated by the display screen generation unit.
Citation Information
Patent Citations
Information providing system
JP2003316686A
Stop device, on-vehicle device, operation management device and operation management system
JP2011227550A
Moving image collection system, moving image collection apparatus, and moving image collection method
JP2018133055A
Rotating map and user-centric weather prediction
US20040181340A1
Work assistance system, work assistance program, and work assistance method
WO2023234258A1