Information processing apparatus and information processing method

Abstract

Provided are: a base screen acquisition unit (205) that acquires a base screen related to a vehicle or operation of the vehicle; a template comment acquisition unit (206) that acquires a template comment; a display screen generation unit (207) that generates a display screen including the base screen and a screen indicating the template comment, based on the base screen acquired by the base screen acquisition unit (205) and the template comment acquired by the template comment acquisition unit (206); and a comment acquisition unit (209) that acquires, as a comment for the base screen, a template comment selected by a crew member of the vehicle for the display screen generated by the display screen generation unit (207) and a region on the base screen to which the template comment is added.

Description

Technical Field

[0001] This disclosure relates to information processing apparatus and information processing methods. Background Technology

[0002] Previously, there were known technologies for communicating with bus operators about the status of the bus's operation (see, for example, Patent Document 1).

[0003] In the technology disclosed in Patent Document 1, when a conductor confirms the occurrence or elimination of an abnormal condition that may cause malfunction to the normal operation of the bus, they touch an abnormal operation condition confirmation button displayed on the conductor's seat display. Then, the conductor inputs the event of the abnormality, the location of the abnormality, and the level of operational disruption caused by the abnormality (operational delay or inability to continue operation) on the abnormal operation condition input screen displayed on the conductor's seat display. Furthermore, examples of abnormal conditions that may cause malfunction to the normal operation of the bus include traffic accidents, vehicles broken down on the road, fires along the route, traffic congestion, or breakdowns. Additionally, the conductor can specify the location of the abnormality on a map screen displayed on the conductor's seat display.

[0004] Existing technical documents

[0005] Patent documents

[0006] Patent Document 1: Japanese Patent Application Publication No. 2011-227550 Summary of the Invention

[0007] The problem that the invention aims to solve

[0008] In the past, the following methods existed: when monitoring the operation of buses, etc., and observing the communication status between the conductor and the manager, if an abnormal situation that might cause a malfunction to normal operation occurred or was eliminated, the abnormal event, the location of the abnormality, and the level of operational disruption caused by the abnormality would be immediately communicated.

[0009] However, in the past, flight attendants could not easily perform simple input. Therefore, even in vehicles capable of autonomous driving, it was difficult to input information while they were in operation.

[0010] As a result, in the past, it was difficult to obtain real-time qualitative feedback from flight attendants to managers regarding flight attendants during operations and on operational feedback.

[0011] Previously, flight attendants could not easily perform simple input, thus, issues such as the following arose.

[0012] First, there is the issue of increased workload when dealing with other flight attendant duties such as passenger handling. For example, one could cite the difficulty of simply typing while conversing with a customer.

[0013] Furthermore, because communication with other flight attendants, such as handling passenger responses, occurs in parallel, there is a challenge in achieving frequent information sharing. For example, issues such as "the constant stream of reports other than major incidents makes it difficult to prevent disruptions or improve service."

[0014] Previously, due to the inability to conduct qualitative monitoring of flight attendants during operations and to provide feedback on operations, issues such as the following existed.

[0015] First, there is a problem of failing to prevent issues that could be directly related to obstacles. For example, there is a failure to communicate with management that "there are no problems now, but if trees are not directly felled, it will lead to poor visibility during operation."

[0016] In addition, there is the issue that flight attendants have difficulty picking up on subtle requests and annoyances that they personally perceive, thus hindering their ability to improve operations. For example, they may be unable to communicate with management about issues such as "the route is frequently blinding during this time period."

[0017] Furthermore, there is the issue of managers finding it difficult to identify the actual effects and feedback when changes are made to the system. For example, it may be difficult to communicate with managers about matters such as "the timetable was adjusted, but has it actually had a positive impact?"

[0018] This disclosure was made to solve the aforementioned problems, and its purpose is to provide an information processing device that allows flight attendants to perform simple input without much effort, compared to the past.

[0019] Methods for solving problems

[0020] The information processing apparatus disclosed herein is characterized by comprising: a base screen acquisition unit that acquires a base screen related to a vehicle or the operation of the vehicle; a template annotation acquisition unit that acquires template annotations; a display screen generation unit that generates a display screen including the base screen and a screen representing the template annotations based on the base screen acquired by the base screen acquisition unit and the template annotations acquired by the template annotation acquisition unit; and an annotation acquisition unit that acquires the template annotations selected by the vehicle's crew for the display screen generated by the display screen generation unit and an area on the base screen for which the template annotations are attached, as annotations for the base screen.

[0021] Invention Effects

[0022] According to this disclosure, due to the configuration as described above, flight attendants are able to perform simple input without much effort compared to the past. Attached Figure Description

[0023] [ Figure 1 [ ] is a diagram showing a structural example of an information processing system equipped with the information processing apparatus of Embodiment 1.

[0024] [ Figure 2 [ ] is a diagram showing a structural example of the information processing device in Embodiment 1.

[0025] [ Figure 3 [] is a flowchart illustrating an example of the operation of the information processing device in Implementation 1.

[0026] [ Figure 4 ] Figure 4 A~ Figure 4 B is a diagram showing an example of a basic screen used in the information processing device of Embodiment 1. Figure 4 A is an image representing a timetable screen. Figure 4 B represents the image of a vehicle. Figure 4 C represents the image of the map.

[0027] [ Figure 5 [1] is a diagram showing an example of a display screen used in the information processing apparatus of Embodiment 1, and is a diagram showing the display screen in the initial state.

[0028] [ Figure 6 [Illustration 1] is a diagram showing an example of a display screen used in the information processing apparatus of Embodiment 1. Figure 5 The displayed screen is a diagram in which the flight attendant has added a specified sticker to a specified position on the base screen contained in the display screen.

[0029] [ Figure 7 [ ] is a diagram showing a structural example of the information processing device in Embodiment 2.

[0030] [ Figure 8 ] Figure 8 A, Figure 8 B is a diagram illustrating an example of the operation of the information processing device in Embodiment 2. Figure 8 A represents a situation where a flight attendant applies the same sticker twice consecutively within a specified area on the base screen displayed on the screen. Figure 8 B represents a situation where the flight attendant applies the same sticker three times consecutively within a specified range on the base screen displayed on the screen.

[0031] [ Figure 9 [ ] is a diagram showing a structural example of the information processing device in Embodiment 3.

[0032] [ Figure 10 ] Figure 10 A, Figure 10 B is a diagram illustrating an example of the operation of the information processing device in Embodiment 3. It shows a situation where a flight attendant adds stickers representing events and stickers representing emotions to a predetermined area on the base screen included in the display screen.

[0033] [ Figure 11 ] Figure 11 A, Figure 11 B is a diagram showing an example of the hardware structure of the information processing device in embodiments 1 to 3. Detailed Implementation

[0034] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings.

[0035] Implementation method 1.

[0036] Figure 1 This is a diagram illustrating a structural example of an information processing system equipped with the information processing device 2 of Embodiment 1.

[0037] The information processing system is a system used for communication between the crew of vehicle 10 and the manager who manages the operation of vehicle 10. Vehicle 10 can be specifically exemplified by buses or railway vehicles, but is not limited to these; it can also be other vehicles, such as automobiles or small mobile vehicles. Furthermore, vehicle 10 can be either a vehicle capable of autonomous driving or a vehicle that cannot.

[0038] For example, Figure 1 As shown, the information processing system includes a sensor 1, an information processing device 2, and an operation control system 3.

[0039] Sensor 1 senses information relating to at least one of the interior and exterior of the vehicle 10, which is the target of the information processing system. The information sensed by sensor 1 is output to information processing device 2.

[0040] As the sensor 1, examples include in-vehicle sensors installed inside the vehicle 10 or external sensors installed outside the vehicle 10. Specific examples of sensor 1 include camera sensors, microphones, three-axis accelerometers, position sensors (HDL), LiDAR, sonar, communication devices, or driving control devices.

[0041] also, Figure 1 This illustrates an information processing system with sensor 1.

[0042] However, sensor 1 is not a necessary structure for an information processing system, and an information processing system may or may not have sensor 1.

[0043] Information processing device 2 is a device capable of notifying the manager of information related to the crew member's notes regarding the vehicle 10 or its operation, based on the crew member's actions in vehicle 10. When the information processing system includes sensor 1, information processing device 2 can also notify the manager of information related to the crew member's notes regarding the vehicle 10 or its operation, based on information from sensor 1 and the crew member's actions in vehicle 10. Figure 1 In the middle, the information processing device 2 is mounted on the vehicle 10.

[0044] The structure of the information processing device 2 will be described later.

[0045] The operation control system 3 is a system used by the manager and is a system for managing and controlling the operation of vehicle 10 based on information notified by information processing device 2.

[0046] In addition, Figure 1 The diagram shows an information processing system with an operation control system 3, where the information processing device 2 communicates with the operation control system 3. However, in the information processing system, it is sufficient for the crew of vehicle 10 to communicate with the manager; notifying the operation control system 3 is not necessary.

[0047] Next, refer to Figure 2 An example of the structure of the information processing device 2 in Embodiment 1 will be described.

[0048] The information processing device 2 of Embodiment 1 is, for example, Figure 2 As shown, it includes a storage unit 201, a sensing information acquisition unit 202, an operation acceptance unit 203, a basic screen category selection unit 204, a basic screen acquisition unit 205, a template annotation acquisition unit 206, a display screen generation unit 207, an annotation range extraction unit 208, an annotation acquisition unit 209, a related information extraction unit 210, and an information output unit 211.

[0049] Storage unit 201 stores various information processed by information processing device 2.

[0050] For example, storage unit 201 stores information related to the base screen and information related to template annotations. Additionally, storage unit 201 may also store information related to the display screen generated by display screen generation unit 207 and information related to annotations obtained by annotation retrieval unit 209. Furthermore, storage unit 201 may also store information related to the range retrieved by annotation range extraction unit 208 and information retrieved by association information extraction unit 210.

[0051] The base screen is the screen that forms the basis for the vehicle 10 or its operation. Examples of such base screens include a timetable screen showing the timetable for the operation of the vehicle 10, a vehicle screen showing the internal structure of the vehicle 10, or a map screen showing the area where the vehicle 10 operates. Furthermore, the timetable screen is a time-based screen where the crew of the vehicle 10 can specify additional times, while the vehicle screen and map screen are space-based screens where the crew of the vehicle 10 can specify locations for additional times.

[0052] Template notes contain at least one of templated images or templated text. Furthermore, template notes are set according to each category of the base image. Additionally, as images, examples include images representing events and images representing emotions.

[0053] The storage unit 201 may be, for example, a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable Memory), or a disk, floppy disk, optical disk, compact disk, mini disk, or DVD (Digital Versatile Disc).

[0054] In addition, Figure 2 The image shows the storage unit 201 being installed inside the information processing device 2.

[0055] However, it is not limited to this, the storage unit 201 may also be located outside the information processing device 2.

[0056] The sensing information acquisition unit 202 acquires information related to at least one of the interior or exterior of the vehicle 10 from the sensor 1. By acquiring information from the sensor 1 continuously or periodically, the sensing information acquisition unit 202 is able to obtain the latest information in real time.

[0057] In addition, Figure 2 The image shows an information processing device 2 having a sensing information acquisition unit 202.

[0058] However, the sensing information acquisition unit 202 is not a necessary structure for the information processing device 2, and the information processing device 2 may not have the sensing information acquisition unit 202.

[0059] The operation receiving unit 203 accepts the operations of the crew members of vehicle 10. For example, if the display device described later is a touch panel type display device, the crew members of vehicle 10 can operate by directly touching the screen displayed on the display device, and the operation receiving unit 203 accepts the operation.

[0060] The basic screen category selection unit 204 selects the category of the basic screen based on the operation received by the operation receiving unit 203.

[0061] In addition, Figure 2 The image shows the information processing device 2 having a basic screen category selection unit 204.

[0062] However, the basic screen category selection unit 204 is not a necessary structure for the information processing device 2, and the information processing device 2 may not have a basic screen category selection unit 204. For example, if there is only one category of basic screen for which the information processing device 2 is intended, it is not necessary to select the category of basic screen, and the information processing device 2 does not need a basic screen category selection unit 204.

[0063] The base screen acquisition unit 205 acquires the base screen. Furthermore, when the information processing device 2 has a base screen category selection unit 204, the base screen acquisition unit 205 acquires the base screen based on the selection result of the base screen category selection unit 204. That is, the base screen acquisition unit 205 acquires the base screen corresponding to the category of the base screen selected by the base screen category selection unit 204 based on the information stored in the storage unit 201.

[0064] Template annotation acquisition unit 206 acquires template annotations. Furthermore, when the information processing device 2 has a basic screen category selection unit 204, the template annotation acquisition unit 206 acquires template annotations based on the selection result of the basic screen category selection unit 204. That is, the template annotation acquisition unit 206 acquires template annotations corresponding to the category of the basic screen selected by the basic screen category selection unit 204 based on information stored in the storage unit 201.

[0065] The display screen generation unit 207 generates a screen that is processed by the information processing device 2. The screen generated by the display screen generation unit 207 is displayed on a display device (not shown). Then, the passenger of the vehicle 10 operates the vehicle based on the screen displayed on the display device. Furthermore, if the display device is a touch panel type display device, the passenger of the vehicle 10 can operate the vehicle by directly touching the screen displayed on the display device.

[0066] The display screen generation unit 207 generates a display screen that includes the base screen and a screen representing the template annotation, based on the base screen obtained by the base screen acquisition unit 205 and the template annotation obtained by the template annotation acquisition unit 206.

[0067] At this time, as the screen that represents the template notes mentioned above, the display screen generation unit 207 can also generate a screen that displays the template notes in a list.

[0068] In addition, the display screen generation unit 207 can also include a screen representing the information in the display screen based on the information obtained by the sensing information acquisition unit 202.

[0069] Furthermore, if the storage unit 201 stores information related to the notes obtained by the notes acquisition unit 209, the display screen generation unit 207 can also include the information related to those notes in the display screen. That is, if there are notes previously entered by the crew of the vehicle 10, the display screen generation unit 207 can also include the information related to those notes in the display screen.

[0070] For this display screen, the crew member of vehicle 10 first selects the desired template annotation from the screen containing template annotations. Then, the crew member selects the area on the base screen to attach the selected template annotation, that is, the position or time of the attached template annotation on the base screen. For example, the crew member selects the part to attach the template annotation by moving the template annotation selected from the screen displaying template annotations to the desired position or time on the base screen.

[0071] Then, the display screen generation unit 207 displays template notes added by the crew of vehicle 10 on the base screen included in the display screen according to the operation received by the operation receiving unit 203.

[0072] Alternatively, for example, the display screen generation unit 207 may generate a selection screen for the crew of vehicle 10 to select the category of the basic screen before generating the aforementioned display screen.

[0073] The annotation range extraction unit 208 extracts the range of assumed additional template annotations from the base screen included in the display screen generated by the display screen generation unit 207 based on the acquisition result of the sensing information acquisition unit 202.

[0074] In this case, the display screen generation unit 207 may also display the range extracted by the annotation range extraction unit 208 on the base screen included in the display screen.

[0075] In addition, Figure 2 The image shows an information processing device 2 with a note range extraction unit 208.

[0076] However, the note range extraction unit 208 is not a necessary structure for the information processing device 2, and the information processing device 2 may not have the note range extraction unit 208.

[0077] The annotation acquisition unit 209, based on the operation received by the operation acceptance unit 203, acquires the template annotation selected by the crew of vehicle 10 for the display screen generated by the display screen generation unit 207, as well as the area on the base screen for which the template annotation is attached, and uses it as annotation for the base screen. At this time, for example, the annotation acquisition unit 209 may also acquire information related to the display screen itself generated by the display screen generation unit 207 as annotation.

[0078] The associated information extraction unit 210 extracts information associated with the note from the information obtained by the sensing information acquisition unit 202 based on the note obtained by the note acquisition unit 209.

[0079] In this case, the display screen generation unit 207 can also display the information extracted by the associated information extraction unit 210 on the display screen.

[0080] In addition, Figure 2 The image shows an information processing device 2 with an associated information extraction unit 210.

[0081] However, the associated information extraction unit 210 is not a necessary structure for the information processing device 2, and the information processing device 2 may not have the associated information extraction unit 210.

[0082] The information output unit 211 outputs information related to the notes obtained by the notes acquisition unit 209 to the operation control system 3.

[0083] In addition, the information output unit 211 can also output the information to the operation control system 3 when the information is extracted by the associated information extraction unit 210.

[0084] In addition, Figure 2 The image shows an information processing device 2 having an information output unit 211.

[0085] However, the information output unit 211 is not a necessary structure for the information processing device 2, and the information processing device 2 may not have an information output unit 211.

[0086] Next, refer to Figure 3 right Figure 2 An example of the operation of the information processing device 2 in Embodiment 1 will be described.

[0087] In addition, the storage unit 201 stores various information processed by the information processing device 2. For example, the storage unit 201 stores information related to the basic screen and information related to template notes in advance. Furthermore, the operation receiving unit 203 receives operations from the crew of vehicle 10.

[0088] exist Figure 2In the example of the operation of the information processing device 2 of Embodiment 1 shown, for example, as Figure 3 As shown, firstly, the sensing information acquisition unit 202 acquires information related to at least one of the interior and exterior of the vehicle 10 from the sensor 1 (step ST101). By acquiring information from the sensor 1 continuously or periodically, the sensing information acquisition unit 202 is able to acquire the latest information in real time.

[0089] In addition, the basic screen category selection unit 204 selects the category of the basic screen according to the operation received by the operation receiving unit 203 (step ST102).

[0090] At this time, for example, the display screen generation unit 207 may also generate a selection screen for the crew of vehicle 10 to select the category of the basic screen, and the crew of vehicle 10 uses the selection screen to select the category of the basic screen.

[0091] Next, the base screen acquisition unit 205 acquires the base screen based on the selection result of the base screen category selection unit 204 (step ST103). That is, the base screen acquisition unit 205 acquires the base screen corresponding to the category of the base screen selected by the base screen category selection unit 204 based on the information stored in the storage unit 201.

[0092] Figure 4 This diagram shows an example of the base screen acquired by the base screen acquisition unit 205 in Embodiment 1.

[0093] Figure 4 A shows an example of a timetable screen. Figure 4 B shows an example of a vehicle image. Figure 4 C shows an example of a map view. Furthermore... Figure 4 The timetable screen shown is a time-based screen where the crew of vehicle 10 can specify additional times for their remarks. Figure 4 The vehicle image shown in B and Figure 4 The map shown in C is a space-based view where additional notes can be specified by the crew of vehicle 10.

[0094] Additionally, the template annotation acquisition unit 206 acquires template annotations based on the selection result of the basic screen category selection unit 204 (step ST104). That is, the template annotation acquisition unit 206 acquires template annotations corresponding to the category of the basic screen selected by the basic screen category selection unit 204 based on the information stored in the storage unit 201. For example, if the basic screen category selection unit 204 selects a map screen as the category of the basic screen, the template annotation acquisition unit 206 acquires template annotations associated with the map screen.

[0095] Next, the display screen generation unit 207 generates a display screen containing the base screen and a screen representing the template annotation based on the base screen obtained by the base screen acquisition unit 205 and the template annotation obtained by the template annotation acquisition unit 206 (step ST105).

[0096] At this time, as a screen for displaying template notes, the display screen generation unit 207 can also generate a screen that displays the template notes in a list.

[0097] Furthermore, if the storage unit 201 stores information related to the remarks obtained by the remarks acquisition unit 209, the display screen generation unit 207 may also include the information related to the remarks in the display screen. That is, if there are remarks previously entered by the crew of the vehicle 10, the display screen generation unit 207 may also include the information related to those remarks in the display screen.

[0098] Figure 5 This diagram illustrates an example of a display screen generated by the display screen generation unit 207 in Embodiment 1. Figure 5 The image shows an example of the initial state of vehicle 10 as a bus, before the conductor of vehicle 10 selects a template note.

[0099] Such as Figure 5 As shown, the display screen generation unit 207 generates a display screen that includes a basic screen and a screen displaying template annotations. Figure 5 In the diagram, number 11 indicates the basic screen. Figure 5 The map is displayed as the base screen. Additionally, in... Figure 5 In the image, number 12 indicates the screen displaying template notes. Figure 5 The text shows the selection of the texture icon indicated by label 121, displayed as a list of textures in the template notes. Figure 5 The display includes textures representing "Unexpected Construction," "Drowsiness," "False Detection of Grass and Trees," "Unknown Cause," and "Traffic Congestion." Furthermore, the textures representing "Unexpected Construction," "False Detection of Grass and Trees," "Unknown Cause," and "Traffic Congestion" are equivalent to textures representing events, while the texture representing "Drowsiness" is equivalent to a texture representing an emotion.

[0100] In addition, Figure 5 In the middle, when the text icon shown in label 122 is selected, the state of displaying text as template notes is switched.

[0101] In addition, Figure 5 The display screen also shows information such as the current route of the bus (labeled 13), the current time (labeled 14), the name of the conductor (labeled 15), and the number of passengers (labeled 16).

[0102] Faced with such a display screen, the crew of vehicle 10 first selects the desired template note from the screen containing template notes.

[0103] Then, the attendant of vehicle 10 selects the location or time for the additional template annotation selected on the base screen. For example, the attendant selects the location for attaching the template annotation by moving the template annotation selected from the screen displaying the template annotation to the desired location or time on the base screen. Here, if the base screen is a time-based screen such as a timetable screen, the attendant selects the time for attaching the template annotation; if the base screen is a space-based screen such as a vehicle screen or a map screen, the attendant selects the location for attaching the template annotation.

[0104] Then, based on the operation received by the operation receiving unit 203, the display screen generation unit 207 displays template notes added by the crew of vehicle 10 on the base screen included in the display screen.

[0105] Figure 6 This diagram illustrates an example of a display screen generated by the display screen generation unit 207 in Embodiment 1. Figure 6 In, relative to Figure 5 This shows an example of a display screen showing the status of a template note selected by the crew member of vehicle 10.

[0106] exist Figure 6 In the image, number 21 indicates a template note selected and added to the base screen by the crew of vehicle 10. Figure 6 The screen shows the result when the flight attendant selects a sticker indicating "emergency engineering" and attaches the sticker to a designated position on the base screen.

[0107] In addition, the information processing device 2 may also have the function of deleting template notes attached to the base screen included in the display screen based on the operation received by the operation receiving unit 203.

[0108] In addition, the annotation range extraction unit 208 can also extract the range of assumed additional template annotations in the base screen included in the display screen generated by the display screen generation unit 207 based on the acquisition result of the sensing information acquisition unit 202.

[0109] In this case, the display screen generation unit 207 may also display the range extracted by the annotation range extraction unit 208 on the base screen included in the display screen.

[0110] Next, the annotation acquisition unit 209, based on the operation received by the operation acceptance unit 203, acquires the template annotation selected by the crew of vehicle 10 for the display screen generated by the display screen generation unit 207, as well as the area on the base screen for which the template annotation is attached, and uses it as an annotation for the base screen (step ST106). For example, the annotation acquisition unit 209 may also acquire information related to the display screen itself generated by the display screen generation unit 207 as an annotation.

[0111] Furthermore, the association information extraction unit 210 can also extract information related to the annotation obtained by the annotation acquisition unit 209 from the information obtained by the sensing information acquisition unit 202. For example, if the annotation acquisition unit 209 obtains a texture indicating "emergency construction" as an annotation and attaches it to a specified area on the map screen, and the sensing information acquisition unit 202 obtains images based on the camera sensor, the association information extraction unit 210 can extract images indicating the situation of "emergency construction" by extracting images of the area corresponding to the specified range.

[0112] In this case, the display screen generation unit 207 can also display the information extracted by the associated information extraction unit 210 on the display screen.

[0113] Next, the information output unit 211 outputs information related to the notes obtained by the notes acquisition unit 209 to the operation control system 3 (step ST107).

[0114] In addition, the information output unit 211 can also output the information to the operation control system 3 when the information is extracted by the associated information extraction unit 210.

[0115] Thus, in the information processing device 2 of embodiment 1, a display screen is generated that includes a base screen and a screen representing a template annotation corresponding to the base screen. The template annotation selected by the crew member of vehicle 10 for the display screen and the area on the base screen with the template annotation are obtained as annotations for the base screen included in the display screen.

[0116] Therefore, compared to the past, the information processing device 2 of Embodiment 1 allows flight attendants to perform simple input without much effort. As a result, the information processing device 2 of Embodiment 1 can provide real-time qualitative monitoring of flight attendants during operation and feedback on operations to managers.

[0117] That is, in the information processing device 2 of Embodiment 1, the workload can be reduced. For example, "by allowing inputs to be performed simultaneously, it is possible to run in parallel with other crew members' work."

[0118] Furthermore, in the information processing device 2 of Embodiment 1, frequent information sharing is possible. For example, "even minor matters can be easily submitted, preventing obstacles before they occur and improving services."

[0119] Furthermore, in the information processing device 2 of Embodiment 1, obstacles can be prevented before they occur. That is, it is possible to "report minor concerns that may cause problems in advance".

[0120] Furthermore, in the information processing device 2 of Embodiment 1, the use of acquiring interpretive and qualitative information can be improved. That is, it is possible to report "in addition to quantitative information such as video information inside and outside the vehicle, driving information, or weather information, interpretive and qualitative information personally felt by the crew member".

[0121] Furthermore, in the information processing device 2 of Embodiment 1, feedback can be obtained from the flight attendant when changes are made. At this time, it is possible to "report not only negative reports, but also positive ones".

[0122] For example, in the information processing device 2 of Embodiment 1, it is possible to "notify in advance that the elongation of cultivated plants on the road may hinder the sensing of autonomous driving in the future, even though it has not yet become a problem."

[0123] In addition, for example, in the information processing device 2 of embodiment 1, it is possible to "add information such as 'overlapping with the transfer at station 00' or 'overlapping with the home time of high school △△' based on the automatically detected congestion data or predictions, taking into account factors or background that only train attendants can notice, thereby making it easier to identify or improve the cause."

[0124] Additionally, for example, in the information processing device 2 of Embodiment 1, it is possible to "notify people that there are many people who have misunderstood the bus stop location, and that they should move together when the bus arrives," which is information that is difficult to pick up through automatic detection.

[0125] Furthermore, for example, in the information processing device 2 of Embodiment 1, it is possible to "provide positive feedback such as the bus schedule being improved, resulting in smoother travel compared to before".

[0126] Furthermore, in the information processing device 2 of Embodiment 1, by including stickers as template annotations, a large amount of information can be communicated in a short time in a concise and easy-to-understand manner compared to the past, conveying vague emotions or situations that cannot be fully conveyed by text alone, and making it easier for managers to collect the required information when processing large amounts of information.

[0127] As described above, according to this embodiment 1, the information processing device 2 includes: a base screen acquisition unit 205 that acquires a base screen related to the vehicle 10 or the operation of the vehicle 10; a template annotation acquisition unit 206 that acquires template annotations; a display screen generation unit 207 that generates a display screen including the base screen and a screen representing the template annotations based on the base screen acquired by the base screen acquisition unit 205 and the template annotations acquired by the template annotation acquisition unit 206; and an annotation acquisition unit 209 that acquires the template annotations selected by the crew of the vehicle 10 for the display screen generated by the display screen generation unit 207 and the area on the base screen for which the template annotations are attached, as annotations for the base screen.

[0128] Therefore, in the information processing device 2 of Embodiment 1, compared to the past, flight attendants can easily perform simple input. As a result, in the information processing device 2 of Embodiment 1, it is possible to provide real-time qualitative monitoring of flight attendants during operation and feedback on operation to managers.

[0129] In addition, according to Embodiment 1, a base screen category selection unit 204 is provided to select the category of the base screen, a base screen acquisition unit 205 acquires the base screen based on the selection result of the base screen category selection unit 204, and a template annotation acquisition unit 206 acquires the template annotation based on the selection result of the base screen category selection unit 204.

[0130] Therefore, in the information processing device 2 of Embodiment 1, the flight attendant can select an appropriate base screen according to the situation, further improving convenience. That is, the flight attendant can select a time-based base screen or a space-based base screen according to the situation.

[0131] Additionally, according to Embodiment 1, the system includes: a sensing information acquisition unit 202 that acquires information from the sensor 1 related to at least one of the interior and exterior of the vehicle 10; and a note range extraction unit 208 that, based on the acquisition result of the sensing information acquisition unit 202, extracts a range of assumed additional template notes from the base screen included in the display screen generated by the display screen generation unit 207, and the display screen generation unit 207 displays the range extracted by the note range extraction unit 208 on the base screen included in the display screen.

[0132] Therefore, in the information processing device 2 of Embodiment 1, the ease of operation for flight attendants can be further improved, and flight attendants can input information more quickly.

[0133] Additionally, according to Embodiment 1, the system includes: a sensing information acquisition unit 202 that acquires information from the sensor 1 that relates to at least one of the interior and exterior of the vehicle 10; and an association information extraction unit 210 that extracts information associated with a note from the information acquired by the sensing information acquisition unit 202 based on a note acquired by the note acquisition unit 209.

[0134] Therefore, in the information processing device 2 of Embodiment 1, it is easier for flight attendants or managers to grasp information.

[0135] As described above, according to Embodiment 1, the information processing method includes the following steps: a base screen acquisition unit 205 acquires a base screen related to the vehicle 10 or the operation of the vehicle 10; a template annotation acquisition unit 206 acquires template annotations; a display screen generation unit 207 generates a display screen containing the base screen and a screen representing the template annotations based on the base screen acquired by the base screen acquisition unit 205 and the template annotations acquired by the template annotation acquisition unit 206; and an annotation acquisition unit 209 acquires the template annotations selected by the vehicle's crew for the display screen generated by the display screen generation unit 207 and the area on the base screen for which the template annotations are attached, as annotations for the base screen.

[0136] Therefore, in the information processing method of Embodiment 1, compared to the past, flight attendants can easily perform simple input. As a result, in the information processing method of Embodiment 1, it is possible to provide real-time qualitative monitoring of flight attendants during operation and feedback on operations from flight attendants to managers.

[0137] Implementation method 2.

[0138] Figure 7 This is a diagram illustrating a structural example of the information processing device 2 according to Embodiment 2. Figure 7 In the information processing device 2 of Embodiment 2 shown, relative to Figure 2 The information processing device 2 of Embodiment 1 shown has an additional count detection unit 212, and the display screen generation unit 207 has been changed to a display screen generation unit 207b. Regarding... Figure 7 Other configuration examples in the information processing apparatus 2 of Embodiment 2 shown, and Figure 2 The information processing device 2 shown in Embodiment 1 has the same configuration example and is labeled with the same reference numerals. Only the different parts are described.

[0139] Furthermore, the template notes obtained by the template note acquisition unit 206 in Embodiment 2 include at least templated textures.

[0140] The count detection unit 212 detects the number of times the same image is attached, based on the operation received by the operation receiving unit 203, when the crew of vehicle 10 continuously attaches the same image to the base image included in the display image generated by the display image generation unit 207 within a specified range.

[0141] Based on the operation received by the operation receiving unit 203, the display screen generation unit 207b displays a sticker added by the crew of vehicle 10 on the base screen included in the display screen, and changes the display mode according to the number of times detected by the number of times detection unit 212.

[0142] At this time, for example, the display screen generation unit 207b may also change the size of the texture displayed on the base screen according to the number of times detected by the number of times detection unit 212.

[0143] Alternatively, for example, the display screen generation unit 207b may change the color of the texture displayed on the base screen based on the number of times detected by the number of times detection unit 212.

[0144] Additionally, for example, the display screen generation unit 207b can change the thickness of the edges of the texture displayed on the base screen based on the number of times detected by the number of times detection unit 212.

[0145] Alternatively, for example, the display screen generation unit 207b may combine changes to the size of the texture displayed on the base screen, changes to the color of the texture, and changes to the thickness of the edges of the texture based on the number of times detected by ...

[0146] The display screen generation unit 207b has the same functions as the display screen generation unit 207 in Embodiment 1, except for those described above.

[0147] Next, refer to Figure 8 A specific example of the operation of the information processing device 2 in Embodiment 2 will be described.

[0148] exist Figure 8 In section A, an example of a texture showing a situation where road shoulder construction has been carried out, allowing for avoidance but requiring slight caution. Additionally, in... Figure 8 In section B, an example of a texture is shown where a large-scale project has been undertaken and it is necessary to notify other vehicles.

[0149] exist Figure 8 In scenario A, to notify management of shoulder construction, the flight attendant applied the same texture twice consecutively to the same location on the base image. Furthermore, in... Figure 8 In section A, as shown on the right, the display screen generation unit 207b displays the above-mentioned texture by significantly changing it relative to the case of adding one texture.

[0150] In addition, Figure 8 In scene B, to notify management of a major project, the flight attendant added the same texture three times consecutively to the same location on the base screen. Furthermore, in... Figure 8 In section B, as shown on the right, the display screen generation unit 207b significantly alters the texture compared to the case of adding a texture once, and displays it with thicker edges.

[0151] Thus, in the information processing device 2 of Embodiment 2, by having the same sticker be applied multiple times consecutively by the crew of vehicle 10, the display method of the sticker is changed according to the number of times. Therefore, in the information processing device 2 of Embodiment 2, it is possible to attach visual information to the sticker, indicating the importance of the matter represented by the sticker, or indicating the crew's or manager's response to the matter represented by the sticker.

[0152] Furthermore, the above text shows the case where the number of times the same texture is continuously applied, based on the operation received by the operation receiving unit 203.

[0153] In contrast, if the information processing device 2 has the function of deleting template notes attached to the base screen, the number of times detection unit 212 can also reduce the number of times based on the deletion of the texture.

[0154] As described above, according to this embodiment 2, the template annotation obtained by the template annotation acquisition unit 206 includes a sticker and has a count detection unit 212. When the same sticker is continuously attached by the crew of the vehicle 10 to the base screen included in the display screen generated by the display screen generation unit 207 within a specified range, the count detection unit 212 detects the number of times the sticker is attached. The display screen generation unit 207 changes the display mode according to the number of times detected by the count detection unit 212 and displays the sticker attached by the crew of the vehicle 10 to the base screen included in the display screen.

[0155] Therefore, in the information processing device 2 of embodiment 2, in addition to the effects in embodiment 1, the information indicating importance or response can be easily conveyed to the manager through the intuitive input of the flight attendant, and the response burden of the flight attendant or manager is reduced.

[0156] Implementation method 3.

[0157] Figure 9 This is a diagram illustrating a structural example of the information processing device 2 in Embodiment 3. Figure 9 In the information processing device 2 of Embodiment 3 shown, relative to Figure 2 In the information processing apparatus 2 of Embodiment 1 shown, the display screen generation unit 207 is changed to a display screen generation unit 207c. Regarding... Figure 9 Other configuration examples in the information processing device 2 of Embodiment 3 shown are similar to those in Embodiment 3. Figure 2 The information processing device 2 shown in Embodiment 1 has the same configuration example and is labeled with the same reference numerals. Only the different parts are described.

[0158] Furthermore, the template notes obtained by the template note acquisition unit 206 in Embodiment 2 include at least a texture representing a templated event and a texture representing a templated emotion.

[0159] Based on the operation received by the operation receiving unit 203, the display screen generation unit 207c, when the crew of vehicle 10 adds an event-representing image and an emotion-representing image to the base screen included in the display screen within a specified range, adjusts the image to match the event-representing image. Figure 1 It is displayed in an integrated manner on the base screen.

[0160] At this time, for example, the display screen generation unit 207c can also add markers to the textures representing events displayed on the base screen. Furthermore, the display screen generation unit 207c can also display detailed information about textures that have been attached to represent emotions by having the crew of the vehicle 10 select the texture representing the event.

[0161] Additionally, for example, the display screen generation unit 207c can change at least one of the color or the edge thickness of the event-representing texture displayed on the base screen. Furthermore, the display screen generation unit 207c can also display detailed information about textures attached to represent emotions by having the crew of the vehicle 10 select the event-representing texture.

[0162] The display screen generation unit 207c has the same functions as the display screen generation unit 207 in Embodiment 1, except for those described above.

[0163] Next, refer to Figure 10 A specific example of the operation of the information processing device 2 in Embodiment 2 will be described.

[0164] exist Figure 10 In the video, flight attendants add stickers representing events and stickers representing emotions to the same position on the base screen.

[0165] Moreover, in Figure 10 In section A, as shown in the center, the display screen generation unit 207c adds a marker to the aforementioned event-representing texture and displays it. This marker indicates that the aforementioned emotion-representing texture is attached. Furthermore, in... Figure 10 In section A, as shown on the right, the display screen generation unit 207c can display detailed information about the emotional textures attached to the event textures selected by the crew members of vehicle 10. Figure 10In section A, as detailed information, the textures representing events and emotions are displayed side by side.

[0166] In addition, Figure 10 In section B, as shown in the center, the display screen generation unit 207c thickens the edges of the texture representing the event for display. Furthermore, in... Figure 10 In section B, as shown on the right, the display screen generation unit 207c can display detailed information about the emotionally expressive textures attached to the event-representing textures by having the crew of vehicle 10 select the texture representing the event. Figure 10 In section B, as detailed information, the textures representing events and emotions are displayed side by side.

[0167] Thus, in the information processing device 2 of Embodiment 3, when an event-representing icon and an emotion-representing icon are selected within a specified range, the emotion-representing icon is integrated with the event-representing icon. Therefore, in the information processing device 2 of Embodiment 3, more detailed information can be visually conveyed to the manager through the flight attendant's intuitive input.

[0168] Furthermore, as described above, the display screen generation unit 207c, when the event-representing texture and the emotion-representing texture are attached within a defined range, causes the emotion-representing texture and the event-representing texture to... Figure 1 The situation is displayed in an integrated manner.

[0169] In contrast, if the information processing device 2 has the function of deleting template notes attached to the base screen, and if the event-representing or emotion-representing texture is deleted from the integrated texture, the display screen generation unit 207c can also decouple from the integration and return to normal display.

[0170] Furthermore, the above description shows a case where the display screen generation unit 207c is added to the display screen generation unit 207 in the information processing apparatus 2 of Embodiment 1. However, it is not limited to this; the display screen generation unit 2c can also be added to the display screen generation unit 207b in the information processing apparatus 2 of Embodiment 2 to achieve the same effect as described above.

[0171] As described above, according to this embodiment 3, the template annotations obtained by the template annotation acquisition unit 206 include stickers representing events and stickers representing emotions. When the crew of vehicle 10 adds stickers representing events and stickers representing emotions to the base screen included in the display screen within a predetermined range, the display screen generation unit 207 associates the stickers representing emotions with the stickers representing events. Figure 1 It is displayed in an integrated manner on the base screen.

[0172] Therefore, in the information processing device 2 of embodiment 3, in addition to the effects of embodiments 1 and 2, more detailed information can be visually conveyed to the manager through the intuitive input of the flight attendant.

[0173] Finally, refer to Figure 11 Hereinafter, we will describe hardware structure examples of the information processing apparatus 2 in embodiments 1 to 3. Furthermore, the hardware structure example of the information processing apparatus 2 in embodiment 1 will be described below, but the hardware structure examples of the information processing apparatus 2 in embodiments 2 and 3 are also the same.

[0174] The functions of the sensing information acquisition unit 202, operation acceptance unit 203, basic screen category selection unit 204, basic screen acquisition unit 205, template annotation acquisition unit 206, display screen generation unit 207, annotation range extraction unit 208, annotation acquisition unit 209, associated information extraction unit 210, and information output unit 211 in the information processing device 2 are implemented by the processing circuit 501. The processing circuit 501 can be as follows: Figure 11 A shows dedicated hardware, which can also be shown as... Figure 11 B shows a CPU (Central Processing Unit, also known as a central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, processor, or DSP (Digital Signal Processor)) 502 that executes the program stored in memory 503.

[0175] When the processing circuit 501 is dedicated hardware, it may be equivalent to a single circuit, a composite circuit, a programmable processor, a parallel programmable processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof. The functions of each of the following units—sensor information acquisition unit 202, operation acceptance unit 203, basic screen category selection unit 204, basic screen acquisition unit 205, template annotation acquisition unit 206, display screen generation unit 207, annotation range extraction unit 208, annotation acquisition unit 209, associated information extraction unit 210, and information output unit 211—can be implemented separately by the processing circuit 501, or the functions of each unit can be combined and implemented by the processing circuit 501.

[0176] When the processing circuit 501 is a CPU 502, the functions of the sensing information acquisition unit 202, operation acceptance unit 203, basic screen category selection unit 204, basic screen acquisition unit 205, template annotation acquisition unit 206, display screen generation unit 207, annotation range extraction unit 208, annotation acquisition unit 209, associated information extraction unit 210, and information output unit 211 are implemented by software, firmware, or a combination of software and firmware. The software and firmware are described as programs and stored in the memory 503. The processing circuit 501 implements the functions of each unit by reading and executing the programs stored in the memory 503. That is, the information processing device 2 has the capability to store data where the result of execution by the processing circuit 501 is, for example, the execution of... Figure 3 The program 503 is stored in the memory of the steps shown. Alternatively, these programs can also be described as programs that enable the computer to execute the steps and methods of the sensor information acquisition unit 202, operation reception unit 203, basic screen category selection unit 204, basic screen acquisition unit 205, template annotation acquisition unit 206, display screen generation unit 207, annotation range extraction unit 208, annotation acquisition unit 209, associated information extraction unit 210, and information output unit 211. Here, the memory 503 can be, for example, non-volatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, EEPROM, disk, floppy disk, optical disk, compact disk, mini disk, or DVD.

[0177] Furthermore, the functions of the sensing information acquisition unit 202, operation acceptance unit 203, basic screen category selection unit 204, basic screen acquisition unit 205, template annotation acquisition unit 206, display screen generation unit 207, annotation range extraction unit 208, annotation acquisition unit 209, associated information extraction unit 210, and information output unit 211 can be partially implemented using dedicated hardware and partially implemented using software or firmware. For example, the sensing information acquisition unit 202 can be implemented using the processing circuit 501 as dedicated hardware, and the functions of the operation acceptance unit 203, basic screen category selection unit 204, basic screen acquisition unit 205, template annotation acquisition unit 206, display screen generation unit 207, annotation range extraction unit 208, annotation acquisition unit 209, associated information extraction unit 210, and information output unit 211 can be implemented by the processing circuit 501 reading and executing the program stored in the memory 503.

[0178] Thus, the processing circuit 501 can implement the above-mentioned functions through hardware, software, firmware, or a combination thereof.

[0179] Furthermore, it is possible to freely combine the various embodiments, modify any constituent elements of each embodiment, or omit any constituent elements in each embodiment.

[0180] Industrial availability

[0181] Compared to previous methods, the information processing device disclosed herein allows flight attendants to perform simple input without much effort, making it suitable for use in information processing devices, etc.

[0182] Label Explanation

[0183] 1: Sensor; 2: Information processing device; 3: Operation control system; 10: Vehicle; 201: Storage unit; 202: Sensor information acquisition unit; 203: Operation acceptance unit; 204: Basic screen category selection unit; 205: Basic screen acquisition unit; 206: Template annotation acquisition unit; 207, 207b, 207c: Display screen generation unit; 208: Annotation range extraction unit; 209: Annotation acquisition unit; 210: Related information extraction unit; 211: Information output unit; 212: Count detection unit; 501: Processing circuit; 502: CPU; 503: Memory.

Claims

1. An information processing device, wherein, The information processing device has the following features: The basic image acquisition unit acquires basic images related to the vehicle or the operation of the vehicle; The template notes acquisition department retrieves template notes; The display screen generation unit generates a display screen that includes the basic screen and a screen representing the template annotation, based on the basic screen obtained by the basic screen acquisition unit and the template annotation obtained by the template annotation acquisition unit. as well as The note acquisition unit acquires the template notes selected by the vehicle's crew for the display screen generated by the display screen generation unit, and the area on the base screen with the template notes attached, as notes for the base screen.

2. The information processing device according to claim 1, characterized in that, The information processing device includes a basic screen category selection unit, which selects the category of the basic screen. The basic image acquisition unit acquires the basic image based on the selection result of the basic image category selection unit. The template annotation acquisition unit obtains template annotations based on the selection result of the basic screen category selection unit.

3. The information processing apparatus according to claim 1 or 2, characterized in that, The information processing device includes: The sensing information acquisition unit acquires information from sensors relating to at least one of the vehicle's interior and exterior; and The annotation range extraction unit extracts, based on the results obtained by the sensing information acquisition unit, the range of assumed additional template annotations within the base screen included in the display screen generated by the display screen generation unit. The display screen generation unit displays the range extracted by the annotation range extraction unit on the base screen included in the display screen.

4. The information processing apparatus according to any one of claims 1 to 3, characterized in that, The information processing device includes: The sensing information acquisition unit acquires information from sensors relating to at least one of the vehicle's interior and exterior; and The associated information extraction unit extracts information associated with the note from the information obtained by the sensing information acquisition unit based on the note obtained by the note acquisition unit.

5. The information processing apparatus according to any one of claims 1 to 4, characterized in that, The template notes obtained by the template note acquisition unit include textures. The information processing device includes a frequency detection unit that detects the number of times the same image is applied when the vehicle's crew continuously applies the same image within a predetermined range to a base image included in a display image generated by the display image generation unit. The display screen generation unit changes the display mode according to the number detected by the number detection unit and displays stickers added by the vehicle crew on the base screen included in the display screen.

6. The information processing apparatus according to any one of claims 1 to 5, characterized in that, The template notes obtained by the template note acquisition unit include stickers representing events and stickers representing emotions. When the vehicle's crew attaches an event-representing image and an emotion-representing image to the base screen within a specified range, the display screen generation unit causes the emotion-representing image to be attached to the event-representing image and displayed as a single unit on the base screen.

7. An information processing method, comprising the following steps: The basic view acquisition unit acquires basic views related to the vehicle or the operation of the vehicle; Template notes were obtained from the template notes section. The display screen generation unit generates a display screen that includes the basic screen and a screen representing the template annotation, based on the basic screen obtained by the basic screen acquisition unit and the template annotation obtained by the template annotation acquisition unit; and The annotation acquisition unit acquires the template annotation selected by the vehicle's crew for the display screen generated by the display screen generation unit, and the area on the base screen with the template annotation attached, as annotations for the base screen.

Images