Information processing device, information processing method, and program

Abstract

This information processing device comprises a first processing unit and a second processing unit. The first processing unit performs processing for simultaneously displaying a first route image showing at least a part of a movement route of a moving body on which a first person rides, and an image of a second person different from the first person, on a first display positioned inside the moving body. The second processing unit performs processing for outputting, to an information processing device operated by the second person, image display information including: route information for displaying information about the movement route; and information for displaying an image of the first person.

Description

Information processing apparatus, information processing method, and program

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

[0002] In recent years, apparatuses that guide travel routes of vehicles have become widespread. As such an apparatus, for example, there is an apparatus described in Patent Document 1. This apparatus includes a cooperation unit, a guidance unit, and a second operation unit. The cooperation unit starts and cancels cooperation between a plurality of navigation apparatuses. The guidance unit performs guidance accompanied by screen display based on a set position in at least one navigation apparatus among the cooperating navigation apparatuses. The second operation unit accepts an operation of a function that is not displayed on the screen of the navigation apparatus under guidance among the cooperating navigation apparatuses other than the navigation apparatus that is providing guidance, and performs a second operation of reflecting the position obtained as a result of the operation on other cooperating navigation apparatuses.

[0003] Japanese Unexamined Patent Publication No. 2016-176765

[0004] When setting route guidance, opinions of a plurality of people may be heard. In this case, it is desirable to enhance the sense of unity among the plurality of people. An object of the present invention is, for example, to enhance the sense of unity between a first person riding in a vehicle and a second person when setting route guidance.

[0005] The invention according to claim 1 comprises: a first processing unit that performs processing for causing a first display located inside a moving body to simultaneously display a first route image showing at least a part of a travel route of the moving body on which a first person is riding, and an image of a second person different from the first person; and a second processing unit that performs processing for outputting image display information including route information for displaying information related to the travel route and information for displaying an image of the first person to another information processing apparatus operated by the second person, wherein the information processing apparatus is.

[0006] The invention described in claim 15 is an information processing method in which a computer processes to simultaneously display on a first display located inside a mobile vehicle a first route image showing at least a portion of the travel route of a mobile vehicle on which a first person is riding, and an image of a second person different from the first person, and processes to output image display information, which includes route information for displaying information related to the travel route and information for displaying the image of the first person, to another information processing device operated by the second person.

[0007] The invention described in claim 16 is a program for a computer to implement: a first processing unit that performs processing to simultaneously display on a first display located inside the mobile body a first route image showing at least a portion of the travel route of a mobile body on which a first person is riding, and an image of a second person different from the first person; and a second processing unit that performs processing to output image display information, including route information for displaying information related to the travel route and information for displaying the image of the first person, to another information processing device operated by the second person.

[0008] This figure shows the functional configuration of the information processing device according to the first embodiment, and the device used together with the information processing device. This figure shows a modified version of Figure 1. This figure shows an example of the hardware configuration of the information processing device. This figure shows the functional configuration of the information processing device according to the second embodiment, and the device used together with the information processing device. This figure shows an example of a screen that the information processing device displays on the second display. This figure shows an example of a screen that the information processing device displays on the second display. This figure shows an example of a screen that the information processing device displays on the first display. This figure shows an example of a screen that the information processing device displays on the first display. This figure shows an example of a screen that the information processing device displays on the first display. This figure shows an example of a screen that the information processing device displays on the first display. This figure shows an example of a screen that the information processing device displays on the second display. This figure shows an example of a screen that the information processing device displays on the first display. This figure shows an example of a screen that the information processing device displays on the second display. This figure shows an example of a screen that the information processing device displays on the first display. This figure shows an example of a screen that the information processing device displays on the first display. This figure shows an example of a screen that the information processing device displays on the second display. This figure shows an example of a screen that the information processing device displays on the first display. This figure shows an example of a screen displayed on the second display by the information processing device. This figure shows an example of a screen displayed on the first display by the information processing device. This figure shows an example of a screen displayed on the first display by the information processing device. This figure shows an example of a screen displayed on the second display by the information processing device. This figure shows an example of a screen displayed on the first display by the information processing device. This figure shows an example of a screen displayed on the second display by the information processing device. This figure shows an example of a screen displayed on the first display by the information processing device. This figure shows an example of a screen displayed on the second display by the information processing device. This figure shows an example of a screen displayed on the first display by the information processing device.

[0009] Embodiments of the present invention will be described below with reference to the drawings. In all drawings, similar components are denoted by the same reference numerals, and their descriptions are omitted as appropriate. Furthermore, in the following description, the display is assumed to have a touch panel function.

[0010] (First Embodiment) Figure 1 shows the functional configuration of the information processing device 10 according to this embodiment, and the device used together with the information processing device 10. The information processing device 10 is used together with the information processing device 20 and the information processing device 30, and performs processing to display information regarding the movement route of a moving object on a display. The moving object is, for example, a vehicle, but may be other than a vehicle.

[0011] The information processing device 30 is mounted on a mobile vehicle and performs processing to provide various types of information to a first person, such as a driver, who is aboard the vehicle. One example of this information provision processing is to display a screen on a first display 310 located inside the mobile vehicle, and to output sound from a speaker located inside the mobile vehicle. This screen includes, for example, a first route image showing at least a portion of the travel route and an image of a second person who is different from the first person.

[0012] The second person is interested in the movement route of the moving object and communicates with the first person. The second person may be outside the moving object or inside it. There may be one second person or multiple second people. For example, multiple people outside the moving object may be the second person at the same time, or a person inside the moving object and a person outside the moving object may be the second person at the same time.

[0013] The information processing device 30 can communicate with the imaging device 40. The imaging device 40 is located inside the moving object and can photograph a first person. Hereinafter, the image generated by the imaging device 40 will be referred to as the image of the first person. The information processing device 30 acquires the image of the first person generated by the imaging device 40 and transmits it to the information processing device 10. The imaging device 40 may be part of the information processing device 30.

[0014] The moving body may contain multiple imaging devices 40. These multiple imaging devices 40 capture images of the first person from different directions. The information processing device 30 may transmit images of the first person generated by all imaging devices 40 to the information processing device 10, or it may transmit images of the first person generated by a specific imaging device 40 to the information processing device 10. An example of a specific imaging device 40 is an imaging device 40 designated by the information processing device 20 via the information processing device 10. This designation is input to the information processing device 20, for example, by a second person.

[0015] Furthermore, if multiple imaging devices 40 are provided inside the moving body, at least one imaging device 40 may capture images of the outside of the moving body from inside the moving body. The information processing device 30 also acquires the images generated by this imaging device 40 and transmits them to the information processing device 10. Hereinafter, this image will be referred to as the external image.

[0016] The information processing device 20 is a communication device operated by a second person, and for example, it has a second display 210 and an imaging unit 220. The information processing device 20 performs processing to simultaneously display information about the movement route of a moving object and an image of the first person. This information is displayed, for example, on the second display 210 of the information processing device 20. The information processing device 20 also has an imaging unit 220. The imaging unit 220 generates an image of the second person and transmits this image to the information processing device 10. The information processing device 20 is, for example, a portable communication device such as a so-called smartphone or tablet terminal, but is not limited to these. Also, if there are multiple second people, these multiple second people operate different information processing devices 20 from each other.

[0017] The information processing device 10 has a first processing unit 110 and a second processing unit 120. The information processing device 10 may also have a function to operate equipment mounted on a mobile body.

[0018] The first processing unit 110 performs processing to simultaneously display the first route image and the second person image on the first display 310. The first route image shows at least a part of the travel route of the mobile vehicle carrying the first person. The travel route shown in the first route image may show the route the mobile vehicle should take from now on, the route the mobile vehicle has taken so far, or both. The second person image is, for example, an image generated by the imaging unit 220 of the information processing device 20. However, the first processing unit 110 may use an image of the second person that the information processing device 10 has stored in advance instead of an image generated by the imaging unit 220.

[0019] The second processing unit 120 performs processing to output image display information to the information processing device 20. The image display information includes route information for displaying information about the movement route of a moving object, and information for displaying an image of a first person. The route information may include an image showing the movement route, for example, an image with the movement route superimposed on a map, or it may include information that identifies the current position of the moving object and the set route. The image of the first person is, for example, an image generated by the imaging device 40. However, the second processing unit 120 may use an image of the first person that has been stored in the information processing device 10 in advance, instead of an image generated by the imaging device 40.

[0020] The information processing device 20 then simultaneously displays information regarding the travel route and an image of the first person on the second display 210. For example, if the route information includes an image showing the travel route, such as an image with the travel route superimposed on a map, the information processing device 20 uses this image as at least part of the information regarding the travel route. Also, if the route information includes information identifying the current position of the moving object and the set route, the information processing device 20 uses this information to generate an image showing the travel route, such as an image with the travel route superimposed on a map, and uses this image as at least part of the information regarding the travel route. Hereinafter, the image displayed on the second display 210, which shows the travel route superimposed on a map, will be referred to as the second route image.

[0021] Some of the processing performed by the information processing device 10 described above may be performed by the information processing device 30.

[0022] Furthermore, as shown in Figure 2, the information processing device 10 may also function as the information processing device 30. In this case, the information processing device 10 is mounted on a vehicle. Also, the first display 310 becomes part of the information processing device 10.

[0023] Thus, by using the information processing device 10, the first person can grasp information about the route of the moving object while viewing the image of the second person, and the second person can grasp information about the route of the moving object while viewing the image of the second person. Therefore, the sense of unity between the first person and the second person is improved.

[0024] The imaging device 40 may repeatedly generate images of the first person. The imaging unit 220 of the information processing device 20 may also repeatedly generate images of the second person. In this case, it is preferable that the first processing unit 110 acquires the image of the second person each time it is generated and displays it on the first display 310. It is also preferable that the second processing unit 120 acquires the image of the first person each time it is generated and updates the image display information. In this case, the information processing device 20 displays the image of the first person on the second display 210 each time it is generated. Doing so further enhances the sense of unity between the first and second people.

[0025] Here, the images of the first person and the second person may be images from a so-called video call. In this case, both the information processing device 20 and the information processing device 30 have microphones. The information processing device 20 generates a facial image of the second person and second audio information indicating the voice of the second person, and transmits the second audio image together with the facial image of the second person to the information processing device 10. The information processing device 30 acquires a facial image of the first person and generates first audio information indicating the voice of the first person, and transmits the first audio image together with the facial image of the first person to the information processing device 10.

[0026] The first processing unit 110 then performs processing to output sound based on the second audio information from a speaker located inside the mobile device. For example, the first processing unit 110 transmits the second audio information to the information processing device 30. The information processing device 30 then outputs a signal based on the second audio information to the speaker, causing sound to be output from this speaker. At this time, the information processing device 30 continuously updates the second image displayed on the first display 310.

[0027] The second processing unit 120 also performs processing to output the first audio information to the information processing unit 20. For example, the second processing unit 120 transmits the first audio information to the information processing unit 20 along with the image of the first person. The information processing unit 20 outputs a signal based on the first audio information to a speaker it has, causing the speaker to output sound. At this time, the information processing unit 20 continuously updates the first image displayed on the second display 210.

[0028] In this case, for example, a second person can advise a first person on route setting for a mobile object by engaging in conversation with them. The second person could be someone close to the first person, or someone whose job it is to provide advice on route setting. Alternatively, a device or agent could be used to interact with the first person instead of the second person. This device or agent could, for example, use generative AI to interact with the first person.

[0029] Furthermore, if there are multiple second persons and multiple information processing devices 20 are communicating with the information processing device 30 via the information processing device 10, the multiple second persons may use the information processing device 20 to make a video call. In this case, the information processing device 30 may or may not allow the first person to participate in this video call.

[0030] Figure 3 shows an example of the hardware configuration of the information processing device 10. The information processing device 10 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0031] Bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060 to send and receive data to and from each other. However, the method of connecting the processor 1020 and the other components to each other is not limited to bus connection.

[0032] Processor 1020 is a processor implemented using components such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit).

[0033] Memory 1030 is a main memory device implemented as RAM (Random Access Memory), etc.

[0034] The storage device 1040 is an auxiliary storage device implemented as a removable media such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or memory card, or as ROM (Read Only Memory). The storage device 1040 stores program modules that implement each function of the information processing device 10 (for example, the first processing unit 110, the second processing unit 120, and the root update unit 130, which will be described later). The processor 1020 reads these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to the program module.

[0035] The input / output interface 1050 is an interface for connecting the information processing device 10 with various input / output devices.

[0036] The network interface 1060 is an interface for connecting the information processing device 10 to a network. This network may be, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method by which the network interface 1060 connects to the network may be wireless or wired. The information processing device 10 may communicate with the information processing devices 20 and 30 via the network interface 1060.

[0037] In summary, using the information processing device 10 improves the sense of unity between the first person and the second person.

[0038] (Second Embodiment) Figure 4 shows the functional configuration of the information processing device 10 according to this embodiment, and the devices used together with the information processing device 10. The information processing device 10 according to this embodiment has the following functions in addition to the information processing device 10 according to the first embodiment.

[0039] First, the information processing device 10 includes a route update unit 130. The information processing device 20 transmits update information to the information processing device 10 for updating the travel route of a moving object. The update information includes, for example, at least one of the following: a change of destination, a change of stopover, a deletion of a stopover, and an addition of a stopover. The route update unit 130 performs processing to update the travel route according to this update information. For example, if the information processing device 10 has a travel route generation function, i.e., a navigation function, the route update unit 130 performs processing to realize this function. Then the route update unit 130 updates the travel route using the update information. Also, if a device other than the information processing device 10 has a travel route generation function, i.e., a navigation function, the route update unit 130 transmits update information to this device to update the travel route.

[0040] When the travel route is updated, the first processing unit 110 updates the first route image so that the updated travel route is displayed, and the second processing unit 120 updates the route information to indicate the updated travel route. The first display 310 of the information processing device 30 then displays the updated first route image, and the second display 210 of the information processing device 20 displays a second route image based on the updated route information.

[0041] Here, when the information processing apparatus 10 acquires update information, the first processing unit 110 may perform a confirmation output for causing a first person to confirm whether or not the movement route may be updated according to the update information. In this case, when the route updating unit 130 acquires permission information indicating that the first person has permitted updating of the movement route, the route updating unit 130 performs processing for updating the movement route according to the update information. One example of the confirmation output is causing the first display 310 to display information indicating that update information has been acquired and information for inquiring whether or not the movement route may be updated. This display may include a button for selecting whether or not to permit updating of the movement route.

[0042] With this configuration, it is possible to suppress changing of the movement route against the intention of the first person.

[0043] Note that the first processing unit 110 may perform the confirmation output when a first condition is satisfied. In this case, when the first condition is satisfied and permission information is acquired, the route updating unit 130 performs processing for updating the movement route according to the update information. With this configuration, it is possible to suppress the confirmation output from being performed when the first person is busy, for example, when the first person is operating the moving object.

[0044] The first condition may relate to, for example, a movement state of the moving object. In this example, the first condition is, for example, that the moving object is stopped. The first condition may be that the moving object is stopped at a predetermined location. One example of the predetermined location is an intersection having a traffic light.

[0045] The first condition may relate to the update information. For example, the first condition is that the information amount of the update information is equal to or less than a reference value.

[0046] Furthermore, the information processing device 30 may cause the first display 310 or a speaker inside the moving body to output content. The content output here is, for example, at least one of music and video. The video may be a program, a movie, or news. Then, the information processing device 20 may transmit change information for changing the output content to the information processing device 10 in accordance with an input made by a second person. The change information includes, for example, at least one of information indicating a sound source after change, information indicating video after change, and information indicating a news source after change.

[0047] In this case, the route update unit 130 performs processing for changing the output content in accordance with the change information. That is, the route update unit 130 also functions as a change unit that changes content. For example, when the information processing device 10 controls the information processing device 30, the route update unit 130 changes the output content. Then, the first processing unit 110 may cause the first display 310 to perform display indicating that the output content has been changed. Furthermore, the second processing unit 120 may cause the second display 210 to perform display indicating that the output content has been changed.

[0048] Here, when the information processing device 10 acquires the change information, the first processing unit 110 may perform a confirmation output for causing a first person to confirm whether or not the output content may be changed in accordance with the change information. In this case, when the route update unit 130 acquires permission information indicating that the first person has permitted the change of the output content, the route update unit 130 performs processing for changing the output content in accordance with the change information. One example of the confirmation output is causing the first display 310 to display information indicating that the change information has been acquired, and information inquiring whether the output content may be changed. This display may include a button for selecting whether to permit the change of the output content.

[0049] By doing so, it is possible to suppress changing of the output content against the intention of the first person.

[0050] The following describes examples of the screens displayed on the second display 210 and the first display 310, followed by specific examples of the processing performed by the first processing unit 110 and the processing performed by the second processing unit 120.

[0051] Figure 5 shows an example of a screen displayed on the second display 210 by the information processing device 20. In the example shown in this figure, the image area 211 and the operation area 212 are displayed simultaneously on the second display 210. The language used for this screen may be changeable by setting. This setting can be done, for example, through at least one of the information processing device 10 and the information processing device 20.

[0052] Image area 211 is an area for displaying the first image generated by the imaging device 40. In the example shown in this figure, the image area 211 also displays an external image, i.e., an image taken by the imaging device 40 of the outside of the moving object (for example, in front), in real time. In the example shown in this figure, there are multiple second people. Therefore, the image area 211 also displays images of second people other than the second person operating the information processing device 20. These images are transmitted to the information processing device 20 in real time by the second processing unit 120 of the information processing device 10.

[0053] In the example shown in this figure, the external image is larger than both the image of the first person and the image of the second person. However, the relative sizes of these images may be changed, for example, by setting inputs made to the information processing device 20. Also, the layout within the image area 211, the layout within the operation area 212, and the positions of the image area 211 and operation area 212 on the second display 210 may be changed, for example, by setting inputs made to the information processing device 20. If these changes are made, setting information indicating the changed display mode may be stored in association with the second person. When the second person uses the information processing device 20 again to display the image area 211 and operation area 212, the display mode of the second display 210 may be set according to the stored setting information.

[0054] The operation area 212 is an area where a screen is displayed for a second person to operate the equipment mounted on the mobile device. The example shown in this figure shows the top screen of the operation area 212. This top screen displays buttons for selecting the function to be operated. These buttons include, for example, at least one of the following: a "Navigation Settings" button for setting a route, an "Audio Settings" button for setting audio settings, a "News Settings" button for setting the source of the news to be displayed, a "Restaurant Order Settings" button for placing an order in advance at a restaurant or other establishment, and an "EV Charging Spot Settings" button for reserving a charging spot to charge the electric vehicle's battery.

[0055] Figure 6 shows an example of a screen displayed on the second display 210 by the information processing device 20. The example shown in this figure is the screen displayed on the second display 210 after a second person selects the "Navigation Settings" button in the operation area 212 as shown in Figure 5. In this example, the operation area 212 displays a second route image, that is, an image with the travel route superimposed on a map. This image is a screen for performing various operations related to setting the travel route of a moving object. An example of such operation is selecting and setting stopovers and destinations. In connection with this selection and setting, the scale and region of the map displayed as the second route image can be changed by the operation of the second person.

[0056] The second route image may be the same as or different from the first route image displayed on the first display 310 at that time. In the latter case, the second route image may be an image with reduced information content from the first route image. As described above, the scale and region of the map displayed as the second route image can be changed by the operation of the second person. However, even if this change is made, the amount of information and format of the map used for the second route image may be the same as or different from the map used for the first route image.

[0057] Furthermore, the second person is not involved in controlling the moving object. Therefore, the second person can always perform the operations described using Figures 5 and 6.

[0058] Next, the screens displayed on the first display 310 will be described using Figures 7, 8, 9, and 10. Figures 7 to 10 all show screens that the information processing device 30 displays on the first display 310 when the information processing device 30 and the information processing device 20 are communicating via the information processing device 10. The language used for these screens may be changeable by setting. This setting can be done, for example, via at least one of the information processing device 10 and the information processing device 30.

[0059] Figure 7 shows the screen displayed on the first display 310 when the second condition is not met, and Figure 8 shows the screen displayed on the first display 310 when the second condition is met. Furthermore, the screen shown in Figure 8 includes information (for example, at least a part of the screen) that is displayed on the second display 210 of the information processing device 20 based on the route information. For this reason, when the second condition is met, the first processing unit 110 performs processing to display the information displayed on the information processing device 20 based on the route information on the first display 310.

[0060] As will be discussed later, the screen shown in Figure 8 contains more information than the screen shown in Figure 7. The second condition relates, for example, to the movement state of the moving object. The second condition is, for example, that the moving object is stopped, but is not limited to this.

[0061] In the example shown in Figure 7, the root area 311 and the linking area 312 are displayed simultaneously on the first display 310.

[0062] Route area 311 is an area for displaying information about the moving object's route, and displays an image similar to the image displayed by a so-called route guidance device. This image is, for example, an image in which the current location of the moving object and the route it should take are superimposed on a map.

[0063] The collaboration area 312 displays information indicating that the information processing device 20 and the information processing device 30 are communicating. One example of this information is an image of a second person. In the example shown in this figure, there are multiple second people, so the collaboration area 312 displays images of multiple second people. Furthermore, if these multiple second people are having a video call with each other, and the information processing device 30, i.e., the first person, is not participating in this video call, the collaboration area 312 also displays information indicating this, such as the text "Real-time collaboration in progress". In the example shown in this figure, information indicating the status of the processing being performed in the information processing device 20 is displayed, for example, that the "Navigation Settings" button is selected and that multiple second people are discussing which stops to set.

[0064] In the example shown in Figure 8, the root area 311 and the linking area 312 are displayed simultaneously on the first display 310. The image displayed in the root area 311 is the same as in Figure 7. On the other hand, the linking area 312 displays the same information as the information displayed in the operation area 212 of the second display 210 of the information processing device 20 at that time. For this reason, the amount of information displayed in the linking area 312 in Figure 8 is greater than the amount of information displayed in the linking area 312 in Figure 7.

[0065] In the example shown in Figure 9, the information processing device 20 has finished transmitting update information for updating the travel route to the information processing device 10. The first processing unit 110 then displays a confirmation screen in the communication area 312 of the first display 310 for the first person to confirm whether or not to update the travel route according to the update information. This screen includes buttons to select whether or not to allow the travel route update, such as a "yes" button and a "no" button. However, this screen does not display detailed information about the update. This is because displaying detailed information could interfere with the operation of the mobile device by the first person.

[0066] The example shown in Figure 10 illustrates an example of a screen displayed on the first display 310 after the travel route has been updated according to the update information. In this example, the travel route update history is displayed in the cooperation area 312. The screen displayed in the cooperation area 312 displays the same information as the information displayed in the operation area 212 of the second display 210 of the information processing device 20 at that time.

[0067] The screen shown in Figure 10 may also be displayed when the moving object is stopped. In this case, the communication area 312 of the first display 310 may also display detailed information about the update, such as details about the added stopover locations.

[0068] Furthermore, in the examples shown in Figures 7 to 10, the first display 310 does not display the history of information exchange between multiple second persons, that is, the history of information exchange between multiple information processing devices 20. However, this history may be displayed when the moving object is stopped. An example of the history displayed here is, for example, the history of a text-based conversation. In this way, the first person can understand the process by which the updated information was decided.

[0069] Figures 11 to 17 show examples of the display on the second display 210 and the first display 310 when "Navigation Settings" is selected on the top screen of the operation area 212 shown in Figure 5.

[0070] First, Figures 11 to 13 show examples of screens displayed immediately after "Navigation Settings" is selected. Figure 11 shows an example screen displayed on the second display 210, while Figures 12 and 13 show examples of screens displayed on the first display 310. Note that Figure 12 is an example screen displayed while the moving object is in motion, and Figure 13 is an example screen displayed while the moving object is stationary.

[0071] As shown in Figure 11, the operation area 212 of the second display 210 displays display items for inputting information to change the route. Meanwhile, in both Figure 12 and Figure 13, the route area 311 of the first display 310 displays a map, the route the mobile vehicle should travel, and the current location of the mobile vehicle. However, as shown in Figure 12, while the mobile vehicle is moving, the information displayed in the communication area 312 of the first display 310 is different from the information displayed in the operation area 212 of the second display 210, and includes, for example, a second person's face image and text indicating that the route is being changed. Meanwhile, as shown in Figure 13, while the mobile vehicle is stopped, the communication area 312 displays the same screen as the operation area 212 in addition to the second person's face image.

[0072] Then, once the route change is completed on the screen shown in Figure 11, the operation area 212 of the second display 210 displays information showing the map, the current location of the moving object, and the changed route, as shown in Figure 14. In the example shown in Figure 14, since the route change is the addition of a waypoint, the added waypoint is highlighted on the map. Also, as shown in Figure 15, the communication area 312 of the first display 310 displays text indicating that the second person has requested a route change (for example, that a waypoint has been added), and an item (for example, a button) for the first person to input whether or not to approve this addition, regardless of whether the moving object is moving or not.

[0073] Furthermore, if the first person makes a predetermined input to the information processing device 10 while the moving object is stopped, detailed information regarding the route change, such as detailed route information to the waypoint, may be displayed in the communication area 312 of the first display 310.

[0074] Then, on the screen shown in Figure 15, when the first person inputs whether or not to approve the addition of a waypoint, information indicating the input result is displayed on the second display 210 of the information processing device 20. This allows the second person to confirm whether or not a waypoint has been added, that is, whether or not the first person has accepted the second person's request and changed the settings of the information processing device 10.

[0075] Subsequently, as shown in Figure 16, the route setting history is displayed in the operation area 212 of the second display 210. Also, as shown in Figure 17, the route setting history is displayed in the communication area 312 of the first display 310, regardless of whether the moving object is moving or not.

[0076] Furthermore, the second person can check the details of the route setting history at any time by performing a predetermined operation when the screen shown in Figure 16 is displayed. On the other hand, the first person can check the details of the route setting history only when the moving object is stopped, by performing a predetermined operation when the screen shown in Figure 17 is displayed.

[0077] Figures 18 to 22 show examples of the display on the second display 210 and the first display 310 when "Audio Settings" is selected on the top screen of the operation area 212 shown in Figure 5.

[0078] First, Figures 18 to 20 show examples of screens displayed immediately after "Audio Settings" is selected. Figure 18 shows an example screen displayed on the second display 210, and Figures 19 and 20 show examples of screens displayed on the first display 310. Note that Figure 19 is an example screen displayed while the moving object is in motion, and Figure 20 is an example screen displayed while the moving object is stationary.

[0079] As shown in Figure 18, the operation area 212 of the second display 210 displays display items for selecting audio settings, such as the sound source to be output (an example of content). Meanwhile, in both Figure 19 and Figure 20, the route area 311 of the first display 310 displays a map, the route the mobile vehicle should travel, and the current location of the mobile vehicle. However, as shown in Figure 19, while the mobile vehicle is moving, the information displayed in the interaction area 312 of the first display 310 is different from the information displayed in the operation area 212 of the second display 210, and includes, for example, a second person's face image and text indicating that the audio has been changed. Meanwhile, as shown in Figure 20, while the mobile vehicle is stationary, the interaction area 312 displays the same screen as the operation area 212 in addition to the second person's face image.

[0080] Then, when the audio settings, such as selecting a sound source, are completed on the screen shown in Figure 18, the operation area 212 of the second display 210 displays information indicating the selected sound source (for example, a so-called album art image) and display items for inputting instructions regarding the playback of the sound source (for example, a play start button, a rewind button, and a fast forward button), as shown in Figure 21. This screen may also be displayed after the first person has given input indicating that they approve the change in audio settings on the screen shown in Figure 22.

[0081] As shown in Figure 22, the communication area 312 of the first display 310 displays text indicating that a second person has requested a change in the audio settings, regardless of whether the moving object is moving or not, and an item (e.g., a button) for the first person to input whether or not to approve this change.

[0082] Then, on the screen shown in Figure 22, when the first person inputs whether or not they approve the change in audio settings, information indicating the input result is displayed on the second display 210 of the information processing device 20. This allows the second person to confirm whether or not the audio settings have been changed, that is, whether or not the first person has accepted the second person's request and changed the settings of the information processing device 10.

[0083] Figures 23 to 27 show examples of the display on the second display 210 and the first display 310 when "News Settings" is selected on the top screen of the operation area 212 shown in Figure 5.

[0084] First, Figures 23 to 25 show examples of screens displayed immediately after "News Settings" is selected. Figure 23 shows an example screen displayed on the second display 210, and Figures 24 and 25 show examples of screens displayed on the first display 310. Note that Figure 24 is an example screen displayed while the moving object is in motion, and Figure 25 is an example screen displayed while the moving object is stationary.

[0085] As shown in Figure 23, the operation area 212 of the second display 210 displays display items for selecting a news source (an example of content). Meanwhile, in both Figures 24 and 25, the route area 311 of the first display 310 displays a map, the route the mobile vehicle should travel, and the current location of the mobile vehicle. However, as shown in Figure 24, while the mobile vehicle is moving, the information displayed in the interaction area 312 of the first display 310 is different from the information displayed in the operation area 212 of the second display 210, and includes, for example, a second person's face image and text indicating that a news source has been selected. Meanwhile, as shown in Figure 25, while the mobile vehicle is stationary, the interaction area 312 displays the same screen as the operation area 212 in addition to the second person's face image.

[0086] Then, once the selection of a news source is complete on the screen shown in Figure 23, the operation area 212 of the second display 210 displays information indicating the selected news source (e.g., an image) and display items for inputting instructions regarding news playback (e.g., a play start button, a rewind button, and a fast forward button), as shown in Figure 26. This screen may also be displayed after the first person has given input indicating that they approve the change of news source on the screen shown in Figure 27.

[0087] Furthermore, as shown in Figure 27, the interaction area 312 of the first display 310 displays text indicating that the news source has changed, regardless of whether the moving object is moving or not, and an item (e.g., a button) for the first person to input whether or not to approve this change.

[0088] Then, on the screen shown in Figure 27, when the first person inputs whether or not they approve the change of the news source, information indicating the input result is displayed on the second display 210 of the information processing device 20. This allows the second person to confirm whether or not the news source has been changed, that is, whether or not the first person has accepted the second person's request and changed the settings of the information processing device 10.

[0089] In summary, this embodiment also improves the sense of unity between the first person and the second person.

[0090] The embodiments of the present invention have been described above with reference to the drawings, but these are merely examples of the present invention, and various other configurations can also be adopted.

[0091] 10 Information processing device 20 Information processing device 30 Information processing device 40 Imaging device 110 First processing unit 120 Second processing unit 130 Route update unit 210 Second display 220 Imaging unit

Claims

1. An information processing device comprising: a first processing unit that performs processing to simultaneously display on a first display located inside a mobile body a first person a first person is riding on a first route image showing at least a portion of the travel route of a mobile body, and an image of a second person different from the first person; and a second processing unit that performs processing to output image display information, including route information for displaying information about the travel route and information for displaying an image of the first person, to another information processing device operated by the second person.

2. An information processing apparatus according to claim 1, wherein the image of the first person and the image of the second person are repeatedly generated, the first processing unit acquires the image of the second person each time the image of the second person is generated and displays it on the first display, and the second processing unit acquires the image of the first person each time the image of the first person is generated and updates the image display information.

3. An information processing device according to claim 2, wherein when an image of the first person is generated, first audio information indicating the voice of the first person is generated, when an image of the second person is generated, second audio information indicating the voice of the second person is generated, the first processing unit performs processing to output audio based on the second audio information from a speaker located inside the mobile body, and the second processing unit performs processing to output the first audio information to the other information processing device.

4. An information processing apparatus according to any one of claims 1 to 3, wherein the second image of a person is generated by an imaging unit mounted on the other information processing apparatus.

5. An information processing device according to claim 4, wherein the information processing device is equipped with a route update unit that receives update information for updating the travel route from the other information processing device and performs processing for updating the travel route in accordance with the update information.

6. An information processing device according to claim 5, wherein the first processing unit, upon acquiring the update information, outputs a confirmation message to a first person to confirm whether or not it is permissible to update the travel route according to the update information, and the route update unit, upon acquiring permission information indicating that the first person has permitted the update of the travel route, performs processing to update the travel route according to the update information.

7. An information processing device according to claim 6, wherein the first processing unit performs the confirmation output when the first condition is met, and the route update unit performs processing to update the travel route according to the update information when the first condition is met and the permission information is obtained.

8. An information processing device according to claim 7, wherein the first condition relates to the movement state of the moving body.

9. In the information processing apparatus according to claim 7, the first condition is an information processing apparatus relating to the update information.

10. An information processing device according to any one of claims 1 to 3, wherein the information processing device receives change information from the other information processing device for changing the content output inside the mobile device, and includes a change unit that performs processing for changing the output content in accordance with the change information.

11. An information processing device according to claim 10, wherein the first processing unit, upon acquiring the change information, outputs a confirmation message to a first person to confirm whether or not it is permissible to change the output content in accordance with the change information, and the change unit, upon acquiring permission information indicating that the first person has permitted the change of the output content, performs processing to change the output content in accordance with the change information.

12. An information processing device according to any one of claims 1 to 11, wherein the route information includes an image identical to the first route image, or an image obtained by reducing the amount of information of the first route image.

13. An information processing device according to any one of claims 1 to 12, wherein the first processing unit performs a process to display information displayed on the other information processing device on the first display based on the route information when the second condition is met.

14. An information processing device according to claim 13, wherein the second condition relates to the movement state of the moving body.

15. An information processing method comprising: a computer performing processing to simultaneously display on a first display located inside a mobile vehicle a first person on a first route image showing at least a portion of the travel route of a mobile vehicle on which a first person is riding, and an image of a second person different from the first person; and performing processing to output image display information, including route information for displaying information related to the travel route and information for displaying the image of the first person, to another information processing device operated by the second person.

16. A program for a computer to implement: a first processing unit that performs processing to simultaneously display on a first display located inside the mobile body a first route image showing at least a portion of the travel route of a mobile body on which a first person is riding, and an image of a second person different from the first person; and a second processing unit that performs processing to output image display information, including route information for displaying information about the travel route and information for displaying the image of the first person, to another information processing device operated by the second person.

Images