Information processing device and information processing program

Abstract

To prevent processing corresponding to operation from being executed without approval of other users when the operation requiring the approval of the other users occurs.SOLUTION: An information processing device includes: a first object; a display control part for displaying a first operator corresponding to the first object in a first display area corresponding to a first user; a display form change part for suspending execution of processing corresponding to first operation and changing a display form of the first operator when the first operation requiring approval of a second user for the first object occurs; an operator display control part for displaying the first operator in a second display area corresponding to the second user when the second operation is performed to the first operator with the display form changed; and a processing execution part for executing the suspended processing when third operation for approving the first operation is performed to the first operator displayed in the second display area.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and an information processing program.

Background Art

[0002] Display devices having large screens have been put into practical use. For example, Patent Document 1 describes an information processing apparatus that executes various processes using this type of display device.

[0003] In the information processing apparatus described in Patent Document 1, for example, a passenger can advance part of a series of processes by operating a passenger screen, and a driver can advance the remaining processes by operating a driver screen. By the driver and the passenger sharing the operation, the target process can be completed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] For example, there are processes that are preferably executed after obtaining the approval of the driver, such as changing the destination or setting a waypoint on a navigation system. However, in the information processing apparatus described in Patent Document 1, such processes can be executed at the discretion of the passenger.

[0006] In view of the above circumstances, an embodiment of the present disclosure aims to provide an information processing apparatus and an information processing program that can prevent a process corresponding to an operation that requires the approval of another user from being executed without the approval of the other user when such an operation occurs.

Means for Solving the Problems

[0007] An information processing apparatus according to an embodiment of the present disclosure includes a display control unit that displays a first object and a first operator corresponding to the first object in a first display area corresponding to a first user, and when a first operation that requires approval by a second user occurs for the first object, the execution of the process corresponding to the first operation is suspended, and a display form changing unit that changes the display form of the first operator, and when a second operation is performed on the first operator whose display form has been changed, an operator display control unit that displays the first operator in a second display area corresponding to the second user, and when a third operation that approves the first operation is performed on the first operator displayed in the second display area, a process execution unit that executes the suspended process.

Effects of the Invention

[0008] According to an embodiment of the present disclosure, there are provided an information processing apparatus and an information processing program capable of preventing a process corresponding to an operation that requires approval by another user from being executed without approval by the other user when the operation occurs.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Mode for Carrying Out the Invention

[0010] The following description relates to an information processing apparatus and an information processing program according to one embodiment of the present disclosure. For common or corresponding elements, the same or similar reference numerals are attached, and overlapping descriptions are appropriately simplified or omitted as appropriate.

[0011] FIG. 1 is a diagram schematically showing a vehicle A in which an in-vehicle system 1 according to one embodiment of the present disclosure is installed. Vehicle A is an example of a moving body and is a left-hand drive vehicle. Vehicle A may be a right-hand drive vehicle.

[0012] The in-vehicle system 1 includes, for example, a main unit 2 installed in the dashboard, a display unit 13 connected to the main unit 2, and an occupant discrimination device 18. The screen 13a of the display unit 13 has a size extending from near the right front pillar to near the left front pillar. A reference numeral 13R is attached to the right end of the screen 13a located near the right front pillar. A reference numeral 13L is attached to the left end of the screen 13a located near the left front pillar.

[0013] As described above, the display unit 13, which is an example of a display device, is installed in the vehicle A. In the vehicle A, a seat row including a passenger seat S1 (an example of a first seat) and a driver's seat S2 (an example of a second seat) is installed. The screen 13a of the display unit 13 is located in front of this seat row and is formed to extend in the vehicle width direction of the vehicle A.

[0014] The screen 13a is partitioned into a right display area 13aR, a left display area 13aL, and a central display area 13aC. The right display area 13aR is an example of a first display area and is located opposite the passenger seat S1. The left display area 13aL is an example of a second display area and is located opposite the driver's seat S2. That is, the display unit 13 is an example of a display device having a screen including a first display area and a second display area.

[0015] In addition, any reference to an element using designations such as "first" and "second" used in the present disclosure does not generally limit the quantity or order of those elements. These designations are used for convenience in distinguishing between two or more elements. Therefore, a reference to a first and a second element does not mean, for example, that only two elements are adopted, or that the first element must precede the second element.

[0016] The right display area 13aR is located near the passenger seat S1. Therefore, it is difficult for the finger of the user (i.e., the driver) seated in the driver's seat S2 to reach the right display area 13aR. Accordingly, the right display area 13aR can be said to be a screen area for the user (i.e., the passenger) seated in the passenger seat S1.

[0017] On the other hand, the left display area 13aL is located near the driver's seat S2. Therefore, it is difficult for the finger of the passenger to reach the left display area 13aL. Accordingly, the left display area 13aL can be said to be a screen area for the driver.

[0018] The central display area 13aC is an example of a third display area and is a screen area between the right display area 13aR and the left display area 13aL.

[0019] The control unit 10 described later manages each of the areas of the right display area 13aR, the left display area 13aL, and the central display area 13aC in terms of the coordinates of the screen 13a, for example.

[0020] The occupant discrimination device 18 is a device that discriminates which of the pre-registered users is the person sitting on the seat in the vehicle A, and is a DMS (Driver Monitoring System), a fingerprint authentication device, etc.

[0021] In addition, when the occupant discrimination device 18 is a fingerprint authentication device, even if the authenticated person can be identified, the seating position of the authenticated person cannot be identified. Therefore, when the occupant discrimination device 18 is a fingerprint authentication device, for example, before authentication, the authenticated person is made to input their seating position on a predetermined menu screen. Alternatively, two fingerprint sensors may be provided near the passenger seat S1 and near the driver's seat S2, and the seating position may be specified based on the position of the fingerprint sensor that has been authenticated.

[0022] FIG. 2 is a block diagram showing the hardware configuration of the in-vehicle system 1 according to an embodiment of the present disclosure. The in-vehicle system 1 includes a main unit 2 (an example of an information processing device) connected to a touch-operable display device (display unit 13 in this embodiment). The in-vehicle system 1 is equipped with various functions including, for example, an audio function and a navigation function. The in-vehicle system 1 may be a device that forms part of an IVI (In-Vehicle Infotainment).

[0023] As shown in FIG. 2, the main unit 2 includes a control unit 10, a player 11, a sound system 12, an operation unit 14, a storage unit 15, a GNSS (Global Navigation Satellite System) reception unit 16, and a DR (Dead Reckoning) sensor 17.

[0024] The main unit 2 may be configured to include only some of the above components (for example, the control unit 10 and the storage unit 15). In this case, other components not included in the main unit 2 (such as the player 11) may be configured as units independent of the main unit 2. Further, the main unit 2 may be configured as a single in-vehicle device including the display unit 13 and the passenger discrimination device 18 in addition to the control unit 10, the player 11, the sound system 12, the operation unit 14, the storage unit 15, the GNSS receiver 16, and the DR sensor 17.

[0025] Further, the in-vehicle system 1 may include other components not shown in FIG. 2. That is, there is flexibility in the form of the in-vehicle system 1 and the main unit 2, and various design changes are possible.

[0026] The player 11 is connected to a sound source. The player 11 plays the audio signal input from the sound source and outputs it to the control unit 10.

[0027] The sound source is, for example, a disk medium such as a CD (Compact Disc) or SACD (Super Audio CD) storing digital audio data, a storage medium such as an HDD (Hard Disk Drive) or USB (Universal Serial Bus) memory, a smartphone, a tablet terminal, or a server that performs stream distribution via a network. When the sound source is stream-distributed or when the sound source is stored in the storage unit 15 described later, the player 11 as an individual piece of hardware may be omitted.

[0028] The main unit 2 is an example of an information processing device according to an embodiment of the present disclosure, and is an example of a computer that executes the information processing method and information processing program according to the present embodiment. That is, the information processing device according to the present embodiment is incorporated into the in-vehicle system 1 as the main unit 2.

[0029] The control unit 10 is configured as, for example, an LSI (Large Scale Integration), and includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and a DSP (Digital Signal Processor).

[0030] The control unit 10 executes various programs developed from the storage unit 15 to the work area of the RAM. Thereby, the control unit 10 controls the operation of the in-vehicle system 1.

[0031] The control unit 10 is, for example, a single processor or a multi-processor, and includes at least one processor. When configured to include a plurality of processors, the control unit 10 may be packaged as a single device, or may be configured by a plurality of physically separated devices within the in-vehicle system 1.

[0032] The control unit 10 processes the digital audio signal input from the player 11 or the storage unit 15 and outputs it to the sound system 12.

[0033] The sound system 12 includes a D / A converter, an amplifier, etc. The digital audio signal is converted into an analog signal by the D / A converter. This analog signal is amplified by the amplifier and output to each speaker installed in the vehicle interior. Thereby, for example, a piece of music recorded in the sound source is reproduced in the vehicle interior from each speaker.

[0034] The display unit 13 is a device that displays various screens, and includes, for example, a display configured by an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence). A touch panel is mounted on the display.

[0035] The user can perform various touch operations on the display (screen 13a), such as touch-on (touching the screen 13a with a finger), touch-off (lifting the finger from the screen 13a), flick (dragging a finger across the screen 13a), swipe (slide), drag, and drop.

[0036] The control unit 10 detects the coordinates on the screen 13a being touched and executes the process associated with the detected coordinates.

[0037] That is, the display unit 13 is an example of a touch-operable display device. Incidentally, the control unit 10 is connected to the display unit 13, which is an example of a display device.

[0038] The operation unit 14 includes mechanical operators such as switches, buttons, knobs, and wheels of a mechanical type, a capacitive non-contact type, a membrane type, etc. Also, the display unit 13 equipped with a touch panel display forms part of the operation unit 14. A GUI with touch-operable operators is displayed on the screen 13a of the display unit 13.

[0039] The user can operate the in-vehicle system 1 via mechanical operators or operators on the GUI (Graphical User Interface).

[0040] The storage unit 15 is, for example, an auxiliary storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), or a flash memory. Various programs such as an information processing program for executing the information processing method according to this embodiment, and various data such as map data for navigation are stored in the storage unit 15. When the player 11 is omitted, the sound source data is also stored in the storage unit 15.

[0041] The GNSS receiver 16 measures the current position of the vehicle based on GNSS signals received from a plurality of GNSS satellites. The GNSS receiver 16 measures the current position at a predetermined time interval (for example, every second) and outputs the measurement result to the control unit 10. A typical example of GNSS is GPS (Global Positioning System).

[0042] The control unit 10 renders the map data stored in the storage unit 15 and displays the map on the screen 13a of the display unit 13. At the same time, the control unit 10 acquires the current position measured by the GNSS receiver 16 and overlays (map-matches) a mark indicating the position of the host vehicle at the acquired current position on the position on the road of the map displayed on the screen 13a of the display unit 13.

[0043] The DR sensor 17 includes various sensors such as a gyro sensor that measures the angular velocity related to the azimuth of the vehicle in the horizontal plane and a vehicle speed sensor that detects the rotational speeds of the left and right drive wheels of the vehicle.

[0044] The control unit 10 can also estimate the current position from the information acquired from the DR sensor 17. The control unit 10 may compare both the current position acquired from the GNSS receiver 16 and the current position estimated based on the information acquired from the DR sensor 17, and then determine the final current position.

[0045] FIG. 3 shows an example of a display screen displayed on the screen 13a of the display unit 13. As shown in FIG. 3, a plurality of objects are displayed on the screen 13a.

[0046] An object is a display item that shows the type of application and the information processed by that application on screen 13a, or a display item that symbolizes such information, and its shape and size are variable. For example, there are widgets, icons, thumbnail images, pop-ups, lists, and information display windows. A widget is a display item that includes interface components of a GUI (Graphical User Interface), and has a layout for displaying the result processed by the application corresponding to that widget or for receiving an instruction to process with that application. An object may be called by another name such as content.

[0047] Examples of objects include those for displaying information related to a navigation function, those for displaying an overhead image of a vehicle when parked, those for operating the audio function installed in in-vehicle system 1, those for tuning a radio, those for adjusting the temperature and air volume of the air conditioner installed in the vehicle, and those for displaying and setting various vehicle-related information (e.g., speedometer, tachometer).

[0048] As an example, object C1 displays a navigation image processed by a navigation app for navigation. Object C4 also displays a navigation image processed by the same navigation app. The symbol MK shown in objects C1 and C4 is a mark indicating the current position of vehicle A.

[0049] On screen 13a, for example, objects corresponding to the user are displayed.

[0050] Specifically, in storage unit 15, users who board vehicle A (e.g., the owner of vehicle A and their family), objects, and layouts are stored in association with each other. The user can store in storage unit 15 in association with each other the user, the object, and the layout by operating main unit 2, for example.

[0051] The object associated with the user may be, for example, an object frequently used by the user. In this case, the control unit 10 performs, for example, deep learning to associate the user with the frequently used object and stores it in the storage unit 15.

[0052] Based on the discrimination result by the passenger discrimination device 18, the control unit 10 identifies the driver and passengers including the presence or absence of riding. The control unit 10 calls the object stored in association with the identified user from the storage unit 15, and arranges the called object in the layout stored in association with the user and displays it on the screen 13a.

[0053] More specifically, the control unit 10 displays the object associated with the identified passenger in the right display area 13aR in the layout associated with the passenger, and also displays the object associated with the identified driver in the left display area 13aL in the layout associated with the driver.

[0054] The central display area 13aC is, for example, a screen area shared by the driver and passengers. A default object (for example, a media player that displays a video) is displayed in the central display area 13aC.

[0055] The object displayed in the central display area 13aC is not limited to the default object. The object displayed in the central display area 13aC may be determined according to, for example, the combination of the driver and passengers.

[0056] The sizes of the right display area 13aR, the left display area 13aL, and the central display area 13aC (the exclusive area of each area with respect to the screen 13a) may be fixed regardless of the combination of the driver and passengers, or may be changed according to the combination of the driver and passengers.

[0057] In the example of FIG. 3, objects C1 and C2 are displayed in the left display area 13aL. Object C3 is displayed in the central display area 13aC. Objects C4 and C5 are displayed in the right display area 13aR.

[0058] Furthermore, icons corresponding to the objects are displayed in each area. Specifically, in the left display area 13aL, icon B1 corresponding to object C1 and icon B2 corresponding to object C2 are displayed. In the central display area 13aC, icon B3 corresponding to object C3 is displayed. In the right display area 13aR, icon B4 corresponding to object C4 and icon B5 corresponding to object C5 are displayed.

[0059] Icons B1 to B5 each accept operations related to the corresponding objects C1 to C5. When collectively referring to icons B1 to B5, they are denoted as "icon B".

[0060] Icon B is displayed in the order corresponding to the objects in each of the right display area 13aR, left display area 13aL, and central display area 13aC. As an example, in the right display area 13aR, objects C4 and C5 are displayed in order from the left to the right of the screen. Therefore, the corresponding icons B4 and B5 are also displayed in order from the left to the right of the screen.

[0061] By aligning the order of objects C1 to C5 with the order of icons B1 to B5, the user can easily grasp the correspondence between icons B1 to B5 and objects C1 to C5. Therefore, the operability is improved.

[0062] The control unit 10 operates as a display control unit that displays a first object (for example, object C4) and a first operator (for example, icon B4) corresponding to the first object in a first display area (for example, the right display area 13aR) corresponding to a first user (for example, a passenger).

[0063] FIG. 4 shows an example of a display screen when a touch operation is performed on the screen 13a shown in FIG. 3. The hands shown in each figure including FIG. 4 that show an example of a display screen indicate how a user (here, a driver or a passenger) touches the screen 13a. Also, the white arrows shown by broken lines (for example, FIG. 6) indicate the movement of the finger of the user who performs a slide operation (including drag, flick, etc.) on the screen 13a.

[0064] At least one sub-icon is associated with each icon B. For example, as shown in FIG. 4, when the driver touches the icon B1, three sub-icons SBa to SBc associated with the icon B1 are expanded and displayed.

[0065] When the sub-icon SBa is touched, for example, the object C1 transitions to the destination setting mode. When the sub-icon SBb is touched, for example, the object C1 transitions to the scale variable mode of the map image. When the sub-icon SBc is touched, for example, the object C1 transitions to the setting mode of the navigation system.

[0066] In the example of FIG. 4, when transitioning to the destination setting mode, the driver can search for and set a destination by touching the menu displayed in the object C1. The driver can also set the touch position as the destination by directly touching the map image displayed in the object C1.

[0067] When the destination is set, navigation is started. When navigation is started, for example, as shown in FIG. 4, in the objects C1 and C4, a route RT (see thick line) to the destination is superimposed and displayed on the map image.

[0068] The driver and the passenger can each independently operate the objects C1 and C4. FIG. 5 shows an example of a display screen when the passenger touches the map image of the object C4 to add a via point. In FIG. 5, the symbol P1 indicates the via point to be added.

[0069] Route RT is changed as the waypoints are added. If the addition of a waypoint is confirmed only by the operation of a passenger on object C4, for example, it may interfere with the driver's driving operation due to a sudden change in route RT. Therefore, it is desirable that the addition of a waypoint be executed after obtaining the driver's approval.

[0070] Therefore, in the present embodiment, as shown in FIG. 5, when a passenger performs an operation to add waypoint P1, the display form of icon B4 corresponding to object C4 is changed. In the example of FIG. 5, icon B4 is changed from a white circle to a black circle. Through the change in the display form of icon B4, the passenger can recognize that the operation just performed (for example, the operation to add waypoint P1) is an operation that requires the driver's approval (approval-required operation).

[0071] The change in the display form may be a change in the color of the icon or a blinking display. Further, the control unit 10 may control the sound system 12 to issue a voice indicating that it is an operation that requires the driver's approval (approval-required operation) along with the change in the display form.

[0072] FIG. 6 shows an example of a display screen when a passenger performs a touch operation on the screen 13a shown in FIG. 5.

[0073] When the passenger flicks the icon B4 with the changed display form to the left display area 13aL side, as shown in FIG. 6, the icon B4 moves from the original display position (refer to the symbol B4' indicated by the dotted line in FIG. 6) to an adjacent position of the icon B1 displayed in the left display area 13aL. Further, the waypoint P1 is also displayed on the map image of object C1, and the tab TB is added to object C1.

[0074] At this time, the display form of the icon B4 displayed in the left display area 13aL is displayed in a display form different from that of the other icons B1 and B2. Further, the control unit 10 may control the sound system 12 to issue a voice indicating that a proposal has been made by the passenger.

[0075] The passenger can also move the icon B4 to an adjacent position to the icon B1 by performing another slide operation such as dragging the icon B4 by a predetermined amount to the left display area 13aL side instead of the flick operation.

[0076] The waypoint P1 is indicated by, for example, a star mark. The star mark indicates a waypoint added to the route.

[0077] Depending on the scale, orientation, overhead position, etc. of the map image (for convenience, referred to as the "map display form"), the waypoint P1 may not be located within the map image displayed by the object C1. In this case, in the object C1, the map display form is temporarily changed so that the waypoint P1 fits within the map image.

[0078] The tab TB is a toggle-type operator. Each time the tab TB is touched, the display state of the object C1 changes. Specifically, when the tab TB is touched in the state where the waypoint P1 is displayed, the display of the waypoint P1 disappears. When the tab TB is touched in the state where the waypoint P1 is not displayed, the waypoint P1 is displayed. When the tab TB is touched in the state where the map display form has been changed, the map display form returns to the original map display form. When the tab TB is touched again, the map display form returns to the changed map display form again.

[0079] Depending on the timing, the driver may find the superimposed display of the waypoint P1 on the map image and the change of the map display form troublesome. In this case, the driver can turn off the display of the waypoint P1 or return the map display form to its original state by touching the tab TB.

[0080] In this embodiment, if a passenger only performs an additional operation on the waypoint P1, the information of the waypoint P1 is not immediately reflected in the object C1. Only when the passenger flicks the icon B4 with the changed display form to the driver side, the information of the waypoint P1 is reflected in the object C1. Thereby, for example, it is possible to prevent the information of the waypoint P1 from being inadvertently sent from the passenger to the driver.

[0081] The passenger can propose to the driver to add the waypoint P1 by performing an intuitive operation of flicking the icon B4 to the driver side.

[0082] FIG. 7 shows an example of a display screen when the driver performs a touch operation on the screen 13a shown in FIG. 6.

[0083] The driver can approve the proposal to add the waypoint P1 by dragging (or flicking) the icon B4 displayed at the adjacent position of the icon B1 (see the reference sign B4' indicated by the dotted line in FIG. 7) so as to overlap the icon B1.

[0084] The driver can reject the proposal to add the waypoint P1 by flicking the icon B4 displayed at the adjacent position of the icon B1 (see the reference sign B4' indicated by the dotted line in FIG. 7) to the right display area 13aR side (in other words, the passenger side) (see the black arrow in FIG. 7).

[0085] In this way, the driver can approve or reject the proposal to add the waypoint P1 by performing an intuitive operation of flicking the icon B4 sent from the passenger.

[0086] When the driver performs an approval operation, the waypoint P1 is added to the route RT. Thereby, the route RT is re-searched and re-set. As shown in FIG. 7, the waypoint P1 and the re-set route RT are displayed on the map images of the objects C1 and C4.

[0087] When the driver performs an unauthorized operation, the addition of waypoint P1 is not executed, and objects C1 and C4 return to the state before, for example, a passenger performs the addition operation of waypoint P1.

[0088] FIG. 8 is a flowchart showing the processing executed by the control unit 10 in one embodiment of the present disclosure. For example, in the display screen example of FIG. 3, when any icon B is touched, the execution of the processing shown in FIG. 8 is started.

[0089] Note that each step of the flowchart shown in this embodiment may be reordered within a non - conflicting range. Also, each step of the flowchart shown in this embodiment may be executed concurrently or in parallel within a non - conflicting range. For example, in the present disclosure, although the processing of various steps is presented using an exemplary order, it is not limited to this presented order.

[0090] The control unit 10 expands and displays the sub - icon associated with the touched icon B, as shown in FIG. 4 for example (step S101).

[0091] When the control unit 10 detects an operation on the sub - icon (step S102: YES), it executes processing corresponding to the operation (for example, setting a destination) (step S103), and folds up the expanded - displayed sub - icon (step S105).

[0092] Even when the control unit 10 detects a predetermined cancel operation (step S102: NO, step S104: YES), it folds up the expanded - displayed sub - icon (step S105). The cancel operation is, for example, an operation of touching icon B while the sub - icon is in the expanded - displayed state.

[0093] FIG. 9 is a flowchart showing the processing executed by the control unit 10 in one embodiment of the present disclosure. When the control unit 10 detects the occurrence of an approval-required operation (an example of the first operation), it starts executing the processing shown in FIG. 9. The approval-required operation includes an operation to add a waypoint, the playback order of music on the music application, etc. The operation subject to the approval-required operation may be determined in advance for each application, or may be set by the user. The operation subject to the approval-required operation may be appropriately updated by deep learning, for example.

[0094] In the flowchart of FIG. 9, the case where the driver is the approver (an example of the second user) and the passenger is the approvee (an example of the first user) is explained. The same processing as in the flowchart of FIG. 9 is also performed when the passenger is the approver (an example of the second user) and the driver is the approvee (an example of the first user).

[0095] The control unit 10 suspends the execution of the processing corresponding to the approval-required operation (step S201). This avoids the execution of the processing without the driver's approval.

[0096] The control unit 10 changes the display form of the icon B corresponding to the object on which the approval-required operation has been performed, as shown in FIG. 5, for example (step S202).

[0097] In this way, when an approval-required operation (an example of the first operation) that requires approval by the second user (for example, the driver) occurs for the first object (for example, object C4), the control unit 10 suspends the execution of the processing corresponding to the approval-required operation and changes the display form of the first operator (for example, icon B4), operating as a display form changing unit.

[0098] The control unit 10 waits for a proposal operation (step S203).

[0099] The proposal operation is an example of the second operation. The proposal operation is an operation of sliding (such as flicking or dragging) an operator (for example, icon B4) whose display form has been changed in the first display area (for example, the right display area 13aR) to the side where the second display area (for example, the left display area 13aL) is located.

[0100] When the control unit 10 detects a proposal operation (step S203: YES), it moves the icon B to be operated from the approver side (for example, the right display area 13aR) to the approver side (for example, the left display area 13aL) (step S205). For example, as shown in FIG. 6, when the icon B4 is flicked from the passenger side to the driver side in the right display area 13aR, the flicked icon B4 is displayed at an adjacent position to the icon B1 in the left display area 13aL.

[0101] In this way, when a second operation (for example, an operation of flicking to the second user side who is the approver) is performed on the first operator (for example, icon B4) whose display form has been changed, the control unit 10 operates as an operator display control unit that displays the first operator in the second display area (for example, the left display area 13aL) corresponding to the second user.

[0102] For example, if the map display form is changed due to a proposal operation in a situation where the driver should concentrate on the driving operation (such as during high-speed driving or when turning right or left), it may interfere with the driving operation. Therefore, the control unit 10 determines whether it is a situation where it is difficult for the approver (the second user) to perform an approval operation (the third operation) based on the information about the vehicle (step S206).

[0103] The information about the vehicle is, for example, various information (such as vehicle speed) obtained from the DR sensor 17 and information (such as the distance to the intersection for right or left turn) obtained by the navigation system.

[0104] The control unit 10 does not proceed to the process of step S207 until it is determined that it is not a situation where it is difficult for the approver (the second user) to perform an approval operation (the third operation).

[0105] When it is determined that the situation is not such that it is difficult for the approver (second user) to perform the approval operation (third operation) (step S206: YES), the control unit 10 notifies the approver of the content of the approval-required operation (step S207).

[0106] In the example of FIG. 6, the waypoint P1 is displayed with a star mark on the map image of the object C1. Thereby, it is conveyed to the driver that the operation of adding the point indicated by the star mark as the waypoint P1 has been performed. That is, in the example of FIG. 6, the display of this star mark is the notification of the content of the approval-required operation to the approver. In the example of FIG. 6, the tab TB is also displayed together with the display of the star mark.

[0107] In this way, the control unit 10 operates as an information acquisition unit that acquires information regarding the vehicle (such as vehicle speed).

[0108] Further, the control unit 10 operates as a determination unit that determines whether it is difficult for the approver (second user) to perform the approval operation (an example of the third operation) based on the information regarding the vehicle acquired by the information acquisition unit.

[0109] The control unit 10 operates as a notification unit that notifies the approver (second user) that the approval-required operation (an example of the first operation) has occurred. Incidentally, until it is determined by the determination unit that it is not difficult to perform the approval operation (an example of the third operation), the control unit 10 operating as the notification unit withholds the notification to the approver regarding the occurrence of the approval-required operation (an example of the first operation).

[0110] The control unit 10 waits for the approval operation (step S208).

[0111] The approval operation is an example of a third operation for approving a to-be-approved operation, and is an operation performed on a first operator (for example, icon B4) displayed in a second display area (for example, left display area 13aL). More specifically, the approval operation is an operation of sliding the first operator (for example, icon B4) displayed in the second display area (for example, left display area 13aL) to the side opposite to the side where the first display area (for example, right display area 13aR) is located. In the example of FIG. 7, an operation of dragging (or flicking) the icon B4 displayed at an adjacent position of the icon B1 so as to overlap the icon B1 is the approval operation.

[0112] When the control unit 10 detects an approval operation (step S208: YES), it executes the process held in step S201, that is, the process corresponding to the to-be-approved operation (step S209). In the example of FIG. 7, by executing this process, the waypoint P1 is added to the route RT, and the waypoint P1 and the re-set route RT are displayed on the map images of the objects C1 and C4. Also, in the left display area 13aL, the display of the icon B4 disappears, and in the right display area 13aR, the icon B4 is redisplayed in the form before the to-be-approved operation.

[0113] As described above, when an approval operation (an example of a third operation) for approving a to-be-approved operation (an example of a first operation) is performed on a first operator (for example, icon B4) displayed in a second display area (for example, left display area 13aL), the control unit 10 operates as a process execution unit that executes the held process.

[0114] When the control unit 10 detects a non-approval operation (step S208: NO), it executes a cancellation process for canceling the execution of the process held in step S201, that is, the process corresponding to the to-be-approved operation (step S210). As a result, the addition of the waypoint P1 is not executed, and the objects C1 and C4 return to, for example, the state before the co-rider performs the addition operation of the waypoint P1. Also, in the left display area 13aL, the display of the icon B4 disappears, and in the right display area 13aR, the icon B4 is redisplayed in the form before the to-be-approved operation.

[0115] The non-approval operation is an example of a fourth operation for rejecting an operation requiring approval, and is an operation of sliding a first operator (for example, icon B4) displayed in a second display area (for example, left display area 13aL) to the side where the first display area (for example, right display area 13aR) is located.

[0116] In addition, even when a predetermined cancel operation is performed during the waiting for the proposed operation (step S203: NO, step S204: YES), the control unit 10 executes a cancel process (step S210).

[0117] The above is the description of the exemplary embodiments of the present disclosure. The embodiments of the present disclosure are not limited to those described above, and various modifications are possible within the scope of the technical idea of the present disclosure. For example, the content obtained by appropriately combining the embodiments explicitly exemplified in the specification or obvious embodiments is also included in the embodiments of the present application.

[0118] In the present embodiment, an in-vehicle system has been described as an example. However, the present embodiment can also be applied to an environment where two operators located at both ends of a large screen jointly operate, for example, in office work, a presentation in a conference room, or a game play in a living room.

[0119] In the above, the case where an operation requiring approval occurs for an object in a dedicated area (right display area 13aR, left display area 13aL) has been described. However, the same processing is executed even when an operation requiring approval occurs for an object in a shared area (central display area 13aC) as well as in the dedicated area.

[0120] Using FIG. 10, a case will be described where a passenger performs an approval-required operation on an object C3 in the central display area 13aC. Note that the object C3 is an example of a second object displayed in the central display area 13aC (an example of a third display area) by a control unit 10 operating as a display control unit. The icon B3 corresponding to the object C3 is an example of a second operator displayed in the central display area 13aC (an example of a third display area) by a control unit 10 operating as a display control unit.

[0121] When an approval-required operation occurs for the object C3, the display form of the icon B3 corresponding to the object C3 is changed. When the passenger flicks the icon B3 with the changed display form to the left display area 13aL side (that is, the passenger performs a proposal operation), as shown in FIG. 10, the icon B3 moves from the original display position (refer to the symbol B3' indicated by a dotted line in FIG. 10) into the left display area 13aL.

[0122] When the driver performs an approval operation (an operation of sliding the icon B3 in the direction of the arrow D1), the process corresponding to the approval-required operation that has been held is executed. When the driver performs a non-approval operation (an operation of sliding the icon B3 in the direction of the arrow D2), the execution of the process corresponding to the approval-required operation that has been held is canceled.

[0123] In this way, when an approval-required operation (an example of a fifth operation) that requires approval by a second user (for example, the driver) occurs for a second object (for example, the object C3), the control unit 10 operating as a display form change unit holds the execution of the process corresponding to the approval-required operation and changes the display form of the second operator (for example, the icon B3).

[0124] When a proposal operation (an example of a sixth operation) is performed on the second operator (for example, the icon B3) with the changed display form, the control unit 10 operating as an operator display control unit displays the second operator in the second display area (for example, the left display area 13aL).

[0125] When an approval operation (an example of the seventh operation), which approves an approval-required operation (an example of the fifth operation) on a second operator (for example, icon B3) displayed in the second display area (for example, the left display area 13aL), is performed, the control unit 10 that operates as a process execution unit executes the suspended process.

Explanation of Signs

[0126] 1 : In-vehicle system 2 : Main unit 10 : Control unit 11 : Player 12 : Sound system 13 : Display unit 14 : Operation unit 15 : Storage unit 16 : GNSS receiver 17 : DR sensor

Claims

1. A display control unit that displays a first object and a first operator corresponding to the first object in a first display area corresponding to a first user; When a first operation that requires approval by a second user occurs for the first object, a display form changing unit that suspends execution of processing corresponding to the first operation and changes the display form of the first operator; An operator display control unit that, when a second operation is performed on the first operator whose display form has been changed, displays the first operator in a second display area corresponding to the second user; A processing execution unit that, when a third operation for approving the first operation is performed on the first operator displayed in the second display area, executes the suspended processing. An information processing apparatus comprising: Information processing apparatus.

2. The second operation is an operation of sliding the first operator whose display form has been changed in the first display area toward the side where the second display area is located. The information processing apparatus according to claim 1.

3. The processing execution unit: When the third operation is performed, executes the suspended processing; When a fourth operation is performed, cancels execution of the suspended processing; The third operation is an operation of sliding the first operator displayed in the second display area to the side opposite to the side where the first display area is located; The fourth operation is an operation of sliding the first operator displayed in the second display area toward the side where the first display area is located. The information processing apparatus according to claim 1.

4. Connected to a display device having a screen including the first display area and the second display area; The display device is installed inside a vehicle; Inside the vehicle, a seat row including a first seat located opposite to the first display area and a second seat located opposite to the second display area is installed; The screen is located in front of the seat row and extends in the vehicle width direction of the vehicle. The information processing apparatus according to claim 1.

5. Further comprising a notification unit that notifies the second user that the first operation has occurred. The information processing apparatus according to claim 4.

6. An information acquisition unit that acquires information about the vehicle; A determination unit that determines whether it is difficult for the second user to perform the third operation based on the acquired information. Until it is determined by the determination unit that it is not difficult to perform the third operation, the notification unit holds the notification to the second user about the occurrence of the first operation. The information processing apparatus according to claim 5. **Claim 7** The screen includes a third display area between the first display area and the second display area. The display control unit displays a second object and a second operator corresponding to the second object in the third display area. When a fifth operation that requires approval by the second user occurs for the second object, the display form change unit holds the execution of the process corresponding to the fifth operation and changes the display form of the second operator. When a sixth operation is performed on the second operator whose display form has been changed, the operator display control unit displays the second operator in the second display area. When a seventh operation that approves the fifth operation is performed on the second operator displayed in the second display area, the process execution unit executes the held process. The information processing apparatus according to any one of claims 4 to 6. **Claim 8** A first object and a first operator corresponding to the first object are displayed in a first display area corresponding to a first user. When a first operation that requires approval by a second user occurs for the first object, the execution of the process corresponding to the first operation is held and the display form of the first operator is changed. When a second operation is performed on the first operator whose display form has been changed, the first operator is displayed in a second display area corresponding to the second user. A process of executing the held process when a third operation for approving the first operation is performed on the first operator displayed in the second display area, causing the computer to execute the process. Information processing program.

Images