Information processor and information processing program
The information processing device enhances operability by detecting the operator's position and rearranging screen objects closer to their seating location, addressing reach limitations in large display devices.
Patent Information
- Application Number
- JP2023191334
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-11-09
- Publication Date
- 2025-05-21
AI Technical Summary
Existing display devices with large screens face operability issues as it is difficult for operators to perform touch operations on objects displayed in areas away from their seating position, particularly in vehicles where the driver's reach is limited.
An information processing device that includes a detection unit to identify the operator's position and a display control unit to rearrange objects on the screen closer to the operator, allowing easier access and operation by adjusting the layout based on the detected position.
Improves the operability of touch operations on objects displayed in screen areas that are difficult to reach by rearranging them closer to the operator, enhancing usability and reducing the need for complex finger movements.
Smart Images

Figure 2025078973000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing device and an information processing program. [Background technology]
[0002] Display devices with large screens are now in practical use. For example, Patent Document 1 describes an information processing device that controls the display of this type of display device.
[0003] The information processing device described in Patent Document 1 changes the display range of an image in a screen area that displays the same image as that displayed in an electronic side mirror in response to a touch operation on the screen of a display device installed inside a vehicle cabin. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent Publication No. 2022-11370 Summary of the Invention [Problem to be solved by the invention]
[0005] In Patent Document 1, the screen of the display device is sized to cover almost the entire dashboard. Therefore, for example, it may be difficult for a driver sitting in the driver's seat to touch an object displayed in an area of the screen near the passenger seat because the driver's finger cannot reach the object. Thus, Patent Document 1 has room for improvement in terms of improving the operability of touch operations on objects displayed in a screen area away from the operator.
[0006] In consideration of the above circumstances, an embodiment of the present disclosure aims to provide an information processing device and an information processing program that can improve the operability of touch operations on objects displayed in a screen area away from the operator. [Means for solving the problem]
[0007] An information processing device according to one embodiment of the present disclosure is a device connected to a touch-operable display device, and includes a detection unit that detects the position of an operator relative to the screen of the display device, and a display control unit that rearranges operable objects displayed on the screen so as to be closer to the position of the operator detected by the detection unit, and displays them on the screen. Effect of the Invention
[0008] According to an embodiment of the present disclosure, an information processing device and an information processing program are provided that can improve the operability of a touch operation on an object displayed in a screen area away from an operator. [Brief description of the drawings]
[0009] [Figure 1] 1 is a diagram illustrating a vehicle in which an in-vehicle system according to an embodiment of the present disclosure is installed. [Diagram 2] 1 is a block diagram showing a hardware configuration of an in-vehicle system according to an embodiment of the present disclosure. [Diagram 3] FIG. 2 is a diagram showing an example of a display screen displayed on a screen of a display unit according to an embodiment of the present disclosure. [Figure 4] 4 is a diagram showing an example of a display screen when a touch operation is performed on the screen shown in FIG. 3. FIG. [Diagram 5] 4 is a diagram showing an example of a display screen when a touch operation is performed on the screen shown in FIG. 3. FIG. [Figure 6] 6 is a diagram showing an example of a display screen when a touch operation is performed on the screen shown in FIG. 5. FIG. [Figure 7] FIG. 13 is a diagram showing an example of a display screen when the operator is a passenger. [Figure 8] A flowchart showing a process executed by a control unit included in an in-vehicle system according to an embodiment of the present disclosure. [Figure 9] This is a subroutine of the first main process (step S104) in FIG. 8. [Figure 10]This is a subroutine of the second main process (step S105) in FIG. 8. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] The following description relates to an information processing device and an information processing program according to an embodiment of the present disclosure. Note that common or corresponding elements are denoted by the same or similar reference numerals, and duplicate descriptions will be appropriately simplified or omitted.
[0011] 1 is a diagram illustrating a vehicle A in which an in-vehicle system 1 according to an embodiment of the present disclosure is installed. The vehicle A is an example of a moving body, and is a left-hand drive vehicle. The vehicle A may be a right-hand drive vehicle.
[0012] The in-vehicle system 1 includes, for example, a main unit 2 installed in a dashboard and a display unit 13 connected to the main unit 2. A screen 13a of the display unit 13 has a size that extends from near the right front pillar to near the left front pillar. A reference symbol 13R is attached to the right end of the screen 13a located near the right front pillar. A reference symbol 13L is attached to the left end of the screen 13a located near the left front pillar.
[0013] In this manner, the display unit 13, which is an example of a display device, is installed inside the vehicle A. A row of seats including a driver's seat S1 and a passenger seat S2 (which are an example of a left seat and a right seat arranged in the same row, and also an example of a first seat and a second seat arranged in a first direction) is installed inside the vehicle A. The screen 13a of the display unit 13 is located in front of the row of seats and is formed to extend in the vehicle width direction of the vehicle A.
[0014] It should be noted that any reference to an element using a designation such as "first," "second," etc., used in this disclosure does not generally limit the quantity or order of those elements. These designations are used for convenience to distinguish between two or more elements. Thus, a reference to a first and a second element does not imply, for example, that only two elements are employed, or that the first element must precede the second element.
[0015] 2 is a block diagram showing a hardware configuration of an in-vehicle system 1 according to an embodiment of the present disclosure. The in-vehicle system 1 includes a main unit 2 (an example of an information processing device) connected to a touch-operable display device (display unit 13 in this embodiment). The in-vehicle system 1 is equipped with various functions including, for example, an audio function and a navigation function. The in-vehicle system 1 may be a device forming a part of an IVI (In-Vehicle Infotainment).
[0016] As shown in FIG. 2, the main unit 2 includes a control unit 10, a player 11, a sound system 12, an operation unit 14, a memory unit 15, a GNSS (Global Navigation Satellite System) receiving unit 16, and a DR (Dead Reckoning) sensor 17.
[0017] The main unit 2 may be configured to include only some of the above components (for example, the control unit 10 and the storage unit 15). In this case, other components (such as the player 11) that are not included in the main unit 2 may be configured as units independent of the main unit 2. The main unit 2 may be configured as a single vehicle-mounted device including the display unit 13 in addition to the control unit 10, the player 11, the sound system 12, the operation unit 14, the storage unit 15, the GNSS receiving unit 16, and the DR sensor 17.
[0018] Furthermore, the in-vehicle system 1 may have other configurations that are not shown in Fig. 1. In other words, the in-vehicle system 1 and the main unit 2 have a degree of freedom, and various design changes are possible.
[0019] The player 11 is connected to a sound source. The player 11 reproduces an audio signal input from the sound source and outputs the signal to the control unit 10.
[0020] The sound source is, for example, a disk medium such as a CD (Compact Disc) or SACD (Super Audio CD) that stores digital audio data, a storage medium such as a HDD (Hard Disk Drive) or USB (Universal Serial Bus), a smartphone, a tablet terminal, or a server that performs streaming via a network. When the sound source is streamed or stored in a storage unit 15 described later, the player 11 as separate hardware may be omitted.
[0021] The main unit 2 including the control unit 10 and the storage unit 15 is an example of an information processing device according to an embodiment of the present disclosure, and is an example of a computer that executes the information processing method and information processing program according to the present embodiment.
[0022] The control unit 10 is configured as, for example, a large scale integration (LSI) and includes a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and a digital signal processor (DSP).
[0023] In this manner, the information processing device according to this embodiment is incorporated into the in-vehicle system 1 as the main unit 2 including the control unit 10 and the storage unit 15.
[0024] The control unit 10 executes various programs deployed in a work area of the RAM, thereby controlling the operation of the in-vehicle system 1.
[0025] The control unit 10 is, for example, a single processor or a multi-processor, and includes at least one processor. When the control unit 10 includes multiple processors, the control unit 10 may be packaged as a single device, or may be configured as multiple devices that are physically separated within the in-vehicle system 1.
[0026] The control unit 10 processes a digital audio signal input from a player 11 or a storage unit 15 and outputs the processed signal to a sound system 12 .
[0027] The sound system 12 includes a D / A converter, an amplifier, etc. Digital audio signals are converted into analog signals by the D / A converter. These analog signals are amplified by the amplifier and output to each speaker installed in the vehicle cabin. As a result, for example, music recorded on a sound source is reproduced from each speaker in the vehicle cabin.
[0028] The display unit 13 is a device that displays various screens, and includes, for example, a display configured with an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display. The display is equipped with a touch panel.
[0029] A user (operator) can perform various touch operations on the display (screen 13a), such as touch on (touching screen 13a with a finger), touch off (removing a finger from screen 13a), flick (moving a finger across screen 13a), swipe (slide), drag, and drop.
[0030] The control unit 10 detects the coordinates on the screen 13a that are touched, and executes a process associated with the detected coordinates.
[0031] That is, the display unit 13 is an example of a touch-operable display device. Additionally, the control unit 10 is connected to the display unit 13, which is an example of a display device.
[0032] The operation unit 14 includes mechanical operators such as mechanical, capacitive non-contact, and membrane switches, buttons, knobs, and wheels. In addition, the display unit 13 equipped with a touch panel display constitutes a part of the operation unit 14. A GUI on which touch-operable operators are arranged is displayed on a screen 13a of the display unit 13.
[0033] An operator can operate the in-vehicle system 1 via mechanical controls or controls on a GUI (Graphical User Interface).
[0034] The storage unit 15 is, for example, an auxiliary storage device such as a hard disk drive (HDD) or a solid state drive (SSD) or a flash memory. The storage unit 15 stores various programs such as an information processing program for executing the information processing method according to the present embodiment, and various data such as map data for navigation. When the player 11 is omitted, sound source data is also stored in the storage unit 15.
[0035] The GNSS receiver 16 measures the current position of the vehicle based on GNSS signals received from multiple GNSS satellites. The GNSS receiver 16 measures the current position at a predetermined time interval (e.g., every second) and outputs the measurement result to the control unit 10. A representative example of the GNSS is the Global Positioning System (GPS).
[0036] The control unit 10 renders the map data stored in the memory unit 15 to display the map on the screen 13a of the display unit 13, and also acquires the current position measured by the GNSS receiving unit 16 and superimposes a mark indicating the vehicle's position onto the acquired current position, which is the position on the road on the map displayed on the screen 13a of the display unit 13 (map matching).
[0037] The DR sensor 17 includes various sensors such as a gyro sensor that measures the angular velocity of the vehicle in relation to its orientation in a horizontal plane, and a vehicle speed sensor that detects the rotational speeds of the left and right drive wheels of the vehicle.
[0038] The control unit 10 can also estimate the current position from the information acquired by the DR sensor 17. The control unit 10 may compare both the current position acquired by the GNSS receiving unit 16 and the current position estimated based on the information acquired by the DR sensor 17, and then determine the final current position.
[0039] 3 shows an example of a display screen displayed on the screen 13a of the display unit 13. For example, some of a plurality of objects arranged in a virtual space are displayed on the screen 13a. The virtual space is a two-dimensional virtual space or a three-dimensional virtual space.
[0040] 3, of the object group, objects C3 to C5 are displayed. The object group includes n objects C1 to Cn (n is a natural number). For convenience, some objects that are not displayed on screen 13a are indicated by dashed lines.
[0041] For example, when the control unit 10 detects a flick operation, the control unit 10 updates the area in the virtual space displayed on the screen 13a in response to the detected flick operation, thereby causing the object to be scrolled and displayed on the screen 13a.
[0042] For example, when a flick operation is continued in the left direction of the screen, the screen scrolling stops at the position where the rightmost object Cn is displayed. Also, when a flick operation is continued in the right direction of the screen, the screen scrolling stops at the position where the leftmost object C1 is displayed. Also, the screen scrolling may be cyclical without stopping. For example, when a flick operation is performed in the right direction of the screen in a state where objects C1 to C3 are displayed in order from the left of the screen, the screen 13a scrolls and objects Cn, C1, and C2 are displayed in order from the left of the screen. For example, when a flick operation is performed in the left direction of the screen in a state where objects Cn, C(n-1), and C(n-2) are displayed in order from the right of the screen, the screen 13a scrolls and objects C1, Cn, and C(n-1) are displayed in order from the right of the screen.
[0043] An object is a display object on the screen 13a that symbolizes the type of application or information processed by the application, and has a variable shape and size. Examples include widgets, icons, thumbnail images, pop-ups, lists, and information display windows. A widget is a display object that includes interface components of a GUI (Graphical User Interface), and is used to display the results of processing by an application corresponding to the widget, or to lay out a reception section for receiving instructions to process with the application. An object may be called by another name, such as content.
[0044] The objects include, for example, objects that display information related to the navigation function, objects that display an aerial image of the vehicle when parking, objects for operating the audio functions installed in the in-vehicle system 1, objects for selecting radio stations, objects for adjusting the temperature and airflow of the air conditioner installed in the vehicle, and objects for displaying and setting various information related to the vehicle (e.g., speedometer, tachometer).
[0045] 3, icons B1 to B3 are displayed near the left edge 13L of the screen 13a (in other words, near the driver's seat S1). Icons B1 to B3 are also displayed near the right edge 13R of the screen 13a (in other words, near the passenger seat S2).
[0046] Icons B1 to B3 are operators associated with commands that have some effect on objects. For example, when icon B1 for searching restaurants is dragged and dropped onto the map displayed in route guidance object C5, the coordinate position of the restaurant on the map is highlighted. When the operator touches the highlighted coordinate position, the corresponding restaurant is set as the destination.
[0047] The icons B1 to B3 near the left end 13L are located near the driver's seat S1 and are difficult to reach from the passenger seat S2. Therefore, the icons B1 to B3 near the left end 13L can be said to be controls for an operator (hereinafter referred to as "driver") seated in the driver's seat S1. The icons B1 to B3 near the right end 13R are located near the passenger seat S2 and are difficult to reach from the driver's seat S1. Therefore, the icons B1 to B3 near the right end 13R can be said to be controls for an operator (hereinafter referred to as "passenger") seated in the passenger seat S2. For convenience, the icons B1 to B3 near the left end 13L are referred to as "driver's icons B1 to B3". The icons B1 to B3 near the right end 13R are referred to as "passenger's icons B1 to B3".
[0048] In the example of FIG. 3, object C5 is located toward the right end 13R of the screen 13a. Therefore, it is difficult for the driver's fingers to reach object C5. It is not easy for the driver to operate object C5. When the vehicle body vibrates while the vehicle is running or when object C5 requires precise operation, the difficulty of operation increases further.
[0049] Therefore, for example, it is conceivable that the driver performs a flick operation to move the object C5 toward the left end 13L, and then operates the object C5. In this case, the driver needs to perform an appropriate flick operation so that the object C5 moves to a position that is easy for the driver to operate. However, in a situation such as while driving, it is desirable to keep the time that the driver gazes at the screen 13a short. Therefore, it is desirable to provide a user interface that does not require such a flick operation.
[0050] Figures 4 and 5 show examples of the display screen when a touch operation is performed on screen 13a shown in Figure 3. The hand shown in each of the figures showing the display screen examples, including Figure 4, shows the manner in which the operator touches screen 13a. Also, the white arrow shown by the dashed line shows the movement of the operator's finger performing a drag operation on screen 13a.
[0051] In the example of Figure 4, the driver's icon B1 for searching restaurants is displayed inside the border BL LThe image shows how the mouse cursor has been dragged beyond the boundary line BL. L is located in a position that is easily reachable from the driver's seat S1 and is slightly to the left of the center of the screen 13a.
[0052] Driver icon B1 border BL L When the object is dragged beyond the border BL, the objects that were displayed side by side on the screen are split into two parts, as shown in Figure 5. L In other words, the objects including object C5 that were displayed in a position that was difficult for the finger to reach are now displayed in a position that is easy for the finger to reach (here, the boundary line BL L In order to display multiple objects side-by-side in the vertical direction of the screen, each object is displayed smaller than it was before the drag operation (see Figure 3, for example).
[0053] By shrinking each object, more objects can be displayed in a limited space.
[0054] 5, when the driver drags the driver's icon B1 to the upper or lower end of the screen and holds his / her finger there, the objects are scrolled while the driver holds his / her finger there. This allows the driver to display on the screen 13a an object (e.g., object C2 or object C6) that was located outside the area of the screen 13a in the virtual space.
[0055] Fig. 6 shows an example of a display screen when a touch operation is performed on the screen 13a shown in Fig. 5. As shown in Fig. 6, when the driver further drags the driver's icon B1 onto the object C5, the object C5 is enlarged and displayed relative to the other objects. For convenience, in Fig. 6, the object C5 before being enlarged is shown by a dashed line and is denoted by the reference character C5'.
[0056] Illustratively, object C5 returns to the size it had before the drag operation (see FIG. 3, for example). Other objects are displayed in a reduced size at the same time as object C5 is enlarged in order to secure the display space for object C5 after the enlargement.
[0057] When the driver's icon B1 is dragged out of the enlarged object C5, each object returns to its original size (see FIG. 5, for example). When the driver's icon B1 is dragged onto, for example, object C4, object C4 is now enlarged and the remaining objects are reduced.
[0058] That is, the object at the dragged position of the driver's icon B1 is displayed enlarged relative to the other objects.
[0059] By enlarging and displaying the object at the drag position, the operability of this object is improved.
[0060] When the driver's icon B1 is dropped on the object C5, the coordinate position of the restaurant in the map displayed on the object C5 is highlighted. When the driver touches the highlighted coordinate position, the restaurant is set as the destination.
[0061] 3, object C3 is located toward the left edge 13L of the screen 13a. Therefore, it is difficult for a passenger sitting in the passenger seat S2 to reach object C3. It is not easy for the passenger to operate object C3.
[0062] Fig. 7 is a diagram similar to Fig. 6, and shows an example of a display screen in the case where the operator is a passenger. In the example of Fig. 7, the passenger icon B2 is located on the boundary line BL R The objects that were dragged beyond the border BL R The images are rearranged vertically on the screen near the border line BL and displayed on the screen 13a. Ris located in a position that is easily reachable from the passenger seat S2 and is slightly to the right of the center of the screen 13a.
[0063] In this way, the objects including object C3, which was displayed in a position that was difficult for the finger to reach, are now displayed in a position that is easy to reach (here, the boundary line BL R The location will be relocated to the location nearest to the
[0064] As shown in Fig. 7, when the passenger further drags the passenger icon B1 onto the object C3, the object C3 is enlarged and displayed relative to the other objects, similar to the example of Fig. 6. Note that, for convenience, in Fig. 7, the object C3 before being enlarged is indicated by a dashed line and is denoted by the reference character C3'.
[0065] In this manner, in this embodiment, the object displayed on the screen 13a is rearranged and displayed at a position closer to the operator (driver or passenger). Therefore, the operator can easily operate the object that was displayed in a screen area that is difficult to reach with the fingers.
[0066] Fig. 8 is a flowchart showing a process executed by the control unit 10 in one embodiment of the present disclosure. For example, when the in-vehicle system 1 is started, execution of the process shown in Fig. 8 is started. When the in-vehicle system 1 is shut down, the process shown in Fig. 8 is ended.
[0067] It should be noted that the order of the steps in the flowcharts shown in the present embodiment may be changed as long as there is no inconsistency. Also, the steps in the flowcharts shown in the present embodiment may be executed in parallel or in parallel as long as there is no inconsistency. For example, although the present disclosure presents the processing of various steps using an exemplary order, the present disclosure is not limited to the order presented.
[0068] The control unit 10 detects a user who uses an object (step S101).
[0069] For example, the control unit 10 displays a list of users. Information on the users included in the list is registered in advance by, for example, a user who gets into the vehicle A. The control unit 10 detects a user selected by a touch operation from the list.
[0070] The control unit 10 displays an object corresponding to the user detected in step S101 on the screen 13a (step S102).
[0071] For example, the control unit 10 stores objects used by the user in association with the user. The control unit 10 determines the objects associated with the user detected in step S101 as objects to be displayed on the screen 13a. The control unit 10 displays these objects on the screen 13a, and also displays the driver icons B1 to B3 and the passenger icons B1 to B3 near the left end 13L and the right end 13R, respectively. As a result, for example, the screen shown in FIG. 3 is displayed.
[0072] In this way, the control unit 10 operates as a setting unit that sets a user of an object from among a plurality of candidates (e.g., users listed in a list), and also operates as a determination unit that determines an object to be displayed on the screen 13a according to the set user. The control unit 10 operates as a display control unit that displays the object determined by the determination unit on the screen 13a.
[0073] The positions and timings for displaying the icons B1 to B3 are not limited to those described above. For example, when the control unit 10 detects a long press operation (i.e., an operation of touching the screen 13a without moving a finger for a predetermined time or more), the control unit 10 may display the icons B1 to B3 at the position where the icon B1 to B3 is being pressed and held.
[0074] The object associated with the user is, for example, an object that is frequently used by the user. The control unit 10 performs, for example, deep learning to associate the user with the object.
[0075] The control unit 10 detects the position of the operator who touches the screen 13a (step S103). Note that this operator is not necessarily the same as the user detected in step S101.
[0076] For example, when any of the driver icons B1 to B3 is touched, the control unit 10 detects that the operator is located in the driver's seat S1. When any of the passenger icons B1 to B3 is touched, the control unit 10 detects that the operator is located in the passenger seat S2.
[0077] The control unit 10 may detect the position of the operator who touches the screen 13a by using a DMS (Driver Monitoring System).
[0078] In this way, the control unit 10 operates as a detection unit that detects the position of the operator relative to the screen 13a (an example of a screen of a display device). More specifically, the control unit 10 operating as a detection unit detects whether the operator is located in the driver's seat S1 (an example of a left seat) or in the passenger seat S2 (an example of a right seat). From another perspective, the control unit 10 operating as a detection unit detects whether the operator is located near the left edge 13L of the screen 13a (an example of a first edge of the screen) or near the right edge 13R (an example of a second edge opposite the first edge).
[0079] When the operator is in the driver's seat S1 (i.e., the driver) (step S103: driver's seat S1), the control unit 10 executes a first main process (step S104). When the operator is in the passenger's seat S2 (i.e., the passenger) (step S103: passenger's seat S2), the control unit 10 executes a second main process (step S105).
[0080] FIG. 9 shows a subroutine of the first main process (step S104).
[0081] As shown in FIG. 9, the control unit 10 L is set (step S104a).
[0082] In this way, the control unit 10 divides the area in the screen 13a into a first area closer to the operator (here, the boundary line BL L A region to the left of the driver (region closer to the driver) and a second region away from the operator (region BL L A boundary line that divides the vehicle into a region closer to the passenger and a region closer to the operator (here, a boundary line BL L ) acts as a boundary setter.
[0083] The control unit 10 determines whether the touched driver's icon is on the border line BL L It is determined whether the drag has been made to a position beyond the position (step S104b).
[0084] Driver icons with border BL L When the object is dragged beyond the boundary line BL (step S104b: YES), the control unit 10 moves the objects displayed side by side on the screen to a position beyond the boundary line BL as shown in FIG. L The images are then rearranged so that they are lined up vertically on the screen in the vicinity and displayed on the screen 13a (step S104c).
[0085] In this way, the control unit 10 operates as a display control unit that rearranges the operable objects displayed on the screen 13a so as to be closer to the position of the operator detected by the detection unit, and displays them on the screen 13a. In addition, when the control unit 10 operating as a display control unit detects that the operator is located closer to the left end 13L of the screen 13a (an example of closer to the first end of the screen), the control unit 10 rearranges the objects closer to the left end 13L and displays them on the screen 13a. Furthermore, when the control unit 10 operating as a display control unit detects that the operator is located in the driver's seat S1 (an example of a left seat), the control unit 10 rearranges the objects closer to the driver's seat S1 and displays them on the screen 13a.
[0086] More specifically, the control unit 10 converts the arrangement of the objects in the virtual space from the horizontal direction of the screen to the vertical direction of the screen. LAt a position a certain distance away from the boundary line BL L The control unit 10 reduces the size of each object and displays it on the screen 13a so that the objects that were displayed side by side in the horizontal direction of the screen can also be displayed in the vertical direction of the screen.
[0087] That is, the control unit 10 operating as a display control unit detects the boundary line BL L When a drag operation across the boundary line BL (an example of a drag operation from the first area to the second area) is detected, the object is moved to the boundary line BL L In more detail, the control unit 10, which operates as a display control unit, rearranges the plurality of objects on the screen 13a so as to be located near the boundary line BL L In the vicinity, the line is aligned in a specified order (specifically, the boundary line BL L At a position a certain distance away from the boundary line BL L ) and displayed on screen 13a.
[0088] In this state, when the driver's icon is dragged to the upper end of the screen, the control unit 10 scrolls the objects arranged vertically on the screen upward while the dragging finger remains in that position. Also, when the driver's icon is dragged to the lower end of the screen, the control unit 10 scrolls the objects arranged vertically on the screen downward while the dragging finger remains in that position.
[0089] The driver icon has a border BL L If the icon is dropped without being dragged beyond the position, the control unit 10 ends the first main process (step S104). If the drop position at this time is on an object (for example, on object C3), the control unit 10 executes a process for the object according to the driver's icon.
[0090] The control unit 10 determines whether or not the driver's icon has been dragged onto any of the objects aligned vertically on the screen (step S104d).
[0091] When the driver's icon is dragged onto any object (step S104d: YES), the control unit 10 displays the object at the dragged position in an enlarged scale and displays the other objects in a reduced scale, as shown in FIG. 6, for example (step S104e).
[0092] When the driver icon is dropped without being dragged onto any object, the control unit 10 ends the first main process (step S104) and returns to the screen display of, for example, FIG.
[0093] The control unit 10 determines whether or not the driver's icon has been dropped onto the enlarged and displayed object (step S104f).
[0094] When the driver's icon is dropped onto the enlarged object (step S104f: YES), the control unit 10 executes a process for the object according to the driver's icon (step S104g).
[0095] When the user operation requested for the object on which the driver icon is dropped is completed, the control unit 10 ends the first main process (step S104) and returns to the screen display of, for example, Fig. 3. Note that, if the process executed for the object is resizing the object, the control unit 10 displays the object in the resized size.
[0096] Fig. 10 shows a subroutine of the second main process (step S105). As shown in Fig. 10, the second main process (step S105) is basically the same process as the first main process (step S104).
[0097] In the second main process (step S105), since the operator is a passenger, in step S105a, the control unit 10 detects the boundary line BL R Set.
[0098] Passenger icons are bordered with BL R When the object is dragged beyond the boundary line BL (step S105b: YES), the control unit 10 moves the object that was displayed side by side in the horizontal direction of the screen to the boundary line BL R The images are then rearranged so that they are lined up vertically on the screen in the vicinity and displayed on the screen 13a (step S105c).
[0099] In this way, when the control unit 10 operating as a display control unit detects that the operator is located near the right edge 13R of the screen 13a (an example of a position near the second edge of the screen), the control unit 10 rearranges the object closer to the right edge 13R and displays it on the screen 13a. Also, when the control unit 10 operating as a display control unit detects that the operator is located in the passenger seat S2 (an example of a seat on the right side), the control unit 10 rearranges the object closer to the passenger seat S2 and displays it on the screen 13a.
[0100] When the passenger icon is dragged onto any object (step S105d: YES), the control unit 10 displays the object at the dragged position in an enlarged scale and displays the other objects in a reduced scale, for example, as shown in FIG. 7 (step S105e).
[0101] When the passenger icon is dropped on the enlarged object (step S105f: YES), the control unit 10 executes a process for the object according to the driver icon (step S105g).
[0102] In this manner, in this embodiment, the object displayed on the screen 13a is rearranged and displayed at a position closer to the operator (driver or passenger). Therefore, the operator can easily operate the object that was displayed in a screen area that is difficult to reach with the fingers.
[0103] The above is a description of exemplary embodiments of the present disclosure. The embodiments of the present disclosure are not limited to those described above, and various modifications are possible within the scope of the technical idea of the present disclosure. For example, the embodiments of the present application also include appropriate combinations of embodiments, etc., which are exemplified in the specification, or obvious embodiments, etc.
[0104] In the above embodiment, the objects are rearranged and displayed so as to be aligned vertically on the screen closer to the operator, but the manner in which the objects are rearranged is not limited to this. For example, the objects may be rearranged and displayed so as to be aligned in a circular shape closer to the operator.
[0105] In the above embodiment, when an icon is dropped, the object is displayed enlarged on the spot, but the manner in which the object is displayed enlarged is not limited to this. When an icon is dropped, the object may be moved to the center of the screen, for example, and displayed enlarged in the center of the screen. [Explanation of symbols]
[0106] 1: In-vehicle systems 2: Main unit 10: Control section 11: Player 12: Sound System 13: Display section 14:Operation section 15: Storage section 16: GNSS receiver 17:DR sensor
Claims
1. An information processing device connected to a touch-operable display device, A detection unit that detects a position of an operator with respect to a screen of the display device; a display control unit that rearranges an operable object displayed on the screen so as to be closer to a position of the operator detected by the detection unit, and displays the object on the screen. Information processing device.
2. the detection unit detects whether the operator is located near a first edge of the screen or near a second edge opposite to the first edge, The display control unit is when it is detected that the operator is located near a first edge of the screen, repositioning the object closer to the first edge and displaying the object on the screen; when it is detected that the operator is located near a second edge of the screen, the object is repositioned closer to the second edge and displayed on the screen; The information processing device according to claim 1 .
3. The display device is installed in a vehicle, A row of seats including a left seat and a right seat arranged in the same row is provided in the vehicle, The screen is located in front of the seat row and is formed to extend in a vehicle width direction of the vehicle, The detection unit detects whether the operator is located in the left seat or the right seat, The display control unit is when it is detected that the operator is located in the left seat, relocating the object closer to the left seat and displaying the object on the screen; when it is detected that the operator is located in the right seat, repositioning the object closer to the right seat and displaying it on the screen; The information processing device according to claim 1 .
4. a setting unit for setting a user of the object from among a plurality of candidates; a determination unit that determines the object to be displayed on the screen according to the set user, The display control unit displays the object determined by the determination unit on the screen. The information processing device according to claim 1 .
5. a boundary setting unit that sets a boundary line that divides an area in the screen into a first area closer to the operator and a second area farther from the operator, the boundary line being located closer to the operator; The display control unit is when detecting a drag operation from the first area to the second area, rearrange the object near the border and display it on the screen; The information processing device according to claim 1 .
6. the display control unit rearranges the plurality of objects so as to be aligned in a predetermined row near the boundary line and displays the objects on the screen. The information processing device according to claim 5 .
7. the display control unit displays the object selected by the touch operation in an enlarged manner relative to the other objects.
7. The information processing device according to claim 5 or 6.
8. An information processing program executed by a computer connected to a touch-operable display device, Detecting a position of an operator relative to a screen of the display device; causing the computer to execute a process of repositioning an operable object displayed on the screen so as to be closer to the detected position of the operator and displaying the object on the screen; Information processing program.
Citation Information
Patent Citations
Vehicular display device
JP2022011370A