In-vehicle system and information processing device

Abstract

The vehicle-mounted system includes a display device (20) and an information processing device. The display device (20) is provided in the front of the driver's seat and includes a pair of display units. The pair of display units are positioned on both sides of the steering wheel (4) and protrude toward the rear of the vehicle from the instrument unit positioned in front of the steering wheel (4), and also have a touch panel (25). The information processing device includes a control unit (100) configured to output a command to the display device (20) to display the screen on which the driver inputs information on either of the pair of display units according to the driver's dominant hand when the driver inputs information on the touch panel (25).

Description

Technology Field

[0001] The present disclosure provides a vehicle-mounted system and an information processing device. Background Technology

[0002] It is known that a display unit has a main display unit for displaying vehicle information and a display unit including an operation button display unit provided adjacent to the main display unit for displaying operation buttons, and that the arrangement of the operation button display unit is changed (for example, see Japanese Patent Publication No. 2015-080994).

[0003] The present disclosure improves the operability of a plurality of displays.

[0004] A vehicle-mounted system according to one aspect of the present disclosure includes a display device, a terminal for a driver of a vehicle, and an information processing device configured to output information through the display device.

[0005] The above display device is provided in the front part of the driver's seat in the vehicle cabin and includes a pair of display units.

[0006] The above pair of display units are positioned on both sides of the steering wheel and protrude toward the rear of the vehicle more than the instrument unit positioned in front of the steering wheel, and also have touch panels.

[0007] The above information processing device comprises a control unit and a memory unit, and

[0008] The above control unit is,

[0009] Acquire information regarding the driver from the terminal of the driver, and

[0010] Identifying the driver's primary hand based on the information regarding the driver and the information regarding the driver's primary hand stored in the memory unit, and

[0011] When the driver inputs information on the touch panel, outputting a command to the display device to display the screen on which the driver inputs information on one of the pair of display units according to the driver's dominant hand.

[0012] It is configured to run.

[0013] A vehicle-mounted system according to one aspect of the present disclosure includes a display device and an information processing device configured to output information through the display device.

[0014] The above display device is provided in the front part of the driver's seat in the vehicle cabin and includes a pair of display units.

[0015] The above pair of display units are positioned on both sides of the steering wheel and protrude toward the rear of the vehicle more than the instrument unit positioned in front of the steering wheel, and also have touch panels.

[0016] The above information processing device is equipped with a control unit.

[0017] The above control unit outputs a command to the display device to display the screen on which the driver inputs information on one of the pair of display units according to the driver's dominant hand when the driver inputs information on the touch panel.

[0018] It is configured to run.

[0019] In the vehicle-mounted system described above, the pair of display parts may be positioned on the vehicle's front side, rather than the gripping part of the steering wheel, in the front-rear direction of the vehicle.

[0020] In the vehicle-mounted system described above, the information processing device may be provided with a memory unit configured to store information regarding the driver's primary hand. The control unit may be configured to acquire information regarding the driver from the driver's terminal and to identify the driver's primary hand from the information regarding the driver and the information regarding the driver's primary hand stored in the memory unit.

[0021] In the above-described vehicle-mounted system, the information processing device may be provided with a memory unit configured to store information regarding the driver's primary hand. The control unit may be configured to acquire information regarding the driver from the driver's utterance and to identify the driver's primary hand from the information regarding the driver and the information regarding the driver's primary hand stored in the memory unit.

[0022] In the above-described vehicle-mounted system, the screen on which the driver inputs information may be a map screen.

[0023] In the above-described vehicle-mounted system, the screen on which the driver inputs information may be a screen for inputting text.

[0024] An information processing device according to one aspect of the present disclosure has a display device and is configured to output information through the display device.

[0025] The above display device is,

[0026] It is provided in the front part of the driver's seat within the cabin and includes a pair of display units.

[0027] The above pair of display units are positioned on both sides of the steering wheel and protrude toward the rear of the vehicle more than the instrument unit positioned in front of the steering wheel, and also have touch panels.

[0028] The above information processing device is equipped with a control unit.

[0029] The above control unit outputs a command to the display device to display the screen on which the driver inputs information on one of the pair of display units according to the driver's dominant hand when the driver inputs information on the touch panel.

[0030] It is configured to run.

[0031] In the above information processing device, the pair of display parts may be positioned on the vehicle's front side, rather than the gripping part of the steering wheel, in the front-rear direction of the vehicle.

[0032] The above information processing device may include a memory unit configured to store information regarding the driver's primary hand. The control unit may be configured to acquire information regarding the driver from the driver's terminal and to identify the driver's primary hand from the information regarding the driver and the information regarding the driver's primary hand stored in the memory unit.

[0033] The above information processing device may include a memory unit configured to store information regarding the driver's primary hand. The control unit may be configured to acquire information regarding the driver from the driver's utterance and to identify the driver's primary hand from the information regarding the driver and the information regarding the driver's primary hand stored in the memory unit.

[0034] In the information processing device described above, the screen on which the driver inputs information may be a screen relating to a map.

[0035] In the above information processing device, the screen on which the driver inputs information may be a screen for inputting characters.

[0036] Additionally, another aspect of the present disclosure is a vehicle equipped with the vehicle-mounted system described above, an information processing method executed by the information processing device described above, a program for executing the information processing method on a computer, or a computer-readable storage medium that non-temporarily stores the program.

[0037] According to the present disclosure, the operability of a plurality of displays can be improved. Brief explanation of the drawing

[0038] The features, advantages, and technical and industrial significance of exemplary embodiments of the present invention are described below with reference to the attached drawings, in which similar symbols denote similar elements. Figure 1 is a drawing showing the interior of a vehicle cabin. Figure 2 is an enlarged view of the area around the steering wheel. FIG. 3 is a schematic diagram illustrating an example of the hardware configuration of a vehicle and a user terminal of the vehicle. Figure 4 is a diagram illustrating the functional configuration of an ECU. Figure 5 is a diagram illustrating an example of user information. Figure 6 is a diagram illustrating a screen for registering the hand that the user primarily uses. Figure 7 is a diagram illustrating a screen for inputting a destination displayed on an outer display. Figure 8 is a diagram illustrating the screen when entering a destination using a keyboard. Figure 9 is a diagram illustrating the screen when a destination is entered via flick. FIG. 10 is a flowchart of a process for displaying a navigation screen according to a first embodiment. FIG. 11 is a flowchart showing the flow of the process for registering the primarily used hand according to the first embodiment. FIG. 12 is a flowchart showing the flow of another process for registering the primarily used hand according to the first embodiment. Specific details for implementing the invention

[0039] One can envision equipping a vehicle with a touch panel and providing various services based on the user's touch. In this scenario, inputting text or drawing shapes can be considered. However, if the touch panel is positioned on the side opposite to the user's dominant hand, it becomes difficult for the user to input text or other elements.

[0040] A system that is one aspect of the present disclosure comprises a display device and an information processing device that outputs information through the display device, wherein the display device comprises a pair of display units that are positioned on both sides of the steering wheel and protrude toward the rear of the vehicle from an instrument unit positioned in front of the steering wheel, and also have touch panels.

[0041] The display device has a pair of display units positioned on both sides of the steering wheel. Additionally, the pair of display units is configured to be touch-operable via a touch panel. Preferably, the pair of display units are positioned in a location that protrudes toward the rear of the vehicle—that is, a location closer to the driver—than the instrument panel (typically a meter panel where the speedometer is placed) positioned in front of the steering wheel in the front-rear direction of the vehicle. By providing the pair of display units in this position, it becomes possible to place the touch panel near the part of the steering wheel that is gripped by the driver. In other words, it becomes possible to minimize the time the driver takes their hands off the steering wheel during operation. Furthermore, the steering wheel does not necessarily have to be circular, provided that it has a gripping portion and performs steering operations by rotating it.

[0042] A pair of display units presents information to the user, for example, information related to the control of the vehicle or information related to the convenience of the vehicle's occupants. Information related to the convenience of the vehicle's occupants may include information for providing entertainment to the vehicle's occupants or information related to the comfort of the occupants. Information regarding the comfort or convenience of the occupants includes, for example, interfaces for operating audio, navigation, air conditioner, telephone, clock, or voice assistant, or information regarding the operating status of such devices. Additionally, information related to the control of the vehicle may include information regarding the driving of the vehicle. Information related to the control of the vehicle includes, for example, interfaces for operating headlights, wipers, side mirrors, ADAS (Advanced Driver Assistance System), drive mode, ride height, steering wheel position, or seat position, or information regarding the operating status of such devices.

[0043] Here, the information processing device comprises a control unit configured to output a command to the display device to display a screen on which the driver inputs information, according to the driver's dominant hand, when the driver inputs information on the touch panel. In this way, the control unit displays a screen for inputting information on a screen positioned according to the driver's dominant hand. As a result, since the user can input information with their dominant hand, it becomes easier for the user to input information.

[0044] Hereinafter, embodiments of the present disclosure are described based on the drawings. The configurations of the following embodiments are examples, and the present disclosure is not limited to the configurations of the embodiments. Furthermore, the following embodiments may be combined as much as possible.

[0045] First embodiment

[0046] FIG. 1 is a drawing illustrating the interior of a vehicle (1). As illustrated, a driver's seat (2) and a passenger seat (3) are provided in the interior of the vehicle (1). Furthermore, the vehicle (1) of the present embodiment is a right-hand drive vehicle, and the driver's seat (2) is provided on the right side of the vehicle. A steering wheel (4) is positioned in front of the driver's seat (2). Additionally, the steering wheel (4) may be circular, or, as illustrated, may be U-shaped (so-called irregular steering wheel). The steering wheel (4) is connected to the steering device of the vehicle (1) through a steering column. The steering column is covered by a column cover.

[0047] The passenger seat (3) is provided to the left of the driver's seat (2), and a center display (24) is positioned on the front side of the vehicle at a midpoint between the driver's seat (2) and the passenger seat (3). The center display (24) displays, for example, auxiliary information such as car navigation, or content related to entertainment such as audio or television.

[0048] A meter display (21) is provided on the front side of the vehicle of the steering wheel (4). The meter display (21) is a full-screen type display located in front of the driver's seat (2) and provides various information to the driver of the vehicle (1). The meter display (21) displays information necessary for driving the vehicle, such as, for example, the vehicle speed (vehicle speed), engine rotational speed (if the vehicle (1) has an engine), charge / discharge status (if the vehicle (1) has a driving battery), and driving distance. The meter display (21) is an example of a "instrument unit" in the present disclosure.

[0049] A pair of display devices (27) are provided in the front part of the driver's seat (2) inside the vehicle. The pair of display devices (27) each include a touch panel display positioned on both sides of the steering wheel (4). In this embodiment, the display (22) positioned close to the inside of the vehicle is referred to as the inner display (22), and the display (23) positioned near the outside of the vehicle is referred to as the outer display (23). The inner display (22) and the outer display (23) are connected to the instrument panel of the vehicle (1).

[0050] With reference to FIG. 2, the detailed structure of the inner display (22) and the outer display (23) will be described. FIG. 2 is an enlarged view of the area around the steering wheel (4). The inner display (22) and the outer display (23) are vertically elongated displays and are connected to a support member (5) that supports each display. The support member (5) has a shape that protrudes in the left and right directions of the steering wheel. In the support member (5), the outer display (23) is connected to the right end facing the front of the vehicle, and the inner display (22) is connected to the left end facing the front of the vehicle. By doing so, a display surface can be positioned near the gripping part of the steering wheel (4).

[0051] Additionally, the above description is an example where the vehicle (1) is a right-hand drive vehicle, and if the vehicle (1) is a left-hand drive vehicle, the left and right sides are reversed. That is, in the support member (5), the outer display (23) is connected to the left end facing the front of the vehicle, and the inner display (22) is connected to the right end facing the front of the vehicle.

[0052] The support member (5) may also serve as a column cover that covers the steering column. The support member (5) extends in the left and right directions (vehicle width direction) from the part through which the steering column passes, and each extends toward the rear of the vehicle, and is also shaped to bend and curve so that the angle of the steering wheel (4) in the left and right directions becomes smaller.

[0053] Additionally, the inner display (22) and the outer display (23) are positioned at an angle with respect to the left and right directions of the steering wheel, so that each is tilted toward the steering wheel. That is, the inner display (22) is positioned to protrude from the rear of the vehicle (1) to the inner side of the vehicle (1), and the outer display (23) is positioned to protrude from the rear of the vehicle (1) to the outer side of the vehicle (1). In this way, the inner display (22) and the outer display (23) are positioned so that each faces the driver.

[0054] The area (4R) indicated by the dashed line in FIG. 2 is the part (grip part) where the steering wheel (4) is gripped by the right hand, and the area (4L) indicated by the dashed line in FIG. 2 is the part (grip part) where the steering wheel (4) is gripped by the left hand. The inner display (22) and the outer display (23) are positioned on the front side of the vehicle rather than the grip part of the steering wheel (4) in the front-rear direction of the vehicle (1). By making the support part (5) have the shape described above, the position of the inner display (22) and the outer display (23) in the front-rear direction of the vehicle can be brought closer by the grip part of the steering wheel (4). Therefore, the amount of hand movement can be reduced when the driver performs touch operations on the inner display (22) or the outer display (23) while driving.

[0055] The meter display (21), inner display (22), and outer display (23) are all displays having touch panels. Additionally, the touch panel only needs to have at least the inner display (22) and the outer display (23). The touch panel may employ, for example, a pressure-sensitive type that detects pressure when a user presses the panel, and a capacitive type that detects a change in capacitance when a user presses the panel. The display is, for example, an LCD (Liquid Crystal Display) or an EL (Electroluminescence) panel.

[0056] The inner display (22) displays information regarding the convenience of the occupant of the vehicle (1), for example. Information regarding the convenience of the occupant of the vehicle (1) includes information for providing entertainment to the occupant of the vehicle (1). Information regarding the convenience of the occupant of the vehicle (1) may include information regarding the comfort of the occupant, etc. Information regarding the comfort or convenience of the occupant includes, for example, information regarding switches, buttons, etc. for operating audio, navigation devices, air conditioners, telephones, clocks, AI partners (voice assistants), etc., and information regarding the operating status of these devices.

[0057] The outer display (23) displays information regarding the control of the vehicle (1), for example. The information regarding the control of the vehicle (1) includes information regarding the driving of the vehicle (1). The information regarding the control of the vehicle (1) includes information regarding switches, buttons, etc. for operating power windows, headlights, wipers, side mirrors, ADAS, drive modes, suspensions, steering wheel positions, and seat positions, for example, and information regarding the operating status of these devices. By displaying information regarding the control of the vehicle (1) on the outer display (23), it is possible to prevent a passenger other than the driver from operating the information regarding the control of the vehicle (1).

[0058] Additionally, the information displayed on the inner display (22) and the outer display (23) is not limited to the above. The inner display (22) may display information regarding the control of the vehicle (1), and the outer display (23) may display information regarding the convenience of the occupants of the vehicle (1). Furthermore, the information displayed on the inner display (22) and the outer display (23) may be arbitrarily determined. Additionally, information regarding the indicator displayed on the meter display (21) is displayed on the inner display (22) or the outer display (23), as described below.

[0059] FIG. 3 is a schematic diagram illustrating an example of the hardware configuration of a vehicle (1) and a user terminal (40) of the vehicle (1). The user terminal (40) is a terminal carried by the driver of the vehicle (1). The vehicle (1) has an ECU (10), a display device (20), a center display (24), a sensor group (31), an electrical equipment group (32), a communication module (33), a microphone (34), and a speaker (35). The ECU (10) can be configured as a computer having a processor (CPU, GPU, etc.), a main memory (RAM, ROM, etc.), and an auxiliary memory (EPROM, hard disk drive, removable media, etc.). An operating system (OS), various programs, various tables, etc. are stored in the auxiliary memory, and by executing the programs stored therein, various functions (software modules) that meet a predetermined purpose, as described below, can be realized. However, some or all of the functions may be realized as hardware modules by hardware circuits such as ASICs or FPGAs. A display device (20), a center display (24), a sensor group (31), an electrical equipment group (32), a communication module (33), a microphone (34), and a speaker (35) are connected to the ECU (10). The ECU (10) is an example of an information processing device.

[0060] The display device (20) has a meter display (21), an inner display (22), an outer display (23), and a touch panel (25). The touch panel (25) is a unit for detecting touch operations performed on the meter display (21), the inner display (22), and the outer display (23). A touch panel (25) is disposed on each of the meter display (21), the inner display (22), and the outer display (23), and is made capable of operation by touch.

[0061] The sensor group (31) is a set of multiple sensors for acquiring sensor data used in driving the vehicle (1). The sensors may acquire physical quantities or acquire image data, etc. The sensor group (31) includes, for example, a sensor that detects the state of the vehicle (1) and a sensor that detects the operation of the driver. The sensor group (31) includes, for example, a speed sensor, an acceleration sensor, an accelerator opening sensor that detects the position of the accelerator pedal, a brake sensor that detects the position of the brake pedal, a steering angle sensor that detects the angle of the steering wheel, an engine rotational speed sensor that detects the rotational speed of the engine, a water temperature sensor that detects the temperature of the engine's coolant, an oil temperature sensor that detects the temperature of the engine's oil, a hydraulic pressure sensor that detects the engine's oil pressure, a sensor that detects the intake pressure of the engine, a yaw rate sensor, a turn signal switch sensor (a sensor that detects the state of the turn signal switch), a shift position sensor, a sensor that detects position information (GPS sensor), a sensor that detects the temperature inside the vehicle, a sensor that detects the temperature outside the vehicle, and a radar that measures the distance to an object.

[0062] The electrical equipment group (32) is a set of electrical equipment used in the vehicle (1). The electrical equipment group (32) may include power windows, air conditioners, suspension, massage seats, navigation devices, audio devices, telephones, wipers, headlights, side mirrors, and voice assistants.

[0063] The communication module (33) is a means for performing short-range wireless communication between the vehicle (1) and the user terminal (40). The microphone (34) is a means for acquiring the user's speech and converting the voice into an electrical signal. The speaker (35) is a device that converts the electrical signal received from the control unit (100) into sound. Additionally, the microphone (34) and the speaker (35) may be placed on any of the meter display (21), the inner display (22), or the outer display (23).

[0064] The user terminal (40) is a terminal used by the driver (user) of the vehicle (1), and is, for example, a smartphone, tablet terminal, wearable terminal, or PC (Personal Computer). As another example, the user terminal (40) may be an electronic key of a smart key system. For example, application software capable of changing the settings of the vehicle (1) is installed on the user terminal (40). The user terminal (40) is equipped with a control unit (41), a memory unit (42), and a communication module (43). The control unit (41) of the user terminal (40) can be realized by a hardware processor, for example, a CPU. In addition, the control unit (41) may be configured to include RAM, ROM (Read Only Memory), cache memory, etc. The memory unit (42) is configured by a storage medium such as RAM, a magnetic disk, or flash memory as a means of storing information. A program executed by the control unit (41) and data used by said program are stored in the memory unit (42). The communication module (43) of the user terminal (40) has the same configuration as the communication module (33) of the vehicle (1). Additionally, the communication module (33) of the vehicle (1) and the communication module (43) of the user terminal (40) may include a wireless communication interface for short-range wireless communication, such as Bluetooth (registered trademark). Furthermore, the vehicle (1) and the user terminal (40) may be configured so that the vehicle (1) and the user terminal (40) can communicate in a short-range wireless manner. A user ID capable of identifying a user is stored in the memory unit (42) of the user terminal (40), and when short-range wireless communication is performed between the vehicle (1) and the user terminal (40), the user ID is transmitted from the user terminal (40) to the vehicle (1).

[0065] FIG. 4 is a diagram illustrating the functional configuration of an ECU (10). The ECU (10) is a functional component and comprises a control unit (100) and a memory unit (110). The control unit (100) is a functional component provided by, for example, a processor executing various programs stored in an auxiliary memory unit. The memory unit (110) is a means for storing information and is configured to include a main memory unit and an auxiliary memory unit. User information (111) is stored in the memory unit (110).

[0066] FIG. 5 is a diagram showing an example of user information (111). User information (111) is information indicating the user's primary hand and is information regarding the primary hand associated with the user ID. Additionally, the user ID may be associated with, for example, an electronic key corresponding to a smart key or the user's mobile terminal (e.g., a smartphone), or may be associated with the user's voice. As another example, the control unit (100) may identify the user ID by, for example, analyzing the user's face captured by a camera. Information regarding the user's primary hand is registered by the user in advance through the touch panel (25). Regarding the information regarding the primary hand, if the user's primary hand is the right hand, "Right" is stored in the user information (111), and if the user's primary hand is the left hand, "Left" is stored in the user information (111).

[0067] FIG. 6 is a diagram illustrating a screen (50) for registering the hand that a user primarily uses. This registration screen (50) is displayed when a user touches a GUI (Graphical User Interface) component for moving to the screen for registering the hand primarily used, which is displayed on an inner display (22) or an outer display (23). At this time, the control unit (100) transmits a command to the display device (20) to display a GUI component (501) for registering the user as a right-handed person and a GUI component (502) for registering the user as a left-handed person on the registration screen (50). Then, the control unit (100) determines which GUI component has been touched based on a touch signal received from the touch panel (25), and stores it in the memory unit (110) as user information (111) associated with a user ID.

[0068] Here, the control unit (100) provides a conversation service by a virtual agent (AI partner) capable of conversing in natural language. The control unit (100) displays a character of the virtual agent on, for example, an inner display (22) or an outer display (23), and allows a user to set a destination by conversing with said character. When the control unit (100) obtains a destination from the user through this conversation, it searches for a route from the current location of the vehicle (1) to the destination and executes route guidance. Since this navigation screen corresponds to information regarding passenger convenience, it is displayed on the inner display (22).

[0069] The control unit (100) can display a map on a pair of display devices (27) in a conversational service and set a location that the user touches or circles on the map as a destination. Here, since navigation is a service related to user convenience, it is usually displayed on the inner display (22). That is, the map is displayed to the left of the user. At this time, if the user is right-handed, the user handles the map with the hand opposite to the hand they primarily use. Therefore, it becomes difficult to perform fine work.

[0070] Therefore, in the present embodiment, the control unit (100) displays a screen requiring input by a user on the display positioned on the side of the user's main hand among the inner display (22) and the outer display (23). Information regarding the screen requiring input by a user is stored in the memory unit (110).

[0071] FIG. 7 is a diagram illustrating a screen (51) for inputting a destination displayed on an outer display (23). Additionally, the following description assumes that the user's primary hand is the right hand. A map (511) is displayed, and when the user draws a circle (512) on the map (511), the control unit (100) searches for a landmark located inside the circle (512) and sets it as a destination. The control unit (100) identifies the location on the map touched by the user from the touch signal received from the touch panel (25) and the map information stored in the memory unit (110). Additionally, if multiple landmarks exist, the name or description corresponding to each landmark may be displayed on the map (511), and the landmark touched by the user may be set as the destination. As another example, the control unit (100) may set the area near the center of the circle (512) as the destination. Similarly, when the user touches the map, you can set the location touched by the user as the destination, or you can search for the landmark closest to the location touched by the user and set it as the destination.

[0072] The control unit (100) may display a map (511) for inputting a destination on the outer display (23) when there is a predetermined input to the microphone (34). The predetermined input is a request regarding setting a destination, such as, for example, "to decide a destination" or "there is a place I want to go." The utterance corresponding to this predetermined input is stored in the memory unit (110).

[0073] In addition, when a user operates GUI components such as a keyboard, the GUI components are displayed on the display of the user's dominant hand. FIG. 8 is a diagram illustrating a screen (52) when a destination is entered on a keyboard. The keyboard is a GUI component (521), and the control unit (100) transmits a command to the display device (20) so that it is displayed on the display of the dominant hand (in FIG. 8, the outer display (23)). The control unit (100) identifies the character entered by the user according to the touch signal.

[0074] Additionally, FIG. 9 is a diagram illustrating a screen (53) when a destination is input via flick. A control unit (100) transmits a command to a display device (20) so that a flick-inputtable GUI component (531) is displayed on the display of the hand that is primarily used (in FIG. 9, the outer display (23)). The control unit (100) identifies the character entered by the user according to the touch signal. Furthermore, in addition, when the user performs manual input, for example, a screen for performing manual input is displayed on the display of the user's primary hand. For example, in cases where the user does not know how to read Chinese characters and cannot set a destination via voice input, the destination can be set by performing manual input. In this case, an algorithm for identifying a character according to the touch signal is stored in the memory unit (110), and the control unit (100) can set a destination according to the identified character.

[0075] FIG. 10 is a flowchart of a process for displaying a navigation screen according to a first embodiment. The process shown in FIG. 10 is executed repeatedly at predetermined intervals in the ECU (10).

[0076] In step S101, the control unit (100) acquires a speech. The control unit (100) acquires the speech of a user input into the microphone (34). When the processing of step S101 is completed, the processing proceeds to step S102.

[0077] In step S102, the control unit (100) determines whether a predetermined utterance has been detected. The predetermined utterance is an utterance by which a user inputs a destination using a touch panel (25). The control unit (100) determines that a predetermined utterance has been detected if the user's utterance includes a predetermined keyword stored in the memory unit (110). The keyword may be, for example, "I want to input a destination" or "I want to select a destination from the screen." At this time, the control unit (100) may make a determination based on known language recognition technology. Additionally, the control unit (100) may determine whether there was an input containing the predetermined keyword when the user conversed with a virtual agent (AI partner) capable of conversing in natural language. If the control unit (100) makes a positive determination in step S102, the processing proceeds to step S103, and if it makes a negative determination, this routine is terminated.

[0078] In step S103, the control unit (100) identifies a user ID. For example, the control unit (100) may obtain information regarding the user ID from the user terminal (40) by performing short-range wireless communication with the user terminal (40). As another example, the control unit (100) may obtain information regarding the user ID associated with an electronic key. As yet another example, the control unit (100) may obtain information regarding the user ID by voice recognition based on the user's speech. At this time, the control unit (100) may identify the user ID by, for example, obtaining acoustic feature quantities from the user's speech and comparing them with acoustic feature quantities for each user ID stored in the memory unit (110). At this time, the control unit (100) may, for example, use the Mel-Frequency Cepstrum Coefficient (MFCC). Additionally, the user ID may be identified by biometric authentication or facial authentication. For example, it may be configured to enable fingerprint authentication when a user touches the inner display (22) or the outer display (23). When the processing of step S103 is completed, the processing proceeds to step S104.

[0079] In step S104, the control unit (100) identifies the user's dominant hand. The control unit (100) identifies the user's dominant hand from the user information (111) according to the user ID specified in step S103. At this time, the control unit (100) identifies, for example, that the user's dominant hand is the right hand. When the processing of step S104 is completed, the processing proceeds to step S105.

[0080] In step S105, the control unit (100) specifies a display corresponding to the dominant hand specified in step S104. At this time, the control unit (100) specifies that if the user is left-handed, the display corresponding to the dominant hand is the inner display (22), and if the user is right-handed, the display corresponding to the dominant hand is the outer display (23). Additionally, in the case of a left-hand drive vehicle, the control unit (100) specifies that if the user is left-handed, the display corresponding to the dominant hand is the outer display (23), and if the user is right-handed, the display corresponding to the dominant hand is the inner display (22). When the processing of step S105 is completed, the processing proceeds to step S106.

[0081] In step S106, the control unit (100) transmits a command to the display device (20) to display a screen (51) for inputting a destination as illustrated in FIG. 7 on a specific display in step S105. The screen (51) for inputting a destination may be, for example, a screen displaying a map of a predetermined range including the current location detected by a GPS sensor included in the sensor group (31). In addition, as another example, a screen may be displayed that allows a user to input a map on the touch panel (25). In this case, the control unit (100) may be configured to search for a map based on the user's input. When the processing of step S106 is completed, the processing proceeds to step S107.

[0082] In step S107, the control unit (100) identifies the location touched by the user based on the touch signal from the touch panel (25). The control unit (100) identifies which location on the map the user has touched based on the touch signal. The map displayed on the outer display (23) is stored in the memory unit (110). Additionally, if the user indicates a range with a circle (512) on the map (511), the control unit (100) identifies that range. When the processing of step S107 is completed, the processing proceeds to step S108.

[0083] In step S108, the control unit (100) specifies a destination. The control unit (100) may specify a location on the map (511) touched by the user as the destination. As another example, the control unit (100) may specify a landmark closest to the touch location as the destination. Information regarding landmarks is stored in the memory unit (110). Additionally, if the user indicates a range with a circle (512), the landmark included in that range is specified. In this case, if multiple landmarks are included, the control unit (100) may list the searched multiple landmarks on the outer display (23) and have the user select a landmark. Then, the landmark selected by the user may be specified according to the touch signal from the touch panel (25). When the processing of step S108 is completed, the processing proceeds to step S109.

[0084] In step S109, the control unit (100) performs a route search to a specific landmark in step S108. The control unit (100) performs a route search based on the current location specified by the signal from the GPS sensor and a specific destination. At this time, the control unit (100) searches for a route based on the logic stored in the memory unit (110). In addition, the map information used at this time is stored in the memory unit (110). When the processing of step S109 is completed, the processing proceeds to step S110.

[0085] In step S110, the control unit (100) outputs a command to the display device (20) to display the searched route, vehicle location, and map on the inner display (22). The navigation screen is displayed on the inner display (22) as usual.

[0086] Additionally, FIG. 11 is a flowchart showing the flow of the process for registering the primary hand according to the first embodiment. The process shown in FIG. 11 is executed in the ECU (10) by triggering when a user touches a GUI component for moving to the screen for registering the primary hand displayed on the inner display (22) or the outer display (23).

[0087] In step S201, the control unit (100) identifies the user terminal (40). The control unit (100) identifies the user terminal (40) by performing short-range wireless communication with the user terminal (40). At this time, since the user ID stored in the memory unit (42) of the user terminal (40) is transmitted from the user terminal (40) to the vehicle (1), the control unit (100) obtains the user ID from the user terminal (40). When the processing of step S201 is completed, the processing proceeds to step S202.

[0088] In step S202, the control unit (100) determines whether information regarding the hand primarily used corresponding to the user ID exists in the user information (111). The control unit (100) makes a negative determination if the acquired user ID is not stored in the user information (111), or if information regarding the hand primarily used corresponding to the acquired user ID does not exist. If the control unit (100) makes a negative determination in step S202, the processing proceeds to step S203, and if it makes a positive determination, this routine terminates.

[0089] In step S203, the control unit (100) outputs a command to the display device (20) to display the registration screen (50) of the main hand as illustrated in FIG. 6. When the processing of step S203 is completed, the processing proceeds to step S204.

[0090] In step S204, the control unit (100) identifies the location touched by the user on the registration screen (50) of the hand primarily used, based on the touch signal from the touch panel (25). When the processing of step S204 is completed, the processing proceeds to step S205.

[0091] In step S205, the control unit (100) identifies the user's dominant hand based on the location touched by the user and the location of the GUI component placed on the registration screen (50) for the dominant hand. The control unit (100) identifies the user's dominant hand by identifying which GUI component was touched among the GUI component (501) for registering the user as a right-handed person and the GUI component (502) for registering the user as a left-handed person. When the processing of step S205 is completed, the processing proceeds to step S206.

[0092] In step S206, the control unit (100) stores the user's primary hand in the memory unit (110) as user information (111). At this time, the control unit (100) stores information regarding the primary hand associated with a specific user ID in step S201 in the memory unit (110).

[0093] FIG. 12 is a flowchart showing the flow of another process for registering the main hand used in the first embodiment. The process shown in FIG. 12 is executed in the ECU (10) by detecting the user's utterance as a trigger.

[0094] In step S301, the control unit (100) obtains the user's speech from the microphone (34). When the processing of step S301 is completed, the processing proceeds to step S302.

[0095] In step S302, the control unit (100) identifies a user ID. The control unit (100) identifies the user ID by, for example, obtaining acoustic feature quantities from a user's utterance and comparing them with acoustic feature quantities for each user ID stored in the memory unit (110). Additionally, in step S302, the control unit (100) may obtain a user ID from a user terminal (40) or an electronic key in the same manner as the processing in step S201 above. Furthermore, if there is no user ID corresponding to the utterance, the control unit (100) may issue a new user ID. When the processing of step S302 is completed, the processing proceeds to step S303.

[0096] In step S303, the control unit (100) determines whether information regarding the hand primarily used corresponding to the user ID exists in the user information (111). The control unit (100) makes a negative determination if the acquired user ID is not stored in the user information (111), or if information regarding the hand primarily used corresponding to the acquired user ID does not exist. If the control unit (100) makes a negative determination in step S303, the processing proceeds to step S304, and if it makes a positive determination, this routine terminates.

[0097] In step S304, the control unit (100) outputs a command to emit a voice from the speaker (35) asking the user for their dominant hand. At this time, the control unit (100) outputs a command to emit a voice from the speaker (35), for example, "Please tell me which hand you use," or "Is your dominant hand your right hand or your left hand?" When the processing of step S304 is completed, the processing proceeds to step S305.

[0098] In step S305, the control unit (100) acquires the user's speech through the microphone (34). When the processing of step S305 is completed, the processing proceeds to step S306.

[0099] In step S306, the control unit (100) identifies the dominant hand using known language recognition technology from the user's utterance obtained in step S305. When the processing of step S306 is completed, the processing proceeds to step S307.

[0100] In step S307, the control unit (100) stores the user's primary hand in the memory unit (110) as user information (111). At this time, the control unit (100) stores information regarding the primary hand in the memory unit (110) in association with the user ID specified or issued in step S302.

[0101] As described above, according to the present embodiment, when a user needs to input on the screen, the screen is output so that input is possible on a display placed on the side of the dominant hand. This makes it easier for the user to input on the screen.

[0102] Other embodiments

[0103] The above embodiments are merely examples, and the present disclosure may be implemented with appropriate modifications within the scope of not departing from the gist thereof. The processing or means described in the present disclosure may be freely combined and implemented as long as no technical contradictions arise. Furthermore, processing described as being performed by a single device may be distributed and executed by multiple devices. Alternatively, processing described as being performed by different devices may be executed by a single device. In a computer system, the hardware configuration by which each function is realized can be flexibly changed.

[0104] In the above embodiment, text input when setting a destination on a map was described, but not limited to maps, when a user inputs text or shapes, the control unit (100) may output a command to display a screen for inputting text or shapes on the display of the hand side that is primarily used.

[0105] The present disclosure can also be realized by supplying a computer program having the functions described in the above embodiments to a computer, and by having one or more processors of the computer read and execute the program. Such a computer program may be provided to the computer via a non-transient computer-readable storage medium that can be connected to the system bus of the computer, or may be provided to the computer via a network. A non-transient computer-readable storage medium includes, for example, any type of disk such as a magnetic disk (floppy disk, hard disk drive (HDD), etc.), an optical disk (CD-ROM, DVD disk, Blu-ray disk, etc.), read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic card, flash memory, optical card, and any type of medium suitable for storing electronic instructions.

Claims

Claim 1 In a vehicle-mounted system, the system comprises a display device (20), a terminal of a driver of a vehicle (1), and an information processing device configured to output information through the display device (20). The display device (20) is provided in the front of the driver's seat (2) in the vehicle cabin and includes a pair of display units. The pair of display units are positioned on both sides of the steering wheel (4) and protrude toward the rear of the vehicle more than the instrument unit positioned in front of the steering wheel (4), and also have a touch panel (25). The information processing device comprises a control unit (100) and a memory unit (110). The control unit (100) acquires information regarding the driver from the terminal of the driver, and identifies the driver's primary hand based on the information regarding the driver and information regarding the driver's primary hand stored in the memory unit (110). When the driver inputs information to the touch panel (25), the screen on which the driver inputs information is configured according to the driver's primary hand. A vehicle-mounted system configured to execute a command to be displayed on one of the pair of display units, output to the display device (20). Claim 2 A vehicle-mounted system comprises a display device (20) and an information processing device configured to output information through the display device (20). The display device (20) is provided in the front of the driver's seat in the vehicle cabin and includes a pair of display units. The pair of display units are positioned on both sides of the steering wheel (4) and protrude toward the rear of the vehicle from the instrument unit positioned in front of the steering wheel (4), and also have a touch panel (25). The information processing device is provided with a control unit (100). The control unit (100) is configured to output a command to the display device (20) to display the screen on which the driver inputs information on the touch panel (25) according to the driver's primary hand. Claim 3 In paragraph 2, the pair of display parts are positioned on the vehicle's front side rather than the gripping part of the steering wheel (4) in the vehicle's front-rear direction. Claim 4 In paragraph 2, the information processing device comprises a memory unit (110) configured to store information regarding the driver's primary hand, and the control unit (100) acquires information regarding the driver from the driver's terminal, and is configured to identify the driver's primary hand from the information regarding the driver and the information regarding the driver's primary hand stored in the memory unit (110), in a vehicle-mounted system. Claim 5 In paragraph 2, the information processing device comprises a memory unit (110) configured to store information regarding the driver's primary hand, and the control unit (100) is configured to acquire information regarding the driver from the driver's speech, and to identify the driver's primary hand from the information regarding the driver and the information regarding the driver's primary hand stored in the memory unit (110), in a vehicle-mounted system. Claim 6 In paragraph 2, the screen on which the driver inputs information is a screen relating to a map, a vehicle-mounted system. Claim 7 In paragraph 2, the screen on which the driver inputs information is a screen for inputting characters, a vehicle-mounted system. Claim 8 In an information processing device, a display device (20) is provided, and the information processing device is configured to output information through the display device (20). The display device (20) is provided in the front part of the driver's seat in the vehicle cabin and includes a pair of display units. The pair of display units are positioned on both sides of the steering wheel (4) and protrude toward the rear of the vehicle from the instrument unit positioned in front of the steering wheel (4), and also have a touch panel (25). The information processing device is provided with a control unit (100), and the control unit (100) is configured to execute a command to output to the display device (20) a command to display the screen on which the driver inputs information on the touch panel (25) according to the driver's main hand. Claim 9 In claim 8, the above pair of display parts is an information processing device positioned on the front side of the vehicle rather than the gripping part of the steering wheel (4) in the front-rear direction of the vehicle (1). Claim 10 In claim 8, the information processing device comprises a memory unit (110) configured to store information regarding the driver's primary hand, and the control unit (100) is configured to acquire information regarding the driver from the driver's terminal and to identify the driver's primary hand from the information regarding the driver and the information regarding the driver's primary hand stored in the memory unit (110). Claim 11 In claim 8, the information processing device comprises a memory unit (110) configured to store information regarding the driver's primary hand, and the control unit (100) acquires information regarding the driver from the driver's speech, and is configured to identify the driver's primary hand from the information regarding the driver and the information regarding the driver's primary hand stored in the memory unit (110). Claim 12 In paragraph 8, the screen on which the driver inputs information is an information processing device, which is a screen relating to a map. Claim 13 In paragraph 8, the screen on which the driver inputs information is an information processing device that is a screen for inputting characters.

Images