Information processing device, information processing method, and program

Abstract

The present technology pertains to an information processing device, an information processing method, and a program capable of improving operability of a vehicle. The information processing apparatus includes: a function setting unit that sets a function to be executed by an operation unit based on a setting condition based on at least one of a state of a vehicle and a state of an occupant of the vehicle; and a display control unit that controls display on the operation unit of function information relating to the function set to the operation unit. The present technology can be applied to a vehicle, for example.

Description

Technical Field

[0001] The present technology relates to an information processing device, an information processing method, and a program, and particularly to an information processing device, an information processing method, and a program capable of improving the operability of a vehicle. Background Art

[0002] In the related art, it has been proposed to enable setting of the content of operation of an operation unit in front of a driver's seat of a vehicle and to display the content of operation at a position overlapping the operation unit on a display panel (see, for example, PTL 1).

[0003] [Citation List]

[0004] [Patent Document]

[0005] [PTL 1]

[0006] JP 2022-78862A Summary of the invention

[0007] [Technical issues]

[0008] However, in the invention described in PTL 1, regardless of the state of the vehicle or the state of the occupant, the content of the operation of the operation unit is not changed from the preset content.

[0009] The present technology has been conceived in view of the above circumstances, in order to improve the operability of the vehicle.

[0010] [Solution to the problem]

[0011] According to one aspect of the present technology, an information processing device includes: a function setting unit, which sets a function to be performed by an operating unit based on a setting condition, and the setting condition is based on at least one of a state of a vehicle and a state of an occupant of the vehicle; and a display control unit, which controls the display of function information related to the function set for the operating unit on the operating unit.

[0012] According to one aspect of the present technology, an information processing method includes: setting a function to be performed by an operating unit based on a set condition, the set condition being based on at least one of a state of a vehicle and a state of an occupant of the vehicle; and controlling the display of function information related to the function set for the operating unit on the operating unit.

[0013] According to one aspect of the present technology, a program causes a computer to perform the following processing: setting a function to be performed by an operating unit based on a set condition, the set condition being based on at least one of a state of a vehicle and a state of an occupant of the vehicle; and controlling the display of function information related to the function set for the operating unit on the operating unit.

[0014] According to one aspect of the present technology, a function to be performed by an operating unit is set based on a set condition based on at least one of a state of a vehicle and a state of an occupant of the vehicle; and display of function information related to the function set for the operating unit on the operating unit is controlled. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a block diagram illustrating an example configuration of a vehicle control system.

[0016] Figure 2 is a diagram illustrating an example of a sensing area.

[0017] Figure 3 is a block diagram illustrating an example configuration of an operating system.

[0018] Figure 4 is a schematic diagram illustrating an example arrangement of a steering switch.

[0019] Figure 5 Schematic diagrams each illustrating an example configuration of a steering switch are depicted.

[0020] Figure 6 Schematic diagrams each illustrating an example configuration of a steering switch are depicted.

[0021] Figure 7 This is a flowchart for explaining the steering switch control process.

[0022] Figure 8 A diagram illustrating an example arrangement of steering switches for functionality in a parking state is depicted.

[0023] Fig. 9 is a diagram illustrating an example arrangement of the functions of a steering switch during manual driving.

[0024] Fig.10 A diagram illustrating an example arrangement of steering switches for functionality during autonomous driving is depicted.

[0025] Fig.11 A diagram illustrating an example arrangement of the functions of variable operation switches in a parking state or during automatic driving is depicted.

[0026] Fig.12 is a diagram illustrating an example arrangement of functions of a variable operation switch during manual driving.

[0027] Fig.13 is a block diagram illustrating an example configuration of a computer. DETAILED DESCRIPTION

[0028] Hereinafter, a mode for implementing the present technology will be described. The description will be provided in the following order.

[0029] 1. Example Configuration of Vehicle Control System

[0030] 2. Example

[0031] 3. Example Variation

[0032] 4. Others

[0033] 《1. Example configuration of vehicle control system》

[0034] Figure 1 is a block diagram illustrating an example configuration of a vehicle control system 11 which is an example of a mobile device control system to which the present technology is applied.

[0035] The vehicle control system 11 is provided in the vehicle 1 , and executes processing related to travel assistance and automatic driving of the vehicle 1 .

[0036] The vehicle control system 11 includes a vehicle control ECU (electronic control unit) 21, a communication unit 22, a map information accumulation unit 23, a position information acquisition unit 24, an external identification sensor 25, an on-board sensor 26, a vehicle sensor 27, a storage unit 28, a driving assistance / automatic driving control unit 29, a DMS (driver monitoring system) 30, an HMI (human-machine interface) 31 and a vehicle control unit 32.

[0037] The vehicle control ECU 21, the communication unit 22, the map information accumulation unit 23, the position information acquisition unit 24, the external recognition sensor 25, the vehicle sensor 26, the vehicle sensor 27, the storage unit 28, the driving assistance / automatic driving control unit 29, the driver monitoring system (DMS) 30, the human-machine interface (HMI) 31, and the vehicle control unit 32 are connected to each other via a communication network 41 so as to be able to communicate with each other. The communication network 41 is formed, for example, by an on-vehicle communication network, a bus, or the like that complies with a digital two-way communication standard such as CAN (Controller Area Network), LIN (Local Interconnect Network), LAN (Local Area Network), FlexRay (registered trademark), or Ethernet (registered trademark). Different types of communication networks 41 can be used depending on the type of data to be transmitted. For example, CAN can be applied to data related to vehicle control, while Ethernet can be applied to large-volume data. Note that the various parts of the vehicle control system 11 can be directly connected to each other without the intervention of the communication network 41 using wireless communication designed for relatively short-distance communication such as, for example, NFC (Near Field Communication) or Bluetooth (registered trademark).

[0038] Note that, hereinafter, in the case where the parts of the vehicle control system 11 communicate with each other via the communication network 41, the description of the communication network 41 will be omitted. For example, in the case where the vehicle control ECU 21 and the communication unit 22 communicate with each other via the communication network 41, a simple description will be used below: the vehicle control ECU 21 and the communication unit 22 communicate with each other.

[0039] The vehicle control ECU 21 includes, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or any of various other types of processors. The vehicle control ECU 21 controls all or some of the functions of the vehicle control system 11.

[0040] The communication unit 22 communicates with various devices inside or outside the vehicle, another vehicle, a server, a base station, etc., and performs transmission and reception of various types of data. At this time, the communication unit 22 can perform communication through a variety of communication methods.

[0041] The following will generally describe the communications that the communication unit 22 is able to perform with entities outside the vehicle. For example, the communication unit 22 performs communications with a server (hereinafter referred to as an external server) present on an external network or the like through a wireless communication method such as 5G (fifth generation mobile communication system), LTE (Long Term Evolution) or DSRC (Dedicated Short Range Communication) through a base station or an access point. Examples of external networks with which the communication unit 22 communicates include the Internet, cloud networks, and networks specific to business entities. The communication method used by the communication unit 22 to communicate with such an external network is not limited to a specific method, as long as the communication method is a wireless communication method that allows digital two-way communication at a predetermined transmission speed or higher and over a predetermined length or longer distance.

[0042] In addition, for example, the communication unit 22 is capable of communicating with a terminal present in the vicinity of the vehicle by using a P2P (peer-to-peer) technology. Examples of terminals present in the vicinity of the vehicle include a terminal attached to a movable body moving at a relatively low speed such as a pedestrian or a bicycle, a fixed terminal installed in a store or the like, or an MTC (machine type communication) terminal. In addition, the communication unit 22 is also capable of performing V2X communication. V2X communication refers to communication between the vehicle and another entity, such as, for example, vehicle-to-vehicle communication performed with another vehicle, vehicle-to-infrastructure communication performed with a roadside unit or the like, vehicle-to-home communication performed with a home, or vehicle-to-pedestrian communication performed with a terminal carried by a pedestrian, etc.

[0043] The communication unit 22 is capable of receiving, for example, a program (over the air) for updating software that controls the operation of the vehicle control system 11 from an external entity. The communication unit 22 is also capable of receiving map information, traffic information, information related to the surrounding environment of the vehicle 1, and the like from an external entity. In addition, for example, the communication unit 22 is capable of sending information related to the vehicle 1, information related to the surrounding environment of the vehicle 1, and the like to an external entity. Examples of the information related to the vehicle 1 that the communication unit 22 sends to the external entity include data indicating the state of the vehicle 1, a recognition result obtained by the recognition unit 73, and the like. In addition, for example, the communication unit 22 performs communication for a vehicle emergency call system such as an emergency call (eCall).

[0044] For example, the communication unit 22 receives electromagnetic waves transmitted by a road traffic information communication system (VICS (Vehicle Information and Communication System) (registered trademark)) such as a radio wave beacon, an optical beacon, or an FM multiplex broadcast.

[0045] The following will generally describe the communication that the communication unit 22 can perform with the entity inside the vehicle. The communication unit 22 can communicate with various devices inside the vehicle by using, for example, wireless communication. For example, the communication unit 22 can perform wireless communication with the device inside the vehicle by using a communication method that allows digital two-way communication at a predetermined transmission speed or higher transmission speed using wireless communication such as wireless LAN, Bluetooth, NFC or WUSB (Wireless USB). Without being limited to this, the communication unit 22 can also communicate with various devices inside the vehicle by using wired communication. For example, the communication unit 22 can communicate with various devices inside the vehicle by using wired communication via a cable connected to a connection terminal not depicted. For example, the communication unit 22 can communicate with various devices inside the vehicle by using a communication method that allows digital two-way communication at a predetermined transmission speed or higher transmission speed using wired communication such as USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface) (registered trademark) or MHL (Mobile High Definition Link).

[0046] Here, the in-vehicle device refers to, for example, a device in the vehicle that is not connected to the communication network 41. Examples of in-vehicle devices that can be expected include mobile devices or wearable devices carried by passengers such as the driver, and information devices brought into the vehicle and temporarily installed in the vehicle.

[0047] The map information accumulation unit 23 accumulates one or both of maps acquired from external entities and maps generated in the vehicle 1. For example, the map information accumulation unit 23 accumulates three-dimensional high-precision maps, global maps that are less accurate than high-precision maps and cover a wider area than high-precision maps, and the like.

[0048] Examples of high-precision maps include dynamic maps, point cloud maps, vector maps, and the like. A dynamic map is, for example, a map including four layers of dynamic information, semi-dynamic information, semi-static information, and static information, and is provided to the vehicle 1 from an external server or the like. A point cloud map is a map including a point cloud (point group data). For example, a vector map is a map that associates traffic information such as the positions of lanes and traffic lights with a point cloud map and is therefore suitable for ADAS (Advanced Driver Assistance System) and AD (Autonomous Driving).

[0049] The point cloud map and the vector map may be provided from, for example, an external server or the like, or may be generated in the vehicle 1 as a map to be subjected to matching with a local map to be described below based on sensing results obtained by the camera 51, the radar 52, the LiDAR 53, or the like, and accumulated in the map information accumulation unit 23. In addition, in the case where a high-precision map is provided from an external server or the like, in order to reduce the communication capacity, map data related to a planned route that the vehicle 1 is now about to travel through and that covers, for example, several hundred square meters is acquired from the external server or the like.

[0050] The position information acquisition unit 24 receives a GNSS (Global Navigation Satellite System) signal from a GNSS satellite and acquires the position information of the vehicle 1. The acquired position information is supplied to the driving assistance / automatic driving control unit 29. Note that the position information acquisition unit 24 may not necessarily adopt a method using a GNSS signal, and may acquire the position information using, for example, a beacon.

[0051] The exterior recognition sensor 25 includes various types of sensors for recognizing situations outside the vehicle 1, and supplies sensor data from each sensor to various parts of the vehicle control system 11. The type and number of sensors included in the exterior recognition sensor 25 are optional.

[0052] For example, the external recognition sensor 25 includes a camera 51, a radar 52, a LiDAR (light detection and ranging, laser imaging detection and ranging) 53, and an ultrasonic sensor 54. Without being limited thereto, the external recognition sensor 25 may include one or more types of sensors among the camera 51, the radar 52, the LiDAR 53, and the ultrasonic sensor 54. Any desired number of cameras 51, radars 52, LiDAR 53, and ultrasonic sensors 54 may be installed on the vehicle 1 as long as this is actually possible. In addition, the types of sensors included in the external recognition sensor 25 are not limited to the above examples, and the external recognition sensor 25 may include other types of sensors. An example of a sensing area of ​​each sensor included in the external recognition sensor 25 will be described below.

[0053] Note that the imaging system of the camera 51 is not limited to any specific imaging system. As the camera 51, for example, a camera supporting various types of imaging systems, such as a stereo camera, a monocular camera, an infrared camera, and a ToF (Time of Flight) camera supporting an imaging system capable of distance measurement, may be employed as necessary. In addition, as the camera 51, a camera for simply acquiring a captured image regardless of distance measurement may be employed.

[0054] In addition, for example, the exterior recognition sensor 25 may include an environment sensor for detecting the environment of the vehicle 1. The environment sensor is a sensor for detecting the environment such as weather, atmospheric conditions, or brightness, and may include any of various types of sensors such as, for example, a raindrop sensor, a fog sensor, a sunlight sensor, a snow sensor, and an illumination sensor.

[0055] Furthermore, for example, the exterior recognition sensor 25 includes a microphone for detecting sounds around the vehicle 1 , the position of a sound source, and the like.

[0056] The on-vehicle sensor 26 includes various types of sensors for detecting information inside the vehicle, and supplies sensor data from each sensor to various parts of the vehicle control system 11. The type and number of various types of sensors included in the on-vehicle sensor 26 are not limited to specific types or numbers as long as the type and number actually allow various types of sensors to be installed on the vehicle 1.

[0057] For example, the vehicle-mounted sensor 26 may include one or more types of sensors among a camera, a radar, a seat sensor, a steering wheel sensor, a microphone, and a biometric sensor. For example, a camera that supports various types of imaging systems capable of distance measurement, such as a ToF camera, a stereo camera, a monocular camera, and an infrared camera, may be used as the camera included in the vehicle-mounted sensor 26. In addition, a camera for simply acquiring a captured image regardless of distance measurement may be used as the camera included in the vehicle-mounted sensor 26. The biometric sensor included in the vehicle-mounted sensor 26 is, for example, provided in a seat, a steering wheel, etc., to detect various types of biometric information of an occupant such as a driver.

[0058] The on-board sensor 27 includes various types of sensors for detecting the state of the vehicle 1, and supplies sensor data from each sensor to various parts of the vehicle control system 11. The type and number of various types of sensors included in the on-board sensor 27 are not limited to specific types or numbers as long as the type and number actually allow various types of sensors to be installed on the vehicle 1.

[0059] For example, the vehicle sensor 27 includes a speed sensor, an acceleration sensor, an angular velocity sensor (gyro sensor), and an IMU (inertial measurement unit) integrating such sensors. For example, the vehicle sensor 27 includes a steering angle sensor for detecting the steering angle of the steering wheel, a yaw rate sensor, an accelerator sensor for detecting the operation amount of the accelerator pedal, and a brake sensor for detecting the operation amount of the brake pedal. For example, the vehicle sensor 27 includes a rotation sensor for detecting the rotation speed of the engine or motor, an air pressure sensor for detecting the air pressure of the tire, a slip rate sensor for detecting the slip rate of the tire, and a wheel speed sensor for detecting the rotation speed of the wheel. For example, the vehicle sensor 27 includes a battery sensor for detecting the remaining power and temperature of the battery and an impact sensor for detecting an external impact.

[0060] The storage unit 28 includes at least one of a nonvolatile storage medium and a volatile storage medium, and stores data and programs. The storage unit 28 is used as, for example, an EEPROM (Electrically Erasable Programmable Read-Only Memory) and a RAM (Random Access Memory), and each of a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, and a magneto-optical storage device can be adopted as a storage medium. The storage unit 28 stores various types of programs and data used by various parts of the vehicle control system 11. For example, the storage unit 28 includes an EDR (Event Data Recorder) and a DSSAD (Data Storage System for Automatic Driving), and stores information acquired by the on-board sensor 26 and information related to the vehicle 1 before and after an event such as an accident.

[0061] The driving assist / automatic driving control unit 29 controls driving assist and automatic driving of the vehicle 1. For example, the driving assist / automatic driving control unit 29 includes an analyzing unit 61, an action planning unit 62, and an operation control unit 63.

[0062] The analysis unit 61 performs a process of analyzing the situation of the vehicle 1 and its surroundings. The analysis unit 61 includes a self-position estimation unit 71 , a sensor fusion unit 72 , and a recognition unit 73 .

[0063] The own position estimation unit 71 estimates the own position of the vehicle 1 based on the sensor data from the external recognition sensor 25 and the high-precision map accumulated in the map information accumulation unit 23. For example, the own position estimation unit 71 generates a local map based on the sensor data from the external recognition sensor 25, and matches the local map with the high-precision map, thereby estimating the own position of the vehicle 1. The position of the vehicle 1 is based on, for example, the center of the rear wheel pair axle.

[0064] A local map is, for example, a three-dimensional high-precision map, an occupancy grid map, or the like generated by using a technology such as SLAM (Simultaneous Localization and Mapping). A three-dimensional high-precision map is, for example, the point cloud map mentioned above. An occupancy grid map is a map that divides the three-dimensional or two-dimensional space around the vehicle 1 into grid cells, each of which has a predetermined size and each indicates the occupancy state of an object. The occupancy state of an object is represented as, for example, the presence / absence of an object or the probability of the presence of an object. The local map is also used, for example, in the process of detecting and identifying the situation outside the vehicle 1 performed by the recognition unit 73.

[0065] Note that the own position estimating unit 71 may estimate the own position of the vehicle 1 based on the position information acquired by the position information acquiring unit 24 and the sensor data from the vehicle sensor 27 .

[0066] The sensor fusion unit 72 performs a sensor fusion process of combining a plurality of different types of sensor data (eg, image data supplied from the camera 51 and sensor data supplied from the radar 52) to obtain new information. Methods for combining different types of sensor data include integration, fusion, correlation, and the like.

[0067] The recognition unit 73 performs a detection process of detecting a situation outside the vehicle 1 and a recognition process of recognizing a situation outside the vehicle 1 .

[0068] For example, the recognition unit 73 performs a process of detecting and recognizing a situation outside the vehicle 1 based on information from the exterior recognition sensor 25 , information from the own position estimation unit 71 , information from the sensor fusion unit 72 , and the like.

[0069] Specifically, the recognition unit 73 performs, for example, a process of detecting and recognizing objects around the vehicle 1, etc. The process of detecting an object is, for example, a process of detecting the presence / absence, size, shape, position, movement, etc. of an object. The process of recognizing an object is, for example, a process of recognizing an attribute such as a type of an object or a process of recognizing a specific object. Note, however, that the detection process and the recognition process are not necessarily clearly separated and may overlap in some cases.

[0070] For example, the recognition unit 73 detects objects around the vehicle 1 by performing clustering to classify point clouds based on sensor data obtained by the radar 52, LiDAR 53, etc. into point cluster groups. Therefore, the presence / absence, size, shape, and position of objects around the vehicle 1 can be detected.

[0071] For example, the recognition unit 73 detects the movement of the object around the vehicle 1 by performing tracking following the movement of the point clusters classified by clustering. Therefore, the travel speed and direction (ie, movement vector) of the object around the vehicle 1 can be detected.

[0072] For example, the recognition unit 73 detects or recognizes vehicles, people, bicycles, obstacles, structures, roads, traffic lights, traffic signs, road markings, etc. based on the image data supplied from the camera 51. In addition, the recognition unit 73 can recognize the type of objects around the vehicle 1 by performing recognition processing such as semantic segmentation.

[0073] For example, the recognition unit 73 is capable of performing processing for recognizing traffic regulations around the vehicle 1 based on the map accumulated in the map information accumulation unit 23, the estimation result of the own position by the own position estimation unit 71, and the recognition result of the objects around the vehicle 1 by the recognition unit 73. Through this processing, the recognition unit 73 is capable of recognizing the position and state of traffic lights, the contents of traffic signs and road markings, the details of traffic restrictions, drivable lanes, and the like.

[0074] For example, the recognition unit 73 can perform a process of recognizing the environment around the vehicle 1. Examples of the surrounding environment that the recognition unit 73 is expected to recognize include weather, temperature, humidity, brightness, and road surface conditions.

[0075] The action planning unit 62 generates an action plan of the vehicle 1. For example, the action planning unit 62 generates the action plan by executing processes of path planning and path following.

[0076] Note that path planning (global path planning) is a process of roughly planning a path from a starting point to a destination. This path planning includes a process called local path planning: taking into account the motion characteristics of vehicle 1, a local path is generated within the planned path so that vehicle 1 can safely and smoothly travel near vehicle 1 (local path planning).

[0077] Path following is a process of making a plan for completing safe and accurate driving through a path planned by path planning within a planned time. The motion planning unit 62 can calculate a target speed and a target angular velocity of the vehicle 1 based on the result of the path following process, for example.

[0078] The operation control unit 63 controls the operation of the vehicle 1 to implement the maneuver plan generated by the maneuver planning unit 62 .

[0079] For example, the operation control unit 63 controls the steering control unit 81, the braking control unit 82, and the driving control unit 83 included in the vehicle control unit 32 to be described below to perform acceleration / deceleration control and direction control so that the vehicle 1 will travel on the local path calculated by the local path planning. For example, for the purpose of realizing ADAS functions such as collision avoidance or impact reduction, following travel, vehicle speed maintenance travel, collision warning of the own vehicle, and lane departure warning of the own vehicle, the operation control unit 63 performs cooperative control. For example, for the purpose of automatic driving, etc., the operation control unit 63 performs cooperative control, which enables autonomous travel without the operation of the driver.

[0080] The DMS 30 performs a process of authenticating the driver, a process of identifying the driver's state, etc. based on sensor data from the onboard sensor 26, input data input to the HMI 31 to be described below, etc. Examples of the driver's state expected to be identified include physical condition, sobriety, concentration, fatigue, line of sight, degree of drunkenness, driving operation, posture, etc.

[0081] Note that the DMS 30 may be configured to perform a process of authenticating an occupant other than the driver and a process of identifying the occupant's state. Also, note that, for example, the DMS 30 may be configured to perform a process of identifying the vehicle interior situation based on sensor data from the onboard sensor 26. Examples of vehicle interior situations that are expected to be identified include temperature, humidity, brightness, odor, and the like.

[0082] The HMI 31 performs input of various types of data, instructions, and the like, and presents various types of data to a driver or the like.

[0083] The data input of HMI 31 will be roughly described below. HMI 31 includes an input device for inputting data by a person. HMI 31 generates an input signal based on the data, instructions, etc. input by the input device, and supplies the input signal to various parts of the vehicle control system 11. For example, HMI 31 includes operating components such as a touch screen panel, buttons, switches, and joysticks as input devices. Without being limited to this, HMI 31 may also include an input device that implements information input by a method other than manual operation (such as via voice or gestures). In addition, for example, HMI 31 can use a remote control device using infrared or radio waves, or an external connection device (such as a mobile device or a wearable device) that supports the operation of the vehicle control system 11 as an input device.

[0084] The data presentation of HMI 31 will be roughly described below. HMI 31 generates visual information, audio information, and tactile information for the vehicle's external space or passengers. In addition, HMI 31 performs output control such as output, output content, output timing, output method, etc. of each piece of information generated. For example, HMI 31 generates and outputs information represented by an image or light (such as an operation screen, an indication of the state of the vehicle 1, an indication of a warning, and / or a monitor image representing the situation of the surrounding environment of the vehicle 1, etc.) as visual information. In addition, for example, HMI 31 generates and outputs information represented by sound (such as voice guidance, warning sound, and / or warning message, etc.) as audio information. In addition, for example, HMI 31 generates and outputs information to be given to the passenger's sense of touch via force, vibration, motion, etc. as tactile information.

[0085] As an output device through which the HMI 31 outputs visual information, for example, a display device that presents visual information by displaying an image by itself and a projector device that presents visual information by projecting an image can be adopted. Note that, for example, the display device can be a device that displays visual information within the field of vision of the occupant (such as a head-up display, a transmissive display, or a wearable device with an AR (augmented reality) function) as well as a display device with a normal display. In addition, the HMI 31 can use a display device included in a navigation device, an instrument panel, a CMS (camera monitoring system), an electronic mirror, a lamp, etc. provided in the vehicle 1 as an output device through which visual information is output.

[0086] As an output device through which the HMI 31 outputs audio information, for example, an audio speaker, a headphone, and an earphone may be employed.

[0087] As an output device through which the HMI 31 outputs tactile information, for example, a tactile element using tactile technology may be employed The tactile element is provided in, for example, a portion to be touched by an occupant of the vehicle 1 such as a steering wheel or a seat.

[0088] The vehicle control unit 32 controls various parts of the vehicle 1. The vehicle control unit 32 includes a steering control unit 81, a brake control unit 82, a drive control unit 83, a body system control unit 84, a light control unit 85, and a horn control unit 86.

[0089] For example, the steering control unit 81 detects the state of the steering system of the vehicle 1 and controls the steering system. For example, the steering system includes a steering mechanism, an electric power steering, etc., and the steering mechanism includes a steering wheel, etc. For example, the steering control unit 81 includes a steering ECU that controls the steering system, an actuator that drives the steering system, etc.

[0090] For example, the brake control unit 82 detects the state of the brake system of the vehicle 1 and controls the brake system. For example, the brake system includes a brake mechanism (including a brake pedal, etc.), an ABS (anti-lock brake system), a regenerative brake mechanism, etc. For example, the brake control unit 82 includes a brake ECU that controls the brake system, an actuator that drives the brake system, etc.

[0091] For example, the drive control unit 83 detects the state of the drive system of the vehicle 1 and controls the drive system. For example, the drive system includes an accelerator pedal, a drive force generator for generating a drive force of an internal combustion engine, a drive motor, etc., a drive force transmission mechanism for transmitting the drive force to wheels, etc. For example, the drive control unit 83 includes a drive ECU that controls the drive system, an actuator that drives the drive system, etc.

[0092] For example, the body system control unit 84 detects the state of the body system of the vehicle 1 and controls the body system. For example, the body system includes a keyless entry system, a smart key system, a power window device, a power seat, an air conditioner, an air bag, a seat belt, a shift lever, etc. For example, the body system control unit 84 includes a body system ECU that controls the body system, an actuator that drives the body system, etc.

[0093] For example, the light control unit 85 detects the states of various types of lights of the vehicle 1 and controls the various types of lights. As lights to be controlled, for example, headlights, backlights, fog lights, turn signal lights, brake lights, projection lights, bumper indicators, etc. are assumed. The light control unit 85 includes a light ECU that controls the lights, an actuator that drives the lights, and the like.

[0094] For example, the horn control unit 86 detects the state of the car horn of the vehicle 1 and controls the car horn. For example, the horn control unit 86 includes a horn ECU that controls the car horn, an actuator that drives the car horn, and the like.

[0095] Figure 2 The diagram is provided by Figure 1 FIG. 2 is a diagram showing an example of a sensing area sensed by the camera 51, radar 52, LiDAR 53, ultrasonic sensor 54, etc. in the external recognition sensor 25. Note that Figure 2 , a vehicle 1 is schematically depicted as viewed from above, with the front end of the vehicle 1 on the left and the rear end of the vehicle 1 on the right.

[0096] The sensing area 101F and the sensing area 101B represent examples of the sensing areas of the ultrasonic sensor 54. The sensing area 101F is an area around the front end of the vehicle 1 covered by the plurality of ultrasonic sensors 54. The sensing area 101B is an area around the rear end of the vehicle 1 covered by the plurality of ultrasonic sensors 54.

[0097] The sensing results in the sensing area 101F and the sensing area 101B are used for, for example, parking assistance of the vehicle 1 or the like.

[0098] The sensing areas 102F to 102B represent examples of sensing areas of the radar 52 for short or medium range. The sensing area 102F covers a position farther in front of the vehicle 1 than the sensing area 101F. The sensing area 102B covers a position farther behind the vehicle 1 than the sensing area 101B. The sensing area 102L covers an area near the rear side portion of the left side surface of the vehicle 1. The sensing area 102R covers an area near the rear side portion of the right side surface of the vehicle 1.

[0099] The sensing results in the sensing area 102F are used, for example, for detecting vehicles, pedestrians, etc. that are present in front of the vehicle 1. The sensing results in the sensing area 102B are used, for example, for a collision prevention function behind the vehicle 1. The sensing results in the sensing areas 102L and 102R are used, for example, for detecting objects in the blind spots on the sides of the vehicle 1.

[0100] Sensing areas 103F to 103B represent examples of sensing areas sensed by the camera 51. The sensing area 103F covers a position farther in front of the vehicle 1 than the sensing area 102F. The sensing area 103B covers a position farther behind the vehicle 1 than the sensing area 102B. The sensing area 103L covers an area near the left side surface of the vehicle 1. The sensing area 103R covers an area near the right side surface of the vehicle 1.

[0101] The sensing results in the sensing area 103F can be used, for example, for the recognition of traffic lights or traffic signs, lane departure prevention support systems, and automatic headlight control systems. The sensing results in the sensing area 103B can be used, for example, for parking assistance and surround view systems. The sensing results in the sensing areas 103L and 103R can be used, for example, for surround view systems.

[0102] The sensing area 104 represents an example of the sensing area of ​​the LiDAR 53. The sensing area 104 covers a position farther in front of the vehicle 1 than the sensing area 103F. Conversely, the sensing area 104 has a narrower range in the left-right direction than the sensing area 103F.

[0103] The sensing results in the sensing area 104 are used, for example, to detect objects such as nearby vehicles.

[0104] The sensing area 105 represents an example of the sensing area of ​​the radar 52 for a long distance. The sensing area 105 covers a position farther in front of the vehicle 1 than the sensing area 104. Conversely, the sensing area 105 has a narrower range than the sensing area 104 in the left-right direction.

[0105] The sensing result in the sensing area 105 is used for ACC (Adaptive Cruise Control), emergency braking, collision avoidance, etc., for example.

[0106] Note that the sensing areas of various sensors such as the camera 51, the radar 52, the LiDAR 53, and the ultrasonic sensor 54 included in the exterior recognition sensor 25 may have a plurality of areas other than Figure 2 Specifically, the ultrasonic sensor 54 may be used to sense the area on the side of the vehicle 1, and the LiDAR 53 may be used to sense the area behind the vehicle 1. In addition, it is noted that the positions where the various sensors are arranged are not limited to the examples described above. In addition, it is noted that the number of each type of sensor may be one or more than one.

[0107] 《2. Implementation Examples》

[0108] Next, we will refer to Figures 3 to 10 Embodiments of the present technology are described.

[0109] <Example Configuration of Operating System 201>

[0110] Figure 3 An example configuration of an operating system 201 to which the present technology is applied is illustrated.

[0111] The operating system 201 is a system applicable to the vehicle 1. For example, the operating system 201 forms a part of the vehicle sensor 27, the DMS 30, the HMI 31, the vehicle control unit 32, the recognition unit 73, and the like of the vehicle 1.

[0112] The operation system 201 includes an operation unit 211 , a learning unit 212 , a vehicle state detection unit 213 , an occupant state detection unit 214 , and a variable operation unit control unit 215 .

[0113] For example, the operation unit 211 forms a part of the HMI 31 of the vehicle 1. The operation unit 211 is used to operate the vehicle 1. The operation unit 211 supplies an operation signal indicating the operation content to the learning unit 212 and the variable operation unit control unit 215. The function to be operated by the variable operation unit constituting a part of the operation unit 211 can be changed under the control of the variable operation unit control unit 215.

[0114] The learning unit 212 records the operation history of the occupant and the use history of each function of the HMI 31 by the occupant based on, for example, the operation signal from the operation unit 211. The learning unit 212 learns the characteristics of the occupant (for example, the preference, habit, etc. of the occupant) based on at least one of the operation history of the occupant and the use history of each function of the HMI 31 by the occupant. The learning unit 212 supplies information indicating the learning result of the occupant's characteristics to the variable operation unit control unit 215.

[0115] The vehicle state detection unit 213 forms, for example, a part of the vehicle sensor 27 and the vehicle control unit 32. The vehicle state detection unit 213 detects the state of the vehicle 1, and supplies information indicating the detection result to the variable operation unit control unit 215.

[0116] For example, the occupant state detection unit 214 forms a part of the DMS 30 of the vehicle 1. The occupant state detection unit 214 detects the state of the occupant of the vehicle 1, and supplies information indicating the detection result to the variable operation unit control unit 215.

[0117] The variable operation unit control unit 215 controls the functions and displays of the variable operation units, each of which is variable in the function to be executed thereby. The variable operation unit control unit 215 includes a function setting unit 221 and a display control unit 222 .

[0118] Function setting unit 221 sets a function to be executed by the variable operation unit based on at least one of an operation signal from operation unit 211 , a learning result of occupant characteristics by learning unit 212 , a state of vehicle 1 , and a state of the occupant.

[0119] The display control unit 222 controls display of function information on the variable operation unit, the function information being related to the function assigned to the variable operation unit by the function setting unit 221 .

[0120] <Specific configuration example of variable operation unit>

[0121] Figures 4 to 6 A specific configuration example of the variable operation unit is illustrated.

[0122] Specifically, Figure 4 A steering wheel 251 of the vehicle 1 is schematically illustrated.

[0123] A steering switch 252-1 as a variable operation unit is arranged in a left spoke of the steering wheel 251. The steering switch 252-1 has a shape of a regular dodecagon that is approximately circular.

[0124] A steering switch 252-2 as a variable operation unit is arranged in the right spoke of the steering wheel 251. The steering switch 252-2 has a shape similar to that of the steering switch 252-1.

[0125] Hereinafter, the turn switch 252-1 and the turn switch 252-2 will be simply referred to as the turn switch 252 unless there is a need to distinguish them from each other.

[0126] Figure 5 and Figure 6 A specific configuration example of the steering switch 252 is shown in the figure.

[0127] Figure 5 's A and B illustrate an example in which a plurality of operation areas of the steering switch 252 are formed by a physical switch. Specifically, the steering switch 252 includes sub-switches 261U to 261R formed by a physical switch. The sub-switch 261U is arranged in the upper portion of the steering switch 252. The sub-switch 261D is arranged in the lower portion of the steering switch 252. The sub-switch 261L is arranged in the left portion of the steering switch 252. The sub-switch 261R is arranged in the right portion of the steering switch 252.

[0128] Hereinafter, the sub-switches 261U to 261R will be simply referred to as the sub-switches 261 unless there is a need to distinguish them from each other.

[0129] A display device is provided on the surface of each sub-switch 261. The display device is formed of, for example, an organic EL display.

[0130] Each sub-switch 261 allows the function to be operated by it to be set independently, and allows the function to be operated by it to be changed. In addition, each sub-switch 261 allows information related to the function to be operated by it (hereinafter referred to as function information) to be displayed independently thereon, and allows the displayed content to be changed.

[0131] Note, however, that since each sub-switch 261 is formed of a physical switch, the arrangement of the sub-switches 261 is fixed.

[0132] For example, in Figure 5 In the example of A of FIG. 2 , functions related to the operation of content (e.g., video, music, etc.) to be played inside the vehicle are assigned to the steering switch 252. Specifically, the function of increasing the volume of the content is assigned to the sub-switch 261U. The function of decreasing the volume of the content is assigned to the sub-switch 261D. The function of returning the current playback to the previous segment is assigned to the sub-switch 261L. The function of advancing the current playback to the next segment is assigned to the sub-switch 261R.

[0133] For example, in Figure 5In the example of B, functions related to the operation of the game are assigned to the steering switch 252. Specifically, the triangle (Δ) key is assigned to the sub-switch 261U. The cross (×) key is assigned to the sub-switch 261D. The square (□) key is assigned to the sub-switch 261L. The circle (○) key is assigned to the sub-switch 261R.

[0134] Figure 6 A and B illustrate an example where the steering switch 252 includes a touch screen panel. Specifically, for example, the steering switch 252 includes a capacitive sensor. A display device is provided on the front side of the capacitive sensor. The display device is formed of, for example, an organic EL display. The steering switch 252 can change the arrangement (e.g., position, quantity, shape, etc.) of the sub-switches (i.e., operating areas) by changing the display content of the display device.

[0135] Specifically, in Figure 6 In the example of A, the steering switch 252 is divided into sub-switches 271U to 271DR. The sub-switch 271U is provided in the upper portion of the steering switch 252. The sub-switch 271D is provided in the lower portion of the steering switch 252. The sub-switch 271L is provided in the left portion of the steering switch 252. The sub-switch 271R is provided in the right portion of the steering switch 252. The sub-switch 271UL is provided in the upper left portion of the steering switch 252. The sub-switch 271DL is provided in the lower left portion of the steering switch 252. The sub-switch 271UR is provided in the upper right portion of the steering switch 252. The sub-switch 271DR is provided in the lower right portion of the steering switch 252.

[0136] The function of increasing the volume of the content is assigned to sub-switch 271U. The function of decreasing the volume of the content is assigned to sub-switch 271D. The function of returning the current playback to the previous segment is assigned to sub-switch 271L. The function of advancing the current playback to the next segment is assigned to sub-switch 271R. The function of muting the volume of the content is assigned to sub-switch 271UL. The function of displaying the main screen of the browser on the display in front of the driver's seat is assigned to sub-switch 271DL. The function of displaying the navigation screen on the display in front of the driver's seat is assigned to sub-switch 271UR. The function of starting the phone is assigned to sub-switch 271DR.

[0137] exist Figure 6 In the example of B, with Figure 5 In a similar manner to A and B, the steering switch 252 is divided into sub-switches 272U to 272R. Figure 5 Functions similar to those of the sub-switches 261U to 261R in B are assigned to the sub-switches 272U to 272R.

[0138] Note that, for example, the steering switch 252 may include both a physical switch and a touch screen panel in combination.

[0139] In addition, the steering switch 252 includes the following Figure 6 An example of a touch screen panel is shown in FIG.

[0140] <Steering switch control processing>

[0141] Next, we will refer to Figure 7 The flowchart of FIG. 2 describes the steering switch control process executed by the operating system 201.

[0142] This process starts, for example, when the power of the vehicle 1 is turned on, and ends when the power of the vehicle 1 is turned off.

[0143] At step S1, the vehicle state detection unit 213 detects the state of the vehicle 1 based on data from the vehicle control ECU 21, sensor data from the vehicle sensor 27, control data from the vehicle control unit 32, etc. For example, the vehicle state detection unit 213 detects whether the vehicle 1 is in a parking state, in a state during automatic driving, or in a state during manual driving.

[0144] Here, the state during automatic driving is, for example, a state in which the automatic driving system is operating and all dynamic driving tasks (DDTs) are performed by the vehicle 1 without a driving operation by the driver. Meanwhile, the state during manual driving is, for example, a state in which at least one of the DDTs is operated by the driver.

[0145] At step S2, the occupant state detection unit 214 detects the state of the driver based on the sensor data from the vehicle-mounted sensor 26, the operation data from the operation unit 211, etc. For example, the occupant state detection unit 214 detects whether the driver is in a state of enjoying content, in a state of playing a game, or in another state (hereinafter referred to as a normal state).

[0146] At step S3, the function setting unit 221 determines whether to change the setting of the function of the steering switch 252. For example, in the case where at least one of the state of the vehicle 1 and the state of the driver has changed to satisfy the condition for changing the function setting of the steering switch 252, the function setting unit 221 determines that the function setting of the steering switch 252 is to be changed, and control proceeds to step S4.

[0147] At step S4 , the function setting unit 221 changes the function setting of the steering switch 252 based on a setting condition based on at least one of the state of the vehicle 1 and the state of the driver.

[0148] At step S5 , the display control unit 222 changes the display of the turn switch 252 according to the change in the function setting of the turn switch 252 .

[0149] Here, the following will refer to Figures 8 to 10 An example arrangement of the functionality of each steering switch 252 is described.

[0150] Figure 8 An example arrangement of the function of each turn switch 252 in a case where the vehicle 1 is in a parking state is illustrated.

[0151] Figure 8 Part A of shows an example arrangement of the functions of each steering switch 252 when the driver is in a normal state.

[0152] Specifically, the steering switch 252-1 is divided into sub-switches 281U-1 to 281R-1. The sub-switch 281U-1 is provided in the upper portion of the steering switch 252-1. The sub-switch 281D-1 is provided in the lower portion of the steering switch 252-1. The sub-switch 281L-1 is provided in the left portion of the steering switch 252-1. The sub-switch 281R-1 is provided in the right portion of the steering switch 252-1.

[0153] Functions related to the operation of the content are assigned to the steering switch 252-1. Specifically, the function of increasing the volume of the content is assigned to the sub-switch 281U-1. The function of reducing the volume of the content is assigned to the sub-switch 281D-1. The function of returning the current playback to the previous segment is assigned to the sub-switch 281L-1. The function of advancing the current playback to the next segment is assigned to the sub-switch 281R-1.

[0154] Hereinafter, the sub-switches 281U- 1 to 281R- 1 will be simply referred to as the sub-switch 281 - 1 unless there is a need to distinguish them from each other.

[0155] On each of the sub-switches 281-1, function information related to the function assigned thereto is displayed. For example, the function information includes at least one of the name or abbreviation of the function, the description of the function, an image representing the function (e.g., an icon, a symbol, etc.), and an operation method of the function.

[0156] Note that the display Figure 8 The character string on each of the sub-switches 281-1 in the portion A of the display indicates the function of the sub-switch 281-1, and may not necessarily correspond to the functional information actually displayed thereon. Similarly, the character string displayed on each of the sub-switches in the subsequent other examples indicates the function of the sub-switch, and may not necessarily correspond to the functional information actually displayed thereon.

[0157] The steering switch 252 - 2 is not divided into sub switches.

[0158] The lighting function and the auxiliary function are assigned to the turn switch 252-2. For example, the brightness of the lighting inside the vehicle and its irradiation position can be set by continuously pressing and operating the turn switch 252-2. For example, the auxiliary function is executed when the turn switch 252-2 is touched.

[0159] For example, the auxiliary function is a function of performing various types of support for the driver through voice recognition. In addition, for example, the auxiliary function provides a mode change function. For example, the mode change function is a function of switching between a content appreciation mode and a game mode, turning off an automatic driving mode, etc. For example, when the content appreciation mode is set, functions related to the operation of the content are preferentially assigned to the steering switch 252. For example, when the game mode is set, functions related to the operation of the game are preferentially assigned to the steering switch 252.

[0160] Figure 8 FIG. B illustrates an example arrangement of the functions of the steering switch 252 when the driver is enjoying content. In this case, the steering switch 252 is optimized for content playback.

[0161] and Figure 8 A function similar to that of the turn switch 252 - 1 in section A is assigned to the turn switch 252 - 1 .

[0162] The steering switch 252-2 is divided into sub-switches 281U-2 to 281R-2. The sub-switch 281U-2 is provided in the upper portion of the steering switch 252-2. The sub-switch 281D-2 is provided in the lower portion of the steering switch 252-2. The sub-switch 281L-2 is provided in the left portion of the steering switch 252-2. The sub-switch 281R-2 is provided in the right portion of the steering switch 252-2.

[0163] Functions related to the operation of the content are assigned to the steering switch 252-2. Specifically, the function of increasing the volume of the bass sound of the content is assigned to the sub-switch 281U-2. The function of reducing the bass sound of the content is assigned to the sub-switch 281D-2. The function of setting the repeat / random playback of the segment is assigned to the sub-switch 281L-2. The function of adjusting the setting of the equalizer that changes the audio frequency characteristics of the content is assigned to the sub-switch 281R-2.

[0164] Figure 8 FIG. C illustrates an example arrangement of the functions of the steering switch 252 in the case where the driver is playing a game. In this case, the steering switch 252 is used as a game controller.

[0165] and Figure 8As in A, the steering switch 252-1 is divided into sub-switches 281U-1 to 281R-1.

[0166] Functions related to the operation of the game are assigned to the steering switch 252-1. Specifically, the up key is assigned to the sub-switch 281U-1. The down key is assigned to the sub-switch 281D-1. The left key is assigned to the sub-switch 281L-1. The right key is assigned to the sub-switch 281R-1.

[0167] and Figure 8 As in B, the steering switch 252-2 is divided into sub-switches 281U-2 to 281R-2.

[0168] Functions related to the operation of the game are assigned to the steering switch 252-2. Specifically, the triangle (Δ) key is assigned to the sub-switch 281U-2, and the cross (×) key is assigned to the sub-switch 281D-2. The square (□) key is assigned to the sub-switch 281L-2. The circle (○) key is assigned to the sub-switch 281R-2.

[0169] Fig. 9 An example arrangement of the functions of the steering switch 252 in the case where the vehicle 1 is in a state during manual driving is illustrated. In the case where the vehicle 1 is in a state during manual driving, regardless of the state of the driver, the same function is assigned to the steering switch 252. That is, a function suitable for manual driving is assigned to the steering switch 252.

[0170] Specifically, Figure 8 A function similar to that in A is assigned to the steering switch 252-1.

[0171] and Figure 8 As in B, the steering switch 252-2 is divided into sub-switches 281U-2 to 281R-2.

[0172] Functions related to driving assistance are assigned to steering switch 252-2. Specifically, the function of increasing the maximum speed of vehicle 1 in ACC (i.e., vehicle-to-vehicle distance controller) is assigned to sub-switch 281U-2. The function of reducing the maximum speed of vehicle 1 in ACC is assigned to sub-switch 281D-2. The function of setting the vehicle-to-vehicle distance in ACC is assigned to sub-switch 281L-2. The function of turning on AD (automatic driving) mode is assigned to sub-switch 281R-2.

[0173] Fig.10 An example arrangement of the function of each steering switch 252 in a case where the vehicle 1 is in a state during automatic driving is illustrated.

[0174] Fig.10Schematic diagram A illustrates an example arrangement of the functions of each steering switch 252 when the driver is in a normal state.

[0175] and Figure 8 A function similar to that in A is assigned to the steering switch 252-1.

[0176] The steering switch 252 - 2 is not divided into sub switches.

[0177] The driving information display function and the auxiliary function are assigned to the steering switch 252-2. For example, when the steering switch 252-2 is continuously pressed and operated, various types of information related to the driving of the vehicle 1 are displayed on the display in front of the driver's seat. For example, when the steering switch 252-2 is touched, the auxiliary function is executed.

[0178] Fig.10 FIG. B illustrates an example arrangement of the functions of each steering switch 252 when the driver is enjoying content. In this case, the steering switch 252 is optimized for content playback.

[0179] and Figure 8 A function similar to that in A is assigned to the steering switch 252-1.

[0180] The steering switch 252-2 is divided into sub-switches 282U-2 to 282C-2. The sub-switch 282U-2 is provided in the upper portion of the steering switch 252-2. The sub-switch 282D-2 is provided in the lower portion of the steering switch 252-2. The sub-switch 282L-2 is provided in the left portion of the steering switch 252-2. The sub-switch 282R-2 is provided in the right portion of the steering switch 252-2. The sub-switch 282C-2 is provided in the center of the steering switch 252-2.

[0181] Functions related to the operation of the content are assigned to the steering switch 252-2. Figure 8 Functions similar to those of the sub-switch 281U-2, the sub-switch 281D-2, the sub-switch 281L-2, and the sub-switch 281R-2 in B are assigned to the sub-switch 282U-2, the sub-switch 282D-2, the sub-switch 282L-2, and the sub-switch 282R-2, respectively. An auxiliary function is assigned to the sub-switch 282C-2. For example, when the sub-switch 282C-2 is pressed and held, the auxiliary function is executed.

[0182] Fig.10 FIG. C illustrates an example arrangement of the functions of each steering switch 252 in the case where the driver is playing a game. In this case, the steering switch 252 is used as a game controller.

[0183] and Figure 8A function similar to that in C is assigned to the steering switch 252-1.

[0184] and Fig.10 As in B, the steering switch 252-2 is divided into sub-switches 282U-2 to 282C-2.

[0185] Functions related to the operation of the game are assigned to the steering switch 252-2. Figure 8 Functions similar to those of the sub-switch 281U-2, the sub-switch 281D-2, the sub-switch 281L-2, and the sub-switch 281R-2 in C are assigned to the sub-switch 282U-2, the sub-switch 282D-2, the sub-switch 282L-2, and the sub-switch 282R-2, respectively. An auxiliary function is assigned to the sub-switch 282C-2. For example, when the sub-switch 282C-2 is pressed and held, the auxiliary function is executed.

[0186] Return to reference Figure 7 , after the processing of step S5, the control returns to step S1, and the processing from step S1 onwards is executed.

[0187] Meanwhile, in the event that it is determined at step S3 that the setting of the function of the steering switch 252 is not to be changed, control returns to step S1 , and the processing from step S1 onward is executed.

[0188] As described above, the function and display of the steering switch 252 are changed according to at least one of the state of the vehicle 1 and the state of the driver. This results in improved operability of the vehicle 1.

[0189] For example, the driver can operate the functions used during driving without removing his hands from the steering wheel 251 while the vehicle 1 is driving. Since the function information related to the function assigned to each sub-switch is displayed on the sub-switch, the driver can also correctly recognize and operate the function of each of the sub-switches of the steering switch 252.

[0190] Note that, for example, in some countries, laws, regulations, etc. may require that the positions of telltales and operating devices related to driving functions such as braking and steering be fixed when obtaining type approval certification. In this case, for example, the position and display of sub-switches for performing operations related to driving functions are fixed, while the functions of other sub-switches are made variable.

[0191] 《3. Example Variation》

[0192] Example modifications of the embodiments of the present technology described above will be described below.

[0193] <Example Variation Regarding How to Set the Function of the Turn Switch 252>

[0194] For example, the manner in which the steering switch 252 is divided into sub-switches and the function to be assigned to each sub-switch may be set based on user operations. For example, an occupant such as a driver may be allowed to use the operation unit 211 to set the manner in which the steering switch 252 is divided into sub-switches and the function to be assigned to each sub-switch under each set condition based on at least one of the state of the vehicle 1 and the state of the driver.

[0195] For example, the learning unit 212 may be configured to learn the characteristics (e.g., preferences, habits, etc.) of the driver based on at least one of the operation history performed by the driver on the operation unit 211 and the use history of the functions of the HMI 31 by the driver. In addition, the function setting unit 221 may be configured to set the manner of dividing the steering switch 252 into sub-switches and the function to be assigned to each sub-switch based on the characteristics of the driver under each setting condition based on at least one of the state of the vehicle 1 and the state of the driver.

[0196] This results in, for example, arranging on the steering switch 252 a function that is used with high frequency by the driver, thereby resulting in improved operability for the driver.

[0197] <Example Variation Related to Variable Operation Unit>

[0198] For example, like the function of the steering switch 252 described above, the function to be performed by a switch arranged at a place other than the steering wheel 251 inside the vehicle 1 may be made variable.

[0199] For example, the function to be executed by a switch operated by an occupant other than the driver inside the vehicle 1 may be made variable.

[0200] Fig.11 and Fig.12 An example arrangement of functions of the variable operation switch 301 to be operated by an occupant other than the driver is illustrated.

[0201] Fig.11 An example arrangement of the functions of the variable operation switch 301 in a case where the vehicle 1 is in a parking state or in a state during automatic driving is illustrated.

[0202] Fig.11 Schematic diagram A illustrates an example arrangement of the functions of the variable operation switch 301 when the occupant is in a normal state.

[0203] The variable operation switch 301 is divided into sub-switches 311U to 311DR. The sub-switch 311U is set in the upper part of the variable operation switch 301. The sub-switch 311D is set in the lower part of the variable operation switch 301. The sub-switch 311L is set in the left part of the variable operation switch 301. The sub-switch 311R is set in the right part of the variable operation switch 301. The sub-switch 311UL is set in the upper left part of the variable operation switch 301. The sub-switch 311DL is set in the lower left part of the variable operation switch 301. The sub-switch 311UR is set in the upper right part of the variable operation switch 301. The sub-switch 311DR is set in the lower right part of the variable operation switch 301. The sub-switch 311C is set in the center of the variable operation switch 301.

[0204] The function of increasing the volume of the content is assigned to sub-switch 311U. The function of decreasing the volume of the content is assigned to sub-switch 311D. The function of returning the current playback to the previous segment is assigned to sub-switch 311L. The function of advancing the current playback to the next segment is assigned to sub-switch 311R. The function of muting the volume of the content is assigned to sub-switch 311UL. The function of displaying the main screen of the browser on the display for the occupants is assigned to sub-switch 311DL. The function of displaying the navigation screen on the display for the occupants is assigned to sub-switch 311UR. The function of starting the phone is assigned to sub-switch 311DR. The confirmation (OK) button is assigned to sub-switch 311C.

[0205] Fig.11 B illustrates an example arrangement of the functions of the variable operation switch 301 in a case where the occupant is enjoying content.

[0206] and Fig.11 As in A, the variable operation switch 301 is divided into sub-switches 311U to 311C.

[0207] and Fig.11 Functions similar to those in A are assigned to sub-switch 311U, sub-switch 311D, sub-switch 311L, sub-switch 311R, sub-switch 311DL, and sub-switch 311C. A function of selecting a music source is assigned to sub-switch 311UL. A function of adjusting the setting of an equalizer that changes the audio frequency characteristics of the content is assigned to sub-switch 311UR. A function of changing the chair posture to a relaxing position is assigned to sub-switch 311DR.

[0208] Fig.11 FIG. C illustrates an example arrangement of the functions of the variable operation switch 301 in a case where the occupant is playing a game.

[0209] and Fig.11As in A, the variable operation switch 301 is divided into sub-switches 311U to 311C.

[0210] and Fig.11 Functions similar to the functions in A are assigned to sub-switch 311U, sub-switch 311D, sub-switch 311L, sub-switch 311R, sub-switch 311DL, and sub-switch 311C. A function of displaying the main screen of the game being played is assigned to sub-switch 311UL. A function of connecting to a community of the game being played is assigned to sub-switch 311UR. A function of changing the seat posture to a relaxing position is assigned to sub-switch 311DR.

[0211] Fig.12 An example arrangement of the functions of the variable operation switch 301 in a case where the vehicle 1 is in a state during manual driving is illustrated.

[0212] and Fig.11 As in A, the variable operation switch 301 is divided into sub-switches 311U to 311C and are assigned Fig.11 A similar function to the one in A.

[0213] The above arrangement results in improved operability of variable operation switch 301 to be operated by an occupant other than the driver. Note that a function may be assigned to each sub-switch of variable operation switch 301 based on the characteristics of the occupant, user operation, or the like.

[0214] For example, the type and shape of the operation unit to which the present technology can be applied are not limited to a specific type or shape as long as the function to be executed by it and the display content thereon are changeable. For example, the present technology can be applied to buttons, levers, etc. for vehicles.

[0215] For example, in the case of operating the vehicle 1 using an information processing terminal such as a smartphone, the function of the operation area in the operation unit of the information processing terminal and the display on the operation area can be changed as in the case described above. For example, the display on the information processing terminal can be displayed based on the set conditions. Fig.11 and Fig.12 The variable operation switch 301 is set based on at least one of the state of the vehicle 1 and the state of the occupant.

[0216] For example, the type of vehicle to which the present technology can be applied is not limited to a specific type.

[0217] For example, the present technology can also be applied to an operation unit of a movable body other than a vehicle.

[0218] 《4. Others》

[0219] <Sample configuration of computer>

[0220] The series of processes described above may also be implemented in hardware or in software. In the case where this series of processes is implemented in software, a program forming the software is installed on a computer. Examples of such computers include computers having a dedicated hardware configuration and general-purpose personal computers, etc., and when various programs are installed thereon, it becomes possible to perform various functions.

[0221] Fig.13 is a block diagram illustrating an exemplary hardware configuration of a computer that executes the series of processes described above according to a program.

[0222] In a computer 1000 , a CPU (Central Processing Unit) 1001 , a ROM (Read Only Memory) 1002 , and a RAM (Random Access Memory) 1003 are connected to one another via a bus 1004 .

[0223] In addition, an input / output interface 1005 is connected to the bus 1004. An input unit 1006, an output unit 1007, a storage unit 1008, a communication unit 1009, and a drive 1010 are connected to the input / output interface 1005.

[0224] The input unit 1006 is formed of an input switch, a button, a microphone, an imaging device and / or the like. The output unit 1007 is formed of a display, a speaker and / or the like. The storage unit 1008 is formed of a hard disk, a nonvolatile memory and / or the like. The communication unit 1009 is formed of a network interface and / or the like. The drive 1010 drives a removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk or a semiconductor memory.

[0225] In the computer 1000 having the configuration described above, the CPU 1001 loads the program recorded on the storage unit 1008 into, for example, the RAM 1003 via the input / output interface 1005 and the bus 1004 , and executes the program to perform the series of processes described above.

[0226] The program to be executed by computer 1000 (ie, CPU 1001) may be recorded on removable medium 1011, which may be, for example, package medium, etc. and thus provided. Alternatively, the program may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0227] In the computer 1000, the program can be installed into the storage unit 1008 via the input / output interface 1005 by mounting the removable medium 1011 on the drive 1010. Alternatively, the program can be received by the communication unit 1009 via a wired or wireless transmission medium and installed into the storage unit 1008. Alternatively, the program can be pre-installed into the ROM 1002 or the storage unit 1008.

[0228] Note that the program executed by the computer may be a program that causes the processes to be executed time-sequentially in the order as described in this specification, or a program that causes the processes to be executed in parallel or when they need to be executed (such as when a call has been issued).

[0229] In addition, in this specification, it is assumed that the term "system" refers to a collection of multiple constituent elements (e.g., devices, modules (components), etc.), regardless of whether all the constituent elements are contained in the same housing. Therefore, both multiple devices housed in separate housings and connected via a network and a single device having multiple modules housed in a single housing can be referred to as a system.

[0230] Furthermore, the embodiments of the present technology are not limited to the embodiments described above, and it should be understood that various modifications can be made without departing from the scope of the gist of the present technology.

[0231] For example, the present technology may be implemented through cloud computing in which a single function is implemented by a plurality of devices that collaborate and share processing via a network.

[0232] Additionally, each of the steps described above with reference to the flowcharts may be performed by a single device, or may alternatively be performed by a plurality of cooperating devices.

[0233] Furthermore, in the case where one step includes a plurality of processes, the plurality of processes included in this one step may be performed by a single device, or may alternatively be performed by a plurality of devices in cooperation.

[0234] <Sample combination of configurations>

[0235] The present technology may also have the following configurations.

[0236] (1) An information processing device comprising:

[0237] a function setting unit that sets a function to be executed by the operation unit based on a setting condition based on at least one of a state of a vehicle and a state of an occupant of the vehicle; and

[0238] A display control unit controls display of function information related to the function set to the operation unit on the operation unit.

[0239] (2) The information processing device according to (1) above, wherein:

[0240] The function setting unit sets each function to be executed by the plurality of operation areas of the operation unit based on the setting condition, and

[0241] The display control unit controls display of the function information on each of the operation areas.

[0242] (3) The information processing device according to (2) above, wherein:

[0243] The operating unit is variable in the arrangement of the operating area,

[0244] the function setting unit divides the operation unit into the plurality of operation areas based on the setting condition and sets a function to be executed by each of the operation areas, and

[0245] The display control unit controls display of each of the operation areas and display of the function information on each of the operation areas.

[0246] (4) The information processing device according to (3) above, wherein:

[0247] The operating unit includes a touch screen panel.

[0248] (5) The information processing device according to any one of (1) to (4) above, wherein:

[0249] The state of the occupant includes any of a state of enjoying content, a state of playing a game, and other states.

[0250] (6) The information processing device according to (5) above, wherein:

[0251] The functions include a function related to the operation of content, a function related to the operation of a game, and a function related to the driving of the vehicle.

[0252] (7) The information processing device according to any one of (1) to (6) above, wherein:

[0253] The state of the vehicle includes any one of a state during manual driving, a state during automatic driving, and a parking state.

[0254] (8) The information processing device according to any one of (1) to (7) above, wherein:

[0255] The function information includes at least one of a name or an abbreviation of the function, a description of the function, an image representing the function, and an operation method of the function.

[0256] (9) The information processing device according to any one of (1) to (8) above, wherein:

[0257] The operating unit is operated by a driver.

[0258] (10) The information processing device according to (9) above, wherein:

[0259] The operation unit is provided on a steering wheel of the vehicle.

[0260] (11) The information processing device according to any one of (1) to (10) above, wherein:

[0261] The operation unit is provided on an information processing terminal for operating the vehicle.

[0262] (12) The information processing device according to any one of (1) to (11) above, further comprising:

[0263] a learning unit that learns the characteristics of the occupant based on at least one of an operation history of the occupant and a use history of the function by the occupant, wherein

[0264] The function setting unit sets a function to be executed by the operation unit based on the setting condition and the characteristics of the occupant.

[0265] (13) The information processing device according to any one of (1) to (12) above, wherein:

[0266] The function setting unit sets a function to be executed by the operation unit under each of the setting conditions based on a user operation.

[0267] (14) The information processing device according to any one of (1) to (13) above, further comprising:

[0268] The operating unit.

[0269] (15) An information processing method comprising:

[0270] setting a function to be executed by the operation unit based on a set condition based on at least one of a state of a vehicle and a state of an occupant of the vehicle; and

[0271] The display of function information related to the function set to the operation unit on the operation unit is controlled.

[0272] (16) A program for causing a computer to execute the following processing:

[0273] setting a function to be executed by the operation unit based on a set condition based on at least one of a state of a vehicle and a state of an occupant of the vehicle; and

[0274] The display of function information related to the function set to the operation unit on the operation unit is controlled.

[0275] It is to be understood that the advantageous effects mentioned in this specification are merely illustrative and non-limiting, and other advantageous effects may exist.

[0276] [Reference Symbol List]

[0277] 1: Vehicle

[0278] 11: Vehicle Control System

[0279] 201: Operating Systems

[0280] 211: Operation unit

[0281] 212: Study Unit

[0282] 213: Vehicle status detection unit

[0283] 214: Occupant status detection unit

[0284] 215: Variable operating unit control unit

[0285] 221: Function setting unit

[0286] 222: Display control unit

[0287] 251: Steering Wheel

[0288] 252-1, 252-2: Steering switch

[0289] 261U to 261R, 271U to 271R, 281U-1 to 282C-2: Sub-switch

[0290] 301: Variable operation switch

[0291] 311U to 311C: Sub-switch

Claims

1. An information processing device, comprising: a function setting unit that sets a function to be executed by the operation unit based on a setting condition based on at least one of a state of a vehicle and a state of an occupant of the vehicle; as well as A display control unit controls display of function information related to the function set to the operation unit on the operation unit.

2. The information processing device according to claim 1, wherein: The function setting unit sets each function to be executed by the plurality of operation areas of the operation unit based on the setting condition, and The display control unit controls display of the function information on each of the operation areas.

3. The information processing device according to claim 2, wherein: The operating unit is variable in arrangement of the operating area, the function setting unit divides the operation unit into the plurality of operation areas based on the setting condition and sets a function to be executed by each of the operation areas, and The display control unit controls display of each of the operation areas and display of the function information on each of the operation areas.

4. The information processing device according to claim 3, wherein: The operating unit includes a touch screen panel.

5. The information processing device according to claim 1, wherein: The state of the occupant includes any of a state of enjoying content, a state of playing a game, and other states.

6. The information processing device according to claim 5, wherein: The functions include a function related to the operation of content, a function related to the operation of a game, and a function related to the driving of the vehicle.

7. The information processing device according to claim 1, wherein: The state of the vehicle includes any one of a state during manual driving, a state during automatic driving, and a parking state.

8. The information processing device according to claim 1, wherein: The function information includes at least one of a name or an abbreviation of the function, a description of the function, an image representing the function, and an operation method of the function.

9. The information processing device according to claim 1, wherein: The operating unit is operated by a driver.

10. The information processing device according to claim 9, wherein: The operation unit is provided on a steering wheel of the vehicle.

11. The information processing device according to claim 1, wherein: The operation unit is provided on an information processing terminal for operating the vehicle.

12. The information processing device according to claim 1, further comprising: a learning unit that learns the characteristics of the occupant based on at least one of an operation history of the occupant and a use history of the function by the occupant, wherein The function setting unit sets a function to be executed by the operation unit based on the setting condition and the characteristics of the occupant.

13. The information processing device according to claim 1, wherein: The function setting unit sets a function to be executed by the operation unit under each of the setting conditions based on a user operation.

14. The information processing device according to claim 1, further comprising: The operating unit.

15. An information processing method, comprising: setting a function to be executed by the operation unit based on a set condition based on at least one of a state of a vehicle and a state of an occupant of the vehicle; as well as The display of function information related to the function set to the operation unit on the operation unit is controlled.

16. A program for causing a computer to execute the following processing: setting a function to be executed by the operation unit based on a set condition based on at least one of a state of a vehicle and a state of an occupant of the vehicle; and The display of function information related to the function set to the operation unit on the operation unit is controlled.

Images