On-vehicle control method and on-vehicle control device
By generating icons representing the device to be operated on a multi-function button based on extracted key points and device images, the system improves user operability in in-vehicle control devices.
Patent Information
- Application Number
- JP2023073325
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-27
- Publication Date
- 2024-11-08
AI Technical Summary
The existing in-vehicle control devices lack intuitive display of the device to be operated, leading to low user operability.
The system extracts key points of functions of a device to be operated by a multi-function button, acquires a device image from a database, and generates an icon representing the device to be operated, which is displayed on the multi-function button.
This approach enhances user operability by allowing users to intuitively understand the device to be operated through visual icons.
Smart Images

Figure 2024158266000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an in-vehicle control method and an in-vehicle control device. [Background technology]
[0002] For example, the in-vehicle control device described in Patent Document 1 stores in a storage medium a shortcut that specifies multiple operations for controlling multiple different control target devices in response to user operations, and transmits multiple commands to the multiple control target devices to execute the multiple operations specified in the shortcut in response to a single shortcut execution instruction given by the user on a selection switch. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-085686 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the above-mentioned on-board control device has a problem in that the shortcut switch setting screen does not display an image that allows the user to intuitively understand the device to be operated, resulting in low operability for the user.
[0005] An object of the present invention is to provide an in-vehicle control method and an in-vehicle control device that enable a display with improved operability for the user. [Means for solving the problem]
[0006] The present invention solves the above problem by extracting the key points of the functions of the device to be operated by the multi-function button, retrieving a device image from a database based on the extracted key points, generating an icon representing the device to be operated from the retrieved device image, and outputting a display command to display the icon on the multi-function button. Effect of the Invention
[0007] The present invention can improve the operability for the user. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a block diagram showing a multifunction button system, an ECU, and a user terminal according to the present embodiment. [Diagram 2] FIG. 2 is a plan view of a portion of the spoke and the multifunction button. [Diagram 3] FIG. 3 is a schematic diagram for explaining a program generation method. [Figure 4] FIG. 4 is a schematic diagram showing an example of an icon. [Diagram 5] Figure 5 is the image of a dog used to generate the icon. [Figure 6] FIG. 6 is a flowchart showing a control flow of a vehicle control method executed by the on-board control device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a multifunction button system 1, an ECU 4, and a user terminal 5 according to an embodiment of the present invention. The multifunction button system 1 is a system that controls the button display of the multifunction button 14 and the control content of the in-vehicle device controlled by the operation of the multifunction button 14 according to the state of the vehicle and the change in the environment of the vehicle. As shown in FIG. 1, the multifunction button system 1 includes an imaging device 11, a running state detection device 12, a vehicle position detection device 13, a multifunction button 14, an in-vehicle control device 2, and a database 3. The ECU 4 is a controller that controls the in-vehicle device, and is connected to the multifunction button system 1 via a vehicle communication network such as CAN. The user terminal 5 is a mobile information terminal, and is connected to the multifunction button system 1 via an Internet communication network.
[0010] The imaging device 11 is a device that captures an image of an object, and is, for example, a camera equipped with an imaging element such as a CCD, an ultrasonic camera, an infrared camera, or the like. The imaging device 11 includes an exterior camera that captures an image of an object around the vehicle, and an interior camera that captures an image of an object inside the vehicle. A plurality of imaging devices 11 can be provided in one vehicle.
[0011] The target object is an object outside the vehicle and inside the vehicle cabin. Examples of objects outside the vehicle include lane boundaries on a road, road signs, traffic lights, pedestrian crossings, other vehicles, pedestrians, etc. Examples of objects inside the vehicle cabin include passengers, animals, etc.
[0012] The running condition detection device 12 is a device that detects the running condition of the vehicle. Examples of the running condition detection device 12 include a vehicle speed sensor, an acceleration sensor, a yaw rate sensor, a steering angle sensor, etc. The running condition detection device 12 also includes a temperature sensor that measures the air temperatures inside and outside the vehicle as a device that detects the running environment of the vehicle.
[0013] The vehicle position detection device 13 is a positioning system that detects the current position of the vehicle. The vehicle position detection device 13 calculates the current position of the vehicle from, for example, radio waves received from a satellite for a GPS (Global Positioning System).
[0014] The multifunction button 14 is a part or component operated by the user, and is mounted on the vehicle. The multifunction button 14 outputs a command to operate a device in response to a user's operation. The multifunction button 14 can output commands to multiple devices. The devices that can be operated by the multifunction button 14 and the control contents of the devices can be set by the system or the user according to the state of the vehicle and the environment of the vehicle. The multifunction button 14 also displays an icon representing the device to be operated or the function of the device on the display screen. In the following description, the "device" mainly refers to an in-vehicle device, but the "device" is not limited to an in-vehicle device and may be, for example, a user terminal 5 or a terminal such as a tablet device.
[0015] FIG. 2 is a plan view of a part of the spoke 6 and the multifunction button 14. As shown in FIG. 2, the multifunction button 14 is provided on the spoke 6 of the steering wheel. The multifunction button 14 has a circular display screen 141. Icons are displayed on the display screen 141. The display screen 141 is, for example, a touch panel display. Devices and device functions that are presumed to be currently desired by the user are displayed as icons on the display screen 141. From the icons displayed on the display screen 141, the user can check the devices that can be operated by pressing (tapping) the multifunction button 14 and the control contents when operating. The multifunction button 14 corresponds to the "operation unit" of the present invention.
[0016] The in-vehicle control device 2 controls multiple devices of the vehicle according to the set control content by operating one multi-function button 14 (operation unit). The control content is the state or behavior of the device when the device to be controlled is made to function when controlling the device, and is set for each device. When setting the control content, if the control content for each device is comprehensively displayed on a display or the like, it becomes complicated for the user. Therefore, in this embodiment, the functions of the devices that can be operated by operating the multi-function button 14 can be displayed on the display screen 141 of the multi-function button 14.
[0017] The ROM of the in-vehicle control device 2 stores a program for controlling the multifunction button 14 and a program for controlling devices based on an operation command of the multifunction button 14. The in-vehicle control device 2 has a function for accumulating operation information of the in-vehicle devices by the user, a function for controlling the multifunction button 14, a function for generating icons, and the like. The in-vehicle control device 2 has a storage unit 21, a button control unit 22, and an icon generating unit 23 as functional blocks for realizing each function. Note that the storage unit 21, the button control unit 22, and the icon generating unit 23 are examples of the functional blocks included in the in-vehicle control device 2, and the in-vehicle control device 2 may have other functional blocks. In addition to the functional blocks, the in-vehicle control device 2 has a memory for storing programs, a communication unit for communicating with the ECU 4 and the user terminal 5 via a communication network, and the like. Hereinafter, the functions of each functional block shown in FIG. 1 will be described.
[0018] The storage unit 21 has a function of storing operation information related to operations performed by the user on the vehicle in the database 3. The operation is not particularly limited as long as it is an operation performed by the user, and includes all operations input to the multi-function button 14, the switches of the vehicle's equipment, the steering wheel, the direction indicator lever, the shift lever, etc. The operation information includes personal information of the user who operated the equipment, information of the equipment operated by the user, vehicle status information when the equipment was operated, environmental information when the equipment was operated, etc. The personal information of the user corresponds to, for example, a face image of the user and identification information of the user terminal 5, etc. The information of the equipment is identification information of the equipment to be operated, information on the function of the equipment, information on the use history of the equipment, etc. The vehicle status information indicates the vehicle speed, the position of the vehicle, the driving scene of the vehicle, etc. The environmental information is indicated by passengers and animals riding in the passenger seat or the back seat, the temperature / humidity inside and outside the vehicle, weather conditions, time information, and the status inside the vehicle. The status inside the vehicle is the number of passengers in the vehicle and the status of the passengers (talking, sleeping, operating equipment, etc.). For example, when a user operates the air conditioner while the vehicle is traveling, the memory unit stores in database 3 the personal information of the user who used the air conditioner, the set temperature of the air conditioner, the weather conditions when the air conditioner was turned on, time information, etc. as operation information.
[0019] The storage unit 21 may store operations performed by the user on the vehicle in association with a predetermined category according to the usage situation in which the user uses the vehicle, based on the vehicle's driving situation. The usage situation is a scene in which the vehicle is used, specifically, going to work, coming home, traveling, shopping, etc. Operation information is stored for each user.
[0020] The storage unit 21 has a function of constructing, on the database 3, device condition data according to the vehicle state and the vehicle environment from the operation information accumulated in the database 3. The device condition data is information indicating the operating conditions for making the device function and the control contents when the device is made to function. When the operating conditions are satisfied from the vehicle state and the vehicle environment, the device associated with the satisfied operating conditions can be operated with the control contents indicated by the device condition data. For example, when a user frequently operates a specific device at a certain time or under certain weather conditions, similar operation information is accumulated in the database 3. The storage unit 21 aggregates operation information with many common items, sets the operating conditions and control contents of the device from the common information or similar information, and constructs it as device condition data in the database 3. Then, when the current vehicle state and vehicle environment become the vehicle state and vehicle environment when the device was operated in a similar manner in the past, the operating conditions are satisfied, and the device can be operated with the control contents of the device when it was operated in the past. In this way, the device that the user is requesting to operate and the control contents of the device are inferred.
[0021] The button control unit 22 has a function of generating a control item to be presented to a user based on the accumulated operation information when setting the control content for the multifunction button 14. The control item is information that associates a device operated by the multifunction button 4 with the control content. The button control unit 22 sets the control item based on the device condition data. The button control unit 22 sets the control item according to a user who has entered the driver's seat, a current vehicle state, and / or a vehicle environment. For example, when a user enters a vehicle, the button control unit 22 identifies the user from a camera image, and refers to the database 3 to extract device condition data corresponding to the identified user and the user's entry timing. Then, the button control unit 22 sets the device to be operated by the multifunction button 14 so that the device can be operated with the device and control content indicated by the device condition data. It is also possible to operate multiple devices with a single tap operation on the multifunction button 14. The button control unit 22 may set not only the on / off of the device but also the control content when the device is made to function, and then set the device to be operated by the multifunction button 14. Thereby, when the multifunction button 14 is operated, the button control unit 22 outputs a control command so that the operation target device functions according to the set control content. The control command is transmitted from the button control unit 22 to the device via the ECU 4. Note that, when the operation target device includes a device other than an in-vehicle device, such as a user terminal 5, the button control unit 22 outputs a control command to the device, such as the user terminal 5, included in the operation target device.
[0022] Furthermore, the button control unit 22 displays the device to be operated by the multifunction button 14 as an icon on the display screen 141 of the multifunction button 14. The icon is generated by the icon generating unit 23 described later. The icon represents the device to be operated as a symbol, a picture, or the like, and may represent the device to be operated itself or the function of the device to be operated. For example, when a picture of an air conditioner fan is displayed on the display screen 141 as an icon, the user can confirm that the air conditioner can be turned on by tapping the multifunction button 14. At this time, when the icon is displayed as a moving image of the fan rotating, the air volume level of the air conditioner can also be represented by the rotation speed of the fan.
[0023] The button control unit 22 has a function (recommendation function) of predicting a function currently desired by the user and proposing the predicted function on the display of the multifunction button 14. The button control unit 22 detects the user and detects the current vehicle state and / or vehicle environment using an in-vehicle camera, a sensor, etc. The button control unit 22 refers to the database 3 and extracts device condition data corresponding to the identified user and the user's ride timing. The button control unit 22 identifies device condition data that satisfies the operating conditions from the current vehicle state and / or vehicle environment among the extracted device condition data. Then, the button control unit 22 predicts the control target device and the control content indicated by the identified device condition data as the function desired by the user. The icon generation unit 23 generates an icon of the operation target device based on the main points of the functions of the predicted control target device. Note that a method of generating the icon will be described later. Then, the button control unit 22 displays the generated icon on the display screen 141 of the multifunction button 14, thereby proposing the predicted function to the user. From the icon display on the display screen 141, the user can confirm the target devices and control contents proposed by the multifunction button system 1.
[0024] The icon generating unit 23 extracts the main points of the functions of the device to be operated by the multifunction button 4. The function of the device to be operated by the operation of the multifunction button 4 corresponds to the control contents indicated by the device condition data. The main points of the functions extracted by the icon generating unit 23 indicate at least a part of the control contents. For example, if the set temperature of the air conditioner is 25 degrees and the air is blown only to the front seats as the control contents, the main points of the functions include at least the air conditioner being turned on, and may include the set temperature, the position of the air outlet, the air volume, etc. In other words, the main points of the functions do not need to include all of the control contents. When there are multiple devices to be operated, the icon generating unit 23 may extract the main points of each of the functions of the multiple devices to be operated. The icon generating unit 23 may also extract the main points of multiple functions for one device to be operated.
[0025] The icon generating unit 23 acquires a device image from the database 3 according to the extracted main points. The device image is an image of a device that can be an operation target device, such as an in-vehicle device or a user terminal 5. For example, if the operation target device is an air conditioner, the device image is an illustration of a fan, and if the operation target device is a headlight or a power window, the device image is an illustration of a light or window glass. The captured image may be an illustration that represents the function of the operation target device. For example, an arrow indicating the rotation direction of the fan can be added to the illustration, and the air volume of the air conditioner can be represented by the length and number of the arrows. The captured image may also be an animation (video) that represents the function of the operation target device.
[0026] For example, if the extracted key point of the function of the operation target device is "turn on the air conditioner", icon generation unit 23 acquires an illustration of a fan as a device image from database 3. At this time, for example, if the temperature outside the vehicle is low in winter, icon generation unit 23 may acquire an illustration of a red fan from database 3. When icon generation unit 23 extracts key points of a plurality of functions, it may acquire a plurality of device images corresponding to the respective key points, and when key points of a plurality of functions are acquired for one operation target device, it may acquire an image of one operation target device.
[0027] The icon generating unit 23 generates an icon representing the device to be operated from the acquired device image. For example, when an illustration of a fan is acquired as the device image, the icon generating unit 23 processes the illustration of the fan to match the icon display portion of the screen of the display screen 141, and generates an icon. The icon generating unit 23 then outputs a display command to the multi-function button 4 to display the icon, thereby causing the icon to be displayed on the display screen 141.
[0028] The icon generating unit 23 may generate a display icon to be displayed on the display screen 141 not only from a device image but also from an image captured by an on-board camera (camera image inside or outside the vehicle) and / or detection data of an on-board sensor. For example, the icon generating unit 23 generates an icon showing a user's face from an image of the user's face. The icon generating unit 23 displays the face icon on the display screen 141 together with an icon showing a device to be operated. This allows the user to confirm that the control content of the multi-function button 4 has been set for him / herself.
[0029] The in-vehicle control device 2 may generate a program (control program) for controlling an operation target device triggered by the operation of the multi-function button 4 in response to a command from a user, and generate an icon based on a node included in the program. A method for generating the program and a method for generating an icon based on the node will be described below.
[0030] For example, when the vehicle is parked, the outside air temperature is high, equal to or higher than a predetermined temperature, and there is a dog in the vehicle, the user may wish to open the window a little and turn on the air conditioner (hereinafter also referred to as a request example). In order to realize such an operation of the in-vehicle device with one tap of the multifunction button 14, the in-vehicle control device 2 generates a program. The program includes code for determining whether or not the operating conditions for making the device function are satisfied, code for identifying the device to be operated, and code for making the device to be operated function with the set control content. For example, in the request example, the operating conditions correspond to the vehicle being parked, the outside air temperature being equal to or higher than a temperature designated by the user, and the presence of a dog in the vehicle. Also, the opening degree of the window and turning on the air conditioner correspond to the control content.
[0031] For example, the database 3 stores an application for generating a program, and the button control unit 22 of the in-vehicle control device 2 executes the program generation application in response to a command from the user, and displays a guide screen for generating a program on an in-vehicle display or the like. The user taps along the guide screen on the in-vehicle display to generate a program. The button control unit 22 may refer to the device condition data, and display on the guide screen the devices and control contents operated in the past by the user who input the command, and the vehicle state and / or vehicle environment when the device was operated, to guide the user in a format that allows the user to make a selection, thereby generating a program according to the user's wishes.
[0032] FIG. 3 is a schematic diagram for explaining a program generation method. The program is constructed by nodes indicating at least one of the operating conditions for making the device function and the control contents when the device is made to function, and links connecting the nodes. The nodes are not limited to the control contents of the vehicle, and may indicate data transmission to the user terminal 5, the operating conditions of the user terminal 5, etc. Five blocks shown in FIG. 3 represent the nodes. Node 301 is a parking condition node, and the condition is that the vehicle is parked. When the vehicle is parked, the condition of node 301 is met. Note that the condition of node 301 may be valid only in a specific location. Node 302 is a high temperature condition node, and the condition of node 302 is met when the outside air temperature is equal to or higher than the temperature designated by the user. Node 303 is a dog detection condition node, and the condition of node 303 is met when a dog is detected in the vehicle cabin. Nodes 301 to 303 are condition nodes indicating the operating conditions for making the device function.
[0033] Node 304 is a window node, and indicates a state (control content) in which the power window is slightly open (opening degree is about 10 to 20%). Node 305 is a fan node, and indicates that the air conditioner is on. Nodes 304 and 305 are control content nodes that indicate the control content of the device to be operated.
[0034] In order to generate a program for implementing the above-mentioned request example, when the user specifies the operating conditions and control contents that satisfy the request example on the program generation application, the in-vehicle control device 2 sets the operation device target and control contents of the multifunction button 4. At this time, the button control unit 22 of the in-vehicle control device 2 connects the nodes 301 to 303 and the node 304 with a link 311, and connects the node 304 and the node 305 with a link 312. When there are multiple nodes, the button control unit 22 may assign importance to the nodes. The importance of the node is a priority for iconization, and is ranked according to the relationship between the node and the link. For example, the importance of a node including an operation target device is high. In addition, the importance of a node that is highly related to the user, such as a pet or personal information of the user, is also high. In this way, the button control unit 22 generates a program. The storage unit 21 stores the generated program in the database 3.
[0035] Next, a method of generating an icon based on a node will be described. FIG. 4 is a schematic diagram showing an example of an icon. When a program is generated by the button control unit 22, the icon generating unit 23 acquires a device image related to a node included in the program from the database 3, and generates a display icon to be displayed on the multifunction button 4 from the device image. When there are multiple nodes, the icon generating unit 23 may select a node with a higher importance and then acquire a device image related to the selected node. Also, the node to be the target of the icon may be specified by the user. In the example of FIG. 3, the device images related to the node are an image of a dog, an image showing a power window, and an image of a fan. That is, the nodes 303 to 305 are the nodes to be iconized (icon target nodes). The database 3 stores these images as illustrations of graphic symbols. Then, the icon generating unit 23 generates an icon as shown in the icon 401 of FIG. 4. The device image used for icon generation may be an illustration or image of the user's preference.
[0036] The icon generating unit 23 may generate an icon as shown in icon 402 in FIG. 4 as another icon example. The icon generating unit 23 acquires, as device images, illustrations of graphic symbols of an air conditioner (fan) and a power window, and an image of a dog from the database 3. The image of the dog may be an image previously taken by an in-vehicle camera inside the vehicle. The icon generating unit 23 then generates the icon 402 by trimming the image of the dog shown in FIG. 5 to the size of a display icon and including the illustration. The icon generating unit 23 may generate an icon as shown in icon 403 in FIG. 4 as another icon example. The icon 403 includes an illustration of a dog, which is obtained by extracting a contour and illustrating the image of the dog through image processing.
[0037] After the program and icon are generated, when the current vehicle state and vehicle environment satisfy the three conditions of nodes 301 to 303, the button control unit 22 displays the icon generated by the icon generating unit 23 (the icon based on the icon target node) on the display screen 141 of the multifunction button 4. Then, when the user taps the multifunction button 4, the operation target devices indicated by nodes 303 and 304 operate according to the set control contents. This makes it possible to cause the operation target devices to function in accordance with the above example request, for example.
[0038] Next, a vehicle control method by the on-board control device 2 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing a control flow from creating a program, generating an icon, to displaying the icon.
[0039] In step S1, the button control unit 22 of the in-vehicle control device 2 generates a program in response to a user's command. In step S2, the icon generation unit 23 determines whether or not a node to be iconized is specified among the nodes included in the program. If the user has specified a node to be iconized in advance when the program is generated, the specified node becomes the icon target node.
[0040] If it is determined that a node to be iconized has not been specified, then in step S3, icon generation unit 23 specifies a node of high importance (a node whose importance is higher than a predetermined value) as the icon target node. In step S4, icon generation unit 23 extracts the main points of the function of the device related to the icon target node. If the node data is composed of data that identifies the device to be operated and data that indicates the control process of the control content of the device to be operated, icon generation unit 23 may extract data that indicates the main points of the function from the data that constitutes the node. Note that if the node indicates the main points of the device, icon generation unit 23 may use the node data as is.
[0041] In step S5, the icon generation unit 23 acquires a device image from the database 3 according to the extracted main points. In step S6, the icon generation unit 23 generates a plurality of candidate icons. After generating an icon by the icon generation method described above with reference to Fig. 4, the icon generation unit 23 generates another icon by changing at least one element of the icon's position, size, and type. The icon before the element change and the icon after the element change become the candidate icons.
[0042] In step S7, the icon generation unit 23 presents the candidate icon to the user. In step S8, the icon generation unit 23 determines whether or not a candidate icon has been selected by the user. If a candidate icon has not been selected, the in-vehicle control device 2 returns to step S1 and executes the control flow. If a candidate icon has been selected, in step S8, the icon generation unit 23 outputs a display command to display the selected candidate icon on the multi-function button 4. Then, the in-vehicle control device 2 ends the control flow.
[0043] As described above, the vehicle control method and in-vehicle control device 2 according to this embodiment extract key features of the functions of the target device that is the target of operation of the multi-function button 4, obtain a device image from a database according to the extracted key features, generate an icon representing the target device from the obtained device image, and output a display command to display the icon on the multi-function button 4. This allows the user to intuitively understand the target device from the display of the multi-function button 4, making it possible to provide a display that improves user operability.
[0044] In this embodiment, the on-board control device 2 refers to a database 3 that stores device condition data indicating the operating conditions for functioning the device and the control content when the device is functioning, identifies device condition data that satisfies the operating conditions from the vehicle state and vehicle environment, and extracts the main points of the device to be operated from the identified device condition data. This makes it possible to display an icon corresponding to the current vehicle state and vehicle environment on the multi-function button 4, enabling a display that improves user operability.
[0045] In this embodiment, the device image includes an illustration representing the function of the device to be operated and / or an animation representing the function of the device to be operated. As a result, the illustrations and animations that are the material for generating the icon are stored in the database 3, and by using the images recorded in the database, the functions of the device to be operated can be intuitively understood.
[0046] Furthermore, in this embodiment, the on-board control device 2 generates a display icon to be displayed on the multi-function button 4 from an image captured by an on-board camera and / or detection data from an on-board sensor. This allows objects detected by a camera, a sensor, or the like to be used as icon material, making it possible to generate an icon that matches the user's vehicle usage situation and environment.
[0047] Furthermore, in this embodiment, the in-vehicle control device 2 generates multiple candidate icons from the device image, which differ in at least one element among the icon position, size, and type, and sets the candidate icon selected by the user as the display icon to be displayed on the multi-function button 4. As a result, multiple icon proposals are generated, allowing the user to select an icon that suits his or her preference.
[0048] In this embodiment, the in-vehicle control device 2 generates a program constructed by links connecting nodes with each other, and generates icons to be displayed on the multi-function button 4 from device images related to the nodes included in the program. This allows the user to use images (illustrations, animations, moving images, etc.) corresponding to the programming as icon material, so that when a program is executed by operating the multi-function button 4, the device to be operated can be intuitively understood, enabling a display that enhances user operability.
[0049] The display icon displayed on the multifunction button 4 may include a condition icon indicating an operating condition. In the example of Fig. 3, the nodes 301 to 303 may be icon target nodes. The button control unit 22 may then obtain device images (for example, illustrations shown in the blocks of the nodes 301 to 303 in Fig. 4) related to the nodes 301 to 303 and generate an icon. This allows the user to intuitively understand the operating conditions of the device to be operated.
[0050] The in-vehicle control device 2 may also acquire a program from the database 3, learn the association between nodes and links and the importance of the nodes as a learning model from the use history of the device, input the program generated based on the user's command to the learning model, output the importance of the nodes included in the program from the learning model, and generate a display icon to be displayed on the multi-function button 4 from the device image associated with the node with a higher importance. The in-vehicle control device 2 stores the learning model in the database 3. The learning model is a model that is learned to determine the association between nodes and links and the importance of the nodes from the use history of the device. The learning model is a model that is learned using teacher data that associates input data including a program generated based on a user's command with the importance of the nodes. The learning model is configured by a neural network including an input layer, an output layer, and at least one intermediate layer, each of which is made up of one or more neurons, and the input data is input to the input layer, and the output data is output from the output layer. The learned model is used as a program module of software. As the trained model, a trained model trained by the vehicle control device 2 using teacher data may be used, or a trained model trained by an outside of the vehicle control device 2 using teacher data may be obtained and used.
[0051] In addition, in the power window icons included in the icons 401 to 403, the window position may be changed according to the opening degree (for example, 30%, 50%). Furthermore, the in-vehicle control device 2 may update the device condition data according to the accumulation of new operation information. Then, when the operating conditions or control contents of an already created program are changed by updating the device condition data, the in-vehicle control device 2 may change the nodes included in the program. Furthermore, the in-vehicle control device 2 may change the icon according to the change of the node.
[0052] When an icon is displayed on the multifunction button 4 and the icon is changed due to a change in the node, or when a new icon is added, the in-vehicle control device 2 may display the changed or added icon in a more prominent manner than other icons for a predetermined period of time. The prominent display can be achieved by changing the color or brightness.
[0053] Furthermore, when the vehicle control device 2 changes the device to be operated by the multi-function button 4 and the control content of the device to be operated in response to a command from the user, the vehicle control device 2 changes the program. At this time, the vehicle control device 2 may refer to a program for another user to create the changed program. The program may be referred to by copying the program for the other user as is, or by copying only a portion of the nodes. When the color of the icons is unified for each user, the color of the icon of the referred portion may be the color of the user from which the program was referred. For example, it is assumed that the icons for user A are green and the icons for user B are blue. When the vehicle control device 2 generates a new program using a portion of the program of user A in response to a command from user B, the color of the icon based on the referred node in the program of user A may be green, and the color of the other icons may be blue. [Explanation of symbols]
[0054] 1 Multi-function button system 2. On-board control device 3. Database 4 Multi-function Button 5. User terminal 11 Imaging device 12. Driving condition detection device 13 Vehicle position detection device 14 Multifunction Button 21 Memory section 22 Button control section 23 Icon Generation Unit
Claims
1. An in-vehicle control method executed by an in-vehicle control device that controls a plurality of devices with control contents set by a single operation unit, The in-vehicle control device includes: Extracting the essential features of the functions of the operation target device that is the operation target of the operation unit; Obtaining a device image from a database according to the above points; generating an icon representing the device to be operated from the device image; An in-vehicle control method that outputs a display command for displaying the icon on the operation unit.
2. 2. The in-vehicle control method according to claim 1, The in-vehicle control device includes: referring to the database that stores device condition data indicating operating conditions for functioning the device and the control content when the device is functioned, and identifying the device condition data that satisfies the operating conditions based on the state of the vehicle and the environment of the vehicle; An in-vehicle control method for extracting key points of the device to be operated from the identified device condition data.
3. 3. The in-vehicle control method according to claim 1, The device image includes an illustration representing a function of the device to be operated and / or an animation representing the function of the device to be operated.
4. 3. The in-vehicle control method according to claim 1, The in-vehicle control device includes: An in-vehicle control method for generating display icons to be displayed on the operation unit from images captured by an in-vehicle camera and / or detection data from an in-vehicle sensor.
5. 3. The in-vehicle control method according to claim 1, The in-vehicle control device includes: generating a plurality of candidate icons from the device image, the candidate icons differing in at least one element of the position, size, and type of the icon; The in-vehicle control method includes setting the candidate icon selected by a user as a display icon to be displayed on the operation unit.
6. 3. The in-vehicle control method according to claim 2, The display icon displayed on the operation unit includes a condition icon indicating the operating condition.
7. 3. The in-vehicle control method according to claim 2, The in-vehicle control device includes: obtaining, from the database, a program constructed by nodes indicating at least one of the operating conditions and the control contents and links connecting the nodes; A learning model is trained based on the usage history of the device to learn the association between the node and the link and the importance of the node. inputting the program generated based on a user's instruction into the learning model, and outputting the importance of the nodes included in the program from the learning model; An in-vehicle control method for generating a display icon to be displayed on the operation unit from the device image associated with the node having a higher importance.
8. 3. The in-vehicle control method according to claim 1, generating a program constructed of nodes indicating at least one of operating conditions for functioning the device and the control content and links connecting the nodes; An in-vehicle control method for generating an icon to be displayed on the operation unit from the device image related to the node included in the program.
9. In an on-board control device that controls multiple devices with preset control contents using a single operation unit, The in-vehicle control device includes: Extracting the essential features of the functions of the operation target device that is the operation target of the operation unit; Obtaining a device image from a database according to the above points; generating an icon representing the device to be operated from the device image; An in-vehicle control device outputs a display command to display the icon on the operation unit.
Citation Information
Patent Citations
Vehicular control system
JP2018085686A
