Human-computer interaction device, system and method for vehicle
By setting up a Braille dot matrix output module and input module in the vehicle, the interaction between the user and the vehicle system is achieved, and the problem of inconvenience of users with limited physical functions is solved while riding, and the comfort and convenience of riding are improved.
Patent Information
- Application Number
- CN202510107554.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-23
- Publication Date
- 2025-05-06
AI Technical Summary
The current vehicle functional design is unfriendly to users with severe physical functions, especially blind and deaf users, which makes them inconvenient and uncomfortable when riding, and have a poor experience in using the car.
By setting up a Braille dot matrix output module and an input module in the vehicle, the interaction between the user and the vehicle system is realized, allowing the user to output the function items to be selected through the Braille dot matrix output module, and send input instructions through the input module to control the functional components of the vehicle.
This enables the vehicle functions to meet the needs of users with limited physical functions, improves their comfort and convenience of riding, and provides a better car use experience.
Smart Images
Figure CN119928758A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of vehicle technology, and in particular to a human-computer interaction device, system and method for a vehicle. Background Art
[0002] The functions provided by current vehicles can meet the general riding needs of users with basically normal physical functions. However, for some users with severely limited physical functions, such as blind, deaf-mute users or blind, deaf-mute users who cannot move their limbs significantly, they cannot conveniently use the vehicle's control functions when riding, such as opening windows for ventilation, opening doors, adjusting air-conditioning temperature, etc. It can be seen that the current vehicle function design is not friendly to such special users, which may make them inconvenient and uncomfortable when riding, resulting in a poor user experience of current vehicles. Summary of the invention
[0003] In view of this, an embodiment of the present invention provides a human-computer interaction device, system and method for a vehicle, which realizes the interaction between the user and the vehicle system through a Braille dot matrix output module and an input module, thereby realizing the control of the functional components of the vehicle, so that the functions provided by the vehicle can meet the riding needs of users with limited physical functions, so that this special group of users can conveniently use the various functions provided by the vehicle according to their personal wishes, thereby improving their riding comfort and convenience and giving them a better vehicle experience.
[0004] To achieve the above objective, according to one aspect of an embodiment of the present invention, a human-computer interaction device for a vehicle is provided.
[0005] A human-computer interaction device for a vehicle in an embodiment of the present invention communicates with an on-board processor, including: a Braille dot matrix output module and an input module, wherein:
[0006] The Braille dot matrix output module responds to the wake-up trigger for the human-computer interaction device by outputting the function item to be selected in Braille through the dot matrix area;
[0007] The input module is used to receive the user's input instructions for the selected function items, send the output selected function items and the input instructions to the on-board processor, and enable the on-board processor to generate control instructions based on the output selected function items and the input instructions to control the functional components of the vehicle through the control instructions.
[0008] Optionally, the dot matrix area includes one or more dot matrices, and each dot matrix corresponds to displaying a function item to be selected; the dot matrix contains multiple status points, each of the status points includes a first state and a second state, and the function item to be selected output by the dot matrix is determined by the state combination of each status point in the dot matrix.
[0009] Optionally, for each of the state points in the dot matrix, when the state point is in the first state, the state point protrudes from the surface of the dot matrix area; when the state point is in the second state, the state point is flush with the surface of the dot matrix area or lower than the surface of the dot matrix area.
[0010] Optionally, the Braille dot matrix output module is configured with a plurality of function items to be selected;
[0011] The Braille dot matrix output module is also used for:
[0012] In the case that the number of the function items to be selected exceeds the number of the dot matrix, a plurality of the function items to be selected are output in batches through the dot matrix area.
[0013] Optionally, the input module includes at least a selection button, a first switching button and a second switching button;
[0014] When the input instruction received by the on-board processor indicates that the selection button is selected, a target function item is determined from the candidate function items currently output by the Braille dot matrix output module, and the control instruction is generated according to the target function item;
[0015] When the input instruction received by the on-board processor indicates that the first switch button is selected, switching the current output state of the dot matrix area to output the next batch of the to-be-selected function items;
[0016] When the input instruction received by the on-board processor indicates that the second switch button is selected, a similar function item is determined, the similarity between the similar function item and the selected function item currently output by the dot matrix area is greater than a preset threshold, and the output state of the dot matrix area is switched to output the similar function item.
[0017] Optionally, when the braille dot matrix output module currently outputs multiple function items to be selected,
[0018] In response to the selection button being selected, the on-board processor uses each currently outputted function item as an alternative function item and switches the output state of the dot matrix area to output one of the alternative function items; in response to the trigger operation on the selection button, determines that the outputted alternative function item is the target function item; in response to the trigger operation on the first switch button or the second switch button, switches the output state of the dot matrix area to output the next alternative function item.
[0019] To achieve the above objective, according to another aspect of an embodiment of the present invention, a human-computer interaction system is provided.
[0020] A human-computer interaction system according to an embodiment of the present invention comprises an on-board processor and a human-computer interaction device for a vehicle provided by any of the above embodiments, wherein:
[0021] The Braille dot matrix output module responds to the wake-up trigger for the human-computer interaction device by outputting the function item to be selected in Braille through the dot matrix area;
[0022] The input module is used to receive the user's input instructions for the selected function items, send the output selected function items and the input instructions to the on-board processor, and enable the on-board processor to generate control instructions based on the output selected function items and the input instructions to control the functional components of the vehicle through the control instructions.
[0023] To achieve the above objective, according to another aspect of an embodiment of the present invention, a human-computer interaction method for a vehicle is provided.
[0024] A human-computer interaction method for a vehicle according to an embodiment of the present invention includes:
[0025] The Braille dot matrix output module responds to the wake-up trigger for the human-computer interaction device and outputs the function items to be selected in Braille through the dot matrix area;
[0026] The input module receives the user's input instructions for the selected function items, and sends the output selected function items and the input instructions to the vehicle-mounted processor, so that the vehicle-mounted processor generates control instructions according to the output selected function items and the input instructions, so as to control the functional components of the vehicle through the control instructions.
[0027] To achieve the above objective, according to another aspect of an embodiment of the present invention, an electronic device for human-computer interaction in a vehicle is provided.
[0028] An electronic device for human-computer interaction in a vehicle according to an embodiment of the present invention comprises: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement a method for human-computer interaction in a vehicle according to an embodiment of the present invention.
[0029] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided.
[0030] A computer-readable storage medium according to an embodiment of the present invention stores a computer program, and when the program is executed by a processor, a method for human-computer interaction in a vehicle according to an embodiment of the present invention is implemented.
[0031] An embodiment of the above invention has the following advantages or beneficial effects: through the Braille dot matrix output module and the input module, the interaction between the user and the vehicle system is realized, thereby realizing the control of the vehicle's functional components, so that the functions provided by the vehicle can meet the riding needs of users with limited physical functions, so that this special group of users can conveniently use the various functions provided by the vehicle according to their personal wishes, thereby improving their riding comfort and convenience and giving them a better car experience.
[0032] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.
[0034] Figure 1 is a schematic diagram of main modules of a human-machine interaction device for a vehicle according to an embodiment of the present invention;
[0035] Figure 2 is a schematic diagram of a function item to be selected outputted by an updating dot matrix area according to an embodiment of the present invention;
[0036] Figure 3 is a schematic diagram of a function item to be selected outputted by an updating dot matrix area according to another embodiment of the present invention;
[0037] Figure 4 is a schematic diagram of the state of the dot matrix area when the dot matrix outputs the function items to be selected according to an embodiment of the present invention;
[0038] Figure 5 is a schematic diagram of the state of the dot matrix area when the dot matrix outputs the function items to be selected according to another embodiment of the present invention;
[0039] Figure 6 is a schematic diagram of main modules of a human-machine interaction device for a vehicle according to another embodiment of the present invention;
[0040] Figure 7 is a schematic diagram of main modules of a human-computer interaction system according to an embodiment of the present invention;
[0041] Figure 8 is a schematic diagram of main steps of a human-computer interaction method for a vehicle according to an embodiment of the present invention;
[0042] Fig. 9 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;
[0043] Fig.10 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION
[0044] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.
[0045] It should be pointed out that the embodiments of the present invention and the technical features therein may be combined with each other without conflict.
[0046] Figure 1 4 is a schematic diagram of main modules of a human-machine interaction device for a vehicle according to an embodiment of the present invention.
[0047] like Figure 1As shown, the human-machine interaction device 100 for a vehicle according to an embodiment of the present invention communicates with an on-board processor, and includes: a Braille dot matrix output module 110 and an input module 120, wherein the Braille dot matrix output module 110 outputs the function item to be selected in Braille through the dot matrix area 111 in response to the wake-up trigger for the human-machine interaction device 100; the input module 120 is used to receive the user's input instruction for the function item to be selected, and send the output function item to be selected and the input instruction to the on-board processor, so that the on-board processor generates a control instruction according to the output function item to be selected and the input instruction, so as to control the functional components of the vehicle through the control instruction. Specifically, in order to prevent the user from mis-triggering the human-machine interaction device, the device (human-machine interaction device) can be set to include a sleep state and an active state. When the user does not need to use the device, it is set to a sleep state. If the user needs to use the device, the device can be awakened to be in an active state. Further, the device may also include a wake-up area or a wake-up switch, and the device is activated by touching the wake-up area or turning on the wake-up switch, so that the device switches from a sleep state to an active state. Once the device switches to the active state, the Braille dot matrix output module outputs the function items to be selected for the user to select. The user touches the dot matrix area of the Braille dot matrix output module to determine which or which function items to be selected are currently output, and inputs the corresponding instruction through the input module. The instruction may be a selection instruction indicating affirmation (YES), or a first switching instruction indicating negation (NO), or a second switching instruction indicating negation (NO) and indicating that the currently output function items to be selected are close to the target function items required by the user. Through one or more human-computer interactions between the user and the device, the target function item is finally determined, and the relevant functional components of the vehicle are controlled to perform the corresponding operation. For example, if the target function item is to open the window, then the window glass of the vehicle is controlled to move downward to open the window. For another example, if the target function item is seat heating, then the vehicle seat heating switch is controlled to turn on.
[0048] In an optional embodiment of the present invention, the dot matrix area 111 includes one or more dot matrices, and one dot matrix corresponds to displaying one function item to be selected; the dot matrix includes multiple state points, and each state point includes a first state and a second state, and the function item to be selected output by the dot matrix is determined by the state combination of each state point in the dot matrix. Among them, there are multiple ways for the Braille dot matrix output module to output the function items to be selected, including: outputting only one function item A to be selected each time, and when the user inputs a switching instruction indicating a negative, switching a currently output function item A to be selected to a function item B to be selected, such as Figure 2 As shown, Figure 2A and B in the dot matrix area represent the function items to be selected through the dot matrix output; or two function items A and B to be selected are output each time, and when the user inputs a negative switching instruction, the two function items A and B to be selected currently output are switched to the other two function items C and D to be selected, such as Figure 3 As shown, Figure 3 A, B, C and D in the figure all represent the function items to be selected output by the dot matrix area through the dot matrix; more than two function items to be selected can also be output each time, and when the user inputs a negative switching instruction, the two or more function items to be selected currently output are switched to other function items to be selected. By changing the state of each state point in a dot matrix, the function items to be selected output by the dot matrix are updated.
[0049] In an optional embodiment of the present invention, for each state point in the dot matrix, when the state point is in the first state, the state point protrudes from the surface of the dot matrix area; when the state point is in the second state, the state point is flush with or lower than the surface of the dot matrix area. Wherein, a dot matrix includes multiple state points, each of which can be a rod-shaped object with a smaller diameter, which can move up and down under the drive of the driving component. The dot matrix area also includes a panel with multiple holes, and the number of holes corresponds to the number and position of the rod-shaped objects. When the rod-shaped object moves upward from a position where its top is flush with or lower than the panel, it passes through the corresponding small hole on the panel and protrudes from the panel, so that the user can touch the top of the rod-shaped object. Braille characters are formed by the tops of multiple protruding rod-shaped objects at different positions, and the Braille characters indicate a function item to be selected. By changing the states of multiple rod-shaped objects, that is, changing the states of multiple state points, the function item to be selected output by the dot matrix is updated. For example, a dot matrix includes 6 state points 1, 2, 3, 4, 5, and 6, among which state points 2, 4, and 6 protrude from the panel, and state points 1, 3, and 5 are flush with the panel or lower than the panel. Figure 4 As shown, the shaded circles represent the state points protruding from the panel, the white circles represent the state points flush with the panel or lower than the panel, and the function item to be selected is opening the window; when the state points 2, 5, and 6 protrude from the panel, and the state points 1, 4, and 5 are flush with the panel or lower than the panel, as shown in FIG. Figure 5 As shown, the shaded circles represent state points protruding from the panel, and the white circles represent state points flush with or below the panel, indicating that the function item to be selected is seat heating. It is understood that the number of dots, layout, number of state points, and state combinations in the embodiments of the present invention are only examples and are not intended to be limiting.
[0050] In an optional embodiment of the present invention, the Braille dot matrix output module is configured with multiple function items to be selected; the Braille dot matrix output module is also used to: when the number of the function items to be selected exceeds the number of the dot matrix, output the multiple function items to be selected in batches through the dot matrix area. For example, the Braille dot matrix output module is configured with 6 to-be-selected function items A, B, C, D, E and F, and the number of dots is 2, that is, the dot matrix area outputs at most two to-be-selected function items each time for the user to select. Then, the to-be-selected function items A and B can be output through the dot matrix area first, and when a negative input instruction from the user is received, the to-be-selected function items output by the dot matrix area are switched to the to-be-selected function items C and D, and when a negative input instruction from the user is received again, the to-be-selected function items output by the dot matrix area are switched to the to-be-selected function items E and F; or the to-be-selected function items A and B can be output through the dot matrix area first, and when a positive input instruction from the user is received, the target function item is determined from the to-be-selected function items A and B, that is, the to-be-selected function items A and B are determined as candidate function items, and the target function item is determined from the candidate function items.
[0051] Among them, when outputting the function items to be selected in batches, the display order of multiple function items to be selected (such as A and B first, then C and D, then E and F, etc.) and the matching combination (such as A and B, C and D, E and F, etc.) can be randomly determined or pre-configured. The display order of the function items to be selected and the matching combination information can be pre-configured to determine the user's behavior habits based on the historical data corresponding to the user, and the display order and matching combination information of multiple function items to be selected can be configured according to the behavior habits. Therefore, in an optional embodiment of the present invention, the Braille dot matrix output module is also used to receive definition information for multiple function items to be selected, configure the corresponding function items to be selected for the dot matrix, and output the configured function items to be selected through the dot matrix. The definition information can indicate multiple function items to be selected, the display order of multiple function items to be selected, and the matching combination information.
[0052] The above situation describes the situation where the number of function items to be selected is greater than the number of dot matrices, that is, the dot matrix area cannot display all the function items to be selected at once. This embodiment introduces the situation where the number of function items to be selected is less than or equal to the number of dot matrices, that is, the dot matrix area can display all the function items to be selected at once. That is, in an optional embodiment of the present invention, when the number of function items to be selected does not exceed the number of dot matrices, the dot matrices are randomly assigned to the function items to be selected, and the dot matrices are used to output the function items to be selected. For example, if the total number of function items to be selected configured for the Braille dot matrix output module is 2, such as opening the window and seat heating, and the number of dot matrices is also 2 or 3, then one dot matrix can be randomly designated to output the window opening function item, and another dot matrix can be designated to output the seat heating function item.
[0053] In an optional embodiment of the present invention, the input module 120 at least includes a selection button 121, a first switch button 122 and a second switch button 123. Figure 6As shown; when the input instruction received by the on-board processor indicates that the selection button 121 is selected, the target function item is determined from the candidate function items currently output by the Braille dot matrix output module 110, and the control instruction is generated according to the target function item; when the input instruction received by the on-board processor indicates that the first switch button 122 is selected, the current output state of the dot matrix area is switched to output the next batch of the candidate function items; when the input instruction received by the on-board processor indicates that the second switch button 123 is selected, a similar function item is determined, the similarity between the similar function item and the candidate function item currently output by the dot matrix area is greater than a preset threshold, and the output state of the dot matrix area is switched to output the similar function item. In the case where the selection button is selected, the selection of the selection button indicates that the user determines that the candidate function item currently output is the target function item or includes the target function item. For example, if only one to-be-selected function item is currently output and the selection button is selected, it means that the user indicates that the to-be-selected function item currently output is the target function item; if multiple to-be-selected function items are currently output and the selection button is selected, it means that the user indicates that one of the multiple to-be-selected function items currently output is the target function item. In the case where the first switch button is selected, the first switch button is selected, indicating that the user indicates that the to-be-selected function item currently output is not the target function item or does not include the target function item, and the to-be-selected function items output by the dot matrix area are updated to the next batch of to-be-selected function items. For example, if one or more to-be-selected function items are currently output and the first switch button is selected, it means that the user denies that the to-be-selected function items currently output include the target function item, and the to-be-selected function items currently output by the dot matrix area are updated, so that the next batch of to-be-selected function items are output by the dot matrix area. In the case where the second switch button is selected, the second switch button is selected, indicating that the user denies the currently outputted function item to be selected, and indicates that the currently outputted function item to be selected is close to the target function item, and the function item to be selected outputted in the dot matrix area is updated to the next batch of function items to be selected, and the next batch of function items to be selected is similar to the currently outputted function item to be selected. For example, if the currently outputted function items to be selected are opening the window and heating the seat, and the second switch button is selected, it means that the user denies that the currently outputted function item to be selected includes the target function item, and indicates that the currently outputted function item to be selected is close to the target function item, and the currently outputted function item to be selected in the dot matrix area is updated to a similar function item, such as turning on the air conditioning external circulation and increasing the air conditioning temperature. In the configuration information, the similarities between multiple function items to be selected and other function items are pre-configured, and the preset threshold is pre-configured. For example, according to the configuration information, it can be determined that the similarity between the air conditioning external circulation and opening the window is higher than the preset threshold, and the similarity between the seat heating and increasing the air conditioning temperature is higher than the preset threshold, therefore, the similar function items corresponding to the opening of the window and the seat heating are the air conditioning external circulation and increasing the air conditioning temperature.
[0054] Regarding how to determine the target function item when multiple function items to be selected are currently output and the selection button is selected, in an optional embodiment of the present invention, when the Braille dot matrix output module 110 currently outputs multiple function items to be selected, the on-board processor 701, in response to the selection button 121 being selected, takes each of the currently outputted function items to be selected as an alternative function item, and switches the output state of the dot matrix area 111 to output one of the alternative function items; in response to the trigger operation of the selection button 121, determines that the output alternative function item is the target function item; and in response to the trigger operation of the first switch button 122 or the second switch button 123, switches the output state of the dot matrix area 111 to output the next alternative function item. For example, the multiple function items currently output for selection include seat heating, opening the window, and air conditioning, and the selection button is selected. At this time, seat heating, opening the window, and air conditioning are used as candidate function items for determining the target function item, and the candidate function items are displayed one by one in sequence through the dot matrix area. For example, seat heating is displayed first, and the user's input instruction for the seat heating function is received. If the user triggers the selection button, the seat heating function is determined to be the target function item; if the user triggers the first switch button, it is determined that the seat heating function is not the target function item, and the window opening function continues to be output. If the user continues to trigger the first switch button for the window opening function, the air conditioning instruction function is determined to be the target function item. It should be noted that in this embodiment, the first switch button can be replaced by the second switch button.
[0055] In order to facilitate passengers to use the human-computer interaction device, the human-computer interaction device can be set on the vehicle armrest or on the side of the seat, so that special user groups can easily reach the device and touch the dot matrix area to trigger the input module to enter the correct interaction instructions.
[0056] The human-machine interaction device for a vehicle is described in detail below through a specific embodiment.
[0057] User Xiao Ming is a blind, deaf and mute user. He feels stuffy and smelly in the cabin while riding in a vehicle. He wakes up the device through the wake-up area of the human-computer interaction device. The device outputs the optional function items A, B and C through the dot matrix area of the Braille dot matrix output module. After Xiao Ming touches the dot matrix area for a certain period of time, he triggers the first switch button of the input module for the optional function items A, B and C. The on-board processor updates the optional function items output by the dot matrix area to D, E and F according to the currently output optional function items A, B and C and the trigger instruction of the first switch button. After Xiao Ming determines that the optional function items output by the dot matrix area are D, E and F, The second switch button of the trigger input module, the on-board processor updates the to-be-selected function items output by the dot matrix area to to-be-selected function items G, H and I which are similar to D, E and F respectively according to the to-be-selected function items D, E and F and the trigger instruction of the second switch button, and receives the trigger instruction of the selection button input by Xiao Ming for the to-be-selected function items G, H and I, updates the function items output by the dot matrix area to only the alternative function item G, and receives the trigger instruction of the first switch button input by Xiao Ming, then updates the dot matrix area to only output the alternative function item H, and receives the trigger instruction of the selection button input by Xiao Ming, determines the alternative function item H as the target function item.
[0058] The human-computer interaction device for a vehicle in an embodiment of the present invention realizes interaction between a user and a vehicle system through a Braille dot matrix output module and an input module, thereby realizing control over functional components of the vehicle, thereby enabling the functions provided by the vehicle to meet the riding needs of users with limited physical functions, allowing this special group of users to conveniently use the various functions provided by the vehicle according to their personal wishes, thereby improving their riding comfort and convenience and providing them with a better vehicle-using experience.
[0059] Figure 7 Schematic diagram of main modules of a human-computer interaction system according to an embodiment of the present invention.
[0060] like Figure 7 As shown, the human-computer interaction system 700 of the embodiment of the present invention includes a vehicle-mounted processor 701 and the human-computer interaction device 100 for a vehicle described in any of the above embodiments, wherein:
[0061] The Braille dot matrix output module 110 responds to the wake-up trigger of the human-computer interaction device 100 by outputting the function items to be selected in Braille through the dot matrix area 111;
[0062] The input module 120 is used to receive the user's input instructions for the selected function items, and send the output selected function items and the input instructions to the on-board processor 701, so that the on-board processor 701 generates control instructions based on the output selected function items and the input instructions to control the functional components of the vehicle through the control instructions.
[0063] In an optional embodiment of the present invention, the dot matrix area 111 includes one or more dot matrices, and each dot matrix corresponds to displaying a function item to be selected; the dot matrix includes multiple status points, each of the status points includes a first state and a second state, and the function item to be selected output by the dot matrix is determined by the state combination of each of the status points in the dot matrix.
[0064] In an optional embodiment of the present invention, for each of the state points in the dot matrix, when the state point is in the first state, the state point protrudes from the surface of the dot matrix area; when the state point is in the second state, the state point is flush with the surface of the dot matrix area or lower than the surface of the dot matrix area.
[0065] In an optional embodiment of the present invention, the Braille dot matrix output module 110 is configured with multiple function items to be selected; the Braille dot matrix output module 110 is also used to: when the number of the function items to be selected exceeds the number of the dot matrix, output the multiple function items to be selected in batches through the dot matrix area 111.
[0066] In an optional embodiment of the present invention, the input module 120 includes at least a selection button 121, a first switch button 122 and a second switch button 123; when the input instruction received by the on-board processor 701 indicates that the selection button 121 is selected, the target function item is determined from the candidate function items currently output by the Braille dot matrix output module 110, and the control instruction is generated according to the target function item; when the input instruction received by the on-board processor 701 indicates that the first switch button 122 is selected, the current output state of the dot matrix area is switched to output the next batch of the candidate function items; when the input instruction received by the on-board processor indicates that the second switch button 123 is selected, a similar function item is determined, the similarity between the similar function item and the candidate function item currently output by the dot matrix area is greater than a preset threshold, and the output state of the dot matrix area is switched to output the similar function item.
[0067] In an optional embodiment of the present invention, when the Braille dot matrix output module 110 currently outputs multiple candidate function items, the on-board processor 701, in response to the selection of the selection button 121, uses each candidate function item currently output as an alternative function item, and switches the output state of the dot matrix area 111 to output one of the alternative function items; in response to the trigger operation of the selection button 121, determines that the output alternative function item is the target function item; and in response to the trigger operation of the first switch button 122 or the second switch button 123, switches the output state of the dot matrix area 111 to output the next alternative function item.
[0068] The human-computer interaction system of the embodiment of the present invention realizes the interaction between the user and the vehicle system through the Braille dot matrix output module and the input module, thereby realizing the control of the functional components of the vehicle, so that the functions provided by the vehicle can meet the riding needs of users with limited physical functions, so that this special group of users can conveniently use the various functions provided by the vehicle according to their personal wishes, thereby improving their riding comfort and convenience and giving them a better vehicle experience.
[0069] Figure 8 Schematic diagram of the main steps of the human-computer interaction method for a vehicle according to an embodiment of the present invention. The human-computer interaction method for a vehicle according to the embodiment of the present invention mainly includes steps S801-S802;
[0070] Step S801: the Braille dot matrix output module responds to the wake-up trigger for the human-computer interaction device by outputting the function items to be selected in Braille through the dot matrix area;
[0071] Step S802: The input module receives the user's input instructions for the selected function items, and sends the output selected function items and the input instructions to the vehicle-mounted processor, so that the vehicle-mounted processor generates control instructions according to the output selected function items and the input instructions, so as to control the functional components of the vehicle through the control instructions.
[0072] The human-computer interaction method for vehicles in the embodiment of the present invention realizes the interaction between the user and the vehicle system through the Braille dot matrix output module and the input module, thereby realizing the control of the functional components of the vehicle, so that the functions provided by the vehicle can meet the riding needs of users with limited physical functions, so that this special group of users can conveniently use the various functions provided by the vehicle according to their personal wishes, thereby improving their riding comfort and convenience and giving them a better vehicle experience.
[0073] Fig. 9 An exemplary system architecture 900 is shown, to which an embodiment of the present invention may be applied, of a human-machine interaction apparatus or method or a human-machine interaction system for a vehicle.
[0074] like Fig. 9 As shown, the system architecture 900 may include a human-computer interaction device 100, a network 901, and an onboard processor 701. The network 901 is used to provide a medium for a communication link between the human-computer interaction device 100 and the onboard processor 701. The network 901 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.
[0075] The user can use the human-machine interaction device 100 to interact with the vehicle-mounted processor 701 through the network 901 to receive or send data, etc. The human-machine interaction device 100 can be a portable human-machine interaction device, including but not limited to a smart phone, a tablet computer, a laptop computer, a desktop computer, etc., or a human-machine interaction device installed on a vehicle. The vehicle-mounted processor 701 can be a vehicle-mounted processor included in the vehicle system itself, or a processor configured separately for the human-machine interaction device.
[0076] It should be noted that the human-computer interaction method for a vehicle provided in an embodiment of the present invention can be executed by a human-computer interaction system 700, and can also be executed jointly by a human-computer interaction device 100 for a vehicle and an on-board processor 701. Accordingly, the human-computer interaction device 100 can be arranged in the human-computer interaction system 700.
[0077] It should be understood that Fig. 9 The number of human-machine interaction devices, networks, and vehicle-mounted processors in the embodiment is only illustrative. Any number of human-machine interaction devices, networks, and vehicle-mounted processors may be provided according to implementation requirements.
[0078] Reference below Fig.10 , which shows a schematic diagram of the structure of a computer system 1000 of an electronic device suitable for implementing an embodiment of the present invention. Fig.10 The human-computer interaction device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0079] like Fig.10 As shown, the computer system 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage part 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the computer system 1000 are also stored. The CPU 1001, the ROM 1002, and the RAM 1003 are connected to each other through a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.
[0080] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed, so that a computer program read therefrom is installed into the storage section 1008 as needed.
[0081] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1009, and / or installed from the removable medium 1011. When the computer program is executed by the central processing unit (CPU) 1001, the above-mentioned functions defined in the system of the present invention are executed.
[0082] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
[0083] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0084] The modules involved in the embodiments of the present invention may be implemented by software or hardware. The modules described may also be set in a processor, for example, it may be described as: a processor includes a function output module and a user instruction input module. The names of these modules do not constitute a limitation on the modules themselves in some cases, for example, the user instruction input module may also be described as a "module for receiving the user's input instruction verification for the function item to be selected".
[0085] As another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device includes: a Braille dot matrix output module responds to a wake-up trigger for the human-computer interaction device, and outputs the function item to be selected in Braille through the dot matrix area; an input module receives a user's input instruction for the function item to be selected, and sends the output function item to be selected and the input instruction to the vehicle processor, so that the vehicle processor generates a control instruction according to the output function item to be selected and the input instruction, so as to control the functional components of the vehicle through the control instruction.
[0086] According to the technical solution of the embodiment of the present invention, the interaction between the user and the vehicle system is realized through the Braille dot matrix output module and the input module, thereby realizing the control of the functional components of the vehicle, so that the functions provided by the vehicle can meet the riding needs of users with limited physical functions, so that this special group of users can conveniently use the various functions provided by the vehicle according to their personal wishes, thereby improving their riding comfort and convenience and giving them a better car-using experience.
[0087] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A human-machine interaction device for a vehicle, characterized in that: Communicates with the on-board processor, including: Braille dot matrix output module and input module, wherein, The Braille dot matrix output module responds to the wake-up trigger for the human-computer interaction device by outputting the function item to be selected in Braille through the dot matrix area; The input module is used to receive the user's input instructions for the selected function items, send the output selected function items and the input instructions to the on-board processor, and enable the on-board processor to generate control instructions based on the output selected function items and the input instructions to control the functional components of the vehicle through the control instructions.
2. The device according to claim 1, characterized in that The dot matrix area includes one or more dot matrices, and each dot matrix corresponds to displaying a function item to be selected; the dot matrix contains multiple status points, each of which includes a first state and a second state, and the function item to be selected output by the dot matrix is determined by the state combination of each of the status points in the dot matrix.
3. The device according to claim 2, characterized in that For each of the state points in the dot matrix, when the state point is in the first state, the state point protrudes from the surface of the dot matrix area; when the state point is in the second state, the state point is flush with the surface of the dot matrix area or lower than the surface of the dot matrix area.
4. The device according to claim 2, characterized in that The Braille dot matrix output module is configured with a plurality of function items to be selected; The Braille dot matrix output module is also used for: In the case that the number of the function items to be selected exceeds the number of the dot matrix, a plurality of the function items to be selected are output in batches through the dot matrix area.
5. The device according to claim 4, characterized in that The input module at least includes a selection button, a first switching button and a second switching button; When the input instruction received by the on-board processor indicates that the selection button is selected, a target function item is determined from the candidate function items currently output by the Braille dot matrix output module, and the control instruction is generated according to the target function item; When the input instruction received by the on-board processor indicates that the first switch button is selected, switching the current output state of the dot matrix area to output the next batch of the to-be-selected function items; When the input instruction received by the on-board processor indicates that the second switch button is selected, a similar function item is determined, the similarity between the similar function item and the selected function item currently output by the dot matrix area is greater than a preset threshold, and the output state of the dot matrix area is switched to output the similar function item.
6. The device according to claim 5, characterized in that When the braille dot matrix output module currently outputs multiple function items to be selected, In response to the selection button being selected, the vehicle-mounted processor uses each of the currently outputted to-be-selected function items as an alternative function item, and switches the output state of the dot matrix area to output one of the alternative function items; in response to the triggering operation on the selection button, determines that the outputted alternative function item is the target function item; In response to a trigger operation on the first switching button or the second switching button, the output state of the dot matrix area is switched to output a next alternative function item.
7. A human-computer interaction system, characterized in that: It comprises an on-board processor and a human-computer interaction device for a vehicle according to any one of claims 1 to 6, wherein: The Braille dot matrix output module responds to the wake-up trigger for the human-computer interaction device by outputting the function item to be selected in Braille through the dot matrix area; The input module is used to receive the user's input instructions for the selected function items, send the output selected function items and the input instructions to the on-board processor, and enable the on-board processor to generate control instructions based on the output selected function items and the input instructions to control the functional components of the vehicle through the control instructions.
8. A human-computer interaction method for a vehicle, characterized in that: include: The Braille dot matrix output module responds to the wake-up trigger for the human-computer interaction device and outputs the function items to be selected in Braille through the dot matrix area; The input module receives the user's input instructions for the selected function items, and sends the output selected function items and the input instructions to the vehicle-mounted processor, so that the vehicle-mounted processor generates control instructions according to the output selected function items and the input instructions, so as to control the functional components of the vehicle through the control instructions.
9. An electronic device for human-computer interaction in a vehicle, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to claim 8.
10. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to claim 8 is implemented.