Driving Interaction Incentive Method, Device, Equipment and Storage Medium

Abstract

The present application discloses a driving interaction incentive method, device, equipment and storage medium, relating to the field of intelligent interaction technology. The disclosed driving interaction incentive method includes: when the vehicle is running, giving driving interaction reminders through a target projection device; collecting interaction action information according to the feedback of driver behavior information; performing a fitness score according to the interaction action information, and performing driver interaction incentives according to the fitness score to avoid fatigue driving. In this way, during the running of the vehicle, driving interaction is carried out to guide the driver to perform action interaction and scoring, so as to achieve interaction and incentive, prevent the driver from getting tired, further reduce the risk of fatigue driving, and improve the fun of driving.

Description

Technical Field

[0001] This application relates to the field of intelligent interaction technologies, and in particular, to a driving interaction incentive method, device, equipment, and storage medium. Background Art

[0002] Currently, there are the following methods for vehicles in the market to address driver fatigue: 1) Use special chemicals to detect key components during driver fatigue, and activate medicaments / sprays for the driver at the moment of fatigue to physically prevent the body from getting fatigued or relieve fatigue; 2) Detect the driver's facial state and body posture state through a driver detection module, and when fatigue is judged, start massage or voice broadcast to remind the driver to drive safely and pay attention to rest.

[0003] The above methods for avoiding driving fatigue have an obvious mandatory intention, are not user-friendly to drivers, and are difficult for users to accept. It remains to be confirmed whether the mandatory physical stimulation will cause drug resistance in the body; moreover, the efficacy is limited. If the driver has already become fatigued, simple massage and voice broadcast will not be of much help.

[0004] The above content is only used to assist in understanding the technical solution of this application, and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main purpose of this application is to provide a driving interaction incentive method, device, equipment, and storage medium, aiming to solve the technical problem of being unable to effectively avoid fatigue driving of drivers.

[0006] To achieve the above purpose, this application proposes a driving interaction incentive method, and the method includes:

[0007] During vehicle driving, perform driving interaction reminders through a target projection device;

[0008] Collect interaction action information according to the fed-back driver behavior information;

[0009] Perform a matching degree score according to the interaction action information, and perform driver interaction incentives according to the matching degree score to avoid fatigue driving.

[0010] Optionally, the step of performing driving interaction reminders through a target projection device during vehicle driving includes:

[0011] When it is detected that the driver is driving the vehicle, activate the interaction incentive function;

[0012] According to the interaction incentive function, project onto the target projection position on the front windshield through the target projection device to perform driving interaction reminders.

[0013] Optionally, the step of projecting according to the interactive incentive function onto the target projection position on the front windshield by the target projection device includes:

[0014] Determine a projection image according to the interactive incentive function;

[0015] Collect driver's vision information and front windshield position information;

[0016] Determine the target projection position according to the driver's vision information and front windshield position information;

[0017] Project the projection image onto the target projection position.

[0018] Optionally, the step of determining the target projection position according to the driver's vision information and front windshield position information includes:

[0019] Determine the driving vision range according to the driver's vision information;

[0020] Determine the target projection position on the front windshield according to the driving vision range and front windshield position information.

[0021] Optionally, the step of collecting interactive action information according to the feedback driver behavior information includes:

[0022] Collect the posture information, lip movement information and voice information feedback by the driver;

[0023] Determine the interactive action information according to the posture information, lip movement information and voice information.

[0024] Optionally, the step of performing a fitness score according to the interactive action information includes:

[0025] Determine the driver's effective feedback action according to the interactive action information;

[0026] Obtain a standard interactive action, and compare the standard interactive action with the driver's effective feedback action to obtain an action similarity;

[0027] Perform a fitness score according to the action similarity.

[0028] Optionally, the method further includes:

[0029] Obtain road detection information, and determine road condition information according to the road detection information;

[0030] Perform a risk analysis on the road condition information to determine whether driving incentives can be executed;

[0031] When the judgment result is that driving incentives cannot be executed, give a driving concentration reminder and stop the driving interaction reminder.

[0032] In addition, to achieve the above object, the present application further provides a driving interaction incentive device, which includes:

[0033] An interaction reminder module, configured to perform driving interaction reminders through a target projection device when the vehicle is running;

[0034] An information collection module, configured to collect interaction action information according to the fed-back driver behavior information;

[0035] A scoring incentive module, configured to perform a fit score according to the interaction action information, and perform driver interaction incentives according to the fit score to avoid fatigue driving.

[0036] In addition, to achieve the above object, the present application further provides a driving interaction incentive device, which includes: a memory, a processor, and a computer program stored on the memory and executable on the processor, and the computer program is configured to implement the steps of the driving interaction incentive method as described above.

[0037] In addition, to achieve the above object, the present application further provides a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the driving interaction incentive method as described above are implemented.

[0038] In addition, to achieve the above object, the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the driving interaction incentive method as described above are implemented.

[0039] One or more technical solutions provided by the present application have at least the following technical effects: when the vehicle is running, driving interaction reminders are performed through a target projection device; interaction action information is collected according to the fed-back driver behavior information; a fit score is performed according to the interaction action information, and driver interaction incentives are performed according to the fit score to avoid fatigue driving. In this way, during the vehicle driving process, driving interaction is carried out to guide the driver to perform action interaction and scoring, so as to achieve naive interaction and incentives, prevent the driver from getting tired, further reduce the risk of fatigue driving, and improve the fun of driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The accompanying drawings here are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application.

[0041] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0042] Figure 1 It is a schematic flowchart provided for the first embodiment of the driving interaction incentive method of the present application;

[0043] Figure 2 It is a schematic diagram of each built-in unit of an embodiment of the driving interaction incentive method of the present invention;

[0044] Figure 3 It is a schematic flowchart provided for the second embodiment of the driving interaction incentive method of the present application;

[0045] Figure 4 It is a schematic diagram of the unit structure of the driving interaction incentive device in the embodiment of the present application;

[0046] Figure 5 It is a schematic diagram of the device structure of the hardware operating environment involved in the driving interaction incentive method in the embodiment of the present application.

[0047] The implementation, functional features, and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. Specific Embodiments

[0048] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0049] To better understand the technical solutions of the present application, the following will be described in detail in combination with the accompanying drawings of the specification and the specific embodiments.

[0050] The main solution of the embodiment of the present application is: when the vehicle is driving, driving interaction reminders are made through the target projection device;

[0051] Collect interaction action information according to the feedback of the driver behavior information;

[0052] Perform a matching degree score according to the interaction action information, and perform driver interaction incentives according to the matching degree score to avoid fatigue driving.

[0053] In this embodiment, for the convenience of description, the following will be described with the recognition of the driving interaction incentive device of the water system as the execution subject.

[0054] At present, there are several methods in the existing technology for market vehicles to detect driver fatigue: 1) Using special chemicals to detect the key components during driver fatigue, and activating the medicine / spray to be used on the driver at the moment of fatigue, so that the body is physically no longer fatigued or the fatigue is relieved; 2) Detecting the driver's facial state and body posture state through a driver detection module, and when fatigue is judged, starting massage or voice broadcast to remind the driver to drive safely and pay attention to rest. The above methods for avoiding driving fatigue have an obvious mandatory intention, are not user-friendly to drivers, are difficult for users to accept, and it remains to be confirmed whether the mandatory physical stimulation will cause drug resistance in the body; moreover, the efficacy is limited. If the driver has already become fatigued, simple massage and voice broadcast will not be of much help.

[0055] On the other hand, the current in-vehicle human-computer interaction technology based on AR HUD and the 3D projection technology of mobile phones are both mature, which can support image projection on the front windshield for the driver through a projection device to enhance the augmented reality driving experience. The disadvantage is that this technology cannot be directly associated with the user's driving and is only used for driving assistance. This application provides a solution. When the vehicle is running, driving interaction reminders are carried out through a target projection device; interaction action information is collected according to the fed-back driver behavior information; a matching degree score is carried out according to the interaction action information, and driver interaction incentives are carried out according to the matching degree score to avoid fatigue driving. In this way, during the vehicle driving process, driving interaction is carried out to guide the driver to perform action interaction and scoring, so as to achieve naive interaction and incentives, prevent the driver from getting fatigued, further reduce the risk of fatigue driving, and improve the fun of driving.

[0056] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication, and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device, a driving interaction incentive device, etc. that can implement the above functions. Hereinafter, a water system driving interaction incentive device will be used as an example to illustrate this embodiment and the following embodiments.

[0057] Based on this, the embodiment of this application provides a driving interaction incentive method, referring to Figure 1 , Figure 1 is a schematic flowchart of the first embodiment of the driving interaction incentive method of this application.

[0058] In this embodiment, the driving interaction incentive method includes steps S10 to S30:

[0059] Step S10, when the vehicle is running, carry out driving interaction reminders through a target projection device;

[0060] It should be noted that first, it is determined that the vehicle is driving, then it is determined that driving interaction reminders can be executed, and the way of performing driving interaction reminders is to project and prompt the user on the front windshield through a target projection device.

[0061] In a feasible embodiment, step S10 includes: when it is detected that the driver is driving the vehicle, activating the interaction incentive function; according to the interaction incentive function, projecting through the target projection device to a target projection position on the front windshield to perform driving interaction reminders.

[0062] It should be understood that first, driving detection is performed. When it is detected that the driver is driving the vehicle, the interaction incentive function is activated at this time, and projection is performed according to the interaction incentive function, so as to interact with the driver through the projection on the front windshield glass.

[0063] In a specific implementation, the target projection device refers to an AR HUD or other projection device for projection, and then the 3D / 4D images that need to be interacted are projected to the area above the driver's driving line of sight in the front windshield area through the target projection device, and at the same time, interactive voice reminders are intermittently sent before the interaction is completed.

[0064] It should be noted that the interaction incentive function refers to a function that is preset to interact with the driver in terms of body, voice, etc. to avoid fatigue driving. Various interaction items and specific image contents of the projection can be preset, and this embodiment does not limit them. Usage scenarios of the function: applicable to all scenarios of vehicle use, including driving scenarios and parking scenarios; the driving scenario focuses on driving, and the parking scenario focuses on games; activation of the function: set entry conditions, such as the vehicle has been started to activate this function; exit of the function: set exit conditions, such as the vehicle is powered off to exit this function.

[0065] In a feasible embodiment, in order to accurately determine the projection position that will not block the driver's driving vision, the step of projecting through the target projection device to the target projection position on the front windshield according to the interaction incentive function includes: determining the projection image according to the interaction incentive function; collecting the driver's vision information and the front windshield position information; determining the target projection position according to the driver's vision information and the front windshield position information; projecting the projection image to the target projection position.

[0066] It should be understood that considerations for function safety: it is necessary to avoid interfering with the driver's normal use of the vehicle, including but not limited to the following: not blocking the driver's left, front, and right horizontal lines of sight; the action amplitude required for the interaction by the driver should not be too large; the interaction should not interfere with the driver's torque control, including voice and projection interaction information. Therefore, it is necessary to first determine that the projection image will not interfere with the driver's vision.

[0067] In a specific implementation, first, determine the projection image to be projected according to the interactive incentive function, and then collect the driver's field of vision information. Among them, the driver's field of vision information is determined according to the driver's eye position and information such as object occlusion in the cockpit.

[0068] It should be noted that the driver's field of vision information and the front windshield position information are combined to determine which area of the front windshield is the optimal target projection position for projecting the projection image.

[0069] In a feasible embodiment, to determine the target projection position with the best projection effect, the steps of determining the target projection position according to the driver's field of vision information and the front windshield position information include: determining the driving field of vision range according to the driver's field of vision information; determining the target projection position on the front windshield according to the driving field of vision range and the front windshield position information.

[0070] It should be understood that first, determine the specific field of vision range of the driver according to the driver's field of vision information, then project the field of vision range onto the front windshield to obtain the area on the front windshield where projection can be performed, and finally, intercept the position in the middle of the projection image from the area where projection can be performed as the target projection position.

[0071] Step S20, collect interactive action information according to the feedback driver behavior information;

[0072] In a specific implementation, after issuing a driving interaction reminder to the driver, various information feedback by the driver is collected in real time, and then the driver behavior information is obtained. Finally, the interactive action information is determined based on the driver behavior West Sydney for subsequent fitness analysis.

[0073] In a feasible embodiment, step S20 includes: collecting the posture information, lip movement information, and voice information feedback by the driver; determining the interactive action information according to the posture information, lip movement information, and voice information.

[0074] It should be noted that after issuing the driving interaction reminder, information is obtained through the collection devices in the vehicle, including but not limited to the posture information, lip movement information, and voice information feedback by the driver, that is, the driver's body posture, head posture, lip movement, driver voice input information, etc.

[0075] It should be understood that finally, the interactive action information is summarized by combining the posture information, lip movement information, and voice information.

[0076] Step S30, perform a fitness score according to the interactive action information, and perform driver interaction incentive according to the fitness score to avoid fatigue driving.

[0077] In a specific implementation, after obtaining the interactive action information, a fitness score is calculated based on the interactive action information, that is, the fitness between the virtual interactive action feedback by the user and the standard answer. Finally, a fitness score is obtained, and interactive incentives are provided according to the final fitness score.

[0078] It should be noted that providing driver interactive incentives also includes giving drivers different levels of rewards according to the high or low fitness scores. The specific form can be points or the like. At the same time, after completing one fitness score calculation, the next step of interactive incentives can be carried out, or the fitness scores of multiple interactive incentives can be aggregated, statistically analyzed, and incentivized. This embodiment does not make any limitations.

[0079] In a feasible embodiment, in order to perform more accurate scoring, step S30 includes: determining the driver's effective feedback actions according to the interactive action information; obtaining the standard interactive actions, comparing the standard interactive actions with the driver's effective feedback actions to obtain the action similarity; and calculating the fitness score according to the action similarity.

[0080] It should be understood that first, the driver's effective feedback actions are determined according to the interactive action information. Specifically, the driver's redundant speech, postures, and actions connecting two groups of actions are removed, and the final actions and speech used for interaction are obtained.

[0081] In a specific implementation, the pre-set standard interactive actions are then obtained, and then the driver's effective feedback actions are compared with the standard interactive actions to obtain the action similarity. Finally, the fitness score is obtained according to the percentage of the action similarity.

[0082] It should be noted that as Figure 2 shown in the structural diagram, the driver interaction detection unit is responsible for monitoring the driver's body posture, head posture, lip shape, driver voice input information, etc. The road detection unit is responsible for monitoring the actual road conditions, including but not limited to: lane lines, vehicles within the road view, traffic lights, pedestrians, two-wheel vehicles, etc. The perception and recognition unit is responsible for identifying the information input by the road detection unit, and judging the object type, position, and coordinates. The shadow modeling unit mainly models the information input by the perception and recognition unit, and projects it onto the objects within the front windshield in the form of an augmented reality model image to create a more realistic experience that cannot be distinguished from the actual driving and game scenarios; and outputs the modeled information to the projection display unit. The projection control unit interacts with the driver interaction algorithm control main unit, combines the input of the perception and recognition unit, controls the activation of the pronunciation unit and the projection display unit to interact with the driver according to the road conditions, and at the same time analyzes the input of the driver interaction detection unit, judges and scores, and then notifies the user of the result through the projection display unit and the pronunciation unit again.

[0083] This embodiment provides a driving interaction incentive method. When the vehicle is running, driving interaction reminders are given through a target projection device; interaction action information is collected according to the feedback of driver behavior information; a fitness score is calculated based on the interaction action information, and driver interaction incentives are given according to the fitness score to avoid fatigue driving. In this way, during the vehicle driving process, driving interaction is carried out to guide the driver to perform action interaction and scoring, so as to achieve naive interaction and incentives, prevent the driver from getting tired, further reduce the risk of fatigue driving, and improve the fun of driving.

[0084] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar content as in the above-mentioned first embodiment can be referred to the above introduction and will not be repeated hereinafter. On this basis, please refer to Figure 3 , the method further includes steps S01 to S03:

[0085] Step S01: Obtain road detection information and determine road condition information according to the road detection information;

[0086] It should be noted that first, the road monitoring information is obtained through a road detection unit, including but not limited to lane lines, vehicles within the road view, traffic lights, pedestrians, two-wheeled vehicles, etc., and then the road condition information is extracted from the road detection information, that is, the road conditions during vehicle driving, the positions of nearby vehicles, and obstacle information, etc.

[0087] Step S02: Perform a risk analysis on the road condition information to determine whether driving incentives can be executed;

[0088] It should be understood that after obtaining the road condition information, a risk analysis is performed on the road condition information, so as to determine whether driving incentives can be executed according to the analysis result.

[0089] Step S03: When the judgment result is that driving incentives cannot be executed, give driving concentration reminders and stop the driving interaction reminders.

[0090] In specific implementation, when the judgment result is that there is a car accident risk in the current road condition, it is judged that driving incentives cannot be executed. At this time, driving concentration reminders are given to remind the driver to focus on driving and stop the driving interaction reminders. For example: when the road condition is complex or there are many vehicles, giving driving incentives may affect the driver's driving judgment, and at this time, the driving interaction reminders are stopped.

[0091] It should be noted that the above examples are only for understanding the present application and do not constitute a limitation on the driving interaction incentive method of the present application. Based on this technical concept, more forms of simple transformations are within the protection scope of the present application.

[0092] The present application also provides a driving interaction incentive device. Please refer to Figure 4 The driving interaction incentive device includes:

[0093] An interaction reminder module 10, configured to perform driving interaction reminders through a target projection device when the vehicle is running.

[0094] An information collection module 20, configured to collect interaction action information according to the feedback of driver behavior information.

[0095] A scoring incentive module 30, configured to perform a fit score according to the interaction action information, and perform driver interaction incentives according to the fit score to avoid fatigue driving.

[0096] In this embodiment, when the vehicle is running, driving interaction reminders are performed through a target projection device; interaction action information is collected according to the feedback of driver behavior information; a fit score is performed according to the interaction action information, and driver interaction incentives are performed according to the fit score to avoid fatigue driving. In this way, during the driving process of the vehicle, driving interaction is carried out to guide the driver to perform action interaction and scoring, so as to achieve naive interaction and incentives, prevent the driver from getting fatigued, further reduce the risk of fatigue driving, and improve the fun of driving.

[0097] In one embodiment, the interaction reminder module 10 is further configured to activate the interaction incentive function when detecting that the driver is driving the vehicle; project to a target projection position on the front windshield through the target projection device according to the interaction incentive function to perform driving interaction reminders.

[0098] In one embodiment, the interaction reminder module 10 is further configured to determine a projection image according to the interaction incentive function; collect driver vision information and front windshield position information; determine a target projection position according to the driver vision information and the front windshield position information; project the projection image to the target projection position.

[0099] In one embodiment, the interaction reminder module 10 is further configured to determine a driving vision range according to the driver vision information; determine the target projection position on the front windshield according to the driving vision range and the front windshield position information.

[0100] In one embodiment, the information collection module 20 is further configured to collect posture information, lip movement information, and voice information fed back by the driver; determine interaction action information according to the posture information, lip movement information, and voice information.

[0101] In one embodiment, the scoring and incentive module 30 is further configured to determine effective feedback actions of the driver according to the interaction action information; obtain standard interaction actions, compare the standard interaction actions with the effective feedback actions of the driver to obtain an action similarity; and perform a fit score according to the action similarity.

[0102] In one embodiment, the scoring and incentive module 30 is further configured to obtain road detection information, and determine road condition information according to the road detection information; perform a risk analysis on the road condition information to determine whether a driving incentive can be executed; and when the judgment result is that the driving incentive cannot be executed, give a driving concentration reminder and stop the driving interaction reminder.

[0103] The driving interaction incentive device provided by the present application adopts the driving interaction incentive method in the above embodiment, and can solve the technical problem of being unable to effectively avoid the fatigue driving of the driver. Compared with the prior art, the beneficial effects of the driving interaction incentive device provided by the present application are the same as those of the driving interaction incentive method provided by the above embodiment, and other technical features in the driving interaction incentive device are the same as the features disclosed in the above embodiment method, and will not be elaborated here.

[0104] The present application provides a driving interaction incentive device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the driving interaction incentive method in the first embodiment above.

[0105] Reference is made below to Figure 5 , which shows a schematic structural diagram of a driving interaction incentive device suitable for implementing the embodiments of the present application. The driving interaction incentive device in the embodiments of the present application may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The driving interaction incentive device shown is only an example and should not impose any limitations on the functions and usage scope of the embodiments of the present application.

[0106] As Figure 5As shown, the driving interaction incentive device may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM: Random Access Memory) 1004. In the RAM 1004, various programs and data required for the operation of the driving interaction incentive device are also stored. The processing device 1001, the ROM 1002, and the RAM 1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems may be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the driving interaction incentive device to communicate with other devices wirelessly or wiredly to exchange data. Although the figure shows a driving interaction incentive device having various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be alternatively implemented or had.

[0107] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network through the communication device, or installed from the storage device 1003, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the methods of the embodiments disclosed in the present application are executed.

[0108] The driving interaction incentive device provided by the present application adopts the driving interaction incentive method in the above-mentioned embodiment, and can solve the technical problem of being unable to effectively avoid the driver's fatigue driving. Compared with the prior art, the beneficial effects of the driving interaction incentive device provided by the present application are the same as those of the driving interaction incentive method provided by the above-mentioned embodiment, and other technical features in the driving interaction incentive device are the same as those disclosed in the method of the previous embodiment, and will not be elaborated here.

[0109] It should be understood that each part disclosed in this application can be implemented by hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in a suitable manner in any one or more embodiments or examples.

[0110] As described above, the above are only specific embodiments of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed in this application can easily think of changes or substitutions, which should all be covered by the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

[0111] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., computer programs) stored thereon, and the computer-readable program instructions are used to execute the driving interaction incentive method in the above embodiments.

[0112] The computer-readable storage medium provided by this application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) or flash memory, optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in conjunction with an instruction execution system, device, or device. The program code contained on the computer-readable storage medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0113] The above computer-readable storage medium can be included in the driving interaction incentive device; or it can exist alone without being assembled into the driving interaction incentive device.

[0114] The above computer-readable storage medium stores one or more programs, which, when executed by the driving interaction incentive device, cause the driving interaction incentive device to: during vehicle driving, perform driving interaction reminders through a target projection device; collect interaction action information according to the feedback of driver behavior information; perform a matching degree score according to the interaction action information, and perform driver interaction incentives according to the matching degree score to avoid fatigue driving.

[0115] Computer program code for performing the operations of the present application may be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, and C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., by connecting through an Internet service provider using the Internet).

[0116] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a unit, a program segment, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0117] The units described in the embodiments of the present application may be implemented in software or in hardware. In some cases, the name of the unit does not constitute a limitation on the unit itself.

[0118] The readable storage medium provided by this application is a computer-readable storage medium. The computer-readable storage medium stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned driving interaction incentive method, which can solve the technical problem of being unable to effectively avoid driver fatigue driving. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by this application are the same as those of the driving interaction incentive method provided by the above embodiments, and will not be elaborated here.

[0119] This application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the steps of the driving interaction incentive method as described above.

[0120] The computer program product provided by this application can solve the technical problem of being unable to effectively avoid driver fatigue driving. Compared with the prior art, the beneficial effects of the computer program product provided by this application are the same as those of the driving interaction incentive method provided by the above embodiments, and will not be elaborated here.

[0121] The above are only some embodiments of this application, and do not limit the patent scope of this application accordingly. Any equivalent structural transformation made by using the content of the specification and drawings of this application under the technical concept of this application, or any direct / indirect application in other related technical fields, is included in the patent protection scope of this application.

Claims

1. A driving interaction incentive method, characterized in that: The method includes: When the vehicle is driving, interactive driving reminders are given through the target projection device; Collecting interactive action information according to the feedback of driver behavior information, wherein the interactive action information includes posture information, lip shape information and voice information; A fit score is performed according to the interactive action information, and a driver interaction incentive is performed according to the fit score to avoid fatigue driving, wherein the driver interaction incentive also includes giving the driver different degrees of rewards according to the fit score, and after completing a fit score, the next step of interaction incentive is performed, or the fit scores of multiple interaction incentives are summarized and counted and used as incentives; The step of scoring the degree of fit according to the interactive action information includes: Determine the effective feedback action of the driver according to the interactive action information, remove the redundant voice, gesture and connected actions of the driver in the two groups of actions, and obtain the final action and voice used for interaction as the effective feedback action of the driver; Acquire a standard interactive action, and compare the standard interactive action with the driver's effective feedback action to obtain action similarity; A compatibility score is performed based on the similarity of the actions.

2. The method according to claim 1, characterized in that The step of performing driving interactive reminders through the target projection device when the vehicle is driving includes: When the driver is detected driving the vehicle, the interactive incentive function is activated; According to the interactive incentive function, the target projection device projects onto the target projection position of the front windshield to provide interactive driving reminders.

3. The method according to claim 2, characterized in that The step of projecting to a target projection position facing the wind by a target projection device according to the interactive excitation function comprises: Determining a projection image according to the interactive incentive function; Collect driver's field of view information and front windshield position information; Determining a target projection position according to the driver's field of view information and the front windshield position information; The projection image is projected to the target projection position.

4. The method according to claim 3, characterized in that The step of determining the target projection position according to the driver's field of view information and the front windshield position information comprises: determining a driving field of view according to the driver field of view information; The target projection position on the front windshield is determined according to the driving visual field and the front windshield position information.

5. The method according to claim 1, characterized in that The step of collecting interactive action information according to the feedback driver behavior information includes: Collect the posture information, lip shape information and voice information fed back by the driver; The interactive action information is determined according to the posture information, lip shape information and voice information.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Acquiring road detection information, and determining road condition information according to the road detection information; Performing a risk analysis on the road condition information to determine whether driving incentives can be implemented; When the judgment result is that the driving incentive cannot be executed, a driving concentration reminder is performed, and the driving interaction reminder is stopped.

7. A driving interactive incentive device, characterized in that: The device comprises: An interactive reminder module is used to provide interactive driving reminders through a target projection device when the vehicle is driving; An information collection module, used to collect interactive action information according to the feedback driver behavior information, wherein the interactive action information includes posture information, lip shape information and voice information; A scoring incentive module, used to score the fit according to the interactive action information, and to provide driver interaction incentives according to the fit score to avoid fatigue driving, wherein the driver interaction incentives also include giving different degrees of rewards to the driver according to the fit score, and after completing one fit score, the next step of interaction incentives is carried out, or the fit scores of multiple interaction incentives are summarized and counted for incentives; The scoring incentive module is also used to determine the driver's effective feedback action based on the interactive action information, eliminate the driver's redundant voice, posture and the actions connected in two groups of actions, and the final action and voice used for interaction are the driver's effective feedback action; obtain standard interactive actions, and compare the standard interactive actions with the driver's effective feedback actions to obtain action similarity; and perform a fit score based on the action similarity.

8. A driving interactive incentive device, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the driving interaction incentive method as described in any one of claims 1 to 6.

9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the driving interaction incentive method as described in any one of claims 1 to 6 are implemented.

Images