Interaction method and device and vehicle
An interaction method and vehicle technology, applied in the field of devices, vehicles, and interaction methods, can solve the problem that children cannot interact with the vehicle system, and achieve the effect of interaction
Inactive Publication Date: 2019-09-10
GUANGZHOU XIAOPENG MOTORS TECH CO LTD
13 Cites 3 Cited by
AI-Extracted Technical Summary
Problems solved by technology
[0004] At present, the existing interactions with in-vehicle systems are all set for adults, but in many cases there a...
Method used
[0054] In the embodiment of the present invention, a child seat can be installed on the seat of the vehicle in advance, and then the child is allowed to sit on the child seat to strengthen the protection of the child; therefore in another example of the present invention, a A method for detecting whether t...
Abstract
The embodiment of the invention provides an interaction method and device and a vehicle, wherein the method comprises the following steps: detecting whether a child passenger exists in the vehicle ornot; determining multimedia data corresponding to the child passenger when determining that the child passenger exists in the vehicle, wherein the multimedia data has child characteristics; and furthermore, carrying out interaction based on the multimedia data, so that interaction with children is realized.
Application Domain
Electric/fluid circuitVehicle safety belts
Technology Topic
Interaction methodHuman–computer interaction
Image
Examples
- Experimental program(1)
Example Embodiment
[0041] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.
[0042] refer to figure 1 , which shows a flow chart of the steps of an embodiment of the interaction method of the present invention, which may specifically include the following steps:
[0043] Step 102, detecting whether there are child passengers in the vehicle.
[0044] Step 104. When it is determined that there is a child passenger in the vehicle, determine multimedia data corresponding to the child passenger, and the multimedia data has a child characteristic; so as to perform interaction based on the multimedia data.
[0045] In the embodiment of the present invention, in order to realize the interaction with children, when the vehicle-mounted system is in the open state, it can automatically detect the environment in the vehicle to detect whether there are child passengers in the vehicle; The child passenger corresponds to multimedia data with children's characteristics, wherein the multimedia data with children's characteristics can include various types, such as cartoons, nursery rhymes, and audiobooks, etc., which are not limited in this embodiment of the present invention . The multimedia data corresponding to the child passenger may refer to the multimedia data played by the child passenger last time, or the most frequently played multimedia data with children's characteristics, or all the multimedia data with children's characteristics in the database; etc. etc., which are not limited in this embodiment of the present invention. This further facilitates subsequent interaction with children based on the determined multimedia data with children's characteristics; for example, playing nursery rhymes, animations, etc., the embodiment of the present invention does not limit the specific form of interaction with children.
[0046] In the embodiment of the present invention, there are many ways to detect whether there is a child passenger in the car, for example, the pressure sensor corresponding to the rear seat is used to collect pressure information for detection, and another example is to call an image acquisition device in the car such as a high-definition camera to collect images. For the detection, for example, the information of the ISOFIX (International Standards Organization FIX, child safety seat fixing system) interface is obtained for detection, etc.; this is not limited in the embodiment of the present invention.
[0047] To sum up, in the embodiment of the present invention, it is possible to detect whether there is a child passenger in the car, and when it is determined that there is a child passenger in the car, it is possible to determine the multimedia data corresponding to the child passenger and having child characteristics; so that subsequent passengers can Interacting with the vehicle-mounted system based on the multimedia data with children's characteristics realizes the interaction between children and the vehicle-mounted system.
[0048] In another embodiment of the present invention, after determining the multimedia data corresponding to the child passenger and playing the voice prompt information with children's characteristics, the passenger can interact with the vehicle system based on the multimedia data, as follows:
[0049] refer to figure 2 , which shows a flow chart of steps in an optional embodiment of an interaction method of the present invention, which may specifically include the following steps:
[0050] Step 202, detecting whether there are child passengers in the vehicle.
[0051] In an implementation of the embodiment of the present invention, the child mode can be pre-configured for the vehicle system, and the corresponding trigger conditions can be set for the child mode. When the vehicle system detects that the vehicle environment meets the trigger conditions of the child mode, the child mode can be triggered Furthermore, after the child mode is triggered, the passenger can send a voice command to the on-board system, and correspondingly, the on-board system can receive the passenger's voice command and perform the operation corresponding to the voice command, thereby realizing the interaction between the on-board system and the child. Wherein, the children's mode may refer to a mode for interaction based on multimedia data with children's characteristics; the vehicle environment may include an in-vehicle environment or an out-of-vehicle environment, which is not limited in this embodiment of the present invention.
[0052] In an implementation of the embodiment of the present invention, the trigger condition corresponding to the child mode can be set as follows: there is a child passenger in the car; therefore, in the embodiment of the present invention, after the on-board system is started, it can automatically detect whether there is a child in the car Passengers; it is also possible to automatically detect whether there are child passengers in the vehicle after the on-board system remains on and detects that there are child passengers getting on and off the vehicle; this embodiment of the present invention is not limited. Among them, the camera inside the car and the camera outside the car can be used to collect images during the process of the vehicle changing from a stopped state to a driving state, and through image analysis, it is detected whether there are children passengers getting on and off the vehicle.
[0053] In the embodiment of the present invention, after the passenger sits on the seat, the pressure information collected by the seat pressure sensor will be greater than the pressure information collected when no passenger is seated on the seat, and the weight ranges corresponding to child passengers and adult passengers are different For example, the corresponding weight range for adult passengers can be >40kg, and the weight range for child passengers can be 10kg-30kg. Therefore, in an example of the present invention, a method of detecting whether there is a child passenger in the car may be to call the seat pressure sensor to obtain pressure information, and if the pressure information belongs to the pressure range of the child, it is determined that there is a child passenger in the car; Wherein, the seat pressure sensor may refer to the pressure sensor of the rear seat. Among them, the child's pressure range can be determined according to the weight range corresponding to the child passenger, and then the pressure information obtained by calling the seat pressure sensor can be compared with the child's pressure range to determine whether the pressure information belongs to the child's pressure range.
[0054] In the embodiment of the present invention, a child seat can be pre-installed on the seat of the vehicle, and then the child is allowed to sit on the child seat to enhance the protection of the child; therefore, in another example of the present invention, a detection vehicle The method of whether there is a child passenger in the car may be to obtain the status information of the ISOFIX interface of the child safety seat fixing system, and if the ISOFIX interface is determined to be connected according to the status information, then it is determined that there is a child passenger in the car.
[0055] In the embodiment of the present invention, the body shape and facial features of child passengers are different from those of adult passengers. Therefore, in another example of the present invention, a method of detecting whether there are child passengers in the car can be Yes, calling the image acquisition device to acquire image data, and if it is recognized that there is a child in the image data, it is determined that there is a child passenger in the vehicle; wherein, the image acquisition device may refer to an in-vehicle image acquisition device such as a camera. Wherein, it is possible to identify the persons in the image, analyze the facial features and/or body shapes of each person, and determine whether there is a child in the image.
[0056] Of course, it is also possible to combine at least two of the above-mentioned methods to detect whether there are child passengers in the vehicle, and when at least two of them are satisfied, it can be determined that there are child passengers in the vehicle; for example: when the pressure information belongs to child pressure range, and when it is determined that the ISOFIX interface is connected, it is confirmed that there are child passengers in the car. For another example, when the pressure information belongs to the pressure range of children, and it is recognized that there are children in the image data, it is confirmed that there are child passengers in the car. Also for example: when the pressure information belongs to the pressure range of children, and it is determined that the ISOFIX interface is connected, and it is recognized that there is a child in the image data, it is determined that there is a child passenger in the car; and so on. The embodiment of the present invention does not limit how many ways to combine to realize whether there is a child passenger in the vehicle.
[0057] Step 204, when it is determined that there is a child passenger in the vehicle, identify the child passenger.
[0058] In the embodiment of the present invention, the multimedia data that the child passenger may like can be determined based on the multimedia data played when the child passenger rides the vehicle, such as nursery rhymes, cartoons, etc.; Passengers recommend multimedia data that they may like. In addition, when a certain multimedia data has not been played completely during the child passenger's ride in the vehicle before, the multimedia data may continue to be played when the child passenger rides in the vehicle again. Therefore, in the embodiment of the present invention, when it is determined that there is a child passenger in the car, the child mode can be triggered, and then the identity of the child passenger can be identified to determine the identity information of the child passenger; Multimedia data corresponding to passengers.
[0059] Among them, the feature extraction can be performed according to the image collected by the image acquisition device, and then the extracted feature information is compared with the pre-stored feature information in the database; if there is pre-stored feature information matching the extracted feature information in the database, it can be determined If the identification of the child passenger is successful, the identity information corresponding to the matched pre-stored characteristic information may be determined as the identity information of the child passenger, and then step 206 may be executed. If there is no pre-stored feature information matching the extracted feature information in the database, it means that the identification fails, and step 208 can be executed at this time.
[0060] Step 206, if the identification is successful, search for multimedia data matching the identity information of the child passenger.
[0061] In the embodiment of the present invention, if the identification of the child passenger is successful, the multimedia data corresponding to the child passenger can be searched based on the identity information of the child passenger; The multimedia data that it may like can also search for the multimedia data played by the child passenger history, wherein the multimedia data played by the history is such as the multimedia data that has been played, or the multimedia data that has not been played last time; The multimedia data is determined to be multimedia data corresponding to the child passenger.
[0062] Step 208, if the identification fails, determine the preset multimedia data as the multimedia data corresponding to the child passenger.
[0063] In the embodiment of the present invention, if the identification of the child passenger fails, the preset multimedia data may be determined as the multimedia data corresponding to the child passenger; wherein, the preset multimedia data may be All multimedia data with children's characteristics may also be the top N (N is a positive integer) pieces of multimedia data with the highest playback frequency, etc., which is not limited in this embodiment of the present invention.
[0064] Step 210, playing the voice prompt information with characteristics of children.
[0065]In the embodiment of the present invention, after the child mode is triggered, voice prompt information with children's characteristics can also be played to remind passengers that they can interact with the vehicle system; the voice prompt information can include at least one of the following: welcome information, safety prompts Information and exchange guidance information; of course, other voice prompt information may also be included, which is not limited in this embodiment of the present invention. Among them, the welcome information can be used to improve the interaction experience of passengers, such as "cute, let's start a wonderful journey together!", "little baby, it's finally you!" To remind child passengers to ride safely, such as "cute, sit down obediently along the way!", etc.; the interactive guidance prompt information can be used to remind child passengers to interact, such as "little master, do you have any instructions?" , "Little master, I can sing, what nursery rhymes do you like to listen to?", "Little master, do you want to continue watching the last episode of "Peppa Pig"?", "Little master, do you want to listen to a nursery rhyme?" and many more.
[0066] Wherein, when the identification of the child passenger is successful, the voice prompt information matching the child passenger can be obtained from preset voice prompt information based on the identity information of the child passenger; When the identification of the passenger fails, the default voice prompt information can be obtained as the voice prompt information matched with the child passenger.
[0067] In addition, after the child mode is triggered, the ambient light in the car can also be changed; when the identity of the child passenger is successfully identified, based on the identity information of the child passenger, it can be obtained from the preset change mode of the ambient light. The changing mode of the ambient light matching the child passenger; when the identification of the child passenger fails, a default changing mode of the ambient light may be obtained as the changing mode of the ambient light matching the child passenger. Wherein, the changing manner of the ambient light includes but not limited to the changing manner of the color of the ambient light, the changing manner of on-off frequency of the ambient light, and the like.
[0068] In the embodiment of the present invention, if the passenger performs the control operation according to the played interactive guidance information, the vehicle-mounted system can receive the corresponding control command; then it can control the multimedia data corresponding to the control command, such as playing, switching, etc. Refer to steps 214-216. Wherein, the control operation may be voice control or manual touch screen control, which is not limited in this embodiment of the present invention. If the passenger does not perform the control operation according to the played exchange guidance information, step 212 may be executed.
[0069] Step 212: Display the multimedia data corresponding to the child passenger on the display device.
[0070] In the embodiment of the present invention, display information corresponding to multimedia data with children's characteristics can be displayed on a display device such as a vehicle display screen; wherein, the multimedia data with children's characteristics can include various types, such as cartoons, nursery rhymes, and Audiobooks and the like are not limited in this embodiment of the present invention. Wherein, the presentation information of the multimedia data may include multiple types, such as the cover, name, category, etc. of the multimedia data, which is not limited in this embodiment of the present invention. In an example of the present invention, such as image 3 As shown, the display device displays the display information of nursery rhymes, such as the categories of nursery rhymes such as "English enlightenment nursery rhymes", "50 widely sung nursery rhymes" and "ancient Chinese folk songs selection"; of course, the display device can also use other forms, The display information of the multimedia data is displayed, which is not limited in this embodiment of the present invention. It is convenient for passengers to view multimedia data with children's characteristics through the display device, and to interact based on the displayed multimedia data.
[0071] Step 214: Receive a control instruction for the multimedia data.
[0072] Step 216: Play the video data corresponding to the control instruction on the display device, and/or play the audio data corresponding to the control instruction in the zone corresponding to the child passenger.
[0073] In the embodiment of the present invention, after step 210 or after step 214, the passenger performs a corresponding control operation on the multimedia data; the corresponding on-board system can receive the corresponding control instruction, and then can follow the control instruction The corresponding multimedia data is controlled. Wherein, the video data corresponding to the control instruction can be played in the display device, and the audio data corresponding to the control instruction can also be played in the partition corresponding to the child passenger; for example, a cartoon can be played in the display device, and The audio corresponding to the cartoon is played in the zone corresponding to the child passenger, and for example, nursery rhymes, audio books, etc. can be played in the zone corresponding to the child passenger.
[0074] For example, if the passenger speaks the voice play command "play an English enlightenment nursery rhyme", after the vehicle system receives the voice play command, it can select a song such as "Hello Song" from all the nursery rhymes in the category of "English enlightenment nursery rhymes". , and then play the nursery rhyme "Hello Song" in the zone corresponding to the child passenger.
[0075] For another example, the passenger speaks out the voice play command "play "Peppa Pig", after the vehicle system receives the voice play command, it can select an episode from all the video collections of "Peppa Pig", and then display it on the display device. Play the video data of "Peppa Pig" on the Internet, and play the corresponding audio in the corresponding zone of the child passenger.
[0076] Of course, controlling the corresponding multimedia data according to the control instruction may also include other controls on the corresponding multimedia data; for example, switching of multimedia data, turning pages in the display device, pausing the multimedia data being played, and adjusting the volume of the multimedia data Etc., the embodiment of the present invention does not limit this.
[0077] To sum up, in the embodiment of the present invention, when it is determined that there are child passengers in the vehicle, the child mode is triggered, the multimedia data corresponding to the child passenger is determined, and the voice prompt information with child characteristics is played, the display device can display the The child passenger can display the corresponding multimedia data; it is also possible to receive the control instruction for the multimedia data with children’s characteristics, and then play the video data corresponding to the control instruction on the display device, and/or, in the child passenger The corresponding partition plays the audio data corresponding to the control instruction; thus realizing interaction with the child passenger.
[0078] Secondly, in the embodiment of the present invention, there are many ways to detect whether there are child passengers in the car. One method may be to call the seat pressure sensor to collect pressure information. If the pressure information falls within the pressure range of children, it is determined that there are children in the car. Passenger; another kind can be to obtain the status information of the ISOFIX interface of the child safety seat fixing system, if it is determined that the ISOFIX interface is connected according to the status information, then it is determined that there is a child passenger in the car; another kind can be called The image acquisition device acquires image data, and if it is recognized that there is a child in the image data, it is determined that there is a child passenger in the car; certainly, at least two of the above-mentioned judgments can be used to determine that there is a child passenger in the car; thereby improving the detection of whether there is a child in the car. passenger accuracy.
[0079] In another embodiment of the present invention, after identifying the child passenger and determining the corresponding seat belt interface connection of the child passenger, the vehicle-mounted system automatically adjusts the length of the seat belt of the child passenger; After finishing, interact with child passengers to strengthen the protection of child passengers.
[0080] refer to Figure 4 , showing a flow chart of the steps of another alternative embodiment of the interaction method of the present invention, specifically including the following steps:
[0081] Step 402, after determining that the seat belt interface corresponding to the child passenger is connected, if the identification fails, obtain the circumference information of the child passenger.
[0082] In the embodiment of the present invention, after the child mode is triggered and the identity of the child passenger is identified, it can be determined whether the seat belt interface corresponding to the child passenger is connected, and after determining that the seat belt interface corresponding to the child passenger is connected, it can automatically Adjust the seat belt corresponding to the child passenger. Wherein, if the identification fails, it can indicate that the child passenger has never been in the vehicle, and at this time the circumference information of the child passenger can be obtained, so as to adjust the length of the seat belt corresponding to the child passenger according to the circumference information. Wherein, the circumference information may refer to information used to characterize a child's body circumference, such as waist circumference information, shoulder width information, and the like.
[0083] In an example of the present invention, a manner of obtaining the circumference information of the child passenger may be to determine the weight information of the child passenger according to the pressure information, and determine the circumference information of the child passenger according to the weight information. Among them, the first circumference mapping relationship between weight information and circumference information can be established in advance, for example, (10kg-13kg)-circumference A1, (13kg-16kg)-circumference B1, (16kg-19kg)-circumference C1, (19kg~22kg)-circumference D1, (22kg~25kg)-circumference E1, (25kg~28kg)-circumference F1, (28kg~31kg)-circumference G1; of course, the first circumference mapping for each item The weight range in the relationship and the corresponding circumference information can be determined according to requirements, which is not limited in this embodiment of the present invention. Then, after determining the weight information of the child passenger based on the pressure information obtained by the pressure sensor and the relationship between the pressure information and the weight information; the first circumference mapping relationship can be searched based on the weight information of the child passenger to determine the weight information of the child passenger. Circumference information of the passenger; for example, it is determined that the weight information of the child passenger is 15kg, and by searching the first circumference mapping relationship, it can be determined that the circumference information of the child passenger is circumference B1.
[0084] In an example of the present invention, a method for obtaining the circumference information of the child passenger may be to determine the body shape characteristics of the child passenger according to the image data, and determine the circumference information of the child passenger according to the body shape characteristics; Wherein, the body shape feature may refer to information used to describe the passenger's fatness or thinness, such as thin, thin, normal, overweight, and fat. Among them, the second circumference mapping relationship between body shape characteristics and circumference information can be established in advance, such as thin-circumference A2, thin-circumference B2, normal-circumference C2, overweight-circumference D2, fat-circumference Girth E2; of course, the body shape characteristics and corresponding girth information in each second girth mapping relationship can be determined according to requirements, which is not limited in this embodiment of the present invention. After determining the body shape characteristics of the child passenger through image recognition, the circumference information matching the body shape characteristics of the child passenger can be searched based on the second circumference mapping relationship, and then the circumference information of the child passenger is determined; for example, determining The body shape characteristic of the child passenger is overweight, and by searching the second circumference mapping relationship, it can be determined that the circumference information of the child passenger is D2.
[0085] Certainly, in the embodiment of the present invention, the circumference information of the child passenger can be determined in combination with weight information and body shape characteristics; wherein, a third circumference mapping relationship between the weight information and body shape characteristics and the circumference information can be established in advance, for example : (10kg~13kg), lean—circumference A3, (10kg~13kg), normal—circumference B3, (13kg~16kg), overweight—circumference C3,……. Furthermore, after obtaining the weight information and body shape characteristics of the child passenger, the third circumference mapping relationship can be searched to determine the circumference information of the child passenger.
[0086] Step 404: Generate a corresponding first seat belt adjustment instruction according to the circumference information of the child passenger.
[0087] Step 406: Send the first seat belt adjustment command to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor adjusts the length of the seat belt corresponding to the child passenger according to the first seat belt adjustment command.
[0088]Then, according to the circumference information corresponding to the child passenger, a first seat belt adjustment command can be generated, and the first seat belt adjustment command can be sent to the seat belt sensor corresponding to the child passenger; The belt adjustment command can be used to adjust the length of the seat belt, including the adjustment type information (releasing type information and tightening type information) and the adjustment length information of the seat belt. After the seat belt sensor receives the first seat belt adjustment instruction, it can obtain the adjustment type information and the corresponding adjustment length information of the seat belt from the first seat belt adjustment instruction; For the safety belt, adjust the corresponding adjustment length information according to the adjustment type information. For example, the adjustment type information included in the first seat belt adjustment instruction is tightening type information, and the adjustment length information is 2 cm, then the seat belt sensor tightens the seat belt length of the child passenger by 2 cm after receiving the instruction.
[0089] In an example of the present invention, a method of generating a corresponding first seat belt adjustment instruction according to the circumference information of the child passenger may include the following sub-steps:
[0090] Sub-step 22: Find the length mapping relationship based on the circumference information of the child passenger, and determine the target length information of the seat belt.
[0091] Sub-step 24: Generate a corresponding first seat belt adjustment instruction according to the target length information and current length information of the seat belt.
[0092] In the embodiment of the present invention, the length mapping relationship between the girth information and the length information of the safety belt can be established in advance, for example, girth A1—seat belt length L1, girth B1—seat belt length L2, girth C1—seat belt length L3. Then search the length mapping relationship based on the circumference information of the child passenger, determine the length information of the matching seat belt, and use the found length information of the seat belt as the target length information. Then the difference between the target length information of the seat belt and the current length information of the seat belt can be calculated; if the difference between the two is a positive number, it is determined that the seat belt needs to be relaxed, so the absolute value of the relaxation type and the difference can be used , to generate first seat belt adjustment information. If the difference between the two is negative, it is determined that the seat belt needs to be tightened, so the first seat belt adjustment information can be generated according to the tightening type information and the absolute value of the difference
[0093] Step 408: After determining that the seat belt interface corresponding to the child passenger is connected, if the identification is successful, search for matching seat belt length information based on the child passenger's identity information.
[0094] Step 410: Generate a second seat belt adjustment instruction according to the matched seat belt length information.
[0095] Step 412: Send the second seat belt adjustment command to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor adjusts the length of the seat belt corresponding to the child passenger according to the second seat belt adjustment command.
[0096] In the embodiment of the present invention, after determining that the seat belt interface corresponding to the child passenger is connected, if the identification is successful, it means that the child passenger has ridden in the vehicle last time. The seat belt length information, and then generate a second seat belt adjustment instruction according to the matched seat belt length information. Wherein, the corresponding second seat belt adjustment instruction may be generated according to the matched seat belt length information and the current length information, which is similar to the above-mentioned sub-step 24 and will not be repeated here.
[0097] Step 414 , judging whether the intensity of the activity of the child passenger is greater than the intensity threshold.
[0098] Step 416, if yes, generate a third seat belt adjustment instruction according to preset rules.
[0099] Step 418: Send the third seat belt adjustment command to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor increases the length of the seat belt corresponding to the child passenger according to the third seat belt adjustment command.
[0100] In an optional embodiment of the present invention, some child passengers may move vigorously during the ride. If the seat belt is too tight, it may cause discomfort to the child. Therefore, the first seat belt adjustment instruction/second After the second seat belt command is sent to the seat belt sensor corresponding to the child passenger, it can be determined whether the intensity of the child passenger's activity is greater than the violent activity threshold; if so, a third seat belt adjustment command is generated according to preset rules; The third seat belt adjustment command is sent to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor increases the length of the seat belt corresponding to the child passenger according to the third seat belt adjustment command; Properly loosen the seat belt under the premise to ensure a comfortable experience. Wherein, the strenuous activity threshold can be set according to requirements, and the preset rule can also be set according to requirements, such as increasing the length of the seat belt by 10%; this is not limited in the embodiment of the present invention. In the embodiment of the present invention, whether the activity intensity of the child passenger is greater than the intensity threshold can be checked in real time or periodically; wherein, the third seat belt adjustment instruction can be used to increase the seat belt corresponding to the child passenger. The length instruction may include relaxation type information and relaxation length information; wherein, the generation method of the third seat belt adjustment instruction is similar to the above-mentioned generation method of the first seat belt adjustment instruction, and will not be repeated here.
[0101] After the third seat belt adjustment instruction is sent to the seat belt sensor corresponding to the child passenger, if it is determined that the activity intensity of the child passenger is less than the vigorous activity threshold, a fourth seat belt adjustment instruction may be generated; The fourth seat belt adjustment instruction is sent to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor shortens the length of the seat belt corresponding to the child passenger according to the fourth seat belt adjustment instruction. Wherein, the fourth seat belt adjustment instruction may refer to an instruction for shortening the length of the corresponding seat belt of the child passenger, and may include tightening type information and tightening length information; in addition, the fourth seat belt adjustment instruction may also Set according to the corresponding preset rules, such as increasing the length of the seat belt by 10%, etc., which is not limited in the embodiment of the present invention.
[0102] Among them, the image acquisition device can be called to collect images within a certain period of time, and then by analyzing the images within this period of time, the movement trajectory of the child passenger's limbs can be determined to determine that the intensity of the child passenger's activity is greater than the violent activity threshold.
[0103] In an optional embodiment of the present invention, some child passengers are likely to fall asleep during the ride; therefore, it can be judged whether the child passengers are falling asleep; when it is determined that the children are falling asleep, a prompt message for the children falling asleep is played; And the operation of adjusting the environmental parameters in the vehicle is performed, so as to adjust the environment in the vehicle to an environment favorable for child passengers to sleep. Wherein, the prompt information of the child falling asleep can be used to remind the adult passenger that the child passenger has fallen asleep, so that the adult passenger pays attention to the volume of speaking, puts away the food in the hands of the child passenger, covers the child passenger with a quilt, and so on. In addition, the vehicle-mounted system can automatically perform at least one of the following operations to adjust the environmental parameters in the vehicle: perform at least one of the following operations to reduce the volume: reduce the playback volume of multimedia data, reduce the volume of ringtones for incoming calls, and reduce the volume of voice calls; Execute the operation of adjusting the seat corresponding to the child passenger to a preset elevation angle; perform the operation of adjusting the parameter of the air conditioner corresponding to the child passenger to a preset threshold, wherein the parameter includes at least one of the following: temperature, direction and air volume. Wherein, the operation of reducing the volume may include reducing the volume to a volume threshold, and the corresponding volume thresholds may be different or the same for different operations of reducing the volume, which may be set according to requirements, which is not limited in this embodiment of the present invention; , the preset elevation angle and the preset threshold can also be set according to requirements. Of course, the vehicle-mounted system can also perform an operation of adjusting the environmental parameters in the vehicle, so as to adjust the environment in the vehicle to an environment conducive to the sleeping of children and passengers, which is not limited in this embodiment of the present invention.
[0104] To sum up, in the embodiment of the present invention, after triggering the child mode and performing identity recognition, it can be determined that the seat belt interface corresponding to the child passenger is connected, and if the identity verification fails, the circumference information of the child passenger can be obtained; according to the According to the circumference information of the child passenger, a corresponding first seat belt adjustment command is generated; the first seat belt adjustment command is sent to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor Adjusting the instruction to adjust the length of the seat belt corresponding to the child passenger; and if the identity verification is successful, searching for matching seat belt length information based on the identity information of the child passenger; generating a second seat belt according to the matching seat belt length information an adjustment instruction, and send the second seat belt adjustment instruction to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor adjusts the length of the seat belt corresponding to the child passenger according to the second seat belt adjustment instruction. Furthermore, the length of the seat belt of the child passenger can be automatically adjusted according to the circumference information, so that the child passenger can be more comfortable while ensuring the safety of the child passenger, and the operation of the adult passenger can be saved.
[0105] Secondly, in the embodiment of the present invention, after the first seat belt adjustment command/second seat belt adjustment command is sent to the seat belt sensor corresponding to the child passenger, the vehicle-mounted system can also determine whether the child passenger is Whether the intensity of the activity is greater than the threshold of vigorous activity; if so, generate a second seat belt adjustment instruction according to preset rules; send the second seat belt adjustment instruction to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor The length of the corresponding seat belt of the child passenger is increased according to the second seat belt adjustment instruction; thereby, the comfort of the active child passenger can be ensured.
[0106] Further, the embodiment of the present invention can also judge whether the child passenger is asleep; when it is determined that the child is falling asleep, play a reminder message that the child is falling asleep; The environment in which child passengers sleep; thereby reducing the impact on the sleep of child passengers and ensuring the comfort of child passenger sleep.
[0107] It should be noted that, for the method embodiment, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the embodiment of the present invention is not limited by the described action sequence, because According to the embodiment of the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.
[0108] refer to Figure 5 , which shows a structural block diagram of an embodiment of an interactive device in the present invention, which may specifically include the following modules:
[0109] A detection module 502, configured to detect whether there is a child passenger in the vehicle;
[0110] The information determination module 504 is configured to determine multimedia data corresponding to the child passenger when it is determined that there is a child passenger in the vehicle, and the multimedia data has a child characteristic; so as to perform interaction based on the multimedia data.
[0111] refer to Image 6 , which shows a structural block diagram of an optional embodiment of an interaction device in the present invention, which may specifically include the following modules:
[0112] In an optional embodiment of the present invention, the detection module 502 includes:
[0113] The pressure detection sub-module 5022 is used to call the seat pressure sensor to collect pressure information, and if the pressure information belongs to the pressure range of children, it is determined that there are child passengers in the car;
[0114] The interface state detection sub-module 5024 is used to obtain the state information of the ISOFIX interface of the child safety seat fixing system, and if it is determined that the ISOFIX interface is connected according to the state information, then it is determined that there is a child passenger in the vehicle;
[0115] The image recognition sub-module 5026 is used to call the image acquisition device to obtain image data, and if it is recognized that there is a child in the image data, then it is determined that there is a child passenger in the vehicle.
[0116] In an optional embodiment of the present invention, the device further includes:
[0117] An identification module 506, configured to identify the child passenger;
[0118] The information determination module 504 is configured to search for multimedia data that matches the identity information of the child passenger if the identification is successful; if the identification fails, determine the preset multimedia data as the multimedia data corresponding to the child passenger. data.
[0119] In an optional embodiment of the present invention, the device further includes:
[0120] The circumference information acquiring module 508 is configured to acquire the circumference information of the child passenger after identifying the child passenger and after determining that the seat belt interface corresponding to the child passenger is connected, if the identification fails;
[0121] A first adjustment instruction generation module 510, configured to generate a corresponding first seat belt adjustment instruction according to the circumference information of the child passenger;
[0122] The first adjustment command sending module 512 is configured to send the first seat belt adjustment command to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor adjusts the child passenger according to the first seat belt adjustment command Corresponds to the length of the seat belt.
[0123] In an optional embodiment of the present invention, the circumference information acquisition module 508 is specifically configured to determine the weight information of the child passenger according to the pressure information, and determine the circumference information of the child passenger according to the weight information; and/ Or, determine the body shape characteristics of the child passenger according to the image data, and determine the circumference information of the child passenger according to the body shape characteristics.
[0124] In an optional embodiment of the present invention, the first adjustment instruction generating module 510 is specifically configured to search for a length mapping relationship based on the circumference information of the child passenger, and determine the target length information of the seat belt; The target length information and the current length information generate a corresponding first seat belt adjustment instruction.
[0125] In an optional embodiment of the present invention, the device further includes:
[0126] The length information acquisition module 514 is configured to search for matching seat belt length information based on the identity information of the child passenger after determining that the seat belt interface corresponding to the child passenger is connected;
[0127] The second adjustment instruction generating module 516 is configured to generate a second seat belt adjustment instruction according to the matched seat belt length information;
[0128] The second adjustment command sending module 518 is configured to send the second seat belt adjustment command to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor adjusts the child passenger according to the second seat belt adjustment command Corresponds to the length of the seat belt.
[0129] In an optional embodiment of the present invention, the device further includes:
[0130] An activity state judging module 520, configured to judge whether the intensity of the activity of the child passenger is greater than the threshold of intense activity;
[0131] The third adjustment instruction generation module 522 is configured to generate a third safety belt adjustment instruction according to preset rules if yes;
[0132] The third adjustment command sending module 524 is configured to send the third seat belt adjustment command to the seat belt sensor corresponding to the child passenger, so that the seat belt sensor increases the seat belt sensor of the child passenger according to the third seat belt adjustment command. Corresponds to the length of the seat belt.
[0133] In an optional embodiment of the present invention, the device further includes:
[0134] The display module 526 is configured to display the multimedia data corresponding to the child passenger on the display device.
[0135] In an optional embodiment of the present invention, the device further includes:
[0136] Falling asleep state judging module 528, for judging whether the child passenger is falling asleep;
[0137] The environment parameter adjustment module 530 is configured to perform an operation of adjusting the environment parameters in the vehicle when it is determined that the child is falling asleep, so as to adjust the environment in the vehicle to an environment favorable for child passengers to sleep.
[0138] In an optional embodiment of the present invention, the environmental parameter adjustment module 530 is specifically configured to perform at least one of the following volume reduction operations: reducing the playback volume of multimedia data, reducing the volume of ringtones for incoming calls, and reducing the volume of voice calls; and /or perform the operation of adjusting the seat corresponding to the child passenger to a preset elevation angle; and/or perform the operation of adjusting the parameters of the child passenger’s corresponding zone air conditioner to a preset threshold, wherein the parameters include at least one of the following Types: temperature, direction and air volume.
[0139] In an optional embodiment of the present invention, it is characterized in that the device further includes:
[0140] The transformation module 532 is used to transform the ambient light in the car.
[0141] To sum up, in the embodiment of the present invention, it is possible to detect whether there is a child passenger in the car, and when it is determined that there is a child passenger in the car, determine the multimedia data corresponding to the child passenger and having child characteristics; so that subsequent passengers can be based on The multimedia data with children's characteristics interacts with the vehicle-mounted system to realize the interaction between children and the vehicle-mounted system.
[0142] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiment.
[0143] An embodiment of the present invention also provides a vehicle, which may include a processor, a memory, and a computer program stored on the memory and capable of running on the processor. When the computer program is executed by the processor, the interaction method described in the above embodiment is implemented. .
[0144] An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the interaction method described in the above-mentioned embodiments is implemented.
[0145] Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other.
[0146] Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, devices, or computer program products. Accordingly, embodiments of the invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
[0147] Embodiments of the present invention are described with reference to flowcharts and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor or processor of other programmable data processing terminal equipment to produce a machine such that instructions executed by the computer or processor of other programmable data processing terminal equipment generated for implementation in the process Figure 1 process or multiple processes and/or boxes Figure 1 means for the function specified in one or more boxes.
[0148] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the The command device is implemented in the flow Figure 1 process or multiple processes and/or boxes Figure 1 function specified in one or more boxes.
[0149] These computer program instructions can also be loaded into a computer or other programmable data processing terminal equipment, so that a series of operational steps are performed on the computer or other programmable terminal equipment to produce computer-implemented processing, thereby The instructions executed on provide the flow for implementing the Figure 1 process or multiple processes and/or boxes Figure 1 steps of the function specified in the box or boxes.
[0150] Having described preferred embodiments of embodiments of the present invention, additional changes and modifications to these embodiments can be made by those skilled in the art once the basic inventive concept is appreciated. Therefore, the appended claims are intended to be construed to cover the preferred embodiment and all changes and modifications which fall within the scope of the embodiments of the present invention.
[0151] Finally, it should also be noted that in this text, relational terms such as first and second etc. are only used to distinguish one entity or operation from another, and do not necessarily require or imply that these entities or operations, any such actual relationship or order exists. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or terminal equipment comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements identified, or also include elements inherent in such a process, method, article, or end-equipment. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or terminal device comprising said element.
[0152] An interactive method, an interactive device, and a vehicle provided by the present invention have been introduced in detail above. In this paper, specific examples are used to illustrate the principle and implementation of the present invention. The description of the above embodiments is only used To help understand the method of the present invention and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and scope of application. In summary, this specification The content should not be construed as a limitation of the invention.
PUM


Description & Claims & Application Information
We can also present the details of the Description, Claims and Application information to help users get a comprehensive understanding of the technical details of the patent, such as background art, summary of invention, brief description of drawings, description of embodiments, and other original content. On the other hand, users can also determine the specific scope of protection of the technology through the list of claims; as well as understand the changes in the life cycle of the technology with the presentation of the patent timeline. Login to view more.
Similar technology patents
Remote fetal education system with fetal heart monitoring function
InactiveCN108261207Aovercoming distance barriersachieve interaction
Owner:KONFOONG BIOTECH INT
Information system for enterprise financial reimbursement management
InactiveCN106355383AReduce data inaccuracyachieve interaction
Owner:苏州阳明诚一商业管理有限公司
Classification and recommendation of technical efficacy words
- achieve interaction
Information system for enterprise financial reimbursement management
InactiveCN106355383AReduce data inaccuracyachieve interaction
Owner:苏州阳明诚一商业管理有限公司
Remote fetal education system with fetal heart monitoring function
InactiveCN108261207Aovercoming distance barriersachieve interaction
Owner:KONFOONG BIOTECH INT