Prompting method and device for carrying special passenger on motor vehicle and computer readable storage medium

Abstract

The embodiment of the invention provides a prompting method and device for a special passenger carried on a motor vehicle and a computer readable storage medium. Image analysis is performed according to video images of a motor vehicle cabin acquired and provided by an in-vehicle monitoring camera so as to identify passengers in a riding area of the motor vehicle cabin, and a passenger classification instruction is output when the passengers are identified; the passenger classification instruction is responded, whether the identified passenger is a special passenger or not is judged, if yes, a special passenger instruction is output to control a display device at a preset position on the motor vehicle to display preset prompt information corresponding to the special passenger, and the special passenger at least comprises an infant, the old and a pet. According to the embodiment of the invention, external personnel can be timely and effectively prompted that the motor vehicle carries special passengers.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of motor vehicle driving assistance technology, and more particularly to a method, device and computer-readable storage medium for prompting a motor vehicle that has a special passenger. Background Art

[0002] When a motor vehicle carries special passengers such as infants, the elderly and pets, the motor vehicle driver hopes to take effective warning measures to let outsiders (such as drivers of other vehicles or passers-by) know and be more cautious to keep a safe distance from the motor vehicle, so as to prevent other vehicles or passers-by from affecting the normal driving of the motor vehicle and causing adverse effects on the special passengers.

[0003] The traditional method of reminding that a motor vehicle is carrying special passengers is to post corresponding warning signs on the body of the motor vehicle. However, when a motor vehicle temporarily carries special passengers, it is difficult for the driver to prepare corresponding warning signs in advance, and thus it is impossible to provide effective warnings during the period of transportation. Moreover, when the motor vehicle does not carry special passengers, the posted warning signs are difficult to remove, and cannot provide accurate warnings, making them inconvenient to use. In addition, when the ambient light is weak, the warning signs are difficult for outsiders to clearly identify, resulting in outsiders still being unable to know that there are special passengers in the vehicle, and the warning effect is poor. Summary of the invention

[0004] The technical problem to be solved by the embodiments of the present invention is to provide a method for prompting that a motor vehicle is carrying a special passenger, which can promptly and effectively prompt external personnel that the motor vehicle is carrying a special passenger.

[0005] A further technical problem to be solved by the embodiments of the present invention is to provide a device for reminding that a motor vehicle carries special passengers, which can promptly and effectively remind external personnel that the motor vehicle carries special passengers.

[0006] A further technical problem to be solved by the embodiments of the present invention is to provide a computer-readable storage medium for storing a computer program that can promptly and effectively remind outsiders that the motor vehicle is carrying special passengers.

[0007] In order to solve the above technical problems, the embodiment of the present invention first provides the following technical solution: a method for prompting a motor vehicle that a special passenger is on board, comprising the following steps: During the driving of the motor vehicle, performing image analysis based on the video image of the motor vehicle cabin provided by the in-vehicle monitoring camera to identify the occupants in the seating area of ​​the motor vehicle cabin, and outputting an occupant classification instruction when the occupants are identified; and In response to the occupant classification instruction, it is determined whether the identified occupant is a special occupant. If so, a special occupant instruction is output to control a display device at a predetermined position on the motor vehicle to display preset prompt information corresponding to the special occupant. The special occupants include at least infants, the elderly and pets.

[0008] Further, performing image analysis based on the video image of the motor vehicle cabin provided by the in-vehicle monitoring camera to identify the occupants in the seating area of ​​the motor vehicle cabin specifically includes: Obtaining video images of the motor vehicle cockpit provided by vehicle monitoring cameras; Extracting an in-vehicle image from the video image; and A pre-stored deep learning algorithm model is used to perform image analysis on the in-vehicle image to identify occupants in the seating area of ​​the motor vehicle cabin.

[0009] Furthermore, the judgment as to whether the identified occupant is a special occupant is performed by classifying the occupant using the deep learning algorithm model to determine whether the occupant is a human or a pet. When the occupant is determined to be a human, a preset face recognition algorithm model is used to detect and identify the actual age of the occupant. When the actual age is less than a first preset age threshold, the occupant is determined to be an infant and the special occupant instructions for infants are output. When the actual age is greater than a second preset age threshold, the occupant is determined to be an elderly person and the special occupant instructions for the elderly are output.

[0010] Furthermore, when it is determined that the occupant is a pet, the special occupant instruction for the pet is output.

[0011] Furthermore, the preset prompt information is a prompt pattern and / or text that matches the special occupant.

[0012] Furthermore, the method further comprises: In response to a change instruction input by the user, the display device is controlled to change the prompt pattern and / or text for the special occupant.

[0013] On the other hand, in order to solve the above-mentioned further technical problems, an embodiment of the present invention also provides the following technical solutions: a device for prompting that a motor vehicle carries special passengers, which is connected to an in-vehicle monitoring camera and a display device assembled at a predetermined position on the outside of the motor vehicle body, the device comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, it implements the method for prompting that a motor vehicle carries special passengers as described in any one of the above items.

[0014] Furthermore, the display device is a display taillight, a display screen or a projection device of a motor vehicle.

[0015] On the other hand, in order to solve the above-mentioned further technical problems, an embodiment of the present invention also provides the following technical solutions: a computer-readable storage medium, the computer-readable storage medium includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the method for prompting that a motor vehicle carries special passengers as described in any one of the above items.

[0016] After adopting the above technical scheme, the embodiment of the present invention has at least the following beneficial effects: the embodiment of the present invention first performs image analysis based on the video image of the motor vehicle cabin collected by the in-vehicle monitoring camera during the driving of the motor vehicle to identify the occupants in the seating area of ​​the motor vehicle cabin, and then further determines whether the identified occupants are special occupants. If so, special occupant instructions are output to control the display device at a predetermined position on the body of the motor vehicle to display preset prompt information corresponding to the special occupants, thereby realizing automatic judgment and prompting. The prompts are timely and accurate, and are displayed through the display device, which can set sufficient brightness itself, so that it is convenient to be clearly identified by outsiders even under conditions of weak ambient light, and the prompt effect is good. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 The present invention is a flowchart of the steps of an optional embodiment of the method for prompting a motor vehicle that a special passenger is on board.

[0018] Figure 2 The present invention is a functional block diagram of an optional embodiment of the device for reminding a motor vehicle that there are special passengers.

[0019] Figure 3 The present invention is a functional module diagram of an optional embodiment of the device for reminding a motor vehicle that there are special passengers. DETAILED DESCRIPTION

[0020] The present application is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the following illustrative embodiments and descriptions are only used to explain the present invention and are not intended to limit the present invention. In addition, the embodiments and features in the embodiments of the present application may be combined with each other without conflict.

[0021] like Figure 1 As shown, an optional embodiment of the present invention provides a method for prompting a motor vehicle that carries a special passenger, comprising the following steps: S1: During the driving of the motor vehicle, performing image analysis based on the video image of the motor vehicle cabin provided by the in-vehicle monitoring camera 1 to identify the occupants in the seating area of ​​the motor vehicle cabin, and outputting an occupant classification instruction when the occupants are identified; and S2: Respond to the occupant classification instruction, determine whether the identified occupant is a special occupant, and if so, output a special occupant instruction to control the display device 2 at a predetermined position on the motor vehicle to display preset prompt information corresponding to the special occupant, and the special occupants include at least infants, the elderly and pets.

[0022] The embodiment of the present invention first performs image analysis based on the video images of the motor vehicle cabin collected by the in-vehicle monitoring camera during the driving of the motor vehicle to identify the occupants in the seating area of ​​the motor vehicle cabin, and then further determines whether the identified occupants are special occupants. If so, a special occupant instruction is output to control the display device at a predetermined position on the body of the motor vehicle to display preset prompt information corresponding to the special occupant, thereby realizing automatic judgment and prompting. The prompt is timely and accurate, and is displayed through the display device, which can set sufficient brightness itself, so that it can be clearly identified by outsiders even under conditions of weak ambient light, and the prompt effect is good.

[0023] In a specific implementation, the in-vehicle monitoring camera 1 may be an OMS camera of the motor vehicle or an in-vehicle camera installed separately; in addition, when the motor vehicle is powered on and started and the driving speed is greater than zero, it is determined that the motor vehicle starts to move.

[0024] In an optional embodiment of the present invention, the performing image recognition based on the video image of the motor vehicle cabin collected and provided by the in-vehicle monitoring camera to identify the occupants in the seating area of ​​the motor vehicle cabin specifically includes: Acquire the video image of the motor vehicle cockpit provided by the vehicle monitoring camera 1; Extracting an in-vehicle image from the video image; and A pre-stored deep learning algorithm model is used to perform image analysis on the in-vehicle image to identify occupants in the seating area of ​​the motor vehicle cabin.

[0025] In this embodiment, the in-vehicle image is first extracted from the video image of the vehicle monitoring camera 1, and then a deep learning algorithm model (for example, a CNN convolutional network model or a SVM algorithm model) that has been pre-trained with a large number of pictures is used for image analysis. The image analysis can be performed quickly to identify the occupants in the seating area.

[0026] In an optional embodiment of the present invention, the judgment as to whether the identified occupant is a special occupant is performed by classifying the occupant using the deep learning algorithm model to determine whether the occupant is a human or a pet. When the occupant is determined to be a human, a preset face recognition algorithm model is used to detect and identify the actual age of the occupant. When the actual age is less than a first preset age threshold (for example, 3 years old), the occupant is determined to be an infant and the special occupant instructions for infants are output. When the actual age is greater than a second preset age threshold (for example, 60 years old), the occupant is determined to be an elderly person and the special occupant instructions for the elderly are output.

[0027] In this embodiment, a deep learning algorithm model is also used to classify the identified occupants to determine whether the occupants are humans or pets. When determined to be humans, the actual age of the occupants is further quickly determined through face recognition. Furthermore, based on the actual age, it is accurately determined whether the occupants are special occupants such as infants or elderly people, and the identification is accurate and convenient.

[0028] In an optional embodiment of the present invention, when the occupant is determined to be a pet, the special occupant instruction for the pet is output. In this embodiment, when the occupant is determined to be a pet, the special occupant instruction for the pet is output, and the recognition efficiency is high.

[0029] In this embodiment, in an optional embodiment of the present invention, the preset prompt information is a prompt pattern and / or text that matches the special occupant. In this embodiment, the prompt information can use a prompt pattern or text that matches the special occupant. When a prompt pattern is used, for example: when the special occupant is an infant, the prompt pattern is an infant head or a milk bottle; when the special occupant is an elderly person, the prompt pattern is an elderly head or a cane; when the special occupant is a pet, the prompt pattern is a cat head or a dog head. The prompt effect is intuitive and accurate. It is preferred to use a combination of pictures and texts for prompting. Moreover, it is preferred to use a dynamic display method to display the prompt pattern and / or text.

[0030] In an optional embodiment of the present invention, the method further includes: In response to the change command input by the user, the display device 2 is controlled to change the prompt pattern and / or text for the special passenger. In this embodiment, the user can input the change command to change the prompt pattern and / or text, thereby improving the user experience.

[0031] On the other hand, Figure 2As shown, an optional embodiment of the present invention further provides a prompting device 3 for a motor vehicle carrying a special passenger, which is connected to an in-vehicle monitoring camera 1 and a display device 2 assembled at a predetermined position on the motor vehicle. The device 3 includes a processor 30, a memory 32, and a computer program stored in the memory 32 and configured to be executed by the processor 30. When the processor 30 executes the computer program, it implements the prompting method for a motor vehicle carrying a special passenger as described in any of the above embodiments.

[0032] Exemplarily, the computer program may be divided into one or more modules / units, which are stored in the memory 32 and executed by the processor to implement the present invention. The one or more modules / units may be a series of computer program instruction segments capable of implementing specific functions, which are used to describe the execution process of the computer program in the reminder device 3 for a special passenger on board a motor vehicle. For example, the computer program may be divided into Figure 3 The functional modules in the device 3 for reminding a motor vehicle that there are special passengers, wherein the image analysis module 41 and the special passenger identification module 42 respectively correspond to executing the above steps S1 and S2.

[0033] The reminder device 3 for a motor vehicle carrying a special passenger may be a computing device such as a desktop computer, a notebook, a PDA, and a cloud server. The reminder device 3 for a motor vehicle carrying a special passenger may include, but not limited to, a processor 30 and a memory 32. Those skilled in the art may understand that the schematic diagram is only an example of the reminder device 3 for a motor vehicle carrying a special passenger, and does not constitute a limitation on the reminder device 3 for a motor vehicle carrying a special passenger, and may include more or less components than shown in the figure, or a combination of certain components, or different components, for example, the reminder device 3 for a motor vehicle carrying a special passenger may also include input and output devices, network access devices, buses, etc.

[0034] The processor 30 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor 30 is the control center of the vehicle-carrying special passenger reminder device 3, and uses various interfaces and lines to connect various parts of the vehicle-carrying special passenger reminder device 3.

[0035] The memory 32 can be used to store the computer program and / or module. The processor 30 realizes various functions of the reminder device 3 for a special passenger on a motor vehicle by running or executing the computer program and / or module stored in the memory 32 and calling the data stored in the memory 32. The memory 32 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a graphic recognition function, a graphic overlay function, etc.), etc.; the data storage area can store data (such as graphic data, etc.) created according to the use of the control device, etc. In addition, the memory 32 can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0036] If the functions described in the embodiments of the present invention are implemented in the form of software function modules or units and sold or used as independent products, they can be stored in a storage medium readable by a computing device. Based on this understanding, the embodiments of the present invention implement all or part of the processes in the above-mentioned embodiments, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor 30, the steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0037] In an optional embodiment of the present invention, the display device 2 is a display taillight, display screen or projection device of a motor vehicle. This embodiment provides a variety of types of display devices 2 for selection in practical applications, for example: the display taillight that comes with or is added to the rear of the motor vehicle can be used as the display device 2 to display prompt information. The display taillight usually uses a liquid crystal display screen and is a built-in device on some vehicles. Its prompt effect is eye-catching. If the display taillight that comes with some motor vehicles can be directly used, it is also helpful to reduce costs. Of course, it is understandable that according to the type of the display device 2 and the direction in which the prompt is required, the installation position of the display device 2 can also be the roof, the side of the body, the front of the vehicle, and of course it can also be set inside the vehicle.

[0038] On the other hand, an optional embodiment of the present invention provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the method for prompting that a motor vehicle is carrying a special passenger as described in any of the above embodiments.

[0039] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0040] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the enlightenment of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, which all belong to the protection scope of the present invention.

Claims

1. A method for indicating that a motor vehicle carries a special passenger, characterized in that: The method comprises the following steps: During the driving of the motor vehicle, performing image analysis based on the video image of the motor vehicle cabin provided by the in-vehicle monitoring camera to identify the occupants in the seating area of ​​the motor vehicle cabin, and outputting an occupant classification instruction when the occupants are identified; and In response to the occupant classification instruction, it is determined whether the identified occupant is a special occupant. If so, a special occupant instruction is output to control a display device at a predetermined position on the motor vehicle to display preset prompt information corresponding to the special occupant. The special occupants include at least infants, the elderly and pets.

2. The method for indicating that a motor vehicle carries a special passenger as claimed in claim 1, wherein: Performing image analysis based on the video image of the motor vehicle cabin provided by the in-vehicle monitoring camera to identify the occupants in the seating area of ​​the motor vehicle cabin specifically includes: Obtaining video images of the motor vehicle cockpit provided by the vehicle monitoring camera; Extracting an in-vehicle image from the video image; and A pre-stored deep learning algorithm model is used to perform image analysis on the in-vehicle image to identify occupants in the seating area of ​​the motor vehicle cabin.

3. The method for indicating that a motor vehicle carries a special passenger as claimed in claim 2, wherein: The determination of whether the identified occupant is a special occupant is performed by classifying the occupant using the deep learning algorithm model to determine whether the occupant is a human or a pet. When the occupant is determined to be a human, a preset face recognition algorithm model is used to detect and identify the actual age of the occupant. When the actual age is less than a first preset age threshold, the occupant is determined to be an infant and the special occupant instructions for infants are output. When the actual age is greater than a second preset age threshold, the occupant is determined to be an elderly person and the special occupant instructions for the elderly are output.

4. The method for indicating that a motor vehicle carries a special passenger as claimed in claim 3, wherein: When it is determined that the occupant is a pet, the special occupant instruction for the pet is output.

5. The method for indicating that a motor vehicle carries a special passenger as claimed in claim 1, wherein: The preset prompt information is a prompt pattern and / or text that matches the special occupant.

6. The method for indicating that a motor vehicle carries a special passenger as claimed in claim 5, wherein: The method further comprises: In response to a change instruction input by the user, the display device is controlled to change the prompt pattern and / or text for the special occupant.

7. A method and device for indicating that a motor vehicle carries a special passenger, connected to an in-vehicle monitoring camera and a display device assembled at a predetermined position on the motor vehicle, characterized in that: The device includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, the method for prompting that a motor vehicle is carrying a special passenger as described in any one of claims 1 to 6 is implemented.

8. The method and device for indicating that a motor vehicle is carrying a special passenger as claimed in claim 7, characterized in that: The display device is a display taillight, a display screen or a projection device of a motor vehicle.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the method for prompting that a motor vehicle carries a special passenger as described in any one of claims 1 to 6.

Images