A safety warning method and device and vehicle

Abstract

This invention discloses a safety warning method, device, and vehicle, relating to the field of vehicle safety warning technology. The method includes: identifying whether a target object exists on the armrest of the vehicle's interior; if a target object is present on the armrest, determining the object type; determining a target warning method based on the object type, and triggering a safety warning according to the target warning method. This implementation can promptly alert occupants to the presence of a target object on the armrest, preventing the object from falling off the armrest or interfering with the driver's driving operations, thus reducing the likelihood of accidents.

Description

Technical Field

[0001] This invention relates to the field of vehicle safety warning technology, and in particular to a safety warning method, device and vehicle. Background Technology

[0002] Currently, most vehicles have an armrest box in the interior. The armrest box refers to the component installed between the seats in the vehicle interior, mainly used to provide support for the elbows of the driver and passengers, and may also have storage functions, charging functions, etc.

[0003] If there are objects on the top surface of the armrest box or children climbing on it while the vehicle is in motion, the driver and passengers may not be able to notice them in time. The objects or children on the armrest box will not only affect the driver's normal driving and cause the driver to be distracted, but may also fall off the armrest box due to the inertia generated by the vehicle's movement, causing a safety accident. Summary of the Invention

[0004] In view of this, embodiments of the present invention provide a safety warning method, device and vehicle that can promptly alert drivers and passengers to the presence of a target object on the armrest box, preventing the target object from falling off the armrest box or affecting the driver's driving operation, and reducing the possibility of safety accidents.

[0005] To achieve the above objectives, according to one aspect of the present invention, a security early warning method is provided, comprising: Identify whether a target object is present on the armrest box inside the vehicle's interior; If a target object is present on the aforementioned armrest box, determine the object type of the target object; The target warning method is determined based on the object type of the target object, and the safety warning is triggered according to the target warning method.

[0006] Optionally, the above-mentioned identification of whether a target object exists on the armrest box inside the vehicle includes: Obtain pressure data measured by the pressure sensor installed in the aforementioned armrest box; The pressure data of the armrest box is used to determine whether there is a target object on the armrest box.

[0007] Optionally, the above-mentioned method of determining whether a target object exists on the armrest box using the pressure data of the armrest box includes: When the pressure data is greater than or equal to the first preset pressure threshold, it is determined that there is a target object on the armrest box.

[0008] Optionally, the above-mentioned identification of whether a target object exists on the armrest box inside the vehicle includes: Collect first image data of the designated area above the armrest box; The analysis of the first image data determines whether a target object exists on the armrest box.

[0009] Optionally, the above analysis of the first image data to determine whether a target object exists on the armrest box includes: Analyze whether there is an object on the armrest box in the first image data above; If the analysis results indicate that there is an object on the armrest box, the volume of the object on the armrest box in the first image data is identified; In response to the fact that the volume of the object on the armrest box is greater than a preset volume threshold, it is determined that there is a target object on the armrest box.

[0010] Optionally, the acquisition of pressure data measured by the pressure sensor installed in the armrest box includes: Pressure data for the armrest box is acquired using a pressure sensor located on the upper surface of the armrest box, or between the lid and the body of the armrest box.

[0011] Optionally, determining the object type of the target object includes: When the pressure data is greater than or equal to the first preset pressure threshold and less than the second preset pressure threshold, the object type of the target object is determined to be an interfering object. When the pressure data is greater than or equal to the second preset pressure threshold, the object type of the target object is determined to be a dangerous object.

[0012] Optionally, the above method further includes: if it is determined that the object type of the target object is a dangerous object, triggering the acquisition of an image of the target object; receiving the acquired second image data, and analyzing whether the target object is a child; The above-mentioned determination of the target warning method based on the object type of the target object includes: when the target object is determined to be a child, determining the target warning method associated with the child in the pre-set association relationship between object type and warning method.

[0013] To achieve the above objectives, according to another aspect of the present invention, a safety warning device is provided, comprising: The recognition module is used to identify whether there is a target object on the armrest box inside the vehicle. The determination module is used to determine the object type of the target object when the target object is present on the armrest box. The triggering module is used to determine the target warning method based on the object type of the target object, and to trigger the safety warning according to the target warning method.

[0014] To achieve the above objectives, according to another aspect of the present invention, a vehicle is provided, including: a safety warning device according to the present invention.

[0015] To achieve the above objectives, according to another aspect of the present invention, an electronic device for security early warning is provided.

[0016] An electronic device for security early warning according to an embodiment of the present invention includes: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement a security early warning method according to an embodiment of the present invention.

[0017] To achieve the above objectives, according to another aspect of the present invention, a computer-readable storage medium is provided.

[0018] An embodiment of the present invention provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements a security warning method according to an embodiment of the present invention.

[0019] To achieve the above objectives, according to another aspect of the present invention, a computer program product is provided.

[0020] An embodiment of the present invention provides a computer program product, which includes a computer program that, when executed by a processor, implements a security warning method according to an embodiment of the present invention.

[0021] One embodiment of the above invention has the following advantages or beneficial effects: it can identify whether there is a target object on the armrest box, determine the type of the target object if there is one, and determine the target warning method according to the type of the target object to trigger a safety warning. This can promptly remind the driver and passengers that there is a target object on the armrest box, prevent the target object from falling off the armrest box or affecting the driver's driving operation, reduce the possibility of safety accidents, and improve the user's vehicle usage experience.

[0022] The further effects of the aforementioned unconventional alternative methods will be explained below in conjunction with specific implementation methods. Attached Figure Description

[0023] The accompanying drawings are provided to better understand the invention and are not intended to unduly limit the scope of the invention. Wherein: Figure 1 This is a flowchart illustrating a security early warning method according to an embodiment of the present invention; Figure 2 This is a schematic diagram of a pressure sensor disposed on the upper surface of the armrest box according to an embodiment of the present invention; Figure 3This is a schematic diagram of a pressure sensor disposed between the cover and the body of the box according to an embodiment of the present invention. Figure 4 This is a flowchart illustrating a security warning method according to another embodiment of the present invention; Figure 5 This is a schematic diagram of the main modules of a safety warning device according to an embodiment of the present invention; Figure 6 This is an exemplary system architecture diagram in which embodiments of the present invention can be applied; Figure 7 This is a schematic diagram of the structure of a computer system suitable for implementing the security warning method or security warning device of the present invention. Detailed Implementation

[0024] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of the present invention, including various details to aid understanding. These details should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the invention. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0025] It should be noted that, unless otherwise specified, the embodiments of the present invention and the technical features thereof can be combined with each other.

[0026] Figure 1 This is a schematic diagram illustrating the main steps of a security early warning method according to an embodiment of the present invention. Figure 1 As shown, the security early warning method of this invention mainly includes the following steps: Step S101: Identify whether there is a target object on the armrest box inside the vehicle. The armrest box can include a front armrest box and a rear armrest box. The front armrest box is located between the driver and front passenger seats; the rear armrest box is located in the middle of the rear seats.

[0027] The armrest box mainly consists of a lid and a box body. The lid surface can be used to support the elbows of drivers and passengers, while the interior of the box body can be used for storage.

[0028] Various sensors or devices installed in the vehicle's interior are used to identify whether there are target objects on the upper surface of the armrest box. Target objects refer to objects that may pose a safety threat to the driver and passengers while the vehicle is in motion, or pets, children, etc., that are located on the armrest box.

[0029] Optionally, pressure data measured by a pressure sensor installed in the armrest box can be acquired; the pressure data of the armrest box can be used to determine whether a target object exists on the armrest box.

[0030] Specifically, such as Figure 2 As shown, pressure data for the armrest box can be obtained using a pressure sensor 100 disposed on the upper surface of the armrest box. For example, a thin-film pressure sensor 100 or a pressure sensor array composed of multiple evenly distributed pressure sensors 100 can be disposed in the lid 200 of the armrest box, and pressure data for the upper surface of the lid can be obtained using the thin-film pressure sensor 100 or the pressure sensor array.

[0031] The pressure sensor can be placed on the upper surface of the armrest box lid, or between the soft covering fabric and the rigid frame of the lid, to collect pressure data on the upper surface of the lid.

[0032] like Figure 3 As shown, pressure data for the armrest box can also be obtained using a pressure sensor 100 located between the cover 200 and the body 300 of the armrest box.

[0033] With the armrest box openable, a pressure sensor can be placed between the lid and the body of the armrest box. When a target object is present on the armrest box, the lid is subjected to pressure from the target object, allowing the pressure sensor located between the lid and the body to collect pressure data from the armrest box.

[0034] Furthermore, the number of pressure sensors can be multiple, thereby avoiding inaccurate pressure data collected when the force is uneven.

[0035] It should be noted that when there is more than one pressure sensor, the average pressure data collected by multiple pressure sensors can be used to determine whether there is a target object on the armrest box; alternatively, the pressure data collected by multiple pressure sensors can be compared, and the highest pressure data can be used to determine whether there is a target object on the armrest box. This avoids the situation where the pressure sensor at the location where there is no target object on the armrest box cannot collect pressure data or collects very low pressure data, which would affect the accuracy of determining whether there is a target object on the armrest box if the average pressure data is used.

[0036] In addition, first image data of a designated area above the armrest box can be collected; the first image data can be analyzed to determine whether a target object exists on the armrest box.

[0037] Specifically, an image acquisition device can be pre-installed in the vehicle's interior to collect initial image data of a designated area above the armrest box. The image acquisition device can be a deep infrared camera, a visible light camera, or other similar devices, but is not limited to these.

[0038] The image acquisition device is positioned to acquire first image data of a designated area above the armrest box, such as the edge of the windshield or the inner ceiling, without being specifically limited here.

[0039] Image recognition technology is used to analyze the first image data in order to identify whether there is a target object in a set area above the armrest box in the first image data.

[0040] Furthermore, pressure data from the armrest box and first image data from a designated area above the armrest box can be combined to identify whether a target object exists on the armrest box. If both conditions are met, the presence of a target object on the armrest box is determined, thereby improving the accuracy of target object identification.

[0041] Step S102: If a target object exists on the armrest box, determine the object type of the target object. Object types can be categorized based on pressure data, volume data, user habits, or object characteristics.

[0042] As an example, based on the comparison between pressure data and a pre-set pressure threshold, objects can be classified into lightweight objects, interfering objects, and dangerous objects; based on the comparison between volume data and a pre-set volume threshold, objects can be classified into large objects and small objects; based on user habits, objects can be classified into temporary objects and long-term objects; and based on object characteristics, objects can be classified into easily rolling objects, sharp objects, etc.

[0043] Step S103: Determine the target warning method based on the object type of the target object, and trigger a safety warning according to the target warning method.

[0044] Warning methods can include various approaches, such as voice prompts, beeps, indicator lights, and text prompts. The content of the prompts can also be customized based on the type of object. For example, if the target object is one that is likely to roll away, the voice prompt could be something like, "There is a wheeled object on the armrest box. The brake may fall off. Please put it away."

[0045] The association between object types and warning methods can be pre-defined. After determining the object type of the target object, the target warning method associated with the target object can be determined based on the association between the object type and the warning method, thereby triggering a safety warning according to the target warning method.

[0046] In one optional embodiment, the above-mentioned determination of whether there is a target object on the armrest box using the pressure data of the armrest box includes: determining that there is a target object on the armrest box when the pressure data is greater than or equal to a first preset pressure threshold.

[0047] The first preset pressure threshold can be determined based on the actual situation.

[0048] When the pressure data is less than the first preset pressure threshold, the object placed on the armrest box is relatively light or there is no object placed on the armrest box, which may not affect the safety of the driver and passengers. Therefore, it can be determined that there is no target object on the armrest box.

[0049] When the pressure data is greater than or equal to the first preset pressure threshold, there is an object on the armrest box and the object may affect the safety of the driver and passengers. Therefore, it can be determined that there is a target object on the armrest box.

[0050] In one optional embodiment, the above-mentioned analysis of the first image data to determine whether there is a target object on the armrest box includes: analyzing whether there is an object on the armrest box in the first image data; if the analysis result indicates that there is an object on the armrest box, identifying the volume of the object on the armrest box in the first image data; and determining that there is a target object on the armrest box in response to the volume of the object on the armrest box being greater than a preset volume threshold.

[0051] Image recognition technology is used to analyze the first image data to determine whether there is an object on the armrest box. Specifically, image recognition can be performed using deep learning methods, such as attention mechanisms and semantic segmentation.

[0052] If there is an object on the armrest box, its volume can be used to determine whether it is the target object.

[0053] As an example, if an image acquisition device capable of acquiring depth maps is used to acquire the first image data, each pixel of the object and its depth value can be converted into three-dimensional spatial coordinates through the internal parameters of the image acquisition device. By combining the points corresponding to all the pixels of the object, the "three-dimensional point cloud" of the object can be obtained. After filtering to remove the pixels, the "three-dimensional point cloud" of the object is segmented. The discrete point cloud is connected into a continuous triangular mesh, and the volume of the above triangular mesh is calculated as the volume of the object.

[0054] If the volume of the aforementioned object is less than or equal to the preset volume threshold, the object may not affect the safety of the driver and passengers, is not a target object, and it can be determined that there is no target object on the armrest box; if the volume of the aforementioned object is greater than the preset volume threshold, the object may affect the safety of the driver and passengers, is a target object, and it can be determined that there is a target object on the armrest box.

[0055] In one optional embodiment, determining the object type of the target object includes: when the pressure data is greater than or equal to a first preset pressure threshold and less than a second preset pressure threshold, determining the object type of the target object as an interfering object; when the pressure data is greater than or equal to the second preset pressure threshold, determining the object type of the target object as a dangerous object.

[0056] Regardless of whether the presence of a target object on the armrest box is determined based on pressure data or first image data, the type of the target object can be further determined in order to determine the appropriate target warning method.

[0057] When objects are categorized into interfering objects, hazardous objects, and lightweight objects based on their pressure data, if the pressure data is below a first preset pressure threshold, the target object is determined to be a lightweight object. In this case, no safety warning is issued, and a safety warning is issued according to the warning method associated with lightweight objects. If the target object is an interfering object, a safety warning is issued according to the warning method associated with interfering objects.

[0058] Lightweight objects refer to small, lightweight objects that, due to friction, generally will not fall off the armrest box, or even if they do fall, are unlikely to be damaged or affect the personal safety of the driver and passengers. For example, lightweight objects may include keys, chewing gum, lighters, etc., whose pressure data is less than a first preset pressure threshold.

[0059] Interference objects refer to objects that may affect the use of the armrest box by passengers or slightly affect the driver's driving operations. Examples include wallets, tablets, and handbags whose pressure data is greater than or equal to a first preset pressure threshold but less than a second preset pressure threshold. Warnings associated with interference objects can be triggered by a voice prompt such as "There is an item in the armrest box; avoid distraction," or by a gentler audio-visual alert.

[0060] Hazardous objects refer to items that obstruct the driver's operating area or are likely to fall from the armrest and cause injury, such as thermos cups, toolboxes, power banks, wrenches, etc., with pressure data greater than or equal to the second preset pressure threshold. Warnings associated with hazardous objects can be issued via voice prompts such as "There is a heavy object on the armrest; please put it away promptly," or through visual and auditory alerts with high flashing frequency or prominent colors.

[0061] Furthermore, if the target object is determined to be a dangerous object, image acquisition of the target object is triggered; the acquired second image data is received, and it is analyzed whether the target object is a child.

[0062] If children climb or stand on the armrests inside a vehicle, there is a high risk of them falling or bumping into things, especially during vehicle movement or braking, which could compromise their safety. Therefore, if the target object is a dangerous object, it is necessary to further determine whether the target object is a child.

[0063] At this point, the second image data can be the same as the first image data, or it can be newly acquired image data of the target object. For example, if the presence of a target object on the armrest box is determined through the first image data, the first image data can be directly used as the second image data to further determine whether the target object is a child.

[0064] The above-mentioned determination of the target warning method based on the object type of the target object includes: when the target object is determined to be a child, determining the target warning method associated with the child in the pre-set association relationship between object type and warning method.

[0065] When the target object is a child, a safety warning can be triggered through a pre-set child-associated warning method. For example, a child-associated warning method could be a voice warning such as "Please have your child sit back in the back seat / car seat."

[0066] The warning method and the prompt content can be preset. In particular, when the target object is a child or a distracting or dangerous object other than a child, the prompt content can be set specifically so that drivers and passengers can detect potential dangers in time, reduce the possibility of safety accidents, and improve the safety of children riding in vehicles.

[0067] If the target object is not a child, a safety warning can be issued directly based on the warning method associated with dangerous objects that are not children.

[0068] Optionally, after determining that a target object exists on the armrest box, pressure data of the armrest box and / or first image data of a set area above the armrest box can be continuously acquired at warning intervals to identify whether a target object still exists on the armrest box, until the target object disappears and the safety warning is stopped.

[0069] According to the safety warning method of the present invention, by identifying whether there is a target object on the armrest box, and if there is a target object on the armrest box, determining the object type of the target object; and determining the target warning method according to the object type of the target object to trigger a safety warning, the method can promptly remind the driver and passengers that there is a target object on the armrest box, preventing the target object from falling off the armrest box or affecting the driver's driving operation, reducing the possibility of safety accidents, and improving the user's vehicle usage experience.

[0070] The safety early warning method will be further illustrated below through a specific embodiment.

[0071] like Figure 4 As shown, the security warning method of this embodiment includes the following steps S401 to S408: Step S401: Obtain pressure data measured by the pressure sensor installed in the armrest box; The pressure sensor can be installed on the upper surface of the armrest box or between the lid and the body of the armrest box.

[0072] Step S402: Acquire first image data of the designated area above the armrest box; Step S403: Using the pressure data and / or the first image data, determine whether there is a target object on the armrest box; if there is a target object on the armrest box, proceed to step S404; if there is no target object on the armrest box, end the current process. Specifically, when the pressure data is greater than or equal to the first preset pressure threshold, it is determined that there is a target object on the armrest box.

[0073] In addition, if the analysis result of the first image data indicates that there is an object on the armrest box, the volume of the object on the armrest box in the first image data is identified; in response to the volume of the object on the armrest box being greater than a preset volume threshold, it is determined that there is a target object on the armrest box.

[0074] Furthermore, if pressure data and first image data are acquired simultaneously, and the pressure data is greater than or equal to a first preset pressure threshold and the volume of the object on the armrest box is determined to be greater than a preset volume threshold based on the first image data, it is determined that a target object exists on the armrest box.

[0075] Step S404: Determine the object type of the target object based on the pressure data, and confirm whether the target object is a disturbance object or a dangerous object; if the target object is a disturbance object K1, proceed to step S405; if the target object is a dangerous object K2, proceed to step S406. Specifically, when the pressure data is greater than or equal to the first preset pressure threshold and less than the second preset pressure threshold, the object type of the target object is determined to be an interfering object; when the pressure data is greater than or equal to the second preset pressure threshold, the object type of the target object is determined to be a dangerous object. Step S405: Determine the warning method associated with the interfering object from the pre-defined association between object type and warning method, use it as the target warning method, and trigger a safety warning. Step S406: Trigger image acquisition of the target object; Receive the acquired second image data and analyze whether the target object is a child; If the target object is a child, proceed to step S407; If the target object is not a child, proceed to step S408. Step S407: Determine the warning method associated with the child from the pre-set association between object types and warning methods, use it as the target warning method, and trigger a safety warning; Step S408: Determine the warning method associated with dangerous objects that do not belong to children from the pre-set association relationship between object types and warning methods, use it as the target warning method, and trigger the safety warning.

[0076] According to the safety warning method of the present invention, by identifying whether there is a target object on the armrest box, and if there is a target object on the armrest box, determining the object type of the target object; and determining the target warning method according to the object type of the target object to trigger a safety warning, the method can promptly remind the driver and passengers that there is a target object on the armrest box, preventing the target object from falling off the armrest box or affecting the driver's driving operation, reducing the possibility of safety accidents, and improving the user's vehicle usage experience.

[0077] Figure 5 This is a schematic diagram of the main modules of a safety warning device according to an embodiment of the present invention. Figure 5 As shown, the safety warning device 500 of this embodiment includes: an identification module 501, used to identify whether there is a target object on the armrest box of the vehicle interior; a determination module 502, used to determine the object type of the target object when there is a target object on the armrest box; and a triggering module 503, used to determine the target warning method according to the object type of the target object, and trigger a safety warning according to the target warning method.

[0078] In an optional embodiment of the present invention, the identification module 501 is further configured to acquire pressure data measured by a pressure sensor disposed on the armrest box; and use the pressure data of the armrest box to determine whether there is a target object on the armrest box.

[0079] In an optional embodiment of the present invention, the identification module 501 is further configured to determine that a target object exists on the armrest box when the pressure data is greater than or equal to a first preset pressure threshold.

[0080] In an optional embodiment of the present invention, the identification module 501 is further configured to acquire first image data of a set area above the armrest box; and analyze the first image data to determine whether a target object exists on the armrest box.

[0081] In an optional embodiment of the present invention, the identification module 501 is further configured to analyze whether there is an object on the armrest box in the first image data; if the analysis result indicates that there is an object on the armrest box, identify the volume of the object on the armrest box in the first image data; and in response to the volume of the object on the armrest box being greater than a preset volume threshold, determine that there is a target object on the armrest box.

[0082] In an optional embodiment of the present invention, the identification module 501 is further configured to acquire pressure data for the armrest box using a pressure sensor disposed on the upper surface of the armrest box, or disposed between the lid and the body of the armrest box.

[0083] In an optional embodiment of the present invention, the determining module 502 is further configured to determine the object type of the target object as an interfering object when the pressure data is greater than or equal to a first preset pressure threshold and less than a second preset pressure threshold; and to determine the object type of the target object as a dangerous object when the pressure data is greater than or equal to the second preset pressure threshold.

[0084] In an optional embodiment of the present invention, the safety warning device 500 further includes: an analysis module, which is further configured to trigger image acquisition of the target object when it is determined that the object type of the target object is a dangerous object; receive the acquired second image data and analyze whether the target object is a child; The trigger module 503 is also used to determine the target warning method associated with the child in the preset association relationship between object type and warning method when the target object is determined to be a child.

[0085] According to the safety warning device of the present invention, by identifying whether there is a target object on the armrest box, and if there is a target object on the armrest box, determining the object type of the target object; and determining the target warning method according to the object type of the target object to trigger a safety warning, the device can promptly remind the driver and passengers that there is a target object on the armrest box, preventing the target object from falling off the armrest box or affecting the driver's driving operation, reducing the possibility of safety accidents, and improving the user's vehicle usage experience.

[0086] The following describes the technical scenarios to which the technical solutions provided in the embodiments of the present invention are applicable, based on the system architecture upon which they depend.

[0087] The safety warning device of this invention can be configured in a vehicle or in a terminal device that has established a communication link with the vehicle. For example, the terminal device can be a tablet computer, mobile phone, or other device that has established a communication link with the vehicle.

[0088] Figure 6An exemplary system architecture 600 is shown upon which the security warning method or security warning device to which embodiments of the present invention can be applied depends. For example... Figure 6 As shown, when the safety warning device of this embodiment is configured in a vehicle, the vehicle system architecture 600 may include various systems, such as a driving control system 601, a power system 602, a sensor system 603, a control system 604, one or more peripheral devices 605, a power supply 606, a computer system 607, and a user interface 608. The safety warning method provided by this embodiment can be implemented through interaction with the aforementioned systems, or by controlling the systems through external devices, or by a robot driving the vehicle operating the systems. Optionally, the vehicle system architecture 600 may include more or fewer systems, and each system may include multiple components. Furthermore, each system and component of the vehicle system architecture 600 may be interconnected via wired or wireless means.

[0089] The vehicle system architecture 600 includes a driving control system 601, which can be in fully or partially automated driving mode or controlled by the driver's operation of the steering wheel, clutch, accelerator, etc. For example, the driving control system 601 can automatically control the vehicle's movement based on control signals or control commands without human interaction, or through interaction with external devices or a robot driving the vehicle.

[0090] The powertrain 602 may include components that provide power to the vehicle. For example, the powertrain 602 may include an engine, an energy source, a transmission, wheels, tires, etc. The engine converts the energy source into mechanical energy to supply the transmission. Examples of energy sources may include solar panels, batteries, and other electrical sources. The energy source may also provide power to other systems of the vehicle. Furthermore, the transmission may include a gearbox, differential, drive shaft, and clutch, etc.

[0091] Sensor system 603 may include sensors for sensing the vehicle's surrounding environment (such as sensors for sensing the presence of objects in the vicinity). Examples include a positioning system (which may be a Global Positioning System (GPS), BeiDou Navigation Satellite System, or other positioning systems), radar sensors, ultrasonic sensors, laser rangefinders, voice sensors, inertial measurement units (IMUs), and image sensors. The positioning system can be used to determine the vehicle's geographical location. The IMU is used to sense changes in the vehicle's position and orientation based on inertial acceleration. In one embodiment, the IMU may be a combination of an accelerometer and a gyroscope. The radar sensor can use millimeter-wave signals to sense objects in the vehicle's surrounding environment. In some embodiments, in addition to sensing objects, the radar sensor can also be used to sense the speed and / or direction of travel of objects. The voice sensor may be a device for acquiring sound or speech within the vehicle. The image sensor may be a device for acquiring images of the vehicle's interior.

[0092] The control system 604 may include software systems for implementing vehicle control, such as systems for analyzing the vehicle's surrounding environment, seatbelt pretensioning, route planning, obstacle avoidance, and image analysis. The control system 604 may also include hardware systems such as an accelerator, steering wheel system, seatbelt system, airbag system, and peripheral devices (such as projection equipment and displays). Furthermore, the control system 604 may add or replace components other than those shown and described. Alternatively, some of the components shown above may be omitted.

[0093] The control system 604 may further include a safety warning device that can identify whether there is a target object on the armrest box of the vehicle interior; if there is a target object on the armrest box, determine the object type of the target object; determine a target warning method according to the object type of the target object, and trigger a safety warning according to the target warning method.

[0094] In addition, the control system 604 can also interact with external sensors, other autonomous driving devices, other computer systems, or users via peripheral devices 605. Peripheral devices 605 may include wireless communication systems, on-board computers, microphones and / or speakers, cameras, and projectors, etc.

[0095] In some embodiments, peripheral device 605 provides a means for user interaction with the control system 604 via a user interface. For example, an onboard computer may provide information to the user of the vehicle. The user interface may also operate the onboard computer to receive user input, such as desired warning distance. The onboard computer may be operated via a touchscreen. In other cases, peripheral device may provide a means for communicating with other devices located within the vehicle. For example, a microphone may receive audio (e.g., voice commands or other audio input) from the user of the control system. Similarly, a speaker may output audio to the user of the control system.

[0096] Wireless communication systems can communicate wirelessly with one or more devices, either directly or via a communication network. For example, wireless communication systems can use networks such as cellular networks, WiFi, and wireless local area networks (WLANs), or they can use infrared links, Bluetooth, or ZigBee to communicate directly with devices. Other wireless protocols include those used in various autonomous driving communication systems.

[0097] The power source 606 can provide power to various components of the vehicle. The power source 606 can be a rechargeable lithium-ion or lead-acid battery.

[0098] Some or all of the functions implementing security alerts are controlled by computer system 607. Computer system 607 may include at least one processor that executes instructions stored in a non-transitory computer-readable medium such as memory. Computer system 607 provides the aforementioned control system with execution code to implement security alerts.

[0099] The processor can be any conventional processor, such as a commercially available central processing unit (CPU). Alternatively, the processor can be a special-purpose device such as an application-specific integrated circuit (ASIC) or other hardware-based processor. Those skilled in the art will understand that the processor, computer, or memory can actually include multiple processors, computers, or memories that may or may not be stored in the same physical housing. For example, memory can be a hard disk drive or other storage media located in a housing different from that of a computer. Therefore, references to processors or computers will be understood to include references to a collection of processors or computers or memories that may or may not operate in parallel. Unlike using a single processor to perform the steps described herein, some components, such as steering and deceleration components, may each have their own processor, which performs only determinations related to the function specific to the component.

[0100] User interface 608 is used to provide information to or receive information from users of the vehicle. Optionally, user interface 608 may include one or more input / output devices within a set of peripheral devices 605, such as wireless communication systems, on-board computers, microphones, and speakers.

[0101] It should be understood that the components described above are merely an example. In actual applications, components in the various modules or systems mentioned above may be added or removed as needed. Figure 6 This should not be construed as a limitation on the embodiments of this application.

[0102] The following is for reference. Figure 7 It shows a schematic diagram of the structure of a computer system 700 suitable for implementing the security warning method or security warning device of the present invention. Figure 7 The computer system 700 shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.

[0103] like Figure 7 As shown, the computer system 700 includes a central processing unit (CPU) 701, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 702 or programs loaded from storage section 708 into random access memory (RAM) 703. The RAM 703 also stores various programs and data required for the operation of the computer system 700. The CPU 701, ROM 702, and RAM 703 are interconnected via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0104] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, mouse, etc.; an output section 707 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 710 as needed so that computer programs read from it can be installed into the storage section 708 as needed.

[0105] In particular, according to the embodiments disclosed in this invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 709, and / or installed from removable medium 711. When the computer program is executed by central processing unit (CPU) 701, it performs the functions defined above in the system of this invention.

[0106] It should be noted that the computer-readable medium shown in this invention can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0107] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0108] The modules described in the embodiments of the present invention can be implemented in software or hardware. The described modules can also be housed in a processor; for example, a processor can be described as including an identification module, a determination module, and a triggering module. The names of these modules do not necessarily limit the module itself; for example, the identification module can also be described as "a module for identifying whether a target object exists on the armrest box of a vehicle's interior."

[0109] In another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiments; or it may exist independently and not assembled into the device. The computer-readable medium carries one or more programs that, when executed by the device, cause the device to include: identifying whether a target object exists on the armrest box of the vehicle's interior; if a target object exists on the armrest box, determining the object type of the target object; determining a target warning method based on the object type of the target object, and triggering a safety warning according to the target warning method.

[0110] According to the technical solution of the present invention, the presence of a target object on the armrest box can be identified. If a target object is present on the armrest box, the object type can be determined. Based on the object type, a target warning method can be determined to trigger a safety warning. This can promptly alert the driver and passengers that a target object is present on the armrest box, preventing the target object from falling off the armrest box or affecting the driver's driving operation, reducing the possibility of safety accidents, and improving the user's vehicle usage experience.

[0111] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A safety early warning method, characterized in that, include: Identify whether a target object is present on the armrest box inside the vehicle's interior; If a target object is present on the armrest box, determine the object type of the target object; The target warning method is determined based on the object type of the target object, and a safety warning is triggered according to the target warning method.

2. The safety early warning method according to claim 1, characterized in that, The method of identifying whether a target object exists on the armrest box inside the vehicle includes: Acquire pressure data measured by a pressure sensor installed in the armrest box; The pressure data from the armrest box is used to determine whether a target object exists on the armrest box.

3. The safety early warning method according to claim 2, characterized in that, The step of determining whether a target object exists on the armrest box using the pressure data of the armrest box includes: When the pressure data is greater than or equal to the first preset pressure threshold, it is determined that there is a target object on the armrest box.

4. The safety early warning method according to any one of claims 1-3, characterized in that, The method of identifying whether a target object exists on the armrest box inside the vehicle includes: Acquire first image data of a designated area above the armrest box; The first image data is analyzed to determine whether a target object exists on the armrest box.

5. The safety early warning method according to claim 4, characterized in that, The step of analyzing the first image data to determine whether a target object exists on the armrest box includes: Analyze whether there is an object on the armrest box in the first image data; If the analysis results indicate that there is an object on the armrest box, identify the volume of the object on the armrest box in the first image data; In response to the fact that the volume of an object on the armrest box is greater than a preset volume threshold, it is determined that there is a target object on the armrest box.

6. The safety early warning method according to claim 2, characterized in that, The step of acquiring pressure data measured by a pressure sensor installed in the armrest box includes: Pressure data for the armrest box is acquired using a pressure sensor located on the upper surface of the armrest box, or between the lid and the body of the armrest box.

7. The safety early warning method according to any one of claims 2-3, characterized in that, Determining the object type of the target object includes: When the pressure data is greater than or equal to the first preset pressure threshold and less than the second preset pressure threshold, the object type of the target object is determined to be an interfering object. When the pressure data is greater than or equal to the second preset pressure threshold, the object type of the target object is determined to be a dangerous object.

8. The safety early warning method according to claim 7, characterized in that, The method further includes: if it is determined that the object type of the target object is a dangerous object, triggering the acquisition of an image of the target object; receiving the acquired second image data, and analyzing whether the target object is a child; The step of determining the target warning method based on the object type of the target object includes: when the target object is determined to be a child, determining the target warning method associated with the child from a pre-set association relationship between object type and warning method.

9. A safety early warning device, characterized in that, include: The recognition module is used to identify whether there is a target object on the armrest box inside the vehicle. The determination module is used to determine the object type of the target object when the target object is present on the armrest box; The triggering module is used to determine the target warning method according to the object type of the target object, and trigger a safety warning according to the target warning method.

10. A vehicle, characterized in that, Includes the safety warning device as described in claim 9.

Images