Information presentation method, device, system and computer storage medium

Abstract

The application discloses an information prompting method, device and system and a computer storage medium, and relates to the technical field of data processing. The information prompting method comprises the following steps: acquiring a target image of a vehicle center console; identifying an object in the target image to obtain an identification result; in the case that the identification result contains a target object, sending prompt information to a target terminal, so that the target terminal outputs the prompt information, and the prompt information is used for prompting a user that the target object of the vehicle center console is dangerous; and the target object is an object that will cause danger in the vehicle. According to the embodiment of the application, a safety accident caused by the target object can be prevented.

Description

Technical Field

[0001] This application belongs to the field of data processing technology, and in particular relates to an information prompting method, apparatus, system and computer storage medium. Background Technology

[0002] With the advancement and development of science and technology, while vehicles provide convenience for people's travel, people's demand for vehicle safety is also increasing.

[0003] When using a vehicle, items placed on the center console may pose a danger, but users may not be aware of the potential danger, thus leading to safety accidents. Summary of the Invention

[0004] This application provides an information prompting method, device, system, and computer storage medium that can prevent security incidents caused by target objects.

[0005] In a first aspect, embodiments of this application provide an information prompting method, the method comprising:

[0006] Acquire a target image of the vehicle's center console;

[0007] Identify objects in the target image and obtain the identification results;

[0008] If the identification result contains a target object, a prompt message is sent to the target terminal so that the target terminal outputs a prompt message to alert the user that the target object on the vehicle's center console is dangerous; the target object is any object that could pose a danger to the vehicle.

[0009] In some alternative implementations, before acquiring the target image of the vehicle's center console, the method further includes:

[0010] Get the current status of the vehicle;

[0011] Determine if the parameter information corresponding to the current state meets the preset conditions.

[0012] In some optional implementations, the current state includes the driving state, and the parameter information corresponding to the driving state includes the current vehicle speed;

[0013] The parameter information corresponding to the current state meets the preset conditions, including: the current vehicle speed is greater than the vehicle speed threshold.

[0014] In some optional implementations, the current state includes a locked state, and the parameter information corresponding to the locked state includes the light intensity of the vehicle's center console.

[0015] The parameter information corresponding to the current state meets the preset conditions, including: the light intensity of the vehicle's center console is greater than the light intensity threshold.

[0016] In some alternative implementations, the target terminal is at least one of the vehicle's in-vehicle infotainment system and the user's mobile terminal.

[0017] In some optional implementations, if the identification result includes the target object, a prompt message is sent to the target terminal to cause the target terminal to output the prompt message, including:

[0018] If the recognition result contains the target object and the vehicle is currently in a driving state, a prompt message is sent to the vehicle terminal so that the vehicle terminal can output the prompt message.

[0019] If the identification result contains the target object and the current state is locked, a prompt message is sent to the mobile terminal so that the mobile terminal outputs the prompt message.

[0020] In some optional implementations, objects in the target image are identified to obtain identification results, including:

[0021] The target image is input into the image recognition model so that the image recognition model can identify the objects in the target image and obtain the recognition result.

[0022] Secondly, embodiments of this application provide an information prompting device, which includes:

[0023] The first acquisition module is used to acquire a target image of the vehicle's center console;

[0024] The recognition module is used to identify objects in the target image and obtain the recognition results;

[0025] The sending module is used to send a prompt message to the target terminal when the recognition result contains a target object, so that the target terminal outputs a prompt message to inform the user that the target object on the vehicle's center console is dangerous; the target object is an object that could pose a danger to the vehicle.

[0026] Thirdly, embodiments of this application provide an information prompting system, which includes:

[0027] Image acquisition device, processor, and target terminal;

[0028] An image acquisition device is used to acquire target images of the vehicle's center console and send the target images to the processor.

[0029] A processor for executing the information prompting method of the first aspect;

[0030] The target terminal is used to output prompt information.

[0031] Fourthly, embodiments of this application provide a computer storage medium on which computer program instructions are stored, and when the computer program instructions are executed by a processor, they implement the information prompting method as described in the first aspect.

[0032] This application provides an information prompting method, apparatus, system, and computer storage medium. The method includes: first, acquiring a target image of a vehicle's center console; then, identifying objects in the target image to obtain an identification result; and finally, if the identification result contains a target object, sending a prompt message to a target terminal to cause the target terminal to output a prompt message. The prompt message is used to remind the user that a target object on the vehicle's center console poses a danger, wherein the target object is an object that could cause danger within the vehicle. In other words, this application, by sending a prompt message to a target terminal when the identification result contains a target object, causes the target terminal to output a prompt message to remind the user that a target object inside the vehicle may pose a danger, enabling the user to specifically investigate potential hazards and prevent safety accidents caused by the target object. Attached Figure Description

[0033] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0034] Figure 1 This is a flowchart illustrating the information prompting method provided in an embodiment of this application;

[0035] Figure 2 This is a schematic diagram of the structure of the information prompting device provided in the embodiments of this application;

[0036] Figure 3 This is a schematic diagram of the structure of the information prompting system provided in the embodiments of this application. Detailed Implementation

[0037] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.

[0038] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.

[0039] Before describing the technical solutions provided in the embodiments of this application, in order to facilitate understanding of the embodiments of this application, this application first specifically explains the problems existing in the related technologies:

[0040] When users use their vehicles daily, items placed on the vehicle's center console may pose a danger in different scenarios due to the nature of the items themselves, and users may not be aware of the potential dangers, thus leading to safety accidents.

[0041] For example, some glass fragrance diffusers placed on the vehicle's center console may generate heat and potentially cause a fire if exposed to strong sunlight for an extended period. Another example is that decorative items placed on the vehicle's center console, if not securely mounted, may detach from the console during high-speed driving or tunnel travel due to road bumps or sudden braking, potentially damaging the vehicle or its occupants.

[0042] To address the problems of the prior art, embodiments of this application provide an information prompting method, apparatus, system, and computer storage medium. The information prompting method provided in this application embodiment will be described first below.

[0043] Figure 1 A flowchart illustrating the information prompting method provided in an embodiment of this application is shown.

[0044] like Figure 1 As shown, the information prompting method provided in this application embodiment can be applied to a vehicle-mounted terminal or a server, where the server can be a cloud server. This information prompting method may include the following steps S110 to S130.

[0045] S110, Acquire the target image of the vehicle's center console.

[0046] S120. Identify objects in the target image and obtain the identification results.

[0047] S130. If the identification result contains a target object, send a prompt message to the target terminal so that the target terminal outputs a prompt message. The prompt message is used to remind the user that the target object on the vehicle's central control panel is dangerous; the target object is an object that could cause danger to the vehicle.

[0048] This application provides an information prompting method, which includes: first, acquiring a target image of the vehicle's center console; then, identifying objects in the target image to obtain a recognition result; and finally, if the recognition result contains a target object, sending a prompt message to a target terminal to cause the target terminal to output a prompt message. The prompt message is used to remind the user that a target object on the vehicle's center console poses a danger, wherein the target object is an object that could cause danger within the vehicle. In other words, this application, by sending a prompt message to the target terminal when the recognition result contains a target object, causes the target terminal to output a prompt message to remind the user that a target object inside the vehicle may pose a danger, enabling the user to specifically investigate potential hazards and prevent safety accidents caused by the target object.

[0049] The specific implementation methods for each of the above steps are described below.

[0050] In S110, the vehicle center console can be the workbench in front of the driver and passenger. The vehicle center console is the carrier for installing the instrument panel, air conditioning and audio panel, as well as storage boxes, airbags and other devices.

[0051] The vehicle-mounted system or server can acquire a target image of the vehicle's center console through an image acquisition device. Alternatively, the vehicle-mounted system or server may have the target image of the vehicle's center console stored internally, allowing it to directly acquire the image. This application does not impose any limitations on this. The image acquisition device can be a camera or other device capable of capturing images.

[0052] In some optional implementations, before acquiring the target image of the vehicle's center console, the information prompting method provided in this application embodiment may further include:

[0053] Get the current status of the vehicle;

[0054] Determine if the parameter information corresponding to the current state meets the preset conditions.

[0055] In this embodiment, the target image of the vehicle's center console is only acquired when the parameter information corresponding to the current state of the vehicle meets the preset conditions. Compared with continuously acquiring the target image of the vehicle's center console, this can reduce the power consumption of the vehicle terminal or server.

[0056] The current status of a vehicle can include its driving status and its locked status.

[0057] Driving status can refer to the state in which the vehicle is in motion.

[0058] The vehicle is locked. This means that when the vehicle is locked, the user is not inside the vehicle.

[0059] The vehicle's current status can be obtained by the in-vehicle system or server through communication with the vehicle's Controller Area Network (CAN) bus module. Of course, other methods capable of obtaining the vehicle's current status are also possible and are not limited here.

[0060] Understandably, after obtaining the current state of the vehicle, if it is determined that the parameter information corresponding to the current state does not meet the preset conditions, the vehicle terminal or server will not execute the process of obtaining the target image of the vehicle's center console.

[0061] In other words, if the parameter information corresponding to the current state meets the preset conditions, it is considered that the vehicle's center console may cause a safety accident, and it is necessary to further determine whether a target object exists on the vehicle's center console. If the parameter information corresponding to the current state does not meet the preset conditions, it is considered that the vehicle's center console will not cause a safety accident.

[0062] In some optional implementations, the current state may include the driving state, and the parameter information corresponding to the driving state may include the current vehicle speed;

[0063] The parameter information corresponding to the current state that meets the preset conditions may include: the current vehicle speed is greater than the vehicle speed threshold.

[0064] In this embodiment, when the current vehicle speed is greater than the vehicle speed threshold, a target image of the vehicle's center console can be acquired, providing a basis for determining whether to send a prompt message to the target terminal.

[0065] Correspondingly, the parameter information corresponding to the current state does not meet the preset conditions, which may include: the current vehicle speed is less than or equal to the vehicle speed threshold.

[0066] In this embodiment, the vehicle speed threshold can be set according to actual conditions, and is not limited here. For example, the vehicle speed threshold can be 20 km / h.

[0067] In some alternative implementations, the current state may also include a locked state, and the parameter information corresponding to the locked state may include the light intensity of the vehicle's center console.

[0068] The parameter information corresponding to the current state that meets the preset conditions may include: the light intensity of the vehicle's center console is greater than the light intensity threshold.

[0069] In this embodiment, when the light intensity of the vehicle's center console is greater than the light intensity threshold, a target image of the vehicle's center console can be acquired, providing a basis for determining whether to send a prompt message to the target terminal.

[0070] Correspondingly, the parameter information corresponding to the current state does not meet the preset conditions, which may include: the light intensity of the vehicle's center console is less than or equal to the light intensity threshold.

[0071] In this embodiment, the light intensity threshold can be set according to actual conditions and is not limited here. For example, the light intensity threshold can be 200 lux.

[0072] In S120, after the vehicle's infotainment system or server acquires the target image from the vehicle's center console, it can also identify objects in the target image and obtain the recognition results.

[0073] In some optional implementations, identifying objects in the target image and obtaining identification results may include:

[0074] The target image is input into the image recognition model so that the image recognition model can identify the objects in the target image and obtain the recognition result.

[0075] In this embodiment, an image recognition model is used to identify objects in the target image, and the recognition result is obtained, which provides a basis for determining whether to send a prompt message to the target terminal.

[0076] An image recognition model can be a model used to identify whether a target image contains a target object.

[0077] The recognition result may include the target object, or it may only include non-target objects. Non-target objects can be any objects other than the target object.

[0078] Optionally, before inputting the target image into the image recognition model, the information prompting method provided in this application embodiment may further include:

[0079] Obtain the training sample set, which includes multiple training samples. Each training sample includes an object image and the corresponding category label for the object image.

[0080] The image recognition model is obtained by training training samples using a pre-defined model until the training stopping condition is met.

[0081] The object image can be an image that includes objects on the vehicle's center console.

[0082] The category label corresponding to the object image can be either the target object or a non-target object.

[0083] In S130, after the vehicle-mounted terminal or server identifies the object in the target image and obtains the identification result, it can also send a prompt message to the target terminal if the identification result contains the target object, so that the target terminal can output the prompt message.

[0084] In this embodiment of the application, if the identification result includes a target object, it is considered that the target object may pose a danger and may cause a safety accident. Therefore, a prompt message is sent to the target terminal so that the target terminal outputs a prompt message to remind the user that the target object in the vehicle may pose a danger, so that the user can specifically check for dangerous factors and prevent the safety accident caused by the target object from occurring.

[0085] Accordingly, if the identification results only contain non-target objects and do not contain target objects, it is assumed that the vehicle's central control unit will not cause a safety accident. Therefore, the vehicle's central control unit or server does not perform any operation.

[0086] In some alternative implementations, the target terminal is at least one of the vehicle's in-vehicle infotainment system and the user's mobile terminal. That is, the target terminal can be the in-vehicle infotainment system, the mobile terminal, or both.

[0087] In some optional implementations, if the identification result includes the target object, sending a prompt message to the target terminal to cause the target terminal to output the prompt message may include:

[0088] If the recognition result contains the target object and the vehicle is currently in a driving state, a prompt message is sent to the vehicle terminal so that the vehicle terminal can output the prompt message.

[0089] If the identification result contains the target object and the current state is locked, a prompt message is sent to the mobile terminal so that the mobile terminal outputs the prompt message.

[0090] In this embodiment, when the current state is driving, a prompt message is output through the vehicle's infotainment system; when the current state is locked, a prompt message is output through the mobile terminal. This can promptly remind the user that there may be danger posed by a target object inside the vehicle, so that the user can specifically check for potential hazards and prevent safety accidents caused by the target object.

[0091] The alert message is used to notify the user that a target object on the vehicle's center console is in danger.

[0092] The target object is any object that could pose a danger to the vehicle.

[0093] For example, the prompt message could be "The target object may be dangerous, please handle it promptly".

[0094] For example, the target object can be a glass fragrance box or a decorative item.

[0095] For example, the vehicle-mounted system can output prompts in at least one of the following ways: displaying prompts on the vehicle's screen or broadcasting prompts via voice.

[0096] For example, the mobile terminal may output prompt information in the following ways: by sending a text message or by broadcasting a text message and / or a voice message through at least one of SMS and application (APP).

[0097] In other embodiments, the server can acquire a target image of the vehicle's center console through the vehicle's infotainment system, then identify objects in the target image and obtain identification results. If the identification results contain the target object, the server can send a prompt message to the target terminal so that the mobile terminal can output the prompt message. At the same time, the server sends the identification results to the vehicle's infotainment system so that the vehicle's infotainment system can control the vehicle's display screen to output the prompt message.

[0098] Based on the same inventive concept as the above-described information prompting method, this application also provides an information prompting device. The information prompting device is described below.

[0099] Figure 2 This is a schematic diagram of the information prompting device provided in the embodiments of this application.

[0100] like Figure 2 As shown in the figure, this application embodiment provides an information prompting device 200, which can be applied to a vehicle-mounted terminal or a server. The information prompting device 200 may include a first acquisition module 210, an identification module 220, and a sending module 230.

[0101] The first acquisition module 210 is used to acquire a target image of the vehicle's center console;

[0102] The recognition module 220 is used to recognize objects in the target image and obtain recognition results;

[0103] The sending module 230 is used to send a prompt message to the target terminal when the recognition result contains a target object, so that the target terminal outputs a prompt message. The prompt message is used to remind the user that there is a danger in the target object on the vehicle's central control panel; the target object is an object that may cause danger in the vehicle.

[0104] This application provides an information prompting device. First, it acquires a target image of the vehicle's center console. Then, it identifies objects in the target image to obtain a recognition result. Finally, if the recognition result contains a target object, it sends a prompt message to a target terminal, causing the target terminal to output a prompt message. The prompt message is used to remind the user that a target object on the vehicle's center console poses a danger. The target object is any object that could cause a hazard within the vehicle. In other words, this application, by sending a prompt message to the target terminal when the recognition result contains a target object, causes the target terminal to output a prompt message, thus reminding the user that a target object inside the vehicle may pose a danger. This allows the user to specifically investigate potential hazards and prevent safety accidents caused by the target object.

[0105] In some alternative implementations, the information prompting device 200 may further include:

[0106] The second acquisition module is used to acquire the current status of the vehicle;

[0107] The determination module is used to determine whether the parameter information corresponding to the current state meets the preset conditions.

[0108] In some optional implementations, the current state includes the driving state, and the parameter information corresponding to the driving state includes the current vehicle speed;

[0109] The parameter information corresponding to the current state meets the preset conditions, including: the current vehicle speed is greater than the vehicle speed threshold.

[0110] In some optional implementations, the current state includes a locked state, and the parameter information corresponding to the locked state includes the light intensity of the vehicle's center console.

[0111] The parameter information corresponding to the current state meets the preset conditions, including: the light intensity of the vehicle's center console is greater than the light intensity threshold.

[0112] In some alternative implementations, the target terminal is at least one of the vehicle's in-vehicle infotainment system and the user's mobile terminal.

[0113] In some alternative implementations, the sending module 230 may include:

[0114] The first sending submodule is used to send a prompt message to the vehicle terminal when the recognition result contains the target object and the vehicle's current state is driving, so that the vehicle terminal outputs the prompt message.

[0115] The second sending submodule is used to send a prompt message to the mobile terminal when the recognition result contains the target object and the current state is locked, so that the mobile terminal outputs the prompt message.

[0116] In some alternative implementations, the identification module 220 may be specifically used for:

[0117] The target image is input into the image recognition model so that the image recognition model can identify the objects in the target image and obtain the recognition result.

[0118] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation and the beneficial effects have been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0119] Based on the same inventive concept as the information prompting method described above, this application also provides an information prompting system. The information prompting system is described below.

[0120] Figure 3 This is a schematic diagram of the structure of the information prompting system provided in the embodiments of this application.

[0121] like Figure 3 As shown, the information prompting system 300 provided in this application embodiment may include:

[0122] Image acquisition device 310, processor 320 and target terminal 330;

[0123] Image acquisition device 310 is used to acquire target images of the vehicle's center console and send the target images to the processor;

[0124] Processor 320 is configured to execute the information prompting method described in the above embodiments;

[0125] The target terminal 330 is used to output prompt information.

[0126] This application provides an information prompting system. First, a target image of the vehicle's center console is acquired. Then, objects in the target image are identified to obtain a recognition result. Finally, if the recognition result contains a target object, a prompt message is sent to the target terminal, causing the target terminal to output a prompt message. The prompt message is used to remind the user that a target object on the vehicle's center console poses a danger. The target object is any object that could cause a hazard within the vehicle. In other words, this application, by sending a prompt message to the target terminal when the recognition result contains a target object, causes the target terminal to output a prompt message, thus reminding the user that a target object inside the vehicle may pose a danger. This allows the user to specifically investigate potential hazards and prevent safety accidents caused by the target object.

[0127] The image acquisition device 310 can be a camera, etc.

[0128] The processor 320 can be either a processor 320 for the vehicle-mounted system or a processor 320 for a server.

[0129] The target terminal 330 can be a mobile terminal or an in-vehicle terminal.

[0130] For example, when the processor 320 is a processor 320 for a vehicle-mounted system, the target terminal 330 can be a vehicle-mounted system; when the processor 320 is a processor 320 for a server, the target terminal 330 can be a mobile terminal.

[0131] Regarding the system in the above embodiments, the specific methods by which each module performs operations and the beneficial effects have been described in detail in the embodiments related to the method, and will not be elaborated here.

[0132] Furthermore, in conjunction with the information prompting methods in the above embodiments, this application embodiment can provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when these computer program instructions are executed by a processor, they implement any of the information prompting methods in the above embodiments.

[0133] The above description is merely a specific implementation of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. An information prompting method, characterized in that, include: Obtain the current status of the vehicle, including the locked status, and the parameter information corresponding to the locked status includes the light intensity of the vehicle's center console; Determine that the parameter information corresponding to the current state meets the preset conditions, including: the light intensity of the vehicle center console is greater than the light intensity threshold. Acquire a target image of the vehicle's center console; Identify objects in the target image and obtain identification results; If the identification result contains a target object, a prompt message is sent to the target terminal so that the target terminal outputs the prompt message, which is used to remind the user that the target object on the vehicle's center console is dangerous; the target object is any object that could cause danger to the vehicle. When the identification result contains a target object, sending a prompt message to the target terminal so that the target terminal outputs the prompt message includes: If the identification result contains the target object and the current state is a locked vehicle, a prompt message is sent to the user's mobile terminal so that the mobile terminal outputs the prompt message.

2. The information prompting method according to claim 1, characterized in that, The current state also includes the driving state, and the parameter information corresponding to the driving state also includes the current vehicle speed; The parameter information corresponding to the current state also meets the preset conditions, including: the current vehicle speed is greater than the vehicle speed threshold.

3. The information prompting method according to claim 1, characterized in that, The step of sending a prompt message to the target terminal when the recognition result contains a target object, so that the target terminal outputs the prompt message, further includes: If the identification result contains the target object and the vehicle is currently in a driving state, a prompt message is sent to the vehicle's infotainment system so that the infotainment system outputs the prompt message.

4. The information prompting method according to claim 1, characterized in that, The process of identifying objects in the target image and obtaining identification results includes: The target image is input into an image recognition model so that the image recognition model can identify the objects in the target image and obtain the recognition result.

5. An information prompting device, characterized in that, include: The second acquisition module is used to acquire the current status of the vehicle, including the vehicle lock status, and the parameter information corresponding to the vehicle lock status includes the light intensity of the vehicle center console. The determination module is used to determine whether the parameter information corresponding to the current state meets the preset conditions. The preset conditions include: the light intensity of the vehicle center console is greater than the light intensity threshold. The first acquisition module is used to acquire a target image of the vehicle's center console; The recognition module is used to identify objects in the target image and obtain recognition results; The sending module is configured to send a prompt message to the target terminal when the identification result contains a target object, so that the target terminal outputs the prompt message, which is used to prompt the user that the target object on the vehicle's center console is dangerous; the target object is any object that could cause danger to the vehicle. The sending module includes: The second sending submodule is used to send a prompt message to the user's mobile terminal when the identification result contains the target object and the current state is a locked vehicle state, so that the mobile terminal outputs the prompt message.

6. An information prompting system, characterized in that, The information prompting system includes an image acquisition device, a processor, and a target terminal; The image acquisition device is used to acquire a target image of the vehicle's center console and send the target image to the processor; The processor is configured to execute the information prompting method according to any one of claims 1-4; The target terminal is used to output the prompt information.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions, which, when executed by a processor, implement the information prompting method as described in any one of claims 1-4.

Images