Internet-of-things intelligent cabin message leaving system and method

Abstract

The invention discloses an internet-of-things intelligent cabin message leaving system and method, and belongs to the technical field of internet-of-things intelligent cabin data interaction, the internet-of-things intelligent cabin message leaving system comprises a mobile terminal, a cloud terminal and a vehicle terminal, the vehicle terminal queries message content through an http request, the mobile terminal sends the message content through the http request, and communication authentication verification is performed with the cloud terminal through an mqtt sending protocol; according to the invention, the problem that a user forgets to do items during driving or at the end of driving is solved. The problems that a car owner cannot be contacted through a mobile phone, and family members have communication requirements are solved. And the traffic risk caused by communication in the driving process is avoided. A user can see the message of the family member / himself or herself when getting on the vehicle, the desktop card reminds in the driving process, and the message is unprocessed to remind when getting off the vehicle. The family members can communicate with the vehicle owner through the Internet of Vehicles software under the condition that the mobile phone has no power or no network or has arrearage. A desktop card is used for reminding during driving, and traffic risks are avoided in a voice reminding mode before getting off.

Description

Technical Field

[0001] The present invention belongs to the technical field of data interaction in an intelligent cockpit of the Internet of Things, and in particular to an intelligent cockpit message system and method for the Internet of Things. Background Art

[0002] The current car cockpit software does not have a message board system, so it is easy to forget things during the journey, or the car owner and family members fail to communicate in time or forget after communication. Summary of the invention

[0003] In view of the above problems, the present invention provides an IoT smart cockpit message system and method, including a mobile terminal, a cloud terminal and a vehicle terminal; the vehicle terminal queries the message content through an HTTP request, the mobile terminal sends the message content through an HTTP request, communicates with the cloud terminal through the MQTT sending protocol, sends the message content to the specified MQTT topic, and after receiving the message from the mobile terminal, sends the ID uploaded by the mobile terminal to the user family relationship module for authentication verification. After the verification is passed, the family relationship module calls the vehicle user information module to return the VIN code, and the message board module binds the VIN and the message content, stores them in the MySQL database and sends them to MQTT; the present invention solves the problem of forgetting what needs to be done during or at the end of driving. It solves the problem that the owner cannot be contacted through the mobile phone and the family has communication needs. It avoids the traffic risks caused by communication during driving. You can see the messages of your family / yourself when you get on the car, there are desktop card reminders during driving, and there are unprocessed message reminders when you get off the car. Through the Internet of Vehicles software, family members can communicate with the owner when the mobile phone is out of power / network / or in arrears. Reminders are provided in the form of desktop cards while driving, and voice reminders are provided before getting off the vehicle to avoid traffic risks.

[0004] The technical scheme of the present invention is as follows: an Internet of Things intelligent cockpit message system includes a mobile terminal, a cloud terminal and a vehicle terminal. The vehicle terminal includes a message board app, a vehicle service module, a tts voice service module, a tbox module and a desktop module. The message board app can send an http request to the cloud terminal to query data, display data on the desktop module, call the tts voice service module, and store the queried data; the vehicle service module is a vehicle-mounted system used to communicate with the vehicle terminal, send signals to the vehicle body BCM to control the vehicle body, monitor the changes in the BCM signal on the vehicle, and transmit the signal tts voice service module to receive external input text, convert it into voice content and call the speaker to play; the tbox module is responsible for network connection, connects to the cloud terminal through the mqtt service, receives and subscribes to topics in the cloud terminal, and is used to receive and send messages; the desktop module is a resident Android application that is often displayed on the desktop. In this function, it is called by the message board app to display the message information on the desktop;

[0005] The cloud includes microservices based on kubernates and spring cloud, vehicle user information module, user family relationship module, message board module, message middleware mqtt service and mysql database. The vehicle user information module is used to store vehicle information; the user family relationship module is used to bind information and perform authentication verification during binding; the message board module is used to store vehicle vin and message board module, store, query and send; the mqtt service is an IoT communication message queue middleware service that can publish topics and send messages to subscribers;

[0006] The mobile terminal includes apps and mini-programs. The app is used to apply for a one-time binding verification code from the cloud, and the verification code can be shared after it is obtained. Enter the binding code in the mini-program and send it to the cloud for verification. After the verification is passed, the mini-program page will display a message page with an input box, fill in the content and send it;

[0007] The vehicle computer queries the message content through http request, the mobile terminal sends the message content through http request, communicates with the cloud through the mqtt sending protocol, and sends the message content to the specified mqtt topic. After receiving the message from the mobile terminal, the id uploaded by the mobile terminal will be sent to the user family relationship module for authentication verification. After the verification passes, the family relationship module will call the vehicle user information module to return the vin code, and the message board module will bind the vin and the message content, store them in the mysql database and send them to mqtt.

[0008] Furthermore, the vehicle computer is developed based on the Android system, Java language, MQTT protocol, HTTP protocol, language service, vehicle service, and signal detection.

[0009] Furthermore, the message board app module on the vehicle side can actively query cloud messages, passively receive messages sent from the cloud, and display them on the desktop message board card, and remind the driver through voice broadcast when he is about to leave the car.

[0010] Furthermore, the vehicle user information module, the user family relationship module and the message board module communicate with each other via http requests.

[0011] A method for leaving a message in an IoT smart cockpit comprises the following steps:

[0012] S1 binds the account information to be interacted with;

[0013] After S2 is bound, it can interact with the app through the mini program to leave messages;

[0014] S3 queries the message, compares it, and confirms whether to broadcast it;

[0015] Furthermore, step S1 is specifically as follows:

[0016] S101 sends the invitation request to the cloud via http on the app invitation request page;

[0017] After receiving the request, S102 generates an encryption key through md5 encryption, caches it in the cloud, and returns the encryption key to the app;

[0018] S103 shares S2's encryption key to the mini program in the app, and binds the information in the cloud through the mini program.

[0019] After receiving the binding request, S104 the cloud determines whether the encryption key exists and has not been used. If all conditions are met, the binding information is sent. If any condition is not met, the cloud returns a message to the mini program indicating that the encryption verification code is invalid or has been used.

[0020] Furthermore, step S2 is specifically as follows:

[0021] After S201 binds the account information, enter text information or pictures in the mini program and send the information to the cloud;

[0022] After receiving the information, S202 queries the owner information and vehicle VIN code through ID;

[0023] S203 stores the VIN code and the message content in the vehicle message board table in the MySQL database, and sends the VIN code and the message content to the message board topic of the MQTT service.

[0024] Furthermore, in step S3, the message query is specifically as follows: during the vehicle startup / driving process, the on-board machine can periodically poll the cloud http interface to check whether there is any unread message content; or the tbox module subscribes to the message board topic of the mqtt service. If there is a new message, the cloud mqtt service will send it to the tbox module, and the vehicle machine obtains the new message content by listening to the tbox module signal.

[0025] Furthermore, in step S3, the comparison is specifically to obtain the new message content, compare the message id with the vehicle-mounted local storage to see whether the id exists. If it exists, it will not be displayed; if it does not exist, it will be displayed and the tts voice service module will be called for broadcasting.

[0026] Furthermore, in step S3, when leaving the vehicle, the vehicle service signal interface is used to monitor the seat belt unplugging signal and the gear shifting signal. If the seat belt unplugging signal and the gear shifting P signal are received within five seconds, the tts voice service module is called to broadcast the message.

[0027] The beneficial effects of the present invention are:

[0028] The present invention solves the problem of forgetting things to do during or at the end of a journey. It solves the situation where the owner cannot be contacted via mobile phone and the family has communication needs. It avoids the traffic risks caused by communication during driving. You can see the messages of your family / yourself when you get on the car, there will be desktop card reminders during driving, and reminders of unprocessed messages when you get off the car. Through the Internet of Vehicles software, family members can communicate with the owner when the mobile phone is out of power / network / or in arrears. Reminders in the form of desktop cards during driving and voice reminders before getting off the car can avoid traffic risks. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 The figure is a flow chart of the method of the present invention. DETAILED DESCRIPTION

[0030] It should be noted that in the description of the present invention, the terms "center", "up", "down", "left", "right", "vertical", "horizontal", "inside", "outside", "clockwise", "counterclockwise", etc. indicate directions or positional relationships based on the directions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific direction, be constructed and operated in a specific direction.

[0031] In the present invention, unless otherwise clearly specified and limited, the terms "set", "install", "connect", "connect" and the like should be understood in a broad sense. For example, "fixed" can be a fixed connection, a detachable connection, or an integral connection; the connection can be a mechanical connection or an electrical connection; the connection can be a direct connection or an indirect connection through an intermediate medium, and can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0032] An Internet of Things intelligent cockpit message system includes a mobile terminal, a cloud terminal and a vehicle terminal.

[0033] The vehicle terminal includes a message board APP, a vehicle service module, a TTS voice service module, a tbox module, and a desktop module.

[0034] The message board APP is a module developed based on the Android language and can run on the in-vehicle Android system. It can send http requests to the cloud to query data, display data on the desktop, call the TTS voice service module, and store the queried data. It serves as the main functional logic judgment module.

[0035] The vehicle service module is a module used by the vehicle system to communicate and monitor signals with the vehicle end. It sends signals to the vehicle body BCM to control the vehicle body, monitors changes in BCM signals on the vehicle, and is used to transmit signals. This module is a communication module that converts Java data into binary data.

[0036] The TTS voice service module can receive external input text, convert it into voice content and call the speaker to play it.

[0037] The tbox module is responsible for network connection, connecting to the mqtt cloud server, receiving and subscribing to topics in the mqtt cloud server, and is used to receive and send messages. The data content is in json data format.

[0038] The desktop module is a resident Android application that is often displayed on the desktop. In this function, it is called by the message board APP module to display the message information on the desktop.

[0039] The cloud side includes microservices based on kubernates and spring cloud, vehicle user information module, user family relationship module, message board module and message middleware mqtt service.

[0040] The vehicle user information module is used to store the binding relationship between vehicle information and users. A car has only one owner and communicates with the user family relationship module and message board module through http requests.

[0041] The user family relationship module is used to bind the information of the car owner and his family members, perform authentication verification when binding, query the car owner's ID through the family member's WeChat ID when sending information, and then query the vehicle information to obtain the VIN code, and communicate with the vehicle user information module and message board module through http request

[0042] The message board module is a relationship management module used to store, query, and send vehicle VINs and message boards. The vehicle side queries the message content through http requests, and the mobile side sends the message content through http requests. It communicates with mqtt through the mqtt sending protocol and sends the message content to the specified mqtt topic. After receiving the message from the mobile side, this module will send the WeChat ID uploaded by the mobile side to the user family relationship module for authentication verification. After the verification passes, the family relationship module will call the vehicle user information module to return the VIN code. The message board module will bind the VIN and the message content, store them in mysql and send them to mqtt. This message board module exists as a bridge between the vehicle side and the mini program side.

[0043] The mqtt service is an IoT communication message queue middleware service that can publish topics and send messages to subscribers. The communication is based on the mqtt protocol to send data in json format.

[0044] The mobile terminal includes: mobile app and WeChat applet.

[0045] The mobile app is used by the car owner to apply for a one-time family binding verification code from the cloud. After receiving it, the verification code can be shared with family members.

[0046] The WeChat mini program is for family members to use. Click on the mini program, log in using WeChat, enter the binding code, and send it for cloud verification. After the verification is passed, the mini program page will display a message page with an input box where you can fill in the content and send it.

[0047] The vehicle computer is developed based on the Android system and Java language, and combines the MQTT protocol, HTTP protocol, language service, vehicle service and signal detection.

[0048] The message board app module on the vehicle side can actively query cloud messages, passively receive messages sent from the cloud, and display them on the desktop message board card. It will also remind the driver through voice broadcast when the driver is about to leave the vehicle.

[0049] Apply for a one-time verification code through the mobile app, generate a binding page, share it, and the link is valid once.

[0050] The family members open the mini program and bind the relationship between the family members and the car owner.

[0051] The user family relationship module stores the binding relationship in the cloud.

[0052] Family members enter the message content in the mini program and send it to the message interface of the cloud message board module to obtain services.

[0053] The user family relationship module verifies whether the message user exists.

[0054] The user family relationship module verifies whether the message user has a bound vehicle.

[0055] If all verifications fail, the program returns to the applet.

[0056] If one succeeds and the other fails, 1. First check whether the binding verification code exists. If not, return an invalid binding code. 2. Verify whether the binding verification code has not been used. If it has been used, return the binding code has been used. 3. Verify: decrypt the binding code and check whether the decrypted code is the owner. If not, return that this binding code has no valid owner.

[0057] If the verification is successful, the message board module will be executed in two steps.

[0058] Step 1: Encrypt and store the latest message information in the cloud database.

[0059] Step 2: Send the latest message information to the tbox module on the vehicle side via MQTT.

[0060] If the vehicle computer is not online, the vehicle computer is powered on and the HTTP interface of the message board module queries the unread messages.

[0061] If the vehicle computer is online, the tbox module receives the message sent by mqtt.

[0062] After receiving a message, the message board module will pop up a card on the desktop to display the message content.

[0063] Automatically clicking the Done button closes the card.

[0064] The vehicle service module can detect whether the seat belt is unfastened and whether the gear is in P gear.

[0065] If one or none of the conditions are met, no action is taken;

[0066] If all conditions are met, the message content will be announced by voice.

[0067] Through the vehicle service signal interface, monitor the seat belt unplug signal and the gear shift signal. If the seat belt unplug signal and the gear shift P signal are received within five seconds, it is determined that the owner is about to leave the car, and the voice tts module is called again to broadcast the message.

[0068] A method for leaving a message in an IoT smart cockpit comprises the following steps:

[0069] Step 100: The mobile app applies to generate a one-time encrypted invitation h5 page, and sends this request to the mobile cloud service via http to share it with family members to bind kinship relationships.

[0070] Step 200: After receiving the request, the cloud service generates an encryption key through md5 encryption based on the car owner's userID and timestamp, and caches it in the cloud redis service. This encryption key is used as the unique authentication code for this invitation and is returned to the mobile app client.

[0071] Step 300: The car owner shares the encryption key with family members. The family members open the WeChat applet, log in using WeChat, enter the encryption key, click Submit, and send the family member’s WeChat ID and key to the cloud service to bind the family member’s information.

[0072] Step 400: After receiving the binding request, the cloud service 1. determines whether the key exists and 2. has not been used. If both conditions are met, the family member’s WeChat ID is entered into the owner’s family information table. Otherwise, it returns to the mini program to prompt that the encrypted verification code is invalid or has been used.

[0073] Step 500: After step 400 is passed, the family member's mini program page will display an input box for the message board, where you can enter text information or pictures and click Send. At this time, the WeChat ID and the content to be sent will be sent to the cloud in json data format.

[0074] Step 600: After receiving the data, the cloud service queries the vehicle owner information and the vehicle VIN code through the WeChat ID.

[0075] Step 700: Store the VIN code and message board content in the vehicle message board table in the MySQL database. Send the VIN code and message board content to the message board topic of the MQTT service.

[0076] Step 800: During vehicle startup / driving, the vehicle terminal app can query the message content in two ways. Method 1: By periodically polling the cloud http interface, check whether there are any unread messages. Method 2: The tbox in the car subscribes to the message board topic of the mqtt service. If there is a new message, the MQTT cloud server will send it to the tbox, and the vehicle terminal obtains the new message content by monitoring the tbox signal.

[0077] Step 900: The new message content is obtained, and the message ID is compared with the vehicle local storage to determine whether the ID exists, and whether it is new content. If it exists, it means that it is an old message and is not displayed. If it is a new message, it is displayed on the desktop and the voice tts module is called for broadcasting.

[0078] Step 1000: When leaving the car, remind the owner again. Through the vehicle service signal interface, monitor the seat belt unplug signal and the gear shift signal. If the seat belt unplug signal and the gear shift P signal are received within five seconds, it is determined that the owner is about to leave the car, and the voice tts module is called again to broadcast the message.

[0079] The above is only a specific implementation of the present invention, but the protection scope of the present invention is not limited thereto. Any modification, equivalent replacement and improvement made by any person skilled in the art within the technical scope disclosed by the present invention and within the spirit and principle of the present invention shall be covered within the protection scope of the present invention. At the same time, the contents not described in detail in this specification belong to the prior art known to those skilled in the art.

[0080] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

Claims

1. An IoT smart cockpit message system, characterized in that: include: It includes mobile terminal, cloud terminal and vehicle terminal. The vehicle terminal includes message board app, vehicle service module, tts voice service module, tbox module and desktop module. The message board app can send http request to the cloud terminal to query data, display data in the desktop module, call tts voice service module and store the queried data. The vehicle service module is the vehicle system used to communicate with the vehicle terminal, send signals to the vehicle body BCM to control the vehicle body, monitor the changes of BCM signals on the vehicle, and transmit signals. The tts voice service module can receive external input text, convert it into voice content and call the speaker to play. The tbox module is responsible for network connection, connecting to the cloud through the mqtt service, receiving and subscribing to topics in the cloud, and is used to receive and send messages; the desktop module is a resident Android application that is often displayed on the desktop. In this function, it is called by the message board APP to display message information on the desktop; The cloud includes microservices based on kubernates and spring cloud, vehicle user information module, user family relationship module, message board module, message middleware mqtt service and mysql database. The vehicle user information module is used to store vehicle information. The user family relationship module is used to bind information and perform authentication verification during binding; the message board module is used to store vehicle VIN and message board modules, store, query, and send; the mqtt service is an IoT communication message queue middleware service that can publish topics and send messages to subscribers; The mobile terminal includes apps and mini-programs. The app is used to apply for a one-time binding verification code from the cloud, and the verification code can be shared after it is obtained. Enter the binding code in the mini-program and send it to the cloud for verification. After the verification is passed, the mini-program page will display a message page with an input box, fill in the content and send it; The vehicle computer queries the message content through http request, the mobile terminal sends the message content through http request, communicates with the cloud through the mqtt sending protocol, and sends the message content to the specified mqtt topic. After receiving the message from the mobile terminal, the id uploaded by the mobile terminal will be sent to the user family relationship module for authentication verification. After the verification passes, the family relationship module will call the vehicle user information module to return the vin code, and the message board module will bind the vin and the message content, store them in the mysql database and send them to mqtt.

2. The IoT smart cockpit message system according to claim 1, characterized in that: The vehicle computer is developed based on the Android system and Java language, and combines the MQTT protocol, HTTP protocol, language service, vehicle service and signal detection.

3. The IoT smart cockpit message system according to claim 1, characterized in that: The message board app module on the car side can actively query cloud messages, passively receive messages sent from the cloud, and display them on the desktop message board card. It will also remind the driver through voice broadcast when the driver is about to leave the car.

4. The IoT smart cockpit message system according to claim 1, characterized in that: The vehicle user information module, the user family relationship module and the message board module communicate with each other via http requests.

5. A method for leaving a message in an IoT smart cockpit, characterized in that: The following steps are involved: S1 binds the account information to be interacted with; After S2 is bound, it can interact with the app through the mini program to leave messages; S3 queries the message, compares it, and confirms whether to broadcast it.

6. The method for leaving a message in an IoT smart cockpit according to claim 5, characterized in that: Step S1 is specifically as follows: S101 sends the invitation request to the cloud via http on the app invitation request page; After receiving the request, S102 generates an encryption key through md5 encryption, caches it in the cloud, and returns the encryption key to the app; S103 shares S2's encryption key to the mini program in the app, and binds the information in the cloud through the mini program. After receiving the binding request, S104 the cloud determines whether the encryption key exists and has not been used. If all conditions are met, the binding information is sent. If any condition is not met, the cloud returns a message to the mini program indicating that the encryption verification code is invalid or has been used.

7. The method for leaving a message in an IoT smart cockpit according to claim 5, characterized in that: Step S2 is specifically as follows: After S201 binds the account information, enter text information or pictures in the mini program and send the information to the cloud; After receiving the information, S202 queries the owner information and vehicle VIN code through ID; S203 stores the VIN code and the message content in the vehicle message board table in the MySQL database, and sends the VIN code and the message content to the message board topic of the MQTT service.

8. The method for leaving a message in an IoT smart cockpit according to claim 5, characterized in that: In step S3, the message query is specifically as follows: during the vehicle startup / driving process, the on-board machine can periodically poll the cloud http interface to check whether there are any unread messages; or the tbox module subscribes to the message board topic of the mqtt service. If there are new messages, the cloud mqtt service will send them to the tbox module, and the vehicle machine will obtain the new message content by monitoring the tbox module signal.

9. The method for leaving a message in an IoT smart cockpit according to claim 8, characterized in that: In step S3, the comparison is specifically to obtain the new message content, compare the message ID with the vehicle-mounted local storage to see whether the ID exists. If it exists, it will not be displayed; if it does not exist, it will be displayed and the tts voice service module will be called for broadcasting.

10. The method for leaving a message in an IoT smart cockpit according to claim 9, characterized in that: In step S3, when leaving the vehicle, the vehicle service signal interface is used to monitor the seat belt unplugging signal and the gear shifting signal. If the seat belt unplugging signal and the gear shifting P signal are received within five seconds, the tts voice service module is called to broadcast the message.

Images