Vehicle communication method and device based on Internet of Vehicles, and electronic equipment

Abstract

The invention provides a vehicle communication method and device based on the Internet of Vehicles and electronic equipment, and relates to the technical field of vehicles, in particular to the technical field of the Internet of Vehicles and intelligent navigation. According to the implementation scheme, in-vehicle sound information and vehicle state information of a first vehicle are obtained; determining whether the first vehicle has an emergency situation according to at least one of the in-vehicle sound information and the vehicle state information; in response to determining that the first vehicle has the emergency situation, a first instruction is sent to a server, and the first instruction indicates that the first vehicle has the emergency situation; and receiving a first navigation route from the server to converge with a second vehicle based on the first navigation route, the distance between the second vehicle and the first vehicle being less than a first threshold, the second vehicle including a first rescue resource for handling an emergency, and the second vehicle agreeing with rescue.

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle technology, in particular to the field of vehicle networking and intelligent navigation technology, and specifically to a vehicle communication method, device, electronic device, computer-readable storage medium and computer program product based on the vehicle networking. Background Art

[0002] In related technologies, when an emergency occurs in the vehicle (for example, people in the vehicle need medical emergency, etc.), a help signal can be sent out through the terminal device to seek help from a professional rescue vehicle (for example, an ambulance).

[0003] The approaches described in this section are not necessarily approaches that have been previously conceived or employed. Unless otherwise indicated, it should not be assumed that any approach described in this section is prior art simply by virtue of its inclusion in this section. Similarly, unless otherwise indicated, the issues raised in this section should not be considered as having been recognized in any prior art. Summary of the Invention

[0004] The present disclosure provides a vehicle communication method, device, electronic device, computer-readable storage medium, and computer program product based on the Internet of Vehicles.

[0005] According to one aspect of the present disclosure, a vehicle communication method based on the Internet of Vehicles is provided, which is applied to a first vehicle side, and the method includes: obtaining in-vehicle sound information and vehicle status information of the first vehicle; determining whether an emergency occurs in the first vehicle based on at least one of the in-vehicle sound information and the vehicle status information; in response to determining that the first vehicle has encountered the emergency, sending a first instruction to a server, wherein the first instruction indicates that the first vehicle has encountered the emergency; and receiving a first navigation route from the server to merge with a second vehicle based on the first navigation route, wherein the distance between the second vehicle and the first vehicle is less than a first distance threshold, the second vehicle includes a first rescue resource for handling the emergency, and the second vehicle agrees to rescue.

[0006] According to another aspect of the present disclosure, a vehicle communication method based on the Internet of Vehicles is provided, which is applied to a server side, and the method includes: in response to receiving a first instruction from a first vehicle, determining whether there is a second vehicle whose distance from the first vehicle is less than a first distance threshold, wherein the first instruction indicates that an emergency has occurred in the first vehicle, and the second vehicle includes a first rescue resource for handling the emergency; in response to determining the existence of the second vehicle, generating a second instruction asking the second vehicle whether it agrees to rescue and sending it to the second vehicle; in response to receiving a third instruction from the second vehicle, generating a first navigation route, wherein the third instruction indicates that the second vehicle agrees to rescue, and the first navigation route is used to guide the first vehicle and the second vehicle to merge; and sending the first navigation route to the first vehicle and the second vehicle respectively.

[0007] According to another aspect of the present disclosure, a vehicle communication method based on the Internet of Vehicles is provided, which is applied to a second vehicle side, wherein the second vehicle includes a first rescue resource for handling emergency situations, and the method includes: in response to receiving a second instruction from a server, determining whether to agree to rescue, wherein the second instruction asks whether to agree to rescue the first vehicle in the emergency situation, and the distance between the first vehicle and the second vehicle is less than a first distance threshold; in response to determining to agree to rescue, sending a third instruction indicating agreement to rescue to the server; and receiving a first navigation route from the server to merge with the first vehicle based on the first navigation route.

[0008] According to another aspect of the present disclosure, a vehicle communication device based on the Internet of Vehicles is provided, which is applied to a first vehicle side, and the device includes: a first module, configured to obtain in-vehicle sound information and vehicle status information of the first vehicle; a second module, configured to determine whether an emergency occurs in the first vehicle based on at least one of the in-vehicle sound information and the vehicle status information; a third module, configured to send a first instruction to a server in response to determining that the first vehicle has encountered the emergency, wherein the first instruction indicates that the first vehicle has encountered the emergency; and a fourth module, configured to receive a first navigation route from the server to merge with a second vehicle based on the first navigation route, wherein the distance between the second vehicle and the first vehicle is less than a first distance threshold, the second vehicle includes a first rescue resource for handling the emergency, and the second vehicle agrees to rescue.

[0009] According to another aspect of the present disclosure, a vehicle communication device based on the Internet of Vehicles is provided, which is applied to a server side, and the device includes: a fifth module, configured to determine whether there is a second vehicle whose distance from the first vehicle is less than a first distance threshold in response to receiving a first instruction from a first vehicle, wherein the first instruction indicates that an emergency has occurred in the first vehicle, and the second vehicle includes a first rescue resource for handling the emergency; a sixth module, configured to generate a second instruction asking the second vehicle whether it agrees to rescue in response to determining the existence of the second vehicle and send it to the second vehicle; a seventh module, configured to generate a first navigation route in response to receiving a third instruction from the second vehicle, wherein the third instruction indicates that the second vehicle agrees to rescue, and the first navigation route is used to guide the first vehicle and the second vehicle to merge; and an eighth module, configured to send the first navigation route to the first vehicle and the second vehicle respectively.

[0010] According to another aspect of the present disclosure, a vehicle communication device based on the Internet of Vehicles is provided, which is applied to a second vehicle side, wherein the second vehicle includes a first rescue resource for handling emergency situations, and the device includes: a ninth module, configured to determine whether to agree to rescue in response to receiving a second instruction from a server, wherein the second instruction asks whether to agree to rescue the first vehicle in the emergency situation, and the distance between the first vehicle and the second vehicle is less than a first distance threshold; a tenth module, configured to send a third instruction indicating agreement to rescue to the server in response to determining that rescue is agreed; and an eleventh module, configured to receive a first navigation route from the server to merge with the first vehicle based on the first navigation route.

[0011] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the above method.

[0012] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the above method.

[0013] According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein the computer program implements the above method when executed by a processor.

[0014] According to one or more embodiments of the present disclosure, a vehicle communication method based on the Internet of Vehicles is provided, which determines whether an emergency occurs in a first vehicle through in-vehicle sound information and vehicle status information, and when an emergency occurs in the first vehicle, determines whether there is a second vehicle equipped with corresponding rescue resources within a certain range nearby, and sends a request for help to the second vehicle after determining the existence of the second vehicle, so as to plan a navigation route for the two to converge and rescue after the second vehicle agrees to rescue, thereby realizing mutual assistance between vehicles within a certain distance range and effectively improving the rescue efficiency for emergency situations.

[0015] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings illustrate exemplary embodiments and constitute a part of the specification. Together with the description of the specification, they serve to explain exemplary implementation of the embodiments. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals designate similar, but not necessarily identical, elements.

[0017] Figure 1 is a schematic diagram illustrating an example system in which the various methods described herein may be implemented, according to an exemplary embodiment;

[0018] Figure 2 A flow chart showing a vehicle communication method applied to a first vehicle side according to an embodiment of the present disclosure is shown;

[0019] Figure 3 A flow chart showing a vehicle communication method applied to a first vehicle side according to an embodiment of the present disclosure is shown;

[0020] Figure 4 A flow chart showing a vehicle communication method applied to a first vehicle side according to an embodiment of the present disclosure is shown;

[0021] Figure 5 A flow chart showing a vehicle communication method applied to a first vehicle side according to an embodiment of the present disclosure is shown;

[0022] Figure 6 A flow chart showing a vehicle communication method applied to a first vehicle side according to an embodiment of the present disclosure is shown;

[0023] Figure 7 A flow chart of a vehicle communication method based on the Internet of Vehicles applied to a server side according to an embodiment of the present disclosure is shown;

[0024] Figure 8A partial flow chart of another vehicle communication method based on the Internet of Vehicles and applied to a server side according to an embodiment of the present disclosure is shown;

[0025] Figure 9 A partial flow chart of another vehicle communication method based on the Internet of Vehicles and applied to a server side according to an embodiment of the present disclosure is shown;

[0026] Figure 10 A partial flow chart of another vehicle communication method based on the Internet of Vehicles and applied to a server side according to an embodiment of the present disclosure is shown;

[0027] Figure 11 A partial flow chart of another vehicle communication method based on the Internet of Vehicles and applied to a server side according to an embodiment of the present disclosure is shown;

[0028] Figure 12 A flow chart showing a vehicle communication method applied to a second vehicle side according to an embodiment of the present disclosure is shown;

[0029] Figure 13 ; Shows a structural block diagram of a vehicle mutual assistance device applied to a first vehicle side according to an embodiment of the present disclosure;

[0030] Figure 14 A structural block diagram of a vehicle mutual assistance device applied to a server side according to an embodiment of the present disclosure is shown;

[0031] Figure 15 A structural block diagram of a vehicle mutual assistance device applied to a second vehicle side according to an embodiment of the present disclosure is shown; and

[0032] Figure 16 A structural block diagram of an exemplary electronic device that can be used to implement the embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0033] The following description of exemplary embodiments of the present disclosure is made in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be appreciated by those skilled in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0034] In this disclosure, unless otherwise specified, the use of terms such as "first" and "second" to describe various elements is not intended to limit the positional relationship, temporal relationship, or importance relationship of these elements. Such terms are only used to distinguish one element from another. In some examples, the first element and the second element may refer to the same instance of the element, while in some cases, based on the context of the description, they may also refer to different instances.

[0035] The terms used in the descriptions of the various examples described in this disclosure are for the purpose of describing specific examples only and are not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the element may be one or more. In addition, the term "and / or" used in this disclosure encompasses any one and all possible combinations of the listed items.

[0036] In related technologies, when an emergency occurs in a vehicle (e.g., someone in the vehicle needs medical emergency treatment), a distress signal can be sent out through a terminal device to seek assistance from a professional rescue vehicle (e.g., an ambulance). However, since professional rescue vehicles usually have fixed parking areas and are limited in number, there are many uncertainties in their journey to the vehicle (e.g., long distances, traffic jams, and a shortage of idle vehicles requiring deployment). This can result in a long time and, therefore, low rescue efficiency.

[0037] To solve the above problems, the present disclosure provides a vehicle communication method based on the Internet of Vehicles. When an emergency situation is detected in a first vehicle, it is determined whether there is a second vehicle equipped with corresponding rescue resources within a certain range nearby, and after determining the existence of the second vehicle, a message for help is sent to the second vehicle. After the second vehicle agrees to rescue, a navigation route is planned for the two to converge for rescue, thereby achieving mutual assistance between vehicles within a certain distance range and effectively improving the rescue efficiency in emergency situations.

[0038] The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0039] Figure 1 FIG2 is a schematic diagram of an exemplary system 100 in which the various methods and apparatuses described herein may be implemented according to an embodiment of the present disclosure. Figure 1 , the system 100 includes one or more client devices 101, 102, 103, 104, 105, and 106, a server 120, and one or more communication networks 110 coupling the one or more client devices to the server 120. The client devices 101, 102, 103, 104, 105, and 106 can be configured to execute one or more applications.

[0040] In an embodiment of the present disclosure, the server 120 may run one or more services or software applications that enable execution of a vehicle communication method based on the Internet of Vehicles.

[0041] In some embodiments, server 120 may also provide other services or software applications that may include non-virtualized environments and virtualized environments. In some embodiments, these services may be provided as web-based services or cloud services, such as provided to users of client devices 101, 102, 103, 104, 105, and / or 106 under a software as a service (SaaS) model.

[0042] exist Figure 1 In the configuration shown, the server 120 may include one or more components that implement the functions performed by the server 120. These components may include software components, hardware components, or a combination thereof that can be executed by one or more processors. Users operating client devices 101, 102, 103, 104, 105, and / or 106 may, in turn, utilize one or more client applications to interact with the server 120 to utilize the services provided by these components. It should be understood that a variety of different system configurations are possible, which may differ from the system 100. Therefore, Figure 1 This is an example of a system for implementing the vehicle communication method based on the Internet of Vehicles described herein and is not intended to be limiting.

[0043] The user can use the client devices 101, 102, 103, 104, 105 and / or 106 to perform the vehicle communication method based on the Internet of Vehicles. The client device can provide an interface that enables the user of the client device to interact with the client device. The client device can also output information to the user via the interface. Figure 1 Only six client devices are depicted, but one skilled in the art will appreciate that the present disclosure can support any number of client devices.

[0044] Client devices 101, 102, 103, 104, 105, and / or 106 may include various types of computer devices, such as portable handheld devices, general-purpose computers (such as personal computers and laptops), workstation computers, wearable devices, smart screen devices, self-service terminal devices, service robots, gaming systems, thin clients, various messaging devices, sensors or other sensing devices, etc. These computer devices may run various types and versions of software applications and operating systems, such as Microsoft Windows, Apple iOS, UNIX-like operating systems, Linux, or Linux-like operating systems (such as Google Chrome OS); or include various mobile operating systems, such as Microsoft Windows Mobile OS, iOS, Windows Phone, and Android. Portable handheld devices may include cellular phones, smartphones, tablet computers, personal digital assistants (PDAs), etc. Wearable devices may include head-mounted displays (such as smart glasses) and other devices. Gaming systems may include various handheld gaming devices, internet-enabled gaming devices, etc. Client devices are capable of executing a variety of different applications, such as various internet-related applications, communication applications (such as email applications), and short message service (SMS) applications, and may use various communication protocols.

[0045] The network 110 may be any type of network known to those skilled in the art that can support data communications using any of a variety of available protocols, including but not limited to TCP / IP, SNA, IPX, etc. By way of example only, the one or more networks 110 may be a local area network (LAN), an Ethernet-based network, a token ring, a wide area network (WAN), the Internet, a virtual network, a virtual private network (VPN), an intranet, an extranet, a public switched telephone network (PSTN), an infrared network, a wireless network (e.g., Bluetooth, WIFI), and / or any combination of these and / or other networks.

[0046] Server 120 may include one or more general-purpose computers, specialized server computers (e.g., PC (personal computer) servers, UNIX servers, mid-range servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and / or combination. Server 120 may include one or more virtual machines running virtual operating systems, or other computing architectures involving virtualization (e.g., one or more flexible pools of logical storage devices that may be virtualized to maintain a server's virtual storage device). In various embodiments, server 120 may run one or more services or software applications that provide the functionality described below.

[0047] The computing units in the server 120 may run one or more operating systems including any of the operating systems described above as well as any commercially available server operating systems. The server 120 may also run any of a variety of additional server applications and / or middle-tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, and the like.

[0048] In some implementations, server 120 may include one or more applications to analyze and consolidate data feeds and / or event updates received from users of client devices 101, 102, 103, 104, 105, and 106. Server 120 may also include one or more applications to display the data feeds and / or real-time events via one or more display devices of client devices 101, 102, 103, 104, 105, and 106.

[0049] In some embodiments, server 120 may be a distributed system server or a server integrated with blockchain. Server 120 may also be a cloud server, or an intelligent cloud computing server or intelligent cloud host equipped with artificial intelligence technology. A cloud server is a host product within the cloud computing service system that addresses the management difficulties and poor scalability of traditional physical hosts and virtual private servers (VPS) services.

[0050] System 100 may also include one or more databases 130. In some embodiments, these databases may be used to store map information, audio information, and other information. For example, one or more of databases 130 may be used to store information such as audio files and map files. Databases 130 may reside in a variety of locations. For example, the database used by server 120 may be local to server 120, or may be remote from server 120 and communicate with server 120 via a network-based or dedicated connection. Databases 130 may be of different types. In some embodiments, the database used by server 120 may be, for example, a relational database. One or more of these databases may store, update, and retrieve data to and from the database in response to commands.

[0051] In some embodiments, one or more of the databases 130 may also be used by applications to store application data. The databases used by the applications may be different types of databases, such as a key-value store, an object store, or a conventional store backed by a file system.

[0052] Figure 1The system 100 may be configured and operated in various ways to enable the application of various methods and apparatuses described in accordance with the present disclosure.

[0053] Figure 2 A flowchart of a vehicle communication method based on the Internet of Vehicles applied to a server side according to an embodiment of the present disclosure is shown.

[0054] like Figure 2 As shown, a vehicle communication method 200 based on the Internet of Vehicles is applied to a first vehicle side. The method 200 includes:

[0055] Step 210: Acquire in-vehicle sound information and vehicle status information of the first vehicle;

[0056] Step 220: determining whether an emergency occurs in the first vehicle based on at least one of the in-vehicle sound information and the vehicle status information;

[0057] Step 230: In response to determining that an emergency situation occurs in the first vehicle, sending a first instruction to the server, wherein the first instruction indicates that an emergency situation occurs in the first vehicle; and

[0058] Step 240: Receive a first navigation route from the server to merge with a second vehicle based on the first navigation route, wherein a distance between the second vehicle and the first vehicle is less than a first distance threshold, the second vehicle includes a first rescue resource for handling an emergency, and the second vehicle agrees to rescue.

[0059] Therefore, whether an emergency situation occurs in the first vehicle is determined through the sound information and vehicle status information inside the vehicle. When an emergency situation occurs in the first vehicle, it is determined whether there is a second vehicle equipped with corresponding rescue resources within a certain range nearby. After the existence of the second vehicle is determined, a message for help is sent to it, so that a navigation route can be planned for the two to converge and rescue after the second vehicle agrees to rescue, thereby realizing mutual assistance between vehicles within a certain distance range and effectively improving the rescue efficiency in emergency situations.

[0060] Figure 3 A partial flow chart of another vehicle communication method based on the Internet of Vehicles applied to a first vehicle side according to an embodiment of the present disclosure is shown.

[0061] According to some embodiments, the emergency situation includes a person in a first vehicle requiring emergency treatment, and the in-vehicle sound information includes the intensity and frequency of a person's voice in the vehicle and a target keyword associated with the emergency situation. Step 220 includes:

[0062] Step 310: In response to determining that the target keyword is detected multiple times within a first time period based on the in-vehicle sound information, determining that an emergency situation occurs in the first vehicle; or

[0063] Step 320 : In response to determining, based on the in-vehicle sound information, that the intensity of the human voice in the vehicle is greater than a first intensity threshold and that the offset of the frequency of the human voice in the vehicle compared to the target frequency exceeds an offset threshold, determining that an emergency situation occurs in the first vehicle.

[0064] In this way, emergency situations in which people in the car need first aid can be accurately and quickly identified, thereby improving overall rescue efficiency.

[0065] In step 310, the first time period may be, for example, 10 seconds, and the target keywords may be, for example, phrases such as "help," "120," and "heart attack," indicating an emergency situation requiring emergency treatment for a person in the vehicle. For example, if a person in the vehicle is detected saying, "The driver is having a heart attack, please call 120," it may be determined that an emergency situation has occurred in the first vehicle.

[0066] In step 320, in some cases, the people in the car may be too panicked to clearly say the target keyword. At this time, it can be determined whether an emergency occurs based on the intensity and frequency of the human voice in the car.

[0067] In step 320 , a first intensity threshold is determined based on a decibel range of sound when a person is in a calm state. The first intensity threshold may be, for example, 80 decibels.

[0068] In the example, the in-car sound signal can be collected in real time by the on-board microphone array. Specifically, the collected in-car sound information (analog signal) is sent to the on-board audio codec and sampled according to a preset sampling frequency (for example, 44.1kHz or 48kHz) to discretize it in time. At the same time, the sampled signal amplitude is quantized according to the quantization accuracy (for example, 16 bits or 24 bits) and converted into a series of digital values, thereby completing the conversion process from analog signal to digital signal. The converted digital signal is transmitted to the voice recognition chip via a high-speed data bus such as SPI or I2S for subsequent recognition processing.

[0069] In this example, the intensity of the human voice inside the vehicle can be calculated by calculating the average energy of the sound signal over a certain period of time. For example, if the intensity of the human voice inside the vehicle reaches or exceeds 80 decibels for at least three consecutive frames (for example, each frame is set to be 20ms long, with an overlap of 10ms between frames), it can be considered that there is a high possibility that an emergency situation has occurred in the first vehicle.

[0070] In step 320, the target frequency refers to the fixed sound frequency (center position) that each person has in a calm state according to their gender, age, and vocal habits, and their sound frequency fluctuates within a small range around the center position in daily state.

[0071] In step 320, the deviation threshold is determined based on the deviation of the target subject's voice frequency in an emergency situation from their voice frequency in a calm state. If the target subject's voice frequency is detected to have significantly deviated from its corresponding characteristic frequency multiple times, or if it deviates significantly from its corresponding characteristic frequency continuously within a short period of time, it can be determined that the target subject is experiencing significant emotional fluctuations and may be experiencing an emergency situation.

[0072] In this example, since the main frequency range of human speech is between 300Hz and 3400Hz, the sound between 300Hz and 3400Hz can be mainly detected as human voice. The deviation of the frequency of human voice in the car exceeds the deviation threshold in the following two cases:

[0073] (1) The sound frequency of the person inside the vehicle deviates from its corresponding characteristic frequency by more than 200 Hz at least twice within 10 seconds; and / or

[0074] (2) The energy of the sound frequency of people in the car in the range of 1000Hz to 2000Hz increases by more than 50% within 500ms.

[0075] Figure 4 A partial flow chart of another vehicle communication method based on the Internet of Vehicles applied to a first vehicle side according to an embodiment of the present disclosure is shown.

[0076] According to some embodiments, Figure 4 As shown, the in-vehicle sound information also includes in-vehicle noise intensity and in-vehicle noise frequency. The method 200 further includes:

[0077] Step 410: Determine a first intensity threshold according to the noise intensity inside the vehicle; and

[0078] Step 420: In response to determining based on the in-vehicle sound information that the intensity of the human voice in the vehicle is greater than a first intensity threshold and the offset of the frequency of the human voice in the vehicle compared to the target frequency exceeds the offset threshold, and in response to determining that the absolute value of the difference between the frequency of the human voice in the vehicle and the frequency of the noise in the vehicle is greater than the frequency threshold, it is determined that an emergency situation has occurred in the first vehicle.

[0079] In this way, the influence of the in-vehicle noise on the human voice in the vehicle can be eliminated, so that whether an emergency occurs in the first vehicle can be determined more accurately based on the in-vehicle sound information.

[0080] In step 410, the vehicle's ambient noise intensity can be further detected using an ambient noise detection sensor to determine a first intensity threshold. For example, when the ambient noise intensity is below 70 decibels, the first intensity threshold is set at 80 decibels; if the ambient noise intensity is between 70 and 80 decibels, the first intensity threshold is increased to 85 decibels; and when the ambient noise intensity is above 80 decibels, the first intensity threshold is increased to 90 decibels. This effectively eliminates the interference of in-vehicle noise on human voices.

[0081] In step 420, a frequency threshold is determined based on the difference between the main sound frequency band of the environmental noise and the frequency band of the human voice in an emergency state. The frequency threshold may be, for example, 500 Hz.

[0082] For example, when the absolute value of the difference between the frequency of the human voice inside the car and the frequency of the noise inside the car is greater than 500 Hz, it is determined that the sound corresponding to the frequency of the human voice inside the car is likely to be the sound made by the person inside the car in an emergency.

[0083] According to some embodiments, the vehicle status information includes the speed and direction of travel of the first vehicle, and step 220 includes:

[0084] Step 221: In response to determining based on the vehicle status information that the speed change of the first vehicle in the second time period is greater than a speed threshold and / or the angular change of the driving direction is greater than an angle threshold, and in response to determining based on the in-vehicle sound information that the intensity of human voice in the vehicle is less than a second intensity threshold, it is determined that an emergency situation has occurred in the first vehicle.

[0085] In some cases (for example, a car accident), the people in the car may not be able to speak. Therefore, by detecting that the speed and direction of the vehicle change rapidly and the people in the car are silent, an emergency situation is determined, thereby further expanding the applicable scenarios and scope of the above method.

[0086] For example, when the first vehicle is traveling at a speed of 20-80 km / h (normal driving speed), it brakes suddenly (the longitudinal acceleration is less than -3 m / s 2 and last for at least 0.5 seconds), sharp turns (lateral acceleration greater than 3m / s 2 and lasts for at least 0.5 seconds) or the speed changes by more than 20 km / h within 10 seconds, it can be considered that there is a high possibility that the first vehicle is in an emergency.

[0087] Figure 5 A partial flow chart of another vehicle communication method based on the Internet of Vehicles applied to a first vehicle side according to an embodiment of the present disclosure is shown.

[0088] According to some embodiments, the emergency situation indicates that the first vehicle cannot continue to travel due to insufficient fuel, and the vehicle status information includes the remaining fuel of the first vehicle, such as Figure 5 As shown, step 220 includes:

[0089] Step 510: In response to determining that the remaining fuel level of the first vehicle is less than a fuel level threshold according to the vehicle status information, obtaining first current position information of the first vehicle;

[0090] Step 520: Determine the distance between the first vehicle and the nearest target gas station as a second distance threshold based on the first current location information;

[0091] Step 530: Determine the fuel consumption required for the first vehicle to travel to the target gas station based on the second distance threshold; and

[0092] Step 540: In response to determining, based on the vehicle status information, that the remaining fuel level of the first vehicle is less than the fuel consumption level, determining that an emergency situation occurs in the first vehicle.

[0093] In the case where the first vehicle is low on fuel and is currently far away from the nearest gas station, the first vehicle may break down on the way and be unable to continue driving. Therefore, it can be determined that an emergency situation has occurred and help can be sought, thereby further expanding the applicable scenarios and scope of the above method.

[0094] In step 510, the fuel level threshold may be determined based on the current location of the first vehicle. For example, if the first vehicle is currently located in an area with a high concentration of gas stations, the fuel level threshold may be correspondingly smaller; if the first vehicle is currently located in an area with a low concentration of gas stations, the fuel level threshold may be correspondingly larger.

[0095] In step 520 , the target gas station closest to the first vehicle may be determined based on the map data, and the distance between the target gas station and the first vehicle may be specifically determined as the second distance threshold.

[0096] In step 530, the fuel consumption per kilometer of the first vehicle can be determined based on the historical driving record and historical fuel consumption record of the first vehicle. For example, the fuel consumption per kilometer of the first vehicle can also be determined based on the factory record of the first vehicle.

[0097] Figure 5 A partial flow chart of another vehicle communication method based on the Internet of Vehicles applied to a first vehicle side according to an embodiment of the present disclosure is shown.

[0098] According to some embodiments, the emergency situation indicates that the first vehicle cannot continue to travel due to a fault, and the vehicle status information includes the fault condition of the first vehicle, such as Figure 6 As shown, step 220 includes:

[0099] Step 610: In response to determining that the first vehicle has a fault according to the vehicle status information, obtain second current position information of the first vehicle; and

[0100] Step 620: In response to determining, based on the second current position information, that the distance between the first vehicle and the nearest target repair station is greater than a third distance threshold, determine that the emergency situation occurs in the first vehicle.

[0101] In the case where the first vehicle breaks down and is currently far away from the nearest repair station, it can be determined that an emergency situation has occurred and help can be sought, thereby further expanding the applicable scenarios and scope of the above method.

[0102] In step 620 , the target repair station closest to the first vehicle may be determined based on the map data, and specifically, it may be determined whether the distance between the target repair station and the first vehicle is greater than a third distance threshold.

[0103] According to some embodiments, before step 230 of “sending the first instruction to the server”, method 200 further includes:

[0104] Step 231: Generate a first prompt message for display, wherein the first prompt message prompts whether an emergency situation occurs and assistance is required.

[0105] In some cases, misjudgment may occur only through in-vehicle sound information and vehicle status information. Therefore, when it is determined that an emergency occurs in the first vehicle, the user can be prompted to seek help from the second vehicle after obtaining the user's confirmation, so as to improve the user experience and increase the accuracy of rescue judgment.

[0106] In step 231 , the first prompt information may be, for example, “Is there a medical emergency?” and “Do you want to find a nearby AED device?”.

[0107] According to some embodiments, the first instruction further includes first position information indicating a current position of the first vehicle, and an accuracy of the first position information is higher than a fourth threshold.

[0108] In some cases, the first vehicle may deny the server access to its precise location information, or may simply deny the server access to its location information. Therefore, incorporating high-precision first location information into the first instruction can help the server more quickly and accurately determine the presence of the second vehicle and subsequently generate the first navigation route, while protecting the privacy of the vehicle's location information. This improves overall rescue efficiency.

[0109] For example, the accuracy of the fourth threshold may be relatively high, so as to allow the server to determine whether the second vehicle exists around based on the first position information and to generate the first navigation route.

[0110] For example, the first instruction including the first location information may be transmitted, for example, via an encrypted communication protocol.

[0111] Figure 7 A flowchart of a vehicle communication method applied to a server side according to an embodiment of the present disclosure is shown.

[0112] like Figure 7 As shown, a vehicle communication method 700 based on the Internet of Vehicles is applied to the server side. The method 700 includes:

[0113] Step 710: In response to receiving a first instruction from a first vehicle, determining whether there is a second vehicle whose distance from the first vehicle is less than a first distance threshold, wherein the first instruction indicates that an emergency occurs in the first vehicle, and the second vehicle includes a first rescue resource for handling the emergency;

[0114] Step 720: In response to determining that a second vehicle exists, generating a second instruction to inquire whether the second vehicle agrees to rescue and sending it to the second vehicle;

[0115] Step 730: In response to receiving a third instruction from the second vehicle, generating a first navigation route, wherein the third instruction indicates that the second vehicle agrees to rescue, and the first navigation route is used to guide the first vehicle to merge with the second vehicle; and

[0116] Step 740: Send the first navigation route to the first vehicle and the second vehicle respectively.

[0117] Therefore, when an emergency situation is detected in the first vehicle, it is determined whether there is a second vehicle equipped with corresponding rescue resources within a certain range nearby, and a message for help is sent to the second vehicle after the existence of the second vehicle is determined, so that a navigation route can be planned for the two to meet and rescue after the second vehicle agrees to rescue, thereby achieving mutual assistance between vehicles within a certain distance range and effectively improving the rescue efficiency in emergency situations.

[0118] In step 710 , the emergency situation may be, for example, that the occupants of the first vehicle require medical emergency care, the first vehicle breaks down, or the first vehicle is stuck in mud and cannot continue to travel.

[0119] In step 710, a first distance threshold may be determined based on the current location of the first vehicle. For example, when the first vehicle is currently located in an area with a lot of traffic, the first distance threshold may be, for example, 500 meters, 1 kilometer, or 2 kilometers; for example, when the first vehicle is currently located in an area with a little traffic, the first distance threshold may be, for example, 5 kilometers, 8 kilometers, or 10 kilometers.

[0120] In this example, the first distance threshold may be further adjusted based on the type of emergency situation. For example, if the emergency situation is that the occupants of the first vehicle require medical emergency care, the first distance threshold may be appropriately reduced to increase the likelihood of receiving assistance more quickly.

[0121] In step 710, the first rescue resources include materials and human resources. For example, depending on the type of emergency, the first rescue resources include but are not limited to AEDs (Automated External Defibrillators), medicines, medical personnel, gasoline, water, spare tires, vehicle parts, vehicle repair tools, vehicle repair personnel, ropes, etc.

[0122] In step 710 , the second vehicle may be a vehicle that is currently traveling or can currently depart for rescue, so as to be able to receive and respond to the first request for help in a timely manner.

[0123] In step 710, the second vehicle may be a registered vehicle that can provide the first rescue resource. For example, the registration may be performed through an in-vehicle navigation system or other application with map navigation capabilities, so that upon receiving the first indication indicating an emergency situation with the first vehicle, the server can search and match the second vehicle via the Internet of Vehicles.

[0124] In this example, the second vehicle performs the aforementioned registration based on the in-vehicle navigation application on the vehicle terminal device. For example, when the second vehicle first launches or updates the in-vehicle navigation application, a pop-up window appears through the in-vehicle terminal device's user interface, asking whether the vehicle is equipped with an AED. If "Yes" is selected, the AED device information entry interface is displayed, where the AED device brand, model, expiration date, and photo are entered to complete the registration process.

[0125] For example, the input AED device information can be encrypted using, for example, the AES-256 encryption algorithm (a type of encryption algorithm) and then uploaded to the server, and the second vehicle can be bound to the AED device through the VIN (Vehicle Identification Number) of the second vehicle.

[0126] Exemplarily, the server uses, for example, a MySQL database (a type of database) or a MongoDB database (a type of database) to store relevant information of AED devices and vehicles, and sets an API (Application Programming Interface) interface for each vehicle to query and update information.

[0127] For example, the second vehicle can modify or cancel the registration status of the AED device on the server at any time through the in-vehicle navigation application.

[0128] For example, when the registration of the AED device expires, the server may send a reminder message to the second vehicle to prompt the device to re-register to ensure the validity of rescue resources.

[0129] It is understandable that the above registration process for AED equipment is for illustration only and does not limit the registration process for other types of first rescue resources to this.

[0130] At step 720, if multiple second vehicles are determined to exist, each second vehicle may be sorted based on its distance from the first vehicle, with the second request for assistance being sent preferentially to the closest second vehicle. For example, if the closest second vehicle does not agree to assist, the second request for assistance may be sent to the next closest second vehicle, and so on.

[0131] At step 730, the third instruction may be, for example, a data packet including the second vehicle's unique identifier and confirmation of assistance consent. For example, the third instruction (data packet) may be sent to the server via an encrypted real-time communication protocol, such as the WebSocket protocol (a communication protocol) over TLS encryption, to protect the privacy of the user of the second vehicle.

[0132] In step 740 , relevant data of the first navigation route may be directly generated on the server side and sent to the first vehicle and the second vehicle respectively, so as to generate a visual navigation route for display based on the in-vehicle navigation applications of the two vehicles.

[0133] Exemplarily, in response to determining that the first navigation route is a dynamic navigation route, the current position information (e.g., longitude, latitude, and altitude, etc.) and real-time traffic condition data (e.g., congestion conditions and accident information, etc.) of the second vehicle can be continuously sent to the first vehicle based on a certain period, and the current position information and real-time traffic condition data of the first vehicle can be sent to the second vehicle to perform real-time dynamic updates of the first navigation route.

[0134] For example, the in-vehicle navigation applications of the first and second vehicles can have built-in detailed map data, such as road network information (road type, number of lanes, speed limit, etc.) and point of interest data. Thus, by continuously obtaining the current location information and real-time traffic data of the other vehicle, the in-vehicle navigation application can be supported to perform path calculation based on path planning algorithms such as the Dijkstra algorithm or the A* algorithm, and update the first navigation route in real time by calculating and evaluating different possible paths at the current moment. In this way, it is possible to avoid the first navigation route being inaccessible or taking too long to pass due to sudden accidents during the merging process.

[0135] For example, the first navigation route may be a route that enables the first vehicle and the second vehicle to merge fastest.

[0136] For example, if the first vehicle can continue to drive, the first navigation route is used to guide the first vehicle and the second vehicle to drive towards each other. For example, if the first vehicle cannot continue to drive (for example, it breaks down or can only drive in a direction away from the second vehicle), the first navigation route can also be used to guide the second vehicle to drive towards the first vehicle.

[0137] Exemplarily, the first navigation route may also include real-time guidance information, such as turn prompts or estimated remaining encounter time, etc., to provide better prompts.

[0138] Figure 8 A partial flow chart of another vehicle communication method based on the Internet of Vehicles applied to a server side according to an embodiment of the present disclosure is shown.

[0139] According to some embodiments, Figure 8 As shown, the first instruction further includes first position information indicating the current position of the first vehicle, and the accuracy of the first position information is higher than a second accuracy threshold. The "determining whether there is a second vehicle whose distance to the first vehicle is less than the first distance threshold" in step 210 includes:

[0140] Step 810: Acquire a plurality of pre-stored location information associated with a plurality of initial vehicles, wherein each of the plurality of pre-stored location information indicates a latest location of the corresponding initial vehicle pre-sent to the server, and each of the plurality of initial vehicles includes a first rescue resource;

[0141] Step 820: Determine whether there is an initial vehicle whose distance from the first vehicle is less than a first distance threshold based on the first location information and the plurality of pre-stored location information; and

[0142] Step 830: The initial vehicle whose distance to the first vehicle is less than a first distance threshold is used as the second vehicle.

[0143] In some cases, a vehicle may refuse to allow the server to obtain its precise location information, or may simply refuse to allow the server to obtain its location information. Therefore, by having the second vehicle with the first rescue resource periodically send its latest low-precision location to the server and allowing the inclusion of high-precision first location information in the first instruction sent by the first vehicle, the server can be helped to more quickly and accurately determine whether there is a second vehicle nearby while protecting the privacy of the vehicle's location information, thereby improving overall rescue efficiency.

[0144] Exemplarily, the accuracy of the first location information may be higher than the accuracy of the pre-stored location information.

[0145] According to some embodiments, the third instruction further includes second location information indicating the current location of the second vehicle, and the “generating a first navigation route” in step 230 includes:

[0146] Step 231: Generate a first navigation route according to the first location information and the second location information.

[0147] Based on this, when the vehicle refuses the server to obtain its location information or precise location information, it can help the server to generate the first navigation route more quickly and accurately, so as to improve the overall rescue efficiency.

[0148] For example, the accuracy of the second location information may be higher than the accuracy of the pre-stored location information, and the accuracy of the first location information and the accuracy of the second location information may be the same, so as to generate the first navigation route more accurately and efficiently.

[0149] Figure 9 A partial flow chart of another vehicle communication method based on the Internet of Vehicles applied to a server side according to an embodiment of the present disclosure is shown.

[0150] According to some embodiments, Figure 9 As shown, the first instruction further indicates that the first vehicle can continue to travel. After "determining whether there is a second vehicle whose distance to the first vehicle is less than the first distance threshold" in step 710, method 700 further includes:

[0151] Step 910: Determine, based on the first location information, whether there is a target location whose distance from the first vehicle is less than a first distance threshold, wherein the target location is a location including a second rescue resource for handling an emergency;

[0152] Step 920: In response to determining that the second vehicle and the target location exist simultaneously, determine which of the second vehicle and the target location is closer to the first vehicle; and

[0153] Step 930: In response to determining that the second vehicle is closer to the first vehicle, executing the step of generating a second instruction to the second vehicle to inquire whether the second vehicle agrees to rescue.

[0154] In the case that the first vehicle can continue to drive, if there is a second vehicle and a target location near the first vehicle at the same time, help can be sought from the second vehicle when the second vehicle is closer to the first vehicle, so as to improve the rescue efficiency.

[0155] In step 910, the target location may be, for example, a hospital, a shopping mall, a gas station, a vehicle repair service center, etc. The description of the second rescue resource can refer to the above description of the first rescue resource, which will not be repeated here.

[0156] In the example, in response to determining that the target location is closer to the first vehicle, a route for the first vehicle to travel to the target location can be directly planned to improve rescue efficiency.

[0157] In step 920 , a first distance between the second vehicle and the first vehicle and a second distance between the target location and the first vehicle may be determined based on the first position information, and which of the two is closer to the first vehicle may be determined based on the first distance and the second distance.

[0158] In the example, operations such as rounding or integer truncation may be performed on the first distance and the second distance to reduce processing difficulty.

[0159] Figure 10 A partial flow chart of another vehicle communication method based on the Internet of Vehicles applied to a server side according to an embodiment of the present disclosure is shown.

[0160] According to some embodiments, Figure 10 As shown, after “in response to determining that the second vehicle and the target location exist at the same time” in step 920 , the method 700 further includes:

[0161] Step 1010: Determine a first time length required for the first vehicle to merge with the second vehicle and a second time length required for the first vehicle to travel to the destination; and

[0162] Step 1020: In response to determining that the first time length is less than the second time length, executing the step of generating a second instruction to the second vehicle to inquire whether the second vehicle agrees to rescue.

[0163] When the first vehicle can continue to drive, if there is a second vehicle and a target location near the first vehicle at the same time, help can be sought from the second vehicle when the time required for the second vehicle to merge with the first vehicle is shorter, thereby improving rescue efficiency.

[0164] In the example, in response to determining that the first time length is not greater than the second time length, a route to the target location can be directly planned for the first vehicle to improve rescue efficiency.

[0165] For example, operations such as rounding or truncation may be performed on the first time length and the second time length to reduce processing difficulty.

[0166] Figure 11 A partial flow chart of another vehicle communication method based on the Internet of Vehicles applied to a server side according to an embodiment of the present disclosure is shown.

[0167] According to some embodiments, Figure 11 As shown, after “determining whether there is a second vehicle whose distance to the first vehicle is less than a first threshold” in step 710 , the method 200 further includes:

[0168] Step 1110: In response to determining that the second vehicle does not exist, determine whether there is a third vehicle whose distance from the first vehicle is less than a second distance threshold, wherein the second distance threshold is greater than the first distance threshold, and the third vehicle includes the first rescue resource; and

[0169] Step 1120: In response to determining that a third vehicle exists, generating a fourth instruction to inquire whether the third vehicle agrees to provide assistance and sending the instruction to the third vehicle;

[0170] Step 1130: In response to receiving a fifth instruction from the third vehicle, generating a second navigation route, wherein the fifth instruction indicates that the third vehicle agrees to rescue, and the second navigation route is used to guide the first vehicle and the third vehicle to merge; and

[0171] Step 1140: Send the second navigation route to the first vehicle and the third vehicle respectively.

[0172] In this way, when the second vehicle is not found within a certain range near the first vehicle, the search range can be expanded to further search for a third vehicle that can provide assistance, thereby increasing the possibility of the first vehicle receiving assistance.

[0173] In step 1110 , a specific value of the third threshold may be determined based on the first threshold, the current location of the first vehicle, the type of emergency situation, and the like.

[0174] The description of the above steps 1110 to 1140 can refer to the description of the above steps 710 to 740, and the embodiments of the above steps 710 to 740 can also be applied to steps 1110 to 1140, which will not be repeated here.

[0175] In the example, in response to determining that the third vehicle does not exist, the search range may be further expanded, and so on, until a matching vehicle that can provide assistance to the first vehicle is found.

[0176] Figure 12 A flowchart of a vehicle communication method applied to a second vehicle side according to an embodiment of the present disclosure is shown.

[0177] like Figure 12 As shown, a vehicle communication method 1200 based on the Internet of Vehicles is applied to a second vehicle side. The second vehicle includes a first rescue resource for handling an emergency. The method 1200 includes:

[0178] Step 1210: In response to receiving a second instruction from the server, determining whether to agree to rescue, wherein the second instruction inquires whether to agree to rescue a first vehicle in an emergency, and a distance between the first vehicle and a second vehicle is less than a first distance threshold;

[0179] Step 1220: In response to determining that the rescue is agreed, sending a third instruction indicating the rescue is agreed to the server; and

[0180] Step 1230: Receive a first navigation route from a server to merge with a first vehicle based on the first navigation route.

[0181] Therefore, when a second instruction is received indicating that a first vehicle within a certain range is in an emergency and needs rescue, it is determined whether to rescue it, and after agreeing to the rescue, the first navigation route for merging with the first vehicle is received, thereby achieving mutual assistance between vehicles within a certain distance range and effectively improving the rescue efficiency for emergency situations.

[0182] For the description of steps 1210 to 1230 , reference may be made to the above-mentioned specific description of steps 710 to 740 , which will not be repeated here.

[0183] According to some embodiments, the second instruction further includes second position information indicating a current position of the second vehicle, the accuracy of the second position information being higher than a second accuracy threshold.

[0184] In some cases, the second vehicle may deny the server access to its precise location information, or may simply refuse to allow the server to obtain its location information. Therefore, incorporating high-precision second location information into the second instruction can help the server quickly and accurately generate the first navigation route while protecting the privacy of the vehicle's location information, thereby improving overall rescue efficiency.

[0185] For example, the accuracy of the fifth threshold may be relatively high, so as to allow the server to efficiently and accurately generate the first navigation route based on the second location information.

[0186] According to some embodiments, before step 1210 of “responding to receiving a second instruction from the server”, method 1200 further includes:

[0187] Step 1211: Send pre-stored location information to the server in a target time period, wherein the pre-stored location information indicates the latest location of the second vehicle when the pre-stored location information is sent.

[0188] Therefore, by having the second vehicle with the first rescue resource periodically send the latest low-precision location to the server, the server can be helped to more quickly and accurately determine whether there is a second vehicle around while protecting the privacy of the vehicle's location information, thereby improving the overall rescue efficiency.

[0189] For example, for a vehicle that has been registered to provide the first rescue resource, based on the owner's authorization, the vehicle's latest location can be uploaded to the server based on a certain period using, for example, the MQTT (Message Queuing Telemetry Transport) protocol, so that the server can use it to determine the positional relationship between the vehicle and the first vehicle.

[0190] For example, GeoHash coding (a map coding with an accuracy of typically 6 to 7 digits) can be used to obfuscate the vehicle's latest location information to determine the approximate location of the vehicle based on an accuracy of, for example, several hundred meters or kilometers, so as to determine whether to treat it as the second vehicle when an emergency occurs in the first vehicle.

[0191] Exemplarily, the target time periods may be, for example, 5 minutes, 1 hour, and 3 hours.

[0192] According to another aspect of the present disclosure, a vehicle communication device based on the Internet of Vehicles is provided for use on a first vehicle side. Figure 13 As shown, a vehicle communication device 1300 based on the Internet of Vehicles is applied to the first vehicle side, and the device 1300 includes: a first module 1310, configured to obtain in-vehicle sound information and vehicle status information of the first vehicle; a second module 1320, configured to determine whether the first vehicle has the emergency situation based on at least one of the in-vehicle sound information and the vehicle status information; a third module 1330, configured to send a first instruction to the server in response to determining that the first vehicle has the emergency situation, wherein the first instruction indicates that the first vehicle has the emergency situation; and a fourth module 1340, configured to receive a first navigation route from the server to merge with a second vehicle based on the first navigation route, wherein the distance between the second vehicle and the first vehicle is less than a first distance threshold, the second vehicle includes a first rescue resource for handling the emergency situation, and the second vehicle agrees to rescue.

[0193] According to another aspect of the present disclosure, a vehicle communication device based on the Internet of Vehicles and applied to a server side is provided. Figure 14As shown, a vehicle communication device 1400 based on the Internet of Vehicles is applied to the server side, and the device 1400 includes: a fifth module 1410, configured to determine whether there is a second vehicle whose distance from the first vehicle is less than a first distance threshold in response to receiving a first instruction from the first vehicle, wherein the first instruction indicates that an emergency occurs in the first vehicle, and the second vehicle includes a first rescue resource for handling the emergency; a sixth module 1420, configured to generate a second instruction asking the second vehicle whether it agrees to rescue in response to determining the existence of the second vehicle and send it to the second vehicle; a seventh module 1430, configured to generate a first navigation route in response to receiving a third instruction from the second vehicle, wherein the third instruction indicates that the second vehicle agrees to rescue, and the first navigation route is used to guide the first vehicle and the second vehicle to merge; and an eighth module 1440, configured to send the first navigation route to the first vehicle and the second vehicle respectively.

[0194] According to another aspect of the present disclosure, a vehicle communication device based on the Internet of Vehicles applied to a second vehicle side is provided. Figure 15 As shown, a vehicle communication device 1500 based on the Internet of Vehicles is applied to the second vehicle side, and the device 1500 includes: a ninth module 1510, configured to determine whether to agree to rescue in response to receiving a second instruction from the server, wherein the second instruction asks whether to agree to rescue the first vehicle in an emergency, and the distance between the first vehicle and the second vehicle is less than a first distance threshold; a tenth module 1520, configured to send a third instruction indicating agreement to rescue to the server in response to determining that rescue is agreed; and an eleventh module 1530, configured to receive a first navigation route from the server to merge with the first vehicle based on the first navigation route.

[0195] According to another aspect of the present disclosure, an electronic device is also provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the aforementioned method.

[0196] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is further provided, wherein the computer instructions are used to enable a computer to execute the aforementioned method.

[0197] According to another aspect of the present disclosure, a computer program product is further provided, including a computer program, wherein the computer program implements the aforementioned method when executed by a processor.

[0198] like Figure 16As shown, electronic device 1600 includes a computing unit 1601, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1602 or a computer program loaded from a storage unit 1608 into a random access memory (RAM) 1603. Various programs and data required for the operation of electronic device 1600 can also be stored in RAM 1603. Computing unit 1601, ROM 1602, and RAM 1603 are connected to each other via a bus 1604. An input / output (I / O) interface 1605 is also connected to bus 1604.

[0199] Multiple components in the electronic device 1600 are connected to the I / O interface 1605, including: an input unit 1606, an output unit 1607, a storage unit 1608, and a communication unit 1609. The input unit 1606 can be any type of device that can input information to the electronic device 1600. The input unit 1606 can receive input digital or character information, and generate key signal input related to the user settings and / or function control of the electronic device, and can include but is not limited to a mouse, a keyboard, a touch screen, a trackpad, a trackball, a joystick, a microphone and / or a remote control. The output unit 1607 can be any type of device that can present information, and can include but is not limited to a display, a speaker, a video / audio output terminal, a vibrator and / or a printer. The storage unit 1608 can include but is not limited to a magnetic disk, an optical disk. The communication unit 1609 allows the electronic device 1600 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks, and can include but is not limited to a modem, a network card, an infrared communication device, a wireless communication transceiver and / or a chipset, such as Bluetooth TM devices, 802.11 devices, WiFi devices, WiMax devices, cellular communication devices, and / or the like.

[0200] The computing unit 1601 can be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1601 performs the various methods and processes described above, such as the GPU-based matrix calculation method. For example, in some embodiments, the GPU-based matrix calculation method can be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as the storage unit 1608. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 1600 via the ROM 1602 and / or the communication unit 1609. When the computer program is loaded into the RAM 1603 and executed by the computing unit 1601, one or more steps of the GPU-based matrix calculation method described above can be performed. Alternatively, in other embodiments, the computing unit 1601 may be configured to execute a GPU-based matrix calculation method in any other appropriate manner (eg, by means of firmware).

[0201] Various embodiments of the systems and techniques described above can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0202] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0203] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0204] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0205] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0206] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0207] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not limited herein.

[0208] Although the embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it should be understood that the above-mentioned methods, systems and devices are merely exemplary embodiments or examples, and the scope of the present invention is not limited by these embodiments or examples, but is only limited by the claims after authorization and their equivalents. Various elements in the embodiments or examples may be omitted or replaced by their equivalents. In addition, the steps may be performed in an order different from that described in this disclosure. Further, the various elements in the embodiments or examples may be combined in various ways. It is important that as technology evolves, many of the elements described herein may be replaced by equivalent elements that appear after this disclosure.

Claims

1. A vehicle communication method based on the Internet of Vehicles, applied to a first vehicle, the method comprising: Acquiring in-vehicle sound information and vehicle status information of the first vehicle; determining whether an emergency occurs in the first vehicle based on at least one of the in-vehicle sound information and the vehicle status information; In response to determining that the emergency situation occurs in the first vehicle, sending a first instruction to a server, wherein the first instruction indicates that the emergency situation occurs in the first vehicle; and A first navigation route is received from the server to merge with a second vehicle based on the first navigation route, wherein a distance between the second vehicle and the first vehicle is less than a first distance threshold, the second vehicle includes a first rescue resource for handling the emergency, and the second vehicle agrees to rescue.

2. The method according to claim 1, wherein The emergency situation includes a situation where a person in the first vehicle needs emergency treatment, the in-vehicle sound information includes a human voice intensity, a human voice frequency, and a target keyword associated with the emergency situation, and determining whether the emergency situation occurs in the first vehicle based on at least one of the in-vehicle sound information and the vehicle status information includes: In response to determining, based on the in-vehicle sound information, that the target keyword is detected multiple times within a first time period, determining that the emergency situation occurs in the first vehicle; or In response to determining, based on the in-vehicle sound information, that the intensity of the in-vehicle human voice is greater than a first intensity threshold and that the offset of the in-vehicle human voice frequency from a target frequency exceeds an offset threshold, it is determined that the emergency situation occurs in the first vehicle.

3. The method according to claim 2, wherein: The in-vehicle sound information further includes in-vehicle noise intensity and in-vehicle noise frequency, and the method further includes: Determining the first intensity threshold according to the in-vehicle noise intensity; and In response to determining, based on the in-vehicle sound information, that the intensity of the human voice in the vehicle is greater than the first intensity threshold and that the offset of the frequency of the human voice in the vehicle compared to the target frequency exceeds the offset threshold, and in response to determining that the absolute value of the difference between the frequency of the human voice in the vehicle and the frequency of the noise in the vehicle is greater than the frequency threshold, it is determined that the emergency situation occurs in the first vehicle.

4. The method according to claim 2, wherein: The vehicle status information includes the speed and driving direction of the first vehicle, and determining whether the emergency situation occurs in the first vehicle based on at least one of the in-vehicle sound information and the vehicle status information includes: In response to determining based on the vehicle status information that the speed change of the first vehicle in the second time period is greater than a speed threshold and / or the angular change of the driving direction is greater than an angle threshold, and in response to determining based on the in-vehicle sound information that the intensity of the human voice in the vehicle is less than a second intensity threshold, it is determined that the emergency situation occurs in the first vehicle.

5. The method according to claim 1, wherein The emergency situation includes that the first vehicle cannot continue to travel due to insufficient fuel, the vehicle status information includes the remaining fuel level of the first vehicle, and determining whether the emergency situation occurs in the first vehicle based on at least one of the in-vehicle sound information and the vehicle status information includes: In response to determining, based on the vehicle state information, that the remaining fuel level of the first vehicle is less than a fuel level threshold, obtaining first current position information of the first vehicle; determining, based on the first current location information, a distance between the first vehicle and a nearest target gas station as a second distance threshold; determining the fuel consumption required for the first vehicle to travel to the target gas station according to the second distance threshold; and In response to determining, based on the vehicle state information, that the remaining fuel amount of the first vehicle is less than the fuel consumption amount, it is determined that the emergency situation occurs in the first vehicle.

6. The method according to claim 1, wherein The emergency situation includes that the first vehicle cannot continue to travel due to a fault, the vehicle status information includes the fault status of the first vehicle, and determining whether the emergency situation occurs in the first vehicle based on at least one of the in-vehicle sound information and the vehicle status information includes: In response to determining that the first vehicle has a fault according to the vehicle status information, obtaining second current position information of the first vehicle; and In response to determining, based on the second current position information, that the distance between the first vehicle and the nearest target repair station is greater than a third distance threshold, it is determined that the emergency situation occurs with the first vehicle.

7. The method according to any one of claims 1 to 6, wherein Before sending the first instruction to the server, the method further includes: A first prompt message is generated for display, wherein the first prompt message prompts whether the emergency situation occurs and assistance is required.

8. The method according to any one of claims 1 to 7, wherein The first instruction further includes first current position information indicating the first vehicle, where accuracy of the first current position information is higher than a first accuracy threshold.

9. A vehicle communication method based on the Internet of Vehicles, applied on the server side, comprising: In response to receiving a first instruction from a first vehicle, determining whether there is a second vehicle located at a distance less than a first distance threshold from the first vehicle, wherein the first instruction indicates an emergency situation with the first vehicle and the second vehicle includes a first rescue resource for handling the emergency situation; In response to determining that the second vehicle exists, generating and sending a second instruction to the second vehicle to inquire whether the second vehicle agrees to rescue; generating a first navigation route in response to receiving a third instruction from the second vehicle, wherein the third instruction indicates that the second vehicle agrees to rescue, and the first navigation route is used to guide the first vehicle and the second vehicle to merge; and The first navigation route is sent to the first vehicle and the second vehicle respectively.

10. The method according to claim 9, wherein: The first instruction further includes first position information indicating a current position of the first vehicle, where accuracy of the first position information is greater than a second accuracy threshold, and determining whether there is a second vehicle whose distance from the first vehicle is less than the first distance threshold includes: Obtaining a plurality of pre-stored location information associated with a plurality of initial vehicles, wherein each of the plurality of pre-stored location information indicates a latest location of the corresponding initial vehicle pre-sent to the server, and each of the plurality of initial vehicles includes the first rescue resource; determining, based on the first position information and the plurality of pre-stored position information, whether there is an initial vehicle whose distance from the first vehicle is less than a first distance threshold; and An initial vehicle whose distance from the first vehicle is less than the first distance threshold is used as the second vehicle.

11. The method according to claim 10, wherein: The third instruction further includes second location information indicating a current location of the second vehicle, and generating the first navigation route includes: The first navigation route is generated according to the first location information and the second location information.

12. The method according to claim 10, wherein: The first instruction further indicates that the first vehicle can continue to travel. After determining whether there is a second vehicle whose distance from the first vehicle is less than a first distance threshold, the method further includes: determining, based on the first location information, whether there is a target location whose distance from the first vehicle is less than a first distance threshold, wherein the target location is a location including a second rescue resource for handling the emergency; In response to determining that the second vehicle and the target location exist simultaneously, determining which of the second vehicle and the target location is closer to the first vehicle; and In response to determining that the second vehicle is closer to the first vehicle, the step of generating and transmitting a second instruction to the second vehicle asking the second vehicle whether to agree to rescue is performed.

13. The method according to claim 12, wherein: In response to determining that the second vehicle and the target location exist at the same time, the method further includes: determining a first length of time required for the first vehicle to merge with the second vehicle and a second length of time required for the first vehicle to travel to the destination; and In response to determining that the first time length is less than the second time length, the step of generating and sending a second instruction to the second vehicle asking whether the second vehicle agrees to rescue is performed.

14. The method according to any one of claims 9 to 13, wherein: After determining whether there is a second vehicle whose distance from the first vehicle is less than a first threshold, the method further includes: In response to determining that the second vehicle does not exist, determining whether there is a third vehicle located at a distance less than a second distance threshold from the first vehicle, wherein the second distance threshold is greater than the first distance threshold, and the third vehicle includes the first rescue resource; and In response to determining that the third vehicle exists, generating and sending a fourth instruction to the third vehicle to inquire whether the third vehicle agrees to rescue; generating a second navigation route in response to receiving a fifth instruction from the third vehicle, wherein the fifth instruction indicates that the third vehicle agrees to rescue, and the second navigation route is used to guide the first vehicle and the third vehicle to merge; and The second navigation route is sent to the first vehicle and the third vehicle respectively.

15. A vehicle communication method based on an Internet of Vehicles, applied to a second vehicle, the second vehicle including a first rescue resource for handling an emergency, the method comprising: determining whether to agree to rescue in response to receiving a second instruction from the server, wherein the second instruction inquires whether to agree to rescue a first vehicle in the emergency situation, and a distance between the first vehicle and the second vehicle is less than a first distance threshold; In response to determining that the rescue is agreed, sending a third instruction indicating the rescue is agreed to the server; and A first navigation route is received from the server to merge with the first vehicle based on the first navigation route.

16. The method according to claim 15, wherein The second instruction further includes second position information indicating a current position of the second vehicle, the accuracy of the second position information being higher than a second accuracy threshold.

17. The method according to claim 15 or 16, wherein: Before responding to receiving the second instruction from the server, the method further includes: The pre-stored location information is sent to the server periodically with the target time period as a period, wherein the pre-stored location information indicates the latest location of the second vehicle when the pre-stored location information is sent.

18. A vehicle communication device based on the Internet of Vehicles, applied to a first vehicle, the device comprising: A first module is configured to obtain in-vehicle sound information and vehicle status information of the first vehicle; a second module configured to determine whether an emergency occurs in the first vehicle based on at least one of the in-vehicle sound information and the vehicle status information; A third module is configured to, in response to determining that the emergency situation occurs in the first vehicle, send a first instruction to a server, wherein the first instruction indicates that the emergency situation occurs in the first vehicle; and A fourth module is configured to receive a first navigation route from the server to merge with a second vehicle based on the first navigation route, wherein a distance between the second vehicle and the first vehicle is less than a first distance threshold, the second vehicle includes a first rescue resource for handling the emergency, and the second vehicle agrees to rescue.

19. A vehicle communication device based on the Internet of Vehicles, applied to a server side, comprising: a fifth module configured to, in response to receiving a first instruction from a first vehicle, determine whether there is a second vehicle at a distance less than a first distance threshold from the first vehicle, wherein the first instruction indicates that an emergency has occurred with the first vehicle and the second vehicle includes a first rescue resource for handling the emergency; A sixth module is configured to, in response to determining that the second vehicle exists, generate and send a second instruction to the second vehicle, asking whether the second vehicle agrees to rescue; a seventh module configured to generate a first navigation route in response to receiving a third instruction from the second vehicle, wherein the third instruction indicates that the second vehicle agrees to rescue, and the first navigation route is used to guide the first vehicle and the second vehicle to merge; and An eighth module is configured to send the first navigation route to the first vehicle and the second vehicle respectively.

20. A vehicle communication device based on the Internet of Vehicles, applied to a second vehicle, the second vehicle including a first rescue resource for handling an emergency, the device comprising: A ninth module is configured to determine whether to agree to rescue in response to receiving a second instruction from the server, wherein the second instruction inquires whether to agree to rescue a first vehicle in the emergency situation, and a distance between the first vehicle and the second vehicle is less than a first distance threshold; a tenth module configured to, in response to determining that the rescue is agreed, send a third instruction indicating the rescue is agreed to the server; and An eleventh module is configured to receive a first navigation route from the server, so as to merge with the first vehicle based on the first navigation route.

21. An electronic device comprising: at least one processor; as well as a memory communicatively coupled to the at least one processor; in The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8, or the method of any one of claims 9-14, or the method of any one of claims 15-17.

22. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 8, or the method according to any one of claims 9 to 14, or the method according to any one of claims 15 to 17.

23. A computer program product comprising a computer program, wherein When the computer program is executed by a processor, the computer program implements the method of any one of claims 1 to 8, or the method of any one of claims 9 to 14, or the method of any one of claims 15 to 17.

Images