Data processing method and device, equipment, storage medium and product
By using large language models and voice text conversion models to process vehicle data on the cloud platform, the problem of low efficiency in interactive data processing between vehicles and home monitoring equipment is solved, and efficient information communication and vehicle safety improvement are achieved.
Patent Information
- Application Number
- CN202411309741.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-19
- Publication Date
- 2024-12-13
AI Technical Summary
The prior art has problems of inefficiency in the processing of interactive data between vehicles and home monitoring devices.
Using data processing methods on the cloud platform, the vehicle data is processed using a preset large language model, text information is generated, and the text information is converted into voice information through the preset voice text conversion model, and sent to the home in combination with the vehicle environment video. Monitoring equipment to realize efficient data processing and transmission.
It improves the efficiency of interactive data processing between vehicles and home monitoring equipment, enhances the multimodal processing capability of data, ensures timely communication and convenience of information, and improves vehicle safety and interaction between family members.
Smart Images

Figure CN119135723A_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present invention relate to the field of vehicle technology, and in particular, to a data processing method, apparatus, device, storage medium, and product. Background Art
[0002] With the continuous advancement of technology, the deep integration of the Internet of Vehicles (IoV) and smart homes, especially the connection between vehicles and home monitoring devices, has become a key part of building the future of smart living. This interconnection not only greatly enriches the user experience and promotes social interaction among family members, but also further improves the safety of both home and vehicle.
[0003] However, the existing technology has the problem of low processing efficiency when processing the interactive data of vehicle and home monitoring. Summary of the Invention
[0004] The present invention provides a data processing method, apparatus, device, storage medium and product to solve the problem of low processing efficiency in the prior art when processing interactive data of vehicle and home monitoring.
[0005] According to one aspect of the present invention, a data processing method is provided, which is applied to a cloud platform. The method includes:
[0006] Receive vehicle data sent by the target vehicle, wherein the vehicle data includes basic vehicle information and vehicle environment video;
[0007] Processing the vehicle data using a preset large language model to generate first text information;
[0008] Converting the first text information into first voice information using a preset voice-to-text conversion model;
[0009] The first voice information and the vehicle environment video are sent to a home monitoring device, so that the home monitoring device plays the first voice information and displays the video image of the vehicle environment video.
[0010] According to another aspect of the present invention, there is provided a data processing device applied to a cloud platform, the device comprising:
[0011] A data receiving module is used to receive vehicle data sent by the target vehicle, wherein the vehicle data includes basic vehicle information and vehicle environment video;
[0012] a data processing module, configured to process the vehicle data using a preset large language model to generate first text information;
[0013] An information conversion module, configured to convert the first text information into first voice information using a preset voice-to-text conversion model;
[0014] An information sending module is used to send the first voice information and the vehicle environment video to a home monitoring device, so that the home monitoring device plays the first voice information and displays the video image of the vehicle environment video.
[0015] According to another aspect of the present invention, an electronic device is provided, comprising:
[0016] at least one processor; and
[0017] a memory communicatively connected to the at least one processor; wherein,
[0018] The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor to enable the at least one processor to perform the data processing method described in any embodiment of the present invention.
[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the data processing method according to any embodiment of the present invention when executed.
[0020] According to another aspect of the present invention, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements the data packet processing method as described in any one of the embodiments of the present invention.
[0021] The technical solution provided by an embodiment of the present invention is applied to a cloud platform, and the method includes: receiving vehicle data sent by a target vehicle, the vehicle data including basic vehicle information and a vehicle environment video; processing the vehicle data using a preset large language model to generate a first text message; converting the first text message into a first voice message using a preset voice-to-text conversion model; and sending the first voice message and the vehicle environment video to a home monitoring device, so that the home monitoring device plays the first voice message and displays a video image of the vehicle environment video. Through the above technical solution, a preset large language model is used to convert various types of vehicle data including basic vehicle information and a vehicle environment video into a first text message, and then a preset language-to-text conversion model is used to convert the first text message into a first voice message, and the first text message is sent to the home monitoring device in combination with the vehicle environment video, effectively improving the processing efficiency of interactive data between the vehicle and the home monitoring device.
[0022] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0024] Figure 1 This is a flow chart of a data processing method provided by the first embodiment of the present invention;
[0025] Figure 2 is a flow chart of a data processing method provided by Embodiment 2 of the present invention;
[0026] Figure 3 is a structural diagram of a data processing device provided by Embodiment 3 of the present invention;
[0027] Figure 4 This is a structural diagram of an electronic device provided in Example 4 of the present invention. DETAILED DESCRIPTION
[0028] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.
[0029] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0030] Example 1
[0031] Figure 1This is a flow chart of a data processing method provided by the first embodiment of the present invention. This embodiment is applicable to the case of processing interactive data between a vehicle and a home monitoring device. The method can be executed by a data processing device, which can be implemented in the form of hardware and / or software. The data processing device can be configured in an electronic device, and the electronic device is applied to a cloud platform. Figure 1 As shown, the method includes:
[0032] S110: Receive vehicle data sent by a target vehicle, where the vehicle data includes basic vehicle information and a vehicle environment video.
[0033] In this embodiment, the target vehicle can be understood as a vehicle that can communicate with the corresponding home monitoring device. Vehicle data includes multimodal data such as basic vehicle information and vehicle environment video. Basic vehicle information can be understood as information used to represent the target vehicle's status. For example, basic vehicle information can include vehicle location information, ambient temperature, and engine status. This information can be textual or non-textual. Vehicle environment video includes video of the target vehicle's interior and exterior. The vehicle environment video can be acquired using the target vehicle's video capture device.
[0034] Specifically, when the target vehicle interacts with the home monitoring device, the target vehicle will send the vehicle data to the cloud platform. The cloud platform receives the vehicle data sent by the target vehicle and further processes the vehicle data to better transmit the vehicle data.
[0035] S120: Process the vehicle data using a preset large language model to generate first text information.
[0036] In this embodiment, the pre-set large language model can be understood as a pre-trained deep learning model. This model possesses powerful multimodal data processing capabilities and can comprehensively analyze various modal data from the vehicle, including but not limited to real-time status data collected by vehicle sensors, high-definition images or videos captured by vehicle cameras, and sounds recorded by the vehicle's audio system. It then fuses this multi-source information to generate one or more segments of emotionally charged text information. In this embodiment, this text information is the first text message, which not only accurately describes the core content of each modal data but also infers emotional elements based on the data content, providing users with a richer and more vivid vehicle status report or interactive experience.
[0037] Specifically, the received vehicle data is input into a preset large language model and processed using the preset large language model to obtain first text information that has emotional connotations and describes the vehicle data in text form.
[0038] S130: Convert the first text information into first voice information using a preset voice-to-text conversion model.
[0039] In this embodiment, the preset speech-to-text conversion model can be understood as a pre-trained neural network model for converting text data into speech data.
[0040] Specifically, in the scenario where a vehicle interacts with a home monitoring device, given that family members may be busy with personal affairs and unable to pay attention to the information of the home monitoring device in real time, in order to ensure the timely transmission of key information and improve the convenience of family members in obtaining information, when transmitting information to the home monitoring device, the first text information will be converted into a first voice information that is easy to listen to and understand.
[0041] S140. Send the first voice information and the vehicle environment video to a home monitoring device, so that the home monitoring device plays the first voice information and displays the video screen of the vehicle environment video.
[0042] In this embodiment, the home monitoring device is deployed in the home, including a camera, a microphone and a display screen, which can be used to display the video image of the vehicle environment video, play the first voice information, and at the same time, collect the voice information of family members.
[0043] Specifically, to avoid data loss, the first voice message and the vehicle environment video are simultaneously sent to the home monitoring device. After receiving the data, the home monitoring device plays the first voice message through a playback device and displays the vehicle environment video on a display screen. In this way, regardless of whether family members are in front of the platform or not, they can obtain important vehicle information in a timely and intuitive manner.
[0044] The technical solution provided in the first embodiment of the present invention is applied to a cloud platform, and the method includes: receiving vehicle data sent by a target vehicle, the vehicle data including basic vehicle information and a vehicle environment video; processing the vehicle data using a preset large language model to generate a first text message; converting the first text message into a first voice message using a preset voice-to-text conversion model; and sending the first voice message and the vehicle environment video to a home monitoring device, so that the home monitoring device plays the first voice message and displays a video image of the vehicle environment video. Through the above technical solution, the preset large language model is used to convert various types of vehicle data including basic vehicle information and vehicle environment videos into a first text message, and then the preset language-to-text conversion model is used to convert the first text message into a first voice message, and the first text message is sent to the home monitoring device in combination with the vehicle environment video, effectively improving the processing efficiency of interactive data between the vehicle and the home monitoring device.
[0045] In some embodiments, the vehicle data includes first vehicle data or second vehicle data, wherein the first vehicle data is data entered by a user in the target vehicle, and the second vehicle data is data captured by a data acquisition device in the target vehicle during an emergency. This technical solution enables comprehensive acquisition and analysis of vehicle status data in different scenarios, enhancing the interactivity between families and vehicles while laying a solid foundation for significantly improving vehicle safety.
[0046] In this embodiment, the vehicle data may be first vehicle data or second vehicle data depending on the source and nature. The first vehicle data refers to data actively input by the user in the target vehicle through voice commands, human-machine interface (HMI) or other interactive methods. The first vehicle data may include basic information of the first vehicle and a video of the first vehicle environment. The second vehicle data is data automatically captured and generated by a data acquisition device configured in the target vehicle when the target vehicle encounters an emergency. These emergency situations often cause the target vehicle to trigger a built-in emergency call function. Among them, the data acquisition device may include sensors, recording equipment, and video equipment of the target vehicle. The second vehicle data may include basic information of the second vehicle and a video of the second vehicle environment.
[0047] For example, when the target vehicle encounters an emergency, it will trigger a built-in emergency call function of the target vehicle. At this time, the data acquisition device automatically captures the vehicle data of the target vehicle.
[0048] In some embodiments, after sending the first voice information and the vehicle environment video to the home monitoring device, it also includes: receiving a second inquiry information sent by the home monitoring device; when the received vehicle data is the first vehicle data, sending the second inquiry information to the target vehicle; receiving reply information corresponding to the second inquiry information sent by the target vehicle; and sending reply information corresponding to the second inquiry information to the home monitoring device.
[0049] In this embodiment, the second inquiry information is the voice information of the family members obtained by the home monitoring device.
[0050] Specifically, on the home monitoring device side, when family members receive the vehicle data sent by the target vehicle, they may send a second inquiry message to the home monitoring device. The home monitoring device then forwards this inquiry to the cloud platform. When the cloud platform receives the second inquiry message, if it confirms that the previously received vehicle data is the first vehicle data actively input by the user, in order to enhance the interactive experience between the vehicle user and family members, the cloud platform will push the second inquiry message directly to the target vehicle. The target vehicle will then play this voice message to the vehicle user and allow the vehicle user to respond. After receiving the reply message from the target vehicle, the cloud platform will immediately forward the reply message back to the home monitoring device, thereby realizing efficient interaction between the vehicle user and family members.
[0051] In some embodiments, the basic vehicle information includes vehicle location information and at least one of the following: control type, timestamp, and vehicle direction. The control type is used to determine whether the target vehicle is in a true emergency situation, and the timestamp indicates when the target vehicle transmitted the vehicle data. This technical solution enhances the accuracy of home monitoring and lays a solid foundation for significantly improving vehicle safety.
[0052] In this embodiment, basic vehicle information provides an important basis for safe operation, efficient dispatch, and rapid response in emergency situations. In addition to the core element of vehicle location information, basic vehicle information also covers a variety of key data, including but not limited to:
[0053] Control type: used to determine whether the target vehicle is in a real emergency situation. The control type can include multiple types, such as normal driving, emergency braking, abnormal acceleration, fault alarm, etc. By monitoring the control type, the system can quickly identify whether the vehicle has encountered an emergency situation, such as a sudden failure, traffic accident or illegal intrusion, thereby triggering the corresponding emergency response mechanism.
[0054] Timestamp: The timestamp records in detail the exact time when the target vehicle sends vehicle data, and is an important basis for data analysis and event backtracking.
[0055] Vehicle driving direction: Indicates the current movement trend of the target vehicle, which helps the system predict the vehicle's future driving path.
[0056] In some embodiments, the target vehicle includes a first data storage area, which is used to store vehicle data sent by the target vehicle and voice data from the home monitoring device. The home monitoring device includes a second data storage area, which is used to store voice information and vehicle environment video received by the home monitoring device, as well as voice data sent by the home monitoring device.
[0057] In this embodiment, the first data storage area is located in the target vehicle, where the user stores vehicle data transmitted by the target vehicle and voice data from the home monitoring device. The second data storage area is located in the home monitoring device, storing voice information and vehicle environment video received by the home monitoring device, as well as voice data transmitted by the home monitoring device. This technical solution effectively enhances data security and traceability.
[0058] Example 2
[0059] Figure 2 It is a flowchart of a data processing method provided by the second embodiment of the present invention. This embodiment is optimized and expanded on the basis of the above-mentioned optional embodiments. Optionally, after sending the first voice information and the vehicle environment video to the home monitoring device, it also includes: receiving the first inquiry information sent by the home monitoring device; in the case that the received vehicle data is the second vehicle data, using the preset large language model to process the first inquiry information to generate a second text message, wherein the second text message is the reply information corresponding to the first inquiry information; using the preset voice-to-text conversion model to convert the second text message into a second voice message; and sending the second voice message to the home monitoring device. As Figure 2 As shown, the method includes:
[0060] S210: Receive vehicle data sent by a target vehicle, where the vehicle data includes basic vehicle information and a vehicle environment video.
[0061] S220: Process the vehicle data using a preset large language model to generate first text information.
[0062] S230: Convert the first text information into first voice information using a preset voice-to-text conversion model.
[0063] S240: Send the first voice information and the vehicle environment video to a home monitoring device, so that the home monitoring device plays the first voice information and displays the video screen of the vehicle environment video.
[0064] S250: Receive first inquiry information sent by the home monitoring device.
[0065] In this embodiment, the first inquiry information is the voice information of the family members obtained by the home monitoring device.
[0066] Specifically, at the home monitoring device end, when a family member receives vehicle data sent by a target vehicle, they may send a first query message to the home monitoring device. The home monitoring device then forwards the query message to the cloud platform, which then receives the first query message.
[0067] S260. When the received vehicle data is the second vehicle data, use the preset large language model to process the first inquiry information to generate second text information, wherein the second text information is reply information corresponding to the first inquiry information.
[0068] In this embodiment, the second text message is emotionally charged and is a reply message corresponding to the first inquiry message.
[0069] Specifically, when the received vehicle data is second vehicle data, given that this data is captured by the target vehicle's data acquisition equipment while the target vehicle is in an emergency, it often occurs when the user in the target vehicle may be unable to speak due to the emergency. In this situation, family members are often anxious and anxious and eager to learn about the safety of the vehicle and its occupants. To promptly respond to family members' inquiries and calm their anxiety, the pre-set large language model can be used to directly process the first inquiry message, generating an emotionally charged second text message for timely response to the family members.
[0070] S270: Convert the second text information into second voice information using a preset voice-to-text conversion model.
[0071] Specifically, in order to ensure timely delivery of key information and improve the convenience of family members in obtaining information, when transmitting information to the home monitoring device, the second text information will be converted into a second voice information that is easy to listen to and understand.
[0072] S280: Send the second voice information to the home monitoring device.
[0073] Specifically, the second voice information is sent to the home monitoring device. After receiving the data, the home monitoring device will play the second voice information through the playback device to ensure that family members can obtain important information about the vehicle in a timely manner.
[0074] For example, suppose a target vehicle is driving on the road and suddenly encounters an emergency, such as a traffic accident. The target vehicle collects vehicle data, including a video of the vehicle's surroundings and basic vehicle information, such as its location and direction of travel, and sends this data to a cloud platform. After receiving the vehicle data, the cloud platform uses a pre-set large language model to integrate this complex data into a simple, easily understood sentence, known as a first text message. For example, "I'm having a little trouble right now, but don't worry, I've stopped on XX Road." The pre-set speech-to-text model then converts this first text message into a first voice message, which, combined with the vehicle's surroundings video, is sent to a home monitoring device. Family members can then view the video on the home monitoring device and hear the first voice message. Perhaps due to worry, the family members didn't hear the accident location clearly, so they sent a first inquiry message through the home monitoring device, "Where are you now? Are you okay?" At this time, the cloud platform receives the first inquiry information sent by the home monitoring device, and determines that when the received vehicle data is the second vehicle data, it uses the preset large language model to process the first inquiry information, and generates a second text message with emotional color to reply to the first inquiry information, such as "I am in XX, I have contacted the rescue and will be here soon. Don't worry, I will take good care of myself", and then uses the preset voice-to-text conversion model to convert the second text message into a second voice message, and send it to the home monitoring device to inform family members.
[0075] The technical solution provided by Example 2 of the present invention not only rapidly transmits vehicle status information and on-site environmental video to family members, allowing them to promptly understand and assess the situation and alleviate unnecessary worry, but also automatically generates and sends reassuring responses through a pre-set large language model and speech-to-text conversion model, effectively alleviating family members' anxiety. This effectively improves the efficiency of vehicle safety management, strengthens the emotional connection between family members, and provides strong support for rapid and effective response in emergencies.
[0076] Example 3
[0077] Figure 3 This is a structural diagram of a data processing device provided by the third embodiment of the present invention. Figure 3 As shown, the data processing device is applied to a cloud platform, and the device includes:
[0078] The data receiving module 31 is used to receive vehicle data sent by the target vehicle, wherein the vehicle data includes basic vehicle information and vehicle environment video;
[0079] A data processing module 32 is configured to process the vehicle data using a preset large language model to generate first text information;
[0080] An information conversion module 33 is configured to convert the first text information into first voice information using a preset voice-to-text conversion model;
[0081] The information sending module 34 is used to send the first voice information and the vehicle environment video to the home monitoring device, so that the home monitoring device plays the first voice information and displays the video screen of the vehicle environment video.
[0082] The technical solution provided by the third embodiment of the present invention effectively improves the processing efficiency of interactive data between vehicles and home monitoring devices.
[0083] Optionally, the vehicle data includes first vehicle data or second vehicle data, wherein the first vehicle data is data input by a user in the target vehicle, and the second vehicle data is data captured by a data acquisition device in the target vehicle when the target vehicle is in an emergency situation.
[0084] Optionally, the data processing device further includes:
[0085] a first inquiry information receiving module, configured to receive a first inquiry information sent by the home monitoring device after sending the first voice information and the vehicle environment video to the home monitoring device;
[0086] a second text message generating module configured to, when the received vehicle data is the second vehicle data, process the first inquiry information using the preset large language model to generate a second text message, wherein the second text message is a reply message corresponding to the first inquiry information;
[0087] A second text information conversion module, configured to convert the second text information into second voice information using a preset voice-to-text conversion model;
[0088] The second voice information sending module is used to send the second voice information to the home monitoring device.
[0089] Optionally, the data processing device further includes:
[0090] a second inquiry information receiving module, configured to receive second inquiry information sent by the home monitoring device after sending the first voice information and the vehicle environment video to the home monitoring device;
[0091] a second inquiry information sending module, configured to send the second inquiry information to the target vehicle when the received vehicle data is the first vehicle data;
[0092] a reply information receiving module, configured to receive reply information corresponding to the second inquiry information sent by the target vehicle;
[0093] A reply information sending module is used to send reply information corresponding to the second inquiry information to the home monitoring device.
[0094] Optionally, the basic vehicle information includes vehicle location information and at least one of the following information: control type, timestamp and vehicle driving direction, wherein the control type is used to determine whether the target vehicle is a real emergency situation, and the timestamp is the time point when the target vehicle sends the vehicle data.
[0095] Optionally, the target vehicle includes a first data storage area, which is used to store vehicle data sent by the target vehicle and voice data from the home monitoring device. The home monitoring device includes a second data storage area, which is used to store voice information and vehicle environment video received by the home monitoring device, as well as voice data sent by the home monitoring device.
[0096] The data processing device provided by the embodiment of the present invention can execute the data processing method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.
[0097] Example 4
[0098] Figure 4 : is a structural diagram of an electronic device provided in Embodiment 4 of the present invention. The electronic device may be an electronic device intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.
[0099] like Figure 4As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., which is communicatively connected to the at least one processor 11. The memory stores a computer program that can be executed by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the RAM 13. The processor 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.
[0100] Multiple components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.
[0101] The processor 11 may be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors that run machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the data processing method.
[0102] In some embodiments, the data processing method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the data processing method in any other suitable manner (e.g., by means of firmware).
[0103] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0104] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.
[0105] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0106] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0107] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.
[0108] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.
[0109] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.
[0110] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.
Claims
1. A data processing method, characterized in that: Applied to a cloud platform, the method includes: Receiving vehicle data sent by a target vehicle, wherein the vehicle data includes basic vehicle information and vehicle environment video; Processing the vehicle data using a preset large language model to generate first text information; Converting the first text information into first voice information using a preset voice-to-text conversion model; The first voice information and the vehicle environment video are sent to a home monitoring device, so that the home monitoring device plays the first voice information and displays the video screen of the vehicle environment video.
2. The method according to claim 1, characterized in that The vehicle data includes first vehicle data or second vehicle data, wherein the first vehicle data is data input by a user in the target vehicle, and the second vehicle data is data captured by a data acquisition device in the target vehicle when the target vehicle is in an emergency situation.
3. The method according to claim 2, characterized in that After sending the first voice information and the vehicle environment video to the home monitoring device, the method further includes: Receiving first inquiry information sent by the home monitoring device; In a case where the received vehicle data is the second vehicle data, the first inquiry information is processed using the preset large language model to generate second text information, wherein the second text information is reply information corresponding to the first inquiry information; Converting the second text information into second voice information using a preset voice-to-text conversion model; The second voice information is sent to the home monitoring device.
4. The method according to claim 2, characterized in that: After sending the first voice information and the vehicle environment video to the home monitoring device, the method further includes: Receiving second inquiry information sent by the home monitoring device; In a case where the received vehicle data is the first vehicle data, sending the second inquiry information to the target vehicle; Receiving reply information corresponding to the second inquiry information sent by the target vehicle; Sending reply information corresponding to the second inquiry information to the home monitoring device.
5. The method according to claim 1, characterized in that The basic vehicle information includes vehicle location information and at least one of the following information: control type, timestamp and vehicle driving direction, wherein the control type is used to determine whether the target vehicle is a real emergency, and the timestamp is the time point when the target vehicle sends the vehicle data.
6. The method according to claim 1, characterized in that The target vehicle includes a first data storage area, which is used to store vehicle data sent by the target vehicle and voice data from the home monitoring device. The home monitoring device includes a second data storage area, which is used to store voice information and vehicle environment video received by the home monitoring device, as well as voice data sent by the home monitoring device.
7. A data processing device, characterized in that: Applied to a cloud platform, the device comprises: A data receiving module, used to receive vehicle data sent by a target vehicle, wherein the vehicle data includes basic vehicle information and vehicle environment video; A data processing module, used to process the vehicle data using a preset large language model to generate first text information; An information conversion module, used to convert the first text information into first voice information using a preset voice-to-text conversion model; An information sending module is used to send the first voice information and the vehicle environment video to a home monitoring device, so that the home monitoring device plays the first voice information and displays the video screen of the vehicle environment video.
8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the data processing method according to any one of claims 1 to 6.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the data processing method as described in any one of claims 1 to 6 is implemented.
10. A computer program product, characterized in that The computer program product comprises a computer program, which, when executed by a processor, implements the data processing method according to any one of claims 1 to 6.
