Scene updating method for operation of unmanned special vehicle and storage medium

Abstract

The invention provides an unmanned special vehicle operation-oriented scene updating method and a storage medium, the unmanned special vehicle operation-oriented scene updating method comprises a cloud end, a vehicle end and a vehicle cloud intermediate service library, the vehicle cloud intermediate service library comprises middleware arranged at a cloud service end and middleware arranged at a vehicle-mounted client, and the middleware of the cloud service end comprises a cloud end-scene service scheduling component; the cloud-scene service scheduling component comprises cloud-scene analysis and a cloud local service library; the middleware of the vehicle-mounted client comprises a scene service scheduling assembly, and the scene service scheduling assembly comprises scene analysis, vehicle cloud service scheduling and a vehicle cloud local service library; the middleware of the cloud server side and the middleware of the vehicle-mounted client side are both provided with vehicle cloud interconnection assemblies for vehicle cloud communication. The cloud end further comprises a cloud end micro-service, and the cloud end micro-service configures a scene API and other components. According to the invention, the vehicle cloud middleware is taken as a core, creation, updating, synchronization and issuing of the scene mode file are realized, and accurate scene operation is supported.

Description

Technical Field

[0001] The present application relates to unmanned driving technology, and more particularly to a scene updating method and storage medium for unmanned driving special vehicle operations. Background Art

[0002] Existing intelligent scene modes are usually pre-defined by operators, product managers, etc. and configured on the vehicle side. In actual scenarios, the vehicle will operate according to the pre-set scene mode and the parameters set in the scene mode.

[0003] In order to support maximum flexibility, the intelligent scene mode is usually developed using expert rules. However, rules have limitations and cannot cover all scenarios. In actual vehicle operations, the existing operation mode is affected by the vehicle's built-in scene mode, which has certain limitations and cannot guarantee the scene's use requirements for the vehicle. If a new scene needs to be added to the existing scene library, or if specific factors need to be updated in an existing scene, the existing technical model generally requires the redevelopment of specific services for the vehicle and the cloud, resulting in the vehicle's intelligent scene mode update method being inflexible. Therefore, the existing intelligent scene mode is difficult to meet the scene operation requirements, and the need to create updates on the vehicle and the cloud requires a more flexible response method. Summary of the invention

[0004] The embodiment of the present application provides a scene update method and storage medium for unmanned special vehicle operations to solve the problems existing in the related technologies. The technical solution is as follows:

[0005] A scene updating method for unmanned special vehicle operation, comprising:

[0006] Cloud, vehicle and vehicle-cloud intermediate service libraries,

[0007] The vehicle-cloud intermediate service library includes middleware deployed on the cloud service end and middleware deployed on the vehicle client. The middleware on the cloud service end includes a cloud-scene service scheduling component, and the cloud-scene service scheduling component includes a cloud-scene analysis, a cloud-local service library, and other components not limited to the above components; the middleware on the vehicle client includes a vehicle-scene service scheduling component, and the vehicle-scene service scheduling component includes a vehicle-scene analysis, a vehicle-cloud service scheduling, a vehicle-cloud local service library, and other services not limited to the above services; the middleware on the cloud service end and the middleware on the vehicle client are both provided with a vehicle-cloud interconnection component for vehicle-cloud communication;

[0008] The cloud also includes cloud microservices, which configure scenario APIs and other components not limited to the above components;

[0009] The scene mode file of the cloud is sent to the vehicle side through the scene API and the vehicle side-scene analysis service module;

[0010] The cloud local service library and the car cloud local service library interact in real time to synchronize newly created or updated scene mode files.

[0011] The method of creating or updating a scene mode file includes:

[0012] The user creates or updates the scene mode file in a customized way. The generated scene mode file will be stored in the local service library of the cloud. The scene mode file will generate a cloud-local scene library to store new scene mode files through the cloud scene API, and will be sent to the vehicle-local database synchronously. The cloud scene API parses the scene mode file through the vehicle-scene parsing service and serves as the input for the vehicle-cloud dispatch service to call file-related services and service parameters.

[0013] The triggering of scene mode files includes:

[0014] The vehicle side identifies the characteristics of the scene, and the vehicle side-scene parsing service identifies the specific scene mode through the scene characteristics, and searches for matching scene mode files in the vehicle side-local database. The vehicle-cloud dispatch service calls file-related services and service parameters. In the process of searching for matching scene mode files in the vehicle side-local database, the data is synchronized with the cloud-local scene mode files.

[0015] Cloud delivery includes:

[0016] The cloud sends the scene file to the vehicle-cloud communication module through the cloud-scene API function module and publishes it to the relevant topic of the MQTT server. The vehicle-side scene parsing function module subscribes to the relevant topic of the MQTT server, parses the relevant scene mode file, and sends it to the vehicle-cloud service scheduling module, calls the relevant services, configures the relevant parameters, and sends instructions to the vehicle.

[0017] Vehicle-side triggers include:

[0018] The vehicle-side scene parsing module will actively identify the characteristics of the scene, and match the specific scenes in the relevant scene library through specific characteristics; and call the relevant services to perform operations through the vehicle-cloud service scheduling module; the vehicle-side service scheduling module calls the relevant services, configures the relevant parameters and issues instructions to the vehicle; the scene service scheduling component subscribes to the relevant topics of the MQTT server to obtain the scene mode file.

[0019] The process of synchronizing scene mode files between the vehicle and the cloud includes:

[0020] The scene mode files are stored in the local service library on the cloud and the local service library on the vehicle. The local service library on the vehicle needs to be synchronized with the cloud regularly or in real time. The synchronized content includes user-defined scene file settings, update instructions issued by the cloud, and scene information recognized by the vehicle.

[0021] A computer-readable storage medium stores computer instructions, and the computer instructions implement the above method when executed by a processor.

[0022] The advantages or beneficial effects of the above technical solution include:

[0023] (1) The vehicle side serves as the terminal of the scene and has the ability to flexibly analyze the scene: the vehicle can intelligently identify and judge the current scene based on different driving environments, time, weather, road conditions and other factors, and collect and analyze data on the surrounding environment.

[0024] (2) Enable users to customize scene modes: Users or developers can create scenes that meet specific operating environments based on specific needs, and the "Cloud-Scene API" will send the created / updated files to the vehicle side, so that the scene mode files can serve the actual operation more accurately. The accumulated customized scene data can provide more accurate and intelligent services in the future, and continuously optimize the vehicle's operating performance.

[0025] (3) Rapid creation, update and distribution of scenario mode files: Through the middleware method, various usage scenarios can be quickly created and updated without the need for development from scratch, greatly simplifying the process. This not only reduces the development cost of the "scenario automation operation" software and system for special operation networked autonomous driving unmanned vehicles, but also significantly shortens the development cycle, allowing related software and systems to be put online and run faster.

[0026] (4) Improve the closeness of vehicle-cloud interaction: The cloud can send new scenarios or update existing scenarios to the vehicle in real time or regularly, and the vehicle can quickly respond and apply them to actual operations. This close interaction improves the performance of the vehicle in the usage scenario, making it more in line with actual operation needs and improving operation efficiency and quality.

[0027] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present application will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the multiple drawings represent the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings only depict some embodiments disclosed in the present application and should not be regarded as limiting the scope of the present application.

[0029] Figure 1 A schematic diagram of a method for creating and updating a scene mode file according to the present application;

[0030] Figure 2 A schematic diagram of an application example of the triggering method of the scene mode file according to the present application;

[0031] Figure 3 This is a schematic diagram of the deployment of the vehicle side, cloud side, and vehicle-cloud middleware according to this application;

[0032] Figure 4 A schematic diagram of an application example of the method for sending scene mode files from the cloud according to the present application;

[0033] Figure 5 A schematic diagram of a vehicle-side triggering method according to the scenario mode file of this application;

[0034] Figure 6 It is a schematic diagram of the vehicle-side and cloud-side data synchronization method according to the present application. DETAILED DESCRIPTION

[0035] In the following, only some exemplary embodiments are briefly described. As will be appreciated by those skilled in the art, the described embodiments may be modified in various ways without departing from the spirit or scope of the present application. Therefore, the drawings and descriptions are considered to be illustrative and non-restrictive in nature.

[0036] like Figure 3 As shown, a scene updating method for unmanned special vehicle operation includes:

[0037] Cloud, vehicle and vehicle-cloud intermediate service libraries,

[0038] The vehicle-cloud intermediate service library includes middleware deployed on the cloud service end and middleware deployed on the vehicle client. The middleware on the cloud service end includes a cloud-scene service scheduling component, and the cloud-scene service scheduling component includes a cloud-scene analysis, a cloud-local service library and other components not limited to the above components; the middleware on the vehicle client includes a vehicle-side-scene service scheduling component, and the vehicle-side-scene service scheduling component includes a vehicle-side-scene analysis, vehicle-cloud service scheduling, a vehicle-cloud local service library and other services not limited to the above services; the middleware on the cloud service end and the middleware on the vehicle client are both equipped with a vehicle-cloud interconnection component for vehicle-cloud communication.

[0039] The vehicle-cloud communication component is used to realize the data transmission of vehicle-cloud scene mode files; the vehicle-cloud dispatch service module calls the relevant vehicle-side services and parameter requirements according to the scene files to perform vehicle-side operations.

[0040] The cloud also includes cloud microservices, which configure scenario APIs and other components not limited to the above components;

[0041] The scene mode file of the cloud is sent to the vehicle side through the scene API and the vehicle side-scene analysis service module;

[0042] The cloud local service library and the car cloud local service library interact in real time to synchronize newly created or updated scene mode files.

[0043] API refers to Application Programming Interface, which is a set of predefined functions. Its purpose is to provide applications and developers with the ability to access a set of routines based on certain software or hardware without having to access the source code or understand the details of the internal working mechanism.

[0044] like Figure 1 As shown, the method for creating or updating a scene mode file includes:

[0045] The user creates or updates the scene mode file in a customized way. The generated scene mode file will be stored in the local service library of the cloud. The scene mode file will generate a cloud-local scene library to store new scene mode files through the cloud scene API, and will be sent to the vehicle-local database synchronously. The cloud scene API parses the scene mode file through the vehicle-scene parsing service and serves as the input for the vehicle-cloud dispatch service to call file-related services and service parameters.

[0046] Specifically, the vehicle-side scene analysis automatically analyzes the characteristics of various business scenarios and automatically analyzes the scene mode files. The vehicle-cloud service scheduling module receives the file content analyzed by the vehicle-side scene analysis and drives the vehicle-side and cloud services to perform related business operations according to the business scenario parameters.

[0047] like Figure 2 As shown, the triggering of the scene mode file includes:

[0048] The vehicle side identifies the characteristics of the scene, and the vehicle side-scene parsing service identifies the specific scene mode through the scene characteristics, and searches for matching scene mode files in the vehicle side-local database. The vehicle-cloud dispatch service calls file-related services and service parameters. In the process of searching for matching scene mode files in the vehicle side-local database, the data is synchronized with the cloud-local scene mode files.

[0049] like Figure 4 As shown in the figure, the cloud sends:

[0050] The cloud sends the scene file to the vehicle-cloud communication module through the cloud-scene API function module and publishes it to the relevant topic of the MQTT server. The vehicle-side scene parsing function module subscribes to the relevant topic of the MQTT server, parses the relevant scene mode file, and sends it to the vehicle-cloud service scheduling module, calls the relevant services, configures the relevant parameters, and sends instructions to the vehicle.

[0051] like Figure 5 As shown, the vehicle-side trigger includes:

[0052] The vehicle-side scene parsing module will actively identify the characteristics of the scene, and match the specific scenes in the relevant scene library through specific characteristics; and call the relevant services to perform operations through the vehicle-cloud service scheduling module; the vehicle-side service scheduling module calls the relevant services, configures the relevant parameters and issues instructions to the vehicle; the scene service scheduling component subscribes to the relevant topics of the MQTT server to obtain the scene mode file.

[0053] like Figure 6 As shown, the synchronization process of scene mode files between the vehicle and the cloud includes:

[0054] The scene mode files are stored in the local service library on the cloud and the local service library on the vehicle. The local service library on the vehicle needs to be synchronized with the cloud regularly or in real time. The synchronized content includes user-defined scene file settings, update instructions issued by the cloud, and scene information recognized by the vehicle.

[0055] A computer-readable storage medium stores computer instructions, and the computer instructions implement the above method when executed by a processor.

[0056] Among them, the ways in which users of the in-vehicle client actively initiate scene creation requests include but are not limited to interface operations on the vehicle side or mobile terminal, voice methods, etc. Specifically, users can perform corresponding interface operations through the interface of the in-vehicle client (Application, APP) or the APP of the mobile terminal, thereby actively initiating a request for scene creation through interface operations. Users can also issue voice commands to the microphone of the vehicle side or mobile terminal to actively initiate a request for scene creation. After the user initiates a request for scene creation, the vehicle side or mobile terminal can send a request for scene creation to the cloud. Among them, the mobile terminal can be a smart device such as a mobile phone or a tablet computer.

[0057] The scene creation request includes scene creation parameters, such as keywords of the scene theme or the user's scene preference settings, etc. The user can input the scene creation parameters through the vehicle client APP or the mobile terminal APP.

[0058] Then, the cloud can perform a context analysis on the new scene creation parameters and identify the scenario plan. The execution of the scenario plan requires one or more scenario execution components. The available one or more target scene execution components can be further determined based on the status of the scene execution components. For example: a steering wheel is required according to the scenario plan, but because the steering wheel is unavailable while the vehicle is driving, the steering wheel will not be used as a target scene execution component. In one example, the cloud local service library can store multiple scenario plans, and then the corresponding scenario plans can be matched according to the scenario creation parameters.

[0059] The cloud enables the vehicle to trigger the target scene execution component to work according to the execution information to generate a vehicle scene corresponding to the scene creation parameters. The cloud returns the execution strategy to the vehicle, so that the vehicle can trigger the corresponding target scene execution component through the vehicle client to work according to the execution information to achieve the scene corresponding to the scene creation parameters. For example: trigger the seat to move forward 15cm and then rotate 60 degrees.

[0060] An embodiment of the present application provides a computer-readable storage medium storing computer instructions, which implements the method provided in the embodiment of the present application when the program is executed by a processor.

[0061] Optionally, the memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the terminal or server, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the terminal or server via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0062] A computer-readable storage medium may be a tangible medium for holding and storing instructions used by an instruction execution device, i.e., a computer-readable storage medium, including but not limited to an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of these types. More specific but non-exhaustive examples include: a portable computer disk, a hard drive, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (such as EPROM or flash memory), a static random access memory (SRAM), a portable CD-ROM, a digital versatile disc (DVD), a memory stick, a floppy disk, and a mechanical encoding device (such as a punch card or a groove card with a raised structure), and any suitable combination of the above types. In this context, a computer-readable storage medium should not be interpreted as a transient signal itself, such as a radio wave, other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (such as light pulses in a fiber optic cable), or an electrical signal transmitted through a wire.

[0063] Computer-readable program instructions can be downloaded from a computer-readable storage medium to various computing / processing devices, or downloaded to an external computer or external storage device via a network (such as the Internet, a local area network, a wide area network, and / or a wireless network). The network structure may include copper transmission cables, optical fiber transmission systems, wireless transmission technology, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter or network interface in each computing / processing device is responsible for receiving computer-readable program instructions from the network and forwarding them to the computer-readable storage medium in the device for storage.

[0064] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes are obvious to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein. Therefore, the scope of protection of the present application shall be based on the scope of protection of the claims.

Claims

1. A scene updating method for unmanned special vehicle operation, characterized in that: include: Cloud, vehicle and vehicle-cloud intermediate service libraries, The vehicle-cloud intermediate service library includes middleware deployed on the cloud service end and middleware deployed on the vehicle client. The middleware on the cloud service end includes a cloud-scene service scheduling component, and the cloud-scene service scheduling component includes a cloud-scene analysis and a cloud-local service library; the middleware on the vehicle client includes a vehicle-scene service scheduling component, and the vehicle-scene service scheduling component includes a vehicle-scene analysis, a vehicle-cloud service scheduling and a vehicle-cloud local service library; the middleware on the cloud service end and the middleware on the vehicle client are both provided with a vehicle-cloud interconnection component for vehicle-cloud communication; The cloud also includes a cloud microservice, and the cloud microservice configures a scenario API; The scene mode file of the cloud is sent to the vehicle side through the scene API and the vehicle side-scene analysis service module; The cloud local service library and the car cloud local service library interact in real time to synchronize newly created or updated scene mode files.

2. A scene updating method for unmanned special vehicle operation according to claim 1, characterized in that: The method of creating or updating a scene mode file includes: Users create or update scene mode files in a customized way. The generated scene mode files will be stored in the local service library in the cloud. The scene mode files are generated by the cloud-local scene library through the cloud scene API to store new scene mode files, and are synchronously sent to the vehicle-local database; the cloud scene API parses the scene mode files through the vehicle-scene parsing service, and serves as the input for the vehicle-cloud scheduling service to call file-related services and service parameters.

3. The scene updating method for unmanned special vehicle operation according to claim 1 is applied to the vehicle side, characterized in that: The triggering of scene mode files includes: The vehicle side identifies the characteristics of the scene, and the vehicle side-scene parsing service identifies the specific scene mode through the scene characteristics, and searches for matching scene mode files in the vehicle side-local database. The vehicle-cloud scheduling service calls file-related services and service parameters; in the process of searching for matching scene mode files in the vehicle side-local database, the data is synchronized with the cloud-local scene mode files.

4. The scene updating method for unmanned special vehicle operation according to claim 1 is applied to the cloud, characterized in that: Cloud delivery includes: The cloud sends the scene file to the vehicle-cloud communication module through the cloud-scene API function module and publishes it to the relevant topic of the MQTT server. The vehicle-side scene parsing function module subscribes to the relevant topic of the MQTT server, parses the relevant scene mode file, and sends it to the vehicle-cloud service scheduling module, calls the relevant services, configures the relevant parameters, and sends instructions to the vehicle.

5. The scene updating method for unmanned special vehicle operation according to claim 1 is applied to the vehicle side, characterized in that: Vehicle-side triggers include: The vehicle-side scene parsing module will actively identify the characteristics of the scene, and match the specific scenes in the relevant scene library through specific characteristics; and call the relevant services to perform operations through the vehicle-cloud service scheduling module; the vehicle-side service scheduling module calls the relevant services, configures the relevant parameters and issues instructions to the vehicle; the scene service scheduling component subscribes to the relevant topics of the MQTT server to obtain the scene mode file.

6. A scene updating method for unmanned special vehicle operation according to claim 1, characterized in that: The process of synchronizing scene mode files between the vehicle and the cloud includes: The scene mode files are stored in the local service library on the cloud and the local service library on the vehicle. The local service library on the vehicle needs to be synchronized with the cloud regularly or in real time. The synchronized content includes user-defined scene file settings, update instructions issued by the cloud, and scene information recognized by the vehicle.

7. A scene updating method for unmanned special vehicle operation according to claim 1, characterized in that: The vehicle-cloud dispatch service module calls relevant vehicle-side services and parameter requirements according to the scenario files to perform vehicle-side operations.

8. A computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images