Vehicle machine end device based on cloud service, cloud server, system and implementation method thereof

Abstract

The invention discloses a vehicle-mounted terminal device provided based on cloud service, a cloud server, a vehicle-mounted system provided based on cloud service, a vehicle comprising the vehicle-mounted system, and a corresponding method for implementing the vehicle-mounted system based on cloud service. The vehicle-mounted terminal device is located on a vehicle, and the vehicle-mounted terminal device is provided with a man-machine interaction service module communicating with the cloud server. And the man-machine interaction service module is used for receiving at least one input of a user of the in-vehicle terminal device and providing the at least one input to the virtualized in-vehicle operating system service module in the cloud server, so that the virtualized in-vehicle operating system service module replaces the in-vehicle terminal device to execute corresponding processing according to the at least one input of the user. The cloud server provides cloud service for the in-vehicle terminal device and comprises at least one virtualized in-vehicle operating system service module. By utilizing the scheme of the invention, the lightweight in-vehicle terminal is realized through the virtualization scheme of the in-vehicle terminal, and unified management and storage are carried out through the cloud server, so that the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of vehicle terminals, and more specifically, to a vehicle terminal device provided based on cloud services, a cloud server, a vehicle terminal system provided based on cloud services, and related implementation methods. Background Art

[0002] Some current IoV platform implementations utilize a vehicle-based "car-side + service" approach. However, some of these approaches make the car-side heavyweight rather than lightweight, impose certain hardware and compatibility requirements, and impose certain limitations on subsequent upgrades and expansions, impacting the user experience.

[0003] Therefore, an improved vehicle-side solution is needed. Summary of the Invention

[0004] In order to at least solve the above-mentioned technical problems, the present invention provides a vehicle-end device (or simply referred to as "vehicle") provided based on cloud services, a cloud server, a vehicle-end system provided based on cloud services (including "cloud vehicle-end" or "virtual vehicle-end") and a vehicle including the same, a method for implementing the vehicle-end system based on cloud services, a computer device and a storage medium.

[0005] According to a first aspect of the present invention, a vehicle-end device provided based on cloud services is provided, wherein the vehicle-end device is located on a vehicle, and the vehicle-end device has a human-computer interaction service module that communicates with a cloud server, wherein the human-computer interaction service module is configured to receive at least one input from a user of the vehicle-end device and provide the at least one input to a virtualized vehicle-end operating system service module in the cloud server, so that the virtualized vehicle-end operating system service module replaces the vehicle-end device to perform corresponding processing according to the at least one input received from the user.

[0006] In one embodiment, the vehicle-side device further includes a remote desktop client service module, which is communicatively coupled to the human-computer interaction service module and is configured to display a cloud desktop obtained from the cloud server when the vehicle-side device is connected to the cloud server via a network.

[0007] In one embodiment, the vehicle-side device further includes a data access module, wherein the data access module is configured to transmit data from various sensors on the vehicle received via the vehicle-side device to the cloud server via a network.

[0008] According to a second aspect of the present invention, a cloud server is provided, which is configured to provide cloud services for the vehicle-end device mentioned above, and the cloud server includes at least one virtualized vehicle-end operating system service module, wherein the virtualization layer is configured to receive at least one input from a user from the at least one vehicle-end device, and to perform corresponding processing on behalf of the vehicle-end device based on the at least one input received from the user.

[0009] In one embodiment, the at least one virtualized vehicle operating system service module includes one or more of the following:

[0010] a remote desktop service module, the remote desktop service module being configured to remotely access the remote desktop client service module of the at least one vehicle-end device to display a cloud desktop associated with the at least one virtualized vehicle operating system service module at the remote desktop client service module;

[0011] A virtualized vehicle operating system, wherein the virtualized vehicle operating system is configured to simulate the operating system of the at least one vehicle terminal device to perform relevant calculations and resource allocation,

[0012] a data access service module configured to receive data from vehicle sensors in response to a request from the data access module of the at least one vehicle-side device, and

[0013] An application module is configured to provide one or more applications that are system default or installed by the user of the at least one vehicle-side device.

[0014] In one embodiment, the cloud server also includes a cloud vehicle management service module, which is configured to determine whether to add a virtualized vehicle operating system service module that is the same as or different from one of the at least one virtualized vehicle operating system service modules based on the operating status of the cloud server.

[0015] According to a third aspect of the present invention, a vehicle-machine system based on cloud services is provided, wherein the vehicle-machine system includes at least one vehicle-machine terminal device as described above and at least one cloud server as described above, wherein at least one of the vehicle-machine terminal devices communicates with at least one of the cloud servers, and at least one of the cloud servers provides a cloud-service-based virtualized vehicle-machine operating system for at least one of the vehicle-machine terminal devices.

[0016] According to a fourth aspect of the present invention, a vehicle is provided, comprising the vehicle-side device described above or the vehicle-side system described above.

[0017] According to a fifth aspect of the present invention, a method for implementing a vehicle-machine system based on cloud services is provided, wherein the vehicle-machine system includes at least one vehicle-machine terminal device located on a vehicle, and at least one vehicle-machine terminal device has a human-computer interaction service module that communicates with a cloud server, wherein the method includes: using the human-computer interaction service module to receive at least one input from a user of the at least one vehicle-machine terminal device and providing the at least one input to a virtualized vehicle-machine operating system service module in the cloud server, so that the virtualized vehicle-machine operating system service module replaces the vehicle-machine terminal device to perform corresponding processing according to the at least one input received from the user.

[0018] In one embodiment, the at least one vehicle-side device further includes a remote desktop client service module, which is communicatively coupled to the human-computer interaction service module, wherein the method further includes: when the at least one vehicle-side device is connected to the cloud server via a network, using the remote desktop client service module to display the cloud desktop obtained from the cloud server.

[0019] In one embodiment, the at least one vehicle-end device further includes a data access terminal module, wherein the method further includes: using the data access terminal module to transmit the data received from various sensors on the vehicle to the cloud server via the network.

[0020] In one embodiment, the vehicle system also includes a cloud server for providing cloud services for the at least one vehicle-end device of the vehicle, and the cloud server includes at least one virtualized vehicle-end operating system service module, wherein the method further includes: using the at least one virtualized vehicle-end operating system service module to receive at least one input from the user from the at least one vehicle-end device, and performing corresponding processing on behalf of the vehicle-end device based on the at least one input received from the user.

[0021] In one embodiment, the at least one virtualized vehicle operating system service module includes: one or more of a remote desktop service module, a virtualized vehicle operating system, a data access service module and an application module, wherein the method further includes one or more of the following steps: using the remote desktop service module to remotely access the remote desktop client service module of the at least one vehicle terminal device to display the cloud desktop associated with the at least one virtualized vehicle operating system service module at the remote desktop client service module, using the virtualized vehicle operating system to simulate the operating system of the at least one vehicle terminal device to perform relevant calculations and resource allocation, the data access service module receives data from the vehicle's sensors in response to a request from the data access terminal module of the at least one vehicle terminal device, and using the application module to provide one or more system default applications or applications installed by the user of the at least one vehicle terminal device.

[0022] In one embodiment, the method further includes: using the cloud vehicle management service module to determine whether to add a virtualized vehicle operating system service module that is the same as or different from one of the at least one virtualized vehicle operating system service module based on the operating status of the cloud server.

[0023] According to a sixth aspect of the present invention, a computer device is provided, comprising a memory and a processor, wherein the memory stores computer instructions, which, when executed by the processor, cause the method for implementing a vehicle-mounted system based on cloud services as described above to be executed.

[0024] According to a seventh aspect of the present invention, a non-transitory computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method for implementing a vehicle system based on cloud services as described above is executed.

[0025] The solution of the present invention utilizes communication between a vehicle-side device and a cloud server. A human-computer interaction service module in the vehicle-side device receives at least one user input and provides it to a virtualized vehicle-side operating system service module in the cloud server for processing. Specifically, the virtualized vehicle-side operating system service module performs corresponding processing based on the received at least one user input on behalf of the vehicle-side device. This allows for a lightweight vehicle-side virtualization solution. In other words, all or a majority of vehicle-side services (e.g., tasks requiring high computational load) are virtualized and run in the cloud. As long as the vehicle-side device has internet access and browser capabilities, it can access the corresponding services. Advantageously, this reduces the vehicle-side device's reliance on chipsets and models. All calculations are performed and stored using the virtualized cloud server. The vehicle-side operating system also runs in a virtualized manner on a cloud server or cloud. Furthermore, unified management and storage, including subsequent upgrades and expansion, are provided by the cloud server, improving the user experience. For example, the elasticity and migration capabilities of cloud computing can be leveraged to enable expansion and snapshot recovery of the user's vehicle-side device. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Non-limiting and non-exhaustive embodiments of the present invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified.

[0027] Figure 1 A schematic block diagram of a vehicle-side device based on cloud service provision according to an embodiment of the present invention is illustrated.

[0028] Figure 2 A schematic block diagram of a cloud server according to an embodiment of the present invention is illustrated.

[0029] Figure 3 A schematic block diagram of a virtualized vehicle operating system service module in a cloud server according to an embodiment of the present invention is illustrated.

[0030] Figure 4A A schematic block diagram of a cloud server according to another embodiment of the present invention is illustrated.

[0031] Figure 4B A schematic block diagram of a cloud server according to yet another embodiment of the present invention is illustrated.

[0032] Figure 5 Illustrated based on Figure 4A and Figure 4B A schematic block diagram of a management terminal device in a cloud server.

[0033] Figure 6A schematic block diagram of a vehicle system based on cloud service provision according to an embodiment of the present invention is illustrated.

[0034] Figure 7 A schematic diagram of a vehicle system based on cloud service provision according to an embodiment of the present invention is illustrated.

[0035] Figure 8 A schematic block diagram illustrating details of various parts of a vehicle system provided based on cloud services according to an embodiment of the present invention is shown.

[0036] Figure 9 The flowchart of a method for implementing a vehicle system based on cloud services according to an embodiment of the present invention is illustrated.

[0037] Figure 10 A schematic diagram illustrating a user service interaction process of implementing a vehicle system based on cloud services according to an embodiment of the present invention is illustrated.

[0038] Figure 11 A schematic diagram illustrating a resource interaction process of a vehicle-mounted system based on cloud services according to another embodiment of the present invention is illustrated.

[0039] In all several views of the accompanying drawings, corresponding reference numerals indicate corresponding parts. It will be understood by those skilled in the art that the elements in the drawings are illustrated for simplicity and clarity and are not necessarily drawn to scale. For example, the dimensions of some elements in the drawings may be exaggerated relative to other elements to help improve understanding of the various embodiments of the present invention. In addition, common but easily understood elements that are useful or necessary in commercially feasible embodiments are generally not depicted so as to less obstruct viewing of these various embodiments of the present invention. DETAILED DESCRIPTION

[0040] In the following description, many specific details are set forth to provide a thorough understanding of the present invention. However, it will be apparent to one of ordinary skill in the art that it is not necessary to adopt specific details to practice the present invention. In other cases, well-known materials or methods are not described in detail to avoid obscuring the present invention.

[0041] Reference throughout this specification to "one embodiment," "another embodiment," "another embodiment," "yet another embodiment," "another embodiment," "one example," "another example," "another example," "yet another example," or "yet another example" means that a particular feature, structure, or characteristic described in connection with the embodiment or example is included in at least one embodiment of the present invention, and they are not necessarily all referring to the same embodiment or example. Furthermore, the particular features, structures, or characteristics may be combined in any suitable combinations and / or subcombinations in one or more embodiments or examples.

[0042] Figure 1 A schematic block diagram of a cloud-based vehicle-side device 1 according to one embodiment of the present invention is shown. In one embodiment, the vehicle-side device 1 is located on a vehicle and includes a human-computer interaction service module 12 for communicating with a cloud server and a virtual cloud vehicle-side device on the cloud server. The human-computer interaction service module 12 is configured to receive at least one user input from the vehicle-side device 1 and provide the input to a virtualized vehicle-side operating system service module in the cloud server, causing the virtualized vehicle-side operating system service module to perform corresponding processing based on the received user input on behalf of the vehicle-side device.

[0043] In one embodiment, the user can provide an input instruction related to starting the vehicle-side device 1 to the virtualized vehicle-side operating system service module in the cloud server based on the human-machine interaction service module 12. The virtualized vehicle-side operating system service module performs operations related to starting the vehicle-side device 1 in response to the received startup instruction, and feeds back an indication of the processing result related to starting the vehicle-side device 1 to the human-machine interaction service module 12, so that the vehicle-side device 1 is turned on and the vehicle-side device 1 is started.

[0044] In another embodiment, in addition to the human-computer interaction service module 12, the vehicle-side device 1 may further include a remote desktop client service module 14, which is communicatively coupled to the human-computer interaction service module 12 and is configured to display a cloud desktop obtained from the cloud server when the vehicle-side device 1 is connected to the cloud server via a network. Advantageously, the instructions from the virtualization operating system service module in the cloud server can be executed on the cloud desktop. In one embodiment, the vehicle-side device 1 can provide the user's input to the remote desktop client service module 14 to achieve the synchronous display of the content of the cloud desktop of the cloud vehicle on the vehicle-side device 1 and to be able to execute the instructions from the cloud server on the cloud desktop through the one or more applications. Specifically, for example, the user can operate and apply one or more applications on the cloud desktop of the remote desktop client service module 14 of the vehicle-side device in response to the instructions from the cloud server virtualization operating system service module. In one embodiment, when the vehicle-side device 1 is powered on and the vehicle-side device 1 is used to implement the playback function of a certain application, the user can provide an instruction to play the application to the virtualized vehicle-side operating system service module in the cloud server based on the human-computer interaction service module 12. The virtualized vehicle-side operating system service module generates an instruction to perform operations related to playing the application in response to the received playback instruction, and feeds back an instruction of the processing result related to playing the application to the human-computer interaction service module 12 and / or the remote desktop client service module 14, and then implements the playback function of the application on the cloud desktop of the remote desktop client service module 14 of the vehicle-side device 1, for example, based on the communication coupling between the human-computer interaction service module 12 and the remote desktop client service module 14, and / or implements the playback function of the application with the help of the human-computer interaction service module 12 of the vehicle-side device, such as voice or music playback.

[0045] As those skilled in the art will appreciate, based on the intercommunication between the human-computer interaction service module 12 and / or the remote desktop client service module 14 of the vehicle-side device 1 and the virtualized vehicle-side operating system service module in the cloud server, a superior application service experience for the vehicle-side device 1 can be provided to the user, as required. Advantageously, the virtualized vehicle-side operating system service module can be used instead of the vehicle-side device to perform processing based on at least one received user input, thereby controlling the cloud vehicle-side device associated with the vehicle-side device.

[0046] In yet another embodiment, in addition to the human-computer interaction service module 12 and the remote desktop client service module 14, the vehicle-end device 1 further includes any one of a user access and authentication service module 16 and a data access terminal module 18. The user access and authentication service module 16 and the remote desktop client service module 14 are communicatively coupled. The user access and authentication service module 16 is configured to perform operations related to the initialization of the vehicle-end device 1, the authentication and authorization of the user of the vehicle-end device 1, and the allocation, expansion and upgrade of the cloud server associated with the vehicle-end device 1. The data access terminal module 18 is configured to transmit the data of various sensors on the vehicle received via the vehicle-end device to the virtual cloud vehicle on the cloud server via the network, so that after the cloud server receives the corresponding data, it can realize functions such as data processing and display by, for example, using subscribed services.

[0047] Advantageously, all the services of the entire vehicle computer are placed in the cloud (for example, a cloud server) or the corresponding virtual zone (ZONE) in the cloud through a virtualization solution to run. As long as the vehicle computer has the ability to connect to the Internet and have a browser, it can access the corresponding services, so that the vehicle computer terminal device is implemented as a terminal device that undertakes lightweight services.

[0048] Figure 2 The schematic block diagram of the cloud server 2 according to an embodiment of the present invention is illustrated. The cloud server 2 is configured to provide cloud services for the vehicle-side device 1. For example, the cloud server 2 is mainly responsible for the normal services of the vehicle-side operating system, including initialization, startup, display, operation and installation of various applications, providing synchronization similar to local vehicle-side capabilities, and also supporting service status retention, expansion and automatic upgrade and security repair capabilities. The cloud server 2 may include a virtualization layer 22 and at least one virtualized vehicle-side operating system service module 222. Figure 2 As shown, at least one virtualized vehicle operating system service module 222-1 to 222-n (which may also be collectively referred to as a virtualized vehicle operating system service module 222) is provided on the virtualization layer 22. Each of the at least one virtualized vehicle operating system service module 222-1 to 222-n may be the same or different.

[0049] The virtualization layer 22 of the cloud server 2 is configured to virtualize and schedule the operating system of at least one vehicle-side device 1 to implement virtual operation of the vehicle-side device's operating system. In one embodiment, the virtualization layer 22 can virtualize the operating systems of two different vehicle-side devices 1 and schedule and allocate two identical or different virtualized vehicle-side operating system service modules 222 to each of them, or schedule and allocate the same virtualized vehicle-side operating system service module 222 to both of them. In another embodiment, the virtualization layer 22 can virtualize the operating system of one vehicle-side device 1 and schedule and allocate one virtualized vehicle-side operating system service module 222 or at least two identical or different virtualized vehicle-side operating system service modules 222 to it.

[0050] In one embodiment, the virtualization layer 22 of the cloud server 2 is further configured to support the preservation of the service status of the vehicle-side device 1 and enable snapshot recovery and seamless migration of the vehicle-side device 1. For example, in one embodiment, when the vehicle is turned off, powered off, or enters sleep mode, the current service interface on the cloud desktop displayed by the remote desktop client service module 14 of the vehicle-side device 1 is closed. When the vehicle is started or awakened, the service interface at the time of closure can be directly displayed on the cloud desktop displayed by the remote desktop client service module 14 of the vehicle-side device 1, thereby improving the user experience.

[0051] The at least one virtualized vehicle operating system service module 222 is configured to be responsible for managing and controlling the software and hardware resources of the cloud vehicle corresponding to the at least one vehicle terminal device 1 and providing the environment required for the operation of at least one application, and is further configured to receive at least one input from the user from the at least one vehicle terminal device, and to perform corresponding processing on behalf of the vehicle terminal device according to the at least one input received from the user to realize the relevant functions of the vehicle terminal.

[0052] Figure 3 The following is a schematic block diagram of a virtualized vehicle operating system service module 222 in a cloud server 2 according to another embodiment of the present invention. The at least one virtualized vehicle operating system service module 222 includes one or more of a remote desktop service module 2221, a virtualized vehicle operating system 2223, a data access service module 2225, and an application module 2227.

[0053] The remote desktop service module 2221 is configured to remotely access the remote desktop client service module 14 of the at least one vehicle-side device 1 to display a cloud desktop associated with the at least one virtualized vehicle operating system service module 222 at the remote desktop client service module 14. In one embodiment, the remote desktop client service module 14 uses different connection protocols depending on the virtualized vehicle operating system, and supports the transmission of data such as audio and video.

[0054] The virtualized vehicle operating system 2223 is configured to simulate the operating system of the at least one vehicle-end device 1 to perform relevant calculations and resource allocation, such as network and storage-related resource allocation.

[0055] The data access service module 2225 is configured to receive data from vehicle sensors in response to a request from the data access module 18 of the at least one vehicle-side device 1. In one embodiment, the data access service module 2225 is further configured to implement functions such as data processing and display using at least a publish or subscribe service upon receiving the corresponding data.

[0056] The application module 2227 is configured to provide one or more applications that are system default or installed by the user of the at least one vehicle-end device 1. In one embodiment, one or more applications can be associated based on at least one input of the user. Advantageously, based on the application module 222 being set in the virtualized vehicle-end operating system service module 222 in the cloud server, when the installed application requires a large amount of computing, the expansion capacity of the cloud server can be utilized to obtain a larger computing space, thereby allowing users to obtain a better application service experience. Optionally, one or more applications can also be installed at the vehicle-end device. When the operation of the application requires a smaller amount of computing, the data processing associated with the application can be performed directly at the local vehicle-end device. Advantageously, a wider service experience is provided to users.

[0057] In one embodiment, the cloud server further includes a cloud vehicle management service module configured to determine, based on the operating status of the cloud server, whether to add a virtualized vehicle operating system service module that is the same as or different from one of the at least one virtualized vehicle operating system service modules. Advantageously, this allows for real-time and efficient expansion of vehicle-side devices or vehicle systems associated with the cloud server.

[0058] Figure 4A A schematic block diagram of a cloud server 2 according to yet another embodiment of the present invention is illustrated. Figure 4BThe schematic block diagram of the cloud server 2 according to another embodiment of the present invention is illustrated. The cloud server 2 includes Figure 2 In addition to the virtualization layer 22 in the cloud server 2, the cloud server 2 also includes a management terminal device 24 that provides cloud service management for the at least one vehicle terminal device 1. The management terminal device 24 communicates with the at least one vehicle terminal device 1 and the virtualization layer 22 in the cloud server 2. Figure 4A As shown, the management terminal device 24 and the virtualization layer 22 are included in the same cloud server. Figure 4B As shown, the management end device 24 and the virtualization layer 22 may also be included in two cloud servers. For example, the management end device 24 may be located on another cloud server 3 different from the virtualization layer 22.

[0059] Figure 5 Illustrated based on Figure 4A and Figure 4B Schematic block diagram of a management device 24 in a cloud server 2. The management device 24 includes one or more of a permission and security service module 242, a cloud vehicle management service module 246 (e.g., the cloud vehicle management service module discussed above), and a cloud vehicle monitoring service module 248. As described in further detail below, the management device 24 primarily provides services such as vehicle-side user access, permission authentication and authorization, and management and monitoring of the cloud server associated with the vehicle.

[0060] The permission and security service module 242 is configured to perform permission authentication on the at least one vehicle-end device 1 in response to the authentication request of the access and authentication service module 16 of the at least one vehicle-end device 1. For example, the permission and security service module 242 is mainly used to implement the initialization of the user vehicle-end and subsequent permission authentication and authorization. The cloud vehicle-end management service module 246 is configured to authorize, manage, allocate, and schedule the at least one virtualized vehicle-end operating system service module 222 in the cloud server 2 associated with the vehicle-end in response to the permission authentication of the permission and security service module 242. Therefore, through the communication coupling between the access and authentication service module 16, the permission and security service module 242, and the cloud vehicle-end management service module 246, it is possible to better perform operations related to the initialization of the vehicle-end device, the permission authentication and authorization of the user of the vehicle-end device 1, and the allocation, expansion, snapshot, seamless migration, and upgrade of the cloud server 2 associated with the vehicle-end device 1.

[0061] The cloud-based vehicle monitoring service module 248 is configured to monitor the cloud server 2 (or its virtualization layer 22) and / or issue alerts to the user of the at least one vehicle-based device 1. For example, when the monitoring status is abnormal or the user receives an alert, security repair operations can be performed via the cloud server. Advantageously, the cloud-based vehicle monitoring service module 248 ensures stable operation of the vehicle-based device.

[0062] In one embodiment, the cloud-based vehicle management service module 246 is further configured to determine, in response to the cloud-based vehicle monitoring service module 248 monitoring status of the cloud server 2, whether to add a virtualized vehicle operating system service module that is the same as or different from one of the at least one virtualized vehicle operating system service module 222 to expand the capacity of the virtualization layer 22. Alternatively, in another embodiment, the communication coupling between the cloud-based vehicle management service module 246 and the virtualization layer 22 enables snapshots and seamless migration of the virtualized vehicle operating system service module 222.

[0063] Figure 6 A schematic block diagram of a vehicle system 9 based on cloud service provision according to an embodiment of the present invention is illustrated. Figure 7 A schematic diagram illustrating a cloud-based in-vehicle system 9 according to an embodiment of the present invention is shown. The in-vehicle system 9 includes at least one in-vehicle terminal device 1 and at least one cloud server 2. The at least one in-vehicle terminal device 1 communicates with the at least one cloud server 2, and the at least one cloud server 2 provides a cloud-based virtualized in-vehicle operating system 2223 for the at least one in-vehicle terminal device 1.

[0064] Figure 8 A schematic block diagram illustrating various details of a vehicle-mounted system 9' based on cloud services according to one embodiment of the present invention is provided. The vehicle-mounted system 9' includes two vehicle-mounted devices (i.e., vehicle-mounted device 1-1 and vehicle-mounted device 1-2) and a cloud server 2. The vehicle-mounted device 1-1 and the vehicle-mounted device 1-2 communicate with the cloud server 2.

[0065] Combine Figures 1 to 2As described, the vehicle-end device 1-1 includes a human-computer interaction service module 12-1, a remote desktop client service module 14-1, a user access and authentication service module 16-1, and a data access terminal module 18-1. The remote desktop client service module 14-1 is communicatively coupled with the corresponding human-computer interaction service module 12-1 and the user access and authentication service module 16-1. Similarly, the vehicle-end device 1-2 includes a human-computer interaction service module 12-2, a remote desktop client service module 14-2, a user access and authentication service module 16-2, and a data access terminal module 18-2. The remote desktop client service module 14-2 is communicatively coupled with the corresponding human-computer interaction service module 12-2 and the user access and authentication service module 16-2. The virtualization layer 22 included in the cloud service 2 has two virtualized vehicle-end operating system service modules (i.e., the virtualized vehicle-end operating system service module 222-1 and the virtualized vehicle-end operating system service module 222-2). Reference Figure 8 As described, the virtualized vehicle operating system service module 222-1 includes a remote desktop service module 2221-1, a virtualized vehicle operating system 2223-1, a data access service module 2225-1, and two application programs, APP 2227-11 and APP 2227-12. The virtualized vehicle operating system service module 222-2 includes a remote desktop service module 2221-2, a virtualized vehicle operating system 2223-2, a data access service module 2225-2, and two application programs, APP 2227-21 and APP 2227-22. The vehicle-side device 1-1 communicates with the virtualized vehicle operating system service module 222-1, and the vehicle-side device 1-2 communicates with the virtualized vehicle operating system service module 222-2. Furthermore, for the vehicle-side device 1-1, the remote desktop client service module 14-1 communicates with the remote desktop service module 2221-1, and the data access terminal module 18-1 communicates with the data access service module 2225-1. Similarly, for the vehicle-side device 1-2, the remote desktop client service module 14-2 communicates with the remote desktop service module 2221-2, and the data access terminal module 18-2 communicates with the data access service module 2225-2.

[0066] The vehicle system 9' also includes a management terminal device 24 that provides cloud service management for the vehicle terminal device. In this embodiment, the management terminal device 24 is shown as being on a different cloud server 2 than the virtualization layer 22. Figure 4B As described above, the management terminal device 24 may be located on another cloud server or remote server different from the virtualization layer 22. However, it should be understood that, as described above with respect to Figure 4A As described, the management terminal device 24 and the virtualization layer 22 can be included in the same cloud server (on Figure 8(not shown). Figure 8 As described, the management terminal device 24 includes a permission and security service module 242, a cloud vehicle management service module 246, and a cloud vehicle monitoring service module 248. The permission and security service module 242 and the cloud vehicle management service module 246 are communicatively coupled. In another embodiment, the cloud vehicle management service module 246 can be communicatively coupled to the cloud vehicle monitoring service module 248.

[0067] In one embodiment, the management device 24 can communicate with the vehicle-side device (e.g., vehicle-side device 1-1) and the virtualization layer 22 in the cloud server 2, respectively. Furthermore, for example, for vehicle-side device 1-1, the user access and authentication service module 16-1 communicates with the permission and security service module 242, and the cloud vehicle-side management service module 246 communicates with the virtualization layer 22 to schedule and allocate the virtualized vehicle-side operating system service module 222-1 for vehicle-side device 1-1. Similarly, the above features can also be applied to vehicle-side device 2-1. Of course, as those skilled in the art will appreciate after reading this document, implementing all services of the vehicle-side device in the cloud through a virtualization solution is not limited to the number of vehicle-side devices and virtualized vehicle-side operating system service modules and the scheduling and allocation combinations mentioned above, and can also include other numbers of vehicle-side devices and virtualized vehicle-side operating system service modules, as well as other possible combinations for scheduling and allocation. These and similar variations are also within the scope of protection of this patent application.

[0068] Advantageously, as described above, the cloud server can undertake the normal services of the cloud vehicle operating system for the vehicle-side device, including initialization, startup, display, operation and installation of various applications. While providing capabilities similar to those of local vehicle-side devices, it also supports the retention of service status, capacity expansion, automatic upgrades and security repairs.

[0069] Another aspect of the present invention provides a vehicle, comprising the vehicle-side device or the vehicle-side system described above and below.

[0070] The vehicle herein may be an internal combustion engine vehicle with an internal combustion engine as a driving source, an electric vehicle or fuel cell vehicle with an electric motor as a driving source, a hybrid vehicle with both as a driving source, or a vehicle with another driving source, and in some cases, an electric bicycle or motorcycle. The vehicle may also include an autonomous vehicle. The vehicle-side device, cloud server, vehicle-side system, and method for implementing a vehicle-side system based on cloud services provided by the present invention may be applicable to any of the above-mentioned types of vehicles.

[0071] Figure 9The flowchart of method 90 for implementing a vehicle-mounted system based on cloud services according to one embodiment of the present invention is illustrated. Method 90 includes steps 912, 914, 916, and 918. Method 90 may also include step 922, which includes step 9222, and step 9222 further includes steps 92221, 92223, 92225, and 92227. Method 90 may also include step 924, which includes steps 9242, 9246, and 9248. Each of the above steps will be described below.

[0072] In step 912, the human-computer interaction service module is used to receive at least one input from a user of the at least one vehicle-end device and provide the at least one input to the virtualized vehicle-end operating system service module in the cloud server, so that the virtualized vehicle-end operating system service module replaces the vehicle-end device to perform corresponding processing based on the at least one input received from the user.

[0073] In step 914 , when the at least one vehicle-side device is connected to the cloud server via a network, the remote desktop client service module is used to display the cloud desktop obtained from the cloud server.

[0074] In step 916, the user access and authentication service module is used to perform operations related to initialization of the at least one vehicle-end device, authority authentication and authorization of the user of the at least one vehicle-end device, and allocation, expansion and upgrade of the cloud server associated with the at least one vehicle-end device.

[0075] In step 918, the data access terminal module of the at least one vehicle-end device is used to transmit the data received from various sensors on the vehicle to the cloud server via the network.

[0076] In step 922, the cloud server's virtualization layer is used to virtualize and schedule the operating system of the at least one vehicle-side device. Step 922 includes step 9222, in which the at least one virtualized vehicle-side operating system service module is used to manage and control the software and hardware resources of the cloud vehicle-side device corresponding to the at least one vehicle-side device and provide the environment required for the operation of at least one application. For example, the at least one virtualized vehicle-side operating system service module is used to receive at least one user input from the at least one vehicle-side device and perform corresponding processing on behalf of the vehicle-side device based on the at least one received user input.

[0077] In step 92221, the remote desktop service module of the at least one virtualized vehicle operating system service module is used to remotely access the remote desktop client service module of the at least one vehicle terminal device to display the cloud desktop associated with the at least one virtualized vehicle operating system service module at the remote desktop client service module. In step 92223, the virtualized vehicle operating system of the at least one virtualized vehicle operating system service module is used to simulate the operating system of the at least one vehicle terminal device to perform relevant calculations and resource allocation. In step 92225, the data access service module of the at least one virtualized vehicle operating system service module receives data from the vehicle's sensors in response to the request of the data access terminal module of the at least one vehicle terminal device. In step 92227, the application module of the at least one virtualized vehicle operating system service module is used to provide one or more system default applications or applications installed by the user of the at least one vehicle terminal device.

[0078] In one embodiment, the method 90 may use a cloud vehicle-mounted system management service module to determine whether to add a virtualized vehicle-mounted system operating system service module that is the same as or different from one of the at least one virtualized vehicle-mounted system operating system service modules based on the operating status of the cloud server. The cloud vehicle-mounted system management service module may be included in a management terminal device of the cloud server of the vehicle-mounted system. For example, in step 924, the management terminal device of the vehicle-mounted system is used to provide cloud service management for the at least one vehicle-mounted system device.

[0079] The management end device communicates with the at least one vehicle-end device and the virtualization layer in the cloud server. The management end device may also include: an authority and security service module and a cloud vehicle-end monitoring service module. In step 9242, the authority and security service module performs authority authentication on the at least one vehicle-end device in response to the authentication request of the access and authentication service module of the at least one vehicle-end device. In step 9246, the cloud vehicle-end management service module authorizes, manages, allocates and schedules the at least one virtualized vehicle-end operating system service module in the cloud server in response to the authority authentication of the authority and security service module. In step 9248, the cloud vehicle-end monitoring service module is used to monitor the cloud server and / or alert the user of the at least one vehicle-end device.

[0080] In addition, in step 9248, it may further include: the cloud vehicle management service module determines whether to add a virtualized vehicle operating system service module that is the same as or different from one of the at least one virtualized vehicle operating system service modules in response to the monitoring status of the cloud server operation by the cloud vehicle monitoring service module to expand the capacity of the virtualization layer.

[0081] It should be understood that although Figure 9 The steps in the flowchart are shown in the order indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. In addition, Figure 9 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0082] The method for implementing a vehicle-mounted system based on cloud services in this article can be implemented by the vehicle-mounted terminal device, cloud server or vehicle-mounted system based on cloud services discussed in any of the above implementation plans or examples, and similar extensions can be made, which will not be repeated here.

[0083] Figure 10 The following is a schematic diagram illustrating the user service interaction process of the vehicle system based on cloud service implementation according to one embodiment of the present invention. Figure 10 In the embodiment, the vehicle-side device may play a similar role to the vehicle-side device described herein, and the management end (which may refer to the management end device of the cloud server) and the service end (which may refer to the cloud server) may play a similar role to the cloud server described herein. For example, Figure 10 Each module and Figure 8 The corresponding modules in can correspond and play a similar role. Figure 10 In this embodiment, the user service interaction process may include three stages, namely, the vehicle computer startup stage, the user interaction application stage, and the vehicle computer data transmission stage. The vehicle computer startup stage may include the authentication and authorization stage and the interface display stage.

[0084] refer to Figure 10, in the vehicle computer startup stage, as shown in step 1, and specifically includes steps 1.1 to 1.9. The authentication and authorization stage can be reflected in steps 1.1 to 1.6, and the interface display stage can be reflected in steps 1.7 to 1.9. Specifically, in step 1.1, a user authentication request is sent via the user access and authentication service module of the vehicle computer terminal device; in step 1.2, the authority and security service module of the management terminal device receives the sent user authentication request and performs authority authentication on the user; in step 1.3, when the authority authentication is passed, the authority and security service module sends a signal associated with the authority passing to the cloud vehicle computer management service module of the management terminal device; in step 1.4, the cloud vehicle computer management service module starts the vehicle computer system authorization in response to the signal associated with the authority passing; in step 1.5, the cloud vehicle computer management service module sends a signal associated with starting the cloud vehicle computer authorization to the virtualization layer of the server side, so as to allocate or obtain the virtualization layer of the server side through the virtual resource pool of the virtualization layer; in In step 1.6, the information related to the vehicle system obtained from the virtualization layer is returned to the user access and authentication service module. In step 1.7, based on the information related to the vehicle system, the user access and authentication service module transmits a signal related to the initialization and display of the vehicle interface to the remote desktop client service module of the vehicle-side device. In step 1.8, the remote desktop client service module of the vehicle-side device responds to the signal related to the initialization and display of the vehicle interface and sends a remote desktop connection request to the remote desktop service module of the server based on the obtained encrypted connection information. And in step 1.9, the remote desktop service module of the server responds to the sent remote desktop connection request and returns the remote desktop connection result to the remote desktop client service module of the vehicle-side device. At this point, the display function of the vehicle-side device is realized, and the initialization of the user's power-on is completed.

[0085] In the user interaction application stage, as shown in step 2, it specifically includes steps 2.1 to 2.3. Specifically, in step 2.1, the human-computer interaction service module based on the vehicle-side device receives user input and transmits the user input to the remote desktop client service module of the vehicle-side device; in step 2.2, the remote desktop client service module of the vehicle-side device sends user operation and input requests to the remote desktop service module of the server-side; and in step 2.3, the remote desktop service module of the server-side receives user operation and input requests and executes the APP operation installed on the server-side according to the user input. In this way, the interactive application service function of the vehicle-side device can be realized.

[0086] In the vehicle-machine data transmission stage, as shown in step 3, it specifically includes steps 3.1 to 3.3. Specifically, based on the user access and authentication service module and the data access terminal module of the vehicle-machine terminal device, the data access function of the vehicle sensor and the like is enabled. In step 3.1, the data access terminal module of the vehicle-machine terminal device sends a request related to sensor data to the data access service module of the server end; in step 3.2, the data access service module of the server end receives the data from the vehicle sensor in response to the request related to sensor data, and based on the communication coupling between the data access service module of the server end and the APP, after receiving the corresponding data, the data subscription and publishing service is used to implement data processing and display and other functions; and in step 3.3, the data request result from the vehicle sensor is returned to the data access terminal module of the vehicle-machine terminal device via the data access service module of the server end. In this way, the processing and application of the data of the vehicle-machine terminal device can be realized.

[0087] Advantageously, through this embodiment, vehicle-side services are obtained in a virtualized manner in the cloud, realizing a lightweight vehicle-side system.

[0088] Figure 11 The schematic diagram of the resource interaction process of the vehicle system based on cloud service implementation according to another embodiment of the present invention is illustrated. Figure 10 As described in Figure 11 In the embodiment, the vehicle-side device can play a similar role to the vehicle-side device described in this article, and the management end (which can refer to the management end device of the cloud server) and the service end (which can refer to the cloud server) can play a similar role to the cloud server described in this article. Figure 11 Each module and Figure 8 The corresponding modules in the reference have similar functions. Figure 11 In this embodiment, the resource interaction process can be performed by the cloud vehicle monitoring service module to the cloud server (for example, Figure 11 ) to monitor the server side shown in the figure to keep the monitoring service running continuously and replenish resources in time (for example, update the cloud server or the virtual resource pool in the cloud). Specifically, the resource interaction process may include the cloud server initialization phase (such as Figure 11 1.1 to 1.5 in the previous step) and the cloud server virtual resource update phase (as shown in Figure 11 1.6 to 1.7 in the . Figure 11As shown in , in step 1.1, based on the monitoring status of the cloud vehicle machine monitoring service module of the management end device, the management end device initiates a cloud vehicle machine initialization service associated with the server end; in step 1.2, the server end implements cloud vehicle machine virtualization through the virtualized vehicle machine operating system in the virtualization layer based on the initiated cloud vehicle machine initialization service; in step 1.3, the remote service is further initialized via the remote desktop service module of the server end; in step 1.4, the data access service is further initialized via the data access service module of the server end; in step 1.5, the APP is further installed; in step 1.6, the server end returns the result of the cloud vehicle machine initialization service to the virtualized vehicle machine operating system; and in step 1.7, the virtualized vehicle machine operating system containing the result of the initialization service, or the virtualization layer associated with the virtualized vehicle machine operating system, is placed in the virtual resource pool to replenish resources in time.

[0089] It should be understood that in other embodiments, other interaction processes of the vehicle-side device, cloud server, vehicle-side system or implementation method described in the context may also be implemented according to actual needs.

[0090] Another aspect of the present invention provides a computer device, which includes a memory and a processor, wherein the memory stores computer instructions, and when the computer instructions are executed by the processor, the method for implementing a vehicle-mounted system based on cloud services described above is executed. The computer device can be broadly defined as a server, an on-board terminal, or any other electronic device with the necessary computing and / or processing capabilities. In one embodiment, the computer device may include a processor, a memory, a network interface, a communication interface, etc. connected via a system bus. The processor of the computer device can be used to provide the necessary computing, processing, and / or control capabilities. The memory of the computer device may include a non-volatile storage medium and an internal memory. An operating system, a computer program, etc. may be stored in or on the non-volatile storage medium. The internal memory can provide an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface and the communication interface of the computer device can be used to connect and communicate with external devices via a network. When the computer program is executed by the processor, it can implement any of the steps of the method for implementing a vehicle-mounted system based on cloud services described above.

[0091] Another aspect of the present invention further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method for implementing a vehicle-mounted system based on cloud services as described in any of the above implementation schemes or examples is implemented.

[0092] Those skilled in the art will understand that all or part of the steps of the above-mentioned method for implementing a vehicle system based on cloud services can be completed by instructing related hardware such as computer devices or processors through a computer program, and the computer program can be stored in a non-temporary computer-readable storage medium. When the computer program is executed, the steps of the method for implementing a vehicle system based on cloud services of the present invention are executed. Depending on the circumstances, any reference to memory, storage, database or other media in this document may include non-volatile and / or volatile memory. Examples of non-volatile memory include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid-state disk, etc. Examples of volatile memory include random access memory (RAM), external cache memory, etc.

[0093] The above description of the illustrated embodiments or examples of the present invention, including what is described in the Abstract, is not intended to be exhaustive or to limit the precise forms disclosed. Although specific embodiments and examples of the invention are described herein for illustrative purposes, various equivalent modifications are possible without departing from the broader spirit and scope of the invention.

Claims

1. A vehicle terminal device based on cloud service, characterized in that: The vehicle terminal device is located on the vehicle and has a human-computer interaction service module that communicates with the cloud server, wherein: The human-computer interaction service module is configured to receive at least one input from a user of the vehicle-end device and provide the at least one input to the virtualized vehicle-end operating system service module in the cloud server, so that the virtualized vehicle-end operating system service module replaces the vehicle-end device to perform corresponding processing based on the at least one input received from the user.

2. The vehicle terminal device according to claim 1, characterized in that: The vehicle-side device further includes a remote desktop client service module, which is communicatively coupled to the human-computer interaction service module and is configured to display a cloud desktop obtained from the cloud server when the vehicle-side device is connected to the cloud server via a network.

3. The vehicle-side device according to claim 2, characterized in that: The vehicle terminal device also includes a data access terminal module, wherein: The data access terminal module is configured to transmit data from various sensors on the vehicle received via the vehicle terminal device to the cloud server via the network.

4. A cloud server, characterized in that: The cloud server is configured to provide cloud services for at least one vehicle-end device according to any one of claims 1 to 3, and the cloud server includes at least one virtualized vehicle-end operating system service module. The at least one virtualized vehicle operating system service module is configured to receive at least one input from a user from the at least one vehicle terminal device, and to perform corresponding processing based on the at least one received user input on behalf of the vehicle terminal device.

5. The cloud server according to claim 4, wherein: The at least one virtualized vehicle operating system service module includes one or more of the following: a remote desktop service module, the remote desktop service module being configured to remotely access the remote desktop client service module of the at least one vehicle-end device to display a cloud desktop associated with the at least one virtualized vehicle operating system service module at the remote desktop client service module; A virtualized vehicle operating system, wherein the virtualized vehicle operating system is configured to simulate the operating system of the at least one vehicle terminal device to perform relevant calculations and resource allocation, a data access service module configured to receive data from sensors of the vehicle in response to a request of the data access module of the at least one vehicle-end device, and An application module is configured to provide one or more applications that are system default or installed by the user of the at least one vehicle-side device.

6. The cloud server according to claim 4 or 5, characterized in that: The cloud server also includes a cloud vehicle management service module, which is configured to determine whether to add a virtualized vehicle operating system service module that is the same as or different from one of the at least one virtualized vehicle operating system service modules based on the operating status of the cloud server.

7. A vehicle computer system based on cloud service, characterized in that: The vehicle system includes at least one vehicle-end device according to any one of claims 1-3 and at least one cloud server according to any one of claims 4-6, wherein at least one of the vehicle-end devices communicates with at least one of the cloud servers, and at least one of the cloud servers provides a cloud service-based virtualized vehicle operating system for at least one of the vehicle-end devices.

8. A vehicle comprising the vehicle-end device according to any one of claims 1 to 3 or the vehicle-end system according to claim 7.

9. A method for implementing a vehicle system based on cloud services, characterized in that: The vehicle system includes at least one vehicle terminal device located on a vehicle, at least one vehicle terminal device having a human-computer interaction service module that communicates with a cloud server, wherein the method includes: The human-computer interaction service module is used to receive at least one input from a user of the at least one vehicle-end device and to provide the at least one input to the virtualized vehicle-end operating system service module in the cloud server, so that the virtualized vehicle-end operating system service module replaces the vehicle-end device to perform corresponding processing according to the at least one input received from the user.

10. The method according to claim 9, characterized in that The at least one vehicle-side device further includes a remote desktop client service module, and the remote desktop client service module is communicatively coupled with the human-computer interaction service module, wherein the method further includes: When the at least one vehicle-side device is connected to the cloud server via a network, the remote desktop client service module is used to display the cloud desktop obtained from the cloud server.

11. The method according to claim 10, characterized in that The at least one vehicle-end device further includes a data access terminal module, wherein the method further includes: The data access terminal module is used to transmit the data received from various sensors on the vehicle to the cloud server via the network.

12. The method according to claim 11, characterized in that The vehicle system further includes a cloud server for providing cloud services for the at least one vehicle terminal device of the vehicle, the cloud server including at least one virtualized vehicle operating system service module, wherein the method further includes: The at least one virtualized vehicle operating system service module is used to receive at least one input from a user from the at least one vehicle terminal device, and to perform corresponding processing according to the at least one received user input on behalf of the vehicle terminal device.

13. The method according to claim 12, characterized in that The at least one virtualized vehicle operating system service module includes: one or more of a remote desktop service module, a virtualized vehicle operating system, a data access service module, and an application module, wherein the method further includes one or more of the following steps: Using the remote desktop service module to remotely access the remote desktop client service module of the at least one vehicle-end device to display a cloud desktop associated with the at least one virtualized vehicle operating system service module at the remote desktop client service module, Using the virtualized vehicle operating system to simulate the operating system of at least one vehicle terminal device to perform relevant calculations and resource allocation, The data access service module receives data from the vehicle's sensors in response to a request from the data access terminal module of the at least one vehicle terminal device, and The application module is used to provide one or more applications that are system default or installed by the user of the at least one vehicle-side device.

14. The method according to claim 13, characterized in that The method further comprises: The cloud vehicle machine management service module is used to determine whether to add a virtualized vehicle machine operating system service module that is the same as or different from one of the at least one virtualized vehicle machine operating system service module based on the operating status of the cloud server.

15. A computer device comprising a memory and a processor, wherein the memory stores computer instructions, wherein: When the computer instructions are executed by the processor, the method for implementing a vehicle system based on a cloud service according to any one of claims 9 to 14 is executed.

16. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for implementing a vehicle system based on a cloud service according to any one of claims 9 to 14 is executed.

Images