Vehicle control method, system, and medium

Abstract

The application provides a vehicle control method, system and medium; the method comprises the following steps: in response to a first instruction issued by a user, a target augmented reality image corresponding to a target vehicle component is displayed; in response to a second instruction issued by the user based on the target augmented reality image, a control instruction corresponding to the second instruction is acquired; and the target vehicle component is controlled based on the control instruction; by displaying the augmented reality image corresponding to the vehicle component, the application realizes the control of the vehicle component based on the augmented reality image, provides a new control method for controlling the vehicle component, and brings convenience for the user to control the vehicle component.

Description

Technical Field

[0001] This invention belongs to the field of vehicle control technology, and in particular relates to a vehicle control method, system and medium. Background Technology

[0002] When using a vehicle, users often want to control certain functions or switches on the vehicle. However, existing users often encounter the following problems when controlling vehicle components: the software control interaction of some vehicle functions or components is too deep, requiring multiple clicks; it requires and can only rely on the vehicle's central control screen or steering wheel buttons (located next to the driver's seat). When users are outside the vehicle or not in the driver's seat, it is difficult to control the vehicle, resulting in an uncomfortable user experience. Summary of the Invention

[0003] One objective of this invention is to provide a vehicle control method, system, and medium that displays augmented reality images of corresponding vehicle components to control those components based on those images, thus providing a new control method for controlling vehicle components and bringing convenience to users in controlling vehicle components.

[0004] Another objective of this invention is to provide a vehicle control method, system, and medium that, when controlling vehicle components, does not require actual contact with the corresponding vehicle components, but can identify the vehicle components using image recognition technology, and then generates an augmented reality image using augmented reality technology, thereby realizing the control of the vehicle components based on the augmented reality image.

[0005] Another object of the present invention is to provide a vehicle control method, system and medium that improves the feasibility of the vehicle control method by providing multiple ways to acquire augmented reality images corresponding to target vehicle components and multiple ways to acquire virtual models of corresponding target vehicle components.

[0006] Another objective of this invention is to provide a vehicle control method, system, and medium that enables control of vehicle components regardless of whether the user is inside the vehicle, providing a good user experience; it achieves control of vehicle components without the need for additional hardware, and is simple to operate and highly feasible.

[0007] To achieve the above and other related objectives, in one aspect, the present invention provides a vehicle control method, comprising the following steps: in response to a first instruction issued by a user, displaying a target augmented reality image corresponding to a target vehicle component; in response to a second instruction issued by the user based on the target augmented reality image, acquiring a control instruction corresponding to the second instruction; and controlling the target vehicle component based on the control instruction.

[0008] To achieve the above and other related objectives, in another aspect, the present invention provides a storage medium storing computer instructions that, when executed by a processor, implement the vehicle control method described above.

[0009] To achieve the above and other related objectives, in another aspect, the present invention provides a terminal, comprising: a processor and a memory; the memory being used to store computer instructions; the processor being used to execute the computer instructions stored in the memory, so that the terminal performs the above-described vehicle control method.

[0010] To achieve the above and other related objectives, in another aspect, the present invention provides a vehicle control system, comprising: a smart terminal and a vehicle; wherein the vehicle includes: an in-vehicle terminal; the smart terminal is communicatively connected to the in-vehicle terminal; the smart terminal, in response to a first command issued by a user, displays a target augmented reality image corresponding to a target vehicle component; in response to a second command issued by the user based on the target augmented reality image, acquires a control command corresponding to the second command; sends the control command to the in-vehicle terminal; and the in-vehicle terminal controls the target vehicle component based on the control command.

[0011] To achieve the above and other related objectives, in another aspect, the present invention provides a vehicle control system, comprising: an in-vehicle camera and a vehicle; wherein the vehicle includes: an in-vehicle terminal; the in-vehicle camera is disposed in the vehicle and communicatively connected to the in-vehicle terminal; the in-vehicle camera acquires real-time images of a corresponding target vehicle component and sends the real-time images to the in-vehicle terminal, and / or the in-vehicle camera acquires a global image of the corresponding vehicle and sends the global image to the in-vehicle terminal; the in-vehicle terminal, in response to a first command issued by a user, displays a target augmented reality image corresponding to the target vehicle component; in response to a second command issued by the user based on the target augmented reality image, acquires a control command corresponding to the second command; and controls the target vehicle component based on the control command. Attached Figure Description

[0012] Figure 1 The diagram shown is a structural schematic of the terminal of the present invention in one embodiment.

[0013] Figure 2 The diagram shown is an application scenario architecture diagram of the vehicle control method of the present invention in one embodiment.

[0014] Figure 3 The flowchart shown is an embodiment of the vehicle control method of the present invention.

[0015] Figure 4The flowchart shown is a process of displaying a target augmented reality image corresponding to a target vehicle component in response to a first command issued by a user, according to one embodiment of the present invention.

[0016] Figure 5 The flowchart shown is a flowchart of another embodiment of the present invention, which displays a target augmented reality image corresponding to a target vehicle component in response to a first command issued by a user.

[0017] Figure 6 The diagram shown is a flowchart illustrating the principle of the vehicle control method of the present invention in one embodiment.

[0018] Figure 7 The diagram shown is a structural schematic of a vehicle control system according to an embodiment of the present invention.

[0019] Figure 8 The diagram shown is a structural schematic of the vehicle control system of the present invention in another embodiment.

[0020] Label Explanation

[0021] 1 terminal

[0022] 11 Processing Units

[0023] 12 Memory

[0024] 121 Random Access Memory

[0025] 122 Cache memory

[0026] 123 Storage System

[0027] 124 Programs / Utilities

[0028] 1241 Program Module

[0029] 13 bus

[0030] 14 Input / Output Interfaces

[0031] 15 Network Adapter

[0032] 2 External devices

[0033] 3. Monitors

[0034] 21 Smartphones

[0035] 22 Target Vehicles

[0036] 23 Cloud Servers

[0037] 24 First Camera

[0038] 71 Smart Terminals

[0039] 72 First vehicle

[0040] 721 First Vehicle Terminal

[0041] 722 First Vehicle Camera

[0042] 73 Second Camera

[0043] 81 Second vehicle-mounted camera

[0044] 82 Second vehicle

[0045] 821 Second Vehicle Terminal

[0046] Steps S1 to S3

[0047] Steps S111~S114

[0048] Steps S121~S122

[0049] Steps S1211~S1213 Detailed Implementation

[0050] The following specific embodiments illustrate the implementation of the present invention. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that, unless otherwise specified, the following embodiments and features described therein can be combined with each other.

[0051] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of the present invention. Therefore, the illustrations only show the components related to the present invention and are not drawn according to the actual number, shape and size of the components in the actual implementation. In the actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.

[0052] The vehicle control method, system, and medium of the present invention provide a new control method for vehicle components by displaying augmented reality images of corresponding vehicle components, thereby enabling control of the vehicle components based on these augmented reality images. This brings convenience to users in controlling vehicle components. When controlling a vehicle component, there is no need to actually touch the corresponding vehicle component; instead, image recognition technology can be used to identify the vehicle component, and then augmented reality technology is combined to generate an augmented reality image. Control of the vehicle component is then achieved based on this augmented reality image. By providing multiple methods for obtaining augmented reality images corresponding to target vehicle components and multiple methods for obtaining virtual models of the corresponding target vehicle components, the feasibility of the vehicle control method is improved. It enables control of vehicle components regardless of whether the user is inside the vehicle, providing a good user experience. Control of vehicle components can be achieved without adding any additional hardware, making it simple to operate and highly feasible.

[0053] like Figure 2 As shown, in one embodiment, the vehicle control method of the present invention is applied to... Figure 2 The smartphone 21 in the middle has an app installed on it for controlling vehicle components; assuming, in this embodiment, the user wants to control... Figure 2 The fuel filler cap of the target vehicle 22; specifically, the working principle of this vehicle control method is as follows:

[0054] First, the user opens the app's scan function and points it at the fuel filler neck of the target vehicle 22. Then, image recognition technology identifies the fuel filler neck. Using Augmented Reality (AR) technology, the app on the smartphone 21 displays an AR scene based on the real-world image surrounding the fuel filler neck and a virtual fuel filler neck model stored on the smartphone 21. In this AR scene, the virtual fuel filler neck model is touch-sensitive. The user can then trigger a touch event in this AR scene, causing the smartphone 21 to generate a control command to control the fuel filler neck of the target vehicle 22. Finally, the smartphone 21 sends this control command to... Figure 2 The cloud server 23 in the cloud server 23 then sends the control command to the target vehicle 22, so that the target vehicle 22 can control its fuel filler neck based on the control command.

[0055] It should be noted that the smartphone 21 can also send control commands directly to the target vehicle 22 via near-field wireless communication, without relying on the cloud server 23.

[0056] It should be noted that the scan function of the aforementioned apps utilizes... Figure 2This is achieved through the first camera 24; specifically, the first camera 24 captures a real image of the fuel filler neck of the target vehicle 22 and sends the real image to the smartphone 21, which then uses image recognition technology to identify the real image.

[0057] Furthermore, the first camera 24 can be a camera built into the smartphone 21, or it can be a camera specifically added to the smartphone 21 to enable control of vehicle components.

[0058] like Figure 3 As shown, in one embodiment, the vehicle control method of the present invention includes the following steps:

[0059] Step S1: In response to the first command issued by the user, display the target augmented reality image corresponding to the target vehicle component.

[0060] It should be noted that the target vehicle component is the vehicle component that the user currently wants to control; the target augmented reality image is the AR image corresponding to the vehicle component that the user currently wants to control.

[0061] Specifically, the target AR image is displayed based on user-issued commands.

[0062] It should be noted that the way the user issues the command is not a limitation of the present invention. For example, the user can issue the first command by voice, touch, or other means.

[0063] like Figure 4 As shown, in one embodiment, displaying the target augmented reality image corresponding to the target vehicle component in response to a first command issued by the user includes the following steps:

[0064] Step S111: In response to the first instruction, acquire a real-time image of the corresponding target vehicle component.

[0065] Specifically, based on the first command issued by the user, real-time images of the corresponding target vehicle components are obtained.

[0066] In one embodiment, a user outside the vehicle turns on the camera of a smart terminal by touch and then captures the real-time image through the camera.

[0067] In one embodiment, the user, while inside the vehicle, issues the first command via voice to activate the camera installed on the vehicle and uses the camera to capture real-time images of the corresponding vehicle component. In this case, for some vehicle components located on the outside of the vehicle, the user does not need to get out of the vehicle to obtain their corresponding real-time images, which is convenient for the user.

[0068] Step S112: Identify the target vehicle component based on the real-time image.

[0069] It should be noted that in step S112, image recognition technology is used to identify the real-time image obtained in step S111. This image recognition technology is a conventional technique in the field, and its specific working principle is not a limitation of the present invention, so it will not be described in detail here.

[0070] Step S113: Obtain the target virtual model corresponding to the target vehicle component.

[0071] In one embodiment, obtaining the target virtual model corresponding to the target vehicle component includes the following steps: loading and generating the target virtual model.

[0072] Specifically, after identifying the target vehicle component through the above-mentioned step S112, a target virtual model corresponding to the target vehicle component is generated based on real-time data obtained from LiDAR and other sources.

[0073] It should be noted that the virtual model is generated using real-time data collected by LiDAR and other technologies, which is a conventional technical method in the field. Its specific working principle is not a condition limiting the present invention, and therefore will not be described in detail here.

[0074] It should be noted that the accuracy of the target virtual model is ensured by loading and generating the corresponding target vehicle component using real-time data collected by LiDAR and other means.

[0075] In one embodiment, obtaining the target virtual model corresponding to the target vehicle component includes the following steps: calling the target virtual model.

[0076] Specifically, the target virtual model is pre-built and stored in a location (e.g., a virtual model corresponding to all vehicle parts on the vehicle has been pre-built on a smart terminal). After the target vehicle part is identified in step S112, the target virtual model corresponding to the target vehicle part can be directly called.

[0077] Furthermore, it is also possible to first call the global virtual model of the corresponding vehicle, and then obtain the target virtual model of the corresponding target vehicle component from the global virtual model, as follows:

[0078] In one embodiment, obtaining the target virtual model corresponding to the target vehicle component includes the following steps: calling the global virtual model corresponding to the vehicle, and obtaining the target virtual model based on the global virtual model.

[0079] It should be noted that the global virtual model includes virtual models corresponding to all vehicle components on the vehicle.

[0080] It should be noted that the global virtual model is pre-built. When it is necessary to obtain the target virtual model, the global virtual model can be directly called, and then the target virtual model can be obtained based on the global virtual model.

[0081] It should be noted that the above provides multiple ways to obtain the target virtual model of the corresponding target vehicle component (including: loading and generating, direct calling, and calling the global model and then obtaining it from the global model), which improves the feasibility of the vehicle control method.

[0082] Of course, in practical applications, obtaining the target virtual model of the corresponding target vehicle component is not limited to the above methods, as long as it can achieve the goal of obtaining the target virtual model of the corresponding target vehicle component.

[0083] Step S114: Based on the real-time image and the target virtual model, display the target augmented reality image.

[0084] It should be noted that the AR technology currently supported by mobile OS systems is a technology that calculates the position and angle of camera images in real time and adds corresponding images. The supported AR technology can already overlay the virtual world onto the real world on the mobile phone screen and enable interaction.

[0085] Specifically, in step S114, based on AR technology, a real-time image and a virtual model of the target vehicle component are generated to present an AR image.

[0086] It should be noted that when controlling a target vehicle component, there is no need to actually touch the corresponding target vehicle component. Instead, image recognition technology can be used to identify the target vehicle component, and then augmented reality technology can be used to generate an augmented reality image. Based on this augmented reality image, control of the target vehicle component can be achieved.

[0087] like Figure 5 As shown, in one embodiment, displaying the target augmented reality image corresponding to the target vehicle component in response to a first command issued by the user includes the following steps:

[0088] Step S121: In response to the first instruction, display a global augmented reality image corresponding to the vehicle.

[0089] Specifically, based on the first command issued by the user, a global AR image corresponding to the vehicle is displayed.

[0090] like Figure 5 As shown, in one embodiment, displaying a global augmented reality image of the corresponding vehicle in response to the first instruction includes the following steps:

[0091] Step S1211: In response to the first instruction, invoke the global virtual model corresponding to the vehicle.

[0092] Step S1212: In response to the third instruction, acquire the global image corresponding to the vehicle.

[0093] In one embodiment, the global image corresponding to the vehicle is pre-acquired (e.g., a global image corresponding to the vehicle is pre-acquired via a camera and stored; or the global image corresponding to the vehicle is included with the vehicle after production). Specifically, when a third instruction is received, the global image is directly retrieved without needing to be acquired in real time on-site, saving time. Of course, the global image corresponding to the vehicle can also be acquired in real time on-site via a camera based on a third instruction issued by the user.

[0094] It should be noted that the user's issuance of the third command is based on the same principle as the issuance of the first command in step S1, that is, the command can also be issued through voice, touch or other means.

[0095] Furthermore, there is no explicit restriction on the execution order of steps S1211 and S1212. They can be executed in sequence or simultaneously. When executed in sequence, step S1211 can be executed first, followed by step S1212, or step S1212 can be executed first, followed by step S1211.

[0096] Step S1213: Display the global augmented reality image based on the global image and the global virtual model.

[0097] It should be noted that the working principle of displaying the global AR image in step S1213 is the same as that of displaying the target AR image in step S114 above, so it will not be described in detail here.

[0098] Step S122: Based on the global augmented reality image, acquire and display the target augmented reality image.

[0099] Specifically, after acquiring the global AR image, the target AR image is located and displayed from the global AR image through operations such as flipping and switching.

[0100] It should be noted that the above provides two methods for obtaining target augmented reality images corresponding to the target vehicle components (corresponding to steps S111 to S114 and steps S121 to S122 respectively), which improves the feasibility of the vehicle control method.

[0101] Of course, in practical applications, the method of obtaining the target augmented reality image corresponding to the target vehicle component is not limited to the above methods, as long as it is possible to obtain the target augmented reality image corresponding to the target vehicle component.

[0102] Step S2: In response to the second instruction issued by the user based on the target augmented reality image, obtain the control instruction corresponding to the second instruction.

[0103] Specifically, after displaying the target AR image in step S1, based on the second command issued by the user, the corresponding control command for controlling the target vehicle components is obtained on the target AR image.

[0104] It should be noted that in step S2, the user issues a second command, which works in the same way as the user issues a first command in step S1 above. That is, the command can also be issued through voice, touch, or other means.

[0105] Furthermore, when the second instruction is issued based on touch, it is necessary to add the touch event of the corresponding target vehicle component to the target augmented reality image in advance so that the target augmented reality image has touch event functionality; specifically, this can be done by creating a node corresponding to the target vehicle component in the target augmented reality image, and then adding the touch event to the node.

[0106] Step S3: Control the target vehicle component based on the control command.

[0107] Specifically, after obtaining the control command for controlling the target vehicle component in step S2, the target vehicle component can be controlled based on the control command.

[0108] It should be noted that when the above vehicle control method is applied to a smart terminal, that is, after step S2, the smart terminal obtains the control command. At this time, the smart terminal will send the control command to the vehicle terminal. Specifically, the smart terminal sends the control command to the vehicle terminal through near-field wireless communication; or it sends the control command to the vehicle terminal through a cloud server, so that the vehicle terminal can control the target vehicle components based on the control command.

[0109] It should be noted that the above embodiment of applying the vehicle control method to a smart terminal can enable the user to control vehicle components regardless of whether the user is in the vehicle, providing a good user experience; and no additional hardware is required, relying only on the existing hardware capabilities of the smart terminal device to control vehicle components, making it easy to operate and highly feasible.

[0110] Furthermore, when the above-mentioned vehicle control method is applied to the vehicle terminal, that is, after step S2, the vehicle terminal obtains the control command. At this time, the vehicle terminal can directly control the target vehicle component based on the control command.

[0111] The vehicle control method of the present invention will be further explained and illustrated below through specific embodiments.

[0112] like Figure 6 As shown, in one embodiment, the vehicle control method is applied to an on-board terminal to control the vehicle's fuel filler neck; specifically, the working principle of the vehicle control method is as follows;

[0113] First, the user sends a first command to the in-vehicle terminal via voice. After receiving the command, the in-vehicle terminal controls the vehicle's camera to capture a real-time image of the fuel filler neck. The camera then sends the captured image to the in-vehicle terminal. The in-vehicle terminal uses image recognition technology to identify the real-time image and, upon recognizing the fuel filler neck, directly retrieves a virtual model of the corresponding fuel filler neck from its memory. Then, the in-vehicle terminal uses AR technology, combined with the virtual model of the fuel filler neck, to generate an AR virtual interface for the fuel filler neck, which is then displayed on the in-vehicle screen. Within this AR virtual interface, the user can control the fuel filler neck by touching it.

[0114] It should be noted that the vehicle control method of the present invention does not require actual contact with the corresponding vehicle parts, regardless of whether the user is inside the vehicle. It can first identify the vehicle parts using image recognition technology, and then combine AR technology to generate an AR scene by adding a virtual world to the real scene. At the same time, the corresponding vehicle parts can be controlled in this AR scene, providing a new interaction method and improving the user's actual experience. Compared with the existing vehicle part control, which requires body parts to touch the designated parts of the vehicle, all operations of the present invention do not require contact with the vehicle parts and are presented and operated in the AR scene reproduced on the terminal.

[0115] It should be noted that the protection scope of the vehicle control method described in this invention is not limited to the execution order of the steps listed in this embodiment. Any solution implemented by adding, subtracting, or replacing steps in the prior art based on the principles of this invention is included within the protection scope of this invention.

[0116] The storage medium of this invention stores computer instructions, which, when executed by a processor, implement the vehicle control method described above. The storage medium includes various media capable of storing program code, such as read-only memory (ROM), random access memory (RAM), magnetic disk, USB flash drive, memory card, or optical disk.

[0117] One or more storage media may be used in any combination. The storage medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, RAM, ROM, erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by or in connection with an instruction execution system, apparatus, or device.

[0118] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including—but not limited to—electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of transmitting, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device.

[0119] The program code contained on a computer-readable medium may be transmitted using any suitable medium, including—but not limited to—wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0120] Computer program code for performing the operations of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, Smalltalk, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0121] The present invention will now be described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, these computer program instructions create means for implementing the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams.

[0122] These computer program instructions may also be stored in a computer-readable medium, which causes a computer, other programmable data processing apparatus, or other device to operate in a particular manner, thereby producing an article of manufacture that includes instructions for implementing the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0123] Computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, such that the instructions that execute on the computer or other programmable apparatus provide a process for implementing the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0124] In one embodiment, the present invention provides a terminal including a processor and a memory.

[0125] The memory is used to store computer instructions; preferably, the memory includes various media capable of storing program code, such as ROM, RAM, magnetic disk, USB flash drive, memory card or optical disk.

[0126] The processor is connected to the memory and is used to execute computer instructions stored in the memory so that the terminal performs the vehicle control method described above.

[0127] Preferably, the processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0128] Figure 1 A block diagram of an exemplary terminal 1 suitable for implementing embodiments of the present invention is shown.

[0129] Figure 1 The terminal 1 shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.

[0130] like Figure 1 As shown, terminal 1 is presented in the form of a general-purpose computing device. The components of terminal 1 may include, but are not limited to: one or more processors or processing units 11, memory 12, and bus 13 connecting different system components (including memory 12 and processing unit 11).

[0131] Bus 13 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. Examples of these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MCA) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0132] Terminal 1 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by Terminal 1, including volatile and non-volatile media, removable and non-removable media.

[0133] Memory 12 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 121 and / or cache memory 122. Terminal 1 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 123 may be used to read and write non-removable, non-volatile magnetic media (… Figure 1 Not shown; usually referred to as a "hard drive"). Although Figure 1 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 13 via one or more data media interfaces. Memory 12 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0134] A program / utility 124 having a set (at least one) of program modules 1241 may be stored, for example, in memory 12. Such program modules 1241 include—but are not limited to—an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 1241 typically perform the functions and / or methods described in the embodiments of the present invention.

[0135] Terminal 1 can also communicate with one or more external devices 2 (e.g., keyboard, pointing device, display 3, etc.), and with one or more devices that enable a user to interact with terminal 1, and / or with any device that enables terminal 1 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed through input / output (I / O) interface 14. Furthermore, terminal 1 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) through network adapter 15. Figure 1 As shown, network adapter 15 communicates with other modules of terminal 1 via bus 13. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with terminal 1, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0136] In one embodiment, the terminal is a smart terminal.

[0137] It should be noted that the smart terminal includes, but is not limited to, smartphones, tablets, PDAs (Personal Digital Assistants), and other terminal devices with data processing capabilities. Generally, a smart terminal refers to a type of terminal device that has an independent operating system, allows users to install software, games, and other programs provided by third-party service providers to continuously expand the functionality of the handheld device, and enables wireless network access through mobile communication networks.

[0138] In one embodiment, the terminal is a vehicle-mounted terminal.

[0139] It should be noted that this in-vehicle terminal features an in-vehicle infotainment system. An in-vehicle infotainment system (IVI) is a comprehensive in-vehicle information processing system that utilizes a dedicated in-vehicle central processing unit, based on the vehicle bus system and internet services. IVI can provide a range of applications including 3D navigation, real-time traffic updates, IPTV, driver assistance, fault detection, vehicle information, vehicle control, wireless communication, online entertainment functions, and TSP services. The vehicle also includes cameras, microphones, etc. (not shown), electrically connected to the in-vehicle terminal. The specific number and location of these devices can be configured by those skilled in the art according to their needs.

[0140] like Figure 7 As shown, in one embodiment, the vehicle control system of the present invention includes a smart terminal 71 and a first vehicle 72.

[0141] Specifically, the first vehicle 72 includes a first vehicle-mounted terminal 721; the smart terminal 71 is communicatively connected to the first vehicle-mounted terminal 721; the smart terminal 71, in response to a first command issued by a user, displays a target augmented reality image corresponding to the target vehicle component; in response to a second command issued by the user based on the target augmented reality image, acquires a control command corresponding to the second command; sends the control command to the vehicle-mounted terminal; the vehicle-mounted terminal controls the target vehicle component based on the control command.

[0142] In one embodiment, the system further includes a second camera 73; the second camera 73 is disposed on the smart terminal 71, the second camera 73 is communicatively connected to the smart terminal 71, the second camera 73 acquires real-time images corresponding to the target vehicle component, and / or the second camera 73 acquires global images corresponding to the vehicle.

[0143] Furthermore, the camera built into the smart terminal 71 can be used to collect real-time images of the target vehicle components and / or global images of the vehicle.

[0144] In one embodiment, the system further includes a first vehicle-mounted camera 722; the first vehicle-mounted camera 722 is disposed in the vehicle and is communicatively connected to a first vehicle-mounted terminal 721; the first vehicle-mounted camera 722 acquires real-time images corresponding to the target vehicle components and sends the real-time images to the first vehicle-mounted terminal 721, and / or the first vehicle-mounted camera 722 acquires global images corresponding to the vehicle and sends the global images to the first vehicle-mounted terminal 721; the first vehicle-mounted terminal 721 sends the real-time images and / or the global images to the smart terminal 71.

[0145] It should be noted that the working principle of this vehicle control system is the same as that of the vehicle control method described above, so it will not be repeated here.

[0146] like Figure 8 As shown, in one embodiment, the vehicle control system of the present invention includes a second vehicle-mounted camera 81 and a second vehicle 82.

[0147] Specifically, the second vehicle 82 includes a second vehicle-mounted terminal 821; a second vehicle-mounted camera 81 is disposed on the second vehicle 82, and the second vehicle-mounted camera 81 is communicatively connected to the second vehicle-mounted terminal 821; the second vehicle-mounted camera 81 acquires real-time images of the corresponding target vehicle component and sends the real-time images to the second vehicle-mounted terminal 821, and / or the second vehicle-mounted camera 81 acquires a global image of the corresponding vehicle and sends the global image to the second vehicle-mounted terminal 821; the second vehicle-mounted terminal 821, in response to a first command issued by the user, displays a target augmented reality image corresponding to the target vehicle component; in response to a second command issued by the user based on the target augmented reality image, acquires a control command corresponding to the second command; and controls the target vehicle component based on the control command.

[0148] It should be noted that the working principle of this vehicle control system is the same as that of the vehicle control method described above, so it will not be repeated here.

[0149] It should be noted that the vehicle control system of the present invention can implement the vehicle control method of the present invention, but the implementation device of the vehicle control method of the present invention includes, but is not limited to, the structure of the vehicle control system listed in this embodiment. All structural modifications and substitutions of the prior art made according to the principle of the present invention are included within the protection scope of the present invention.

[0150] In summary, the vehicle control method, system, and medium of the present invention, by displaying augmented reality images of corresponding vehicle components, and controlling the vehicle components based on these augmented reality images, provides a new control method for vehicle components, bringing convenience to users. When controlling a vehicle component, there is no need to actually touch the corresponding vehicle component; the vehicle component can be identified using image recognition technology, and then an augmented reality image is generated using augmented reality technology, thereby achieving control of the vehicle component based on this image. By providing multiple methods for obtaining augmented reality images corresponding to target vehicle components, and multiple methods for obtaining virtual models of the corresponding target vehicle components, the feasibility of the vehicle control method is improved. It enables control of vehicle components regardless of whether the user is in the vehicle, providing a good user experience. Control of vehicle components can be achieved without adding any additional hardware, making it simple to operate and highly feasible. Therefore, the present invention effectively overcomes the various shortcomings of the prior art and has high industrial application value.

[0151] The above embodiments are merely illustrative of the principles and effects of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in the present invention should still be covered by the claims of the present invention.

Claims

1. A vehicle control method, characterized in that, Includes the following steps: In response to the user's first command, display the target augmented reality image corresponding to the target vehicle component; In response to a second instruction issued by the user based on the target augmented reality image, a control instruction corresponding to the second instruction is obtained; Based on the control commands, control the target vehicle components; The step of displaying the target augmented reality image corresponding to the target vehicle component in response to a first command issued by the user includes the following steps: In response to the first instruction, a real-time image of the corresponding target vehicle component is acquired; Based on the real-time images, the target vehicle components are identified; Obtain the target virtual model corresponding to the target vehicle component; Based on the real-time image and the target virtual model, the target augmented reality image is displayed.

2. The method according to claim 1, wherein obtaining the target virtual model corresponding to the target vehicle component includes the following steps: Load and generate the target virtual model.

3. The method according to claim 1, wherein obtaining the target virtual model corresponding to the target vehicle component includes the following steps: Call the target virtual model; or The global virtual model corresponding to the vehicle is invoked, and the target virtual model is obtained based on the global virtual model; the global virtual model includes virtual models corresponding to all vehicle components on the vehicle.

4. The method according to claim 1, wherein displaying the target augmented reality image corresponding to the target vehicle component in response to a first command issued by the user comprises the following steps: In response to the first instruction, a global augmented reality image corresponding to the vehicle is displayed; Based on the global augmented reality image, acquire and display the target augmented reality image.

5. The method according to claim 4, wherein displaying a global augmented reality image of the corresponding vehicle in response to the first instruction comprises the following steps: In response to the first instruction, a global virtual model corresponding to the vehicle is invoked; the global virtual model includes virtual models corresponding to all vehicle components on the vehicle. In response to a third instruction, acquire a global image corresponding to the vehicle; The global augmented reality image is displayed based on the global image and the global virtual model.

6. A storage medium storing computer instructions thereon, characterized in that, When the computer instructions are executed by the processor, they implement the vehicle control method according to any one of claims 1 to 5.

7. A terminal, characterized in that, include: Processor and memory; The memory is used to store computer instructions; The processor is used to execute computer instructions stored in the memory to cause the terminal to perform the vehicle control method according to any one of claims 1 to 5.

8. A vehicle control system, characterized in that, include: A smart terminal and a vehicle; wherein the vehicle includes: an in-vehicle terminal; the smart terminal is communicatively connected to the in-vehicle terminal; The smart terminal In response to the user's first command, display the target augmented reality image corresponding to the target vehicle component; In response to a second instruction issued by the user based on the target augmented reality image, a control instruction corresponding to the second instruction is obtained; Send the control command to the vehicle terminal; The vehicle-mounted terminal controls the target vehicle components based on the control commands; The step of displaying the target augmented reality image corresponding to the target vehicle component in response to a first command issued by the user includes the following steps: In response to the first instruction, a real-time image of the corresponding target vehicle component is acquired; Based on the real-time images, the target vehicle components are identified; Obtain the target virtual model corresponding to the target vehicle component; Based on the real-time image and the target virtual model, the target augmented reality image is displayed.

9. The system according to claim 8, further comprising: Camera; The camera is installed on the smart terminal and is communicatively connected to the smart terminal. The camera captures real-time images corresponding to the target vehicle component, and / or The camera captures a global image of the vehicle.

10. The system according to claim 8, further comprising: Vehicle-mounted cameras; The vehicle-mounted camera is installed in the vehicle and is communicatively connected to the vehicle-mounted terminal; The vehicle-mounted camera acquires real-time images corresponding to the target vehicle component and sends the real-time images to the vehicle-mounted terminal, and / or The vehicle-mounted camera captures a global image of the vehicle and sends the global image to the vehicle-mounted terminal. The vehicle-mounted terminal sends the real-time image and / or the global image to the smart terminal.

11. A vehicle control system, characterized in that, include: Vehicle-mounted camera and vehicle; wherein the vehicle includes: vehicle-mounted terminal; The vehicle-mounted camera is installed in the vehicle and is communicatively connected to the vehicle-mounted terminal; the vehicle-mounted camera acquires real-time images of corresponding target vehicle components and sends the real-time images to the vehicle-mounted terminal, and / or The vehicle-mounted camera captures a global image of the vehicle and sends the global image to the vehicle-mounted terminal. The vehicle-mounted terminal. In response to a first command issued by the user, the target augmented reality image corresponding to the target vehicle component is displayed; In response to a second instruction issued by the user based on the target augmented reality image, a control instruction corresponding to the second instruction is obtained; Based on the control commands, control the target vehicle components; The step of displaying the target augmented reality image corresponding to the target vehicle component in response to a first command issued by the user includes the following steps: In response to the first instruction, a real-time image of the corresponding target vehicle component is acquired; Based on the real-time images, the target vehicle components are identified; Obtain the target virtual model corresponding to the target vehicle component; Based on the real-time image and the target virtual model, the target augmented reality image is displayed.

Images