Vehicle machine picture control method and system

Abstract

The invention relates to the technical field of vehicle machine screen projection, and discloses a vehicle machine picture control method and system.The entity control device obtains vehicle machine information and sends the vehicle machine information and operable information of the entity control device to the terminal device, the terminal device maps the vehicle machine information and the operable information with the operation function of the system of the entity control device, and the operation function of the system of the entity control device is obtained. And the screen picture is sent to the entity control equipment, the entity control equipment projects the screen picture to the vehicle machine for display and sends a target operation event generated in response to operation of the entity control equipment by a user to the terminal equipment, and the terminal equipment updates screen picture display based on the target operation event. According to the method, the terminal equipment is used for updating the screen picture and sending the updated screen picture to the entity control equipment, the entity control equipment projects the updated screen picture sent by the terminal equipment to the vehicle-mounted terminal for display, a user can directly control the picture displayed by the terminal equipment to the vehicle-mounted terminal through the entity control equipment when the terminal equipment projects the screen, operation is convenient, and the driving risk of a driver is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle head unit screen mirroring, and particularly relates to a method and system for controlling the vehicle head unit screen. Background Art

[0002] A smart phone can mirror its screen to the vehicle head unit screen through functions such as CarPlay or Auto. For example, functions such as displaying maps, playing music, or making and receiving calls can be performed through the vehicle head unit screen. Users can also operate on the vehicle head unit screen without looking down at the phone. However, the vehicle head unit screen is relatively far from the driver in some cases, and there may be driving risks when the driver operates the screen while driving. Summary of the Invention

[0003] In view of this, the present invention provides a method and system for controlling the vehicle head unit screen to solve the problem that the vehicle head unit screen is relatively far from the driver and there may be risks when the driver operates the screen while driving.

[0004] In a first aspect, the present invention provides a method for controlling the vehicle head unit screen, which is applied to a physical control device. The physical control device is connected to the vehicle head unit and also connected to a terminal device. The method includes: obtaining vehicle head unit information, and sending the vehicle head unit information and its own operable information to the terminal device, so that the terminal device maps the vehicle head unit information and its operable information sent by the physical control device to the operation functions of the terminal device system. The vehicle head unit information at least includes vehicle head unit button information and a touch screen; projecting the screen image supporting vehicle head unit screen mirroring sent by the terminal device onto the vehicle head unit, so that the vehicle head unit displays the screen image; in response to a target operation event generated by the user operating the physical control device, sending the target operation event to the terminal device, so that the terminal device updates the screen image display based on the target operation function of its own system corresponding to the target operation event sent by the physical control device; and projecting the updated screen image sent by the terminal device onto the vehicle head unit for display.

[0005] In an optional embodiment, the physical control device is connected to the vehicle head unit through a bus interface. Wherein, the vehicle head unit establishes a communication channel according to the type of the physical control device and sends its own protocol version to the physical control device. The obtaining of the vehicle head unit information includes: matching the corresponding protocol version sent by the vehicle head unit with its own protocol version; when the protocol versions match successfully, obtaining the vehicle head unit information through the bus interface.

[0006] The present invention only establishes communication and obtains vehicle head unit information after the protocol versions match successfully, which can ensure the compatibility and stable communication between devices. Moreover, the user can accurately control the terminal device according to the information provided by the vehicle head unit through the physical control device, and there will be no misoperation or control errors caused by inaccurate information.

[0007] In an alternative embodiment, the entity control device establishes a wireless connection with the terminal device. The process of sending the vehicle head unit information and its own operable information to the terminal device includes: broadcasting via wireless means so that the terminal device discovers and identifies the entity control device based on the broadcast signal and initiates a wireless pairing request; verifying the wireless pairing request sent by the terminal device; and after the wireless pairing request is successfully verified, establishing a data channel via wireless means and sending the vehicle head unit information and its own operable information to the terminal device.

[0008] Through the wireless broadcast method of the present invention, the terminal device can automatically identify the entity control device, simplifying the operation process of device connection. Verifying the wireless pairing request sent by the terminal device can ensure that only authorized terminal devices can establish a connection with the entity control device, effectively preventing unauthorized device access. Additionally, the data channel established after the successful verification of the wireless pairing request provides a stable and reliable connection for the transmission of vehicle head unit information and the operable information of the entity control device.

[0009] In an alternative embodiment, the entity control device is a knob, and the operation event is generated by the user's rotation or pressing operation on the knob. The knob is integrated with a rotary encoder. Responding to the target operation event generated by the user operating the entity control device includes: determining the rotation direction of the knob by the user based on the signal phase change state of two output channels in the rotary encoder, and generating a corresponding target operation event based on the rotation direction of the knob; and determining whether there is a pressing operation based on the level change of the button pin in the rotary encoder, and generating a corresponding target operation event when it is determined that there is a pressing operation.

[0010] In a second aspect, the present invention provides a method for controlling a vehicle head unit screen, which is applied to a terminal device. The terminal device is connected to an entity control device. The method includes: performing mapping processing on the vehicle head unit information sent by the entity control device and the operable information of the entity control device with the operation functions of its own system. The vehicle head unit information includes at least vehicle head unit button information and a touch screen; sending the screen image of the screen in the terminal device that supports vehicle head unit screen mirroring to the entity control device so that the entity control device mirrors the screen image that supports vehicle head unit screen mirroring to the vehicle head unit for display; updating the screen image display based on the target operation function of its own system corresponding to the target operation event sent by the entity control device, and sending the updated screen image to the entity control device so that the entity control device mirrors the updated screen image sent by the terminal device to the vehicle head unit for display.

[0011] In an alternative embodiment, the in-vehicle unit information further includes the resolution of the in-vehicle unit. The step of sending the screen image of the terminal device that supports in-vehicle unit screen mirroring to the physical control device includes: obtaining the image data of the screen image of the terminal device that supports in-vehicle unit screen mirroring; encoding the image data into a video stream that conforms to the display of the in-vehicle unit screen based on the resolution of the in-vehicle unit; and sending the video stream to the physical control device, so that the physical control device decodes the video stream, restores it to a screen image frame, and projects the image frame onto the in-vehicle unit for display at a preset frame rate.

[0012] The present invention can encode the screen image into a suitable video stream according to the in-vehicle unit information such as the resolution of the in-vehicle unit, ensure that the screen image is projected onto the in-vehicle unit with a better effect, and ensure that users obtain a good visual experience.

[0013] In a third aspect, the present invention provides an in-vehicle unit screen control system. The system includes a physical control device, a terminal device, and an in-vehicle unit. The physical control device is connected to the in-vehicle unit and also connected to the terminal device. Among them, the physical control device obtains the in-vehicle unit information and sends the in-vehicle unit information and its own operable information to the terminal device. The in-vehicle unit information at least includes in-vehicle unit button information and a touch screen. The terminal device maps the in-vehicle unit information and the operable information of the physical control device sent by the physical control device to the operation functions of its own system, and sends the screen image of the terminal device that supports in-vehicle unit screen mirroring to the physical control device. The physical control device projects the screen image of the terminal device that supports in-vehicle unit screen mirroring onto the in-vehicle unit so that the in-vehicle unit displays the screen image. When the physical control device responds to a target operation event generated by a user operating the physical control device, it sends the target operation event to the terminal device. The terminal device updates the screen image display according to the target operation function of its own system corresponding to the target operation event sent by the physical control device, and sends the updated screen image to the physical control device. The physical control device projects the updated screen image sent by the terminal device onto the in-vehicle unit for display.

[0014] The in-vehicle infotainment (IVI) screen control system provided by the present invention enables the physical control device to obtain IVI information and send the IVI information and its own operable information to the terminal device. The terminal device maps the IVI information and the operable information of the physical control device sent by the physical control device to the operation functions of its own system, and sends the screen image that supports IVI screen mirroring to the physical control device. The physical control device projects the screen image onto the IVI for display, and sends the target operation event generated in response to the user's operation on the physical control device to the terminal device. The terminal device updates the screen image display based on the target operation function of its own system corresponding to the target operation event sent by the physical control device, and sends the updated screen image to the physical control device. The physical control device projects the updated screen image sent by the terminal device onto the IVI for display. The user can directly control the display image on the IVI during screen mirroring through the physical control device, which is convenient for operation and reduces the risk of driving for the driver.

[0015] In an alternative embodiment, the physical control device is connected to the IVI through a bus interface and wirelessly connected to the terminal device.

[0016] In an alternative embodiment, the physical control device is a knob with rotation and pressing functions. The knob can generate corresponding operation events based on the user's rotation or pressing operation on the knob.

[0017] In an alternative embodiment, the knob is cylindrical.

[0018] The physical control device designed by the present invention is a knob, which integrates a rotary encoder. The cylindrical shape provides a smooth and precise operation feel, and the encoder can accurately measure the rotation angle of the knob and confirm the function, realizing high-precision control operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for the description of the specific embodiments or the prior art. Obviously, the following drawings are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0020] Figure 1 is a schematic structural diagram of the IVI screen control system according to an embodiment of the present invention; Figure 2 is a schematic diagram of the interaction of each port in the IVI screen control system according to an embodiment of the present invention; Figure 3 is a flowchart example of the IVI screen control method according to an embodiment of the present invention; Figure 4It is a schematic diagram of the interaction of each port in the vehicle-mounted computer screen control system according to an embodiment of the present invention; Figure 5 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. Detailed implementation manners

[0021] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0022] An embodiment of the present invention provides a vehicle-mounted computer screen control system. As Figure 1 shown, the system includes an entity control device 1, a terminal device 2, and a vehicle-mounted computer 3. The entity control device 1 is connected to the vehicle-mounted computer 3 and also connected to the terminal device 2. Among them, the entity control device 1 obtains vehicle-mounted computer information and sends the vehicle-mounted computer information and its own operable information to the terminal device 2. The vehicle-mounted computer information at least includes the button information of the vehicle-mounted computer 3 and the touch screen. The terminal device 2 maps the vehicle-mounted computer information and the operable information of the entity control device 1 sent by the entity control device 1 to the operation functions of its own system, and sends the screen image that supports the screen mirroring of the vehicle-mounted computer 3 in the terminal device 2 to the entity control device 1. The entity control device 1 projects the screen image that supports the screen mirroring of the vehicle-mounted computer 3 sent by the terminal device 2 onto the vehicle-mounted computer 3 so that the vehicle-mounted computer 3 displays the screen image. When the entity control device 1 responds to a target operation event generated by a user operating the entity control device 1, it sends the target operation event to the terminal device 2. The terminal device 2 updates the screen image display according to the target operation function of its own system corresponding to the target operation event sent by the entity control device 1, and sends the updated screen image to the entity control device 1. The entity control device 1 projects the updated screen image sent by the terminal device 2 onto the vehicle-mounted computer 3 for display.

[0023] In the embodiments of the present invention, the type of the physical control device 1 is not limited. It can be a physical device such as a joystick, a remote control, or a knob. The user can operate the physical control device 1 to control the screen display of the terminal device 2, and then project it onto the in-vehicle computer 3 to meet the driving needs of the in-vehicle users. The physical control device 1 can be placed beside the driver or other in-vehicle users (for example, on the right side of the driver for a left-hand drive vehicle and on the left side of the driver for a right-hand drive vehicle), which is convenient for the driver to operate with one hand. The terminal device 2 is not limited, as long as it is a device with the function of projecting the in-vehicle computer 3, such as a mobile phone, a tablet, etc. The physical control device 1 can establish a connection with the in-vehicle computer 3 and with the terminal device 2, that is, for the in-vehicle computer 3, the physical control device 1 is simulated as a mobile phone, and for the mobile phone, the physical control device 1 is simulated as the in-vehicle computer 3. The physical control device 1 is an adapter for an in-vehicle screen mirroring protocol.

[0024] The physical control device 1 in the embodiments of the present invention is connected to the in-vehicle computer 3 and can obtain in-vehicle computer information from the in-vehicle computer 3, such as the button and touch screen information of the in-vehicle computer 3. When the terminal device 2 asks the physical control device 1 for in-vehicle computer information, the physical control device 1 can send the obtained in-vehicle computer information and its own operable information to the terminal device 2, so that the operation information on the physical control device 1 is the same as the native button behavior of the in-vehicle computer 3 for the terminal device 2. Among them, the operable information of the physical control device 1 can include but is not limited to screen magnification, reduction, confirmation, right click, left click, etc. The terminal device 2 can perform mapping processing on the obtained in-vehicle computer information and the operable information of the physical control device 1 with the operation functions of its own system. For example, it can first parse the in-vehicle computer information and the operable information based on a pre-set communication protocol, and map the parsed in-vehicle computer information and operable information to the operation functions in its own system or application program, and configure in advance the corresponding relationship between the in-vehicle computer information and the operable information and its own specific operations. The terminal device 2 can send the screen image that supports projecting the in-vehicle computer 3 of itself to the physical control device 1. Among them, the screen image that supports projecting the in-vehicle computer 3 can be the entire main screen of the terminal device 2 (including all elements such as the desktop and application icons), or some specific application screens set by the user. For example, in the Android system, the MediaProjection API can be used to capture the screen image, which can create a virtual display, render the application icons that support the in-vehicle computer 3 onto the virtual display, and then use the screen image displayed on the virtual display as the screen image that supports projecting the in-vehicle computer 3 and send it to the physical control device 1, just as an example.

[0025] The entity control device 1 in the embodiment of the present invention can send the screen image supporting the screen mirroring of the vehicle-mounted device 3 sent by the interrupt device to the vehicle-mounted device 3, so that the vehicle-mounted device 3 can display the screen image. After that, the user can operate the entity control device 1 according to the icons and other images displayed on the screen of the vehicle-mounted device 3 and driving requirements. For example, if the user wants to click on the map software icon displayed on the screen of the vehicle-mounted device 3, the user can operate the click confirmation button of the entity control device 1 to enter the navigation application. In response to the target operation event generated by the user operating the entity control device 1, the entity control device 1 can send the target operation event to the terminal device 2. The terminal device 2 can update the screen image accordingly based on the target operation function of its own system corresponding to the target operation event pre-configured. For example, when the target operation function is to move left, the terminal device 2 can move the virtual display focus to the left and send the updated screen image to the entity control device 1. The entity control device 1 sends the updated screen image to the vehicle-mounted device 3 so that the vehicle-mounted device 3 can update the display.

[0026] In the vehicle-mounted device screen control system provided by the present invention, the entity control device obtains vehicle-mounted device information and sends the vehicle-mounted device information and its own operable information to the terminal device. The terminal device maps and processes the vehicle-mounted device information and the operable information of the entity control device sent by the entity control device with the operation functions of its own system, and sends the screen image supporting the vehicle-mounted device screen mirroring to the entity control device. The entity control device projects the screen image onto the vehicle-mounted device for display and sends the target operation event generated in response to the user operating the entity control device to the terminal device. The terminal device updates the screen image display based on the target operation function of its own system corresponding to the target operation event sent by the entity control device, and sends the updated screen image to the entity control device. The entity control device projects the updated screen image sent by the terminal device onto the vehicle-mounted device for display. The user can directly control the display image of the terminal device projected onto the vehicle-mounted device through the entity control device, which is convenient for operation and reduces the risk of driving for the driver.

[0027] Specifically, the entity control device 1 and the vehicle-mounted device 3 are connected through a bus interface. Among them, the vehicle-mounted device 3 establishes a communication channel according to the type of the entity control device 1 and sends its own protocol version to the entity control device 1. The entity control device 1 obtaining the vehicle-mounted device information includes: matching the corresponding protocol version sent by the vehicle-mounted device 3 with its own protocol version; when the protocol version matching is successful, obtaining the vehicle-mounted device information through the bus interface.

[0028] As Figure 2 shown, the entity control device 1 in the embodiment of the present invention is connected to the vehicle-mounted device 3 through a bus interface (Universal Serial Bus, USB). For the USB interface of the vehicle-mounted device 3, when the entity control device 1 is inserted, as Figure 3As shown, the in-vehicle unit 3 enumerates the device through the USB protocol to determine the type of the physical control device 1, and can establish a communication channel according to the type of the physical control device 1, such as a Carplay or Auto channel. The in-vehicle unit 3 and the physical control device 1 can respectively obtain the protocol versions of each other and determine whether the two protocol versions match. If the two protocol versions match successfully, the physical control device 1 can obtain the in-vehicle unit information through the USB data channel, such as touch screen and side note button information.

[0029] In the present invention, communication is established and in-vehicle unit information is obtained only after the protocol versions match successfully, which can ensure the compatibility and stable communication between devices. Moreover, the user can accurately control the terminal device according to the information provided by the in-vehicle unit through the physical control device, and there will be no misoperation or control errors caused by inaccurate information.

[0030] Specifically, the physical control device 1 and the terminal device 2 are wirelessly connected to send the in-vehicle unit information and its own operable information to the terminal device 2, including: broadcasting wirelessly to enable the terminal device 2 to discover and identify the physical control device 1 based on the broadcast signal and initiate a wireless pairing request; verifying the wireless pairing request sent by the terminal device 2; after the wireless pairing request is verified successfully, establishing a data channel wirelessly and sending the in-vehicle unit information and its own operable information to the terminal device 2.

[0031] As Figure 2 shown, the physical control device 1 and the terminal device 2 in the embodiment of the present invention are connected wirelessly through WIFI or Bluetooth. After the physical control device 1 obtains the in-vehicle unit information, as Figure 3 shown, it can be broadcast periodically wirelessly (WIFI and Bluetooth) (equivalent to declaring itself as an in-vehicle unit 3 and waiting for the connection of the terminal device 2, taking the terminal device 2 as a mobile phone for example). The user can discover the existence of the physical control device 1 through the WIFI or Bluetooth of the mobile phone and can actively initiate a pairing request to the physical control device 1 through Bluetooth. The physical control device 1 can verify the pairing request sent by the mobile phone. Among them, verifying the pairing request can include but is not limited to the authentication of the identity of the terminal device 2, the verification of keys and other configuration information. Only by way of example, after the wireless pairing request is verified successfully, the physical control device 1 can establish a data channel with the mobile phone wirelessly, such as through WIFI. The mobile phone will inquire the in-vehicle unit information from the physical control device 1, and the physical control device 1 will send the in-vehicle unit information and its own operable information to the mobile phone. From the perspective of the mobile phone, the operation information of the physical control device 1 is consistent with the operation behavior of the in-vehicle unit information.

[0032] Specifically, the physical control device 1 is a knob, which has rotation and pressing functions. The knob can generate corresponding operation events based on the rotation or pressing operation of the user on the knob. The knob is integrated with a rotary encoder. The physical control device 1 responds to the target operation events generated by the user operating the physical control device 1, including: determining the rotation direction of the knob by the user based on the signal phase change state of two output channels in the rotary encoder, and generating corresponding target operation events based on the rotation direction of the knob; judging whether there is a pressing operation based on the level change of the key pin in the rotary encoder, and generating corresponding target operation events when it is determined that there is a pressing operation.

[0033] In the embodiment of the present invention, the designed physical control device 1 is a knob, which can be rotated and pressed. The operation events are generated by the user's rotation or pressing operation on the knob. For example, the left rotation corresponds to the left direction key, the right rotation corresponds to the right direction key, and the pressing corresponds to the confirmation key, which is used to control the behavior of the terminal device 2. Only as an example, the knob is integrated with a rotary encoder. Taking the incremental encoder as an example, the edge trigger method and the state comparison method can be used to judge the rotation direction of the knob by the user. For example, the principle of the edge trigger method is: the incremental encoder has two output channels, A and B, and the signal phase difference between them is 90 degrees. When the output of phase A is a falling edge, if the phase B is at a high level, it is judged as clockwise rotation (right rotation); if the phase B is at a low level, it is judged as counterclockwise rotation (left rotation). When the phase A is a rising edge, the phase B at a high level is counterclockwise rotation (left rotation), and the phase B at a low level is clockwise rotation (right rotation). Then, corresponding target operation events can be generated based on the rotation direction of the knob by the user. In addition to the A and B phase output pins, the rotary encoder also includes a key pin for confirmation. This pin usually has one foot pulled up to the I / O and the other foot connected to the GND. Normally, the I / O is at a high level. When the key is pressed, the pin conducts and the I / O becomes a low level. Then, it can be judged whether there is a pressing operation based on the level change, and corresponding target operation events are generated when it is determined that there is a pressing operation.

[0034] Specifically, the knob designed in the embodiment of the present invention is cylindrical.

[0035] The physical control device designed in the present invention is a knob, which is integrated with a rotary encoder. The cylindrical shape provides a smooth and precise operation feel. The encoder can accurately measure the rotation angle of the knob and the confirmation function, realizing high-precision control operations.

[0036] Specifically, the in-vehicle unit information further includes the resolution of the in-vehicle unit 3. The terminal device 2 sends the screen image of the screen in the terminal device 2 that supports screen mirroring to the in-vehicle unit 3, including: obtaining the image data of the screen image of the screen in the terminal device 2 that supports screen mirroring to the in-vehicle unit 3; encoding the image data into a video stream that conforms to the screen display of the in-vehicle unit 3 based on the resolution of the in-vehicle unit 3; and sending the video stream to the physical control device 1, so that the physical control device 1 decodes the video stream, restores it to a screen image frame, and projects the image frame onto the in-vehicle unit 3 for display at a preset frame rate.

[0037] As Figure 3 shown, the terminal device 2 in the embodiment of the present invention can use the Application Programming Interface (API) to obtain the screen image. It can create a virtual reality device, render the screen content set by the user that supports vehicle-mounted screen mirroring onto the virtual display, so as to obtain the image data of the screen image. Subsequently, by configuring appropriate parameters (such as the resolution, frame rate, and encoding format of the in-vehicle unit 3, etc.), the collected image data can be encoded into a video stream. After the video stream encoding is completed, the video stream can be sent to the physical control device 1 wirelessly. The physical control device 1 decodes the received video stream, restores it to an image frame, and finally the decoded image frame can be sequentially displayed on the screen of the in-vehicle unit 3 according to the frame rate requirement, realizing the screen mirroring display of the mobile phone screen on the in-vehicle unit 3.

[0038] The present invention can encode the screen image into a suitable video stream according to the in-vehicle unit information such as the resolution of the in-vehicle unit, ensure that the screen image is projected onto the in-vehicle unit with a better effect, and ensure that users obtain a good visual experience.

[0039] The embodiment of the present invention also provides a method for controlling the in-vehicle unit screen. This method is applied to the in-vehicle unit screen control system as Figure 1 shown. Among them, the physical control device 1 is connected to the in-vehicle unit 3 and the terminal device 2. As Figure 4 shown, the physical control device is used to execute steps S101 to S105, and the terminal device is used to execute steps S201 to S204.

[0040] Step S101: Obtain the in-vehicle unit information.

[0041] Step S102: Send the in-vehicle unit information and its own operable information to the terminal device.

[0042] Step S201: Map the in-vehicle unit information sent by the physical control device and the operable information of the physical control device to the operation functions of its own system.

[0043] Step S202: Send the screen image of the screen in the terminal device that supports screen mirroring to the in-vehicle unit to the physical control device.

[0044] Step S103: Cast the screen image that supports in-vehicle head unit screen mirroring sent by the terminal device to the in-vehicle head unit so that the in-vehicle head unit displays the screen image.

[0045] Step S104: In response to the target operation event generated by the user operating the entity control device, send the target operation event to the terminal device.

[0046] Step S203: Update the screen image display based on the target operation function of the entity control device sending the target operation event corresponding to its own system.

[0047] Step S204: Send the updated screen image to the entity control device.

[0048] Step S105: Cast the updated screen image sent by the terminal device to the in-vehicle head unit for display. For detailed description, please refer to the above embodiments and will not be elaborated here.

[0049] For the in-vehicle head unit screen control method provided by the present invention, the entity control device obtains the in-vehicle head unit information and sends the in-vehicle head unit information and its own operable information to the terminal device. The terminal device maps the in-vehicle head unit information and the operable information of the entity control device sent by the entity control device to the operation functions of its own system, and sends the screen image that supports in-vehicle head unit screen mirroring to the entity control device. The entity control device casts the screen image to the in-vehicle head unit for display and sends the target operation event generated by the user operating the entity control device to the terminal device. The terminal device updates the screen image display based on the target operation function of the entity control device sending the target operation event corresponding to its own system, and sends the updated screen image to the entity control device. The entity control device casts the updated screen image sent by the terminal device to the in-vehicle head unit for display. The user can directly control the display image on the in-vehicle head unit when the terminal device performs screen mirroring through the entity control device, which is convenient for operation and reduces the risk of driving for the driver.

[0050] Please refer to Figure 5 , Figure 5 which is a schematic structural diagram of a computer device provided by an alternative embodiment of the present invention, as Figure 5As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting the components, including a high-speed interface and a low-speed interface. Each component communicates with each other using different buses and can be installed on a common motherboard or installed in other ways as needed. The processor can process instructions executed within the computer device, including instructions stored in the memory or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some alternative embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a set of blade servers, or a multi-processor system). Figure 5 In the figure, a processor 10 is taken as an example.

[0051] The processor 10 can be a central processing unit, a network processor, or a combination thereof. Among them, the processor 10 can further include a hardware chip. The above hardware chip can be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The above programmable logic device can be a complex programmable logic device, a field programmable gate array, a generic array logic, or any combination thereof.

[0052] Among them, the memory 20 stores instructions executable by at least one processor 10, so that at least one processor 10 executes the method shown in the above embodiments.

[0053] The memory 20 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the computer device. In addition, the memory 20 can include a high-speed random access memory, and can also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some alternative embodiments, the memory 20 can optionally include a memory remotely set relative to the processor 10, and these remote memories can be connected to the computer device through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0054] The memory 20 can include a volatile memory, such as a random access memory; the memory can also include a non-volatile memory, such as a flash memory, a hard disk, or a solid-state drive; the memory 20 can also include a combination of the above types of memories.

[0055] The computer device further includes a communication interface 30 for the computer device to communicate with other devices or communication networks.

[0056] Embodiments of the present invention also provide a computer-readable storage medium. The method according to the embodiments of the present invention can be implemented in hardware, firmware, or be implemented as computer code that can be recorded on a storage medium, or be implemented as computer code that is originally stored in a remote storage medium or a non-transitory machine-readable storage medium and downloaded through a network and will be stored in a local storage medium, so that the method described herein can be stored as such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, the processor, or the hardware, the method shown in the above embodiments is implemented.

[0057] A part of the present invention can be applied as a computer program product, for example, computer program instructions. When executed by a computer, through the operation of the computer, the methods and / or technical solutions according to the present invention can be called or provided. Those skilled in the art should be able to understand that the forms in which computer program instructions exist in a computer-readable medium include, but are not limited to, source files, executable files, installation package files, etc. Correspondingly, the ways in which computer program instructions are executed by a computer include, but are not limited to: the computer directly executes the instructions, or the computer compiles the instructions and then executes the corresponding compiled program, or the computer reads and executes the instructions, or the computer reads and installs the instructions and then executes the corresponding installed program. Herein, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible by the computer.

[0058] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations all fall within the defined scope.

Claims

1. A vehicle computer screen control method, characterized in that: Applied to a physical control device, the physical control device is connected to a vehicle computer and to a terminal device, the method includes: Acquire vehicle information, and send the vehicle information and its own operable information to the terminal device, so that the terminal device maps the vehicle information and its operable information sent by the physical control device with the operation function of the terminal device system, wherein the vehicle information at least includes vehicle button information and touch screen; Projecting the screen image supported by the vehicle-computer projection sent by the terminal device to the vehicle-computer, so that the vehicle-computer displays the screen image; In response to a target operation event generated by a user operating a physical control device, the target operation event is sent to a terminal device, so that the terminal device updates a screen display based on the target operation event sent by the physical control device corresponding to a target operation function of its own system; Project the updated screen image sent by the terminal device to the vehicle computer display.

2. The method according to claim 1, characterized in that The physical control device is connected to the vehicle computer through a bus interface, wherein the vehicle computer establishes a communication channel according to the type of the physical control device and sends its own protocol version to the physical control device, and the acquisition of vehicle computer information includes: Match the corresponding protocol version sent by the vehicle computer with its own protocol version; When the protocol version matches successfully, the vehicle computer information is obtained through the bus interface.

3. The method according to claim 1, characterized in that The physical control device establishes a wireless connection with the terminal device, and the sending of the vehicle information and its own operable information to the terminal device includes: Broadcasting in a wireless manner so that the terminal device can discover and identify the physical control device based on the broadcast signal and initiate a wireless pairing request; Verify the wireless pairing request sent by the terminal device; After the wireless pairing request is successfully verified, a data channel is established wirelessly to send the vehicle information and its own operational information to the terminal device.

4. The method according to claim 1, characterized in that: The physical control device is a knob, the operation event is generated by a user rotating or pressing the knob, the knob is integrated with a rotary encoder, and the target operation event generated in response to the user operating the physical control device includes: Determine the rotation direction of the knob by the user based on the signal phase change state of the two output channels in the rotary encoder, and generate a corresponding target operation event based on the rotation direction of the knob; Based on the level change of the key pin in the rotary encoder, it is determined whether there is a pressing operation, and when it is determined that there is a pressing operation, a corresponding target operation event is generated.

5. A vehicle computer screen control method, characterized in that: Applied to a terminal device, the terminal device is connected to a physical control device, and the method includes: Mapping the vehicle information sent by the physical control device and the operable information of the physical control device with the operating functions of the system itself, wherein the vehicle information at least includes vehicle button information and a touch screen; Sending the screen image of the terminal device that supports the vehicle-machine screen projection to the physical control device, so that the physical control device projects the screen image that supports the vehicle-machine screen projection to the vehicle-machine display; Based on the target operation event sent by the physical control device corresponding to the target operation function of its own system, the screen display is updated, and the updated screen is sent to the physical control device, so that the physical control device projects the updated screen sent by the terminal device to the vehicle display.

6. The method according to claim 5, characterized in that The vehicle information also includes the resolution of the vehicle, and sending the screen image of the terminal device that supports vehicle projection to the physical control device includes: Obtain image data of the screen image in the terminal device that supports car screen projection; Based on the resolution of the vehicle computer, encoding the image data into a video stream that conforms to the display of the vehicle computer screen; The video stream is sent to a physical control device so that the physical control device decodes the video stream, restores it to a screen image frame, and projects the image frame to a vehicle computer display at a preset frame rate.

7. A vehicle computer screen control system, characterized in that: The system includes a physical control device, a terminal device and a vehicle computer, wherein the physical control device is connected to the vehicle computer and to the terminal device, wherein: The physical control device obtains vehicle information and sends the vehicle information and its own operable information to the terminal device, wherein the vehicle information at least includes vehicle button information and touch screen; The terminal device maps the vehicle information sent by the physical control device and the operable information of the physical control device with the operation functions of its own system, and sends the screen image of the terminal device that supports vehicle projection to the physical control device; The physical control device projects the screen image supported by the vehicle-computer projection and sent by the terminal device to the vehicle-computer, so that the vehicle-computer displays the screen image; The physical control device responds to a target operation event generated by a user operating the physical control device, and sends the target operation event to the terminal device; The terminal device updates the screen display based on the target operation event sent by the physical control device corresponding to the target operation function of its own system, and sends the updated screen display to the physical control device; The physical control device projects the updated screen image sent by the terminal device to the vehicle computer display.

8. The system according to claim 7, characterized in that The physical control device is connected to the vehicle computer via a bus interface and is connected to the terminal device via a wireless connection.

9. The system according to claim 7, characterized in that The physical control device is a knob having rotation and pressing functions, wherein the knob can generate corresponding operation events based on the user's rotation or pressing operation on the knob.

10. The system according to claim 9, characterized in that The knob is cylindrical.

Images