Vehicle machine system and control method thereof

Abstract

The invention relates to a vehicle machine system and a control method thereof. The vehicle machine system comprises a communication module which is configured to receive accessory equipment information from external equipment; and the mapping management module is configured to establish virtual equipment in the vehicle machine system based on the accessory equipment information so as to map the accessory equipment of the external equipment. Therefore, the access of the vehicle machine system to the auxiliary sensor in the external equipment can be realized, and the control of the host system and the application thereof by utilizing the external equipment is realized.

Description

Technical Field

[0001] The present invention relates to a vehicle computer system, and in particular to an extended application of equipment on the vehicle computer system. Background Art

[0002] With the popularity of new energy vehicles and the expansion of multimedia applications, more and more car systems are beginning to install some game applications for user entertainment. Usually, many car games are designed to be used with a controller to provide a better user experience. At present, with the deep binding of mobile phones and car systems, mobile phones can be used to achieve control operations such as unlocking and starting the vehicle. Therefore, mobile phones naturally become the best candidate device for controllers.

[0003] Figure 1 A schematic diagram is shown of a conventional vehicle system 100 using a mobile phone 200 as a handle to operate a game on the vehicle system. As shown in the figure, the vehicle system 100 establishes wireless or wired communication with the communication module 201 on the mobile phone 200 through the communication module 101. When the mobile phone acts as a game handle, the user needs to download the handle control program Handle_App that matches the current game application Game_App on the vehicle system to enable the mobile phone to act as a game handle. During the game, the handle control program Handle_App detects the measurement data of the sensor in the mobile phone 200, such as the three-axis coordinate data output by the gyroscope, and determines the posture or action of the mobile phone based on the sensor measurement data, thereby sending a game control command Game_Command to the game Game_App on the vehicle system through a pre-established wired or wireless communication link. Thus, the Game_App on the vehicle system performs corresponding game process control based on the received game control command.

[0004] However, it should also be noted that although the mobile phone can be used as a game controller according to the above conventional design scheme, if the car system carries different game Game_Apps from multiple suppliers, the user will need to install different handle control programs Handle_App to adapt to these different games, which will bring great inconvenience to the user and take up too much mobile phone space resources. Summary of the invention

[0005] The present invention provides an improved vehicle computer system. By mapping sensors on a mobile phone to virtual sensors established on the vehicle computer, it is possible to allow applications installed on the vehicle computer system to use the mobile phone as a control terminal without installing specific control or driver programs on the mobile phone, thereby achieving the purpose of enabling applications from different sources to be controlled using the mobile phone.

[0006] According to one aspect of the present invention, a vehicle system is provided, comprising a communication module configured to receive accessory device information from an external device; and a mapping management module configured to establish a virtual device in the vehicle system based on the accessory device information to map the accessory device of the external device. In one example, the accessory device may be one or more sensors in an external device such as a mobile phone.

[0007] According to another aspect of the present invention, a control method for device virtualization is provided, comprising receiving accessory device information from an external device; and establishing a virtual device to map the accessory device of the external device based on the accessory device information. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 A schematic diagram showing a conventional vehicle system and mobile phone configuration;

[0009] Figure 2 A schematic diagram of the configuration of a vehicle system and a mobile phone according to an example of the present invention is shown;

[0010] Figure 3 A flowchart of a method for implementing game controller expansion by virtualizing sensors according to an example of the present invention is shown;

[0011] Figure 4 A flow chart of a game controller expansion method according to another example of the present invention is shown.

[0012] In the present invention, the same reference numerals in different drawings indicate the same components and perform the same functions. DETAILED DESCRIPTION

[0013] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present invention.

[0014] Figure 2A vehicle system 100′ according to an example of the present invention and a mobile terminal such as a mobile phone 200 that can communicate with the vehicle system 100′ are shown. As shown in the figure, the mobile phone 200 includes a communication module 201 for establishing wired or wireless communication with the vehicle system 100′. Here, the communication module 201 may include multiple communication sub-modules, each of which uses one of a variety of wireless communication protocols to communicate with other devices that support the same communication protocol. These wireless communication protocols include, for example, but are not limited to Bluetooth, NFC (near field communication), WiFi, infrared, USB, etc. In addition, with the development of the demand for interconnection between cars and mobile phones, a variety of dedicated standard protocols for connecting mobile phones and cars have been developed, such as the ICCOA Carlink protocol and ICCE protocol launched by the Smart Car Open Alliance. According to these protocols, via a communication link established between the car and the mobile phone through wired or wireless methods such as WiFi, the applications and services of the mobile phone can be extended to the car, thereby allowing the use of navigation, music and telephone services provided by the mobile phone through the touch screen, physical buttons, voice receiving devices, etc. on the vehicle side. According to the example of the present invention, Figure 2 As shown, the connection manager 202 on the mobile phone 200 can not only manage the establishment of wired or wireless communication links, but also support the above-mentioned mobile phone and car interconnection standard protocols such as ICCOA Carlink, ICCE, etc. Conventionally, in addition to the communication module 201 and the connection manager 202 to establish a communication connection with the outside world, the mobile phone 200 also includes different types of physical sensors SNS, such as gyroscopes, accelerometers, cameras, touch sensors, etc. These sensors can be used to detect the physical state of the mobile phone or sense external information in real time, thereby enriching the functions and applications of the mobile phone. Figure 2 In the figure, these different types of physical sensors are collectively represented by the 'sensor' box.

[0015] Still Figure 2As shown, the vehicle system 100′ includes a communication module 101 and a mapping management module. In this example, the mapping management module may include a mapping management unit 102 and an interface adapter unit 103. Similar to the mobile phone 200, the communication module 101 includes multiple communication submodules and supports multiple communication protocols, such as Bluetooth, NFC, WiFi, infrared, etc., so as to establish wireless communication with the mobile phone 200 (through the communication module 201) using at least one protocol. In addition, the communication module 101 may also include a wired communication submodule such as a USB module to achieve a wired connection with a mobile phone and other peripherals. According to the present invention, the mapping management module has a communication connection management function, including supporting a variety of mobile phone and car-specific standard protocols developed by the industry, such as ICCOA Carlink protocol, ICCE protocol, etc., so that the vehicle system 100′ can be expanded to apply other peripherals such as services and functions on the mobile phone. According to the present invention, the mapping management module can realize the mapping of the physical sensor in the mobile phone to the virtual sensor on the vehicle side based on the attached sensor information from the mobile phone received by the communication module 101, which is described in detail below.

[0016] According to an example of the present invention, for example, when a user wants to connect a mobile phone 200 to a vehicle system 100′ in a wireless connection mode, the mapping management unit 102 in the vehicle system not only negotiates with the connection manager 202 of the mobile phone to start the wireless link establishment process with the mobile phone according to a wireless communication standard protocol, such as a built-in mobile phone and car interconnection standard protocol, such as ICCOA Carlink (of course, other currently known connection methods such as Bluetooth or WiFi or a combination of Bluetooth and WiFi can also be selected. For the convenience of description, Carlink connection is used as an example in the following description) to start the wireless link establishment process with the mobile phone, but also sends a device sharing authorization request to the mobile phone, such as a sensor sharing request ShareReq in this example. When the connection manager 202 of the mobile phone receives the request ShareReq, it prompts the user whether to allow authorization to share the sensor data in the mobile phone. According to the present invention, the next step of sharing logic can only be performed if the user allows an external connection device, such as a vehicle system, to use sensor data, otherwise the mapping management unit 102 cannot virtualize the corresponding sensor on the vehicle side. According to an example of the present invention, as a sharing permission response ACK to the sharing request ShareReq, the user can also choose to specify which sensors SNS to share with the vehicle system. Thus, the connection manager 202 sends a response ACK to allow sharing to the mapping management unit 102 on the vehicle side, wherein the ACK response includes the sensor information SensorInfo of the sensor (hereinafter referred to as 'SNS') in the mobile phone 200 authorized by the user for sharing, and the sensor information may include information such as the type and identification of the sensor, and also includes the measurement parameters of the sensor, such as the three-axis coordinate parameters of the gyroscope. If the user does not want to share the mobile phone sensor data, the connection manager 202 sends a response NACK to refuse sharing to the mapping management unit 102 according to the user's instructions, so the mapping management unit 102 stops the sharing logic and does not perform the mapping operation of the sensor.

[0017] As an example, after the mapping management unit 102 receives the ACK response transmitted from the connection manager 202 of the mobile phone through the Carlink communication link established between the communication module 101 and the communication module 201 on the mobile phone 200, it determines that the mobile phone user allows the sensor data in the mobile phone to be shared, and therefore executes the following sharing logic to realize the mapping of the physical sensor on the mobile phone to the virtual sensor on the vehicle side. First, the mapping management unit 102 extracts the sensor information SensorInfo from the ACK response. The mapping management unit 102 establishes or installs a virtual sensor (hereinafter referred to as 'vSNS') in the vehicle system 100' for these sensor information SensorInfo. It should be pointed out here that the process of establishing a virtual sensor vSNS in the vehicle system 100' is similar to the process of installing other hardware peripherals in the vehicle system 100' or in the computer system. For example, when a computer is to be connected to a new printer, the necessary installation program is executed so that the new printer is connected to the computer and is "seen" by the computer user, so that the user can use the new printer to perform printing jobs. Therefore, the system device installation and establishment process known in the prior art can be used here to complete the establishment of the virtual sensor vSNS of the present invention, and the sensor information SensorInfo related to the established virtual sensor vSNS can be accessed through the standard application programming interface API allocated to the virtual sensor device. For example, the mapping management unit 102 can establish the virtual sensor vSNS by creating a device file corresponding to each virtual sensor, or by allocating a dedicated memory space for each virtual sensor device to be created in the memory area within the host system 100, and making each memory space correspond to each virtual sensor device one by one, thereby realizing the establishment of the virtual sensor vSNS. Usually, the operating system used by the vehicle system, such as the Android platform, supports multiple types of sensors, and access to the sensors is achieved by using the interface API of the standard sensor. Therefore, according to the example of the present invention, during the process of establishing the virtual sensor vSNS, the interface adaptation unit 103 can adapt the device information of the virtual sensor vSNS, such as the sensor device identification, the sensor parameter data SensorInfo, and the control protocol for the sensor SNS to the standard interface API of the operating system installed in the vehicle computer, such as Android; thereby, the vehicle computer system (including games and other applications running thereon) can utilize the Android sensor framework and, by adopting the standard sensor interface API, realize access to various types of virtual sensors vSNS, including sensor measurement data acquisition, sensor manipulation and other operations.

[0018] According to an embodiment of the present invention, for each type of sensor authorized to be shared by the mobile phone user, a corresponding virtual sensor vSNS can be established respectively. For example, when the mobile phone shares sensor data such as a gyroscope, an accelerometer, and a camera, the mapping management unit 102 can establish virtual gyroscopes, virtual accelerometers, virtual cameras, etc. according to the control protocols followed by the gyroscopes, accelerometers, and cameras (such as the I2C or SPI protocols commonly used by gyroscopes, and the MIPI protocols often used by cameras, etc.). Here, each virtual sensor contains the necessary information for operating the sensor, such as the sensor's identification, parameters, etc. Thus, through these virtual sensor vSNS, each sensor SNS on the mobile phone 200 is mapped to the virtual sensor vSNS on the vehicle system. Therefore, according to the user's indication that the vehicle system allows the use of sensor data, the connection manager 202 in the mobile phone can read the mobile phone sensor data at a certain frequency, or read the latest sensor data by monitoring the sensor data change event and when the sensor data changes, and then use the mobile phone and car interconnection standard protocol such as Carlink to synchronize the sensor data Sensor_data to the virtual sensor in the vehicle system 100′ through the established wireless link.

[0019] In the above embodiment, the user can specify the sensor information that is allowed to be shared after the mobile phone prompts whether to share the sensor data in the mobile phone; but in another embodiment, as a default, the user can only make a decision to allow sharing, and the connection manager 202 in the mobile phone can send all the sensor information in the mobile phone to the vehicle computer, that is, all the sensor data in the mobile phone can be shared by default. In another example, these sensor information SensorInfo can also be selected not to be included in the ACK, but the sensor information SensorInfo is transmitted within a predetermined time period after the ACK is sent to the vehicle computer, and the current sensor measurement data SensorData is optionally included. Therefore, the mapping management unit 102 can further receive SensorInfo within a predetermined time period after receiving the ACK, thereby completing the establishment of the virtual sensor and the data synchronization process.

[0020] It should be pointed out here that in order to achieve network connection and device sharing between mobile phones and vehicle computers, in addition to the sensor parameter information to be shared, it may also be necessary to obtain information necessary to identify the mobile phone during communication, such as type (such as smartphone, tablet computer, etc.) and identification (such as IMEI number, etc.), which will not be discussed here.

[0021] Generally, when an application program, such as a game application Game_App, is designed to be controlled by a handle, the Game_App game is designed to access the standard interface API on the machine device running the game, such as a computer or a mobile phone, to obtain the configuration information of the peripherals configured on the current machine device, such as the handle, including the sensor information such as the gyroscope equipped on the handle. When the game Game_App is started, it will identify the handle equipped with the current game car machine and its related sensor configuration information by scanning the standard interface API of the machine operating system, and thus allow the handle to operate the game. As mentioned above, according to the example of the present invention, when the mapping management unit 102 establishes the virtual sensor vSNS, the interface adapter unit 103 has matched the device information of the relevant virtual sensor vSNS to the standard interface API of the operating system of the car system 100, so that when the game Game_App is started, the standard device interface API of the operating system can also be searched for the virtual sensor vSNS, so it is determined that the car system 100 is 'equipped' with the sensor vSNS, although the real sensor at this time is actually located on the mobile phone 200. Therefore, the game Game_App can access the relevant virtual sensor vSNS through the standard sensor interface API provided by the operating system running on the vehicle computer, so as to obtain the sensor parameter information SensorInfor, including the sensor measurement data Sensor_data synchronized by the connection manager 202 .

[0022] Thus, after the above connection session establishment and virtual sensor creation are completed, whenever the posture of the mobile phone changes, for example, the gyroscope in the mobile phone detects the posture change and generates three-axis coordinate measurement data, such as Figure 2 As shown in the Sensor_data in the figure, the connection manager 202 synchronizes the sensor measurement data Sensor_data to the vehicle system 100' in real time through the communication link established in advance, such as the buffer on the vehicle system, and the mapping management unit 102 uploads the sensor data Sensor_data from the buffer to the virtual sensor vSNS, such as storing it in the device file or dedicated storage space corresponding to the virtual sensor vSNS. According to an example of the present invention, Figure 2As shown, the game Game_App on the vehicle computer accesses the virtual sensor vSNS through the standard sensor interface API to obtain the uploaded sensor data Sensor_data, and analyzes the sensor data Sensor_data to determine the corresponding mobile phone or user status. For example, after scanning the virtual gyroscope and determining that the three-axis measurement data Sensor_data of the gyroscope is received, the game Game_App can process the three-axis measurement data to determine the current posture of the mobile phone 200, such as "tilting to the left", so that Game_App controls the game process according to the "tilting to the left" posture, such as controlling the driving car to turn left. Or, for example, after scanning the virtual camera and determining that the video stream or a series of image frames of the camera are received, Game_App can process the video or image frames to determine the facial expression of the mobile phone user, such as the direction of the eye's line of sight, such as looking to the left, so that Game_App controls the game process according to this line of sight information, such as adjusting the game space to the left.

[0023] Therefore, according to the embodiment of the present invention, by connecting the mobile phone and the vehicle computer through near field communication methods such as WIFI, Bluetooth, NFC and ICCOA Carlink, the sensor SNS in the mobile phone that acts as a game handle can be virtualized to the vehicle computer side, and by synchronizing the data of the mobile phone sensor SNS to the virtual sensor vSNS of the vehicle computer in real time, the game application Game_App on the vehicle computer can directly drive the game operation based on the received sensor measurement data Sensor_data. Therefore, the mobile phone does not need to install any handle driving application such as Handle_App, and only needs to directly transmit the sensor measurement data to the vehicle computer system, thereby simplifying the operation burden of the mobile phone; and the application on the vehicle computer system, such as the game Game_App, completes the recognition of the mobile phone posture and the corresponding different control logic based on the received sensor measurement data Sensor_data, such as the mobile phone tilting to the left indicates the direction of left operation, the mobile phone tilting to the right indicates the direction of right operation, the front end of the mobile phone is raised to indicate the direction of forward operation, and the front end of the mobile phone is lowered to indicate the direction of backward operation, etc. Compared with conventional solutions, since the solution of the present invention transmits sensor measurement data rather than game control instructions between the mobile phone and the vehicle system, it greatly facilitates the scalability of different game applications and saves storage space of the mobile phone.

[0024] In the above examples, the mobile phone and its attached sensors are used as shared devices of the host system for illustration, but it is obvious that the present invention is not limited to sharing mobile phones or sensors in mobile phones, but can also be other external devices or other attached devices therein, such external devices can be other mobile terminals such as tablet computers, notebooks and game consoles, universal game controllers or joysticks, smart mice, digital cameras, pen input devices, etc., and the attached devices can be any components with information perception functions configured in these external devices. The host system according to the present invention can receive the attached device information from the external device, and establish a virtual device based on the attached device information to map the attached device of the external device, thereby realizing the control of device virtualization at the host system.

[0025] Figure 3 A control method for realizing cross-device sensor virtualization on a vehicle computer according to an example of the present invention is shown, and the following is explained based on the example of virtualizing a mobile phone as a game controller. As shown in the figure, in step 301, the mobile phone 200 attempts to establish a network connection with the vehicle computer 100′, for example, using the Carlink protocol to establish a wireless (such as WiFi, Bluetooth, etc.) communication link. Here, the connection establishment between the mobile phone and the vehicle computer includes conventional authentication and other operations, and after the authentication is passed, a communication link is established between the vehicle system 100′ and the mobile phone 200. It should be pointed out here that the initiation of the network connection can be initiated by Game_App when starting an application on the vehicle system, such as Game_App, in order to find available peripherals, such as a game controller; or it can be initiated by the mobile phone user to actively initiate a network connection, such as a Carlink connection, in order to establish a connection with the vehicle system to use vehicle equipment such as speakers or share mobile phone devices for subsequent use.

[0026] In step 303, during or after the network connection is established, a device sharing authorization request, such as a sensor sharing request ShareReq, is sent to the mobile phone to request the mobile phone user to allow sharing of the mobile phone device including the attached sensor SNS thereon.

[0027] In step 305, the user's response to the sensor sharing request ShareReq is received from the mobile phone, and it is determined whether the user allows the sharing of sensor data. If the user does not want to share the mobile phone sensor data, that is, the response NACK for refusing sharing is received, the sharing logic is stopped and the mapping operation of the sensor will not be performed. If the response ACK for allowing sharing is received in step 305, the process proceeds to step 307 to execute the sharing logic. As an example, the received response ACK for allowing sharing includes the sensor information SensorInfo of the sensor SNS in the mobile phone authorized by the user to share, such as the type, identification and other information of the sensor, and also includes the measurement parameters of the sensor, such as the three-axis coordinate parameters of the gyroscope.

[0028] In step 307, the sensor information SensorInfo is extracted from the ACK response, and a virtual sensor vSNS is established or installed on the vehicle computer. For example, a corresponding virtual sensor vSNS can be established for each type of sensor SNS. For example, when the mobile phone shares sensor data such as a gyroscope, accelerometer, and camera, a virtual gyroscope device file, a virtual accelerometer device file, a virtual camera device file, etc. can be established respectively; optionally, a corresponding memory partition mapping can also be established for each virtual sensor in the memory area of ​​the system.

[0029] Then, in step 309, the sharable sensor device information, such as the sensor information SensorInfo of the corresponding sensor, the control protocol dedicated to each type of sensor, etc., is matched to the standard interface API of the operating system loaded in the vehicle system 100′, so as to allow the system or application, such as the game application Game_App, to determine that the vehicle system 100′ is 'equipped' with sensors vSNS such as gyroscopes, accelerometers, and cameras by calling these standard interface APIs, and can access various types of virtual sensors vSNS, including sensor measurement data acquisition, sensor manipulation and other operations, thereby realizing the virtualization of the sensor SNS in the mobile phone 200 to the vehicle 100′, so that the application Game_App on the vehicle 100′ can use these virtualized sensors vSNS to realize the control of the Game_App application by the mobile phone. Figure 4 The following is a flow chart of a control method using a mobile phone as a game controller according to an example of the present invention.

[0030] As mentioned above, after the virtual sensor vSNS on the host system is established, in step 401, the game Game_App detects the accessory device information configured on the current vehicle computer 100′ by calling the standard interface API of the operating system when it is started, so that it can be identified that the current vehicle computer is equipped with a virtual sensor vSNS, such as a virtual gyroscope, a virtual accelerometer, etc., and thus allows the game to operate based on these sensors.

[0031] When the user controls the game through the mobile phone, for example, when the mobile phone is 'turned left', according to the mobile phone-vehicle interconnection protocol, the mobile phone will synchronize the sensor measurement parameters Sensor_data to the vehicle system, such as the three-axis coordinate parameters related to 'turning left' detected by the gyroscope. Therefore, in step 403, the vehicle 100' receives the sensor measurement parameters Sensor_data in real time through the communication link established in advance, and maps them to, for example, the virtual sensor device vSNS, for example, after receiving the three-axis coordinate parameters related to 'turning left', write them to the virtual gyroscope device file or the corresponding storage space; or after receiving the image or video data, write them to the virtual camera device file or the corresponding storage space.

[0032] In step 405, the sensor data Sensor_data is processed to determine the corresponding mobile phone or user status. For example, after scanning the virtual gyroscope and determining that the three-axis measurement data of the gyroscope is received, the game application Game_App can determine the current posture of the mobile phone 200 based on the three-axis measurement data, such as "turn left", so that Game_App controls the game process according to the parsed "turn left" posture information, such as controlling a moving car to turn left. For another example, after scanning the virtual camera and determining that the image or video data is received, the current line of sight direction of the mobile phone user can be determined by processing the data, and then Game_App can control the line of sight direction to control the game.

[0033] Although the exemplary equipment and methods of the present invention are described above in conjunction with specific examples, it is understood that the modules disclosed herein may include processors, electronic devices, hardware devices, electronic components, logic circuits, memories, software codes, firmware codes, etc., or any combination thereof. It will also be appreciated by the technician that the various illustrative logic blocks and method steps described in conjunction with the disclosure herein may be implemented as electronic hardware, computer software, or a combination of the two. Moreover, the equipment or apparatus according to the present invention may be implemented as a processor and a memory, wherein the memory stores a computer program, wherein the processor may implement each module, unit, and method step by executing the computer program. In addition, a machine-readable medium provided in another embodiment of the present invention stores a machine-readable instruction, which, when executed by a processor, causes the processor to execute any of the aforementioned methods disclosed herein.

[0034] The present invention is shown and described in detail above through the accompanying drawings and preferred embodiments. However, the present invention is not limited to these disclosed embodiments. Based on the above multiple embodiments, those skilled in the art can know that the code review methods in the above different embodiments can be combined to obtain more embodiments of the present invention, and these embodiments are also within the protection scope of the present invention.

Claims

1. A vehicle system, include: a communication module configured to receive accessory device information from an external device; The mapping management module is configured to establish a virtual device in the vehicle system based on the accessory device information to map the accessory device of the external device.

2. The vehicle system as claimed in claim 1, in: The accessory device information includes sensor information of one or more sensors in the external device; as well as The mapping management module further includes: A mapping management unit, configured to establish one or more virtual sensors in the vehicle computer for mapping to the one or more sensors according to the sensor information; The interface adapter unit is configured to match the one or more virtual sensors to a standard application interface of the vehicle system.

3. The vehicle system of claim 2, wherein the communication module receives sensor information of the one or more sensors in response to a device sharing request allowing sharing of the one or more sensors in the external device; and The mapping management unit is further configured to establish the virtual sensor through the following process: establishing a virtual sensor corresponding to each of the one or more sensors by creating a virtual sensor device file, or A virtual sensor corresponding to each of the one or more sensors is established by allocating a dedicated storage space.

4. A vehicle system as claimed in claim 2 or 3, wherein the interface adapter unit matches the virtual sensor to the standard application interface of the operating system running on the vehicle system according to the control protocol of the one or more sensors to achieve access to the virtual sensor through the standard application interface.

5. The vehicle system as claimed in claim 4, in, The mapping management unit synchronizes the virtual sensor in response to the measurement data of the one or more sensors received in real time by the communication module.

6. The vehicle system as claimed in claim 5, further comprising: include: An application program, wherein the application program scans a standard application interface of the operating system when running to access the one or more virtual sensors, including obtaining measurement data from the one or more sensors.

7. The vehicle system as claimed in claim 6, wherein the external device includes a mobile terminal, the application includes a game application, and the established communication includes near field communication, at least one of Bluetooth, WiFi, infrared, ICCOA Carlink, and ICCE.

8. The vehicle system of claim 6, wherein the application processes the acquired measurement data to resolve the posture and / or motion of the mobile communication device, wherein the application controls the program process based on the resolved posture and / or motion.

9. A control method for device virtualization, include: receiving accessory device information from an external device; Based on the accessory device information, a virtual device is established to map the accessory device of the external device.

10. The control method of claim 9, wherein the accessory device information includes sensor information of one or more sensors in the external device; The establishing of a virtual device to map the auxiliary device of the external device further comprises: For the sensor information, establish one or more virtual sensors to map to the one or more sensors; The one or more virtual sensors are matched to a standard application interface to enable access to the virtual sensors through the standard application interface.

11. The control method according to claim 10, wherein the virtual sensor is established include: establishing a virtual sensor corresponding to each of the one or more sensors by creating a virtual sensor device file, or A virtual sensor corresponding to each of the one or more sensors is established by allocating a dedicated storage space.

12. The control method according to claim 10 or 11, wherein the external device comprises a mobile terminal, the method further comprising: include: Synchronizing the measurement data of the one or more sensors received in real time to the one or more virtual sensors; The standard application interface is scanned to obtain the measurement data from the virtual sensor.

13. The control method according to claim 12, further comprising: include: Determining the posture and / or motion of the mobile terminal based on the sensor measurement data; Based on the gestures and / or movements, process control instructions for the application are generated.

14. A vehicle system, comprising at least one controller, wherein the controller can be programmed to implement the control method of any one of claims 9 to 13.

15. A computing device, include: a memory storing a computer readable program; At least one processor is configured to execute the computer readable program to implement the control method of any one of claims 9-13.

Images