Very tiny intelligent device and method for running operating system

Abstract

The application provides a very micro intelligent device and a method for operating a system, comprising: a system on chip (SoC) which is internally provided with a preset operating system; an interface module which is electrically connected with the system on chip (SoC), and the system on chip (SoC) transmits data with an external host device through the interface module; and a storage module which is electrically connected with the system on chip (SoC); wherein the operating system interacts with a user through an input / output device of the host device. The application completely encapsulates the operating system in an independent hardware device, realizes real physical isolation, and completely eliminates the security risks caused by hardware resource sharing.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of operating systems, and in particular, to a very micro intelligent device and a method for running an operating system. BACKGROUND

[0002] With the popularity of mobile Internet and the widespread use of smart terminals, mobile devices such as smartphones, tablets, etc. have become the main carriers of personal privacy and sensitive data. These devices have a large amount of personal information, financial data, work materials, etc. However, due to technical and cost limitations, it is still a challenge to completely isolate and protect these privacy and sensitive data.

[0003] To solve this technical problem, the market technology research and development route is as follows:

[0004] (1) Dual system or multi-system solution:

[0005] For example, patent document CN111464509A discloses a network security isolation system for dual processing systems, which deploys two or more operating systems in the same mobile device, one for work and the other for personal life. The advantage of this solution is that it achieves partial isolation of data through the software layer, but since these systems share the same hardware resources (such as CPU, memory, storage, etc.), there is still a risk of information leakage when facing malicious attacks or system vulnerabilities. The security isolation is not complete and cannot completely eliminate data cross-contamination.

[0006] (2) U disk start operating system:

[0007] For example, patent document CN101840477A discloses a method for mobile operating system office, which usually places the image file of Windows or other operating systems in a U disk, and the user starts the operating system by inserting the U disk. The advantage of this solution is that it can run an independent operating system on the host computer without affecting the data security of the host system. However, this method reuses most of the host's resources (such as CPU, memory, network, etc.), which has poor security and is difficult to support mobile terminals (mobile devices do not support starting the operating system from external devices).

[0008] (3) Cloud terminal solution:

[0009] For example, the patent document CN103067500A discloses a webpage browsing method based on a cloud terminal. The cloud terminal hosts data and application programs on a cloud server. A user only runs a client on a mobile device. All operations are completed remotely through a network. This method achieves good data isolation because all calculations and storage are in the cloud. However, its disadvantages are poor user experience, especially when the network is unstable or has high latency. The operation is lagging and slow to respond, which cannot meet the daily use requirements of users.

[0010] Therefore, the prior art cannot guarantee the security of private data while considering the efficiency and convenience of the device. SUMMARY

[0011] In view of the defects in the prior art, the purpose of the present application is to provide a very micro intelligent device and a method for running an operating system.

[0012] According to the present application, a very micro intelligent device is provided, comprising:

[0013] A system on chip (SoC) with a pre-installed operating system;

[0014] An interface module electrically connected to the system on chip (SoC), which transmits data with an external host device through the interface module;

[0015] A storage module electrically connected to the system on chip (SoC);

[0016] The operating system interacts with the user through the input / output device of the host device.

[0017] Further, the host device includes a display screen, and the operating system provides a visual graphical user interface through the display screen.

[0018] Further, the very micro intelligent device further includes any one or any multiple components: a battery module, a display screen, a WIFI module, a cellular communication module, a Bluetooth module, a microphone, a speaker, a camera, or a sensor.

[0019] Further, the host device further includes any one or any multiple components: a battery module, a WIFI module, a cellular communication module, a Bluetooth module, a microphone, a speaker, a camera, or a sensor.

[0020] The very micro intelligent device shares the components through the interface module.

[0021] Further, the interface module includes a USB module.

[0022] The system on chip (SoC) interacts with an external host device through the interface module and obtains power from the host device.

[0023] Further, after the very micro smart device establishes a connection with the host device, the very micro smart device first detects the peripherals configured on the very micro smart device and the host device, obtains the peripheral configuration information of both sides, and selects the peripherals according to the peripheral configuration information of both sides.

[0024] Further, the selection method comprises: in the case that the very micro smart device itself does not have peripherals of a required type, selecting the peripherals corresponding to the host device.

[0025] And in the case that both sides have peripherals of the required type, comparing the performance parameters of the peripherals of both sides, and selecting the peripherals with better performance parameters according to the comparison result.

[0026] Further, during the running of the very micro smart device, when sound needs to be played, the loudspeaker of the host device is used for sound playing.

[0027] When network communication is needed, the WIFI module or the cellular communication module of the host device is used for network communication.

[0028] When sound needs to be collected, the microphone of the host device is used for sound collection.

[0029] When image and video need to be collected, the camera of the host device is used for image and video collection.

[0030] When GPS and sensor data are needed, the GPS and sensor of the host device are used for data collection.

[0031] According to the method for running an operating system on the very micro smart device provided by the application, the method comprises the following steps.

[0032] The host device is installed with client software for controlling the running of the operating system.

[0033] When the interface module is connected to the host device, the operating system is started.

[0034] The operating system encodes and compresses the required transmission content into data packets and transmits the data packets to the client software through the interface module, and the client software decompresses and decodes the data packets and outputs the data packets through the host device.

[0035] The client software sends control instructions according to the operation of a user, and the control instructions are transmitted to the operating system through the interface module to control the operating system.

[0036] Further, the client software comprises a resolution adaptation module;

[0037] The resolution adaptation module compares the preset resolution of the operating system and the resolution of the host device. When the preset resolution of the operating system and the resolution of the host device are the same, the interface of the operating system is normally displayed. When the preset resolution of the operating system and the resolution of the host device are different but the proportion is the same, the resolution of the operating system is enlarged or reduced in proportion to the resolution of the host device. When the preset resolution of the operating system and the resolution of the host device are different and the proportion is not the same, the resolution of the operating system is enlarged or reduced in proportion to the resolution of the host device based on the smaller width or height of the resolution of the host device, the other side is displayed in the center of the screen, and the excess part is displayed as a black border.

[0038] Further, the client software comprises a coordinate conversion module;

[0039] The display of the host device comprises a touch screen.

[0040] When the preset resolution of the operating system and the resolution of the host device are different, the coordinate conversion module converts the screen touch point coordinates of the host device into the touch point coordinates of the operating system.

[0041] Further, the coordinate conversion module compares the preset resolution of the operating system and the resolution of the host device. When the preset resolution of the operating system and the resolution of the host device are the same, the touch point coordinates of the operating system and the touch point coordinates of the host device are the same. When the preset resolution of the operating system and the resolution of the host device are different but the proportion is the same, the touch point coordinates of the host device are enlarged or reduced in proportion. When the preset resolution of the operating system and the resolution of the host device are different and the proportion is not the same, the touch point coordinates of the host device are enlarged or reduced in proportion based on the smaller width or height of the resolution of the host device, and the other side is displayed in the center of the screen after being enlarged or reduced in proportion. The excess part is displayed as a black border, and the excess part is removed in the corresponding touch point coordinate calculation.

[0042] Further, after the operating system is started, the very micro smart device and the host device establish a data connection through the interface module.

[0043] The operating system encodes and compresses audio and video data into data packets for transmission.

[0044] Further, the operating system comprises upper-layer application software, a hardware abstraction layer, and a virtualization device driver.

[0045] When the upper layer application software needs to use the input / output device of the host device during running, a request is initiated to the virtualization device driver of the operating system through the hardware abstraction layer, and the virtualization device driver transmits the request to the client software of the host device through the interface module, and the client software completes the corresponding function through the driver of the host device and the input / output device.

[0046] Further, after the very micro smart device establishes a connection with the host device, the very micro smart device first detects the peripherals configured on itself and the host device, obtains the peripheral configuration information of both sides, and selects the peripherals according to the peripheral configuration information of both sides.

[0047] Further, the selection method comprises: in the case that the very micro smart device itself does not have the required type of peripheral, selecting the peripheral corresponding to the host device;

[0048] and in the case that both sides have the required type of peripheral, comparing the performance parameters of the peripherals of both sides, and selecting the peripheral with better performance parameters according to the comparison result.

[0049] Further, when the very micro smart device needs to play sound during running, the operating system initiates a network connection request to the virtualization device driver through the hardware abstraction layer, and sends the network connection request to the client software through the data transmission channel of the interface module, and the client software uses the loudspeaker of the host device to play sound;

[0050] When network communication is needed, the operating system initiates a network connection request to the virtualization device driver through the hardware abstraction layer, and sends the network connection request to the client software through the data transmission channel of the interface module, and uses the WIFI module or the cellular communication module of the host device to perform network communication;

[0051] When sound needs to be collected, the operating system initiates a network connection request to the virtualization device driver through the hardware abstraction layer, and sends the network connection request to the client software through the data transmission channel of the interface module, and uses the microphone of the host device to collect sound;

[0052] When image and video need to be collected, the operating system initiates a network connection request to the virtualization device driver through the hardware abstraction layer, and sends the network connection request to the client software through the data transmission channel of the interface module, and uses the camera of the host device to collect image and video;

[0053] When GPS and sensor data are needed, the operating system initiates a network connection request to the virtualization device driver through the hardware abstraction layer, and sends the network connection request to the client software through the data transmission channel of the interface module, and uses the GPS and sensor of the host device to collect data.

[0054] Compared with the prior art, the application has the following beneficial effects:

[0055] Compared with the existing dual-system or multi-system technical solutions, the application realizes real physical isolation by completely encapsulating the operating system in an independent hardware device, and completely eliminates the security risks caused by hardware resource sharing.

[0056] The application independently operates and does not depend on the CPU, memory or storage of the host computer, thereby ensuring the security of data processing.

[0057] The application simplifies the device structure, reduces the weight, and ensures the integrity of the functions, thereby solving the problems of inconvenient carrying and management of the device, limited user experience, high cost and maintenance, and complex upgrading. BRIEF DESCRIPTION OF DRAWINGS

[0058] Other features, objects and advantages of the application will become more apparent after reading the detailed description of non-limiting embodiments with reference to the following drawings:

[0059] Figure 1 Fig. 1 is a schematic diagram of an overall architecture of the application;

[0060] Figure 2 Fig. 2 is a schematic diagram of internal connection of a very small smart device;

[0061] Figure 3 Fig. 3 is another schematic diagram of an overall architecture of the application. DETAILED DESCRIPTION

[0062] The application will be described in detail below with reference to specific embodiments. The following embodiments will help those skilled in the art to further understand the application, but do not limit the application in any form. It should be pointed out that, for those skilled in the art, without departing from the concept of the application, a number of changes and improvements can be made. These all belong to the protection scope of the application.

[0063] Example 1

[0064] As Figure 1 and Figure 2As shown, the present application provides a very micro intelligent device, which is in the form of a portable device such as a U disk, and internally includes a system on chip (SoC), an interface module, and a storage module. The very micro intelligent device is built-in with a preset operating system, which can be an Android system, or other versions or types, such as Linux, Hong Meng, Ubuntu, etc., to further expand the application range and support more application scenarios. After the device is connected to an external host device through the interface module, a complete operating system can be independently run on the very micro intelligent device, and the interface of the operating system can be displayed on the host device. The operating system can be run through simple plug-in operation, which simplifies the operation process of the user. The very micro intelligent device does not rely on the CPU, GPU, memory or storage resources of the host device during use, and all calculations, data processing and storage are completed inside the device, but the input / output devices of the host device can be shared, so that the operating system and the host device are completely isolated in a low-cost and highly portable manner, ensuring the security of data and the stability of the system.

[0065] In the present application, the system on chip (SoC) is preferably a high-performance low-power SoC as the central processing device, and the storage module can include memory and flash memory, etc., to meet the data storage needs of different users. The interface module can adopt a USB module, such as USB 3.x, USB4, etc. High-speed data exchange standards are supported to quickly transfer multimedia files and other large data sets, and the very micro intelligent device can also be powered by the host device. The user only needs to connect the device to the host device (such as a smart phone, tablet computer or computer) to start using it. The host device includes a display screen (which can be a touch screen), and the operating system provides a visual graphical user interface through the display screen of the host device.

[0066] As shown in the drawings, Figure 3As shown, in addition to the basic SoC, storage module and interface module, other non-core hardware components can be flexibly selected according to specific application scenarios. In order to better realize the normal operation of the operating system, guarantee the complete function application, and provide a better user interaction experience, the very small smart device can also include the core components of the mobile device such as the battery module, WIFI module, cellular communication module, microphone, speaker, camera, various sensors, etc. Based on the scene needs, the very small smart device adds one or more core components of the mobile device, such as the very small smart device needs independent power supply, and does not obtain power supply from the host device, then the very small smart device can include a battery module, and the battery module is electrically connected with the Soc, if a separate cellular communication module is needed for communication, the very small smart device can include a cellular communication module. In order to reduce the size of the very small smart device and maximize portability, the battery module, WIFI module, cellular communication module, microphone, speaker, camera, various sensors and other core components can fully utilize the existing peripherals of the host device, and the very small smart device shares the above core component peripherals of the host device. Various sensors include light sensors, GPS sensors, distance sensors, gravity sensors, accelerometers, gyroscopes, barometers, magnetic field sensors and other common sensors commonly used in smart phones.

[0067] The application realizes the independence of the device running the operating system, uses independent system-on-chip SoC, interface module and storage module, and preinstalls a complete operating system, can not depend on the computing and data processing resources of the host device, independently protects user privacy and sensitive data, and shares the battery module, WIFI module, cellular communication module, microphone, speaker, camera and other various types of sensors and other hardware resources with the host device through USB communication and power supply, fully utilizes the existing core peripherals of the host device, simplifies the device structure, reduces the weight, and guarantees the completeness of the function, solves the problems of inconvenient carrying and management of the device, limited user experience, high cost and maintenance, and complex upgrading.

[0068] Embodiment 2

[0069] The application also provides a method for running an operating system on the very small smart device, comprising:

[0070] The very small smart device adopts the device of embodiment 1, and the host device installs client software for controlling the operation of the operating system and realizing the interaction between the very small smart device and the host device. The installation package of the corresponding client software is packaged differently for different operating system platforms, such as an exe file for a windows system, an apk file for an Android system, etc.

[0071] After the interface module is connected to the host device, the host device recognizes the device through the interface module and provides power supply, and then the user can wait for the start of the operating system of the very micro smart device through the client software. The very micro smart device and the host device establish a data connection through the interface module. After the start is successful, the operating system of the very micro smart device is displayed on the screen of the host device. The very micro smart device and the host device establish an audio and video connection channel through the interface module. The interface image or video of the operating system is compressed and encoded into a data packet and transmitted to the host device end through the audio and video connection channel at a self-defined frequency. After the host device obtains the data packet, the client software decodes and decompresses the data packet to restore it to an image or video picture, which is visualized and displayed on the host device. In addition, in order to improve the display quality, the client software also includes a resolution adaptive module to ensure that the operating system interface can be correctly displayed regardless of the size of the screen of the host device itself.

[0072] When the screen of the host device visualizes the operating system picture of the very micro smart device, the user operates the operating system on the very micro smart hardware device using the screen touch information of the host device. The client software obtains the screen touch information of the host device and transmits the data packet of the screen touch information to the very micro smart device through the data connection channel at a self-defined frequency. The very micro smart device issues control instructions according to the screen touch information and executes them, thereby realizing user interaction to control the operating system.

[0073] The self-defined frequency can be set according to time, such as 1ms, etc. The compression and encoding technology used can be H.264 or H.265, etc. These encoding technologies can compress high-definition audio and video signals into smaller data packets, thereby reducing the amount of data transmission.

[0074] The operating system interface of the very micro smart device can be pre-set with a self-defined fixed resolution. Since the host device terminal is diversified, it can be a smart phone, a tablet computer or a computer, etc. When the resolution of the very micro smart device is different from that of the host device, there is a problem of incomplete or unequal proportion of screen display. The client software has a resolution adaptive module built-in, which provides optimized screen display to ensure that the screen of the host device displays the operating system interface of the very micro smart device in an un-deformed and optimal display manner.

[0075] The resolution adaptive module compares the preset resolution of the operating system and the resolution of the host device. When the resolutions are the same, the operating system interface is displayed normally. When the resolutions are different but the ratio is the same, the operating system resolution is proportionally enlarged or reduced. When the resolutions are different and the ratios are different, the resolution of the operating system is proportionally enlarged or reduced based on the smaller width or height of the host device resolution, and the other side is displayed in the center. The excess part is displayed as black borders on the top and bottom or left and right sides of the screen. For example, if the preset fixed resolution of the operating system is 1920*1080, if the screen resolution of the host device is 1920*1080, the operating system interface will be displayed normally. If the screen resolution of the host device is 3840*2160, the resolution adaptive module will change the resolution of the operating system to 3840*2160 and display it on the screen of the host device. If the screen resolution of the host device is 2048*1080, the resolution of the operating system will still be 1920*1080, but when the operating system interface is displayed on the host device screen, there will be a black border of (2048-1920) / 2=64 pixels on the left and right of the host device screen. If the screen resolution of the host device is 1920*960, the resolution of the operating system will be proportionally reduced to 1707*960 by the adaptive module, and then displayed in the center of the host device screen. There will be a black border of (1920-1707) / 2=106.5 pixels on the left and right of the host device screen.

[0076] The client software of the host device can also obtain the screen touch information of the host device, and transmit the data packets of the screen touch information to the operating system of the very micro smart device through the data connection channel at a custom frequency. The operating system of the very micro smart device issues control instructions based on the screen touch information and executes them, thereby realizing user interaction.

[0077] The screen touch information acquired by the client software is screen touch point coordinates, and the coordinate values are expressed in pixels. The client software is internally provided with a coordinate conversion module. When the preset resolution of the operating system and the resolution of the host device are different, the coordinate conversion module converts the screen touch point coordinates of the host device into touch point coordinates of the operating system. The coordinate conversion module compares the preset resolution of the operating system and the resolution of the host device. When they are the same, the touch point coordinates of the operating system and the touch point coordinates of the host device are the same. When they are different but the proportions are the same, the touch point coordinates of the host device are enlarged or reduced at the same proportion to be converted into the touch point coordinates of the operating system. When the resolution and the resolution proportion are both different, the smaller width or height of the resolution of the host device is taken as the reference, and the corresponding width or height of the operating system is enlarged or reduced at the same proportion. The multiple of the enlargement or reduction is the multiple of the enlargement or reduction of the touch point coordinates of the host device. The other side displays a black border after the center display of the screen, and the excess part is removed in the calculation of the corresponding touch point coordinates, so as to ensure the accuracy of the position information of the screen touch point coordinates and realize accurate user interaction. For example, the preset fixed resolution of the operating system is 1920*1080, and the acquired screen touch point coordinate value of the host device is (1000, 500). If the screen resolution of the host device is 1920*1080, the touch point coordinate value of the operating system is the same, and the touch point coordinate value of the operating system is (1000, 500). If the screen resolution of the host device is 3840*2160, the touch point coordinate value of the operating system is reduced by one, and the touch point coordinate value of the operating system is changed to (500, 250). If the screen resolution of the host device is 2048*1080, through the coordinate conversion module, the value of the horizontal coordinate is 1000-(2048-1920) / 2=936, and the touch point coordinate value of the operating system is changed to (936, 500), so as to ensure the correct position of the touch point coordinates acquired by the operating system.

[0078] The operating system of the very micro smart device comprises upper layer application software, a hardware abstraction layer (HAL) and a virtualized device driver. The upper layer application software is various APPs commonly used by users. The hardware abstraction layer (HAL) is a software layer between the runtime environment of the operating system and the hardware device driver, and is a bridge connecting the upper layer software and the hardware device. The HAL describes the hardware functions available to the upper layer application software, and provides a consistent interface for the upper layer software, allowing the upper layer software to interact with the hardware that hides the specific implementation details. The virtualized device driver is a hardware device driver simulated in a virtualized environment created in the operating system. The operating system provides virtualized device capabilities to the upper layer application software through the HAL layer, and shares the hardware peripheral component resources of the host computer to the upper layer application software through the HAL layer. When the upper layer application software of the operating system needs to use the corresponding peripheral resources during operation, the HAL layer initiates a request to the virtualized device driver. After receiving the request, the virtualized device driver transmits the request to the client software of the host device through the interface module. The client software completes the corresponding function through the driver program of the host device and the hardware. After the hardware device completes the corresponding function operation, the client software returns the execution result to the virtualized device driver of the operating system through the interface module. The virtualized device driver encapsulates the execution result into a format that can be understood by the upper layer application software, and returns the execution result to the upper layer application software through the HAL layer, thereby directly and efficiently using the hardware peripheral component resources of the host computer, while ensuring the compatibility of various upper layer application software. During the operation of the operating system of the very micro smart device, if the application software needs to play sound, the host device speaker can be used to play sound through the interface module. If the application needs to use network functions such as browsers, the host device WIFI module or cellular network can be used for network communication. If sound collection is needed, the host device microphone can be used to collect sound data. If applications such as photography and video shooting are used, the host device camera can be used to collect image or video data. If applications that use part of the GPS and sensor data are used, the host device GPS and sensor can be used to collect data.

[0079] The embodiment realizes independent operation of a complete operating system with minimal hardware devices, realizes complete isolation of privacy and sensitive data at a low cost, and can ensure the security of data and the stability of the operating system. A unified security solution across platforms is provided, which can not only be used in mobile terminals, but also can be run on traditional computing devices (such as notebook computers and desktop computers), and meets the needs of different application scenarios.

[0080] Embodiment 3

[0081] As Figure 3As shown, the very micro smart device itself can also be configured with the required peripherals, and the technician can select and configure according to the actual situation. If the very micro smart device is configured with one or more of the battery module, WIFI module, cellular communication module, microphone, speaker, camera, sensor, and other components, when the very micro smart device uses network, audio and video data, location information, sensor, and other data interaction, the operating system can directly use the peripherals of the very micro smart device itself, and if the host device is also configured with one or more of the battery module, WIFI module, cellular communication module, microphone, speaker, camera, sensor, and other components, the operating system can select between the peripherals of the very micro smart device and the peripherals of the host device. Specifically, it can be detected whether the device itself has corresponding peripherals, and if not, the shared host device peripherals are used. After the very micro smart device establishes a connection with the host device, it first detects the peripherals configured on itself and the host device, obtains the peripheral configuration information of both parties, and selects peripherals according to the peripheral configuration information of both parties. The selection strategy is as follows: (1) in the case where the very micro smart device itself does not have the required type of peripherals, the peripherals corresponding to the host device are selected; (2) in the case where both parties have the required type of peripherals, the performance parameters of the peripherals of both parties are compared, and the peripheral with better performance parameters is selected according to the comparison result, achieving better user experience and functional application.

[0082] 1. During the operation of the operating system of the very micro smart device, if an application requires sound playback, the speaker of the host device can be used for sound playback.

[0083] During the operation of the operating system of the very micro smart device, if sound playback is required, the upper-layer application software issues a corresponding sound playback request, which is initiated to the virtualization device driver through the HAL layer. After receiving the sound playback request, the virtualization device driver transmits the sound playback request to the client software of the host device through the data connection channel of the interface module. The operating system of the very micro smart device compresses and encodes the sound data into data packets and transmits them to the host device at a self-defined frequency through the audio and video connection channel. The host device obtains the data packets through the audio and video connection channel, and decodes and decompresses the audio data of the data packets through the client software, and then plays the audio data using the speaker of the host device.

[0084] The self-defined frequency can be in units of time, such as 1 ms, etc.

[0085] 2. During the operation of the operating system, if an application requires network functions such as a browser, the WIFI module or cellular communication module of the host device can be used for network communication.

[0086] When the operating system of a very micro smart device is running, when a network function application is used, the operating system initiates a network connection request to the virtualized device driver through the HAL layer, and sends it to the client software through the data transmission channel of the interface module. The client software uses the WIFI module of the host device or the mobile network to establish a connection with the server. After the connection is established, the host device uses the TCP to send or receive message data. The message data sent by the host device comes from the upper-level application software data of the operating system of the very micro smart device transmitted via the data transmission channel. The message data received by the host device is sent to the upper-level application software of the operating system of the very micro smart device via the data transmission channel, thereby enabling the operating system of the very micro smart device to use the WIFI module or mobile network of the host device for network communication.

[0087] 3. During the operation of the operating system of the micro-intelligent device, if sound collection is required, the microphone of the host device is used to collect sound data.

[0088] During the operation of the operating system of a very micro smart device, if an upper-layer application software needs to collect sound, the upper-layer application software will issue a corresponding sound collection request, and initiate a sound collection request to the virtualization device driver through the HAL layer. After receiving the sound collection request, the virtualization device driver will transmit the sound collection request to the client software of the host device through the data connection channel of the interface module. After the client software collects sound data through the microphone of the host device, it compresses and encodes the sound data into a data packet, and transmits it to the virtualization device driver of the operating system of the very micro smart device through the audio and video connection channel at a custom frequency. The virtualization device driver then decodes and decompresses the audio data of the data packet and encapsulates it into a format that the upper-layer application software can understand, and returns it to the upper-layer application software through the HAL layer to complete the sound data collection function.

[0089] 4. During the operation of the operating system of a very micro-intelligent device, applications such as those using photography and video recording functions use the camera of the host device to collect image or video data.

[0090] In the running process of the operating system of the very micro intelligent device, if the upper-layer application software needs to collect image or video data, the upper-layer application software sends a corresponding image or video data request, and initiates the image or video data request to the virtualization device driver through the HAL layer. After receiving the image or video data request, the virtualization device driver transmits the image or video data request to the client software of the host device through the data connection channel of the interface module. After the client software collects the image or video data through the camera of the host device, the client software compresses and encodes the image or video data into a data packet, and transmits the data packet to the virtualization device driver of the operating system of the very micro intelligent device through the audio / video connection channel at a self-defined frequency. The virtualization device driver decodes and decompresses the image or video data of the data packet, encapsulates the image or video data into a format that can be understood by the upper-layer application software, and returns the image or video data to the upper-layer application software through the HAL layer, thereby completing the image or video data collection function.

[0091] 5. In the running process of the operating system of the very micro intelligent device, if part of the GPS and sensor data is used, the GPS and sensor data of the host device are collected.

[0092] In the running process of the operating system of the very micro intelligent device, if the upper-layer application software needs GPS or sensor data, the upper-layer application software sends a corresponding request, and initiates the request to the virtualization device driver through the HAL layer. After receiving the request, the virtualization device driver transmits the request to the client software of the host device through the data connection channel of the interface module. The client software obtains the corresponding data collected by the sensor device of the host device, compresses and encodes the data into a data packet, and sends the data packet to the virtualization device driver of the operating system of the very micro intelligent device through the data connection channel. The virtualization device driver decodes and decompresses the data packet, encapsulates the data into a format that can be understood by the upper-layer application software, and returns the data to the upper-layer application software through the HAL layer. The upper-layer application software obtains the corresponding GPS or sensor data.

[0093] The embodiment provides the user with more choices. If one or more core components are added to the very micro intelligent device due to special needs, the user can dynamically and flexibly select whether to use independent peripherals or to reuse the peripherals of the host device, thereby further expanding the application range of the device and supporting more application scenarios.

[0094] The specific embodiments of the application are described above. It should be understood that the application is not limited to the above specific embodiments, and those skilled in the art can make various changes or modifications within the scope of the claims, which does not affect the essential content of the application. The embodiments of the present application and the features in the embodiments can be arbitrarily combined with each other without conflict.

Claims

1. A very micro intelligent device, characterized in that: include: System-on-chip (SoC), with a built-in preset operating system; An interface module, electrically connected to the system-on-chip (SoC), through which the system-on-chip (SoC) transmits data with an external host device; A storage module, electrically connected to the system-on-chip (SoC); wherein the operating system interacts with the user via the input / output devices of the host device; An audio and video connection channel is established between the micro-intelligent device and the host device through the interface module. The operating system's interface image or video is compressed and encoded into a data packet and transmitted to the host device through the audio and video connection channel at a custom frequency. After the host device obtains the data packet, it decodes and decompresses the data packet through the client software, restores it to an image or video screen, and visually displays it on the host device. The client software obtains the screen touch information of the host device and transmits the data packets of the screen touch information to the very micro intelligent device through the data connection channel at a custom frequency. The very micro intelligent device issues and executes control instructions based on the screen touch information, thereby realizing user interaction and controlling the operating system; The operating system includes upper-layer application software, hardware abstraction layer and virtualized device driver; When the upper-layer application software needs to use the input / output device of the host device during operation, it initiates a request to the virtualization device driver of the operating system through the hardware abstraction layer. After receiving the request, the virtualization device driver transmits the request to the client software of the host device through the interface module. The client software completes the corresponding function through the driver of the host device and the input / output device; The operating system provides virtualized device capabilities to upper-level application software through the HAL layer. The HAL layer is used to share the host machine's hardware peripheral component resources with upper-level application software. When the upper-level application software of the operating system needs to use the corresponding peripheral resources during operation, it initiates a request to the virtualized device driver through the HAL layer. After receiving the request, the virtualized device driver transmits the request to the client software of the host device through the interface module. The client software completes the corresponding function through the host device driver and the hardware device; After the hardware device completes its corresponding functional operation, the client software returns the execution results to the virtualized device driver of the operating system through the interface module. The virtualized device driver then encapsulates these execution results into a format that the upper-layer application software can understand and returns them to the upper-layer application software through the HAL layer. After establishing a connection with the host device, the very micro intelligent device first detects the peripherals configured on itself and the host device, obtains the peripheral configuration information of both parties, and selects peripherals based on the peripheral configuration information of both parties. The selection method includes: when the very micro intelligent device itself does not have the required type of peripherals, selecting the peripherals corresponding to the host device; and when both parties have the required type of peripherals, comparing the performance parameters of the peripherals of both parties, and selecting the peripherals with better performance parameters based on the comparison results.

2. The very micro intelligent device according to claim 1, characterized in that: The host device includes a display screen, and the operating system provides a visual graphical user interface through the display screen.

3. The very micro intelligent device according to claim 1, characterized in that: The very micro smart device further includes any one or more of the following components: a battery module, a display screen, a WIFI module, a cellular communication module, a Bluetooth module, a microphone, a speaker, a camera or a sensor.

4. The very micro intelligent device according to claim 1, characterized in that: The host device further includes any one or more of the following components: a battery module, a WIFI module, a cellular communication module, a Bluetooth module, a microphone, a speaker, a camera or a sensor; The very micro intelligent devices share the components via the interface module.

5. The very micro intelligent device according to claim 1, characterized in that: The interface module includes a USB module; The system-on-chip (SoC) exchanges data with an external host device through the interface module and draws power from the host device.

6. The very micro intelligent device according to claim 1, characterized in that: During operation, when the very micro intelligent device needs to play a sound, the speaker of the host device is used to play the sound; When network communication is required, the host device's WIFI module or cellular communication module is used for network communication; When sound collection is required, use the host device's microphone to collect sound; When images and videos need to be captured, use the host device's camera to capture them. When GPS and sensor data are needed, use the host device's GPS and sensors to collect data.

7. A method for running an operating system on the very micro intelligent device according to any one of claims 1 to 6, characterized in that: include: Installing client software for controlling the operation of the operating system on the host device; When the interface module is connected to the host device, starting the operating system; The operating system encodes and compresses the content to be transmitted into a data packet and transmits it to the client software via the interface module. The client software decompresses and decodes the data packet and outputs it via the host device. The client software obtains the screen touch information of the host device and transmits the data packets of the screen touch information to the very micro intelligent device through the data connection channel at a custom frequency. The very micro intelligent device issues and executes control instructions based on the screen touch information to control the operating system.

8. The method according to claim 7, characterized in that The client software includes a resolution adaptive module; The resolution adaptation module compares the preset resolution of the operating system and the resolution of the host device. When the preset resolution of the operating system and the resolution of the host device are the same, the interface of the operating system is displayed normally. When the preset resolution of the operating system and the resolution of the host device are different but the ratio is the same, the resolution of the operating system is proportionally enlarged or reduced to the resolution of the host device. When the preset resolution of the operating system and the resolution of the host device are different and the ratio is different, the resolution of the operating system is proportionally enlarged or reduced based on the wider or taller side of the host device resolution, and the other side is displayed in the center, and the excess part is displayed as black borders on the top, bottom, left and right.

9. The method according to claim 7, characterized in that The client software includes a coordinate conversion module; The display of the host device includes a touch screen; When the preset resolution of the operating system is different from the resolution of the host device, the coordinate conversion module converts the touch point coordinates of the screen of the host device into the touch point coordinates of the operating system.

10. The method according to claim 9, characterized in that The coordinate conversion module compares the preset resolution of the operating system and the resolution of the host device. When the preset resolution of the operating system and the resolution of the host device are the same, the touch coordinates of the operating system and the touch coordinates of the host device are the same. When the preset resolution of the operating system and the resolution of the host device are different but the ratio is the same, the touch coordinates of the host device are proportionally enlarged or reduced. When the preset resolution of the operating system and the resolution of the host device are different and the ratio is different, the wide side or high side with the smaller resolution of the host device is used as a reference, and the touch coordinates are proportionally enlarged or reduced with the corresponding wide side or high side of the operating system. The magnification or reduction multiple is the magnification or reduction multiple of the touch coordinates of the host device. After the other side is displayed in the center of the screen, the excess part is displayed with a black border, and the excess part is removed in the calculation of the corresponding touch coordinates.

11. The method according to claim 7, characterized in that After the operating system is started, a data connection is established between the very micro intelligent device and the host device via the interface module; The operating system encodes and compresses the audio and video data into data packets for transmission.

12. The method according to claim 7, characterized in that After establishing a connection with the host device, the very micro intelligent device first detects the peripherals configured on itself and the host device, obtains the peripheral configuration information of both parties, and selects the peripherals according to the peripheral configuration information of both parties.

13. The method according to claim 12, characterized in that The selection method includes: selecting a peripheral corresponding to the host device when the very micro intelligent device itself does not have a peripheral of the required type; Also, in the case where both parties have the required type of peripherals, the performance parameters of the peripherals of both parties are compared, and the peripheral with better performance parameters is selected based on the comparison result.

14. The method according to claim 7, wherein: When the micro-intelligent device needs to play sound during operation, the operating system initiates a network connection request to the virtualized device driver through the hardware abstraction layer, and sends the request to the client software through the data transmission channel of the interface module. The client software uses the speaker of the host device to play the sound; When network communication is needed, the operating system initiates a network connection request to the virtualized device driver through the hardware abstraction layer, which is sent to the client software through the data transmission channel of the interface module, and the host device's WIFI module or cellular communication module is used for network communication; When sound collection is needed, the operating system initiates a network connection request to the virtualized device driver through the hardware abstraction layer, which is then sent to the client software via the data transmission channel of the interface module. The host device's microphone is used for sound collection. When images and videos need to be captured, the operating system initiates a network connection request to the virtualized device driver through the hardware abstraction layer, which is then sent to the client software via the data transmission channel of the interface module. The host device's camera is then used to capture images and videos. When GPS and sensor data are needed, the operating system initiates a network connection request to the virtualized device driver through the hardware abstraction layer, which is sent to the client software through the data transmission channel of the interface module, and the GPS and sensors of the host device are used to collect data.

Images