A cross-device collaborative sensing method, device, system and medium

Abstract

The present invention discloses a cross-device collaborative sensing method, apparatus, system and medium, including: determining a sensor data type and a computing power device type from a sensing task; finding a first service device according to the sensor data type and recording it in a cross-device sensor device list; finding a target computing power device that can perform computing services on the computing power device type from a service device according to the computing power device type and recording it in a cross-device collaborative computing list; sending the cross-device sensor device list and the cross-device collaborative computing list to a first operating system; obtaining target sensor data according to the cross-device sensor device list; the first operating system passing the target sensor data to the target computing power device according to the cross-device collaborative computing list; the target computing power device processes the target sensor data to obtain a processing result, and passes the processing result to an application. The present invention is used in the field of sensor information interaction technology.

Description

Technical Field

[0001] The present invention relates to the field of sensor information interaction technology, and in particular to a cross-device collaborative sensing method, device, system and medium. Background Art

[0002] In various fields of digitalization, multiple devices often need to work together to complete some sensing tasks. For example, in the transportation and logistics industry, ground equipment often requires certain sensors of high-altitude equipment to detect the situation on the ground nearby. The existing technical solutions are not efficient in the overall coordination of cross-device sensing tasks. Therefore, improving the coordination efficiency of cross-device sensing is a topic that needs to be studied urgently in the industry. Summary of the invention

[0003] The present invention provides a cross-device collaborative sensing method, apparatus, system and medium to solve one or more technical problems existing in the prior art and at least provide a beneficial choice or create conditions.

[0004] The present invention provides a cross-device collaborative sensing method, comprising: obtaining a sensing task initiated by an application; determining a sensor data type and a computing power device type from the sensing task; searching a service device for a device that can perform sensing information collection services for the sensor data type according to the sensor data type, the device being recorded as a first service device, and recording the first service device in a cross-device sensing device list; searching a service device for a device that can perform computing services for the computing power device type according to the computing power device type, the device being recorded as a target computing power device, and recording the target computing power device in a cross-device collaborative computing list; sending the cross-device sensing device list and the cross-device collaborative computing list to an operating system of a first service device, the operating system being recorded as a first operating system; the first operating system collects sensor data according to the cross-device sensing device list to obtain target sensor data; the first operating system transmits the target sensor data to a target computing power device according to the cross-device collaborative computing list; the target computing power device processes the target sensor data to obtain a processing result, and transmits the processing result to an application.

[0005] Furthermore, the application is a service layer program on a local device.

[0006] Further, searching for a device that can provide a sensor information collection service for the sensor data type from a service device according to the sensor data type, the device being recorded as a first service device, and recording the first service device in a cross-device sensor device list specifically includes: establishing a list of sensors to be matched, and recording the sensor data type in the list of sensors to be matched;

[0007] Access a list of available sensors pre-established in the service device, compare the available sensor list with the list of sensors to be matched, and when the available sensor list contains a sensor data type in the list of sensors to be matched, the service device is considered to be a device that can perform sensor information collection services for the sensor data type, and the device is recorded as a first service device, and the first service device is recorded in the cross-device sensor device list.

[0008] Further, searching for a device that can perform computing services for the computing device type from a service device according to the computing device type, recording the device as a target computing device, and recording the target computing device in a cross-device collaborative computing list specifically includes: establishing a list of computing devices to be matched, and recording the computing device type in the list of computing devices to be matched;

[0009] Access the pre-established available computing power list in the service device, compare the available computing power list with the list of computing power devices to be matched, and when the computing power device type in the list of computing power devices to be matched exists in the available computing power list, it is considered that the service device can provide computing services for the computing power device type, and the device is recorded as the target computing power device, and the target computing power device is recorded in the cross-device collaborative computing list.

[0010] Furthermore, the service device includes a local device and an external device.

[0011] On the other hand, a cross-device collaborative sensing apparatus is provided, comprising: a processor and a memory, the memory being used to store a computer-readable program; when the computer-readable program is executed by the processor, the processor implements a cross-device collaborative sensing method as described in any one of the above technical solutions.

[0012] On the other hand, a cross-device collaborative sensing system is provided, comprising: an acquisition module, a determination module, a first search module, a second search module, and a processing module;

[0013] The acquisition module is used to acquire the sensing task initiated by the application;

[0014] The determination module is used to determine the sensor data type and the computing device type from the sensing task;

[0015] The first search module is used to search for a device that can provide a sensor information collection service for the sensor data type from a service device according to the sensor data type, the device is recorded as a first service device, and the first service device is recorded in a cross-device sensor device list;

[0016] The second search module is used to search for a device that can provide computing services for the computing device type from a service device according to the computing device type, and record the device as a target computing device, and record the target computing device in a cross-device collaborative computing list;

[0017] The processing module is used to send the cross-device sensor device list and the cross-device collaborative operation list to the operating system of the first service device, and the operating system is recorded as the first operating system; the first operating system collects sensor data according to the cross-device sensor device list to obtain target sensor data; the first operating system transmits the target sensor data to the target computing power device according to the cross-device collaborative operation list; the target computing power device processes the target sensor data to obtain a processing result, and transmits the processing result to the application.

[0018] Further, searching for a device that can provide a sensor information collection service for the sensor data type from a service device according to the sensor data type, the device being recorded as a first service device, and recording the first service device in a cross-device sensor device list specifically includes: establishing a list of sensors to be matched, and recording the sensor data type in the list of sensors to be matched;

[0019] Access a list of available sensors pre-established in the service device, compare the available sensor list with the list of sensors to be matched, and when the available sensor list contains a sensor data type in the list of sensors to be matched, the service device is considered to be a device that can perform sensor information collection services for the sensor data type, and the device is recorded as a first service device, and the first service device is recorded in the cross-device sensor device list.

[0020] Further, searching for a device that can perform computing services for the computing device type from a service device according to the computing device type, recording the device as a target computing device, and recording the target computing device in a cross-device collaborative computing list specifically includes: establishing a list of computing devices to be matched, and recording the computing device type in the list of computing devices to be matched;

[0021] Access the pre-established available computing power list in the service device, compare the available computing power list with the list of computing power devices to be matched, and when the computing power device type in the list of computing power devices to be matched exists in the available computing power list, it is considered that the service device can provide computing services for the computing power device type, and the device is recorded as the target computing power device, and the target computing power device is recorded in the cross-device collaborative computing list.

[0022] On the other hand, a computer-readable storage medium is provided, in which a program executable by a processor is stored. When the program executable by the processor is executed by the processor, it is used to implement the cross-device collaborative sensing method as described in any one of the above technical solutions.

[0023] The present invention has at least the following beneficial effects: The method of the present invention obtains the sensor data type and computing power device type from the sensing task, and uses the sensor data type and computing power device type to search the corresponding first service device and target computing power device from the service device. The cross-device sensing device list and the cross-device collaborative operation list are used as media to achieve higher efficiency when performing cross-device collaboration. The efficiency of cross-device collaborative sensing is improved. On the other hand, the present invention also discloses an apparatus, system and medium for applying the method, wherein the beneficial effects of the apparatus, system and medium are similar to those of the method and will not be repeated here. The present invention is used in the field of sensing information interaction technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The accompanying drawings are used to provide a further understanding of the technical solution of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the technical solution of the present invention and do not constitute a limitation on the technical solution of the present invention.

[0025] Figure 1 is a flowchart of steps of a cross-device collaborative sensing method;

[0026] Figure 2 is a schematic diagram of a device structure of a cross-device collaborative sensing device;

[0027] Figure 3 It is a schematic diagram of the system structure of the cross-device collaborative sensing system. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0029] It should be noted that, although the functional modules are divided in the system schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the system or the order in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0030] refer to Figure 1 , Figure 1The cross-device collaborative sensing method is a flow chart of steps. The cross-device collaborative sensing method can be run through a smart device. The purpose of the cross-device collaborative sensing method is to improve the working efficiency of cross-device sensing.

[0031] In order to achieve this technical purpose, the present application discloses a cross-device collaborative sensing method, including: Step 1, obtaining a sensing task initiated by an application.

[0032] When the cross-device collaborative sensing method is executed by the smart device, the smart device executes the cross-device collaborative sensing method through its operating system. For ease of description, the operating system is recorded as a task operating system.

[0033] When cross-device collaborative sensing is required, the application at the business level will generate a sensing task, which refers to a computer task for acquiring pre-set sensing data.

[0034] In a computer program, "task" usually refers to an independent, executable unit that is responsible for completing a specific function or operation. A task can be a simple function, method, or a complex process or thread. Process: A process is a running activity of a program in a computer on a certain data set. It is the basic unit for resource allocation and scheduling of the system and the basis of the operating system structure. In the early computer structure designed for processes, processes were the basic execution entities of programs; in the contemporary computer structure designed for threads, processes are containers for threads. A process has an independent memory space. When a process crashes, it will not affect other processes in protected mode. However, threads do not have independent memory space. If a thread dies, the entire process dies. Therefore, the design of multiple processes is more robust than that of multiple threads. Thread: A thread is the smallest unit that the operating system can perform computational scheduling. It is contained in the process and is the actual operating unit in the process. A thread refers to a single sequential control flow in a process. Multiple threads can run concurrently in a process, and each thread executes different tasks in parallel.

[0035] For a sensing task, when it is initiated by an application, in order to obtain the corresponding data, it needs to include the sensor data type required by the task. The sensor data type is pre-defined by the developer and can be temperature, brightness, indoor environment point cloud, etc.

[0036] In order to process the data in the sensor data type in an identifiable manner, it also requires special computing equipment to process it. Therefore, for the sensing task, it also needs to include special computing equipment for processing the sensor data type. Here, the computing equipment type is used to reflect it.

[0037] To sum up, for sensing tasks, it includes the required sensor data type and computing power device type.

[0038] After the task operating system obtains the sensing task, it can proceed to the next step.

[0039] Step 2: Determine the sensor data type and computing device type from the sensing task.

[0040] The task operating system parses the sensing task to extract the sensor type and computing device type from the sensing task.

[0041] Step 3: According to the sensor data type, a device that can provide sensor information collection service for the sensor data type is searched from the service device, and the device is recorded as a first service device, and the first service device is recorded in a cross-device sensor device list.

[0042] After the task operating system obtains the sensor data type, it can enter the cross-device sensor self-organization stage to obtain the required sensor data from the current device network. The device network will be connected to various available devices, and each available device can be networked in different ways, such as wireless networks such as WiFi, Bluetooth, and Star Flash, or wired networks such as optical fibers and network cables.

[0043] The task operating system accesses the device network and finds a device that can provide sensor information collection services for the sensor data type from the device network according to the sensor data type.

[0044] For ease of description, the device is recorded as the first service device. In order to better record the first service device, the task operating system will create a list, which is recorded as a cross-device sensor device list, and record the information of the first service device in the cross-device sensor device list. This allows other devices to access the first service device through the cross-device sensor device list.

[0045] In order to improve the search efficiency of the task operating system for the first service device, in some further specific embodiments, searching from the service device according to the sensor data type to obtain a device that can perform sensor information collection service for the sensor data type, the device is recorded as the first service device, and recording the first service device in the cross-device sensor device list specifically includes:

[0046] Step 31: Create a list of sensors to be matched, and record the sensor data type in the list of sensors to be matched.

[0047] Step 32, access the available sensor list pre-established in the service device, and compare the available sensor list with the list of sensors to be matched; when the sensor data type in the list of sensors to be matched exists in the available sensor list, it is considered that the service device is a device that can perform sensor information collection services for the sensor data type, and the device is recorded as the first service device, and the first service device is recorded in the cross-device sensor device list.

[0048] The service device is a device connected to the device network, including local devices and external devices.

[0049] After reading the sensor data types required by the task, the task operating system creates a "sensor list to be matched", which contains the sensor data types required by the task.

[0050] When the task operating system accesses the service device through the device network, it will first access the local device. When the local device can determine the first service device, it does not need to access the external device. Of course, when the local device cannot determine the first service device, it is necessary to access the external device and determine the first service device from the external device. The device network refers to the network in which available devices are connected through the Internet of Things technology. The Internet of Things technology allows all objects to be remotely interconnected and realize intelligent management and control.

[0051] The specific process is:

[0052] The task operating system reads the "available sensor list" of the local device. If the "available sensor list" of the local device contains several sensor data types in the "sensor list to be matched", these sensor data types are deleted from the "sensor list to be matched".

[0053] If the "List of Sensors to be Matched" is empty at this time, it means that this device can meet all the sensor data types required by the task alone. Record this device in the "List of Cross-Device Sensor Devices". End all steps in this stage and go directly to step .

[0054] If the "list of sensors to be matched" is not empty at this time, continue to search for more available devices, such as searching from external devices.

[0055] The task operating system reads the "Available Sensor List" of the foreign device through the device network. If the "Available Sensor List" of a foreign device contains several sensor data types in the "Sensor List to be Matched", these sensor data types will be deleted from the "Sensor List to be Matched" and the device and these sensor data types will be recorded in the "Cross-device Sensing Device List".

[0056] If the "List of Sensors to be Matched" is empty at this time, it means that the operating system of this task can use the devices in the "List of Cross-Device Sensor Devices" to meet all the sensor data types required by the sensing task. At this time, record this device in the "List of Cross-Device Sensor Devices". End all steps of this stage.

[0057] If the "List of Sensors to be Matched" is not empty at this time, it means that all available devices cannot meet the sensor data type required by the task under the condition of collaboration. End all steps of this stage and report task failure.

[0058] Step 4: According to the computing device type, a device that can provide computing services for the computing device type is searched from the service device, and the device is recorded as the target computing device, and the target computing device is recorded in the cross-device collaborative computing list;

[0059] After the task operating system obtains the computing power device type, it can enter the computing power self-organization stage to find a suitable dedicated computing power device from the current device network, and calculate the acquired sensor data through the suitable dedicated computing power device to obtain the sensing result.

[0060] The device network will be connected to various available devices, and the various available devices can be networked in different ways, such as wireless network methods such as WiFi, Bluetooth, and Star Flash, or wired network methods such as optical fiber and network cable.

[0061] The task operating system accesses the device network and finds a device from the device network that can perform data computing services for the computing device type according to the computing device type.

[0062] For ease of description, the device is recorded as the target computing device. In order to better record the target computing device, the task operating system will create a list, which is recorded as the cross-device sensor device list, and record the information of the target computing device in the cross-device sensor device list. This allows other devices to access the target computing device through the cross-device sensor device list.

[0063] In order to improve the search efficiency of the task operating system for the target computing device, in some further specific embodiments, according to the computing device type, a device that can perform computing services for the computing device type is searched from the service device, and the device is recorded as the target computing device. Recording the target computing device in the cross-device collaborative computing list specifically includes:

[0064] Step 41: Create a list of computing devices to be matched, and record the computing device type in the list of computing devices to be matched.

[0065] Step 42: Access the available computing power list pre-established in the service device, and compare the available computing power list with the list of computing power devices to be matched. When the computing power list contains a computing power device type in the list of computing power devices to be matched, it is considered that the service device can provide computing services for the computing power device type, and the device is recorded as the target computing power device, and the target computing power device is recorded in the cross-device collaborative computing list.

[0066] The service device is a device connected to the device network, including local devices and external devices.

[0067] After reading the computing device type required for the task, the task operating system creates a "list of computing devices to be matched", which contains the computing device type required for the task.

[0068] When the task operating system accesses the service device through the device network, it will first access the local device. When the local device can determine the target computing device, there is no need to access the external device. Of course, when the local device cannot determine the target computing device, it is necessary to access the external device and determine the target computing device from the external device. The device network refers to the network where available devices are connected through the Internet of Things technology. The Internet of Things technology allows all objects to be remotely interconnected and realize intelligent management and control.

[0069] The specific process is:

[0070] The task operating system creates a "list of computing devices to be matched".

[0071] The task operating system reads the "Available Computing Power List" of the local device. If the "Available Computing Power List" of the local device contains several computing power device types in the "Computing Power Device List to be Matched", these computing power device types are deleted from the "Computing Power Device List to be Matched".

[0072] If the "List of Computing Devices to be Matched" is empty at this time, it means that this device can be used as the only computing device to process all sensor data types. Record the local device in the "Cross-device Collaborative Computing List". End all steps in this stage.

[0073] If the "List of Computing Power Devices to be Matched" is not empty at this time, continue to search for more available devices, such as from external devices.

[0074] The task operating system reads the "Available Computing Power List" of the external device through the device network. If the "Available Computing Power List" of a certain external device contains several computing power device types in the "Computing Power Device List to be Matched", these computing power device types will be deleted from the "Computing Power Device List to be Matched" and the device and these computing power device types will be recorded in the "Cross-device Collaborative Computing List".

[0075] If the "List of Computing Power Devices to be Matched" is empty at this time, it means that this device can use the devices in the "Cross-Device Collaborative Computing List" to meet the computing power required for data processing. Record this device in the "Cross-Device Collaborative Computing List". End all steps in this stage.

[0076] If the "List of Computing Power Devices to be Matched" is not empty at this time, it means that all available devices cannot meet the computing power required for data processing required by the task under the condition of collaboration. End all steps of this stage and report the task failure.

[0077] Step 5. Send the cross-device sensor device list and the cross-device collaborative operation list to the operating system of the first service device, which is recorded as the first operating system; the first operating system collects sensor data according to the cross-device sensor device list to obtain target sensor data; the first operating system transmits the target sensor data to the target computing power device according to the cross-device collaborative operation list; the target computing power device processes the target sensor data to obtain a processing result, and transmits the processing result to the application.

[0078] After completing the cross-device sensor device list and the cross-device collaborative computing list, the task operating system will send the "cross-device sensor device list" and the "cross-device collaborative computing list" to the first service device. Thus, the operating system of the first service device receives the "cross-device sensor device list" and the "cross-device collaborative computing list". For the convenience of description, the operating system of the first service device is recorded as the first operating system.

[0079] After the first operating system obtains the "cross-device sensor device list", it can know which sensor devices need to be used to collect sensor data in the sensor data type recorded in the sensing task. For the convenience of description, the collected sensor data is recorded as target sensor data. In order to process the target sensor data, the first operating system also needs to find the corresponding target computing power device for the target sensor data according to the cross-device collaborative operation list. And, the target sensor data is sent to the target computing power device. After the target computing power device receives the target sensor data, it will perform calculations on the target sensor data to obtain a processing result. After obtaining the processing result, the processing result can be passed to the application. Thereby, the application can obtain the sensing result.

[0080] The present invention obtains the sensor data type and computing device type from the sensing task, and uses the sensor data type and computing device type to search for the corresponding first service device and target computing device from the service device. The cross-device sensing device list and the cross-device collaborative computing list are used as media, so that the cross-device collaboration is more efficient. The efficiency of cross-device collaborative sensing is improved.

[0081] With respect to the application program, in some further specific embodiments, the application program is a program at the service layer on the local device.

[0082] On the other hand, reference Figure 2 , Figure 2 It is a schematic diagram of the device structure of a cross-device collaborative sensing device.

[0083] A cross-device collaborative sensing apparatus is provided, comprising: a processor and a memory, wherein the memory is used to store a computer-readable program. When the computer-readable program is executed by the processor, the processor implements the cross-device collaborative sensing method as described in any one of the above technical solutions.

[0084] It will be appreciated by those skilled in the art that all or some of the steps and systems in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or transient medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. As is well known to those skilled in the art, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0085] On the other hand, reference Figure 3 , Figure 3It is a schematic diagram of the system structure of the cross-device collaborative sensing system.

[0086] A cross-device collaborative sensing system is provided, comprising: an acquisition module, a determination module, a first search module, a second search module and a processing module.

[0087] The acquisition module is used to acquire the sensing task initiated by the application.

[0088] The determination module is used to determine the sensor data type and the computing power device type from the sensing task.

[0089] The first search module is used to search for a device that can provide sensor information collection services for the sensor data type from a service device according to the sensor data type, and the device is recorded as a first service device, and the first service device is recorded in a cross-device sensor device list.

[0090] After the first search module obtains the sensor data type, it can enter the cross-device sensor self-organization stage to obtain the required sensor data from the current device network. The device network will be connected to various available devices, and each available device can be networked in different ways, such as wireless network methods such as WiFi, Bluetooth, and Star Flash, or wired network methods such as optical fiber and network cable.

[0091] The first search module accesses the device network, thereby finding a device that can provide sensor information collection services for the sensor data type from the device network according to the sensor data type.

[0092] For ease of description, the device is recorded as the first service device. In order to better record the first service device, the task operating system will create a list, which is recorded as a cross-device sensor device list, and record the information of the first service device in the cross-device sensor device list. This allows other devices to access the first service device through the cross-device sensor device list.

[0093] In order to improve the search efficiency of the task operating system for the first service device, in some further specific embodiments, searching from the service device according to the sensor data type to obtain a device that can perform sensor information collection service for the sensor data type, the device is recorded as the first service device, and recording the first service device in the cross-device sensor device list specifically includes:

[0094] Step 31: Create a list of sensors to be matched, and record the sensor data type in the list of sensors to be matched.

[0095] Step 32, access the available sensor list pre-established in the service device, and compare the available sensor list with the list of sensors to be matched; when the sensor data type in the list of sensors to be matched exists in the available sensor list, it is considered that the service device is a device that can perform sensor information collection services for the sensor data type, and the device is recorded as the first service device, and the first service device is recorded in the cross-device sensor device list.

[0096] The service device is a device connected to the device network, including local devices and external devices.

[0097] After reading the sensor data type required for the task, the first search module creates a "to-be-matched sensor list", which contains the sensor data type required for the task.

[0098] When the first search module accesses the service device through the device network, it will first access the local device. When the local device can determine the first service device, there is no need to access the external device. Of course, when the local device cannot determine the first service device, it is necessary to access the external device and determine the first service device from the external device. The device network refers to a network where available devices are connected through the Internet of Things technology. The Internet of Things technology allows all objects to be remotely interconnected and realize intelligent management and control.

[0099] The specific process is:

[0100] The first search module reads the "available sensor list" of the local device, and if the "available sensor list" of the local device contains several sensor data types in the "sensor list to be matched", these sensor data types are deleted from the "sensor list to be matched".

[0101] If the "List of Sensors to be Matched" is empty at this time, it means that this device can meet all the sensor data types required by the task alone. Record this device in the "List of Cross-Device Sensor Devices". End all steps in this stage and go directly to step .

[0102] If the "list of sensors to be matched" is not empty at this time, continue to search for more available devices, such as searching from external devices.

[0103] The first search module reads the "available sensor list" of the foreign device through the device network. If the "available sensor list" of a foreign device contains several sensor data types in the "to-match sensor list", these sensor data types are deleted from the "to-match sensor list" and the device and these sensor data types are recorded in the "cross-device sensor device list".

[0104] If the "List of Sensors to be Matched" is empty at this time, it means that the first search module can use the devices in the "List of Cross-Device Sensor Devices" to meet all sensor data types required for the sensing task. At this time, the device is recorded in the "List of Cross-Device Sensor Devices". All steps of this stage are terminated.

[0105] If the "List of Sensors to be Matched" is not empty at this time, it means that all available devices cannot meet the sensor data type required by the task under the condition of collaboration. End all steps of this stage and report task failure.

[0106] The second search module is used to search for a device that can provide computing services for the computing device type from a service device according to the computing device type, and the device is recorded as a target computing device, and the target computing device is recorded in a cross-device collaborative computing list.

[0107] After the second search module obtains the computing power device type, it can enter the computing power self-organization stage to find a suitable dedicated computing power device from the current device network, and calculate the acquired sensor data through the suitable dedicated computing power device to obtain the sensing result.

[0108] The device network will be connected to various available devices, and the various available devices can be networked in different ways, such as wireless network methods such as WiFi, Bluetooth, and Star Flash, or wired network methods such as optical fiber and network cable.

[0109] The second search module accesses the device network to find a device that can perform data computing services for the computing power device type from the device network according to the computing power device type.

[0110] For ease of description, the device is recorded as the target computing device. In order to better record the target computing device, the task operating system will create a list, which is recorded as the cross-device sensor device list, and record the information of the target computing device in the cross-device sensor device list. This allows other devices to access the target computing device through the cross-device sensor device list.

[0111] In order to improve the search efficiency of the second search module for the target computing power device, in some further specific embodiments, according to the computing power device type, a device that can perform computing services for the computing power device type is searched from the service device, and the device is recorded as the target computing power device. Recording the target computing power device in the cross-device collaborative computing list specifically includes:

[0112] Step 41: Create a list of computing devices to be matched, and record the computing device type in the list of computing devices to be matched.

[0113] Step 42: Access the available computing power list pre-established in the service device, and compare the available computing power list with the list of computing power devices to be matched. When the computing power list contains a computing power device type in the list of computing power devices to be matched, it is considered that the service device can provide computing services for the computing power device type, and the device is recorded as the target computing power device, and the target computing power device is recorded in the cross-device collaborative computing list.

[0114] The service device is a device connected to the device network, including local devices and external devices.

[0115] After reading the computing power device type required for the task, the second search module creates a "computing power device list to be matched", which contains the computing power device type required for the task.

[0116] When the second search module accesses the service device through the device network, it will first access the local device. When the local device can determine the target computing device, there is no need to access the external device. Of course, when the local device cannot determine the target computing device, it is necessary to access the external device and determine the target computing device from the external device. The device network refers to the network where available devices are connected through the Internet of Things technology. The Internet of Things technology allows all items to be remotely interconnected and realize intelligent management and control.

[0117] The specific process is:

[0118] The second search module creates a "list of computing power devices to be matched".

[0119] The second search module reads the "Available Computing Power List" of the local device. If the "Available Computing Power List" of the local device contains several computing power device types in the "Computing Power Device List to be Matched", these computing power device types are deleted from the "Computing Power Device List to be Matched".

[0120] If the "List of Computing Devices to be Matched" is empty at this time, it means that this device can be used as the only computing device to process all sensor data types. Record the local device in the "Cross-device Collaborative Computing List". End all steps in this stage.

[0121] If the "List of Computing Power Devices to be Matched" is not empty at this time, continue to search for more available devices, such as from external devices.

[0122] The second search module reads the "Available Computing Power List" of the foreign device through the device network. If the "Available Computing Power List" of a foreign device contains several computing power device types in the "Computing Power Device List to be Matched", these computing power device types will be deleted from the "Computing Power Device List to be Matched" and the device and these computing power device types will be recorded in the "Cross-device Collaborative Computing List".

[0123] If the "List of Computing Power Devices to be Matched" is empty at this time, it means that this device can use the devices in the "Cross-Device Collaborative Computing List" to meet the computing power required for data processing. Record this device in the "Cross-Device Collaborative Computing List". End all steps in this stage.

[0124] If the "List of Computing Power Devices to be Matched" is not empty at this time, it means that all available devices cannot meet the computing power required for data processing required by the task under the condition of collaboration. End all steps of this stage and report the task failure.

[0125] The processing module is used to send the cross-device sensor device list and the cross-device collaborative operation list to the operating system of the first service device, and the operating system is recorded as the first operating system; the first operating system collects sensor data according to the cross-device sensor device list to obtain target sensor data; the first operating system transmits the target sensor data to the target computing power device according to the cross-device collaborative operation list; the target computing power device processes the target sensor data to obtain a processing result, and transmits the processing result to the application.

[0126] After completing the cross-device sensor device list and the cross-device collaborative computing list, the processing module will send the "cross-device sensor device list" and the "cross-device collaborative computing list" to the first service device. Thus, the operating system of the first service device receives the "cross-device sensor device list" and the "cross-device collaborative computing list". For the convenience of description, the operating system of the first service device is recorded as the first operating system.

[0127] After the first operating system obtains the "cross-device sensor device list", it can know which sensor devices need to be used to collect sensor data in the sensor data type recorded in the sensing task. For the convenience of description, the collected sensor data is recorded as target sensor data. In order to process the target sensor data, the first operating system also needs to find the corresponding target computing power device for the target sensor data according to the cross-device collaborative operation list. And, the target sensor data is sent to the target computing power device. After the target computing power device receives the target sensor data, it will perform calculations on the target sensor data to obtain a processing result. After obtaining the processing result, the processing result can be passed to the application. Thereby, the application can obtain the sensing result.

[0128] On the other hand, a computer-readable storage medium is provided, in which a program executable by a processor is stored. When the program executable by the processor is executed by the processor, it is used to implement the cross-device collaborative sensing method as described in any one of the above specific embodiments.

[0129] An embodiment of the present application also discloses a computer program product, including a computer program or computer instructions, wherein the computer program or computer instructions are stored in a computer-readable storage medium, a processor of a computer device reads the computer program or computer instructions from the computer-readable storage medium, and the processor executes the computer program or computer instructions, so that the computer device executes the cross-device collaborative sensing method as described in any of the previous embodiments.

[0130] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0131] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0132] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0133] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0134] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0135] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.

[0136] Although the description of the present application has been quite detailed and specifically describes several described embodiments, it is not intended to be limited to any of these details or embodiments or any particular embodiment, but should be regarded as providing a broad possible interpretation of these claims by reference to the attached claims, taking into account the prior art, so as to effectively cover the intended scope of the present application. In addition, the above description of the present application is based on the embodiments foreseeable by the inventor, and its purpose is to provide a useful description, and those non-substantial changes to the present application that have not yet been foreseen may still represent equivalent changes to the present application.

Claims

1. A cross-device collaborative sensing method, characterized in that: include: Obtaining a sensing task initiated by an application; determining a sensor data type and a computing device type from the sensing task; According to the sensor data type, a device that can provide sensor information collection service for the sensor data type is searched from the service device, the device is recorded as a first service device, and the first service device is recorded in a cross-device sensor device list, the service device includes a local device and a foreign device; According to the computing device type, a device that can provide computing services for the computing device type is searched from the service device, and the device is recorded as a target computing device, and the target computing device is recorded in the cross-device collaborative computing list; Sending the cross-device sensor device list and the cross-device collaborative operation list to an operating system of a first service device, the operating system being recorded as a first operating system; the first operating system collects sensor data according to the cross-device sensor device list to obtain target sensor data; The first operating system transmits the target sensor data to the target computing device according to the cross-device collaborative operation list; The target computing device processes the target sensor data to obtain a processing result, and transmits the processing result to the application program; Also includes: When accessing a service device through a device access network, the local device is accessed first, and when the first service device can be determined in the local device, the foreign device is not accessed; When the first service device cannot be determined in the local device, accessing the foreign device to determine the first service device in the foreign device; The device access network is a network in which available service devices are connected through the Internet of Things technology.

2. A cross-device collaborative sensing method according to claim 1, characterized in that: The application is a program at the service layer on the local device.

3. The cross-device collaborative sensing method according to claim 1, characterized in that: Searching for a device that can provide sensor information collection service for the sensor data type from a service device according to the sensor data type, the device being recorded as a first service device, and recording the first service device in a cross-device sensor device list specifically includes: establishing a list of sensors to be matched, and recording the sensor data type in the list of sensors to be matched; Access a list of available sensors pre-established in the service device, compare the available sensor list with the list of sensors to be matched, and when the available sensor list contains a sensor data type in the list of sensors to be matched, the service device is considered to be a device that can perform sensor information collection services for the sensor data type, and the device is recorded as a first service device, and the first service device is recorded in the cross-device sensor device list.

4. The cross-device collaborative sensing method according to claim 1, characterized in that: Searching for a device that can perform computing services for the computing device type from a service device according to the computing device type, recording the device as a target computing device, and recording the target computing device in a cross-device collaborative computing list specifically includes: establishing a list of computing devices to be matched, and recording the computing device type in the list of computing devices to be matched; Access the pre-established available computing power list in the service device, compare the available computing power list with the list of computing power devices to be matched, and when the computing power device type in the list of computing power devices to be matched exists in the available computing power list, it is considered that the service device can provide computing services for the computing power device type, and the device is recorded as the target computing power device, and the target computing power device is recorded in the cross-device collaborative computing list.

5. A cross-device collaborative sensing device, characterized in that: include: processor; A memory for storing a computer readable program; When the computer-readable program is executed by the processor, the processor is enabled to implement the cross-device collaborative sensing method according to any one of claims 1 to 4.

6. A cross-device collaborative sensing system, characterized in that: include: An acquisition module, a determination module, a first search module, a second search module and a processing module; The acquisition module is used to acquire the sensing task initiated by the application; The determination module is used to determine the sensor data type and the computing device type from the sensing task; The first search module is used to search for a device that can provide a sensor information collection service for the sensor data type from a service device according to the sensor data type, the device is recorded as a first service device, and the first service device is recorded in a cross-device sensor device list, the service device includes a local device and a foreign device; The second search module is used to search for a device that can provide computing services for the computing device type from a service device according to the computing device type, and record the device as a target computing device, and record the target computing device in a cross-device collaborative computing list; The processing module is used to send the cross-device sensor device list and the cross-device collaborative operation list to the operating system of the first service device, and the operating system is recorded as the first operating system; the first operating system collects sensor data according to the cross-device sensor device list to obtain target sensor data; the first operating system transmits the target sensor data to the target computing device according to the cross-device collaborative operation list; The target computing device processes the target sensor data to obtain a processing result, and transmits the processing result to the application program; Also includes: When accessing a service device through a device access network, the local device is accessed first, and when the first service device can be determined in the local device, the foreign device is not accessed; When the first service device cannot be determined in the local device, accessing the foreign device to determine the first service device in the foreign device; The device access network is a network in which available service devices are connected through the Internet of Things technology.

7. The cross-device collaborative sensing system according to claim 6, characterized in that: Searching for a device that can provide sensor information collection service for the sensor data type from a service device according to the sensor data type, the device being recorded as a first service device, and recording the first service device in a cross-device sensor device list specifically includes: establishing a list of sensors to be matched, and recording the sensor data type in the list of sensors to be matched; Access a list of available sensors pre-established in the service device, compare the available sensor list with the list of sensors to be matched, and when the available sensor list contains a sensor data type in the list of sensors to be matched, the service device is considered to be a device that can perform sensor information collection services for the sensor data type, and the device is recorded as a first service device, and the first service device is recorded in the cross-device sensor device list.

8. The cross-device collaborative sensing system according to claim 6, characterized in that: Searching for a device that can perform computing services for the computing device type from a service device according to the computing device type, recording the device as a target computing device, and recording the target computing device in a cross-device collaborative computing list specifically includes: establishing a list of computing devices to be matched, and recording the computing device type in the list of computing devices to be matched; Access the pre-established available computing power list in the service device, compare the available computing power list with the list of computing power devices to be matched, and when the computing power device type in the list of computing power devices to be matched exists in the available computing power list, it is considered that the service device can provide computing services for the computing power device type, and the device is recorded as the target computing power device, and the target computing power device is recorded in the cross-device collaborative computing list.

9. A computer-readable storage medium, characterized in that: A processor-executable program is stored therein, and when the processor-executable program is executed by the processor, it is used to implement the cross-device collaborative sensing method as described in any one of claims 1 to 4.

Images