A device capability distributed collaboration method and system based on an open-source honkong system
By building a galaxy network through the built-in discovery mechanism of the open-source HarmonyOS system, it supports the seamless flow of atomic services between different devices and performs distributed control, solving the problems of difficult interconnection and lack of control flexibility in intelligent device collaboration, and realizing efficient collaboration and data sharing.
Patent Information
- Application Number
- CN202411541133.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-31
- Publication Date
- 2025-10-17
- Estimated Expiration
- 2044-10-31
AI Technical Summary
Existing smart device collaboration technologies have problems such as difficulty in interoperability between devices, low collaboration efficiency, a single atomic service startup method, lack of flexibility and scalability in distributed control, and imperfect device and service discovery mechanisms.
Based on the open-source HarmonyOS system, it detects surrounding devices through a built-in discovery mechanism, builds a galaxy network, supports the seamless flow of atomic services between different devices, and performs real-time monitoring and resource scheduling through distributed control technology.
It enables efficient collaboration and data sharing between devices, provides flexible service startup methods and distributed control capabilities, and enhances user experience and expands application scenarios.
Smart Images

Figure CN119676279B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of intelligent Internet of Things, and in particular to a device capability distributed collaboration method and system based on an open-source Hongmeng system, a terminal, and a computer readable storage medium. BACKGROUND
[0002] Intelligent device collaboration refers to the ability of multiple intelligent devices to work together to complete specific tasks or provide comprehensive services through technical means.
[0003] The reasons for the problems in existing intelligent device collaboration technology mainly include the following aspects:
[0004] (1) Difficulty in interconnection and intercommunication between devices, low collaboration efficiency, reasons: non-uniform communication protocol: different manufacturers' devices may use different communication protocols, making it difficult for devices to communicate directly; hardware compatibility problems: the hardware interface and standards of intelligent devices are not uniform, making it difficult for devices to connect and collaborate; software ecosystem fragmentation: lack of a unified software platform or ecosystem, making it difficult for applications and services to run across devices.
[0005] (2) Single atomic service starting mode, poor user experience, reasons: lack of innovative interaction technology: traditional starting methods such as key, touch screen, etc. are relatively single, and emerging interaction technologies such as gestures, voice, etc. are not fully utilized; service is too tightly bound to the device or operating system: services are often bound to specific devices or operating systems, limiting the flexible start and cross-device use of services.
[0006] (3) Lack of flexibility and scalability in distributed control, reasons: centralized control architecture: traditional control systems are mostly centralized, making it difficult to adapt to flexible control needs in a distributed environment; lack of standardized interfaces: there is no universal distributed control interface standard, making it difficult for different devices to achieve effective control.
[0007] (4) Incomplete device and service discovery mechanism, limiting the expansion of application scenarios, reasons: discovery protocol limitations: existing device discovery protocols may only support specific types of devices or services, and cannot be widely applied; network configuration complexity: in a multi-device network, the complexity of configuration and management limits the rapid discovery and access of devices; insufficient security considerations: security issues in the device and service discovery process have not been fully considered, which may lead to privacy leaks or unauthorized access.
[0008] Therefore, the existing technology still needs to be improved and developed. SUMMARY
[0009] The main purpose of the present application is to provide a device capability distributed collaboration method, system, terminal and computer readable storage medium based on an open source honeymoon system, aiming to solve the problems of low collaboration efficiency, single atomic service starting mode, lack of flexibility and expansibility of distributed control, and limited application scene expansion in the prior art.
[0010] To achieve the above-mentioned purpose, the present application provides a device capability distributed collaboration method based on an open source honeymoon system, which comprises the following steps:
[0011] A discovery mechanism is built in the target master device with an open source honeymoon system, surrounding devices are detected through the built-in discovery mechanism in the target master device, and multiple devices are organized into a galaxy network based on the distributed capability of the open source honeymoon system;
[0012] The preset operation mode of the user is identified, the atomic service is pulled up according to the identification result, and the seamless flow of the atomic service between different devices and the real-time sharing of data are supported through the galaxy network;
[0013] Images or information from different devices are displayed on a distributed screen, and robots in the galaxy network are remotely operated through distributed control technology;
[0014] The device state and service running condition are monitored in real time, and resources are automatically scheduled according to preset rules to respond to abnormal conditions and take corresponding recovery measures.
[0015] Optionally, the device capability distributed collaboration method based on the open source honeymoon system, wherein the built-in discovery mechanism in the target master device with the open source honeymoon system detects surrounding devices through the built-in discovery mechanism in the target master device, and multiple devices are organized into a galaxy network based on the distributed capability of the open source honeymoon system, specifically comprising:
[0016] The built-in discovery mechanism of the target master device with the open source honeymoon system is controlled to start the built-in discovery mechanism and start scanning surrounding devices;
[0017] After detecting surrounding devices through the built-in discovery mechanism in the target master device, the network information of the surrounding devices is obtained, and the secure connection between the target master device and the surrounding devices is established through the encryption and authentication process according to the distributed capability of the open source honeymoon system;
[0018] After the connection is established, a stable communication link is established between devices through distributed soft bus technology, a network topology structure is formed between devices, each device acts as a node in the network, and all nodes jointly constitute a galaxy network.
[0019] Optionally, the device capability distributed collaboration method based on open source monsoon system, wherein the built-in discovery mechanism includes one or both of network protocol and Bluetooth discovery; and the peripheral devices include smart home devices, personal electronic devices, office equipment, industrial automation equipment, vehicles, public infrastructure, medical devices, and retail and commercial devices.
[0020] Optionally, the device capability distributed collaboration method based on open source monsoon system, wherein the displaying images or information from different devices on the distributed screen specifically includes:
[0021] Displaying the names of the devices on the distributed screen for users to identify different devices;
[0022] Displaying the working status of the devices on the distributed screen for users to know the status of the devices;
[0023] For monitoring devices, obtaining real-time video streams, sensor data, and geographic location information and displaying them on the distributed screen;
[0024] For remotely operable devices, displaying operation interfaces on the distributed screen.
[0025] Optionally, the device capability distributed collaboration method based on open source monsoon system, wherein the real-time monitoring of device status and service running specifically includes:
[0026] Periodically collecting CPU usage, memory occupation, network status, and service running status indicators of the devices through device agents;
[0027] Periodically sending heartbeat signals to the distributed management platform to prove that the devices are online, and if the management platform does not receive the heartbeat signals within a certain time, considering that the devices are offline or have faults;
[0028] When detecting device or service abnormalities, automatically attempting to restore services by restarting the devices or redeploying services;
[0029] Intelligently allocating tasks and services according to the capabilities and current load of the devices;
[0030] Periodically backing up data and synchronizing data among devices;
[0031] Using encryption communication and security authentication mechanisms to ensure the security of data transmission;
[0032] Recording detailed operation logs and events for troubleshooting, performance analysis, and security auditing.
[0033] Optionally, the device capability distributed collaboration method based on the open source monsoon system, wherein the preset rules include resource availability rules, nearest distance rules, capability matching rules, load balancing rules and priority rules.
[0034] Optionally, the device capability distributed collaboration method based on the open source monsoon system, wherein the automatic scheduling of resources according to the preset rules to respond to abnormal situations and take corresponding recovery measures specifically includes:
[0035] Receiving an event triggered signal when an emergency occurs;
[0036] According to the preset rules, a suitable distributed camera is automatically selected to monitor the accident area;
[0037] According to the preset rules, a specific function unmanned aerial vehicle is dispatched for air monitoring and evaluation;
[0038] When the camera and the unmanned aerial vehicle start working, the real-time video stream is transmitted back to the control center, and the analysis system of the control center analyzes the video stream to identify key information;
[0039] According to the analysis result, guiding the rescue team to carry out rescue action, and controlling the unmanned aerial vehicle to carry the lifesaving equipment, and according to the instruction of the system, the rescue material is thrown to the trapped personnel;
[0040] All information in the rescue process is shared in real time to all relevant units and personnel, ensuring the transparency and collaboration of information.
[0041] In addition, in order to achieve the above purpose, the application also provides a device capability distributed collaboration system based on an open source monsoon system, wherein the device capability distributed collaboration system based on the open source monsoon system comprises:
[0042] The network building module is used for building a discovery mechanism in the target master device with the open source monsoon system, detecting surrounding devices through the discovery mechanism in the target master device, and building a galaxy network of multiple devices based on the distributed capability of the open source monsoon system;
[0043] The service flow module is used for identifying the preset operation mode of the user, pulling up the atomized service according to the identification result, and supporting the seamless flow of the atomized service between different devices and the real-time sharing of data through the galaxy network;
[0044] The display operation module is used for displaying images or information from different devices on the distributed screen, and remotely operating the robot in the galaxy network through distributed control technology;
[0045] A monitoring and scheduling module is configured to monitor the device status and service operation in real time, and automatically schedule resources according to preset rules to respond to abnormal conditions and take corresponding recovery measures.
[0046] In addition, the application also provides a terminal, which comprises a memory, a processor, and a device capability distributed collaboration program based on an open-source MEC system stored in the memory and executable on the processor, wherein the device capability distributed collaboration program based on the open-source MEC system implements the steps of the device capability distributed collaboration method based on the open-source MEC system when executed by the processor.
[0047] In addition, the application also provides a computer readable storage medium, which stores a device capability distributed collaboration program based on an open-source MEC system, wherein the device capability distributed collaboration program based on the open-source MEC system implements the steps of the device capability distributed collaboration method based on the open-source MEC system when executed by a processor.
[0048] In the application, a discovery mechanism is built in a target master device with an open-source MEC system, surrounding devices are detected by the discovery mechanism built in the target master device, and multiple devices are grouped into a galaxy network based on the distributed capability of the open-source MEC system; a preset operation mode of a user is identified, an atomized service is pulled up according to the identification result, and the atomized service is seamlessly transferred between different devices and the data is shared in real time through the galaxy network; images or information from different devices are displayed on a distributed screen, and a robot in the galaxy network is remotely operated through a distributed control technology; the device status and service operation are monitored in real time, and resources are automatically scheduled according to preset rules to respond to abnormal conditions and take corresponding recovery measures. The application realizes efficient collaboration and data sharing between devices. BRIEF DESCRIPTION OF DRAWINGS
[0049] Figure 1 is a flowchart of a preferred embodiment of the device capability distributed collaboration method based on the open-source MEC system of the application;
[0050] Figure 2 is a structure diagram of a preferred embodiment of the device capability distributed collaboration system based on the open-source MEC system of the application;
[0051] Figure 3 is a structure diagram of a preferred embodiment of the terminal of the application. DETAILED DESCRIPTION
[0052] For the purposes of the present invention, the technical solutions and advantages will be clearer and more explicit, and the following will be further described in detail with reference to the drawings and examples. It should be understood that the specific examples described herein are only used to explain the present invention and do not limit the present invention.
[0053] The device capability distributed collaboration method based on the open source kaihong system according to the preferred embodiment of the present invention, as shown in Figure 1 The device capability distributed collaboration method based on the open source kaihong system includes the following steps:
[0054] Step S10, a discovery mechanism is built in the target master device with the open source kaihong system, the surrounding devices are detected through the discovery mechanism built in the target master device, and a galaxy network is formed based on the distributed capability of the open source kaihong system.
[0055] Specifically, the kaihong OS device automatically detects the surrounding devices through the built-in discovery mechanism, and quickly forms a galaxy network based on the distributed capability of the open source kaihong system. The built-in discovery mechanism usually refers to a network protocol or a series of technical means that allows devices to automatically discover and identify other devices in the network without human intervention. The following is an example of some common built-in discovery mechanisms and their working principles:
[0056] (1) Universal Plug and Play (UPnP):
[0057] Working principle: UPnP is a network protocol that allows devices to automatically discover and interact with other devices on the network, commonly used in smart home devices.
[0058] Example: When a user connects a new smart light bulb to the home network, a smart switch that supports UPnP can automatically detect the presence of the bulb and allow the user to control the bulb through the smart switch application.
[0059] (2) Bluetooth discovery:
[0060] Working principle: Bluetooth devices broadcast their signals to allow other Bluetooth devices to discover them, and establish a connection through the pairing process.
[0061] Example: When using a Bluetooth headset, after turning on the power of the headset, the smartphone will automatically list the available Bluetooth devices in its Bluetooth settings, and the user can choose to connect.
[0062] In the open-source Kaihong OS, the built-in discovery mechanism can be one or a combination of the above technologies, specifically designed for quickly detecting surrounding devices and forming a network. For example, devices can use mDNS to broadcast their existence and implement fast discovery and connection between devices through the distributed capabilities of the open-source Kaihong OS, such as distributed soft bus technology, to build an efficient and collaborative galaxy network.
[0063] Among them, the surrounding devices generally refer to other devices that are in the same network or physical range as the main device (i.e., the device running the Kaihong OS) in a specific environment and can be detected and involved in distributed collaboration through the built-in discovery mechanism. These surrounding devices can include:
[0064] (1) Smart home devices: smart light bulbs, smart sockets, smart switches, smart door locks, smart cameras, etc.
[0065] (2) Personal electronic devices: smartphones, tablets, laptops, smartwatches, smart bands, etc.
[0066] (3) Office equipment: printers, scanners, projectors, smart conference room systems, etc.
[0067] (4) Industrial automation equipment: robots, sensors, actuators, surveillance cameras on automated production lines, etc.
[0068] (5) Transportation: smart cars, drones, electric bikes, etc.
[0069] (6) Public infrastructure: environmental monitoring sensors, traffic lights, surveillance cameras, emergency call columns, etc.
[0070] (7) Medical equipment: wearable health monitoring devices, smart beds in hospitals, monitoring instruments, etc.
[0071] (8) Retail and commercial equipment: electronic shelf labels, self-checkout systems, smart billboards, etc.
[0072] After these devices are detected by the Kaihong OS device through the built-in discovery mechanism, they can quickly form a collaborative network based on the distributed capabilities of the open-source Kaihong OS, enabling interconnection and data sharing between devices, and providing users with more intelligent and convenient services.
[0073] In the present invention, the distributed capability based on the open source harmonious system refers to a series of technologies and functions provided by the open source harmonious system (Open Harmony or kaihong OS), which support efficient interconnection and cooperation between devices. The following are some key features of the distributed capability of the open source harmonious system:
[0074] (1) Distributed soft bus: The open source harmonious system realizes seamless connection between devices through distributed soft bus technology. This technology abstracts hardware differences, so that different devices can transmit data and instructions as smoothly as on a single device.
[0075] (2) Distributed task scheduling: The system can intelligently allocate and schedule tasks between different devices, optimize resource utilization, and improve task processing efficiency.
[0076] (3) Distributed data management: The open source harmonious system provides distributed data management capability, supports cross-device data access and synchronization, and ensures data consistency and real-time performance.
[0077] (4) Distributed hardware capability sharing: The system allows devices to share their hardware capabilities, such as cameras, screens, storage, etc., so that other devices can remotely use these hardware resources.
[0078] Specifically, the role of the distributed capability based on the open source harmonious system in the device discovery and networking step includes:
[0079] (1) Automatic detection and connection: Devices automatically detect other open source harmonious devices in the surrounding area through built-in discovery mechanisms (such as mDNS, Bluetooth, Wi-Fi, etc.), and establish connections.
[0080] (2) Rapid networking: Once devices are discovered, they can quickly form a distributed network to form a "galaxy network", in which devices can communicate and cooperate with each other.
[0081] (3) Service flow: Distributed capability supports seamless flow of atomic services between different devices, which means users can start a task on one device and continue the task on another device without interruption.
[0082] Through these distributed capabilities, the open source harmonious system provides a solid foundation for distributed collaborative technology of device capabilities, making efficient collaboration and data sharing between devices possible.
[0083] The galaxy network in the present invention refers to a distributed network composed of multiple devices, similar to the structure of galaxies in the universe, each device is like a planet in a galaxy, and they are connected and work together through specific mechanisms.
[0084] A galaxy network is a highly flexible and dynamic distributed network that allows for instant data exchange and resource sharing between devices without relying on centralized control nodes.
[0085] Method of forming a galaxy network:
[0086] (1) Device discovery: First, Kaihong OS devices automatically detect other devices in the surrounding area through built-in discovery mechanisms such as mDNS, Bluetooth, Wi-Fi Direct, etc. These mechanisms allow devices to broadcast their existence and listen to the broadcasts of other devices.
[0087] (2) Establishing connections: Once devices are detected, they establish secure connections through encryption and authentication processes based on the distributed capabilities of the open-source Kaihong system.
[0088] (3) Network formation: After establishing connections, devices form a network topology, with each device acting as a node in the network. These nodes collectively form a galaxy network.
[0089] (4) Distributed software bus: The distributed software bus technology of the open-source Kaihong system provides an abstraction layer that hides the differences in underlying hardware, allowing devices to communicate through standardized interfaces.
[0090] The specific steps are as follows:
[0091] (1) Start the discovery mechanism: Kaihong OS devices start the built-in discovery mechanism to begin scanning for surrounding devices.
[0092] (2) Device identification: The system identifies other Kaihong OS devices in the surrounding area and obtains their network information.
[0093] (3) Initiate connection requests: Devices initiate connection requests to each other and perform necessary authentication.
[0094] (4) Form a network: Through the distributed software bus technology, devices establish stable communication links between each other, forming a galaxy network.
[0095] (5) Network management: The system manages devices in the network, including device joining and leaving the network, as well as the allocation and optimization of network resources.
[0096] Through this method, the galaxy network formed not only enables efficient collaboration between devices, but also dynamically adjusts the network structure according to application requirements, thereby adapting to different application scenarios and needs.
[0097] Step S20, identify the user's preset operation mode, according to the identification result, pull up the atomization service, and support the seamless flow of the atomization service between different devices and the real-time sharing of data through the galaxy network.
[0098] Specifically, the atomization service refers to a fine-grained service unit, which has the following characteristics:
[0099] (1) Independence: The atomization service is an independent and reusable functional unit that can run independently without relying on a complete application.
[0100] (2) Combinability: Multiple atomization services can be combined to provide more complex functions or services.
[0101] (3) Lightweight: The atomization service is usually small, easy to start quickly and distribute.
[0102] The purpose or role of pulling up the atomization service includes:
[0103] (1) Fast response: Through the atomization service, users can quickly access and use specific functions without starting a complete application, thereby improving efficiency.
[0104] (2) Enhance user experience: Atomization services can be started in various ways, such as NFC, scanning, etc., which are more intuitive and convenient, and can improve the user's interaction experience.
[0105] (3) Resource optimization: Since the atomization service is lightweight, it can use device resources more efficiently and reduce unnecessary resource consumption.
[0106] (4) Service flow: Atomization services can be seamlessly transferred between different devices, which means users can start a task on one device and easily transfer to another device to continue, realizing cross-device workflow.
[0107] (5) Modular development: Developers can independently develop and maintain atomization services, which makes application iteration and update more flexible and efficient.
[0108] The purpose of pulling up the atomization service is as follows:
[0109] (1) Diversified starting method: Allow users to choose the most suitable starting method according to specific circumstances, such as using NFC to touch the label, scanning the QR code, etc., which can simplify the user's operation process.
[0110] (2) Instant service: Users can immediately obtain services when needed without going through a complex starting process, which is particularly important for time-sensitive application scenarios.
[0111] (3) Cross-device collaboration: The quick launch of atomized services facilitates cross-device collaboration, allowing users to initiate a service on one device, which may involve the coordinated work of multiple devices.
[0112] Through these purposes, atomized services play a key role in the distributed collaboration technology of open-source HONOROS-based device capabilities, providing users with an efficient, flexible, and convenient service experience.
[0113] The main way to achieve fast response of services is as follows:
[0114] (1) Optimize service launch mechanism: Simplify the launch process of atomized services, reduce user operation steps, and enable services to be quickly activated.
[0115] (2) Diversified launch methods: Provide NFC, scan and other launch methods, which can quickly trigger the launch of services without going through the traditional application interface.
[0116] (3) Lightweight service design: Atomized services are designed to be lightweight, meaning they load and run faster, enabling fast response.
[0117] (4) Distributed capability support: The distributed capabilities of open-source HONOROS enable services to quickly flow between devices after discovery and networking without reinitialization.
[0118] The galaxy network provides the network foundation for the fast response of atomized services. Only when devices successfully network can they efficiently exchange data and work together. The galaxy network ensures high-speed and stable communication between devices, which is the premise of fast response of services. For example, when an atomized service is launched on device A, it may need some data or functions on device B, and the galaxy network makes this communication fast and reliable. The galaxy network supports the seamless transfer of atomized services between different devices. For example, users can start a service on a mobile phone, and then the service can seamlessly migrate to a TV or tablet to continue running, all of which rely on stable network connections. In the galaxy network, the system can quickly schedule resources, including computing resources, storage resources, and network resources, as needed to ensure the fast response of atomized services.
[0119] In summary, the galaxy network is the foundation for the fast response of atomized services, providing the necessary network environment and support to enable atomized services to quickly launch and transfer between different devices, thus achieving efficient user experience.
[0120] In the process of service flow, atomic services can be seamlessly transferred between different devices, while realizing real-time sharing of data.
[0121] Service flow refers to the migration and switching process of atomic services between different devices, which is an important function implemented based on the distributed capabilities of the open-source Hongmeng system. Here is a detailed explanation of service flow:
[0122] (1) Definition of service flow:
[0123] Service flow refers to the process of seamlessly migrating a running service from one device to another device for continuous operation when a user uses an intelligent device. This transfer can be manually triggered or automatically completed by the system based on certain conditions.
[0124] (2) Implementation of service flow:
[0125] Seamless migration: When a user starts an atomic service on device A, such as a video call or a game application, the user can easily migrate the service to device B by simple operations (such as dragging, clicking, etc.), while the state of the service (such as the connection of the call, the progress of the game, etc.) remains unchanged.
[0126] Data synchronization: During the service flow process, relevant data and information also need to be synchronized in real time to the target device, ensuring that users can continue to use the service on the new device and have a consistent operation experience.
[0127] (3) Advantages of service flow:
[0128] User experience: Provides a smoother and continuous user experience, allowing users to seamlessly switch services between different devices and scenarios.
[0129] Resource utilization: Optimizes resource usage, for example, users can transfer running services to a tablet computer when the phone battery is low.
[0130] Flexibility: Increases the flexibility of the system, allowing services to be dynamically adjusted according to user needs and environmental changes.
[0131] In the specific application in the implementation steps:
[0132] Scenario switching: For example, a user watches a video on a mobile phone at home, and when preparing to go out, the video can be migrated to a tablet computer for continuous viewing through service flow.
[0133] Collaborative work: In an office environment, users can transfer ongoing projects or documents from a personal computer to a large screen in a conference room for sharing and discussion with colleagues.
[0134] Through service flow, the device capability distributed collaboration technology based on open source Hongmeng system can realize more intelligent and convenient inter-device collaboration, providing users with more rich and efficient application experience.
[0135] The role of atomized services seamlessly transferring between different devices mainly includes the following points:
[0136] (1) Continuity experience: Ensure that users can seamlessly continue the previous service when switching to different devices, without interrupting ongoing tasks or activities, thus providing continuity and consistency of user experience.
[0137] (2) Flexibility: Users can flexibly transfer services from one device to another according to their needs or changes in the environment, increasing the convenience and adaptability of use.
[0138] (3) Resource sharing: Through service flow, the functions and resources of different devices can be fully utilized. For example, a service may require more powerful processing power or a larger screen, and transferring to a more suitable device can improve efficiency and comfort.
[0139] (4) Multi-device collaboration: Promote the collaborative work between multiple devices, so that multiple devices can jointly complete a task, improving work efficiency and collaboration effect.
[0140] (5) Data synchronization: During the service flow process, relevant data and state information are also transferred synchronously, ensuring that users obtain the latest data and information on the new device.
[0141] (6) Scene adaptation: In different application scenarios, service flow can quickly adapt to environmental changes. For example, in a smart home, users can start watching a video in the living room and seamlessly transfer to the bedroom to continue watching.
[0142] Specific roles are as follows:
[0143] (1) Improve work efficiency: In an office environment, users can transfer the service of editing a document or participating in a video conference from a laptop to a large screen in the conference room, facilitating sharing and discussion with the team.
[0144] (2) Enhance entertainment experience: Users can start watching a movie on their mobile phone at home and transfer the service to the TV for a larger screen and better sound experience.
[0145] (3) Emergency response: In an emergency rescue scenario, front-line personnel can transfer the service of on-site monitoring to the large screen in the command center, so that command personnel can make quick decisions.
[0146] (4) Smart Life: In the smart home system, users can manage ingredients through a smart refrigerator in the kitchen, then view recipes on their phones, achieving seamless connection of smart life.
[0147] Through seamless transfer of atomized services between different devices, the distributed collaboration technology based on the open-source Harmony system can provide users with more intelligent, convenient, and personalized service experiences.
[0148] Real-time data sharing is achieved through the following technical means and processes:
[0149] (1) Distributed Database: The open-source Harmony system may have a built-in distributed database that can store and synchronize data across devices. When atomized services are transferred between devices, the relevant data will be updated in the distributed database, ensuring that all devices access the latest data.
[0150] (2) Data Synchronization Mechanism: The system uses efficient data synchronization mechanisms such as real-time data push, data pull, etc. to ensure that when services are transferred from one device to another, relevant data can be synchronized in real time.
[0151] The following are the steps to achieve real-time data sharing:
[0152] (1) Service state saving: When atomized services run on a device, their state (including user operation history, application internal state, etc.) will be saved.
[0153] (2) Service migration preparation: When the user triggers service transfer, the system will prepare to migrate the service, including packaging the service state and data.
[0154] (3) Data transmission: Through secure network connections, service state and data are transmitted from the source device to the target device. This process may involve data encryption and decryption to ensure the security of data transmission.
[0155] (4) Service state recovery: On the target device, the system will restore the service's running state according to the service state and data transmitted, allowing users to seamlessly continue their previous work.
[0156] (5) Real-time update: After service transfer, if the data on the source device changes, the system will update it in real time to the target device through the data synchronization mechanism, and vice versa.
[0157] Through these steps, the following effects are achieved:
[0158] (1) Seamless experience: Users will not feel service interruption or data loss when switching between devices.
[0159] (2) Consistency: Data on all devices remains consistent, regardless of which device the user operates on, and the user can see the latest information.
[0160] (3) Real-time: Data updates are real-time, ensuring the timeliness and accuracy of information.
[0161] In this way, the device capability distributed collaboration technology based on the open source Hongmeng system can realize real-time sharing of data, providing users with a smoother and more consistent user experience.
[0162] Step S30, display images or information from different devices on the distributed screen, and remotely operate robots in the galaxy network through distributed control technology.
[0163] Specifically, the distributed screen is part of the distributed capabilities of the open source Hongmeng system, which refers to a technology that can integrate and expand the screen content of multiple devices; distributed screen is a technology that allows users to use multiple device screens as a unified display interface, which means that users can extend or mirror the screen content of one device to another device, enabling cross-device display and interaction. The specific features are as follows:
[0164] (1) Screen fusion: multiple device screen content can be fused together to form a larger display area.
[0165] (2) Content sharing: content on different devices can be shared to the screens of other devices, enabling multi-screen interaction.
[0166] (3) Collaborative operation: users can operate on one screen while the effects are displayed on another screen, suitable for collaborative work and entertainment scenarios.
[0167] Effects of using distributed screen:
[0168] (1) Expand the display area: distributed screen allows users to expand their work or entertainment space, for example, extending the content of a mobile phone screen to a TV or tablet for a larger visual experience.
[0169] (2) Enhance interactive experience: through distributed screen, users can interact on different devices, for example, editing a document on one device while viewing reference materials on another device.
[0170] (3) Simplify multi-device management: distributed screen technology simplifies content management and sharing between multiple devices, improving efficiency.
[0171] (4) Adapt to complex application scenarios: In the fields of industrial automation, remote monitoring, etc., distributed screens can provide more flexible and intuitive monitoring and control interfaces.
[0172] (5) Implement remote operation: With the support of distributed control technology, users can operate remote devices such as robots and cameras through distributed screens.
[0173] In the implementation step, the use of distributed screens is to realize distributed control, which allows users to view and control images or information from multiple devices on different screens, which is particularly important for scenarios that require multi-view monitoring and remote operation. For example, in the field of industrial automation, operators may need to monitor the camera pictures of multiple workstations in the central control room and manage them centrally through distributed screens. In smart home, users can view security camera pictures from various rooms on the TV in the living room while controlling them through the phone.
[0174] Among them, the image or information refers to the content displayed on the distributed screen, which can be diverse, depending on the application scenario and the function of the device. Here are some possible content examples:
[0175] (1) Device name: The device name can be displayed on the distributed screen, so that users can quickly identify different devices.
[0176] (2) Device status: Display the working status of the device, such as online, offline, busy, idle, etc.
[0177] (3) Real-time data: For monitoring devices, it may include real-time video stream, sensor data (such as temperature, humidity, air pressure, etc.), geographic location information, etc.
[0178] (4) Operation interface: For remotely operable devices such as robots or drones, the distributed screen may display an operation interface, including control buttons, instruction menus, status indicator lights, etc.
[0179] (5) System notifications: Including system updates, safety warnings, fault prompts, etc.
[0180] (6) Interactive data: In the smart home scenario, it may include light brightness, air conditioning temperature settings, door lock status, etc.
[0181] (7) Multimedia content: In entertainment or education applications, it may include videos, pictures, documents, etc.
[0182] (8) Statistical data: In the field of industrial automation, it may include production data, efficiency statistics, fault history, etc.
[0183] Specifically, here are some specific application scenarios and corresponding information content:
[0184] (1) Smart City: Distributed screens may display traffic flow data, public safety monitoring videos, environmental monitoring data, etc.
[0185] (2) Smart Home: Displaying home security camera footage, appliance status (such as refrigerator food type and freshness), family schedule, etc.
[0186] (3) Industrial Automation: Displaying real-time monitoring footage of production line segments, machine operating parameters, production progress, etc.
[0187] (4) Remote Monitoring: Displaying real-time video monitoring, environmental parameters, and equipment operating status of remote locations.
[0188] (5) Emergency Rescue: In emergency response, displaying maps of affected areas, positions of rescue teams, damage to important facilities, etc.
[0189] These information helps users or system administrators better understand and manage devices and resources in a distributed network, enabling more efficient operation and decision-making.
[0190] Distributed control technology refers to a technology that enables centralized management, operation, and monitoring of multiple devices in a distributed network environment. This technology is an important part of the open-source Harmony system's distributed capabilities, allowing users to coordinate and control different devices. Here is a detailed explanation of distributed control technology:
[0191] Definition and characteristics of distributed control technology:
[0192] (1) Centralized management and operation: Distributed control technology can centrally manage multiple devices in the network, allowing users to control and configure multiple devices from a central point.
[0193] (2) Cross-device coordination: It can coordinate the operation of different devices, enabling multiple devices to work together like a single system.
[0194] (3) Remote operation: Users can remotely operate devices in the network, regardless of their physical location.
[0195] (4) Flexibility and scalability: Distributed control technology is designed to be flexible and can adapt to different sizes and complexities of network environments, and can be expanded as the network grows.
[0196] (5) Real-time feedback: The system can provide real-time feedback on the status and operation results of devices, ensuring that users can make timely decisions.
[0197] Key components of distributed control technology:
[0198] (1) Distributed control protocol: A set of rules and standards for communication and control instruction transmission between devices.
[0199] (2) Control interface: An interface provided for user operation, which can be physical buttons, touchscreens, voice commands, or software interfaces.
[0200] (3) Data processing and decision-making: Process input data from various devices and make control decisions based on pre-set rules or algorithms.
[0201] (4) Security mechanism: Ensure the secure transmission of control instructions and prevent unauthorized access and control.
[0202] Applications in implementation steps, distributed control technology is used to achieve the following functions:
[0203] (1) Image or information display: Display images or information from different devices on distributed screens, such as camera footage, sensor data, etc.
[0204] (2) Remote operation: For example, users can remotely operate robots to perform specific tasks or remotely control lighting, air conditioning, and other devices in smart home systems.
[0205] Through this technology, open source Kaihong system can provide an efficient, flexible, and user-friendly way to manage and control devices in a distributed network, thus achieving the core goal of distributed collaboration of device capabilities.
[0206] Device discovery and networking: Kaihong OS devices automatically detect surrounding devices and form a galaxy network through built-in discovery mechanisms. The surrounding devices may include various types of smart devices such as smartphones, tablets, smart cameras, sensors, robots, etc. Robots as nodes in the network also need to be detected and networked.
[0207] Distributed control technology: Distributed control technology is used to achieve remote operation of robots, which means that robots must have been added to the distributed network managed by the open source Kaihong system and can receive control and instructions from the network.
[0208] Communication protocol: Robots, like other devices, need to follow the same communication protocol to effectively exchange data and transmit control instructions in the network.
[0209] Distributed capabilities: Robots utilize the distributed capabilities of the open-source Hongmeng system, such as distributed soft bus technology, to achieve interconnection and interoperation with other devices.
[0210] Atomic services: Robots may also provide or consume atomic services. For example, a robot can provide an atomic service that allows users to start a specific function of the robot through NFC or scanning a QR code.
[0211] Collaborative work: In smart city, industrial automation, emergency rescue and other application scenarios, robots often need to work with other devices. For example, in industrial automation, robots may need to receive data from sensors to perform tasks, or in emergency rescue, robots may need to work with drones and cameras to assess the scene and perform rescue operations.
[0212] Therefore, robots are closely related to the previous devices, and they together form a distributed collaborative system, each device plays its own role, and can also collaborate with each other through the distributed capabilities provided by the open-source Hongmeng system to achieve more efficient and intelligent operation.
[0213] Step S40, real-time monitoring of device status and service running situation, and automatic scheduling of resources according to preset rules to respond to abnormal situations and take corresponding recovery measures.
[0214] Specifically, the system monitors the device status in real time. The system refers to the entire monitoring system built based on the device capability distributed collaboration technology of the open-source Hongmeng system. This system includes the following key components and mechanisms to ensure the stability and reliability of distributed collaboration:
[0215] Monitoring system:
[0216] Distributed management platform: This is the core of the system, responsible for managing and monitoring the status of devices and services in the entire distributed network.
[0217] Device agent: An agent program installed on each device, responsible for collecting device status information and reporting to the distributed management platform.
[0218] The following are specific measures to ensure the stability and reliability of distributed collaboration:
[0219] (1) State monitoring: The system collects CPU usage, memory usage, network status, service running status and other key indicators of devices through device agents regularly.
[0220] (2) Heartbeat mechanism: The device agent will regularly send a heartbeat signal to the distributed management platform to prove that the device is online. If the management platform does not receive the heartbeat signal within a certain period of time, it may consider the device offline or malfunctioning.
[0221] (3) Fault detection and recovery: The system can detect abnormalities in devices or services and automatically attempt to restore service, such as by restarting the device or redeploying the service.
[0222] (4) Load balancing: The system can intelligently distribute tasks and services according to the capabilities of devices and current load conditions to avoid overloading individual devices.
[0223] (5) Data backup and synchronization: The system regularly backs up data and synchronizes data between devices to prevent data loss.
[0224] (6) Security mechanisms: The system uses encrypted communication and secure authentication mechanisms to ensure the security of data transmission and prevent unauthorized access.
[0225] (7) Log recording and auditing: The system records detailed operation logs and events for troubleshooting, performance analysis, and security auditing.
[0226] Through these measures, the system can timely discover potential problems, quickly respond to abnormal situations, and take appropriate recovery measures to ensure the stability and reliability of the distributed collaborative system. This is crucial for applications such as smart cities, smart homes, and industrial automation that require high system stability.
[0227] Automatic resource scheduling according to preset rules refers to the system automatically allocating and scheduling resources in emergency situations based on predefined logic and conditions to respond to emergency events. Here are some possible rules and specific processes:
[0228] Pre-set rule examples:
[0229] (1) Resource availability rule: The system will prioritize scheduling resources that are currently available and best suited for task execution.
[0230] (2) Nearest distance rule: In emergency rescue, the system may choose the device closest to the accident site for scheduling.
[0231] (3) Capability matching rule: The system will select devices with corresponding functions according to task requirements, such as selecting high-resolution cameras when high-definition monitoring is required.
[0232] (4) Load balancing rule: The system will try to balance the load of each device to avoid overloading some devices while others are idle.
[0233] (5) Priority rule: Some tasks may have higher priority, and the system will prioritize resource scheduling to meet these tasks.
[0234] Specific process expansion:
[0235] (1) Event Trigger: When an emergency situation occurs, such as natural disasters, accidents, etc., the system will receive a signal of event trigger.
[0236] (2) Resource Scheduling:
[0237] Camera Scheduling: The system automatically selects appropriate distributed cameras to monitor the accident area according to preset rules. For example, according to the nearest distance rule, the system will select the camera closest to the accident site.
[0238] Drone Scheduling: The system will also schedule drones with specific functions, such as drones carrying thermal imaging cameras, to conduct aerial monitoring and evaluation according to rules such as capability matching rules.
[0239] (3) Real-time Monitoring:
[0240] Cameras and drones start working, transmitting real-time video streams back to the control center.
[0241] The analysis system of the control center will analyze the video stream to identify key information such as injured personnel and dangerous sources.
[0242] (4) Rescue Command:
[0243] The system guides the rescue team to conduct rescue operations based on the analysis results. For example, if someone is found trapped, the system will instruct the nearest rescue team to go to the rescue.
[0244] Drones can carry lifesaving equipment and deliver rescue supplies to trapped personnel according to system instructions.
[0245] (5) Information Sharing:
[0246] All information during the rescue process, including video monitoring, rescue progress, resource allocation, etc., will be shared in real time to all relevant units and personnel, ensuring information transparency and collaboration.
[0247] Through this process, the device capability distributed collaboration technology based on open source Hongmeng system can quickly and effectively respond to emergencies, improve rescue efficiency and reduce losses. The application of this technology is particularly important in the field of public safety and can play a key role in critical moments.
[0248] Advantages of the invention:
[0249] (1) Achieve efficient interconnection between devices and improve collaboration efficiency.
[0250] (2) Provide multiple ways to start atomic services and enhance user experience.
[0251] (3) Enhance the flexibility and scalability of distributed control, adapt to complex application scenarios.
[0252] (4) Perfect the device and service discovery mechanism, broaden the application scenarios.
[0253] The application realizes device capability distributed collaboration based on an open source Hongmeng system, and provides strong technical support for smart life, industrial production, public safety and other fields. The technology can be widely applied to smart city, smart home, industrial automation, remote monitoring, emergency rescue and other fields in the future, to realize efficient collaboration and data sharing between devices.
[0254] Further, as shown in Figure 2 based on the above-mentioned device capability distributed collaboration method based on the open source Hongmeng system, the application also correspondingly provides a device capability distributed collaboration system based on the open source Hongmeng system, wherein the device capability distributed collaboration system based on the open source Hongmeng system comprises:
[0255] The network building module 51 is used for building a discovery mechanism in the target master device with the open source Hongmeng system, detecting surrounding devices through the discovery mechanism built in the target master device, and building a galaxy network of multiple devices based on the distributed capability of the open source Hongmeng system.
[0256] The service flow module 52 is used for identifying the preset operation mode of the user, pulling up the atomized service according to the identification result, and supporting seamless flow of the atomized service between different devices and real-time sharing of data through the galaxy network.
[0257] The display operation module 53 is used for displaying images or information from different devices on a distributed screen, and remotely operating robots in the galaxy network through distributed control technology.
[0258] The monitoring and scheduling module 54 is used for monitoring the device state and service running condition in real time, automatically scheduling resources according to the preset rules, responding to abnormal conditions, and taking corresponding recovery measures.
[0259] Further, as shown in Figure 3 based on the above-mentioned device capability distributed collaboration method based on the open source Hongmeng system and system, the application also correspondingly provides a terminal, which comprises a processor 10, a memory 20 and a display 30. Figure 3 Only part of the components of the terminal are shown, but it should be understood that all the shown components are not required, and more or less components can be alternatively implemented.
[0260] The memory 20 can be an internal storage unit of the terminal in some embodiments, such as a hard disk or a memory of the terminal. The memory 20 can also be an external storage device of the terminal in other embodiments, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal. Further, the memory 20 can include both the internal storage unit and the external storage device of the terminal. The memory 20 is used to store application software and various data installed on the terminal, such as program codes of the terminal, etc. The memory 20 can also be used to temporarily store data that has been output or will be output. In an embodiment, the memory 20 stores an open-source-Maemo-based device capability distributed collaboration program 40, which can be executed by the processor 10 to implement the open-source-Maemo-based device capability distributed collaboration method.
[0261] The processor 10 can be a central processing unit (CPU), a microprocessor or other data processing chip in some embodiments, which is used to run program codes or process data stored in the memory 20, such as to execute the open-source-Maemo-based device capability distributed collaboration method, etc.
[0262] The display 30 can be an LED display, a liquid crystal display, a touch liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, etc. in some embodiments. The display 30 is used to display information of the terminal and to display a visualized user interface. The components 10-30 of the terminal communicate with each other through a system bus.
[0263] In an embodiment, the steps of the open-source-Maemo-based device capability distributed collaboration method as described above are implemented when the processor 10 executes the open-source-Maemo-based device capability distributed collaboration program 40 in the memory 20.
[0264] The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores an open-source-Maemo-based device capability distributed collaboration program, which, when executed by a processor, implements the steps of the open-source-Maemo-based device capability distributed collaboration method as described above.
[0265] In summary, the application provides a device capability distributed collaboration method, system, terminal and computer readable storage medium based on an open source Honeycomb system, the method comprising: embedding a discovery mechanism in a target master device with an open source Honeycomb system, detecting surrounding devices through the embedded discovery mechanism in the target master device, and forming a galaxy network of multiple devices based on the distributed capability of the open source Honeycomb system; identifying a preset operation mode of a user, pulling up an atomized service according to the identification result, and supporting seamless flow of the atomized service between different devices and real-time sharing of data through the galaxy network; displaying images or information from different devices on a distributed screen, and remotely operating robots in the galaxy network through distributed control technology; monitoring device status and service running in real time, and automatically scheduling resources according to preset rules to respond to abnormal situations and take corresponding recovery measures. The application realizes efficient collaboration and data sharing between devices.
[0266] It should be noted that in this paper, the term "including", "containing" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or terminal including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or includes elements inherent to such process, method, article or terminal. Without more limitations, the element defined by the statement "including a" does not exclude the presence of another identical element in the process, method, article or terminal including the element.
[0267] Of course, those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by a computer program instructing related hardware (such as a processor, a controller, etc.) to complete, and the program can be stored in a computer readable storage medium, and the program can include the processes of the above-mentioned method embodiments when executed. The computer readable storage medium can be a memory, a disk, an optical disk, etc.
[0268] It should be understood that the application of the application is not limited to the above examples, and those skilled in the art can improve or change according to the above description, and all these improvements and changes should belong to the protection scope of the claims of the application.
Claims
1. A device capability distributed collaboration method based on the open source Hongmeng system, characterized by: The device capability distributed collaboration method based on the open source Hongmeng system includes: A discovery mechanism is built into a target host device equipped with the open source Hongmeng system, and surrounding devices are detected through the built-in discovery mechanism in the target host device, and multiple devices are formed into a galaxy network based on the distributed capabilities of the open source Hongmeng system; Identify the user's preset operation mode, launch the atomic service based on the identification result, and support the seamless flow of the atomic service between different devices and the real-time sharing of data through the Galaxy network; Display images or information from different devices on distributed screens and remotely operate robots in the galaxy network through distributed control technology; Monitor device status and service operation in real time, and automatically dispatch resources according to preset rules to respond to abnormal situations and take appropriate recovery measures.
2. The device capability distributed collaboration method based on the open source Hongmeng system according to claim 1 is characterized in that: The method includes: building a discovery mechanism into a target host device equipped with the open source Hongmeng system, detecting surrounding devices through the built-in discovery mechanism in the target host device, and forming a galaxy network of multiple devices based on the distributed capabilities of the open source Hongmeng system, specifically including: Control the target host device equipped with the open source Hongmeng system to start the built-in discovery mechanism and begin scanning surrounding devices; After detecting the peripheral devices through the built-in discovery mechanism in the target master device, the network information of the peripheral devices is obtained, and a secure connection between the target master device and the peripheral devices is established through encryption and authentication based on the distributed capabilities of the open source Hongmeng system; Once the connection is established, a stable communication link is established between devices through distributed soft bus technology, forming a network topology between the devices. Each device acts as a node in the network, and all nodes together constitute a galaxy network.
3. The device capability distributed collaboration method based on the open source Hongmeng system according to claim 1 or 2 is characterized in that: The built-in discovery mechanism includes one or both of network protocol and Bluetooth discovery; the peripheral devices include smart home devices, personal electronic devices, office equipment, industrial automation equipment, transportation, public infrastructure, medical equipment, and retail and commercial equipment.
4. The device capability distributed collaboration method based on the open source Hongmeng system according to claim 1 is characterized in that: Displaying images or information from different devices on distributed screens specifically includes: Display the device name on the distributed screen to help users identify different devices; Display the working status of the equipment on distributed screens to inform users of the equipment status; For monitoring devices, real-time video streams, sensor data, and geographic location information are obtained and displayed on distributed screens; For devices that can be remotely operated, the operation interface is displayed on distributed screens.
5. The device capability distributed collaboration method based on the open source Hongmeng system according to claim 1 is characterized in that: The real-time monitoring of device status and service operation specifically includes: Regularly collect device CPU usage, memory usage, network status, and service operation status indicators through device agents; Regularly send heartbeat signals to the distributed management platform to prove that the device is online. If the management platform does not receive the heartbeat signal within a certain period of time, it will be considered that the device is offline or faulty. When a device or service anomaly is detected, it automatically attempts to restore the service by restarting the device or redeploying the service; Intelligently allocate tasks and services based on the equipment's capabilities and current load conditions; Back up data regularly and sync it between devices; Adopt encrypted communication and security authentication mechanisms to ensure the security of data transmission; Record detailed operation logs and events for troubleshooting, performance analysis, and security auditing.
6. The device capability distributed collaboration method based on the open source Hongmeng system according to claim 1 is characterized in that: The preset rules include resource availability rules, closest distance rules, capability matching rules, load balancing rules and priority rules.
7. The device capability distributed collaboration method based on the open source Hongmeng system according to claim 1 is characterized in that: Automatically dispatching resources according to preset rules to respond to abnormal situations and taking corresponding recovery measures specifically includes: Receive event-triggered signals when an emergency occurs; According to preset rules, the appropriate distributed cameras are automatically selected to monitor the accident area; According to preset rules, dispatch drones with specific functions to conduct aerial monitoring and assessment; When cameras and drones start working, they transmit real-time video streams back to the control center. The analysis system in the control center analyzes the video streams and identifies key information. Based on the analysis results, the rescue team is guided to carry out rescue operations, and the drone carrying life-saving equipment is controlled to deliver rescue supplies to the trapped people according to the system's instructions; All information during the rescue process will be shared with all relevant units and personnel in real time to ensure transparency and coordination of information.
8. A distributed collaborative system for device capabilities based on the open source Hongmeng system, characterized by: The device capability distributed collaborative system based on the open source Hongmeng system includes: A network building module, which is used to build a discovery mechanism into a target host device equipped with the open source Hongmeng system, detect surrounding devices through the built-in discovery mechanism in the target host device, and build a galaxy network of multiple devices based on the distributed capabilities of the open source Hongmeng system; The service flow module is used to identify the user's preset operation mode, launch the atomic service based on the identification result, and support the seamless flow of the atomic service between different devices and the real-time sharing of data through the Galaxy network; Display operation module, used to display images or information from different devices on distributed screens and remotely operate robots in the galaxy network through distributed control technology; The monitoring and scheduling module is used to monitor the device status and service operation in real time, and automatically schedule resources according to preset rules to respond to abnormal situations and take corresponding recovery measures.
9. A terminal, characterized in that: The terminal includes: a memory, a processor, and a device capability distributed collaboration program based on the open source Harmony system stored in the memory and runnable on the processor. When the device capability distributed collaboration program based on the open source Harmony system is executed by the processor, the steps of the device capability distributed collaboration method based on the open source Harmony system as described in any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a device capability distributed collaboration program based on the open source HarmonyOS system. When the device capability distributed collaboration program based on the open source HarmonyOS system is executed by the processor, the steps of the device capability distributed collaboration method based on the open source HarmonyOS system as described in any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Internet of Things transmission communication method based on real-time shared storage and miniature device
CN113810467A
Method for testing task scheduling capability of open source gap operating system
CN117130910A