Application systems and application devices in a networked device collection

Abstract

The embodiment of this specification discloses an application system and application device in a networked device set. The solution includes: multiple devices in the device set are networked and connected to each other, and each device is equipped with an application system, and the application system includes: a user interaction module that interacts with the user; a business module that responds to the interaction with the user and determines the specified business to be executed; a functional support module that supports communication between the device itself and other devices in the device set, searches for capabilities supported by other devices, and determines the device used to execute the specified business in the device set as the target device according to the search results, so as to execute the specified business through the business module of the target device.

Description

Technical Field

[0001] The present specification relates to the field of Internet technology, and in particular to an application system and application device in a networked device set. Background Art

[0002] With the development of computer and Internet technology, the Internet of Things (IoT), smart home and the Internet of Things (IoT) have gradually entered people's lives. In daily work and life, we are no longer surrounded by only mobile phones, but by a variety of smart devices, such as smart TVs, smart speakers, smart watches, smart cameras, etc.

[0003] Although there are more and more smart devices around people, the cooperation between smart devices is still not so "intelligent". It is often necessary for users to actively initiate commands before the smart devices can cooperate to execute business.

[0004] Based on this, a smarter and more versatile application solution is needed. Summary of the invention

[0005] One or more embodiments of the present specification provide an application system and an application device in a networked device set to solve the following technical problem: a more intelligent and more versatile application solution is needed.

[0006] To solve the above technical problems, one or more embodiments of this specification are implemented as follows:

[0007] One or more embodiments of the present specification provide an application system in a networked device set, wherein multiple devices in the device set are networkedly connected to each other, and each of the devices is equipped with the application system, and the application system includes:

[0008] User interaction module, interacting with users;

[0009] A business module, in response to the interaction with the user, determines the designated business to be currently executed;

[0010] The function support module supports communication between the device in which the device is located and other devices in the device set, searches for capabilities supported by the other devices, and determines, based on the search results, a device in the device set for executing the specified service as a target device, so as to execute the specified service through the service module of the target device. One or more embodiments of this specification provide an application device in a networked device set, wherein multiple devices in the device set are networked and connected to each other, and each of the devices is equipped with the application system, and the application device includes:

[0011] at least one processor; and,

[0012] a memory communicatively connected to the at least one processor; wherein,

[0013] The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

[0014] Interact with users through the user interaction module;

[0015] Determine the designated business to be executed currently in response to the interaction with the user through the business module;

[0016] The function support module supports communication between the device itself and other devices in the device set, and searches for capabilities supported by the other devices. Based on the search results, the device used to execute the specified business is determined in the device set as the target device, so as to execute the specified business through the business module of the target device.

[0017] At least one of the above technical solutions adopted in one or more embodiments of this specification can achieve the following beneficial effects:

[0018] Through the functional support module, the devices in the networked device set can communicate with each other, which improves the convenience of communication between the devices. Through the capabilities supported by each device, it can actively make decisions for users, and can select the most suitable target device for users to perform designated services without the need for users to issue instructions, further improving the intelligence of smart devices. Moreover, based on the application system architecture, intelligent interaction between devices is realized, which does not depend on the underlying operating system, and improves the versatility of the solution. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0020] Figure 1 A schematic diagram of the architecture of an application system in a networked device set provided by one or more embodiments of this specification;

[0021] Figure 2 A schematic diagram of a networked device set in an application scenario provided for one or more embodiments of this specification;

[0022] Figure 3 A schematic diagram of a specific architecture of an application system in a networked device set in an application scenario provided by one or more embodiments of this specification;

[0023] Figure 4 A flowchart of a business process in an application scenario provided for one or more embodiments of this specification;

[0024] Figure 5 A schematic diagram of the structure of an application device in a networked device set provided in one or more embodiments of this specification. DETAILED DESCRIPTION

[0025] The embodiments of the present specification provide an application system and an application device in a networked device set.

[0026] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of them. Based on the embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0027] In traditional solutions, in order to solve the problem that smart devices are not "smart" enough, a unified interface for devices can be defined at the operating system level where the application is located, so as to facilitate direct interconnection and interoperability of devices. However, this method is highly dependent on the operating system, making the overall solution less versatile.

[0028] Based on this, Figure 1 A schematic diagram of the architecture of an application system in a networked device collection provided for one or more embodiments of this specification. The system can be applied to different business fields, such as the Internet of Things field, Internet financial business field, e-commerce business field, instant messaging business field, game business field, official business field, etc. The devices included in the architecture can be composed of devices in corresponding fields (such as various smart devices in the Internet of Things system, etc.), and some input parameters or intermediate results of the devices during use allow manual intervention and adjustment to help improve accuracy.

[0029] A meshed device set refers to a device set that contains multiple devices, and a mesh structure connection relationship can be formed between the multiple devices. Figure 2 A schematic diagram of a networked device set in an application scenario provided for one or more embodiments of this specification, wherein each device in the device set (eg Figure 2The TV, mobile phone, IoT device, car computer, cloud and other smart devices shown in the figure are interconnected, and different devices can be connected and communicated through the Internet or near-field network (for example, a short-distance communication network established by Bluetooth, NFC (Near Field Communication), RFID (Radio-frequency identification), zegbee, local area network, etc.). Generally speaking, if the distance between devices is short, near-field communication is preferred for communication. If the distance between devices is far, communication is required through the Internet and the cloud.

[0030] Each device is equipped with Figure 1 Of course, the applications installed on different devices may not be exactly the same. For example, the versions of the application systems installed on the devices are different, the interfaces displayed to users by the application systems are different, and the specific services that the application systems can perform are different according to the different user login accounts. However, the architectures adopted by the various application systems are consistent, and they all contain the following Figure 1 The corresponding modules shown in the figure can play the corresponding function to ensure that each device can communicate with each other through the application.

[0031] like Figure 1 As shown, the application system includes a user interaction module, a business module and a functional support module.

[0032] The user interaction module is mainly used to interact with users through the front end. It can send information to users and receive information input by users, such as showing users the business handling process, giving users voice prompts, receiving information input by users through a virtual keyboard, etc. Generally speaking, when the user interaction module receives information input by users (such as touch screen input, voice input, external peripheral input, etc.), it sends the information to the business module, which processes the business.

[0033] Business module, the application system interacts with the user, responds to the information input by the user, and determines the designated business that the user is currently about to execute or is already in the process of executing based on the information. The designated business can be initiated by the user, or it can be predicted that the user will execute it based on the user's trigger in other businesses. The execution process and logic adopted by the business module may be different for different businesses, but the architecture of the application system based on which the designated business is executed is the same. Generally speaking, during the execution of the business, the business module needs to interact with the cloud and execute the designated business for the user by calling the relevant files stored locally. At this time, the application system in this article can also be used to interact with the cloud.

[0034] The functional support module is used to support the communication between the device where the application is located and other devices in the device set. Figure 2 As shown, based on the different environments, the devices can communicate with each other through near field communication or the Internet.

[0035] On the other hand, during the device communication process, the functional support module can also find the capabilities supported by other devices. Capabilities refer to the functions that a device can achieve, usually including at least hardware and software aspects, such as whether it supports camera functions, whether it has a screen, whether it has a MIC card and other hardware functions, whether it supports specific software modules, built-in operating systems, chip processing capabilities and other software functions. Of course, depending on the different accounts logged in by the user in the application system, the supported capabilities also include business functions such as the business scope that the device can perform.

[0036] In the traditional way, users need to specify the target device to execute the specified service. In order to improve the intelligence of the device in processing services and improve the user experience, the function support module actively selects the target device for the user in the device set according to the capabilities supported by each device found, and executes the specified service for the user through the service module of the target device.

[0037] When executing a specified service on the target device, if the specified service requires the user to log in to an account, the user's account can be automatically logged in on the target device through the functional support module. For example, when a user executes a payment service on the target device, the user logs in to the payment account and makes a payment. If the specified service does not require the user to log in to an account, it can be handled directly on the target device. For example, when a user executes a camera service on the target device, the camera of the target device is called to collect images.

[0038] Through the functional support module, the devices in the networked device set can communicate with each other, which improves the convenience of communication between the devices. Through the capabilities supported by each device, it can actively make decisions for users, and can select the most suitable target device for users to perform designated services without the need for users to issue instructions, further improving the intelligence of smart devices. Moreover, based on the application system architecture, intelligent interaction between devices is realized, which does not depend on the underlying operating system, and improves the versatility of the solution.

[0039] Figure 3 This is a schematic diagram of a specific architecture of an application system in a networked device set in an application scenario provided by one or more embodiments of this specification. The functional support module includes a device discovery module, a device broadcast module, a device registration module and a capability search module.

[0040] When a new device is connected to the device collection, the new device broadcasts the device information of itself to other devices in the device collection through the device broadcast module in the installed application system. At the same time, the device discovery module discovers and collects the device information broadcast by other devices. The device information includes hardware information and software information. The capability search module can determine the capabilities supported by other devices based on the collected device information, where the hardware information corresponds to the hardware capabilities and the software information corresponds to the software capabilities. The device registration module completes the registration of other devices based on the collected device information, and other devices that already exist in the device collection also complete the registration of the new device. Of course, the application system can also include a communication interface, which can be a full-duplex communication module that supports Internet communication and near-field network communication.

[0041] Furthermore, if Figure 3 As shown, the function support module also includes a decision center module. The decision center module and the capability search module can exchange data. It is mainly used to make decisions on behalf of users in the process of executing designated services, not by users, but to actively make decisions and select target devices on their behalf, so as to reduce the actions that users need to perform, and select the most suitable target device for users, so that the target device is selected for users without users knowing, and users can continue to process designated services through the target device, thereby improving user experience.

[0042] Specifically, the decision center module determines whether the device where it is located supports the software and hardware capabilities (including software capabilities and hardware capabilities) required to execute the specified business. If the device where it is located does not support the software and hardware capabilities, it is impossible to continue to execute the specified business on the device where it is located, and it is necessary to select a target device from other devices to execute the specified business. For example, the user is using device A and initiates a specified business through device A. At this time, device A is the device where it is located. In executing the business, it is necessary to collect the user's face image through the camera for face recognition. However, the camera of device A is broken, so it is necessary to select a target device that can support the camera function from other devices to execute the specified business of face recognition. If the device where it is located supports the software and hardware capabilities, the target device is selected based on the determination results of other devices on whether the software and hardware capabilities are supported. At this time, the device that executes the specified business is screened according to the actual needs of the user, the surrounding scene and other conditions. It can be the device itself or a device that supports the software and hardware capabilities in other devices.

[0043] Among them, in some scenarios, if device A originally supports a certain capability, but due to objective reasons in some scenarios, the device cannot use the capability in the current environment, then in the process of selecting the target device, the device will not be selected as the target device. For example, device A supports the capability of video recording and can perform the designated service of face recognition, but when the designated service is about to be performed, during the process of selecting the target device, the camera of the device is occupied by other applications and the video recording function cannot be performed at the current moment, so the device will not be selected as the target device.

[0044] Furthermore, if Figure 3 As shown, the functional support module also includes a state synchronization module. The state synchronization module synchronizes the business operation status between the devices based on the data interaction between different devices in the device set. Once the user executes a business through a device in the device set, the business operation status can be synchronized to all other devices in the device set or only to some devices (for example, the business operation status is only synchronized to other devices that have the ability to execute the business, or further, the business operation status is only synchronized to the selected target device, so as to reduce the consumption of computing resources).

[0045] If the specified service is already in the process of execution, or needs to be continued on other devices, the state synchronization module is required to synchronize the service operation status. If the specified service has not started, or continues to be executed on this device, the state synchronization module may not be required to synchronize, or only the pre-service of the specified service, user account information, etc. may be synchronized.

[0046] In one or more embodiments of the present specification, although the decision center can actively make decisions for the user and select a target device, in some scenarios, the target device ultimately selected may not be what the user really wants to use. For example, the target device selected for the user is the most suitable device for executing the specified service at the current moment, but the user has an agreement with other people to use the target device to talk to them after 1 minute, and it is difficult to complete the specified service within 1 minute. At this time, the user actually wants to use other devices to execute the specified service.

[0047] Based on this, after determining the designated business to be executed, in the user interaction module, the user is prompted (for example, through interface display, voice broadcast, etc.) with the devices in the device set that support software and hardware capabilities (if the device where the application is currently located supports it, the device where the application is currently located can also be used as part of the prompt device). The user can select the device based on the user interaction module and execute the designated business through the selected device to meet the support for user experience in some special scenarios. Among them, the prompt process can be carried out synchronously with the decision center module, or the two forms can be carried out asynchronously or one of them can be carried out selectively based on different scenario requirements.

[0048] In one or more embodiments of the present specification, the decision center module determines the current interaction scene data during the decision-making process, and predicts whether the current interaction scene is a user discomfort scene that is inconvenient for the user to operate based on the interaction scene data. Among them, the interaction scene refers to the scene in which the user uses the device and interacts with the device, and the interaction scene data is collected and can reflect the interaction scene from the front or side. For example, the device status data collected by the posture sensor, gyroscope, etc. carried in the device can directly reflect the user's current interaction scene, or the operation data performed by the user on the device collected by the application system or operating system can be inferred based on it to reflect the user's current interaction scene from the side. The user discomfort scene refers to the conflict between the business currently being executed by the user and the interaction scene.

[0049] At this time, if it is predicted that there is a user discomfort scenario, it means that the user is performing the ongoing service and it is difficult to maintain the interaction scenario and continue to interact with the device to perform the specified service. At this time, according to the software and hardware capability support results of other devices, the target device is determined among other devices so that the user can perform the specified service on the target device, so that the user can maintain the interaction scenario and continue to perform the service without having to perform the specified service in the user discomfort scenario, thus ensuring the user experience.

[0050] For example, the decision center module determines the executing business on the device where it is located (the executing business can be executed by the application system or by other applications in the operating system). In real life, when the user executes the executing business and the specified business on the device, there is often a relatively fixed interaction posture between himself and the device. Here, the interaction posture corresponding to the executing business is called the first interaction posture, and the interaction posture corresponding to the specified business is called the second interaction posture.

[0051] If in real life, when the user performs the first interaction posture and the second interaction posture at the same time, conflicts are likely to occur, and it is inconvenient for the user to maintain the first interaction posture and the second interaction posture at the same time to perform related operations, the interaction scene data can be determined according to the executing business. For example, the executing business is to make a call and feedback the order problem with the customer service. The first interaction posture requires the user to hold the device close to the face, the microphone close to the mouth, and the receiver close to the ear. If the designated business is to input text or obtain information such as order number through the application system, the second interaction posture requires the device to be brought in front of the face to facilitate text input or information acquisition. At this point, there is a conflict between the first interaction posture and the second interaction posture, and it is difficult for the user to perform these two interaction postures at the same time. The interaction scene is a user discomfort scene.

[0052] Furthermore, in a scenario where the user is not comfortable, a target device is selected for the user to execute a specified service. Although this can improve the convenience of the user in the service execution process, the user still needs to manually go to the target device to execute the specified service.

[0053] Based on this, the decision center module temporarily interrupts the ongoing business in the case of user discomfort and instructs the user to continue to operate through the first interactive gesture. In response to the user's operation through the first interactive gesture, after determining the target device among other devices, the target device responds to the user's operation and then resumes the ongoing business. By temporarily interrupting the ongoing business, the user does not need to perform other interactive gestures and can continue to respond on the target device through the interactive gesture, further improving user convenience.

[0054] Still taking the above example of making a call and obtaining information through a device, the decision center module temporarily interrupts the ongoing business and temporarily blocks the conversation line, but does not block the reception of the user's voice. The decision center module can continue to obtain what the user says at this time, but the other party of the call cannot hear it. At this time, the user is prompted by voice, allowing the user to wake up the target device (for example, the target device is a smart TV) through voice, and the information that the user needs to obtain is displayed in the target device, and then the conversation between the user and the caller is resumed.

[0055] Furthermore, if the user needs to specify a specific service to obtain business information (for example, the order number mentioned above), in addition to displaying the business information to the user through the target device and then the user relaying the business information to the caller, the target device can also directly feed back the business information to the executing business through the mesh connection, and directly send a voice to the caller during the call to inform the other party of the business information without the user having to perform additional operations, thereby ensuring the user experience.

[0056] In one or more embodiments of the present specification, in addition to the above-mentioned interaction postures causing user discomfort, there may be other reasons that make it difficult for the user to continue to perform the specified business through his or her own device. At this time, you can also choose to use the target device to assist your own device in performing the specified business.

[0057] Specifically, when the decision center module determines that the device where it is located supports the software and hardware capabilities required to execute the specified business, it usually continues to execute the specified business on its own device. At this time, the application system determines the interaction level between the specified business and the user; the higher the interaction level, the more operations the user needs to perform for the specified business.

[0058] The application system can monitor and collect the network environment of the device where it is located through itself or the underlying operating system. When the device is in an environment such as a basement or subway station, the upper limit of the network transmission speed may be lower than the specified speed. The network environment in this scenario is called a weak network environment. If the device where the application is located is in a weak network environment, it is difficult to continue to perform the specified service by itself. If the interaction level corresponding to the specified service is low, lower than the preset level, and the user needs to perform very few operations (for example, the user is playing an idle game or transferring files from one cloud to another), then the specified service is executed on the target device at this time until the device where the application is located leaves the weak network environment, and then the specified service is continued on the device where the application is located. This ensures that in a weak network environment, users can also perform some specified services that do not require much interaction from themselves through the target device, which improves the user experience while also improving the operating efficiency of these specified services.

[0059] Figure 4 A flowchart of business processing in an application scenario is provided for one or more embodiments of the present specification. When a user starts an application system on a device, its own device information is broadcast through the device broadcast module, and other devices in the device set are discovered through the device discovery module at the same time, and the device is registered through the device registration module.

[0060] When the user is ready to execute a specified service, the user interaction module prompts the user which devices can be used to execute the specified service, and the user selects the target device. Alternatively, the decision center module actively makes a decision and selects the target device.

[0061] The designated service is started on the target device, and during the execution of the designated service, the status of the designated service is synchronized on different devices through a status synchronization module.

[0062] Based on the same idea, one or more embodiments of this specification also provide devices corresponding to the above system, such as Figure 5 shown.

[0063] Figure 5 An application device in a networked device set provided in one or more embodiments of this specification, wherein multiple devices in the device set are networkedly connected to each other, and each of the devices is respectively equipped with the application system, and the application device includes:

[0064] at least one processor; and,

[0065] a memory communicatively connected to the at least one processor; wherein,

[0066] The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

[0067] Interact with users through the user interaction module;

[0068] Determine the designated business to be executed currently in response to the interaction with the user through the business module;

[0069] The function support module supports communication between the device itself and other devices in the device set, and searches for capabilities supported by the other devices. Based on the search results, the device used to execute the specified business is determined in the device set as the target device, so as to execute the specified business through the business module of the target device.

[0070] In the 1990s, improvements to a technology could be clearly distinguished as hardware improvements (for example, improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the method flow). However, with the development of technology, many improvements to the method flow today can be regarded as direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented using a hardware entity module. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the user's programming of the device. Designers can "integrate" a digital system on a PLD by programming it themselves, without having to ask a chip manufacturer to design and produce a dedicated integrated circuit chip. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is similar to the software compiler used when developing and writing programs, and the original code before compilation must also be written in a specific programming language, which is called hardware description language (HDL). There is not only one HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages ​​and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.

[0071] The controller can be implemented in any appropriate manner, for example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (such as software or firmware) that can be executed by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller. Examples of controllers include, but are not limited to, the following microcontrollers: ARC625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that in addition to implementing the controller in a purely computer-readable program code manner, the controller can be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, this controller can be considered as a hardware component, and the devices included therein for implementing various functions can also be regarded as structures within the hardware component. Or even, the devices for implementing various functions can be regarded as both software modules for implementing the method and structures within the hardware component.

[0072] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0073] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0074] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification may be in the form of complete hardware embodiments, complete software embodiments, or embodiments in combination with software and hardware. Moreover, the embodiments of this specification may be in the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0075] This specification is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0076] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0077] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0078] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0079] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0080] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0081] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0082] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0083] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device, equipment, and non-volatile computer storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0084] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0085] The above description is only one or more embodiments of this specification and is not intended to limit this specification. For those skilled in the art, one or more embodiments of this specification may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of one or more embodiments of this specification shall be included in the scope of the claims of this specification.

Claims

1. An application system in a networked device set, wherein a plurality of devices in the device set are networked and connected to each other, and each of the devices is equipped with the application system, and the application system comprises: User interaction module, interacting with users; A business module, in response to the interaction with the user, determines the designated business to be currently executed; A function support module supports communication between the device where the device is located and other devices in the device set, searches for capabilities supported by the other devices, and determines, based on the search result, a device for executing the specified service in the device set as a target device, so as to execute the specified service through the service module of the target device. The function support module also includes a decision center module; The decision center module determines current interaction scene data, and predicts whether the current interaction scene is a user discomfort scene that is inconvenient for the user to operate based on the interaction scene data; If yes, determining a device for executing the specified service from other devices in the device set as the target device; If it is predicted that there is a user discomfort scenario, it means that the user is having difficulty maintaining the interaction scenario while performing the service being executed, and continues to interact with the device to perform the specified service; The decision center module determines an ongoing service on the device where the module is located, wherein the ongoing service corresponds to a first interaction gesture between the user and the device where the module is located, and the designated service corresponds to a second interaction gesture between the user and the device where the module is located; The interaction scenario data is determined according to the executing business, wherein, in the user discomfort scenario, the inconvenience for the user to operate is caused by a conflict between the first interaction posture and the second interaction posture.

2. The application system according to claim 1, wherein the function support module comprises a device discovery module and a capability search module; The device discovery module discovers and collects device information of the device to which the device is currently connected; The capability search module searches for the capabilities supported by the device to which the device itself is currently connected according to the device information.

3. The application system according to claim 2, wherein the decision center module determines, based on the specified service, whether the device where the decision center module is located currently supports the software and hardware capabilities required to execute the specified service, and determines, based on the capability search module, whether other devices in the device set currently support the software and hardware capabilities required to execute the specified service; According to the current determination result of whether the software and hardware capabilities are supported, a device for executing the designated service is determined in the device set as the target device.

4. The application system according to claim 3, wherein the decision center module determines whether the device where the module is located currently supports the software and hardware capabilities required to execute the specified business; If not, a device for executing the designated service is determined from other devices in the device set as the target device.

5. In the application system as described in claim 2, the user interaction module, after the business module determines the designated business to be currently executed, prompts the user with the devices in the device set that support the software and hardware capabilities required to execute the designated business, so that the user can select a device to execute the designated business.

6. The application system as claimed in claim 4, wherein the functional support module further comprises a status synchronization module for synchronizing the status of business operations on a plurality of devices in the device set to facilitate the execution of the designated business.

7. The application system according to claim 1, wherein the decision center module temporarily interrupts the executing business in the case of user discomfort and instructs the user to operate through the first interaction gesture; In response to the operation performed by the user through the first interaction gesture, determining the target device among other devices in the device set; Resume the executing business.

8. The application system according to claim 7, wherein the service information obtained by executing the designated service in the target device is fed back to the executing service through the meshed connection or the user.

9. The application system according to claim 3, wherein the decision center module determines whether the device where the module is located currently supports the software and hardware capabilities required to execute the specified business; If yes, determining the interaction level between the designated service and the user; If the network environment of the device itself is in a weak network environment and the interaction level is lower than the preset level, the specified service is executed on the target device until the device itself leaves the weak network environment, and then the specified service is continued to be executed on the device itself.

10. The application system according to any one of claims 1 to 9, wherein the multiple devices include cloud devices and local devices, and the application system is an application APP installed on the devices.

11. An application device in a networked device set, wherein a plurality of devices in the device set are connected to each other in a networked manner, and each of the devices is equipped with an application system, and the application device comprises: at least one processor; as well as, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute, through the application system: Interact with users through the user interaction module; Determine the designated business to be executed currently in response to the interaction with the user through the business module; The function support module supports communication between the device itself and other devices in the device set, and searches for capabilities supported by the other devices. According to the search result, a device for executing the specified service is determined in the device set as a target device, so as to execute the specified service through the service module of the target device. The function support module also includes a decision center module. Determine the current interaction scene data through the decision center module, and predict whether the current interaction scene is a user discomfort scene that is inconvenient for the user to operate based on the interaction scene data; If yes, determining a device for executing the specified service from other devices in the device set as the target device; If it is predicted that there is a user discomfort scenario, it means that the user is having difficulty maintaining the interaction scenario while performing the service being executed, and continues to interact with the device to perform the specified service; Determine, by means of the decision center module, an ongoing service on the device where the user is located, wherein the ongoing service corresponds to a first interaction gesture between the user and the device where the user is located, and the designated service corresponds to a second interaction gesture between the user and the device where the user is located; The interaction scenario data is determined according to the executing business, wherein, in the user discomfort scenario, the inconvenience for the user to operate is caused by a conflict between the first interaction posture and the second interaction posture.

Images