Electronic device and method for internet of things system, and storage medium

Abstract

The present disclosure relates to an electronic device and method for an Internet of Things (IoT) system, and a storage medium. The method comprises: an electronic device determining that a scenario has changed; and executing an operation to enable one or more IoT devices associated with the changed scenario to obtain application information generated on the basis of the changed scenario, wherein the application information is used for enabling the one or more IoT devices to implement functions adapted to the changed scenario. On the basis of the solution, by means of automatically enabling, on the basis of a change in scenario, an IoT device to implement functions adapted to the new scenario, the flexibility and adaptability of function deployment of the IoT device are improved.

Description

Electronic device, method, and storage medium for internet of things system Reference of Related Applications

[0001] This application claims the benefit of Chinese Patent Application No. 202410883284.7, filed July 2, 2024, entitled “Electronic device, method, and storage medium for internet of things system,” the entire contents of which are incorporated herein by reference. TECHNICAL FIELD

[0002] The present disclosure relates to the field of Internet of Things, and more particularly to electronic device, method, and storage medium for fast adaptation to scenario changes in the field of Internet of Things. BACKGROUND

[0003] Internet of Things (IoT) has been increasingly widely applied due to its great advantages in personalization, intelligence, and automation of data collection, system monitoring, and service provision, and flexibility of network expansion. In order to meet the needs of application scenarios, multiple IoT devices need to be deployed in the relevant environment. Through the collection and processing of data by IoT devices, and the interaction between IoT devices and between IoT devices and remote servers, the corresponding requirements can be met.

[0004] However, IoT devices usually have the feature of single function, and the implementation of their functions depends on specific application scenarios, and the software and hardware need to be bound together, so that one kind of hardware can only implement one function. In order to cope with various scenarios, the traditional solution is to deploy as many different IoT devices as possible. These IoT devices each run different software corresponding to the scenario they are in to implement the tasks assigned to them. When the scenario changes, the original software of the IoT device may no longer adapt to the new scenario. Therefore, in order to adapt to the new scenario requirements, technicians often need to go to the scene to upgrade or update the software of the IoT device when they learn that the function of the IoT device needs to be adjusted, in order to improve the function of the IoT device. Due to the involvement of human beings, the timeliness of software update cannot be guaranteed.

[0005] In addition, the conventional technical solution can also update the firmware of the IoT device through a remote server. Specifically, the server can receive an indication that the IoT device has registered, determine the current version of the firmware of the IoT device, and determine the success status of the last software update. If the current version of the firmware of the IoT device is different from the last version, an update package is sent to the IoT device to update it to the latest version, and the current version of the firmware is recorded, otherwise it is determined that the firmware of the IoT device is already the latest, and this information is saved. Although the update of the software can be carried out through the iterative release of the software version, the upgrade focuses on the repair of specific functions and defects and is irrelevant to the changing scene, and the time of the iterative release is difficult to synchronize with the time of the change of the scene, which also makes it difficult to guarantee the timeliness of the software update.

[0006] Therefore, it is desirable to provide a technology that enables a quick response to the change of the scene in the Internet of Things environment, thereby realizing the automatic and efficient deployment of the functions of the IoT device. SUMMARY

[0007] One aspect of the present disclosure relates to an electronic device for an IoT system. The electronic device can be at the IoT device side. According to embodiments of the present disclosure, the electronic device can include a processor and a memory. The memory can include computer program instructions. The memory and the computer program instructions can be configured to, with the processor, cause the electronic device to: determine that a scene has changed; and perform an operation to cause one or more IoT devices associated with the changed scene to obtain application information generated according to the changed scene, wherein the application information is used to cause the one or more IoT devices to implement functions adapted to the changed scene.

[0008] Another aspect of the present disclosure relates to a method for an IoT system. According to embodiments of the present disclosure, the method can include: determining that a scene has changed; and performing an operation to cause one or more IoT devices associated with the changed scene to obtain application information generated according to the changed scene, wherein the application information is used to cause the one or more IoT devices to implement functions adapted to the changed scene.

[0009] Still another aspect of the disclosure relates to an electronic device for an IoT system. The electronic device can be at a network device side. According to an embodiment of the disclosure, the electronic device can include a processor and a memory. The memory can include computer program instructions. The memory and the computer program instructions can be configured to, through the processor, cause the electronic device to receive indication information indicating a changed scene from an IoT device, the indication information being received when a scene is changed, generate application information according to the indication information, wherein the application information is used to cause one or more IoT devices associated with the changed scene to implement a function adapted to the changed scene, and provide the application information to the one or more IoT devices.

[0010] Still another aspect of the disclosure relates to a method for an IoT system. According to an embodiment of the disclosure, the method can include receiving indication information indicating a changed scene from an IoT device, the indication information being received when a scene is changed, generating application information according to the indication information, wherein the application information is used to cause one or more IoT devices associated with the changed scene to implement a function adapted to the changed scene, and providing the application information to the one or more IoT devices.

[0011] Still another aspect of the disclosure relates to a computer readable storage medium having stored one or more computer program instructions. According to an embodiment of the disclosure, the one or more computer program instructions can, when executed by a processing device, cause the processing device to perform the above-described method.

[0012] The above summary is provided to summarize some example embodiments and to provide an initial understanding of the aspects of the subject matter described herein. The above summary does not necessarily identify key or essential features of the subject matter described herein and shall not be construed as identifying any one or more examples as critical or essential to the subject matter described herein. Other features, aspects, and advantages of the subject matter described herein will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0013] A better understanding of the present disclosure can be obtained from the following detailed description in conjunction with the following drawings, in which:

[0014] FIG. 1 is a diagram of an example of an Internet of Things (IoT) environment according to an embodiment of the disclosure;

[0015] FIG. 2 is a flowchart of a method for deploying a function of an IoT device according to an embodiment of the disclosure;

[0016] FIG. 3 is a flowchart of a method of updating a function by generating application information through an IoT device according to an embodiment of the disclosure;

[0017] FIG. 4 is a flowchart of a method of updating a function by generating application information through a server according to an embodiment of the disclosure;

[0018] FIG. 5 is another flowchart of a method for deploying a function of an IoT device according to an embodiment of the disclosure;

[0019] FIG. 6 is a diagram of an example of a software architecture of an IoT device according to an embodiment of the disclosure;

[0020] FIG. 7 is a diagram of an example of a scenario according to an embodiment of the disclosure;

[0021] FIG. 8 is a flowchart of a process used in the scenario of FIG. 7 according to an embodiment of the disclosure;

[0022] FIG. 9 is a diagram of an example of another scenario according to an embodiment of the disclosure;

[0023] FIG. 10 is a block diagram of an example structure of a personal computer as an information processing apparatus that can be employed in embodiments of the present disclosure;

[0024] FIG. 11 is a block diagram showing a first example of a schematic configuration of a gNB to which the technology of the present disclosure can be applied;

[0025] FIG. 12 is a block diagram showing a second example of a schematic configuration of a gNB to which the technology of the present disclosure can be applied;

[0026] FIG. 13 is a block diagram showing an example of a schematic configuration of a smartphone to which the technology of the present disclosure can be applied; and

[0027] FIG. 14 is a block diagram showing an example of a schematic configuration of a car navigation device to which the technology of the present disclosure can be applied.

[0028] While the embodiments described in the present disclosure can be susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and are herein described in detail. It should be understood, however, that the drawings and detailed description thereto are not intended to limit the embodiments to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the claims. DETAILED DESCRIPTION

[0029] The following description of representative applications of aspects of devices and methods according to this disclosure is provided for the purposes of increasing context and helping with understanding the described embodiments. Thus, it will be apparent to a person skilled in the art that the described embodiments below can be implemented without some or all of the specific details given below. In other cases, well-known process steps are not described in detail so as not to unnecessarily obscure the described embodiments. Other applications are also possible, and the solutions of this disclosure are not limited to these examples.

[0030] Referring first to FIG. 1, a diagram of an Internet of Things (IoT) environment 100 in which a plurality of IoT devices 110-1 to 110-N are deployed is described.

[0031] The IoT devices deployed in the IoT environment 100 can be the same or different. The IoT devices can be cameras, robots, sensors, mobile terminals, tablet computers, personal computers, other devices with information collection / processing capabilities, etc. One IoT device can communicate with one or more of the other IoT devices, and the communication between the IoT devices can be accomplished through direct communication or through indirect communication via other devices (e.g., other IoT devices or remote servers). The communication mode can be wireless communication based on WiFi, sidelink communication, etc., or can be wired communication based on cables. Although only the IoT device 110-1, the IoT device 110-2, the IoT device 110-3, and the IoT device 110-N are shown in FIG. 1, a person skilled in the art can understand that there can be more or fewer IoT devices in the IoT environment 100, which cooperate with each other to perform functions corresponding to the scenario in which they are located.

[0032] The IoT environment 100 can communicate with an external network 200. The external network 200 can be a network containing a server 210 (e.g., a cloud system), can be a remote control platform, or can be other IoT environments. Through the interaction with the IoT environment 100 via the external network 200, data of the IoT devices in the IoT environment 100 can be obtained for further processing, the IoT devices can be monitored, or requests sent by the IoT devices can be responded to.

[0033] In addition to the IoT devices 110-1 to 110-N, the IoT environment 100 can also include one or more processing devices (not shown), such as servers, personal computers, etc. The processing devices can process data from the IoT devices 110-1 to 110-N, centrally control the IoT devices 110-1 to 110-N, or communicate with the outside world (such as the external network 200, etc.) on behalf of the IoT devices 110-1 to 110-N.

[0034] One or more scenarios in the IoT environment 100 can be related to the location where the respective IoT device 110-1 to 110-N is located. For example, the scenario corresponding to the IoT device 110-1 is at the entrance of a supermarket, the scenarios corresponding to the IoT devices 110-2 and 110-3 are at the food shelf area of the supermarket, the scenario corresponding to the IoT device 110-N is at the checkout area of the shopping mall, and so on. Of course, these IoT devices can also correspond to the same scenario (for example, at the swimming pool area, the restaurant area, etc.).

[0035] When deploying the IoT devices, the correspondence between the IoT devices and their associated scenarios can be established in advance. For example, the IoT device 110-1 corresponds to scenario 1, the IoT device 110-2 corresponds to scenario 2, the IoT device 110-3 corresponds to scenarios 2 and 3, the IoT device 110-N corresponds to scenario 4, and so on. These correspondences can be stored in the IoT devices, in the processing devices that can exist in the IoT environment 100, and in the servers accessed through the external network 200. When the IoT device needs to determine the IoT device related to the scenario, it can access the corresponding storage location to obtain the information of the related IoT device.

[0036] When the scenario corresponding to the IoT device changes, the current function of the IoT device can no longer be suitable for the changed scenario. This requires timely adjustment of the function of the IoT device. For example, the current function of the IoT device is to recommend dishes to customers according to dish satisfaction, but part of the ingredients in the kitchen are sold out, and if the IoT device does not know about the occurrence of this situation and still only recommends dishes according to the currently known dish satisfaction, it may recommend dishes that cannot be sold to customers, which will greatly affect the user experience. Therefore, the function of the IoT device that wants to recommend dishes can be adjusted in a timely manner according to the change in the scenario caused by the sale-out of part of the ingredients. However, the existing way of updating software through manual intervention or iteratively updating software through a server is difficult to respond to the change in the scenario in a timely and effective manner, resulting in outdated or ineffective functions of the IoT device, which greatly affects the performance of the Internet of Things and reduces the user experience.

[0037] Therefore, the embodiments of the present disclosure provide a method for enabling the function of the IoT device to automatically adapt to the scenario, so that the function of the IoT device can be automatically and efficiently deployed when the scenario changes, thereby improving the performance of the Internet of Things and enhancing the user experience. A flowchart of a method 200 for deploying the function of the IoT device is shown in FIG. 2. For ease of understanding, the IoT environment 100 of FIG. 1 will be referred to, and the method 200 will be described taking the IoT device 110-1 as an execution subject. Those skilled in the art can understand that other IoT devices can also execute the process of the method 200.

[0038] In S210, it is determined that the scene changes.

[0039] The IoT device 110-1 can determine that the scene corresponding to itself changes, or determine that the scene corresponding to other IoT devices changes. The scene corresponding to the IoT device 110-1 itself and the scene corresponding to other IoT devices can be the same scene or different scenes. The reason for determining the change of the scene is to update the functions of the IoT devices associated with the changed scene in time when the scene changes, so as to adapt to the new scene as soon as possible.

[0040] According to an embodiment of the present disclosure, the IoT device 110-1 can detect the scene within its detectable range. In the case where the detected scene indicates the occurrence of a predetermined event, the IoT device 110-1 determines that the scene changes. The scene indicating the occurrence of the predetermined event can also be referred to as the changed scene or the new scene.

[0041] For example, the IoT device 110-1 can have one or more cameras. The camera can monitor the state information about objects such as articles, people, animals, plants, raindrops, etc. within its field of view, thereby detecting the scene within the field of view. The scene can be the scene corresponding to the IoT device 110-1 itself or the scene corresponding to other IoT devices. For example, the camera can use an existing algorithm or an existing artificial intelligence (AI) chip or an AI chip trained for specific scene information according to application requirements, detect the scene by analyzing the content of the photographed picture or video, thereby obtaining scene information related to the scene, such as how many people gather, whether the people are crowded, the distribution of people, the popularity of goods, the number of goods reduced, whether the shelf is empty, etc. Those skilled in the art can understand that in the process of training the AI chip, the AI chip can be trained for a specific target through supervised learning. For example, different people gathering patterns in a large number of pictures can be labeled, so that the AI chip can determine whether there is people gathering according to one or more frames in the picture or video. The training method of obtaining the information of interest by using the picture or video is easy to be implemented by those skilled in the art, and will not be described here.

[0042] When the scene information related to the detected scene indicates that a predetermined event occurs, it can be determined that the scene changes, and then the function of the associated IoT device needs to be updated. For example, the scene detected by the IoT device 110-1 can be in a state of change at any time, such as personnel moving in the scene, personnel entering and exiting, goods moving, goods falling, etc. However, it should be noted that not all changes mean that the scene changes. In an embodiment of the present disclosure, the occurrence of a predetermined event means that the scene changes. The predetermined event can be an event that has a close relationship with the function of the IoT device. Different events require different functions to be implemented by the IoT device.

[0043] For example, the predetermined event can include personnel gathering (e.g., the number of people in a certain range such as a square with a side length of 2 meters, a rectangle with a length of 3 meters and a width of 1 meter, a semicircle with a radius of 2 meters, etc. exceeds a threshold value, etc.), a shortage of a certain goods (e.g., a shelf on which goods are stacked becomes empty, etc.), a certain goods is popular (e.g., the speed of decrease within a predetermined time is greater than a threshold value, etc.), a robot tray is idle, etc. Different predetermined events require the IoT device to implement functions corresponding thereto. For example, the occurrence of a personnel gathering event requires the IoT device related thereto to prevent new personnel from entering, etc.; the occurrence of a certain goods shortage event requires the IoT device related thereto to transport goods from the warehouse, etc.; the occurrence of a certain goods popular event requires the IoT device related thereto to adjust the order in which goods are presented to customers, etc. When the predetermined event occurs, the IoT device 110-1 determines that the scene changes, and at this time the related IoT device needs to be adjusted to a function corresponding to the predetermined event.

[0044] According to an embodiment of the present disclosure, the IoT device 110-1 can also receive information related to the scene it detects from other IoT devices (e.g., 110-2), and determine that the scene changes according to the received information.

[0045] Like the IoT device 110-1, other IoT devices (e.g., 110-2) can also have one or more cameras and obtain information of the scene within the field of view of the camera. For example, the IoT device 110-2 can obtain information of the scene related to the IoT device 110-1. For example, the IoT device 110-2 uses the intelligent chip installed therein to determine the occurrence of a predetermined event as described above, such as the tray of the IoT device 110-1 being idle, or one or more of the products recommended by the IoT device 110-1 being in short supply, etc., by analyzing the pictures or videos taken, and notifies the IoT device 110-1 of the information related thereto. The IoT device 110-1 that obtains the information can determine that the scene changes by determining the occurrence of the predetermined event.

[0046] The information sent by the IoT device 110-2 to the IoT device 110-1 can be information indicating that a predetermined event occurs (e.g., informing a specific predetermined event), or can be information of a picture or video acquired to enable the IoT device 110-1 to determine that a predetermined event occurs by analysis. In addition, the IoT device 110-2 can send relevant information of the scene it detects to the IoT device 110-1 only when it determines that a predetermined event occurs. Those skilled in the art can understand that the scene-related information sent by the IoT device 110-2 to the IoT device 110-1 can be about the scene of the IoT device 110-1, or about its own scene, or about the scene of another IoT device.

[0047] Those skilled in the art can understand that the change of the scene can also be determined by training a corresponding AI model. The trained AI model can determine the change of the scene according to the difference between the current scene and the previous scene, thereby indicating that the IoT device needs to make corresponding adjustments. For example, the AI model can be trained by inputting a large amount of scene content and corresponding IoT device functions to it.

[0048] In S220, an operation is performed to enable one or more IoT devices associated with the changed scene to obtain application information generated according to the changed scene, wherein the application information is used to enable the one or more IoT devices to implement functions adapted to the changed scene.

[0049] After the IoT device 110-1 determines that the scene has changed, the IoT device 110-1 determines the IoT device associated with the new scene by utilizing the correspondence between the scene and the associated IoT device, and performs an operation to enable the IoT device corresponding to the new scene to obtain application information generated according to the new scene. The IoT device obtaining the application information can implement functions corresponding to the new scene according to the application information, thereby being able to adjust the functions in a timely manner according to the scene without human intervention, thereby improving the response speed of the Internet of Things to the change of the scene, and improving the network performance. It should be understood that the IoT device associated with the new scene can include the IoT device 110-1 itself, which means that the IoT device 110-1 can not only update other IoT devices, but also can update itself.

[0050] The application information can be an application program related to the changed scene, can be data related to the changed scene, can be a data program compiled from the data related to the changed scene, and can further be any combination of the above information. For example, when the application information is an application program, the IoT device can execute a corresponding function by running the application program; when the application information is data, the IoT device can change an inference result by providing the data as input to, for example, an AI model, can update an existing AI model through small sample learning according to the data, or can provide the data as a parameter to a program to change the behavior of the program; when the application information is a data program, the IoT device can read relevant data from the data program by executing the data program and change an AI model inference result, update an AI model, or change a program behavior based on the obtained data. In the context of the present disclosure, the data program is a program that can read and write data therein, and provides an interface for data, which is used to access the data, thereby increasing the security of the data. In some cases, the application program and the data program can be collectively referred to as a program.

[0051] The application information generated according to the changed scene can be completed by the IoT device 110-1 or by the server through a request sent by the IoT device 110-1 to the server. Regardless of the way in which the application information is generated, the application information will be provided to one or more IoT devices associated with the new scene to achieve a function adapted to the new scene. A flowchart of a method 300 of updating a function by generating application information by an IoT device is shown in FIG. 3, and a flowchart of a method 400 of updating a function by generating application information by a server is shown in FIG. 4. For ease of understanding, FIGS. 3 and 4 will also be described by taking the IoT device 110-1 as an execution subject in the Internet of Things environment 100 shown in FIG. 1, and it can be understood by those skilled in the art that other IoT devices are also applicable.

[0052] As shown in FIG. 3, in S310, the IoT device 110-1 determines that the scene has changed. This step is basically the same as S210, and will not be described again here.

[0053] In S320, the IoT device 110-1 generates application information according to scene information related to the changed scene. For example, the scene information can be obtained by analyzing a picture or a video (for example, by using an AI chip to analyze), which can represent the state of an object contained in the scene, such as a gathering of people, an empty tray, or a pile of goods. The application information can be an application program, data, and / or a data program, as described above, and the function of the IoT device can be updated through the application information, such as causing the IoT device to perform a new operation, update an output result, and the like.

[0054] According to an embodiment of the disclosure, the IoT device 110-1 can generate semantic information for describing the changed scene according to the scene information, and then generate application information according to the semantic information.

[0055] For example, the scene information can be information perceived by the IoT device 110-1 through a sensor such as a camera. These information can be processed as a parameter set for describing parameters related to the changed scene, such as the number of people gathered, the variety of goods, and / or the degree of popularity of goods, etc. These information can also be processed as a script language for describing the characteristics of the changed scene, such as that a certain goods is being snatched by people, that the nearby robot tray is empty, etc. Both the parameter set and the script language belong to the semantic information. Of course, the semantic information can also be implemented by some multi-dimensional vector, content written in a programming language or prompt, as long as the new scene can be described through the semantic information. The situation that will cause the existing function of the IoT device to be no longer applicable and / or the function of the IoT device to be changed.

[0056] Then, for example, key data for describing the scene can be generated from the semantic information as application information. For another example, the semantic information can be converted into a program as the application information by using a compiler technology. In one example, the semantic information can be converted into a program by LLVM (Low Level Virtual Machine) or a compiler technology based on LLVM (e.g. warmc). In particular, the semantic information can be converted into a program in the form of wasm (WebAssembly) (which can also be referred to as a wasm application) by LLVM or a compiler technology based on LLVM (e.g. warmc), so that the implementation of the function of the IoT device is more optimized, and the corresponding program can be efficiently executed on the IoT device. The wasm application can be compiled into an AOT format, and the AOT format can be configured to run under XIP. For example, a tool chain compiled by wasm can be deployed on the IoT device for compiling application data into a data program or compiling a device function to be implemented into an application program. And, a sandbox system can be provided for the program to protect the security of the program execution. Although the above process of converting the semantic information into a program is implemented by using the existing compiler technology, those skilled in the art can understand that with the development of the compiler technology and the development of the AI model that can generate code and can be used as a compiler, various ways of converting semantic information into a program will appear in the future, which all belong to the conversion by using the compiler technology.

[0057] In S330, the IoT device 110-1 provides the application information to one or more IoT devices associated with the changed scene.

[0058] Before providing the application information, the IoT device 110-1 can determine one or more IoT devices associated with the changed scene according to a pre-stored or obtained correspondence between a scene and associated IoT devices. Of course, if all the IoT devices are associated with the same scene, the IoT device 110-1 can not determine the IoT devices associated with the new scene.

[0059] The IoT device 110-1 can provide the application information directly to the IoT devices, or through the forwarding of other IoT devices or servers or processing devices in the IoT environment. In addition, the IoT device 110-1 can determine whether the IoT devices associated with the new scene have the ability to process the application information, and send the application information if it is determined that they have the ability. For example, if the hardware version of an IoT device is too low to support the execution of the application information, or if the IoT device is not sensitive to the data contained in the application information (for example, the data is not useful to the IoT device, is not the input information of its AI model, etc.), the IoT device 110-1 can not send the application information to such IoT device, in order to save network transmission resources and avoid power consumption of the IoT device. Of course, the IoT device 110-1 can also directly provide the application information without considering the capabilities of those IoT devices, and whether to use the application information is determined by those IoT devices themselves. The IoT devices using the application information can adjust their own functions accordingly to adapt to the changed scene.

[0060] In addition to being generated by the IoT device, the application information can also be generated by, for example, the external network 200 or the server contained in the IoT environment 100, as shown in the method 400 of FIG. 4.

[0061] In S410, the IoT device 110-1 determines that the scene has changed. This step is basically the same as S210, and will not be repeated here.

[0062] In S420, the IoT device 110-1 sends indication information indicating the changed scene to the server, so that the server generates application information according to the indication information and provides the application information to one or more IoT devices associated with the changed scene.

[0063] The indication information can be regarded as request information for requesting the server to generate application information corresponding to the changed scene according to the indication information. According to an embodiment of the present disclosure, the indication information can include scene information related to the changed scene, can include semantic information generated according to the scene information related to the changed scene to describe the changed scene, or can include both. As described above, the scene information can be information perceived by a camera or information output by an AI chip analyzing a photographed picture or video, which can describe the scene in a predetermined format or mode. The semantic information can be generated based on the scene information, such as a parameter set, a script language, etc. Through further extraction and / or analysis of the scene information, information that will trigger the function update of the IoT device can be selected as the semantic information. For example, a correspondence relationship between different scene features and IoT device functions can be set in advance, and when the scene information becomes to contain a certain scene feature, the scene feature is converted into semantic information to describe it.

[0064] For example, the IoT device 110-1 can provide the scene information to the server directly after determining that the scene has changed. The server can first convert the scene information into semantic information as the IoT device 110-1 does in S320, and then convert the semantic information into a program through a compiler technology as application information for providing to the IoT device associated with the new scene. For another example, the IoT device 110-1 can convert the scene information into semantic information after determining that the scene has changed, and then send the semantic information to the server. Thus, the server can directly convert the semantic information into a program through a compiler technology. Since part or all of the application information generation process can be transferred to the server to be completed, the power consumption of the IoT device can be saved.

[0065] According to an embodiment of the present disclosure, the IoT device 110-1 can send indication information indicating the changed scene to the server in a case where it does not have the capability to generate application information according to the scene information related to the changed scene. For example, the IoT device 110-1 does not have a compiler installed therein, and thus it cannot convert the scene information into a program. For another example, the IoT device 110-1 is limited in processing resources, storage space, battery capacity, etc., and thus it cannot convert the scene information into a program. Since the software and / or hardware of the IoT device 110-1 are difficult to enable the IoT device 110-1 to complete the generation of the application information locally, the IoT device 110-1 can seek the help of the server to generate the application information according to the scene information. Of course, the IoT device 110-1 can request the server to generate the application program as needed in a case where it has the capability to generate the application program itself, for example, in a case where it needs to save processing resources, there is a task with higher priority, etc.

[0066] The server can generate the program in the form of wasm according to the scene information and / or the semantic information by using the compiler technology, as in S320, so as to efficiently run the generated program at the IoT device. The application information generated by the server can be directly sent to the IoT device associated with the new scene by the server, or sent to the IoT device (e.g., IoT device 110-1) that sends the indication information by the server. After the IoT device 110-1 receives the application information, it can send it to the IoT device associated with the new scene by forwarding. Of course, those skilled in the art can understand that the device that performs the forwarding of the application information can also be the server or the IoT device that does not send the indication information in the Internet of Things environment 100, as long as the message destination is carried in the message to be forwarded.

[0067] The IoT devices associated with the new scene to which the application information needs to be sent can be determined by the server from the indication information. At this time, the indication information can further carry the indication of these IoT devices, which is determined by the IoT device 110-1 according to the corresponding relationship between the scene and the associated IoT device. The server can also determine the IoT devices associated with the new scene according to the indicated changed scene according to the corresponding relationship between the scene and the associated IoT device which it stores in advance.

[0068] After the IoT devices associated with the new scene obtain the application information, they can implement the function suitable for the new scene by using the application information, thereby achieving the effect of automatically adjusting the function according to the change of the scene without human intervention. According to the embodiments of the present disclosure, the IoT devices associated with the new scene need to perform legality check on the application information, and only after passing the legality check, the application information is used. In this way, the security of the Internet of Things can be improved, and the risk of being attacked by arbitrarily receiving unknown information can be avoided. For example, the IoT device can check whether the application information is from a legal IoT device or server (e.g., the IoT device knows that the device with the IP address or physical address is a legal device), check whether the generation time stamp of the application information is within a predetermined time period, and / or check whether the function purpose corresponding to the application information is an achievable purpose, etc., to perform legality check on the application information.

[0069] IoT devices can change their operation by executing application programs and / or data programs as application information, thereby implementing new functions. According to embodiments of the present disclosure, programs can be stored in IoT devices in the form of XIP (eXecute In Place). Programs stored in the form of XIP in memory do not need to be loaded into memory to be executed, thereby improving the startup speed of the programs. Also, programs stored in the form of XIP in memory occupy a fixed storage area, thereby when updating the programs, the storage area can be overwritten without affecting other storage areas. In view of the limited resources of IoT devices in the Internet of Things environment, the need for adaptability to scenarios and flexibility of functions, etc., the adoption of XIP in IoT devices has at least the following advantages. First, the software of a conventional IoT device is one whole, i.e., the software of the entire device is integrated. From the operating system (OS), hardware abstraction layer (HAL), framework (Framework), application program (APP), all together, as an image. When a small part of logic needs to be updated, the entire software image is rewritten. The APP in the form of XIP running in a sandbox can be deployed independently. When the APP needs to be updated, only the relevant APP can be updated without making changes to other parts. Thus, when transferring programs from one device to another, if a file system is used, frequent updates of programs can cause file fragmentation. When fragmentation is serious, even if the total storage space is sufficient, the file cannot be deployed. However, the program in the form of XIP is a whole continuous file, which usually occupies a fixed area on the memory (such as flash memory) and is not easily fragmented. In order to adapt to frequent updates of programs, taking the form of XIP can more reasonably and efficiently utilize the storage space. Second, the program carried by the conventional executable program form needs a specific format, such as PE / ELF format. These formats can not be suitable for parsing and running on resource-constrained IoT devices, because they require more software and hardware resources, such as a file system. XIP is usually a custom format with a direct memory instruction image of an executable program. When a program needs to be transferred, only the program file is transmitted as a data block to other devices. Third, the loading of a conventional application program needs to parse files in PE / ELF format, and the system can need to provide or require some additional information, such as the installation path of the program, the dependent library, etc. The program in the form of XIP on the IoT device does not need these additional information. The program in the form of XIP is placed in a specific flash memory partition of the IoT device, and is mapped to virtual memory when starting, just like the program already exists in the memory, so its loading speed is very fast. When uninstalling the program in the form of XIP, only another program in the form of XIP needs to overwrite this flash memory partition, and then remap to the virtual space. The system does not need to register any information, greatly simplifying the operation of the IoT device and saving its resources and power.

[0070] In addition, the IoT device can produce an inference output that is adapted to the new scenario by providing data related to the new scenario as application information to the prediction model, or can cause the program to exhibit an action that is adapted to the new scenario by providing the data to the parameters of the built-in program. In addition, the data as application information can also train the current model through small sample learning to perform an operation adapted to the new scenario. Such data causes the IoT device to exhibit a function adapted to the new scenario.

[0071] The function of the IoT device can be automatically updated by the automatically generated program and / or data depending on the change of the scenario, which not only makes the deployment of the IoT device more flexible and more adaptive, but also reduces the complexity at the time of initialization. The reason is that at the time of initialization, only the default function corresponding to the scenario at the time of initial installation can be deployed to the IoT device. The default function may, for example, be a recording function of goods on the shelf when installed on a supermarket shelf, an ordering function when placed in a restaurant, a route guiding function when placed in a shopping mall, and the like. The update of the subsequent function can be automatically performed through the perception of the IoT device to the change of the scenario.

[0072] The real-time change of the application scenario causes the traditional software deployment method to be unable to adapt to such changes. However, by using the method of the embodiments of the present disclosure, the software and data on the IoT device can be flexibly changed according to the scenario, so that the business can be more intelligently and efficiently processed. Through the execution of the above-mentioned scheme, the IoT device can quickly respond to the change of the scenario without human intervention. Thus, the IoT device can adapt to the new scenario more quickly and accurately, thereby improving the network performance and improving the user experience.

[0073] In addition, as described above, the change of the scenario can be perceived by the local device, or can be perceived by other devices in the entire environment. Once the change of the scenario is perceived, the relevant IoT device can be directly or indirectly (for example, via a server) notified to update the software, so as to redefine the function of the device. This means that the function of the device can be defined by the local real-time demand, rather than by the cloud server user, thereby improving the real-time and autonomy of the software update.

[0074] In addition, the update of the function can not only refer to the upgrade of the related application or software development kit (SDK), but also include the support of different functions in different scenarios, or even switch from one function to another according to the conversion of the device and the scenario. The software package deployed into the IoT device can be compiled from multiple languages (C, JAVA, JS, etc.), and then converted into a binary file locally, and then sent to the corresponding device via the server side or through the IoT device to execute the related function. By adaptively generating the corresponding program based on the scenario, the deployment of the related software can be completed according to the change of the scenario on the IoT device with limited resources, and the adaptability of the IoT device and the flexibility of the function deployment are improved. By the XIP scheme, the program is executed and the program switching is completed, and the memory resources can not be occupied, so that the hardware usage is optimized. Moreover, since the sandbox system can be used, the security of the program running possibly from the third party can be ensured, and since the program runs in the sandbox system and cannot execute the operation not assigned, the local environment is protected from threats and invasions.

[0075] A flowchart of a method 500 for deploying the function of an IoT device according to an embodiment of the present disclosure is shown in FIG. 5.

[0076] In S510, the method 500 starts. For example, each IoT device initially installed in the Internet of Things environment has a default function corresponding to the operation required to be performed by the current installation environment. It is possible that the functions of each IoT device have been updated, and they are performing the updated functions.

[0077] In S520, the IoT device performs the current function until the scenario changes. The change of the scenario can include the change of the scenario corresponding to the IoT device itself or other IoT devices, or the completion of the function execution of the IoT device or the no longer need of the current function.

[0078] In S530, the IoT device sends a request and data to the server. For example, the request can be used to request the server to distribute a new function for it, the data can include the information related to the change of the scenario (for example, the scenario information related to the changed scenario), and the data can be included in the request.

[0079] In S540, the IoT device receives the new application program from the server. The new application program can be generated by the server according to the data in S530.

[0080] In S550, the IoT device uses the XIP feature to load the received new application program into the memory such as flash memory.

[0081] In S560, the IoT device checks the operating environment and the license, and runs the received new application program in a case where the operating environment and the license indicate that the program can be run. During the running of the program, the method 500 can return to S520 to continue monitoring whether the scenario changes.

[0082] In S570, after the IoT device starts running the new application program, the IoT device uninstalls the installation package of the application program. Thus, the storage space can be saved without affecting the running of the program.

[0083] Next, an example of a diagram of a software architecture of an IoT device according to an embodiment of the present disclosure will be described with reference to FIG. 6.

[0084] In an IoT device such as a camera, a runtime can be deployed, for example, only a webassembly runtime. Based on the runtime, the functions of the IoT device can be provided by an application program. A sandbox system can be generated for the application program, and the application program runs in the sandbox to protect the security of the system. For a smart IoT device, its inference function can be customized using wasi-nn of wasm. The deployment of the software can take the form of XIP, which further decouples the functions from the specific device and avoids the problem that the binding of software and hardware in the IoT device makes it difficult to adapt to changes in scenarios.

[0085] In a case where an event occurs, the IoT device can perform a corresponding function with respect to the event. When the event changes, the function of the IoT device can change. For example, as shown in FIG. 6, under event 1, the IoT device performs function A. At this time, application program 1 and data 1 are stored in the flash memory, which are deployed in the form of XIP, so as to be mapped to the virtual memory when executed without occupying the memory. When event 1 changes to event 2, application program 2 and data 2 are stored in the flash memory, and the function of the IoT device changes from function A to function B. Application program 2 and data 2 are also deployed in the form of XIP and mapped to the virtual memory when executed. Although it is shown in the figure that both the application program and the data change when the event changes, only one of the application program and the data can change, which causes function B to adapt to the current event. By analogy, when a new event occurs, the application program / data stored in the flash memory changes, and the function of the IoT device changes to function C.

[0086] The occurrence of an event can be discovered by an IoT device by detecting a scenario and reported to the cloud. Of course, the IoT device can also directly tell other IoT devices about the occurrence of the event. The cloud can notify the IoT device about the known event to let them determine the change of the scenario. In addition, application information including application programs and / or data can be distributed by the cloud in the case of being generated by the IoT device, and issued by the cloud to different IoT devices in the case of being generated by the cloud.

[0087] In the following, some specific examples of scenarios according to embodiments of the present disclosure will be described.

[0088] In the supermarket shown in FIG. 7, a camera IoT1 is installed near the supermarket shelf, and an automatic settlement device IoT2 is installed at the checkout counter. IoT1 continuously acquires images about the shelf to monitor the best-selling goods on the shelf (as shown in 7-01). IoT1 collects relevant information through the acquired images, and analyzes the sales of the goods and ranks them according to the collected information (as shown in 7-02). IoT1 sends the ranked information to the automatic settlement device IoT2 in the form of a data program (as shown in 7-03). IoT2 pushes the identified merchandise types to the user in priority order based on the received information (as shown in 7-04), so that the better-selling goods are arranged in a more forward position, thereby facilitating user selection. For example, IoT2 can increase the selection / presentation probability of the best-selling goods when identifying the goods purchased by the user according to the application information provided by IoT1 (e.g., the top 10 best-selling merchandise types), so that customers can preferentially choose. At this time, the change of the scenario affects the IoT device at the checkout counter.

[0089] A flowchart of a method 800 used in the scenario of FIG. 7 is shown in FIG. 8. The left side is the operation performed by IoT1, and the right side is the operation performed by IoT2.

[0090] In S805, IoT1 performs an inference operation by using a smart chip to acquire scenario information according to the detected scenario.

[0091] In S810, IoT1 determines whether customers are gathered according to the acquired scenario information. In the case where customers are not gathered, return to S805 to continue detecting the scenario. In the case where customers are gathered (e.g., the number of customers exceeds a predetermined threshold), it is determined that the scenario has changed. At this time, some information needs to be collected for IoT2 to use.

[0092] In S815, IoT1 acquires a Customer Number parameter. In S820, IoT1 acquires a Merchandise Type parameter. S820 can be executed in parallel with S815, or can be executed before S815.

[0093] In S825, IoT1 defines a data program get_customer_number to obtain the number of customers through the program. In S830, IoT1 outputs get_customer_number. In S835, IoT1 defines a data program get_merchandise_type to obtain the type of merchandise through the program. In S840, IoT1 outputs get_merchandise_type. The execution order of the definition and output of the two data programs is not particularly limited, as long as the same data program is defined first and then output. For simple cases, the wasm text sequence can be generated directly, for example, as a parameter set expressed in a program. For complex cases, a script such as TypeScript can be used, which can be converted into a program in the form of wasm, for example, using the LLVM compiler Wasmnizer-ts.

[0094] In S845, IoT1 compiles the programs in S830 and S840 into a program in the form of wasm using LLVM / warmc.

[0095] In S850, IoT1 generates an executable file csm_env_chg_xip.aot. Through the executable file, the above-mentioned data programs can be obtained.

[0096] In S855, IoT1 sends the executable file csm_env_chg_xip.aot to IoT2.

[0097] In S860, IoT2 receives the executable file csm_env_chg_xip.aot.

[0098] In S865, IoT2 writes csm_env_chg_xip.aot as an application program into the application program partition in the flash memory.

[0099] In S870, IoT2 memory maps csm_env_chg_xip.aot to map to the virtual memory without loading into the memory.

[0100] In S875, IoT2 runs the application program and calls get_customer_number to obtain the number of customer information. In S880, IoT2 runs the application program and calls get_merchandise_type to obtain the type of merchandise information. The execution order of S875 and S880 is not particularly limited.

[0101] In S885, IoT2 provides the new information acquired in S875 and S880 to an AI model of IoT2 that utilizes the information to update an inference task in IoT2.

[0102] In S890, IoT2 outputs a new inference result.

[0103] FIG. 9 shows a schematic diagram of an example of another scenario according to an embodiment of the present disclosure. As shown in FIG. 9, multiple IoT devices are installed in a restaurant, which can move freely in the restaurant as service robots. The server robots have shelves to place items. The first server robot IoT1 leaves the kitchen with a tray of food, at which time it is responsible for delivering food (as shown in 9-01). IoT1 can observe other service robots to determine whether their shelves are empty (as shown in 9-02). At some time, IoT1 detects that the second service robot IoT2 and / or the third service robot IoT3 have completed tray delivery, and their shelves are empty (as shown in 9-03). Then, IoT1, for the service robots with empty shelves, informs the server about the scenario information at this time to receive a new program from the server to adapt to the scenario, and sends the received program to IoT2 and / or IoT3 to make IoT2 and / or IoT3 with empty shelves perform the operation of recycling trays (as shown in 9-04). In 9-04, IoT1 can also compile locally to generate a corresponding new program according to the scenario information at this time (the shelves are empty), and send it to IoT2 and / or IoT3.

[0104] Through the execution of the scheme according to the embodiments of the present disclosure, the IoT devices associated with the changed scenario can be automatically caused to perform the related functions without manual intervention when the scenario changes, the response speed to the scenario change is improved, and the flexibility and adaptability of the deployment of the functions of the IoT devices are improved, thereby the network performance can be improved and the user experience is improved.

[0105] The above respectively describes each exemplary device and method according to the embodiments of the present disclosure. It should be understood that the operations or functions of these devices can be combined with each other, thereby achieving more or less operations or functions than described. The operation steps of each method can also be combined with each other in any appropriate order, thereby similarly achieving more or less operations than described.

[0106] It should be appreciated that the machine executable instructions in the machine readable storage medium or program product according to embodiments of the present disclosure can be configured to perform operations corresponding to the above-described device and method embodiments. Embodiments of the machine readable storage medium or program product are apparent to those skilled in the art from the foregoing description, and therefore are not described again here. The machine readable storage medium and program product for carrying or including the above-described machine executable instructions also fall within the scope of the present disclosure. Such storage medium can include, but is not limited to, a floppy diskette, an optical disk, a magneto-optical disk, a memory card, a memory stick, and the like.

[0107] In addition, it should be appreciated that the above-described series of processes and devices can also be realized by software and / or firmware. In the case of being realized by software and / or firmware, a program constituting the software is installed from a storage medium or a network to a computer having a dedicated hardware structure, such as a general-purpose personal computer 1300 shown in FIG. 10, which is capable of performing various functions when various programs are installed. FIG. 10 is a block diagram showing an example structure of a personal computer as an information processing device that can be employed in embodiments of the present disclosure. In one example, the personal computer can correspond to the above-described exemplary IoT device according to the present disclosure.

[0108] In FIG. 10, a central processing unit (CPU) 1301 performs various processes according to a program stored in a read only memory (ROM) 1302 or a program loaded from a storage section 1308 to a random access memory (RAM) 1303. In the RAM 1303, data required when the CPU 1301 performs various processes and the like is also stored as necessary.

[0109] The CPU 1301, the ROM 1302, and the RAM 1303 are connected to each other via a bus 1304. An input / output interface 1305 is also connected to the bus 1304.

[0110] The following components are connected to the input / output interface 1305: an input section 1306 including a keyboard, a mouse, and the like; an output section 1307 including a display such as a cathode ray tube (CRT), a liquid crystal display (LCD), and the like, and a speaker and the like; a storage section 1308 including a hard disk and the like; and a communication section 1309 including a network interface card such as a LAN card, a modem, and the like. The communication section 1309 performs communication processing via a network such as the Internet.

[0111] A drive 1310 is also connected to the input / output interface 1305 as necessary. A removable medium 1311 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like is mounted on the drive 1310 as necessary, so that a computer program read therefrom is installed in the storage section 1308 as necessary.

[0112] In a case where the above series of processes are implemented by software, a program constituting the software is installed from a network such as the Internet or a storage medium such as the detachable medium 1311.

[0113] It is to be understood by those skilled in the art that such a storage medium is not limited to the detachable medium 1311 in which the program is stored, which is distributed separately from the apparatus to provide the program to the user, as illustrated in FIG. 10. Examples of the detachable medium 1311 include a magnetic disk (including a floppy disk (registered trademark)), a magneto-optical disk (including a mini disk (MD) (registered trademark)), and a semiconductor memory. Alternatively, the storage medium can be the ROM 1302, a hard disk included in the storage section 1308, or the like, in which the program is stored and which is distributed to the user together with the apparatus including them.

[0114] The technology of the present disclosure can be applied to various products. For example, the base station mentioned in the present disclosure can be implemented as any type of evolved NodeB (gNB), such as a macro gNB and a small gNB. The small gNB can be a gNB for a small cell having a smaller coverage than a macro cell, such as a pico gNB, a micro gNB, and a home (femto) gNB. Alternatively, the base station can be implemented as any other type of base station, such as a NodeB and a Base Transceiver Station (BTS). The base station can include a main body (also referred to as a base station device) configured to control wireless communication, and one or more Remote Radio Heads (RRHs) provided at a different place from the main body. In addition, each of the various types of terminals to be described below can operate as a base station by temporarily or semi-persistently performing a base station function.

[0115] For example, the IoT device mentioned in the present disclosure, which is also referred to as a user equipment in some examples, can be implemented as a mobile terminal such as a smartphone, a tablet personal computer (PC), a notebook PC, a portable game terminal, a portable / dongle type mobile router, and a digital camera, or a vehicle-mounted terminal such as a car navigation device. The user equipment can also be implemented as a terminal that performs machine-to-machine (M2M) communication (also referred to as a machine type communication (MTC) terminal). Furthermore, the user equipment can be a wireless communication module (such as an integrated circuit module including a single wafer) mounted on each of the above-described terminals.

[0116] Application examples according to the present disclosure will be described below with reference to FIGS. 11 to 14.

[0117] [Application Example Regarding Base Station]

[0118] It should be appreciated that the IoT devices in the present disclosure can communicate with a base station and access an external network or communicate with each other through the base station. The term base station has all the breadth of its ordinary meaning and at least includes a wireless communication station used to communicate as part of a wireless communication system or radio system to facilitate communication. Examples of base stations can be, for example, but not limited to, the following: a base station can be one or both of a base transceiver station (BTS) and a base station controller (BSC) in a GSM system, can be one or both of a radio network controller (RNC) and a Node B in a WCDMA system, can be an eNB in an LTE and LTE-Advanced system, or can be a corresponding network node in future communication systems (such as gNB, eLTE eNB, etc. that can occur in a 5G communication system). Part of the functions of the base station of the present disclosure can also be implemented as an entity having a control function for communication in D2D, M2M, and V2V communication scenarios, or as an entity having a spectrum coordination function in a cognitive radio communication scenario.

[0119] First application example

[0120] Fig. 11 is a block diagram illustrating a first example of a schematic configuration of a gNB to which the techniques of the present disclosure can be applied. The gNB 1400 includes a plurality of antennas 1410 and a base station device 1420. The base station device 1420 and each of the antennas 1410 can be connected with each other via an RF cable. In one implementation, the gNB 1400 (or the base station device 1420) here can correspond to the electronic devices 300A, 1300A, and / or 1500B described above.

[0121] Each of the antennas 1410 includes a single or a plurality of antenna elements (such as a plurality of antenna elements included in a multiple-input multiple-output (MIMO) antenna), and functions to transmit and receive radio signals for the base station device 1420. As illustrated in Fig. 11, the gNB 1400 can include a plurality of antennas 1410. For example, the plurality of antennas 1410 can be compatible with a plurality of frequency bands used by the gNB 1400.

[0122] The base station device 1420 includes a controller 1421, a memory 1422, a network interface 1423, and a wireless communication interface 1425.

[0123] The controller 1421 can be, for example, a CPU or a DSP, and operates various functions of a higher layer of the base station apparatus 1420. For example, the controller 1421 generates data packets from data in a signal processed by the wireless communication interface 1425, and transfers the generated packets via the network interface 1423. The controller 1421 can bundle data from a plurality of baseband processors to generate bundled packets, and transfer the generated bundled packets. The controller 1421 can have a logical function of performing control such as radio resource control, radio bearer control, mobility management, admission control, and scheduling. The control can be performed in conjunction with a nearby gNB or a core network node. The memory 1422 includes RAM and ROM, and stores programs executed by the controller 1421 and various types of control data such as a terminal list, transmission power data, and scheduling data.

[0124] The network interface 1423 is a communication interface for connecting the base station apparatus 1420 to the core network 1424. The controller 1421 can communicate with a core network node or another gNB via the network interface 1423. In this case, the gNB 1400 and the core network node or other gNBs can be connected to each other by logical interfaces such as S1 and X2 interfaces. The network interface 1423 can also be a wired communication interface or a wireless communication interface for a wireless backhaul line. If the network interface 1423 is a wireless communication interface, the network interface 1423 can use a higher frequency band for wireless communication than a frequency band used by the wireless communication interface 1425.

[0125] The wireless communication interface 1425 supports any cellular communication scheme such as Long Term Evolution (LTE) and LTE-Advanced, and provides wireless connections to terminals located in the cell of the gNB 1400 via the antennas 1410. The wireless communication interface 1425 can generally include, for example, a baseband (BB) processor 1426 and an RF circuit 1427. The BB processor 1426 can perform, for example, encoding / decoding, modulation / demodulation, and multiplexing / demultiplexing, and perform various types of signal processing of layers (e.g., L1, medium access control (MAC), radio link control (RLC), and packet data convergence protocol (PDCP)). The BB processor 1426 can have a part or all of the logical functions described above instead of the controller 1421. The BB processor 1426 can be a memory that stores a communication control program, or a module that includes a processor and related circuitry configured to execute the program. Updating the program can cause the function of the BB processor 1426 to change. The module can be a card or a blade that is inserted into a slot of the base station device 1420. Alternatively, the module can also be a chip mounted on a card or a blade. Meanwhile, the RF circuit 1427 can include, for example, a mixer, a filter, and an amplifier, and transmit and receive wireless signals via the antennas 1410. Although FIG. 11 shows an example in which one RF circuit 1427 is connected to one antenna 1410, the present disclosure is not limited to this illustration, but one RF circuit 1427 can be connected to multiple antennas 1410 at the same time.

[0126] As illustrated in FIG. 11, the wireless communication interface 1425 can include multiple BB processors 1426. For example, the multiple BB processors 1426 can be compatible with multiple frequency bands used by the gNB 1400. As illustrated in FIG. 11, the wireless communication interface 1425 can include multiple RF circuits 1427. For example, the multiple RF circuits 1427 can be compatible with multiple antenna elements. Although FIG. 11 shows an example in which the wireless communication interface 1425 includes multiple BB processors 1426 and multiple RF circuits 1427, the wireless communication interface 1425 can also include a single BB processor 1426 or a single RF circuit 1427.

[0127] Second Application Example

[0128] FIG. 12 is a block diagram illustrating a second example of a schematic configuration of a gNB to which the technology of the present disclosure can be applied. A gNB 1530 includes multiple antennas 1540, a base station device 1550, and RRHs 1560. The RRHs 1560 and each of the antennas 1540 can be connected to each other via an RF cable. The base station device 1550 and the RRHs 1560 can be connected to each other via a high-speed line such as a fiber cable. In one implementation, the gNB 1530 (or the base station device 1550) here can correspond to the electronic devices 300A, 1300A, and / or 1500B described above.

[0129] Each of the antennas 1540 includes a single or multiple antenna elements (such as multiple antenna elements included in a MIMO antenna) and is used for the RRH 1560 to transmit and receive wireless signals. As illustrated in FIG. 12, the gNB 1530 can include multiple antennas 1540. For example, the multiple antennas 1540 can be compatible with multiple frequency bands used by the gNB 1530.

[0130] The base station device 1550 includes a controller 1551, a memory 1552, a network interface 1553, a wireless communication interface 1555, and a connection interface 1557. The controller 1551, the memory 1552, and the network interface 1553 are the same as the controller 1421, the memory 1422, and the network interface 1423 described with reference to FIG. 11.

[0131] The wireless communication interface 1555 supports any cellular communication scheme (such as LTE and LTE-Advanced) and provides wireless communication to terminals located in a sector corresponding to the RRH 1560 via the RRH 1560 and the antennas 1540. The wireless communication interface 1555 can generally include, for example, a BB processor 1556. The BB processor 1556 is the same as the BB processor 1426 described with reference to FIG. 11 except that the BB processor 1556 is connected to the RF circuit 1564 of the RRH 1560 via the connection interface 1557. As illustrated in FIG. 12, the wireless communication interface 1555 can include multiple BB processors 1556. For example, the multiple BB processors 1556 can be compatible with multiple frequency bands used by the gNB 1530. Although FIG. 12 illustrates an example in which the wireless communication interface 1555 includes multiple BB processors 1556, the wireless communication interface 1555 can also include a single BB processor 1556.

[0132] The connection interface 1557 is an interface for connecting the base station device 1550 (the wireless communication interface 1555) to the RRH 1560. The connection interface 1557 can also be a communication module for communication in the high-speed line described above.

[0133] The RRH 1560 includes a connection interface 1561 and a wireless communication interface 1563.

[0134] The connection interface 1561 is an interface for connecting the RRH 1560 (the wireless communication interface 1563) to the base station device 1550. The connection interface 1561 can also be a communication module for communication in the high-speed line described above.

[0135] The wireless communication interface 1563 transmits and receives a wireless signal via the antenna 1540. The wireless communication interface 1563 can include, for example, an RF circuit 1564. The RF circuit 1564 can include, for example, a mixer, a filter, and an amplifier, and transmits and receives a wireless signal via the antenna 1540. While FIG. 12 illustrates an example in which one RF circuit 1564 is connected to one antenna 1540, the present disclosure is not limited to this illustration, but one RF circuit 1564 can be connected to multiple antennas 1540 at the same time.

[0136] As illustrated in FIG. 12, the wireless communication interface 1563 can include multiple RF circuits 1564. For example, the multiple RF circuits 1564 can support multiple antenna elements. While FIG. 12 illustrates an example in which the wireless communication interface 1563 includes multiple RF circuits 1564, the wireless communication interface 1563 can also include a single RF circuit 1564.

[0137] [Application Examples Related to User Equipment]

[0138] First Application Example

[0139] FIG. 13 is a block diagram illustrating an example of a schematic configuration of a smartphone 1600 to which the technology of the present disclosure can be applied. The smartphone 1600 includes a processor 1601, a memory 1602, a storage 1603, an external connection interface 1604, a camera 1606, a sensor 1607, a microphone 1608, an input device 1609, a display device 1610, a speaker 1611, a wireless communication interface 1612, one or more antenna switches 1615, one or more antennas 1616, a bus 1617, a battery 1618, and an auxiliary controller 1619. In one implementation, the smartphone 1600 (or the processor 1601) here can correspond to the terminal device 300B and / or 1500A described above.

[0140] The processor 1601 can be, for example, a CPU or a system on chip (SoC), and controls functions of the application layer and the other layers of the smartphone 1600. The memory 1602 includes a RAM and a ROM, and stores a data and a program executed by the processor 1601. The storage 1603 can include a storage medium such as a semiconductor memory and a hard disk. The external connection interface 1604 is an interface for connecting an external device such as a memory card and a universal serial bus (USB) device to the smartphone 1600.

[0141] The camera 1606 includes an image sensor such as a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS), and generates a captured image. The sensor 1607 can include a set of sensors such as a measurement sensor, a gyro sensor, a geomagnetic sensor, and an acceleration sensor. The microphone 1608 converts a sound input to the smartphone 1600 into an audio signal. The input device 1609 includes, for example, a touch sensor configured to detect a touch on a screen of the display device 1610, a keypad, a keyboard, a button, or a switch, and receives an operation or information input from a user. The display device 1610 includes a screen such as a liquid crystal display (LCD) and an organic light emitting diode (OLED) display, and displays an output image of the smartphone 1600. The speaker 1611 converts an audio signal output from the smartphone 1600 into a sound.

[0142] The wireless communication interface 1612 supports any cellular communication scheme such as LTE and LTE-Advanced, and performs wireless communication. The wireless communication interface 1612 can include, for example, a BB processor 1613 and an RF circuit 1614, in general. The BB processor 1613 can perform, for example, encoding / decoding, modulation / demodulation, and multiplexing / demultiplexing, and perform various types of signal processing for wireless communication. Meanwhile, the RF circuit 1614 can include, for example, a mixer, a filter, and an amplifier, and transmit and receive a wireless signal via an antenna 1616. The wireless communication interface 1612 can be one chip module in which the BB processor 1613 and the RF circuit 1614 are integrated. As illustrated in FIG. 13, the wireless communication interface 1612 can include a plurality of BB processors 1613 and a plurality of RF circuits 1614. Although FIG. 13 illustrates an example in which the wireless communication interface 1612 includes a plurality of BB processors 1613 and a plurality of RF circuits 1614, the wireless communication interface 1612 can include a single BB processor 1613 or a single RF circuit 1614.

[0143] In addition, the wireless communication interface 1612 can support another type of wireless communication scheme in addition to the cellular communication scheme, such as a short-range wireless communication scheme, a near field communication scheme, and a wireless local area network (LAN) scheme. In this case, the wireless communication interface 1612 can include a BB processor 1613 and an RF circuit 1614 for each wireless communication scheme.

[0144] Each of the antenna switches 1615 switches a connection destination of the antenna 1616 between a plurality of circuits included in the wireless communication interface 1612, for example, circuits for different wireless communication schemes.

[0145] Each of the antennas 1616 includes a single or multiple antenna elements (such as a plurality of antenna elements included in a MIMO antenna), and is used for the wireless communication interface 1612 to transmit and receive wireless signals. As illustrated in FIG. 13, the smartphone 1600 can include a plurality of antennas 1616. While FIG. 13 illustrates an example in which the smartphone 1600 includes a plurality of antennas 1616, the smartphone 1600 can also include a single antenna 1616.

[0146] Furthermore, the smartphone 1600 can include an antenna 1616 for each wireless communication scheme. In this case, the antenna switch 1615 can be omitted from the configuration of the smartphone 1600.

[0147] The bus 1617 connects the processor 1601, the memory 1602, the storage 1603, the external connection interface 1604, the camera 1606, the sensor 1607, the microphone 1608, the input device 1609, the display device 1610, the speaker 1611, the wireless communication interface 1612, and the auxiliary controller 1619 to one another. The battery 1618 supplies power to the respective blocks of the smartphone 1600 illustrated in FIG. 13 via feed lines, which are partially illustrated as dotted lines in the figure. The auxiliary controller 1619 operates the minimum necessary functions of the smartphone 1600, for example, in a sleep mode.

[0148] Second Application Example

[0149] FIG. 14 is a block diagram illustrating an example of a schematic configuration of a car navigation device 1720 to which the technology according to the present disclosure can be applied. The car navigation device 1720 includes a processor 1721, a memory 1722, a global positioning system (GPS) module 1724, a sensor 1725, a data interface 1726, a content player 1727, a storage medium interface 1728, an input device 1729, a display device 1730, a speaker 1731, a wireless communication interface 1733, one or more antenna switches 1736, one or more antennas 1737, and a battery 1738. In one implementation, the car navigation device 1720 (or the processor 1721) here can correspond to the terminal device 300B and / or 1500A described above.

[0150] The processor 1721 can be, for example, a CPU or a SoC, and controls a navigation function and another function of the car navigation device 1720. The memory 1722 includes a RAM and a ROM, and stores data and programs executed by the processor 1721.

[0151] The GPS module 1724 measures a position (such as latitude, longitude and altitude) of the car navigation device 1720 using GPS signals received from GPS satellites. The sensor 1725 can include a set of sensors such as a gyro sensor, a geomagnetic sensor and an air pressure sensor. The data interface 1726 is connected to, for example, an in-vehicle network 1741 via a terminal not shown, and acquires data generated by the vehicle such as vehicle speed data.

[0152] The content player 1727 reproduces content stored in a storage medium such as a CD and a DVD, which is inserted into the storage medium interface 1728. The input device 1729 includes, for example, a touch sensor configured to detect a touch on a screen of the display device 1730, a button or a switch, and receives an operation or information input from a user. The display device 1730 includes a screen such as an LCD or an OLED display, and displays an image of a navigation function or reproduced content. The speaker 1731 outputs a sound of a navigation function or reproduced content.

[0153] The wireless communication interface 1733 supports any cellular communication scheme such as LTE and LTE-Advanced, and performs wireless communication. The wireless communication interface 1733 can generally include, for example, a BB processor 1734 and an RF circuit 1735. The BB processor 1734 can perform, for example, encoding / decoding, modulation / demodulation and multiplexing / demultiplexing, and perform various types of signal processing for wireless communication. Meanwhile, the RF circuit 1735 can include, for example, a mixer, a filter and an amplifier, and transmit and receive wireless signals via an antenna 1737. The wireless communication interface 1733 can also be one chip module in which the BB processor 1734 and the RF circuit 1735 are integrated thereon. As shown in FIG. 14, the wireless communication interface 1733 can include a plurality of BB processors 1734 and a plurality of RF circuits 1735. Although FIG. 14 shows an example in which the wireless communication interface 1733 includes a plurality of BB processors 1734 and a plurality of RF circuits 1735, the wireless communication interface 1733 can also include a single BB processor 1734 or a single RF circuit 1735.

[0154] In addition, the wireless communication interface 1733 can support another type of wireless communication scheme in addition to the cellular communication scheme, such as a short-range wireless communication scheme, a near field communication scheme and a wireless LAN scheme. In this case, the wireless communication interface 1733 can include a BB processor 1734 and an RF circuit 1735 for each wireless communication scheme.

[0155] Each of the antenna switches 1736 switches a connection destination of the antenna 1737 between a plurality of circuits included in the wireless communication interface 1733, such as circuits for different wireless communication schemes.

[0156] Each of the antennas 1737 includes a single or multiple antenna elements (such as multiple antenna elements included in a MIMO antenna), and is used for the wireless communication interface 1733 to transmit and receive wireless signals. As shown in FIG. 14, the car navigation device 1720 can include multiple antennas 1737. Although FIG. 14 shows an example in which the car navigation device 1720 includes multiple antennas 1737, the car navigation device 1720 can also include a single antenna 1737.

[0157] In addition, the car navigation device 1720 can include an antenna 1737 for each wireless communication scheme. In this case, the antenna switch 1736 can be omitted from the configuration of the car navigation device 1720.

[0158] The battery 1738 supplies power to the various blocks of the car navigation device 1720 shown in FIG. 14 via feed lines, which are partially shown as dotted lines in the figure. The battery 1738 accumulates power supplied from the vehicle.

[0159] The technology of the present disclosure can also be implemented as an in-vehicle system (or vehicle) 1740 including the car navigation device 1720, the in-vehicle network 1741, and one or more of the blocks in the vehicle module 1742. The vehicle module 1742 generates vehicle data such as vehicle speed, engine speed, and fault information, and outputs the generated data to the in-vehicle network 1741.

[0160] The exemplary embodiments of the present disclosure are described above with reference to the accompanying drawings, but the present disclosure is of course not limited to the above examples. Various changes and modifications can be made by those skilled in the art within the scope of the appended claims, and it should be understood that such changes and modifications naturally fall within the technical scope of the present disclosure.

[0161] For example, a plurality of functions included in one unit in the above embodiments can be implemented by separate apparatuses. Alternatively, a plurality of functions implemented by a plurality of units in the above embodiments can be respectively implemented by separate apparatuses. In addition, one of the above functions can be implemented by a plurality of units. Needless to say, such a configuration is included in the technical scope of the present disclosure.

[0162] The functions of the elements disclosed herein can be implemented using circuitry or processing circuitry including a general purpose processor, a special purpose processor, an integrated circuit, an ASIC ("application specific integrated circuit"), conventional circuitry, and / or combinations thereof configured to perform the disclosed functions. Processors are considered processing circuitry or circuitry as they include transistors and other circuitry in which they are comprised. In the present disclosure, a circuit, unit, or device is hardware that performs or is programmed to perform the recited function. The hardware can be any hardware disclosed herein or otherwise known that is programmed or configured to perform the recited function. When the hardware is a processor that can be considered a type of circuit, the circuit, device, or unit is a combination of hardware and software, the software being used to configure the hardware and / or processor.

[0163] In this specification, the steps described in the flowcharts include not only processes performed in time series of the order described, but also processes performed in parallel or individually rather than in time series. Furthermore, even in the steps that are processed in time series, the order can be changed as appropriate without departing from the scope of the present disclosure.

[0164] While the present disclosure and its advantages have been illustrated by description of embodiments, it is understood that changes, substitutions, and alterations can be made by those skilled in the art without departing from the spirit and scope of the present disclosure as defined by the appended claims. Moreover, the terms "including", "comprising", or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. In addition, the term "about" means that a value is within 10% of the value.

[0165] It will be appreciated from the description herein that the disclosed embodiments can be configured as follows: 1. An electronic device for an Internet of Things (IoT) system, comprising: a processor; and a memory including computer program instructions, wherein the memory and the computer program instructions are configured to, with the processor, cause the electronic device to perform operations of: determining that a scene has changed; and performing an operation to cause one or more IoT devices associated with the changed scene to obtain application information generated according to the changed scene, wherein the application information is used to cause the one or more IoT devices to implement a function that is adapted to the changed scene. 2. The electronic device of clause 1, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: detecting a scene within a detectable range of the IoT device; and determining that the scene has changed in a case where the detected scene indicates occurrence of a predetermined event, wherein the detected scene is the changed scene. 3. The electronic device of clause 1, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: receiving information related to a scene detected by another IoT device from the other IoT device; and determining that the scene has changed according to the received information, wherein the scene detected by the other IoT device is the changed scene. 4. The electronic device of clause 1, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: generating the application information according to scene information related to the changed scene; and providing the application information to the one or more IoT devices. 5. The electronic device of clause 4, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: determining the one or more IoT devices associated with the changed scene according to a correspondence between a scene and an associated IoT device, before transmitting the application information to the one or more IoT devices. 6. The electronic device of clause 4, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: transmitting the application information to the one or more IoT devices in response to determining that the one or more IoT devices have a capability to process the application information, before transmitting the application information to the one or more IoT devices. 7. The electronic device of clause 4, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: generating semantic information describing the changed scene according to the scene information; and generating the application information according to the semantic information.8.The electronic device of clause 7, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to: convert the semantic information into a program in a wasm form as the application information by utilizing a compiler technique. 9.The electronic device of clause 1, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to: transmit indication information indicating the changed scene to a server to cause the server to generate the application information according to the indication information and provide the application information to the one or more IoT devices. 10.The electronic device of clause 9, wherein the indication information comprises at least one of: scene information related to the changed scene; and semantic information generated to describe the changed scene according to the scene information related to the changed scene. 11.The electronic device of clause 9, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to: transmit the indication information indicating the changed scene to the server in a case where the IoT device does not have a capability to generate the application information according to the scene information related to the changed scene. 12.The electronic device of clause 9, wherein the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to: receive a program in a wasm form obtained according to the indication information from the server as the application information. 13.The electronic device of clause 1, wherein the electronic device is configured to have only a default function corresponding to a scene at an initial installation at an initialization. 14.The electronic device of clause 1, wherein the application information comprises at least one of: an application program related to the changed scene; data related to the changed scene; and a data program compiled from the data related to the changed scene. 15.The electronic device of clause 14, wherein at least one of the application program and the data program is stored in an XIP form in the one or more IoT devices. 16.The electronic device of clause 1, wherein the application information is usable by the one or more IoT devices only after passing a legality check. 17.The electronic device of clause 1, wherein the one or more IoT devices comprise the electronic device. 18.A method for an Internet of Things (IoT) system, comprising: determining that a scene is changed; and performing an operation to cause one or more IoT devices associated with the changed scene to obtain application information generated according to the changed scene, wherein the application information is used to cause the one or more IoT devices to implement a function adapted to the changed scene.19.An electronic device for an Internet of Things (IoT) system, comprising: a processor; and a memory including computer program instructions, wherein the memory and the computer program instructions are configured to, with the processor, cause the electronic device to: receive, from an IoT device, indication information indicating a changed scene, the indication information being received when a scene changes; generate application information according to the indication information, wherein the application information is used to cause one or more IoT devices associated with the changed scene to implement a function that is adapted to the changed scene; and provide the application information to the one or more IoT devices. 20.A method for an Internet of Things (IoT) system, comprising: receiving, from an IoT device, indication information indicating a changed scene, the indication information being received when a scene changes; generating application information according to the indication information, wherein the application information is used to cause one or more IoT devices associated with the changed scene to implement a function that is adapted to the changed scene; and providing the application information to the one or more IoT devices. 21.A computer readable storage medium having stored thereon computer program instructions which, when executed by a processing device, cause the processing device to perform the method according to clause 18 or 20.

Claims

1. An electronic device for an Internet of Things (IoT) system, comprising: a processor; and a memory including computer program instructions, wherein the memory and the computer program instructions are configured to, with the processor, cause the electronic device to perform operations of: determining that a scene has changed; and performing an operation to cause one or more IoT devices associated with the changed scene to obtain application information generated according to the changed scene, wherein the application information is used to cause the one or more IoT devices to implement a function that is adapted to the changed scene. the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: detecting a scene within a detectable range of an IoT device; and 2.The electronic device of claim 1, wherein, in a case where the detected scene indicates occurrence of a predetermined event, determining that the scene has changed, wherein the detected scene is the changed scene. the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: receiving information related to a scene detected by another IoT device from the other IoT device; and 3.The electronic device of claim 1, wherein, determining that the scene has changed according to the received information, wherein the scene detected by the other IoT device is the changed scene. the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: generating the application information according to scene information related to the changed scene; and 4. The electronic device of claim 1, wherein, providing the application information to the one or more IoT devices. the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: determining the one or more IoT devices associated with the changed scene according to a correspondence between a scene and an associated IoT device, before transmitting the application information to the one or more IoT devices.

5. The electronic device of claim 4, wherein, the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: transmitting the application information to the one or more IoT devices in response to determining that the one or more IoT devices have a capability to process the application information, before transmitting the application information to the one or more IoT devices.

6. The electronic device of claim 4, wherein, the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: generating semantic information describing the changed scene according to the scene information; and 7. The electronic device of claim 4, wherein, generating the application information according to the semantic information. the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: converting the semantic information into a program in a wasm form as the application information by utilizing a compiler technique.

8. The electronic device of claim 7, wherein, the memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform operations of: ​ 9.The electronic device of claim 1, wherein, ​ transmitting, to a server, indication information indicative of the changed scene, to cause the server to generate the application information based on the indication information and provide the application information to the one or more IoT devices.

10. The electronic device of claim 9, wherein, The indication information comprises at least one of: scene information related to the changed scene; and semantic information generated based on the scene information related to the changed scene to describe the changed scene. 11.The electronic device of claim 9, wherein The memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform the following operation: transmitting, to a server, indication information indicative of the changed scene, in a case where the IoT device does not have a capability to generate the application information based on the scene information related to the changed scene.

12. The electronic device of claim 9, wherein, The memory and the computer program instructions are further configured to, with the processor, cause the electronic device to perform the following operation: receiving, from the server, a program in a wasm form obtained based on the indication information as the application information.

13. The electronic device of claim 1, wherein, The electronic device is configured to have only a default function corresponding to a scene at an initial installation at an initialization.

14. The electronic device of claim 1, wherein, The application information comprises at least one of: an application program related to the changed scene; data related to the changed scene; and a data program compiled from the data related to the changed scene.

15. The electronic device of claim 14, wherein, At least one of the application program and the data program is stored in an XIP form in the one or more IoT devices.

16. The electronic device of claim 1, wherein, The application information is usable by the one or more IoT devices only after passing a legality check.

17. The electronic device of claim 1, wherein, The one or more IoT devices comprise the electronic device.

18. A method for an Internet of Things (IoT) system, comprising: determining that a scene has changed; and performing an operation to cause one or more IoT devices associated with the changed scene to obtain application information generated based on the changed scene, wherein the application information is used to cause the one or more IoT devices to implement a function adapted to the changed scene.

19. An electronic device for an Internet of Things (IoT) system, comprising: a processor; and a memory including computer program instructions, wherein the memory and the computer program instructions are configured to, with the processor, cause the electronic device to perform the following operations: receiving, from an IoT device, indication information indicative of a changed scene, the indication information being received when the scene has changed; generating application information based on the indication information, wherein the application information is used to cause one or more IoT devices associated with the changed scene to implement a function adapted to the changed scene; and providing the application information to the one or more IoT devices.

20. A method for an Internet of Things (IoT) system, comprising: receiving, from an IoT device, indication information indicative of a changed scene, the indication information being received when the scene has changed; generating application information based on the indication information, wherein the application information is used to cause one or more IoT devices associated with the changed scene to implement a function adapted to the changed scene; and ​ ​ providing the application information to the one or more IoT devices.

21. A computer-readable storage medium having stored thereon computer program instructions, the computer program instructions, when executed at a processing device, causing the processing device to perform the method of claim 18 or 20.

Images