Information processing apparatus, apparatus management system, information processing method, and program

Abstract

An information processing apparatus 1 including a plurality of modules (first module 12, second module 13, ···) that process data transmitted from a sensing device 3, the information processing apparatus 1 including a generation unit (control unit 11) that generates a plurality of virtual devices corresponding to each of the plurality of modules, the virtual devices being for transmitting and receiving data between the corresponding module and the sensing device. According to the present disclosure, when a plurality of modules share a physical device, it is possible to maintain a module to be maintained without stopping the processing of modules other than the module to be maintained.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an apparatus management system, an information processing method, and a program.

Background Art

[0002] Conventionally, an information processing apparatus that processes information from a sensing device has a plurality of functions and includes modules (for example, containers, etc.) that execute functions for each function. In such an information processing apparatus, a plurality of modules may share a sensing device that is a physical device. In the example shown in FIG. 6, a camera 3A (sensing device) is shared between a first module 12 (recording function) and a second module 13 (call function). In such a case, when maintaining any of a plurality of modules that share a certain sensing device, it is necessary to stop the processing of modules other than the module to be maintained. In the example shown in FIG. 6, when maintaining the first module 12 (recording function) (for example, updating, etc.), it is necessary to stop the processing of the second module 13 (call function). Therefore, if the second module has a function that needs to be operated 24 hours a day, 365 days a year, such as a nurse call, stopping it for maintenance will cause problems in the service.

[0003] On the other hand, Patent Document 1 describes that a wireless router, rather than a sensing device, is provided with a plurality of applications and a virtual computer is provided for each application. Here, a virtual computer is a virtual CPU (Central Processing Unit).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In order to solve the above problems, even if Patent Document 1 is applied, only virtual CPUs are provided for each module, and physical devices continue to be shared among modules. Therefore, in the above case, it is still necessary to stop the processing of modules other than the module to be maintained. Also, by providing a loopback between the sensing device and the module and creating derivative data of the data transmitted from the sensing device to the module, it is possible to eliminate the sharing of physical devices among modules. However, creating derivative data increases the cost of data transfer processing.

[0006] Therefore, an object of the present disclosure is to enable maintenance of a module to be maintained without stopping the processing of modules other than the module to be maintained when a plurality of modules share a physical device.

Means for Solving the Problems

[0007] To solve the above problems, an information processing apparatus according to the present disclosure is an information processing apparatus including a plurality of modules that process data transmitted from a sensing device, including a generation unit that generates a plurality of virtual devices corresponding to each of the plurality of modules, wherein the virtual device transmits and receives data between the corresponding module and the sensing device.

[0008] Also, a device management system according to the present disclosure is the above information processing apparatus, the sensing device, and includes.

[0009] Also, an information processing method according to the present disclosure is An information processing method in an information processing apparatus including a plurality of modules that process data transmitted from a sensing device, including a generation step of generating a plurality of virtual devices corresponding to each of the plurality of modules, The virtual device transmits and receives data between the corresponding module and the sensing device.

[0010] In addition, the program according to the present disclosure causes a computer of an information processing apparatus including a plurality of modules that process data transmitted from a sensing device to function as a generation unit that generates a plurality of virtual devices corresponding to each of the plurality of modules, The virtual device transmits and receives data between the corresponding module and the sensing device.

Advantages of the Invention

[0011] According to the present disclosure, when a plurality of modules share a physical device, the processing of modules other than the module to be maintained can be continued without stopping, and the module to be maintained can be maintained.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. However, the scope of the present disclosure is not limited to those described in the following embodiments and drawings.

[0014] <Device Management System 100> First, the configuration of the device management system 100 will be described with reference to FIG. 1. As shown in FIG. 1, the device management system 100 includes an information processing device 1, a cloud server 2, and a sensing device 3. The information processing device 1 and the cloud server 2 transmit and receive information via a communication network 1000. The information processing device 1 and the sensing device 3 are connected by a cable or the like. Note that in FIG. 1, there is one information processing device 1, but the present disclosure is not limited to this example, and there may be a plurality of information processing devices 1.

[0015] The information processing device 1 is a device that processes information acquired from the sensing device 3. The information processing device 1 has a plurality of modules (first module 12, second module 13,...) that process information acquired from the sensing device 3. A module is, for example, a container such as an AI container. Note that at least one of the plurality of modules may be a module that needs to operate 24 hours a day, 365 days a year. Also, for example, a module that needs to operate 24 hours a day, 365 days a year may be a module related to a nurse call. The cloud server 2 is a device that manages the information processing device 1. An administrator of the device management system 100 operates an administrator information processing device (not shown) connected to the cloud server 2 and performs maintenance management of the modules of the information processing device 1 through the cloud server 2. Note that an on-premises server may be used instead of the cloud server 2. The sensing device 3 is a sensing device that detects an object such as a camera or a voice device (microphone, speaker). The communication network 1000 is a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, or the like.

[0016] <Information Processing Apparatus 1> Next, the configuration of the information processing apparatus 1 will be described with reference to FIGS. 1 and 2. As shown in FIG. 1, the information processing apparatus 1 includes a control unit 11, a first module 12, a second module 13, an operation unit 14, a communication unit 15, a storage unit 16, and a display unit 17.

[0017] The control unit 11 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc. The CPU of the control unit 11 reads out various programs stored in the storage unit 16, expands them in the RAM, executes various processes according to the expanded programs, and controls the operations of each part of the information processing apparatus 1.

[0018] The control unit 11 functions as a generation unit that generates a plurality of virtual devices corresponding to each of the plurality of modules. After generation, the control unit 11 assigns the corresponding plurality of virtual devices to each of the plurality of modules. The control unit 11 controls the virtual devices by controlling a virtual device controller that executes creation and deletion of virtual devices. Specifically, when the virtual device is a container, the control unit 11 uses docker as the virtual device controller (here, the container controller). In addition, the control unit 11 controls the modules by controlling a module controller that executes assignment and startup of the modules. Specifically, when the module is a container, the control unit 11 uses docker as the module controller (here, the container controller). Then, the control unit 11 controls the module controller and mounts the created virtual device to the module.

[0019] A virtual device is software that emulates the functions of a sensing device, which is a physical device, and behaves like a sensing device. The virtual device sends and receives data between the corresponding module and the sensing device. When the sensing device, which is the source of the emulated function, is stopped, the virtual device sends dummy data that mimics the data sent from the sensing device to the corresponding module. Note that a virtual device can share a sensing device. Also, during the transmission of dummy data, the virtual device may send information indicating that it is dummy data to the module. For example, v4l2-loopback can be used for a virtual device. v4l2-loopback is a virtual driver that receives data equivalent to a device corresponding to v4l2 as an external input and outputs it as it is. In this way, by using a virtual device with a container, each virtual device can be made into an individual service installed in an independent execution environment. As a result, the service can be started / stopped individually, or existing implementations based on open standards can be reused for stable development.

[0020] A method for data transfer between a sensing device and a virtual device will be described. The case where the sensing device is a camera will be used for the description. For example, an image transfer program (such as gstreamer) may be used to transfer an image. Specifically, the control unit 11 controls gstreamer using a command to start or stop the transfer of an image sent from the sensing device to a specified virtual driver. In this case, resources (RAM bandwidth, CPU) are used for the transfer. By using DMA (Direct Memory Access), the processing load for the resources (CPU) can be reduced. Note that even without control using a command, the control unit 11 may read an external configuration file or transfer an image using an image transfer program set as a kernel event as described below. Alternatively, for example, an image transfer program set as a kernel module may be used to transfer an image. Specifically, the kernel module receives a memory-mapped data area from a camera and shares it with a virtual device. The virtual device receives the memory-mapped data of v4l2 and outputs the image as it is. In this case, shared memory is used, and less resource utilization is required. However, there are drawbacks such as the fact that old programs may not support shared memory.

[0021] Here, a system configuration example of the virtual device will be described with reference to FIG. 2. FIG. 2 shows a state in which a virtual camera VD1, which is a virtual device corresponding to the first module 12, a virtual camera VD2, which is a virtual device corresponding to the second module 13, a virtual microphone VD3, and a virtual speaker VD4 are generated by the control unit 11, and each virtual device is connected to each sensing device 3 and each module. The virtual camera VD1 and the virtual camera VD2 mimic the functions of a camera (sensing device 3A). The virtual microphone VD3 mimics the function of a microphone (sensing device 3B). The virtual speaker VD4 mimics the function of a speaker (sensing device 3C).

[0022] The control unit 11 functions as a deletion unit that deletes the virtual device connected to the module in response to the deletion of the module.

[0023] The first module 12 is a module that processes information transmitted from a camera (sensing device 3A) and has a recording function. The second module 13 is a module that uses a camera (sensing device 3A), a microphone (sensing device 3B), and a speaker (sensing device 3C) and has a call function (video call function). Note that FIG. 1 shows the case where the information processing apparatus 1 has two modules, namely, the first module 12 and the second module 13, but the present invention is not limited to this example, and the number of modules may be three or more.

[0024] The operation unit 14 includes a keyboard having cursor keys, numeric input keys, various function keys, etc., a pointing device such as a mouse, a touch panel laminated on the surface of the display unit 17, etc. The operation unit 14 is configured to be operable by an operator. Further, the operation unit 14 outputs various signals based on operations performed by the operator to the control unit 11.

[0025] The communication unit 15 can transmit and receive various signals and various data to and from other devices connected via the communication network 1000.

[0026] The storage unit 16 is composed of a non-volatile semiconductor memory, a hard disk, etc., and stores various programs executed by the control unit 11, parameters necessary for the execution of the programs, various data, etc.

[0027] The display unit 17 is composed of a monitor such as an LCD (Liquid Crystal Display), and displays various screens, etc. according to the instructions of the display signal input from the control unit 11.

[0028] <Module startup process> Next, with reference to FIG. 3, the module startup process in the information processing apparatus 1 will be described. In the example of FIG. 2, the module startup process is a process of starting the first module 12 and the second module 13.

[0029] First, the control unit 11 generates virtual devices (step S1; generation step). In the example of FIG. 2, the control unit 11 generates a virtual camera VD1, a virtual camera VD2, a virtual microphone VD3, and a virtual speaker VD4.

[0030] Next, the control unit 11 assigns virtual devices to the modules (step S2). In the example of FIG. 2, the control unit 11 assigns the virtual camera VD1 to the first module 12, and assigns the virtual camera VD2, the virtual microphone VD3, and the virtual speaker VD4 to the second module 13.

[0031] Next, the control unit 11 causes the module to start (step S3) and ends the module start-up process.

[0032] <Module Stop Process> Next, with reference to FIG. 4, the module stop process in the information processing apparatus 1 will be described. In the example of FIG. 2, the module stop process is a process of stopping the first module 12 and the second module 13.

[0033] First, the control unit 11 stops the module (step S11). In the example of FIG. 2, the control unit 11 stops the first module 12 and the second module 13.

[0034] Next, the control unit 11 releases the assignment between the module and the virtual device (step S12). In the example of FIG. 2, the control unit 11 releases the assignment between the first module 12 and the virtual camera VD1, the second module 13 and the virtual camera VD2, the virtual microphone VD3, and the virtual speaker VD4.

[0035] Next, the control unit 11 deletes the virtual device (step S13; deletion step) and ends the module stop process. In the example of FIG. 2, the control unit 11 deletes the virtual camera VD1, the virtual camera VD2, the virtual microphone VD3, and the virtual speaker VD4.

[0036] <Others> As shown in FIG. 5, a virtual machine (virtual machine VM1, virtual machine VM2) may be provided between the module and the virtual device for each module. A virtual machine is software that emulates the functions of a CPU and behaves in the same way.

[0037] <Effect> As described above, the information processing apparatus 1 is an information processing apparatus 1 including a plurality of modules (first module 12, second module 13, ···) that process data transmitted from the sensing device 3, and includes a generation unit (control unit 11) that generates a plurality of virtual devices corresponding to each of the plurality of modules. The virtual device transmits and receives data between the corresponding module and the sensing device. Therefore, when a plurality of modules share a physical device, the processing of modules other than the module to be maintained can be stopped without stopping, and the module to be maintained can be maintained. That is, it becomes possible to maintain the modules individually. Here, the effects will be described in comparison with the conventional example. FIG. 6 shows a conventional system configuration. The first module 12 (recording function) and the second module 13 (call function) share the camera 3A. When performing maintenance work on one of the modules, it was necessary to stop both modules. According to the present disclosure as shown in FIGS. 2 and 5, by outputting dummy data from the virtual device, it is not necessary to stop the module connected to the virtual device. That is, even when the first module 12 (recording function) is under maintenance, since dummy data is output from the virtual camera VD2, the displayed image becomes dummy, but the call function can be used. Similarly, when adding a new function, that is, when adding a new module, it is not necessary to stop the existing modules that share the sensing device. For example, at the time of updating a module, it is possible to perform a startup test with the updated module without stopping the functions of the existing modules, and when successful, stop the existing modules and switch to the new module. Also, for example, when newly adding another new module that uses (shares) a physical device, it is not necessary to stop the existing modules that are operating.

[0038] Further, the information processing apparatus 1 includes a deletion unit that deletes the virtual device corresponding to the module in response to the deletion of the module. Therefore, since the modules are dynamically created / deleted, the resources to be used can be limited to the necessary amount.

[0039] Further, the device management system 100 includes an information processing device 1 and a sensing device 3. Therefore, when multiple modules share a physical device, the processing of modules other than the module to be maintained can be kept running, and the module to be maintained can be maintained. That is, it becomes possible to maintain the modules individually.

[0040] Furthermore, the information processing method is an information processing method in an information processing device including a plurality of modules that process data transmitted from a sensing device, and includes a generation step (step S1) of generating a plurality of virtual devices corresponding to each of the plurality of modules. The virtual device transmits and receives data between the corresponding module and the sensing device. Therefore, when multiple modules share a physical device, the processing of modules other than the module to be maintained can be kept running, and the module to be maintained can be maintained. That is, it becomes possible to maintain the modules individually.

[0041] Also, the program causes a computer of the information processing device 1 including a plurality of modules (first module 12, second module 13, ···) that process data transmitted from the sensing device 3 to function as a generation unit (control unit 11) that generates a plurality of virtual devices corresponding to each of the plurality of modules. The virtual device transmits and receives data between the corresponding module and the sensing device. Therefore, when multiple modules share a physical device, the processing of modules other than the module to be maintained can be kept running, and the module to be maintained can be maintained. That is, it becomes possible to maintain the modules individually.

[0042] As described above, the present disclosure has been specifically described based on embodiments. However, it goes without saying that the present disclosure is not limited to the above embodiments and can be appropriately modified without departing from the gist thereof. For example, in the above description, an example in which a hard disk, a semiconductor non-volatile memory, etc. are used as a computer-readable medium of the program according to the present disclosure has been disclosed, but the present disclosure is not limited to this example. As other computer-readable media, portable recording media such as CD-ROM can be applied.

[0043] In addition, regarding the detailed configuration and detailed operation of each device, they can be appropriately modified without departing from the gist of the invention.

Industrial Applicability

[0044] This invention can be used in an information processing apparatus, a device management system, an information processing method, and a program.

Explanation of Signs

[0045] 100 Device management system 1 Information processing apparatus 11 Control unit (generation unit, deletion unit) 12 First module 13 Second module 14 Operation unit 15 Communication unit 16 Storage unit 17 Display unit 2 Cloud server 3 Sensing device 1000 Communication network

Claims

1. An information processing apparatus comprising a plurality of modules for processing data transmitted from a sensing device, comprising a generation unit that generates a plurality of virtual devices corresponding to each of the plurality of modules, wherein the virtual device is an information processing apparatus that transmits and receives data between the corresponding module and the sensing device.

2. The information processing apparatus according to claim 1, further comprising a deletion unit that deletes the virtual device corresponding to the module in response to the deletion of the module.

3. The information processing apparatus according to claim 1, wherein, while the sensing device is stopped, the virtual device transmits dummy data to the corresponding module.

4. The information processing apparatus according to claim 1, wherein the sensing device includes a camera and an audio device.

5. The information processing apparatus according to claim 1, wherein at least one of the modules is a module that needs to operate 365 days a year, 24 hours a day.

6. The information processing apparatus according to claim 5, wherein the module that needs to operate 365 days a year, 24 hours a day is a module related to a nurse call.

7. An apparatus management system comprising the information processing apparatus according to any one of claims 1 to 6, and the sensing device.

8. An information processing method in an information processing apparatus comprising a plurality of modules for processing data transmitted from a sensing device, including a generation step of generating a plurality of virtual devices corresponding to each of the plurality of modules, wherein the virtual device is an information processing method that transmits and receives data between the corresponding module and the sensing device.

9. Causing a computer of an information processing apparatus comprising a plurality of modules for processing data transmitted from a sensing device to function as a generation unit that generates a plurality of virtual devices corresponding to each of the plurality of modules, wherein the virtual device is a program that transmits and receives data between the corresponding module and the sensing device. ​

Images