Method, device, electronic device and storage medium for reducing resource consumption of intelligent voice device

Abstract

The embodiments of the present application disclose a method, apparatus, electronic device, and storage medium for reducing resource consumption of intelligent voice devices. A specific implementation of the method includes: detecting whether the intelligent voice device is in a state to be awakened and has not been awakened for a preset time period; in response to detecting that the intelligent voice device is in a state to be awakened and has not been awakened for a preset time period, turning on the low-microphone mode to pick up the target audio; detecting whether the target audio includes the wake-up word audio; in response to detecting that the target audio includes the wake-up word audio, turning on the multi-microphone mode to record and obtain the audio to be recognized. This implementation provides a method for reducing resource consumption of intelligent voice devices and improves user experience.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular to methods, devices, electronic devices, and storage media for reducing resource consumption of intelligent voice devices. Background Art

[0002] As smart voice devices, such as smart central control screens and smart speakers in home scenarios, become increasingly popular, smart voice devices are turned on for a long time and all functions are kept in working order, causing the CPU to be in a high occupancy state for a long time, resulting in severe heating and even freezing or automatic restart, which greatly affects the user experience of smart voice devices. Summary of the invention

[0003] The embodiments of the present application provide methods, devices, electronic devices and storage media for reducing resource consumption of intelligent voice devices.

[0004] In a first aspect, some embodiments of the present application provide a method for reducing resource consumption of an intelligent voice device, the method comprising: detecting whether the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period; in response to detecting that the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period, turning on a few-microphone mode to pick up sound to obtain target audio; detecting whether the target audio includes wake-up word audio; in response to detecting that the target audio includes wake-up word audio, turning on a multi-microphone mode to record to obtain audio to be recognized.

[0005] In some embodiments, the method also includes: determining whether the smart voice device in the wake-up state is playing audio; in response to the smart voice device playing audio, turning on local acoustic echo cancellation; in response to the smart voice device not playing audio, turning off local acoustic echo cancellation.

[0006] In some embodiments, the method further includes: after the intelligent voice device is started, turning on the multi-microphone mode for sound pickup, and turning off the local acoustic echo cancellation.

[0007] In some embodiments, the method also includes: uploading the audio to be recognized to the cloud for recognition; receiving the speech recognition and semantic analysis results returned by the cloud; processing the speech recognition and semantic analysis results; and returning to the wake-up state after the speech recognition and semantic analysis results are processed.

[0008] In some embodiments, the few-microphone mode includes a single-microphone mode, and the multi-microphone mode includes a four-microphone mode.

[0009] In a second aspect, some embodiments of the present application provide a device for reducing resource consumption of an intelligent voice device, the device comprising: a first detection unit, configured to detect whether the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period; a first activation unit, configured to, in response to detecting that the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period, activate a few-microphone mode to pick up sound to obtain target audio; a second detection unit, configured to detect whether the target audio includes wake-up word audio; a second activation unit, configured to, in response to detecting that the target audio includes wake-up word audio, activate a multi-microphone mode to record to obtain audio to be recognized.

[0010] In some embodiments, the device also includes a local acoustic echo cancellation control unit, which is configured to: determine whether the smart voice device in the wake-up state is playing audio; in response to the smart voice device playing audio, turn on local acoustic echo cancellation; in response to the smart voice device not playing audio, turn off local acoustic echo cancellation.

[0011] In some embodiments, the device further includes an initialization unit, which is configured to: after the intelligent voice device is started, turn on the multi-microphone mode for voice pickup, and turn off the local acoustic echo cancellation.

[0012] In some embodiments, the device also includes a processing unit configured to: upload the audio to be recognized to the cloud for recognition; receive the speech recognition and semantic analysis results returned by the cloud; process the speech recognition and semantic analysis results; and restore to the wake-up state after the speech recognition and semantic analysis results are processed.

[0013] In some embodiments, the few-microphone mode includes a single-microphone mode, and the multi-microphone mode includes a four-microphone mode.

[0014] In a third aspect, some embodiments of the present application provide a device comprising: one or more processors; a storage device on which one or more programs are stored, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method as described above in the first aspect.

[0015] In a fourth aspect, some embodiments of the present application provide a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the method described above in the first aspect.

[0016] The embodiments of the present application provide a method, device, electronic device and storage medium for reducing resource consumption of intelligent voice devices, by detecting whether the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period; in response to detecting that the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period, turning on the few-microphone mode to pick up sound to obtain the target audio; detecting whether the target audio includes wake-up word audio; in response to detecting that the target audio includes wake-up word audio, turning on the multi-microphone mode to record to obtain audio to be recognized, thereby providing a method for reducing resource consumption of intelligent voice devices and improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0018] Figure 1 are some exemplary system architecture diagrams to which the present application may be applied;

[0019] Figure 2 is a flow chart of an embodiment of a method for reducing resource consumption of an intelligent voice device according to the present application;

[0020] Figure 3 It is a schematic diagram of an application scenario of the method for reducing resource consumption of intelligent voice devices according to the present application;

[0021] Figure 4 It is a structural schematic diagram of an embodiment of a device for reducing resource consumption of an intelligent voice device according to the present application;

[0022] Figure 5 It is a structural diagram of a computer system of a server or terminal suitable for implementing some embodiments of the present application. DETAILED DESCRIPTION

[0023] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It should also be noted that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings.

[0024] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0025] Figure 1 An exemplary system architecture 100 is shown to which an embodiment of a method for reducing resource consumption of an intelligent voice device or an apparatus for reducing resource consumption of an intelligent voice device of the present application can be applied.

[0026] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0027] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various client applications can be installed on terminal devices 101, 102, 103, such as sound collection applications, sound processing applications, music playback applications, smart speaker applications, etc.

[0028] Terminal devices 101, 102, and 103 can be hardware or software. When terminal devices 101, 102, and 103 are hardware, they can be various intelligent voice devices with multiple microphones, including but not limited to intelligent speakers, smart phones, tablet computers, laptop computers, and desktop computers. When terminal devices 101, 102, and 103 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules, or as a single software or software module. Terminal devices 101, 102, and 103 can detect whether the intelligent voice device is in a state to be awakened and has not been awakened for more than a preset time period; in response to detecting that the intelligent voice device is in a state to be awakened and has not been awakened for more than a preset time period, turn on the low-microphone mode to pick up the target audio; detect whether the target audio includes the wake-up word audio; in response to detecting that the target audio includes the wake-up word audio, turn on the multi-microphone mode to record and obtain the audio to be recognized. No specific limitation is made here.

[0029] The server 105 may be a server that provides various services, such as a background server that provides support for applications installed on the terminal devices 101 , 102 , and 103 .

[0030] It should be noted that the method for reducing the resource consumption of intelligent voice devices provided in the embodiment of the present application can be executed by the server 105, or by the terminal devices 101, 102, 103. Accordingly, the device for reducing the resource consumption of intelligent voice devices can be set in the server 105, or in the terminal devices 101, 102, 103.

[0031] It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0032] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0033] Continue to refer Figure 2 , shows a process 200 of an embodiment of a method for reducing resource consumption of an intelligent voice device according to the present application. The method for reducing resource consumption of an intelligent voice device comprises the following steps:

[0034] Step 201, detecting whether the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period.

[0035] In this embodiment, the method for reducing resource consumption of intelligent voice devices executes the subject (for example Figure 1 The server or terminal shown in the figure can first detect whether the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period. The preset time period can be set according to actual needs, for example, it can be set to 15 minutes. In some optional implementations of this embodiment, the multi-microphone mode may include a four-microphone (4mic) mode and a six-microphone mode, which can be specifically determined according to the hardware equipped with the intelligent voice device. Compared with the low-microphone mode, the multi-microphone mode consumes more power but can achieve better sound pickup effects.

[0036] In some optional implementations of this embodiment, the method further includes: after the intelligent voice device is started, turning on the multi-microphone mode for sound pickup, and turning off the local acoustic echo cancellation (AEC).

[0037] Step 202, in response to detecting that the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period, turning on the low-microphone mode to pick up sound to obtain the target audio.

[0038] In this embodiment, the execution subject can, in response to detecting that the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period, turn on the low-microphone mode to pick up the target audio. In some optional implementations of this embodiment, the low-microphone mode can include a single-microphone mode or a dual-microphone mode.

[0039] Step 203, detect whether the target audio includes the wake-up word audio.

[0040] In this embodiment, the above-mentioned execution entity can detect whether the target audio includes the wake-up word audio according to step 202.

[0041] Step 204, in response to detecting that the target audio includes the wake-up word audio, the multi-microphone mode is turned on to record and obtain the audio to be recognized.

[0042] In this embodiment, the execution subject can, in response to detecting that the target audio includes the wake-up word audio, start the multi-microphone mode to record and obtain the audio to be recognized. The multi-microphone mode can achieve a better sound pickup effect and obtain a higher quality audio to be recognized.

[0043] In some optional implementations of this embodiment, the method further includes: determining whether the smart voice device in the wake-up state is playing audio; in response to the smart voice device playing audio, turning on local acoustic echo cancellation; in response to the smart voice device not playing audio, turning off local acoustic echo cancellation. Reasonable turning on and off of local acoustic echo cancellation can further reduce the resource consumption of the device.

[0044] In some optional implementations of this embodiment, the method also includes: uploading the audio to be recognized to the cloud for recognition; receiving the speech recognition and semantic analysis results returned by the cloud; processing the speech recognition and semantic analysis results; and restoring to the wake-up state after the speech recognition and semantic analysis results are processed.

[0045] Continue to see Figure 3 , Figure 3 FIG. 1 is a schematic diagram of an application scenario of the method for reducing resource consumption of intelligent voice devices according to this embodiment. Figure 3 In the application scenario, after the application is started, the voice-related engine is initialized, the 4mic mode is turned on and the sound is picked up, and the local AEC is turned off;

[0046] Then enter the homepage and enter the waiting state, detect whether there is music playing, turn on the local AEC if there is music playing, and turn off the local AEC if there is no music playing. At the same time, check whether it has not been awakened for more than 15 minutes. If it has, turn off the 4mic mode and turn on the single mic for sound pickup. When the engine detects the wake-up word audio, it switches to the recognition state and turns on the 4mic mode for recording. Finally, upload the audio to the cloud for recognition, receive the cloud recognition results and semantic results and process them, and return to the waiting state after the processing is completed.

[0047] The method provided by the above-mentioned embodiments of the present application provides a method for reducing resource consumption of intelligent voice devices and improving user experience by detecting whether the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period; in response to detecting that the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period, turning on the few-microphone mode to pick up sound to obtain the target audio; detecting whether the target audio includes wake-up word audio; in response to detecting that the target audio includes wake-up word audio, turning on the multi-microphone mode to record to obtain audio to be recognized.

[0048] Further references Figure 4 As an implementation of the methods shown in the above figures, the present application provides an embodiment of a device for reducing resource consumption of an intelligent voice device. Figure 2 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0049] like Figure 4 As shown, the device 400 for reducing resource consumption of intelligent voice devices in this embodiment includes: a first detection unit 401, a first opening unit 402, a second detection unit 403, and a second opening unit 404. Among them, the first detection unit is configured to detect whether the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period; the first opening unit is configured to, in response to detecting that the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period, turn on the low-microphone mode to pick up the target audio; the second detection unit is configured to detect whether the target audio includes the wake-up word audio; the second opening unit is configured to, in response to detecting that the target audio includes the wake-up word audio, turn on the multi-microphone mode to record and obtain the audio to be recognized.

[0050] In this embodiment, the specific processing of the first detection unit 401, the first opening unit 402, the second detection unit 403, and the second opening unit 404 of the apparatus 400 for reducing resource consumption of an intelligent voice device can refer to Figure 2 This corresponds to step 201, step 202, step 203 and step 204 in the embodiment.

[0051] In some optional implementations of this embodiment, the device also includes a local acoustic echo cancellation control unit, which is configured to: determine whether the intelligent voice device in the wake-up state is playing audio; in response to the intelligent voice device playing audio, turn on local acoustic echo cancellation; in response to the intelligent voice device not playing audio, turn off local acoustic echo cancellation.

[0052] In some optional implementations of this embodiment, the apparatus further includes an initialization unit, which is configured to: after the intelligent voice device is started, turn on the multi-microphone mode for sound pickup, and turn off the local acoustic echo cancellation.

[0053] In some optional implementations of this embodiment, the device also includes a processing unit, which is configured to: upload the audio to be recognized to the cloud for recognition; receive the speech recognition and semantic analysis results returned by the cloud; process the speech recognition and semantic analysis results; and restore to the wake-up state after the speech recognition and semantic analysis results are processed.

[0054] In some optional implementations of this embodiment, the few-microphone mode includes a single-microphone mode, and the multi-microphone mode includes a four-microphone mode.

[0055] The device provided by the above-mentioned embodiments of the present application provides a method for reducing resource consumption of intelligent voice devices and improving user experience by detecting whether the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period; in response to detecting that the intelligent voice device is in a to-be-wake-up state and has not been awakened for a preset time period, turning on the few-microphone mode to pick up sound to obtain the target audio; detecting whether the target audio includes wake-up word audio; in response to detecting that the target audio includes wake-up word audio, turning on the multi-microphone mode to record to obtain audio to be recognized.

[0056] Reference below Figure 5 , which shows a schematic diagram of the structure of a computer system 500 suitable for implementing a server or terminal of an embodiment of the present application. Figure 5 The server or terminal shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0057] like Figure 5 As shown, the computer system 500 includes a central processing unit (CPU) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage part 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the system 500 are also stored. The CPU 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0058] The following components can be connected to the I / O interface 505: an input section 506 including such as a keyboard, a mouse, etc.; an output section 507 including such as a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 508 including a hard disk, etc.; and a communication section 509 including a network interface card such as a LAN card, a modem, etc. The communication section 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the I / O interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed, so that a computer program read therefrom is installed into the storage section 508 as needed.

[0059] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 509, and / or installed from the removable medium 511. When the computer program is executed by the central processing unit (CPU) 501, the above functions defined in the method of the present application are executed. It should be noted that the computer-readable medium described in the present application can be a computer-readable signal medium or a computer-readable medium or any combination of the above two. The computer-readable medium can be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable media may include, but are not limited to, an electrical connection with one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, an apparatus or a device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, an apparatus or a device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0060] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as C or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0061] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0062] The units involved in the embodiments of the present application may be implemented by software or by hardware. The described units may also be provided in a processor. For example, they may be described as follows: a processor includes a first detection unit, a first activation unit, a second detection unit, and a second activation unit. The names of these units do not, in some cases, constitute limitations on the units themselves. For example, the first detection unit may also be described as "a unit configured to detect whether the intelligent voice device is in a state to be awakened and has not been awakened for more than a preset time period."

[0063] As another aspect, the present application also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs. When the above one or more programs are executed by the device, the device: detects whether the intelligent voice device is in a state to be awakened and has not been awakened for a preset time period; in response to detecting that the intelligent voice device is in a state to be awakened and has not been awakened for a preset time period, turns on the low-microphone mode to pick up the target audio; detects whether the target audio includes the wake-up word audio; in response to detecting that the target audio includes the wake-up word audio, turns on the multi-microphone mode to record and obtain the audio to be recognized.

[0064] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.

Claims

1. A method for reducing resource consumption of an intelligent voice device, comprising: Detect whether the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period; In response to detecting that the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period, turning on a low-microphone mode to pick up sound to obtain target audio; Detecting whether the target audio includes a wake-up word audio; In response to detecting that the target audio includes the wake-up word audio, starting a multi-microphone mode to record and obtain the audio to be recognized; After the intelligent voice device is started, the multi-microphone mode is turned on for voice pickup, and the local acoustic echo cancellation is turned off; The method further comprises: Uploading the audio to be recognized to the cloud for recognition; Receive speech recognition and semantic analysis results returned by the cloud; Processing the speech recognition and semantic analysis results; After the speech recognition and semantic analysis results are processed, the system returns to the waiting-to-wake-up state.

2. The method according to claim 1, wherein: The method further comprises: Determine whether the intelligent voice device in the wake-up state is playing audio; In response to the intelligent voice device playing audio, starting local acoustic echo cancellation; In response to the intelligent voice device not playing audio, local acoustic echo cancellation is turned off.

3. The method according to any one of claims 1 to 2, wherein: The few-microphone mode includes a single-microphone mode, and the multi-microphone mode includes a four-microphone mode.

4. A device for reducing resource consumption of an intelligent voice device, comprising: A first detection unit is configured to detect whether the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period; A first activation unit is configured to, in response to detecting that the intelligent voice device is in a waiting state and has not been awakened for more than a preset time period, activate a low-microphone mode to pick up sound to obtain target audio; A second detection unit is configured to detect whether the target audio includes a wake-up word audio; A second activation unit is configured to activate a multi-microphone mode to record audio to obtain audio to be recognized in response to detecting that the target audio includes the wake-up word audio; The device further comprises an initialization unit configured to: After the intelligent voice device is started, the multi-microphone mode is turned on for voice pickup, and the local acoustic echo cancellation is turned off; Uploading the audio to be recognized to the cloud for recognition; Receive speech recognition and semantic analysis results returned by the cloud; Processing the speech recognition and semantic analysis results; After the speech recognition and semantic analysis results are processed, the system returns to the waiting-to-wake-up state.

5. The device according to claim 4, wherein: The apparatus further comprises a local acoustic echo cancellation control unit configured to: Determine whether the intelligent voice device in the wake-up state is playing audio; In response to the intelligent voice device playing audio, starting local acoustic echo cancellation; In response to the intelligent voice device not playing audio, local acoustic echo cancellation is turned off.

6. An electronic device comprising: one or more processors; a storage device having one or more programs stored thereon; When the one or more programs are executed by the one or more processors, the one or more processors are enabled to implement the method according to any one of claims 1 to 3.

7. A computer readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method according to any one of claims 1 to 3 is implemented.

Images