Spliced screen display interaction method and system based on gesture control

Abstract

The invention belongs to the technical field of display, and discloses a splicing screen display interaction method and system based on gesture control. The method comprises the following steps: capturing gesture operation data of a user based on an image sensor deployed around the spliced screen, and inputting the gesture operation data into a pre-trained gesture recognition model to output a corresponding operation purpose; wherein the gesture recognition model is built based on a deep learning algorithm; the operation purpose comprises picture aggregation and aggregation position, picture dispersion and dispersion position, picture rotation and rotation angle, picture depth-of-field movement, and target area scaling and scaling position for the spliced screen; converting the operation purpose into a control signal to be input to a control end of the spliced screen; and performing display switching on the display end of the spliced screen based on the control signal. Diversified interactive display can be realized, so that derivative requirements of users in various scenes are met.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a spliced ​​screen display interaction method and system based on gesture control. Background Art

[0002] A spliced ​​screen is a large or extra-large display device that is composed of multiple independent smaller display screens to display a wide angle. It is commonly used in outdoor display, monitoring display and other scenarios.

[0003] Existing splicing screens all use a fixed display format. Specifically, after the splicing screen hardware is installed, the display mode will be set based on the program, such as the screen is spread across all smaller screens to display the splicing screen in an aggregated manner; for example, several independent and complete screens are discretely displayed in a matrix style on the splicing screen. Once the program setting is completed, the display mode is also fixed. If the display mode needs to be modified, the program needs to be modified and reloaded.

[0004] However, with the advancement of technology and the improvement of material standards, in addition to the basic display function, splicing screens also need to meet the derivative needs of users in various scenarios. For example, in commercial advertisements and large-scale exhibitions, it is necessary to attract users to stop and learn about products based on the splicing screen, and to promote and sell products. In the monitoring center, it is necessary to quickly retrieve monitoring data on demand to quickly respond to the corresponding monitoring conditions. However, the existing fixed display method cannot meet the above needs. Summary of the invention

[0005] The purpose of the present invention is to provide a splicing screen display interaction method and system based on gesture control, so as to improve the technical problem that the existing splicing screen fixed display mode cannot meet the derived needs of users in various scenarios.

[0006] To achieve the above object, the present invention proposes the following technical solutions:

[0007] In a first aspect, the technical solution provides a splicing screen display interaction method based on gesture control, comprising:

[0008] Capturing the user's gesture operation data based on image sensors deployed around the spliced ​​screen, and inputting the gesture operation data into a pre-trained gesture recognition model to output a corresponding operation purpose;

[0009] The gesture recognition model is built based on a deep learning algorithm; the operation purpose includes image aggregation and aggregation position, image dispersion and dispersion position, image rotation and rotation angle, image depth movement, target area scaling and scaling position of the spliced ​​screen;

[0010] Converting the operation purpose into a control signal to input into the control end of the splicing screen;

[0011] The display end of the spliced ​​screen is switched based on the control signal.

[0012] Further, after switching the display end of the spliced ​​screen based on the control signal; it includes:

[0013] When it is determined that no new gesture operation data is captured within the first preset time period, a restoration control signal is input to the control end of the splicing screen;

[0014] Based on the restoration control signal, the display end of the spliced ​​screen is controlled to display a preset initial picture.

[0015] Furthermore, the method of capturing the user's gesture operation data based on image sensors deployed around the spliced ​​screen includes:

[0016] When it is determined that there are multiple gesture operation data at the same time and they come from different users, they are all input into a pre-trained gesture recognition model to output corresponding multiple operation purposes;

[0017] When it is determined that the operation purposes are different, obtaining the position coordinates of each user, and calculating the closest position coordinates of each position coordinate that are closest to the preset operation position coordinates;

[0018] The user's operation purpose corresponding to the most recent position coordinates is focused on, and other operation purposes are ignored.

[0019] Furthermore, the display switching of the display end of the spliced ​​screen based on the control signal includes:

[0020] Obtaining a user request to generate a video screen corresponding to a display switching process, and / or a screenshot screen of any display screen;

[0021] Sending an acquisition instruction to the display end of the spliced ​​screen; wherein the acquisition instruction is used to guide the user to acquire the video screen and / or the screenshot screen;

[0022] Obtain user feedback, or when no user feedback is obtained within a second preset time period, input a next control signal to the control end of the spliced ​​screen;

[0023] Based on the next control signal, the display end of the spliced ​​screen is controlled to switch the current picture.

[0024] In a second aspect, the present technical solution provides a spliced ​​screen display interactive system based on gesture control.

[0025] include:

[0026] A gesture recognition module, used to capture the user's gesture operation data based on image sensors deployed around the spliced ​​screen, and input the gesture operation data into a pre-trained gesture recognition model to output a corresponding operation purpose;

[0027] The gesture recognition model is built based on a deep learning algorithm; the operation purpose includes image aggregation and aggregation position, image dispersion and dispersion position, image rotation and rotation angle, image depth movement, target area scaling and scaling position of the spliced ​​screen;

[0028] A signal conversion module, used for converting the operation purpose into a control signal to be input to the control end of the splicing screen;

[0029] The display control module is used to switch the display of the spliced ​​screen based on the control signal.

[0030] Further, including:

[0031] A judgment module, used for inputting a restoration control signal to the control end of the splicing screen when judging that no new gesture operation data is captured within a first preset time period;

[0032] An initialization module is used to control the display end of the spliced ​​screen to display a preset initial screen based on the restoration control signal.

[0033] Furthermore, the gesture recognition module includes:

[0034] a purpose acquisition unit, for determining that when there are multiple gesture operation data at the same time and they come from different users, inputting them into a pre-trained gesture recognition model to output multiple corresponding operation purposes;

[0035] A position acquisition unit, used for acquiring the position coordinates of each user when determining that the operation purposes are different, and calculating the nearest position coordinates of each position coordinate that are closest to the preset operation position coordinates;

[0036] The purpose locking unit is used to focus on the user's operation purpose corresponding to the most recent position coordinates and ignore other operation purposes.

[0037] Furthermore, the display control module includes:

[0038] A request acquisition unit, used to acquire a user request to generate a video screen corresponding to the display switching process, and / or a screenshot screen of any display screen;

[0039] An instruction sending unit, used for sending an acquisition instruction to the display end of the spliced ​​screen; wherein the acquisition instruction is used to guide the user to acquire the video screen and / or the screenshot screen;

[0040] A signal control unit, used to obtain user feedback, or input a next control signal to the control end of the spliced ​​screen when no user feedback is obtained within a second preset time period;

[0041] A picture switching unit is used to control the display end of the spliced ​​screen to switch the current picture based on the next control signal.

[0042] In a third aspect, the technical solution provides an electronic device, comprising at least one processor, the processor being coupled to a memory, the memory storing a computer program, and the computer program being configured to execute the method when executed by the processor.

[0043] In a fourth aspect, the technical solution provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a computer, the method described above is implemented.

[0044] Beneficial effects:

[0045] It can be seen from the above technical solutions that the technical solution of the present invention provides a splicing screen display interaction method based on gesture control to improve the defect that the existing splicing screen fixed display method cannot meet the derived needs of users in various scenarios.

[0046] Specifically, the method includes: first, capturing the user's gesture operation data based on the image sensors deployed around the splicing screen, and inputting the gesture operation data into a pre-trained gesture recognition model to output the corresponding operation purpose. The gesture recognition model is built based on a deep learning algorithm; the operation purpose includes screen aggregation and aggregation position, screen dispersion and dispersion position, screen rotation and rotation angle, screen depth movement, target area scaling and scaling position. Secondly, converting the operation purpose into a control signal to input into the control end of the splicing screen. Finally, switching the display end of the splicing screen based on the control signal.

[0047] In summary, this technical solution proposes a method for using gesture interaction to control the special-shaped display of the splicing screen, so that users do not need to rely on physical buttons, remote controls or computer software, and can achieve display switching control of the splicing screen through simple gestures. And the gesture control method improves user satisfaction through intuitive and natural interaction. It can also adapt to the use needs in different scenarios, such as large-scale exhibitions, commercial advertisements, etc. Specifically, in large-scale exhibition scenarios, the splicing screen is controlled by gestures to display rich and diverse exhibition content, thereby enhancing the audience's participation and experience. In commercial advertising scenarios, the splicing screen is controlled by gestures to achieve rapid switching and display of advertising content and attract consumers' attention. In the monitoring center scenario, the splicing screen is controlled by gestures to achieve aggregation, rotation and other operations of multiple monitoring screens, thereby improving monitoring efficiency. This effectively meets various derivative needs of users.

[0048] It should be appreciated that all combinations of the foregoing concepts, as well as additional concepts described in greater detail below, may be considered to be part of the inventive subject matter of the present disclosure, provided such concepts are not mutually inconsistent.

[0049] The foregoing and other aspects, embodiments and features of the present invention can be more fully understood from the following description in conjunction with the accompanying drawings. Other additional aspects of the present invention, such as the features and / or beneficial effects of the exemplary embodiments, will be apparent from the following description or learned from the practice of the specific embodiments according to the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The drawings are not intended to be drawn to scale. In the drawings, each identical or nearly identical component shown in various figures may be represented by the same reference numeral. For clarity, not every component is labeled in every figure. Embodiments of various aspects of the present invention will now be described by way of example and with reference to the accompanying drawings, in which:

[0051] Figure 1 This is a flow chart of the gesture-controlled spliced ​​screen display interaction method described in this embodiment;

[0052] Figure 2 Processing flow chart for capturing multi-user gestures;

[0053] Figure 3 The processing flow chart after the current user gesture interaction display ends;

[0054] Figure 4 A flowchart for processing the interaction results;

[0055] Figure 5 It is a structural block diagram of the splicing screen display interactive system based on gesture control described in this embodiment;

[0056] Figure 6 is a structural block diagram of the electronic device described in this embodiment. DETAILED DESCRIPTION

[0057] In order to make the purpose, technical solution and advantages of the embodiment of the present invention clearer, the technical solution of the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings of the embodiment of the present invention. Obviously, the described embodiment is a part of the embodiment of the present invention, not all of the embodiments. Based on the described embodiment of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. Unless otherwise defined, the technical terms or scientific terms used herein should be the common meaning understood by people with general skills in the field to which the present invention belongs.

[0058] The words "first", "second" and similar words used in the specification and claims of this application do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, unless the context clearly indicates otherwise, the singular form of "a", "an" or "the" and other similar words do not indicate a quantitative limitation, but rather indicate the presence of at least one. Words such as "include" or "comprise" and the like mean that the elements or objects appearing before "include" or "comprise" cover the features, wholes, steps, operations, elements and / or components listed after "include" or "comprise", and do not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, components and / or their collections. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0059] With the advancement of technology and the improvement of material standards, in addition to basic display functions, spliced ​​screens also need to meet the derivative needs of users in various scenarios. For example, in commercial advertisements and large-scale exhibitions, it is necessary to attract users to stop and understand the products based on the spliced ​​screen, and to promote and sell the products. In the monitoring center, it is necessary to quickly retrieve the monitoring data on demand in order to quickly respond to the corresponding monitoring conditions. However, the existing fixed display method cannot meet the above needs. Based on this, this embodiment aims to provide a spliced ​​screen display interaction method based on gesture control to improve the above technical defects.

[0060] The following is a detailed introduction to the gesture-controlled spliced ​​screen display interaction method of this embodiment in conjunction with the accompanying drawings.

[0061] like Figure 1 As shown, the method comprises the following steps:

[0062] Step S102: Capture the user's gesture operation data based on image sensors deployed around the spliced ​​screen, and input the gesture operation data into a pre-trained gesture recognition model to output a corresponding operation purpose.

[0063] In this step, the gesture recognition model is built based on a deep learning algorithm.

[0064] Specifically, the operation purpose includes image aggregation and aggregation position, image dispersion and dispersion position, image rotation and rotation angle, image depth movement, target area scaling and scaling position.

[0065] As a specific implementation method, considering that multiple users are performing interactive gesture operations in front of the spliced ​​screen at the same time. In order to respond accurately in such a situation. Figure 2 As shown, the method of capturing the user's gesture operation data based on the image sensors deployed around the spliced ​​screen also includes the following steps:

[0066] Step S10202: when it is determined that there are multiple gesture operation data at the same time and they come from different users, they are all input into the gesture operation data input pre-trained gesture recognition model to output corresponding multiple operation purposes.

[0067] Step S10204: when it is determined that the operation purposes are different, the position coordinates of each user are obtained, and the nearest position coordinates of each position coordinate and the preset operation position coordinates are calculated.

[0068] In specific implementation, the operation position coordinates may be the coordinates of the center position at a certain distance from the splicing screen. At this time, the user at the nearest position coordinates is considered as the core operation user. Based on this, proceed as follows:

[0069] Step S10206: focus on the user's operation purpose corresponding to the most recent position coordinates, and ignore other operation purposes.

[0070] At this time, based on steps S10202 to S10206, the proximity principle can be introduced to improve the accuracy of gesture recognition.

[0071] Step S104: convert the operation purpose into a control signal to input into the control end of the splicing screen.

[0072] Step S106: switching the display of the display end of the spliced ​​screen based on the control signal.

[0073] As a specific implementation method, since the corresponding interactive display is related to personal preferences, in order to improve the interactive experience of subsequent users, Figure 3 As shown, after step S106, the following steps are further included:

[0074] Step S10802: When it is determined that no new gesture operation data is captured within the first preset time period, a restoration control signal is input to the control end of the spliced ​​screen.

[0075] Step S10804: Based on the restoration control signal, the display end of the spliced ​​screen is controlled to display a preset initial screen.

[0076] At this time, based on steps S10802 to S10804, whether the interactive display operation is completed can be determined by whether there is a new gesture operation, thereby facilitating subsequent users to continue the interactive display operation and improving the display experience.

[0077] As another specific implementation method, the user's need to save the interaction process and results is taken into consideration. For example, in a monitoring center scenario, some abnormal parameters or key parameters may need to be saved to facilitate subsequent problem clarification or analysis and optimization; in a large exhibition scenario, product information of interest may need to be retained to facilitate subsequent purchases or product comparison analysis. Even in some scenarios, the entire interactive operation process forms a visually beautiful video screen. Based on this consideration, combined with Figure 4 As shown, step S106 also includes:

[0078] Step S10602: Obtain a user request to generate a video screen corresponding to the display switching process, and / or a screenshot screen of any display screen.

[0079] Step S10604: Send an acquisition instruction to the display end of the spliced ​​screen.

[0080] In this step, the acquisition instruction is used to guide the user to acquire the video screen and / or the screenshot screen;

[0081] Step S10606: Obtain user feedback, or when no user feedback is obtained within a second preset time period, input a next control signal to the control end of the spliced ​​screen.

[0082] Step S10608: Control the display end of the spliced ​​screen to switch the current screen based on the next control signal.

[0083] At this time, based on steps S10602 to S10608, the operation results can be saved and obtained immediately, and the saved content is only triggered upon user request, thereby avoiding memory occupation of the storage end of the splicing screen during automatic saving, which affects the smoothness of interaction.

[0084] In summary, the method of this embodiment can realize the display switching control of the spliced ​​screen through simple gestures. And the gesture control method improves the user's satisfaction through intuitive and natural interaction. It can also adapt to the use needs in different scenarios, such as large exhibitions, commercial advertisements, etc. At the same time, considering the simultaneous operation of multiple users and the user's need to save the interaction results, a corresponding solution is designed.

[0085] The above program can be run in the processor, or it can be stored in the memory (or computer-readable storage medium), which includes permanent and non-permanent, removable and non-removable media. Information storage can be achieved by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined in this article, computer-readable media does not include temporary computer-readable media, such as modulated data signals and carrier waves.

[0086] These computer programs can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps of the functions specified in one or more blocks can be implemented by different modules corresponding to different steps.

[0087] Based on this, this embodiment also provides a splicing screen display interactive system based on gesture control. Figure 5 As shown, including:

[0088] The gesture recognition module is used to capture the user's gesture operation data based on the image sensors deployed around the spliced ​​screen, and input the gesture operation data into a pre-trained gesture recognition model to output the corresponding operation purpose.

[0089] Among them, the gesture recognition model is built based on a deep learning algorithm; the operation purpose includes screen aggregation and aggregation position, screen dispersion and dispersion position, screen rotation and rotation angle, screen depth movement, target area scaling and scaling position.

[0090] The signal conversion module is used to convert the operation purpose into a control signal to input to the control end of the splicing screen.

[0091] The display control module is used to switch the display of the spliced ​​screen based on the control signal.

[0092] Since the system is built based on the method, what has been described above will not be repeated here.

[0093] For example, the system further comprises:

[0094] The judgment module is used to input a restoration control signal to the control end of the splicing screen when judging that no new gesture operation data is captured within a first preset time period.

[0095] An initialization module is used to control the display end of the spliced ​​screen to display a preset initial screen based on the restoration control signal.

[0096] For example, the gesture recognition module includes:

[0097] The purpose acquisition unit is used to determine that when there are multiple gesture operation data at the same time and they come from different users, input them all into the pre-trained gesture recognition model to output corresponding multiple operation purposes.

[0098] The position acquisition unit is used to acquire the position coordinates of each user when it is determined that the operation purposes are different, and calculate the nearest position coordinates of each position coordinate that are closest to the preset operation position coordinates.

[0099] The purpose locking unit is used to focus on the user's operation purpose corresponding to the most recent position coordinates and ignore other operation purposes.

[0100] For another example, the display control module includes:

[0101] The request acquisition unit is used to acquire a user request to generate a video screen corresponding to the display switching process, and / or a screenshot screen of any display screen.

[0102] An instruction sending unit is used to send an acquisition instruction to the display end of the spliced ​​screen; wherein the acquisition instruction is used to guide the user to acquire the video screen and / or the screenshot screen.

[0103] The signal control unit is used to obtain user feedback, or when no user feedback is obtained within a second preset time period, input the next control signal to the control end of the spliced ​​screen.

[0104] A picture switching unit is used to control the display end of the spliced ​​screen to switch the current picture based on the next control signal.

[0105] This embodiment also provides an electronic device. Figure 6 As shown, it includes at least one processor, the processor is coupled to a memory, a computer program is stored in the memory, and the computer program is configured to execute the method when executed by the processor.

[0106] At the same time, this embodiment also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a computer, the method described above is implemented.

[0107] Since the system, electronic device and storage medium are all built based on the method and used to implement the method, in actual application, a variety of interactive displays can be used to meet the user's derived needs in corresponding scenarios.

[0108] Although the present invention has been disclosed as above with preferred embodiments, it is not intended to limit the present invention. A person with ordinary knowledge in the technical field to which the present invention belongs may make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be determined by the definition of the claims.

Claims

1. A splicing screen display interaction method based on gesture control, characterized in that: include: Capturing the user's gesture operation data based on image sensors deployed around the spliced ​​screen, and inputting the gesture operation data into a pre-trained gesture recognition model to output a corresponding operation purpose; The gesture recognition model is built based on a deep learning algorithm; the operation purpose includes image aggregation and aggregation position, image dispersion and dispersion position, image rotation and rotation angle, image depth movement, target area scaling and scaling position of the spliced ​​screen; Converting the operation purpose into a control signal to input into the control end of the splicing screen; The display end of the spliced ​​screen is switched based on the control signal.

2. The gesture-controlled splicing screen display interaction method according to claim 1, characterized in that: After switching the display end of the spliced ​​screen based on the control signal; comprising: When it is determined that no new gesture operation data is captured within the first preset time period, a restoration control signal is input to the control end of the splicing screen; Based on the restoration control signal, the display end of the spliced ​​screen is controlled to display a preset initial picture.

3. The interactive method for splicing screen display based on gesture control according to claim 1, characterized in that: The method captures the user's gesture operation data based on image sensors deployed around the spliced ​​screen; comprising: When it is determined that there are multiple gesture operation data at the same time and they come from different users, they are all input into a pre-trained gesture recognition model to output corresponding multiple operation purposes; When it is determined that the operation purposes are different, obtaining the position coordinates of each user, and calculating the closest position coordinates of each position coordinate that are closest to the preset operation position coordinates; The user's operation purpose corresponding to the most recent position coordinates is focused on, and other operation purposes are ignored.

4. The interactive method for splicing screen display based on gesture control according to claim 1, characterized in that: The method of switching the display end of the spliced ​​screen based on the control signal comprises: Obtaining a user request to generate a video screen corresponding to a display switching process, and / or a screenshot screen of any display screen; Sending an acquisition instruction to the display end of the spliced ​​screen; wherein the acquisition instruction is used to guide the user to acquire the video screen and / or the screenshot screen; Obtain user feedback, or when no user feedback is obtained within a second preset time period, input a next control signal to the control end of the spliced ​​screen; Based on the next control signal, the display end of the spliced ​​screen is controlled to switch the current picture.

5. A splicing screen display interactive system based on gesture control, characterized in that: include: A gesture recognition module, used to capture the user's gesture operation data based on image sensors deployed around the spliced ​​screen, and input the gesture operation data into a pre-trained gesture recognition model to output a corresponding operation purpose; The gesture recognition model is built based on a deep learning algorithm; the operation purpose includes image aggregation and aggregation position, image dispersion and dispersion position, image rotation and rotation angle, image depth movement, target area scaling and scaling position of the spliced ​​screen; A signal conversion module, used for converting the operation purpose into a control signal to be input to the control end of the splicing screen; The display control module is used to switch the display of the spliced ​​screen based on the control signal.

6. The gesture-controlled splicing screen display interactive system according to claim 5, characterized in that: include: A judgment module, used for inputting a restoration control signal to the control end of the splicing screen when judging that no new gesture operation data is captured within a first preset time period; An initialization module is used to control the display end of the spliced ​​screen to display a preset initial screen based on the restoration control signal.

7. The gesture-controlled splicing screen display interactive system according to claim 5, characterized in that: The gesture recognition module comprises: a purpose acquisition unit, for determining that when there are multiple gesture operation data at the same time and they come from different users, inputting them into a pre-trained gesture recognition model to output multiple corresponding operation purposes; A position acquisition unit, used for acquiring the position coordinates of each user when determining that the operation purposes are different, and calculating the nearest position coordinates of each position coordinate that are closest to the preset operation position coordinates; The purpose locking unit is used to focus on the user's operation purpose corresponding to the most recent position coordinates and ignore other operation purposes.

8. The gesture-controlled splicing screen display interactive system according to claim 5, characterized in that: The display control module comprises: A request acquisition unit, used to acquire a user request to generate a video screen corresponding to the display switching process, and / or a screenshot screen of any display screen; An instruction sending unit, used for sending an acquisition instruction to the display end of the spliced ​​screen; wherein the acquisition instruction is used to guide the user to acquire the video screen and / or the screenshot screen; A signal control unit, used to obtain user feedback, or input a next control signal to the control end of the spliced ​​screen when no user feedback is obtained within a second preset time period; A picture switching unit is used to control the display end of the spliced ​​screen to switch the current picture based on the next control signal.

9. An electronic device, characterized in that: The method comprises at least one processor, wherein the processor is coupled to a memory, wherein a computer program is stored in the memory, and wherein the computer program is configured to execute the method according to any one of claims 1 to 4 when executed by the processor.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a computer, the method according to any one of claims 1 to 4 is implemented.

Images