Artwork environment parameter adjusting method and device and electronic equipment

By obtaining artwork characteristic information and environmental monitoring information, dynamically adjusting the environmental parameters of the artwork, the problem that traditional methods are difficult to meet the needs of personalized display of different artworks is solved, and efficient and personalized artwork display effects are achieved.

CN119511986APending Publication Date: 2025-02-25ZHEJIANG GRAND LEISURE OUTDOOR PROD CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411619691.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-13
Publication Date
2025-02-25

AI Technical Summary

Technical Problem

Traditional artwork environmental parameter adjustment methods are difficult to meet the personalized display needs of different types of artworks, especially in terms of temperature and humidity and lighting control, which cannot meet the needs of different materials such as oil painting, sketching, and sculpture at the same time.

Method used

By obtaining the characteristic information of the artwork and environmental monitoring information, dynamically adjust the internal environmental parameters in the sunroom, including temperature, humidity and lighting parameters, to ensure that the artwork is always in the best display state.

Benefits of technology

It realizes personalized display of different types of artworks, reduces manual intervention, reduces the risk of artwork damage caused by human operational errors, and improves audience participation and satisfaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119511986A_ABST
    Figure CN119511986A_ABST
Patent Text Reader

Abstract

The invention provides an artwork environment parameter adjusting method and device and electronic equipment, and the method comprises the steps: obtaining the feature information and environment monitoring information of a target artwork in a sunlight room, and the environment monitoring information comprises the internal environment parameters of the sunlight room, and / or the external environment parameters of the sunlight room; and adjusting the internal environment parameters according to the feature information and / or the environment monitoring information. In the implementation process of the scheme, the change of the feature information, the internal environment parameters and / or the external environment parameters of the target artwork in the sunlight room is comprehensively considered, so that the internal environment parameters in the sunlight room are dynamically adjusted, the internal environment of the sunlight room is always in an optimal state, and the service life of the sunlight room is prolonged. Therefore, the personalized display requirements of the artworks in the sunlight room are effectively met.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical fields of intelligent control, the Internet of Things and artificial intelligence, and more specifically, to a method, device and electronic device for adjusting environmental parameters of artworks. Background Art

[0002] At present, the adjustment of environmental parameters of artworks usually relies on manual adjustment of environmental parameters. Since only the temperature and humidity in the exhibition hall can be adjusted uniformly, it is difficult to meet the needs of all types of artworks at the same time. In addition, the lighting is often controlled uniformly, which may cause some artworks to be overexposed or under-lit. For example, for exhibitions of various types of artworks, the oil paintings, sketches and sculptures in the exhibition have different requirements for temperature and humidity and the best lighting display effects. Therefore, traditional environmental parameter adjustment of artworks usually relies on manual adjustment of environmental parameters, which is difficult to meet the personalized display needs of artworks. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a method, device and electronic device for adjusting environmental parameters of artworks, so as to improve the problem of difficulty in meeting the personalized display needs of artworks.

[0004] The embodiment of the present application provides a method for adjusting the environmental parameters of artworks, including: obtaining characteristic information and environmental monitoring information of a target artwork in a sunroom, the environmental monitoring information including: internal environmental parameters of the sunroom, and / or external environmental parameters of the sunroom; adjusting the internal environmental parameters according to the characteristic information and / or environmental monitoring information. In the implementation of the above scheme, by comprehensively considering the characteristic information, internal environmental parameters and / or external environmental parameters of the target artwork in the sunroom, the internal environmental parameters in the sunroom are dynamically adjusted to ensure that the internal environment of the sunroom is always in the best state, thereby effectively meeting the personalized display needs of the artworks in the sunroom.

[0005] Optionally, in an embodiment of the present application, the characteristic information of the target artwork includes: material characteristics; obtaining the characteristic information of the target artwork in the sunroom includes: extracting the material characteristics of the target artwork from the image data of the target artwork; or extracting the material characteristics of the target artwork from the sensor data of the target artwork. In the implementation process of the above scheme, by accurately identifying the material characteristics of the target artwork from the image data or sensor data of the target artwork, the system can automatically adjust environmental parameters such as temperature and humidity according to the material characteristics to ensure that each artwork is in the best preservation condition, thereby reducing the need for manual intervention and reducing the risk of damage to artworks due to human operational errors.

[0006] Optionally, in an embodiment of the present application, extracting material features of a target artwork from the image data of the target artwork includes: identifying description text of the target artwork from the image data of the target artwork, and determining the material features of the target artwork based on the description text of the target artwork; or extracting texture features from the image data of the target artwork, and determining the material features of the target artwork based on the texture features; or extracting light reflection features and light absorption features from the image data of the target artwork, and determining the material features of the target artwork based on the light reflection features and light absorption features. In the implementation process of the above scheme, whether it is oil painting, ceramics, paper artwork or other materials, it can be accurately identified through image data (and description text), so that it can adapt to the identification of multiple material features, and directly provide material information through description text, reducing the risk of misjudgment that may be caused by relying solely on image analysis, thereby improving the recognition accuracy of material features.

[0007] Optionally, in the embodiment of the present application, the internal environmental parameters include: temperature and / or humidity; adjusting the internal environmental parameters according to the characteristic information and / or environmental monitoring information includes: determining the target temperature and / or target humidity in the sunroom according to the material characteristics of the target artwork; adjusting the current temperature in the sunroom to the target temperature in the sunroom, and / or adjusting the current humidity in the sunroom to the target humidity in the sunroom. In the implementation of the above scheme, since different art materials have specific requirements for temperature and humidity, by responding to and adjusting the current temperature and / or humidity in a timely manner, adverse environmental factors can be effectively avoided in a timely manner, such as automatically taking adjustment measures when it is detected that the temperature is about to exceed the safety range, thereby avoiding potential damage.

[0008] Optionally, in an embodiment of the present application, the characteristic information of the target artwork includes: color characteristics and morphological structure characteristics, internal environmental parameters include: lighting parameters, and external environmental parameters include: behavior parameters of visitors; adjusting the internal environmental parameters according to the characteristic information and / or environmental monitoring information includes: determining the target lighting parameters of the target artwork according to the color characteristics, morphological structure characteristics and / or behavior parameters of the visitors; adjusting the current lighting parameters according to the target lighting parameters of the target artwork. In the implementation process of the above scheme, the system can dynamically adjust the lighting parameters according to the color characteristics, morphological structure characteristics and / or behavior parameters of the visitors, so that the artwork currently being paid attention to is more prominent, and combined with the audience's behavior data and the characteristic information of the artwork, the system can guide the audience to these exhibits by adjusting the lighting parameters, thereby improving the audience's participation and satisfaction.

[0009] Optionally, in an embodiment of the present application, the target lighting parameters of the target artwork are determined according to the color characteristics, morphological structural characteristics and / or the behavioral parameters of the visitors, including: using a neural network model to predict according to the color characteristics, morphological structural characteristics and / or the behavioral parameters of the visitors to obtain the target lighting parameters of the target artwork; wherein the neural network model is obtained after training the neural network using the behavioral parameters of the visitors as training data and the questionnaire data of the visitors as training labels. In the implementation process of the above scheme, the target lighting parameters of the target artwork are dynamically adjusted according to the behavioral parameters of the visitors through the neural network model, so that the artwork currently being paid attention to is more prominent. According to the color characteristics of the artwork, the neural network model can predict the light color temperature that is most suitable for displaying the artwork, so that the color of the artwork is presented more realistically, and combined with the morphological structural characteristics of the artwork, the model can predict the lighting angle and brightness that can best highlight the texture and details of the artwork, thereby enhancing the visual effect.

[0010] Optionally, in the embodiment of the present application, the behavior parameters of the visitors include: the length of time they stay at a location, the path they move, the frequency of taking photos, and / or their sight lines. In the implementation of the above solution, the system can dynamically adjust the intensity, color temperature, and angle of the light according to the length of time they stay at a location, the path they move, and their sight lines, so as to highlight the artwork that the visitors are currently paying attention to.

[0011] Optionally, in the embodiment of the present application, the target lighting parameters include: lighting color temperature, lighting brightness and / or lighting angle. In the implementation of the above solution, by dynamically adjusting the lighting parameters, the lighting color temperature, lighting brightness and / or lighting angle and other lighting parameters can be adjusted according to the theme and style of the artwork, thereby creating different atmospheres.

[0012] An embodiment of the present application also provides an artwork environmental parameter adjustment device, including: a target information acquisition module, used to obtain characteristic information and environmental monitoring information of a target artwork in a sunroom, the environmental monitoring information including: internal environmental parameters of the sunroom, and / or, external environmental parameters of the sunroom; an environmental parameter adjustment module, used to adjust the internal environmental parameters according to the characteristic information and / or environmental monitoring information.

[0013] Optionally, in an embodiment of the present application, the characteristic information of the target artwork includes: material characteristics; the target information acquisition module includes: a material feature extraction sub-module for extracting the material characteristics of the target artwork from the image data of the target artwork; or, extracting the material characteristics of the target artwork from the sensor data of the target artwork.

[0014] Optionally, in an embodiment of the present application, the material feature extraction submodule includes: a first material feature determination unit, which is used to identify the description text of the target artwork from the image data of the target artwork, and determine the material features of the target artwork based on the description text of the target artwork; or, a second material feature determination unit, which is used to extract texture features from the image data of the target artwork, and determine the material features of the target artwork based on the texture features; or, a third material feature determination unit, which is used to extract light reflection features and light absorption features from the image data of the target artwork, and determine the material features of the target artwork based on the light reflection features and light absorption features.

[0015] Optionally, in an embodiment of the present application, the internal environmental parameters include: temperature and / or humidity; the environmental parameter adjustment module includes: a target temperature and humidity determination submodule, used to determine the target temperature and / or target humidity in the sunroom according to the material characteristics of the target artwork; a current temperature and humidity adjustment submodule, used to adjust the current temperature in the sunroom to the target temperature in the sunroom, and / or, to adjust the current humidity in the sunroom to the target humidity in the sunroom.

[0016] Optionally, in an embodiment of the present application, characteristic information of the target artwork includes: color characteristics and morphological structure characteristics, internal environmental parameters include: lighting parameters, external environmental parameters include: behavior parameters of visitors; the environmental parameter adjustment module includes: a target lighting parameter determination submodule, used to determine the target lighting parameters of the target artwork based on the color characteristics, morphological structure characteristics and / or behavior parameters of the visitors; a current lighting parameter adjustment submodule, used to adjust the current lighting parameters according to the target lighting parameters of the target artwork.

[0017] Optionally, in an embodiment of the present application, a target lighting parameter determination submodule includes: a lighting parameter prediction unit, which is used to use a neural network model to predict according to color features, morphological structure features and / or behavioral parameters of visitors, to obtain target lighting parameters of the target artwork; wherein the neural network model is obtained by training the neural network using the behavioral parameters of visitors as training data and the questionnaire data of visitors as training labels.

[0018] Optionally, in an embodiment of the present application, the behavior parameters of the visitor include: length of stay at a location, movement path, frequency of taking photos and / or focus of sight.

[0019] Optionally, in an embodiment of the present application, the target lighting parameters include: light color temperature, light brightness and / or light angle.

[0020] An embodiment of the present application further provides an electronic device, including: a processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the machine-readable instructions execute the method described above when executed by the processor.

[0021] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method described above is executed.

[0022] The embodiment of the present application also provides a computer program product, including: a computer program or a computer instruction, and the computer program or the computer instruction executes the method described above when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0024] Figure 1 A schematic diagram of the process of adjusting the artwork environment parameters provided in an embodiment of the present application is shown;

[0025] Figure 2 A schematic diagram of the structure of the artwork environment parameter adjustment device provided in an embodiment of the present application is shown;

[0026] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0027] To make the purpose, technical scheme and advantages of the embodiment of the present application clearer, the technical scheme in the embodiment of the present application will be clearly and completely described below in conjunction with the drawings in the embodiment of the present application. It should be understood that the drawings in the embodiment of the present application only serve the purpose of explanation and description, and are not used to limit the protection scope of the embodiment of the present application. In addition, it should be understood that the schematic drawings are not drawn in real proportion. The flowchart used in the embodiment of the present application shows the operation implemented according to some embodiments of the embodiment of the present application. It should be understood that the operation of the flowchart can be implemented out of order, and the steps without logical context can be reversed in order or implemented simultaneously. In addition, those skilled in the art can add one or more other operations to the flowchart under the guidance of the content of the embodiment of the present application, or remove one or more operations from the flowchart.

[0028] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all embodiments. The components of the embodiments of the present application described and shown in the drawings generally here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the embodiments of the present application claimed, but merely represents the selected embodiments of the embodiments of the present application.

[0029] It is understandable that the "first" and "second" in the embodiments of the present application are used to distinguish similar objects. Those skilled in the art will understand that the words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not necessarily limit the difference. In the description of the embodiments of the present application, the term "and / or" is merely a description of the association relationship of associated objects, indicating that there may be three relationships, such as A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the related objects before and after are in an "or" relationship. The term "multiple" refers to more than two (including two), and similarly, "multiple groups" refers to more than two groups (including two groups).

[0030] It should be noted that the method for adjusting the art environment parameters provided in the embodiments of the present application can be executed by electronic devices, where the electronic devices refer to device terminals or servers that have the function of executing computer programs, such as smart phones, personal computers, tablet computers, personal digital assistants, or mobile Internet devices. Servers refer to devices that provide computing services through the network, such as x86 servers and non-x86 servers, and non-x86 servers include mainframes, minicomputers, and UNIX servers.

[0031] The following is an example of an application scenario in which the artwork environmental parameter adjustment method is applicable: artworks can be placed in sunrooms in places such as shopping malls, squares, museums, art galleries, history museums or art galleries, and corresponding artwork themes can be planned according to seasons, festivals, shopping mall promotions, etc., so as to attract traffic to shopping malls, squares, museums, art galleries, history museums or art galleries and enhance commercial value. In this case, the artwork environmental parameter adjustment method can be used to adjust the artwork environmental parameters in these places. Since the method dynamically adjusts the internal environmental parameters in the sunroom by comprehensively considering the characteristic information of the target artwork in the sunroom, the changes in the internal environmental parameters and / or the external environmental parameters, the internal environment of the sunroom can always be kept in the best condition.

[0032] See also Figure 1The flowchart of the method for adjusting the environment parameters of artworks provided by the embodiment of the present application is shown; the main idea of ​​the method for adjusting the environment parameters of artworks is to comprehensively consider the characteristic information of the target artworks in the sun room, the changes of the internal environment parameters and / or the external environment parameters, so as to dynamically adjust the internal environment parameters in the sun room, so as to achieve the effect of allowing the artworks in the sun room to be displayed in a personalized manner. The implementation methods of the above-mentioned method for adjusting the environment parameters of artworks may include:

[0033] Step S110: Acquire characteristic information and environmental monitoring information of a target artwork in a sunroom, wherein the environmental monitoring information includes: internal environmental parameters of the sunroom and / or external environmental parameters of the sunroom.

[0034] Sun room refers to a transparent room for displaying artworks, and the four sides of the room can be set with transparent glass or translucent glass (such as glass with lighting effects) so that people can appreciate the artworks through the glass. It is understandable that the above-mentioned sun room can adopt a modular design, and all frames, glass panels and other structural components are manufactured according to unified standards to facilitate interchangeable installation, disassembly and transfer operations, which is suitable for temporary construction or replacement of exhibition locations such as schools or squares.

[0035] Optionally, if the sun room is set outdoors (such as a square or an open-air shopping mall), solar photovoltaic panels and energy storage batteries can also be set on the upper ceiling of the sun room, so that the solar photovoltaic panels can convert the absorbed solar energy into electrical energy and store the electrical energy in the energy storage battery, thereby powering various sensors and main control panels set in the sun room, so that sufficient power supply can be guaranteed even outdoors at night. Since various sensors are installed on the inner surface and the outer surface of the sun room, the main control panel can obtain environmental monitoring information of the sun room through these sensors, and can also obtain characteristic information of the target artwork through these sensors. The above-mentioned sensors may include: infrared sensors, high-definition cameras, temperature sensors, humidity sensors, light intensity sensors, photosensors, air quality monitors and / or global positioning system (GPS) sensors, etc.

[0036] The feature information of the above-mentioned target artwork refers to the feature information extracted from the sensor data of the artwork, including: material features, color features and / or morphological structure features, etc. The feature information of different artworks (oil paintings, ceramics, paper artworks or sculptures, etc.) is different and can be distinguished from material features, color features and / or morphological structure features.

[0037] Step S120: adjusting internal environmental parameters according to the characteristic information and / or environmental monitoring information.

[0038] It is understandable that different artworks (oil paintings, ceramics, paper artworks or sculptures, etc.) have different requirements for the internal environmental parameters of the sunroom. For example, for artworks that are particularly sensitive to humidity, the system can automatically start the dehumidifier in the sunroom to adjust the humidity in the sunroom; however, for works that require specific lighting conditions to achieve the best viewing effect, the best effect can be achieved by adjusting the sunshades and various light sources installed in the sunroom.

[0039] In the specific practice, the feature information of the artwork (such as material characteristics, storage conditions and special requirements, etc.) can be stored in the feature database of the artwork, and can also be stored in the internal environmental parameters of the sun room and / or the external environmental parameters of the sun room. When a new artwork is placed in a display space such as a sun room, it only needs to be input into the system, and then the electronic device in the embodiment of the present application can automatically identify the feature information of the artwork and / or the environmental monitoring information inside and outside the sun room where it is located, and adjust the internal environmental parameters according to the feature information and / or the environmental monitoring information.

[0040] In the process of implementing the above scheme, by comprehensively considering the characteristic information of the target artwork in the sunroom, the changes in the internal environmental parameters and / or the external environmental parameters, the internal environmental parameters in the sunroom are dynamically adjusted to ensure that the internal environment of the sunroom is always in the best state, thereby effectively meeting the personalized display needs of the artwork in the sunroom.

[0041] As an optional implementation of the above step S110, the characteristic information of the above target artwork may include: material characteristics. There are many ways to extract material characteristics, including the following:

[0042] The first method of extracting material features is to extract material features through image data. The above-mentioned implementation method of obtaining feature information of target artworks in the sun room may include:

[0043] Step S111: extracting material features of the target artwork from the image data of the target artwork.

[0044] The second method of extracting material features, or extracting material features through sensor data, the above-mentioned implementation methods of obtaining feature information of target artworks in the sun room may include:

[0045] Step S112: extracting material features of the target artwork from the sensor data of the target artwork.

[0046] The implementation methods of the above step S112 include: the first way is to extract the material characteristics of thermal properties. Since different materials have different thermal emissivity and thermal conductivity, a thermal imaging camera can be installed in the above sun room, and the thermal imaging camera is used to detect the thermal emissivity and thermal conductivity of the surface of the target artwork, and a thermal image representing the temperature distribution of the target artwork is calculated based on the thermal emissivity and thermal conductivity, thereby obtaining the material characteristics of the target artwork in terms of thermal characteristics. The second way is to extract the material characteristics of infrared radiation characteristics. For example, since infrared sensors can detect infrared radiation emitted by objects, different materials have different infrared radiation characteristics. Therefore, infrared sensors can be installed in the above sun room to obtain the infrared spectrum of the target artwork, and the material characteristics of the target artwork corresponding to the infrared radiation characteristics can be determined based on the infrared spectrum. In addition, the material characteristics of the target artwork can also be extracted from sensor data collected by acoustic sensors and / or X-ray fluorescence analyzers. The third method is to read the material characteristics of the artwork through the RFID tag. For example, if the artwork is attached with an RFID tag, the RFID reader can be used directly to read the material characteristics pre-stored in the RFID tag.

[0047] Optionally, by identifying the material characteristics of the artwork, the system can adjust the color temperature of the light to make the color of the artwork more realistic. For example, oil paintings may require warm light with a lower color temperature to highlight its rich color levels. In addition, the system can adjust the angle and brightness of the light in combination with the material characteristics to highlight the texture and details of the artwork and enhance the visual effect. Furthermore, the system can also provide personalized display solutions based on the specific material characteristics of each artwork. For example, for materials that are easily affected by light, low-brightness and direction-controllable lights can be used.

[0048] It is understandable that in some scenarios where only the lighting effect of the artwork is considered and the temperature and humidity inside and outside the sunroom do not need to be considered to affect the viewing effect of the artwork, a door can be set on one side of the sunroom to allow people to enter the sunroom to view the artwork. After viewing the artwork, people can directly exit the sunroom from the side door. Of course, another door can be set on the other side of the sunroom to facilitate people to exit from the other door. In other words, the sunroom can be equipped with two doors, one door is used to enter the sunroom to view the artwork, and the other door is used for people to exit the sunroom after viewing the artwork, so that the viewing can be carried out in an orderly manner and reduce crowding or trampling.

[0049] As an optional implementation of the above step S111, the above implementation of extracting the material features of the target artwork from the image data of the target artwork may include:

[0050] Step S111a: Identify the description text of the target artwork from the image data of the target artwork.

[0051] The implementation method of the above-mentioned step S111a, for example, is to use a convolutional neural network (CRNN) model, an attention scene text recognizer (ASTR) model, a YOLO model, a region-based R-CNN model (such as Fast R-CNN, Faster R-CNN, etc.) or a Rosetta model, etc. to identify the description text of the target artwork from the image data of the target artwork.

[0052] Optionally, descriptive text can be automatically extracted through image recognition technology (such as OCR), and combined with image processing technology to perform material feature analysis, which can achieve a fast and automated material recognition process, improve processing speed, and reduce the need for human intervention.

[0053] Step S111b: determining the material characteristics of the target artwork according to the image data and description text of the target artwork.

[0054] The implementation method of the above step S111b is, for example: using the image encoder in the neural network model to extract image features from the image data of the target artwork, and using the text encoder in the neural network model to extract text features from the description text of the target artwork, wherein the above image encoder can adopt the Vision Transformer (ViT) model, and the above text encoder can adopt the Bidirectional Encoder Representation from Transformers (BERT) model. Then, the multimodal fusion network model is used to perform feature fusion on the image features in the above image data and the text features in the text data to obtain the material features of the above target artwork.

[0055] Alternatively, as an optional implementation of the above step S111, the above implementation of extracting the material features of the target artwork from the image data of the target artwork may include:

[0056] Step S111c: extracting color features, texture features and morphological structure features from the image data of the target artwork.

[0057] An implementation example of the above step S111c is as follows: a high-resolution HD camera can also be installed in the above sun room, and the HD camera is used to collect image data of the target artwork. Then, a feature extraction module in a neural network model trained using deep learning technology is used to extract color features, texture features, and morphological structure features from the image data. Among them, the feature extraction module in the above neural network model can use a ViT model or a Contrastive Language-Image Pre-Training (CLIP) model to extract image features from the image data.

[0058] Step S111d: Determine the material characteristics of the target artwork based on the color characteristics, texture characteristics and morphological structure characteristics.

[0059] The implementation method of the above step S111d is, for example: after obtaining the above color features, texture features and morphological structure features, the feature fusion module in the neural network model can also be used to fuse the color features, texture features and morphological structure features to obtain the above material features. The feature fusion module in the above neural network model can use the Feature Pyramid Networks (FPN) model to fuse features of different scales through top-down paths and lateral connections, or a model based on the self-attention mechanism (such as the RoBERTa model or the ALBERT model, etc.). The introduction of the attention mechanism can help the model automatically focus on the key areas in the image, especially the recognition of materials and surface details, and the self-attention mechanism can enable the model to automatically identify the feature differences in different areas.

[0060] In the implementation process of the above scheme, by combining color features, texture features and morphological structure features, the system can comprehensively analyze the material of the artwork from multiple dimensions. This multi-dimensional approach improves the accuracy and reliability of material recognition. Different materials have unique characteristics in color, texture and morphological structure. For example, the brushstrokes of oil paintings, the glaze of ceramics, the fiber structure of paper artworks, etc., these subtle features can be accurately captured by image processing technology. The above-mentioned method for adjusting the environmental parameters of artworks is applicable to artworks of various material types. Whether it is oil paintings, ceramics, paper artworks or other materials, they can be accurately identified through color, texture and morphological structure characteristics.

[0061] Alternatively, as an optional implementation of the above step S111, the above implementation of extracting the material features of the target artwork from the image data of the target artwork may include:

[0062] Step S111e: extracting light reflection features and light absorption features from the image data of the target artwork.

[0063] The implementation method of the above step S111e is, for example: Since each material has its own specific spectral absorption and reflection characteristics, and spectrometers can measure the reflectance or transmittance of an object at different wavelengths to identify the chemical composition of the material, a hyperspectral imaging camera or a multi-spectral imaging spectrometer can be used to collect the target artwork, and collect images from different angles and distances to obtain spectral image data with comprehensive reflection and absorption information. Then, the spectral image data is corrected to eliminate system errors, align image data from multiple angles or multiple time points, and use filtering and denoising methods to reduce image noise and improve the data quality of the spectral image data. The spectral reflectance in the spectral image data is calculated with the spectral reflectance of the standard whiteboard through the formula R_ratio(λ)=R_pixel(λ) / R_white(λ), and the relative reflectance of the pixel point on the surface of the artwork is obtained, and the light reflection characteristics of the artwork at each pixel point are determined according to the relative reflectance of the pixel point on the surface of the artwork. Among them, λ represents the wavelength, R_pixel(λ) represents the spectral reflectance in the spectral image data, R_white(λ) represents the spectral reflectance of the standard white board, and R_ratio(λ) represents the relative reflectance of the pixel point on the surface of the artwork.

[0064] Finally, the formula A(λ)=1-R_ratio(λ) can be used to calculate the absorptivity of the pixel points on the artwork surface, and the light absorption characteristics of each pixel point of the artwork can be determined based on the absorptivity of the pixel points on the artwork surface. For example, by analyzing the absorptivity at different wavelengths, the light absorption characteristics of the artwork can be obtained based on the absorptivity at different wavelengths. Among them, A(λ) represents the absorptivity of the pixel point on the artwork surface, and R_ratio(λ) represents the relative reflectivity of the pixel point on the artwork surface.

[0065] Step S111f: determining the material characteristics of the target artwork according to the light reflection characteristics and the light absorption characteristics.

[0066] The implementation of the above step S111f is, for example, to establish a feature database containing light reflection and light absorption characteristics of known materials, and the feature database may contain light reflection characteristics such as standard reflectivity and light absorption characteristics such as absorptivity curves of various materials at specific wavelengths. Then, the light reflection and light absorption characteristics of the extracted artwork are matched with the standard features in the feature database, and a machine learning algorithm (such as support vector machine, random forest, neural network, etc.) is used to identify the material characteristics that best match the target artwork from the feature database.

[0067] It is understandable that the above-mentioned feature database can also store the target temperature and / or target humidity in the sunroom corresponding to the material characteristics of each artwork. For example, the material characteristics of oil painting correspond to a target temperature of 18-22°C in the sunroom, and the relative humidity of oil painting is 40%-60%. However, the material characteristics of paper artwork correspond to a target temperature of 15-20°C in the sunroom, and its relative humidity is 30%-50%. The material characteristics of ceramics correspond to a target temperature of 15-25°C in the sunroom, and its relative humidity is 40%-60%.

[0068] As an optional implementation of the above step S120, the above internal environment parameters may include: temperature and / or humidity; the above implementation of adjusting the internal environment parameters according to the characteristic information and / or environmental monitoring information may include:

[0069] Step S121: determining a target temperature and / or target humidity in the sunroom according to the material characteristics of the target artwork.

[0070] An implementation example of the above step S121 is as follows: since the above feature database can also store the target temperature and / or target humidity in the sunroom corresponding to the material characteristics of each artwork, if the artwork is identified as an oil painting based on the material characteristics of the target artwork, then it can be determined that the target temperature in the sunroom corresponding to the material characteristics of the oil painting is 18-22°C, and the relative humidity of the oil painting is 40%-60%.

[0071] Step S122: adjusting the current temperature in the sunroom to the target temperature in the sunroom, and / or adjusting the current humidity in the sunroom to the target humidity in the sunroom.

[0072] The implementation method of the above step S122 is, for example: if the current temperature of the sun room where the oil painting is located is 25°, the current temperature of 25° in the sun room can be adjusted to a target temperature of 18-22°C. In the specific practice, a temperature sensor can be installed in the above sun room, and the temperature sensor is used to monitor the current temperature in the sun room in real time. It is understandable that a temperature controller can also be installed in the above sun room, which is used to generate an adjustment control instruction according to the target temperature in the sun room. In addition, an air conditioning system with cooling and heating functions can also be installed in the above sun room, which is used to adjust the current temperature in the sun room to the target temperature in the adjustment control instruction according to the adjustment control instruction sent by the central controller. Similarly, a heater of the type of electric heater, oil-filled radiator heater or wall-mounted heater can also be installed in the above sun room, which is used to provide additional heat to increase the current temperature when the current temperature is low, so as to ensure that the current temperature in the sun room is increased to the target temperature value.

[0073] Similarly, if the current humidity of the sunroom where the oil painting is located is 30%, the current humidity of 30% in the sunroom can be adjusted to the target humidity of 40%-60% in the sunroom. In the specific practice, a humidity sensor can be installed in the above-mentioned sunroom: used to monitor the current humidity in the sunroom in real time. It is understandable that a humidity controller can also be installed in the above-mentioned sunroom to generate adjustment control instructions according to the target humidity in the sunroom. In addition, a humidifier and a dehumidifier can also be installed in the above-mentioned sunroom to adjust the current humidity in the sunroom to the target humidity in the sunroom according to the adjustment control instructions sent by the central controller. Among them, the humidifier is used to increase the humidity in the sunroom, and the dehumidifier is used to reduce the humidity in the sunroom.

[0074] Similarly, the sun room may also be equipped with an air conditioner with a dehumidification function to adjust the temperature and humidity simultaneously when necessary, so as to adjust the current temperature in the sun room to the target temperature in the sun room, and adjust the current humidity in the sun room to the target humidity in the sun room. For example, if the current temperature is high and the humidity is high, the air conditioner will start the cooling and dehumidification functions to reduce the temperature and humidity at the same time.

[0075] As an optional implementation of the above step S120, the characteristic information of the above target artwork may include: color characteristics, texture characteristics and morphological structure characteristics, the above internal environment parameters may include: lighting parameters, and the above external environment parameters may include: behavior parameters of visitors; the implementation of adjusting the internal environment parameters according to the characteristic information and / or environmental monitoring information may include:

[0076] Step S123: Determine target lighting parameters of the target artwork according to color features, texture features, morphological structure features and / or behavior parameters of visitors.

[0077] Target lighting parameters refer to the lighting parameters for the target artwork, which may include: color temperature, light brightness, light intensity, light color and / or illumination angle, etc. Such target lighting parameters can not only display the artwork under the best conditions, but also highlight its colors and details, thereby creating a more immersive and interactive display environment, enhancing the audience's viewing experience and the visual effect of the artwork.

[0078] As an optional implementation of the above step S123, the above-mentioned determination of the target lighting parameters of the target artwork based on the color characteristics, texture characteristics, morphological structure characteristics and / or the behavior parameters of the visitors may include:

[0079] Step S123a: extracting color features, texture features and morphological structure features from the video data of the target artwork.

[0080] For example, in the implementation of the above step S111c, a high-resolution HD camera may be installed in the above sun room, and the HD camera is used to collect image data of the target artwork. Then, a ViT model or a contrastive language-image pre-training (CLIP) model is used to extract color features (such as main color, color distribution, etc.), texture features, and morphological structure features from the video data of the target artwork.

[0081] Step S123b: Use a neural network model to predict according to color features, texture features, morphological structure features and / or behavior parameters of visitors to obtain target lighting parameters of the target artwork.

[0082] The neural network model is obtained by training the neural network with color features, texture features, morphological structure features and / or visitor behavior parameters as training data, and with visitor questionnaire data as training labels, to obtain a trained neural network model. Therefore, the trained neural network model learns the association pattern and influence pattern of color features, texture features, morphological structure features and / or visitor behavior parameters on target lighting parameters (such as color temperature, brightness, intensity, color, irradiation angle, etc.) of the target artwork.

[0083] The implementation method of the above step S123b is, for example: first obtain color features, texture features, morphological and structural features, and the behavior parameters of visitors (such as the length of time they stay at a location, the moving path, the frequency of taking photos, and / or the sight of attention, etc.). The behavior data of visitors can be recorded by a camera or an infrared sensor, and extracted from the behavior data of the audience, and the opinions and suggestions of the audience on the display effect are collected through a questionnaire, and these data will be used as training labels. Then, the color features, texture features, morphological and structural features, and / or the behavior parameters of the visitors are used as training data (i.e., as the input of the neural network model), and the questionnaire data of the visitors are used as training labels (i.e., as the output of the neural network model), and the RoBERTa model or ALBERT model is trained to obtain the trained RoBERTa model or ALBERT model. Then, the trained RoBERTa model or ALBERT model is used to predict the color features, texture features, morphological and structural features, and / or the behavior parameters of the visitors to obtain the target lighting parameters of the target artwork.

[0084] Step S124: adjusting the current lighting parameters according to the target lighting parameters of the target artwork.

[0085] The implementation method of the above step S124 is, for example: reading the current lighting parameters (color temperature, brightness, intensity, color, irradiation angle, etc.) through the lighting control system, and after reading the front lighting parameters, comparing the current lighting parameters with the target lighting parameters of the target artwork, and calculating the amount to be adjusted. The way to adjust the current lighting parameters includes: color temperature adjustment: adjusting the color temperature of the light through the intelligent lighting system in the sun room, so that the difference between the color temperature of the current lighting parameter and the color temperature of the target lighting parameter of the target artwork is less than a preset threshold. And / or, brightness adjustment: adjusting the brightness of the light through the intelligent lighting system in the sun room, so that the difference between the brightness of the current lighting parameter and the brightness of the target lighting parameter of the target artwork is less than a preset threshold. And / or, intensity adjustment: adjusting the intensity of the light through the intelligent lighting system in the sun room, so that the difference between the intensity of the current lighting parameter and the intensity of the target lighting parameter of the target artwork is less than a preset threshold. And / or, color adjustment: adjusting the color of the light through the intelligent lighting system in the sun room, so that the difference between the color of the current lighting parameter and the color of the target lighting parameter of the target artwork is less than a preset threshold. And / or, irradiation angle adjustment: adjusting the irradiation angle of the light through an electric device in the sun room so that the difference between the irradiation angle of the current light parameter and the irradiation angle of the target light parameter of the target artwork is less than a preset threshold.

[0086] In the specific practice, the above-mentioned sun room can be installed with a light sensor to monitor the current light parameters in the sun room, such as color temperature, brightness, intensity, color, irradiation angle, etc. In addition, the above-mentioned sun room can also be installed with a camera for capturing the image data of the artwork, and the above-mentioned sun room can also be installed with an infrared sensor to monitor the audience's behavior parameters, such as the length of time the position stays, the moving path, the frequency of taking pictures and / or the line of sight, etc. It can be understood that in order to adjust the light parameters in the sun room, the above-mentioned sun room can also be installed with an intelligent lamp, which can support the functions of adjusting color temperature, brightness, intensity and irradiation angle. And / or, the above-mentioned sun room can also be installed with a dimmer, which can be a dimmer operated by manual remote control, or a dimmer that can be intelligently adjusted without remote control. And / or, the above-mentioned sun room can also be installed with a light parameter controller, which can be a controller for adjusting light parameters (such as color temperature, brightness, intensity, color, irradiation angle, etc.) to ensure that the light parameters meet the best display conditions of the artwork. Among them, the illumination angle adjustment function can adjust the illumination angle of the light through a mechanical device or an electric device to enhance the three-dimensional sense and detail expression of the artwork.

[0087] As an optional implementation of the above-mentioned method for adjusting the environmental parameters of artworks, the behavior parameters of visitors include: the length of time they stay at a location, the path they move, the frequency of taking photos, and / or their line of sight. According to the length of time the visitors stay at a location, the path they move, and their line of sight, the system can dynamically adjust the intensity, color temperature, and angle of the light to highlight the artwork that the visitors are currently paying attention to. For example, when a visitor stays in front of a certain artwork for a long time, the light can be automatically enhanced to make it more eye-catching.

[0088] Optionally, by analyzing the audience's behavioral data, the system can identify the audience's points of interest and recommend similar or related artworks to improve the audience's participation and satisfaction. Then, by analyzing the audience's behavioral data, the system can identify the audience's points of interest and recommend similar or related artworks for viewing and appreciation to improve the audience's participation and satisfaction. In addition, based on the audience's movement path and residence time, the system can provide personalized guided tour services to guide the audience to better understand the background and related information of the exhibits. In addition, by collecting and analyzing the audience's behavioral data, it can be determined which areas or artworks are the most popular and which areas are relatively deserted, which helps curators optimize the exhibition layout, reasonably arrange the exhibits, and improve the overall viewing effect. It also helps that according to the audience's movement path and residence time, the system can predict the distribution of people flow, help managers to effectively control the flow, and avoid crowding and safety hazards.

[0089] As an optional implementation of the above-mentioned method for adjusting the environmental parameters of artworks, the target lighting parameters include: light color temperature, light brightness and / or light angle. By accurately adjusting the color temperature of the light, the color of the artwork can be presented more realistically, because different artworks may require different color temperatures to highlight their color characteristics. For example, artworks with warm colors are suitable for using lights with lower color temperatures, while artworks with cool colors are suitable for using lights with higher color temperatures. By adjusting the brightness and angle of the light, the details and texture of the artwork can be highlighted, allowing the audience to better appreciate the subtleties of the work. For example, for artworks with rich textures, the shadow effect can be enhanced and the texture can be highlighted by adjusting the light angle.

[0090] Optionally, the lighting parameters can be adjusted dynamically, such as the color temperature, brightness and / or angle of the light, according to the theme and style of the artwork, to create different atmospheres. For example, for classical artworks, soft and warm lighting can be used; for modern artworks, bright and high-contrast lighting can be used. In addition, the software control system running on the electronic device can dynamically adjust the lighting parameters in combination with the audience's behavioral parameters (such as the length of time they stay in a position, the movement path, the frequency of taking photos, and the line of sight) to create a more interactive display environment. For example, when the audience stays in front of a piece of art for a long time, the lighting can be automatically enhanced to make it more eye-catching.

[0091] See also Figure 2 The schematic diagram of the structure of the art environment parameter adjustment device provided in the embodiment of the present application is shown; the embodiment of the present application provides an art environment parameter adjustment device 200, including:

[0092] The target information acquisition module 210 is used to acquire characteristic information and environmental monitoring information of a target artwork in the sun room, wherein the environmental monitoring information includes: internal environmental parameters of the sun room and / or external environmental parameters of the sun room.

[0093] The environmental parameter adjustment module 220 is used to adjust the internal environmental parameters according to the characteristic information and / or the environmental monitoring information.

[0094] As an optional implementation of the above device, the characteristic information of the target artwork includes: material characteristics; the target information acquisition module includes:

[0095] The material feature extraction submodule is used to extract the material features of the target artwork from the image data of the target artwork; or to extract the material features of the target artwork from the sensor data of the target artwork.

[0096] As an optional implementation of the above device, the material feature extraction submodule includes:

[0097] The first material feature determination unit is used to identify the description text of the target artwork from the image data of the target artwork, and determine the material feature of the target artwork according to the description text of the target artwork.

[0098] Alternatively, the second material feature determination unit is used to extract texture features from the image data of the target artwork, and determine the material features of the target artwork according to the texture features.

[0099] Alternatively, the third material feature determination unit is used to extract light reflection features and light absorption features from the image data of the target artwork, and determine the material features of the target artwork according to the light reflection features and light absorption features.

[0100] As an optional implementation of the above device, the internal environmental parameters include: temperature and / or humidity; the environmental parameter adjustment module includes:

[0101] The target temperature and humidity determination submodule is used to determine the target temperature and / or target humidity in the sun room according to the material characteristics of the target artwork.

[0102] The current temperature and humidity adjustment submodule is used to adjust the current temperature in the sunroom to the target temperature in the sunroom, and / or adjust the current humidity in the sunroom to the target humidity in the sunroom.

[0103] As an optional implementation of the above device, the characteristic information of the target artwork includes: color characteristics and morphological structure characteristics, internal environmental parameters including: lighting parameters, external environmental parameters including: behavior parameters of visitors; the environmental parameter adjustment module includes:

[0104] The target lighting parameter determination submodule is used to determine the target lighting parameters of the target artwork according to the color characteristics, morphological structure characteristics and / or the behavior parameters of the visitors.

[0105] The current lighting parameter adjustment submodule is used to adjust the current lighting parameters according to the target lighting parameters of the target artwork.

[0106] As an optional implementation of the above device, the target light parameter determination submodule includes:

[0107] The lighting parameter prediction unit is used to use a neural network model to predict according to color characteristics, morphological structure characteristics and / or behavior parameters of visitors to obtain target lighting parameters of a target artwork.

[0108] The neural network model is obtained by training the neural network using the behavioral parameters of visitors as training data and the questionnaire data of visitors as training labels.

[0109] As an optional implementation of the above device, the behavior parameters of the visitor include: the length of time spent at a location, the moving path, the frequency of taking photos and / or the sight line of attention.

[0110] As an optional implementation of the above device, the target lighting parameters include: light color temperature, light brightness and / or light angle.

[0111] It should be understood that the device corresponds to the above-mentioned embodiment of the method for adjusting the environmental parameters of artworks, and can execute the various steps involved in the above-mentioned method embodiment. The specific functions of the device can be found in the above description, and the detailed description is appropriately omitted here. The device includes at least one software function module that can be stored in a memory in the form of software or firmware or fixed in the operating system (OS) of the device.

[0112] See also Figure 3 The electronic device 300 provided in the embodiment of the present application includes: a processor 310 and a memory 320, wherein the memory 320 stores machine-readable instructions executable by the processor 310, and when the machine-readable instructions are executed by the processor 310, the above method is executed.

[0113] The embodiment of the present application also provides a computer-readable storage medium 330, on which a computer program is stored, and the computer program is executed by the processor 310 to execute the above method. The computer-readable storage medium 330 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, disk or optical disk.

[0114] The embodiment of the present application also provides a computer program product, including: a computer program or a computer instruction, and the computer program or the computer instruction executes the method described above when executed by a processor.

[0115] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0116] In several embodiments provided by the embodiments of the present application, it should be understood that the disclosed device and method can also be implemented in other ways. The device embodiments described above are only schematic, for example, the flowcharts and block diagrams in the accompanying drawings show the possible implementation architecture, functions and operations of the devices, methods and computer program products according to the multiple embodiments of the embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a part of a module, a program segment or a code, and a part of a module, a program segment or a code includes one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also be different from the order of occurrence marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which is mainly determined by the functions involved.

[0117] In addition, each functional module of each embodiment in the embodiment of the present application can be integrated together to form an independent part, or each module can exist separately, or two or more modules can be integrated to form an independent part. In addition, in the description of this specification, the description of reference terms "one embodiment", "some embodiments", "example", "specific example", "some examples", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the embodiment of the present application. In this specification, the schematic representation of the above terms does not necessarily target the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples without contradiction.

[0118] The above description is only an optional implementation manner of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the embodiments of the present application, which should be covered within the protection scope of the embodiments of the present application.

Claims

1. A method for adjusting environmental parameters of artworks, characterized in that: include: Acquire characteristic information and environmental monitoring information of a target artwork in a sunroom, wherein the environmental monitoring information includes: internal environmental parameters of the sunroom and / or external environmental parameters of the sunroom; The internal environmental parameters are adjusted according to the characteristic information and / or the environmental monitoring information.

2. The method according to claim 1, characterized in that The characteristic information of the target artwork includes: material characteristics; the obtaining characteristic information of the target artwork in the sun room includes: Extracting material features of the target artwork from the image data of the target artwork; Alternatively, the material features of the target artwork are extracted from the sensor data of the target artwork.

3. The method according to claim 2, characterized in that The step of extracting the material features of the target artwork from the image data of the target artwork comprises: Identifying a description text of the target artwork from the image data of the target artwork, and determining a material feature of the target artwork according to the description text of the target artwork; Alternatively, texture features are extracted from the image data of the target artwork, and material features of the target artwork are determined according to the texture features; Alternatively, light reflection characteristics and light absorption characteristics are extracted from the image data of the target artwork, and the material characteristics of the target artwork are determined according to the light reflection characteristics and the light absorption characteristics.

4. The method according to claim 2, characterized in that: The internal environment parameters include: temperature and / or humidity; the adjusting the internal environment parameters according to the characteristic information and / or the environmental monitoring information includes: Determining a target temperature and / or target humidity in the sunroom according to material characteristics of the target artwork; The current temperature in the sunroom is adjusted to the target temperature in the sunroom, and / or the current humidity in the sunroom is adjusted to the target humidity in the sunroom.

5. The method according to claim 1, characterized in that The characteristic information of the target artwork includes: color characteristics and morphological structure characteristics, the internal environment parameters include: lighting parameters, and the external environment parameters include: behavior parameters of visitors; the adjusting the internal environment parameters according to the characteristic information and / or the environmental monitoring information includes: Determine the target lighting parameters of the target artwork according to the color characteristics, the morphological structure characteristics and / or the behavior parameters of the visitor; The current lighting parameters are adjusted according to the target lighting parameters of the target artwork.

6. The method according to claim 5, characterized in that The step of determining the target lighting parameters of the target artwork according to the color characteristics, the morphological structure characteristics and / or the behavior parameters of the visitor includes: Using a neural network model to predict according to the color features, the morphological structure features and / or the behavior parameters of the visitor, to obtain target lighting parameters of the target artwork; The neural network model is obtained by training the neural network using the behavior parameters of the visitors as training data and the questionnaire data of the visitors as training labels.

7. The method according to claim 5, characterized in that The behavior parameters of the visitor include: length of stay at a location, movement path, frequency of taking photos and / or line of sight.

8. The method according to claim 5, characterized in that The target lighting parameters include: lighting color temperature, lighting brightness and / or lighting angle.

9. An artwork environment parameter adjustment device, characterized in that: include: A target information acquisition module is used to acquire characteristic information and environmental monitoring information of a target artwork in a sun room, wherein the environmental monitoring information includes: internal environmental parameters of the sun room, and / or external environmental parameters of the sun room; An environmental parameter adjustment module is used to adjust the internal environmental parameters according to the characteristic information and / or the environmental monitoring information.

10. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the machine-readable instructions are executed by the processor to perform any method according to claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 8 is executed.

12. A computer program product, characterized in that include: A computer program or a computer instruction, wherein when the computer program or the computer instruction is executed by a processor, the method according to any one of claims 1 to 8 is executed.