Image processing method and device, equipment, storage medium and computer program product

Abstract

The invention provides an image processing method and device, electronic equipment, a storage medium and a computer program product, and relates to the technical field of computers. The method comprises the following steps: acquiring image prompt data; the image prompt data is used for prompting the content of a to-be-generated target image, and the image prompt data is automatically generated based on at least one of user data of an identified target object, environment data of a target space and current observation data; generating a target image matched with the content prompted by the image prompting data; and displaying the generated target image in an interface of the target device. According to the method and the device, the problem of relatively low image display accuracy caused by lack of individuation and real-time performance of image display in related technologies is solved.

Description

Technical Field

[0001] The present application relates to the field of computer technology. Specifically, the present application relates to an image processing method, device, electronic device, storage medium and computer program product. Background Art

[0002] Currently, users can use electronic devices such as electronic photo albums or smart screen devices to display images. These images can often only be selected from images pre-stored in the media library. Not only can they not meet the personalized needs of users, but they are also not real-time, making it difficult to accurately express the user's experience at a certain moment when the image is displayed.

[0003] For example, for a user who is feeling happy at a certain moment, the electronic photo album may be displaying images with dark tones, or when the user is preparing to go to bed, the smart screen device may not be displaying soft tones or quiet images.

[0004] As can be seen from the above, the existing image display lacks personalization and real-time performance, resulting in poor accuracy of image display and poor user experience. Summary of the invention

[0005] The present application provides an image processing method, device, electronic device and storage medium, which can solve the problem of poor image display accuracy due to lack of personalization and real-time performance in related technologies. The technical solution is as follows:

[0006] According to one aspect of the present application, an image processing method includes: obtaining image prompt data; the image prompt data is used to prompt the content of a target image to be generated, and the image prompt data is automatically generated based on at least one of user data of an identified target object, environmental data of a target space, and current observation data; generating a target image that matches the content prompted by the image prompt data; and displaying the generated target image in an interface of a target device.

[0007] According to one aspect of the present application, an image processing device includes: a data acquisition module, used to acquire image prompt data; the image prompt data is used to prompt the content of a target image to be generated, and the image prompt data is automatically generated based on at least one of the user data of the identified target object, the environmental data of the target space, and the current observation data; an image generation module, used to generate a target image that matches the content prompted by the image prompt data; and an image display module, used to display the generated target image in the interface of the target device.

[0008] In an exemplary embodiment, the device also includes: a data generation module, which is used to identify at least one of the activity of the target object in the target space, the environmental conditions of the target space, the current climate, the current time, and the current event to obtain target data; the target data includes at least one of the user data of the target object, the environmental data of the target space, and the current observation data; based on the user data of the target object, the environmental data of the target space, and the current observation data, the image prompt data is automatically generated.

[0009] In an exemplary embodiment, the data generation module is further used to monitor the environmental status of the target space based on at least one first monitoring device in the target space to obtain environmental data of the target space; and use the environmental data of the target space as the target data.

[0010] In an exemplary embodiment, the data generation module is also used to photograph the devices and / or objects in the target space based on at least one second monitoring device in the target space to obtain a spatial image containing the devices and / or objects in the target space; perform image recognition on each device and / or object in the spatial image to determine the devices and / or objects existing around the target device; generate environmental data of the target space based on the determined devices and / or objects, and use the environmental data of the target space as the target data.

[0011] In an exemplary embodiment, the data generation module is also used to monitor whether the target object exists in the target space based on at least one first monitoring device in the target space; if so, based on at least one second monitoring device in the target space, photograph the target object in the target space to obtain a user image containing the target object; identify the emotion or action of the target object in the user image to determine the emotional state or action of the target object; generate user data of the target object based on the emotional state or action of the target object, and use the user data of the target object as the target data.

[0012] In an exemplary embodiment, the data generation module is also used to obtain historical behavior data of the target object in the target space; the historical behavior data reflects the historical behavior of the target object with respect to the historical target image displayed by the target device and / or the historical usage data of the target object with respect to each device in the target space; preference learning is performed on the historical behavior data of the target object to obtain the preference data of the target object; user data of the target object is generated based on the preference data of the target object, and the user data of the target object is used as the target data.

[0013] In an exemplary embodiment, the data generation module is also used to monitor the current time and / or weather to determine the current time and / or current weather; if the current time meets the set conditions or the current weather is monitored to have changed, current observation data is generated based on the current time or current weather, and the current observation data is used as the target data.

[0014] In an exemplary embodiment, the image display module is also used to detect whether the target device is deployed in other spaces; the other spaces are different from the target space; if so, the target image is displayed in linkage between the target device in the target space and the target device in the other spaces.

[0015] In an exemplary embodiment, the device also includes: an image adjustment module, which is used to obtain environmental data of the target space and monitor whether the environmental state of the target space changes based on the environmental data of the target space; if so, the target image is adaptively adjusted according to the environmental data of the target space to display the adjusted target image in the interface of the target device.

[0016] In an exemplary embodiment, the image adjustment module is also used to determine the current light intensity and / or current temperature of the target space based on the environmental data of the target space; and adjust the brightness and contrast of the target image according to the current light intensity and / or current temperature of the target space.

[0017] In an exemplary embodiment, the image adjustment module is also used to determine whether a device or object newly deployed around the target device is identified in the target space based on the environmental data of the target space; if so, determine the image theme related to the identified device or object, and adjust the content of the target image based on the determined image theme.

[0018] In an exemplary embodiment, the image adjustment module is also used to determine the activity state of the target object in the target space based on the environmental data of the target space; the activity state is used to describe the number of target objects in the target space, and / or whether the target object moves; and adjust the content of the target image to match the activity state of the target object.

[0019] According to one aspect of the present application, an electronic device includes at least one processor and at least one memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the image processing method as described above is implemented.

[0020] According to one aspect of the present application, a storage medium stores a computer program, which implements the image processing method described above when executed by one or more processors.

[0021] According to one aspect of the present application, a computer program product includes a computer program, and when the computer program is executed by one or more processors, the image processing method described above is implemented.

[0022] The beneficial effects of the technical solution provided by this application are:

[0023] In the above technical scheme, image prompt data is first automatically generated by identifying at least one of the user data of the target object, the environmental data of the target space, and the current observation data, and then a target image matching the content is generated based on the content of the target image to be generated prompted by the image prompt data, and the target image is displayed in the interface of the target device. In the above process, the target image displayed in the interface is related to the image prompt data, and the image prompt data is automatically generated based on at least one of the user data of the target object, the environmental data of the target space, and the current observation data. That is to say, the target image can reflect the activity of the target object in the target space, the environmental conditions of the target space, the current system weather, etc. in real time based on the above data, and can also change with the changes of the target object, so that the target image can not only meet the personalized needs of the user, but also have real-time performance, thereby effectively solving the problem of poor image display accuracy due to the lack of personalization and real-time performance in related technologies. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings described below are only some embodiments of the present application, and those skilled in the art can obtain other drawings based on these drawings without creative work.

[0025] Figure 1 It is a schematic diagram of the implementation environment involved in this application;

[0026] Figure 2 is a flowchart of an image processing method according to an exemplary embodiment;

[0027] Figure 3 is a flowchart of another image processing method according to an exemplary embodiment;

[0028] Figure 4 is a schematic diagram showing how to identify and obtain target data in different situations according to an exemplary embodiment;

[0029] Figure 5 is a schematic diagram showing that image prompt data is automatically generated based on different data triggers according to an exemplary embodiment;

[0030] Figure 6 yes Figure 2 Step 350 in an embodiment is a flowchart of an embodiment;

[0031] Figure 7 is a flowchart of another image processing method according to an exemplary embodiment;

[0032] Figure 8 is a schematic diagram showing adaptive adjustment of a target image based on different data according to an exemplary embodiment;

[0033] Fig. 9 A structural block diagram of an image processing device according to an exemplary embodiment;

[0034] Fig.10 A structural block diagram of an electronic device is shown according to an exemplary embodiment. DETAILED DESCRIPTION

[0035] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be interpreted as limiting the present application.

[0036] It will be understood by those skilled in the art that, unless expressly stated, the singular forms "one", "said", and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present disclosure refers to the presence of the features, integers, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be intermediate elements. In addition, the "connection" or "coupling" used herein may include wireless connection or wireless coupling. The term "and / or" used herein includes all or any unit and all combinations of one or more associated listed items.

[0037] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0038] Figure 11 is a schematic diagram of an implementation environment involved in an image processing method. The implementation environment at least includes a user terminal 110, a smart device 130, a server 170, and a network device. Figure 1 In the embodiment, the network devices include a gateway 150 and a router 190, which is not specifically limited herein.

[0039] Among them, the user terminal 110, which can also be considered as a user end or terminal, can deploy (also understood as install) the client associated with the smart device 130. This user terminal 110 can be an electronic device such as a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart control panel, other devices with display and control functions, etc., which are not limited here.

[0040] Among them, the client is associated with the smart device 130, which essentially means that the user registers an account in the client and configures the smart device 130 in the client. For example, the configuration includes adding a device identifier to the smart device 130, so that when the client is run in the user terminal 110, it can provide the user with functions such as device display and device control of the smart device 130. This client can be in the form of an application or a web page. Accordingly, the interface for device display on the client can be in the form of a program window or a web page, etc., which is not limited here.

[0041] The smart device 130 is deployed in the gateway 150, and communicates with the gateway 150 through its own configured communication module, and is then controlled by the gateway 150. It should be understood that the smart device 130 generally refers to one of the multiple smart devices 130, and the embodiment of the present application only takes the smart device 130 as an example, that is, the embodiment of the present application does not limit the number and device type of smart devices deployed in the gateway 150. In an application scenario, the smart device 130 accesses the gateway 150 through a local area network, and is thus deployed in the gateway 150. The process of the smart device 130 accessing the gateway 150 through the local area network includes: the gateway 150 first establishes a local area network, and the smart device 130 joins the local area network established by the gateway 150 by connecting to the gateway 150. This local area network includes, but is not limited to: ZIGBEE or Bluetooth. Among them, the smart device 130 can be a smart printer, a smart fax machine, a smart camera, a smart air conditioner, a smart door lock, a smart light, or a human body sensor equipped with a communication module, a door and window sensor, a temperature and humidity sensor, a water immersion sensor, a natural gas alarm, a smoke alarm, a wall switch, a wall socket, a wireless switch, a wireless wall sticker switch, a magic cube controller, a curtain motor, a millimeter wave radar, etc.

[0042] The interaction between the user terminal 110 and the smart device 130 can be achieved through a local area network or a wide area network. In one application scenario, the user terminal 110 establishes a communication connection between the router 190 and the gateway 150 in a wired or wireless manner. For example, the wired or wireless manner includes but is not limited to WIFI, so that the user terminal 110 and the gateway 150 are deployed in the same local area network, so that the user terminal 110 can interact with the smart device 130 through the local area network path. In another application scenario, the user terminal 110 establishes a communication connection between the server 170 and the gateway 150 in a wired or wireless manner. For example, the wired or wireless manner includes but is not limited to 2G, 3G, 4G, 5G, WIFI, etc., so that the user terminal 110 and the gateway 150 are deployed in the same wide area network, so that the user terminal 110 can interact with the smart device 130 through the wide area network path.

[0043] The server end 170 may also be considered as a cloud, a cloud platform, a platform end, a service end, etc. The server end 170 may be a server, a server cluster consisting of multiple servers, or a cloud computing center consisting of multiple servers, so as to better provide background services to a large number of user terminals 110. For example, the background service includes an image processing service.

[0044] In one application scenario, it is assumed that the user terminal 110 is an intelligent control panel equipped with a display screen. The intelligent control panel can obtain image prompt data, which is used to prompt the content of the target image to be generated. Figure 1 Each smart device 130 in the illustrated implementation environment identifies user data of a target object, environmental data of a target space, current observation data, etc., and then automatically generates image prompt data based on at least one of the above data.

[0045] After obtaining the image prompt data, a target image matching the content prompted by the image prompt data can be generated, and then the target image can be displayed in the interface of the intelligent control panel. Since the target image can reflect the activity of the target object in the target space, the environmental conditions of the target space, the current system weather, etc. in real time based on the above data, it can also change with the changes of the target object, so that the target image can not only meet the personalized needs of users, but also has real-time performance, thereby effectively solving the problem of poor image display accuracy caused by the lack of personalization and real-time performance in related technologies.

[0046] Of course, in other application scenarios, image processing and image display can also be done by Figure 1In the implementation environment shown, other electronic devices equipped with display screens and other electronic devices with image processing capabilities (such as the server side 170) are respectively completed, that is, the above-mentioned image processing process completed by the user terminal 110 can also be implemented by the server side 170. At this time, after the server side 170 generates the target field image, the target image is sent to other electronic devices through the wide area network path. For example, the smart device 130 is equipped with a display screen. Then, for the smart device 130, it can receive the target image sent by the server side 170 and display the target image in the interface of the smart device 130, thereby providing users with more personalized and real-time image display services, greatly improving the user experience.

[0047] See also Figure 2 The present application embodiment provides an image processing method, which is applicable to an electronic device, for example, the electronic device may be Figure 1 The user terminal 110 and the smart device 130 in the implementation environment shown may also be Figure 1 Other electronic devices with image processing capabilities in the illustrated implementation environment, such as a gateway 150 , a server 170 , etc., are shown.

[0048] In the following method embodiments, for ease of description, the execution subject of each step of the method is taken as an electronic device as an example for illustration, but this does not constitute a specific limitation.

[0049] like Figure 2 As shown, the method may include the following steps:

[0050] Step 310, obtaining image prompt data.

[0051] Among them, image prompt data may refer to information used to guide or prompt image processing in image generation tasks, and used to prompt the content of the target image to be generated, wherein the image prompt data is automatically generated based on at least one of the user data of the identified target object, the environmental data of the target space, and the current observation data.

[0052] First of all, it should be noted that the target object refers to any movable object in the target space, for example, the object can be a person, a pet, a robot, etc., and this embodiment particularly refers to a movable person in the target space. Based on this, the user data of the target object can reflect the activity of the target object in the target space, not only the current emotion or action of the target object in the target space, but also the historical behavior of the target object in the target space. Specifically, the user data of the target object includes the emotional state or action of the target object, the preference data of the target object, etc. Among them, the preference data of the target object reflects the behavioral preference of the target object, and the preference data can reflect the device usage habits of the target object using each device in the target space, that is, the preference data can be derived from the historical usage data of the target object for each device in the target space, for example, the preference data reflects that the user is more inclined to turn on the smart TV in the living room at 8 o'clock in the evening; the preference data can also reflect the target object's preference for the target image that has been displayed in the target device, that is, the preference data can also be derived from the historical behavior of the target object for the historical target image displayed by the target device, etc. For example, the historical behavior includes the user's browsing, liking, commenting, setting as screen saver, etc. of the historical target image.

[0053] The environmental data of the target space can be used to describe the environmental conditions of the target space. For example, the environmental conditions may not only refer to the light intensity, temperature, humidity, and presence of a target object in the target space, but may also refer to the various devices or objects deployed in the target space, or whether the above environmental conditions have changed, such as temperature rise, a device is removed from the target space, or a device is newly deployed around the target device in the target space. Among them, the device may refer to an electrically controlled object, while the object is different from the device and refers to a non-electrically controlled object, including but not limited to: green plants, wall decorations, non-electric curtains, sofas, wardrobes, etc. in the target space. It should be noted that an electrically controlled object refers to a device that generates vibrations when working, and correspondingly, a non-electrically controlled object refers to an object that cannot generate vibrations.

[0054] The current observation data may be information reflecting the current climate, current weather, current time, and current major events, etc. For example, the current weather may include various weather conditions such as rainy days, sunny days, cloudy days, and showers; the current time may be a specific date or a certain period of time, and may also include various holidays, anniversaries, etc.; the current major events may be events that have a significant impact, are widely concerned, or are important and occur within the current time period.

[0055] The above data can be obtained through Figure 1The smart device identification in the implementation environment is shown. For example, the temperature of the target space is monitored by a temperature sensor deployed in the target space to obtain the temperature of the target space; or, the device or object in the target space is photographed by a camera deployed in the target space, and then the device or object existing around the target device in the target space can be determined by image recognition technology; or, the target object in the target space can be photographed by a camera deployed in the target space, and then the emotional state or action of the target object can be determined by emotion or action recognition technology. Examples are not given here one by one.

[0056] Secondly, the image prompt data is used to prompt the content of the target image to be generated. That is to say, in order to display the target image in the interface of the target device, it is first necessary to obtain image prompt data that can prompt the content of the generated target image, so that a target image matching the content prompted by the image prompt data can be generated.

[0057] In this embodiment, the image prompt data is automatically generated based on at least one of the user data of the target object, the environmental data of the target space, and the current observation data. In other words, if at least one of the user data of the target object, the environmental data of the target space, and the current observation data is identified, the image prompt data can be automatically generated, and accordingly, the electronic device can obtain the image prompt data. Furthermore, as at least one of the user data of the target object, the environmental data of the target space, and the current observation data changes, the automatic generation of the image prompt data can also be triggered, so that the electronic device obtains the image prompt data to facilitate the subsequent generation and display of the target image. In this way, as at least one of the user data of the target object, the environmental data of the target space, and the current observation data changes, the image prompt data will change accordingly, thereby ensuring that the target image follows the changes, thereby meeting the user's more personalized and real-time image display service needs.

[0058] For example, if the current observation data reflects that the current time is 6 o'clock in the morning, the image prompt data of "sunrise" is automatically generated; or, if the user data of the target object shows that the user feels happy, the image prompt data of "happy" is automatically generated; or, if the environmental data of the target space reflects that the current weather changes from sunny to rainy, the image prompt data of "rainy day" is automatically generated.

[0059] Of course, in addition to automatically generating image prompt data based on the above data, in other embodiments, the user can also choose to actively generate image prompt data, that is, actively generate image prompt data through input methods such as text, voice, gesture, and expression. Specifically, the electronic device responds to the input operation triggered by the user for the entrance of the request to generate the target image, and obtains the image input data; the image input data is converted into image prompt data. For example, the user can actively generate the image prompt data of "love" by making a heart-shaped gesture operation, and this embodiment does not constitute a specific limitation on this. It should be noted that the entrance for requesting the generation of the target avatar in the electronic device can be a text input box, a voice dialog box, a camera icon, and other operable controls. Accordingly, as the form of the input component configured by the electronic device is different, the input operation form will also be different. For example, for a mouse, the input operation can be a mechanical operation such as clicking and dragging, and for a touch screen, the input operation can be a gesture operation such as clicking and sliding, which is not limited here.

[0060] Step 330: Generate a target image that matches the content prompted by the image prompt data.

[0061] In this embodiment, the electronic device can use the image generation model to generate a target image that matches the content prompted by the image prompt data under the guidance of the image prompt data. The image generation model is a deep learning model that has been trained and has the ability to generate a target image from the image prompt data. For example, the deep learning model can be a machine learning model such as a diffusion model, a generative adversarial network (GAN), Instruct-Imagen, Stable Diffusion, Stable Cascade, PixArt-Alpha, etc.

[0062] Taking the image generation model obtained by diffusion model training as an example, the image generation process based on the image generation model essentially includes a random denoising process and a diffusion learning process. The image prompt data and a random data are input into the image generation model. Since the image prompt data indicates the content of the target image to be generated, the image prompt data is introduced in the random denoising process to guide the image generation model to perform diffusion learning on the random data according to the content indicated by the image prompt data, and finally output a target image that matches the content indicated by the image prompt data. For example, based on the image prompt data of "rainy day", the image generation model can generate a target image of "rainy city"; or, based on the image prompt data of "Christmas", the image generation model can generate a target image related to the theme of Christmas.

[0063] It is worth mentioning that in this embodiment, the trained image generation model can be deployed locally on the electronic device, so that the electronic device itself has the ability to generate the target image. Of course, in other embodiments, the image generation model can also be deployed on other electronic devices, such as Figure 1 The server side 170 in the implementation environment is shown. At this time, after the electronic device (such as the user terminal 110) obtains the image prompt data, it sends the image prompt data to the server side 170, and the server side 170 completes the generation of the target image, and then returns the generated target image to the electronic device for display. In addition, the training process of the image generation model can also be completed in other electronic devices, which is conducive to improving the processing efficiency of the electronic device.

[0064] Step 350: Display the generated target image in the interface of the target device.

[0065] For an electronic device with image processing capability and equipped with a display screen, the electronic device can be regarded as a target device. After generating a target image, the target image can be displayed on the display screen. For an electronic device with image processing capability but not equipped with a display screen, after generating a target image, the electronic device needs to send the target image to a target device equipped with a display screen. For example, Figure 1 A smart device 130 in an implementation environment is shown. The smart device 130 may be a smart TV, so that the target image can be displayed on the display screen of the smart TV.

[0066] Through the above process, since the target image is related to the image prompt data automatically generated based on at least one of the user data of the target object, the environmental data of the target space, and the current observation data, the target image can reflect the activity of the target object in the target space, the environmental conditions of the target space, the current system weather, etc. in real time, and can also change with the changes of the target object, so that the target image can not only meet the personalized needs of the user, but also has real-time performance, thereby effectively solving the problem of poor image display accuracy caused by the lack of personalization and real-time performance in related technologies.

[0067] See also Figure 3 In an exemplary embodiment, before step 310, the method may further include the following steps:

[0068] Step 410, identifying at least one of the activity of the target object in the target space, the environmental conditions of the target space, the current climate, the current time, and the current event to obtain target data.

[0069] The target data includes at least one of user data of the target object, environmental data of the target space, and current observation data.

[0070] In this embodiment, based on different situations, different devices in the target space and different recognition technologies are used to obtain corresponding target data.

[0071] Figure 4 A schematic diagram showing target data identified in different situations in an embodiment is shown, combined with Figure 4 For example, the activity of the target object in the target space may refer to the current emotion or action of the target object in the target space. Then, the emotion or action can be captured by a camera deployed in the target space, and then the emotional state or action of the target object can be determined through emotion or action recognition technology.

[0072] The environmental data of the target space may include the light intensity of the target space. Then, the light intensity may be monitored by a light sensor deployed in the target space.

[0073] Step 430, automatically generating image prompt data based on at least one target data among user data of the target object, environmental data of the target space, and current observation data.

[0074] That is to say, the automatic generation of image prompt data can be triggered when at least one of the user data of the target object, the environmental data of the target space, and the current observation data is identified, or it can be triggered when at least one of the user data of the target object, the environmental data of the target space, and the current observation data changes.

[0075] Figure 5 A schematic diagram showing the automatic generation of image prompt data based on different data triggers in one embodiment is shown. Figure 5 The automatic generation process of image prompt data is described as follows:

[0076] In a possible implementation, the image prompt data can be triggered to be automatically generated when the emotional state or action of the target object is identified. Specifically, based on at least one first monitoring device in the target space, monitor whether there is a target object in the target space; if yes, then based on at least one second monitoring device in the target space, take a photo of the target object in the target space to obtain a user image containing the target object; identify the emotion or action of the target object in the user image to determine the emotional state or action of the target object; generate the user data of the target object based on the emotional state or action of the target object, and use the user data of the target object as the target data.

[0077] The first monitoring device and the second monitoring device can both be Figure 1 The smart device 130 in the implementation environment is shown. For example, the first monitoring device can be a human body sensor, and the second monitoring device can be a smart camera. Therefore, it is possible to determine whether the target object's emotional state is happy or sad, and whether the action is a certain gesture or a whole-body action such as jumping or squatting, through shooting, as well as recognition technologies such as emotions or actions. Accordingly, image prompt data can be automatically generated based on the recognized emotional state or action, for example, a happy emotional state corresponds to the image prompt data of "happy", or a "V-shaped" gesture corresponds to the image prompt data of "victory", or a jumping whole-body action corresponds to the image prompt data of "joy".

[0078] In this way, through the introduction of emotion or action recognition technology, the subsequently generated target image can be closely related to the user's emotional state or action, which is conducive to providing users with more personalized and real-time image display services, greatly improving the user experience.

[0079] In one possible implementation, the image prompt data can be triggered to be automatically generated when the target object's device usage habits for each device in the target space are identified, and can also be triggered to be automatically generated when the target object's preference for the historical target image displayed by the target device is identified. Specifically, the historical behavior data of the target object in the target space is obtained; preference learning is performed on the historical behavior data of the target object to obtain the preference data of the target object; the user data of the target object is generated based on the preference data of the target object, and the user data of the target object is used as the target data. Among them, the historical behavior data reflects the historical behavior of the target object with respect to the historical target image displayed by the target device, and / or the historical usage data of the target object with respect to each device in the target space.

[0080] It should be noted that the user's browsing, liking, commenting, setting as screen saver and other behaviors of the historical target image displayed by the target device, as well as the user's opening, closing, and adjusting of each device in the target space can be recorded and saved in the background. For example, the background can be Figure 1 As shown in the implementation environment, the server side 170, the electronic device can obtain the above data from the background and then obtain the user's behavior preference through preference learning algorithms such as machine learning, and then automatically generate image prompt data based on the user's behavior preference. For example, if the user's behavior preference reflects the user's preference for landscape images, the electronic device can generate image prompt data of "mountains and waters", or, if the user's behavior preference reflects the user's habit of turning on the smart TV in the living room at 8 o'clock in the evening, the electronic device can generate image prompt data of "turn on the TV" at 8 o'clock in the evening.

[0081] In this way, through continuous learning and feedback of users' device usage habits and preferences, the image prompt data is continuously optimized, thereby ensuring that users can be provided with target images that are more in line with their preferences, greatly improving the user experience.

[0082] In a possible implementation, the image prompt data can be triggered to be automatically generated when the environmental state of the target space is identified. Specifically, based on at least one first monitoring device in the target space, the environmental state of the target space is monitored to obtain the environmental data of the target space; the environmental data of the target space is used as the target data. For example, based on the temperature sensor in the target space, if the electronic device determines that the temperature of the target space is high, it can automatically generate the image prompt data of "ice cream" to alleviate the user's discomfort with the hot climate.

[0083] In this way, it can be fully guaranteed that the target image can have a good display effect in different environments, enhancing the user's comfort.

[0084] In one possible implementation, image prompt data can be triggered to be automatically generated when devices or objects existing around the target device in the target space are identified. Specifically, based on at least one second monitoring device in the target space, the devices and / or objects in the target space are photographed to obtain a spatial image containing the devices and / or objects in the target space; image recognition is performed on each device and / or object in the spatial image to determine the devices and / or objects existing around the target device; environmental data of the target space is generated based on the determined devices and / or objects, and the environmental data of the target space is used as target data. For example, when an electronic device determines that there are green plants around it, image prompt data related to the theme of green plants will be automatically generated.

[0085] In this way, scene recognition through the introduction of image recognition technology such as devices or objects can make the subsequently generated target image fully adapt to the current scene, which is conducive to enhancing the overall coordination between the target image and the surrounding environment of the target device, and thus helps to enhance the user's immersion and experience.

[0086] In one possible implementation, the image prompt data can be triggered to be automatically generated when it is recognized that the current time meets the set conditions, and can also be triggered to be automatically generated when it is recognized that the current weather has changed. The set conditions here can be flexibly set according to the actual needs of the application scenario. For example, the set conditions can be a certain time period, or a specific date or anniversary, or a holiday, etc. Specifically, the current time and / or weather are monitored to determine the current time and / or current weather; if the current time meets the set conditions or the current weather is monitored to have changed, the current observation data is generated based on the current time or the current weather, and the current observation data is used as the target data. For example, if the electronic device detects that the current time is January 1, New Year's Day, it automatically generates image prompt data for "New Year's Day".

[0087] It is explained here that the electronic device itself can have the ability to monitor the current time or the current weather. For example, the electronic device uses its own RTC (Real-Time Communication) component to track the current time, or it can use various sensors deployed in the target space to monitor the current time or the current weather. This is not limited here.

[0088] With the cooperation of the above-mentioned embodiments, automatic recognition of target data is achieved through real-time monitoring of the target object, equipment or objects in the target space, the current time, the current weather, etc., which is used as the basis for automatic generation of image prompt data, so that users can be provided with more personalized and real-time target images, which is conducive to improving user experience.

[0089] See also Figure 6 In an exemplary embodiment, step 350 may include the following steps:

[0090] Step 351, detecting whether the target device is deployed in other spaces.

[0091] Among them, other spaces are different from the target space.

[0092] If yes, it means that the target image has a hardware implementation environment for linkage display in different rooms, and then step 353 is executed.

[0093] On the contrary, if it is detected that no target device is deployed in other spaces, it means that the target image does not yet have a hardware implementation environment for linkage display in different rooms, and the target image is displayed in the interface of the target device in the target space.

[0094] Step 353 , linking display of the target image is performed between the target device in the target space and the target devices in other spaces.

[0095] After it is detected that the target image has a hardware implementation environment for linkage display in different spaces, linkage display of the target image in different spaces can be achieved based on the hardware implementation environment.

[0096] In a possible implementation, linkage display can be that multiple target devices in different spaces display a part of the target image respectively. It can also be understood that linkage display refers to multiple target devices in different spaces collaboratively displaying a continuous panoramic target image. In this way, the collaborative work of multiple target devices in different spaces is realized, and the expression form and spatial range of the target image display are expanded.

[0097] For example, the hardware implementation environment includes four target devices deployed in four rooms of a home. At this time, the target image can be evenly divided into four blocks. The division method can be vertical division, horizontal division, or "cross" division, which is not limited here. Then, the four target devices in the four rooms can each display one of the blocks of the target image.

[0098] In a possible implementation, the linkage display can be to display the same or theme-related target images in multiple target devices in different spaces. In this way, the target image can be displayed across multiple display screens, thereby creating a more coordinated image display effect in multiple spaces. It should be noted that theme-related target images refer to target images displayed by different target devices that have similar contents but are still different.

[0099] For example, the user installs two smart TVs in the master bedroom and the guest bedroom respectively. When the user enters the guest bedroom from the master bedroom, the smart TV in the guest bedroom will automatically and synchronously display the same target image as the smart TV in the master bedroom.

[0100] Or, the user installs a smart central control screen and a smart TV in the living room and bedroom respectively. When the user enters the bedroom from the living room, the smart TV in the bedroom automatically displays the target image related to the theme of the smart central control screen in the living room. For example, if the light in the living room is strong, the smart central control screen will display a brighter sunrise beach image, while if the light in the bedroom is dim, the smart TV may display a darker sunset beach image.

[0101] With the help of the above-mentioned embodiments, the linked display of target images among multiple target devices is realized, which can not only create a more coordinated image display effect in multiple spaces, but also expand the expression form and spatial range of image display.

[0102] See also Figure 7 In an exemplary embodiment, before step 350, the method may further include the following steps:

[0103] Step 510: Acquire environmental data of the target space, and monitor whether the environmental state of the target space changes based on the environmental data of the target space.

[0104] As mentioned above, the environmental data of the target space is obtained by monitoring the environmental state of the target space based on at least one first monitoring device in the target space. Therefore, the environmental data of the target space can reflect whether the environmental state of the target space has changed. The change can not only refer to whether the light intensity, temperature, humidity of the target space has changed, whether there is movement of the target object, etc., but also whether the various devices or objects deployed in the target space have changed.

[0105] Taking the first monitoring device as a temperature sensor as an example, as the temperature sensor is deployed in the target space, the temperature sensor can monitor the temperature of the target space in real time, and then monitor whether the temperature of the target space has changed.

[0106] If yes, it means that the environmental state of the target space is monitored to have changed, and step 530 is executed.

[0107] On the contrary, if it is detected that the environmental state of the target space has not changed, the generated target image is kept unchanged and displayed in the interface of the target device.

[0108] Step 530 , adaptively adjust the target image according to the environmental data of the target space, so as to display the adjusted target image in the interface of the target device.

[0109] After detecting that the environmental state of the target space has changed, it is necessary to adaptively adjust the target image generated in step 330 so that it can adapt to the changed environmental state of the target space, thereby providing users with more personalized and real-time image display services, thereby improving user experience.

[0110] In a possible implementation, adaptive adjustment refers to directly adjusting the image attributes of the target image, for example, the image attributes include hue, brightness, contrast, etc. In a possible implementation, adaptive adjustment includes first adjusting the image prompt data so that the image prompt data adapts to the changed environmental state of the target space, and then regenerating a matching target image based on the adjusted image prompt data so that the content of the adjusted target image conforms to the updated image theme, so that it can adapt to the changed environmental state of the target space.

[0111] Figure 8 A schematic diagram showing how a target image is adaptively adjusted according to different data in one embodiment is shown. Figure 8 The adaptive adjustment process of the target image is described as follows:

[0112] In one possible implementation, the target image can change with changes in the ambient light, ambient temperature, etc. of the target space. Specifically, based on the environmental data of the target space, the current light intensity and / or the current temperature of the target space are determined; according to the current light intensity and / or the current temperature of the target space, the brightness and contrast of the target image are adjusted. For example, the brightness and contrast of the target image will increase as the current light intensity of the target space becomes stronger and the current temperature rises. It is explained here that the light intensity of the target space can be monitored by a light sensor deployed in the target space, and the temperature of the target space can be monitored by a temperature sensor deployed in the target space. Of course, in other embodiments, the temperature of the target space can also be monitored by a human body sensor in the target space, and this embodiment does not limit this.

[0113] It is understandable that when the light intensity of the target space becomes stronger, the user may also appropriately adjust the screen brightness of the target device to avoid eye irritation. Therefore, in another possible implementation, the target image can also change with the change of the screen brightness of the target device. Specifically, based on the environmental data of the target space, the screen brightness of the target device is determined; according to the screen brightness of the target device, the brightness and contrast of the target image are adjusted. For example, the brightness and contrast of the target image will decrease as the screen brightness of the target device decreases.

[0114] In this way, the good display effect of the target image in different environments is fully guaranteed, which is conducive to improving the user's comfort.

[0115] In a possible implementation, the target image can change with the change of the devices or objects around the target device. Specifically, based on the environmental data of the target space, it is determined whether the target space recognizes a device or object newly deployed around the target device; if so, the image theme related to the recognized device or object is determined, and the content of the target image is adjusted based on the determined image theme.

[0116] For example, if a new green plant is identified around the target device in the target space, a target image containing "green plant" can be regenerated so that the content of the target image matches the image theme related to the green plant. It should be noted that each device or object in the target space is determined based on image recognition technology.

[0117] In a possible implementation, the target image can change with the activity state of the target object in the target space. Specifically, based on the environment data of the target space, the activity state of the target object in the target space is determined; and the content of the target image is adjusted to match the activity state of the target object.

[0118] The activity state is used to describe the number of target objects in the target space and / or whether the target objects are moving. For example, if it is recognized that the number of people in the target space suddenly increases and is very active, a target image related to a multi-person gathering can be regenerated so that the content of the target image matches the active activity state of the multi-person gathering. It is noted that the target objects in the target space can be monitored using human body sensors, millimeter wave radars, etc. in the target space.

[0119] In this way, it is fully ensured that the target image can adapt to the current scene, and the overall coordination between the target image and the surrounding environment of the target device is enhanced, which is conducive to improving the user's immersion and experience.

[0120] Through the coordination of the above embodiments, adaptive adjustment of the target image is achieved, so that the target image can change with changes in the light intensity, temperature, newly deployed equipment or objects, and activity status of the target object in the target space, further meeting the user's personalized and real-time needs for image display services, and greatly improving the user experience.

[0121] In one application scenario, image processing and image display are implemented by an electronic device with image processing capabilities and a display screen. The electronic device is suitable for Figure 1 The smart device 130 in the implementation environment is shown. For example, the smart device 130 may refer to a scene screen, a smart screen, a millimeter wave radar, etc. in a smart home system. The generation of the target image may be completed by calling a service platform such as AIGC, which may be deployed on Figure 1 The server side 170 in the implementation environment is shown.

[0122] The following is an explanation of the process of image processing and image display in the application scenario through a specific example. Specifically, the image prompt data can be automatically generated based on at least one of the user data of the target object, the environmental data of the target space, and the current observation data.

[0123] The user data of the target object may include the user's emotional state. For example, generating a target image based on the user's emotional state:

[0124] The electronic device itself is equipped with a camera and supports an emotion analysis algorithm. When a user sits in front of the electronic device, the electronic device can capture the user's facial expression in real time based on the camera, and analyze the facial expression using an emotion analysis algorithm, recognizing that the user's current emotional state is "happy". At this time, image prompt data of a "sunny beach" is generated based on the "happy" emotional state, and then a target image is generated through the AIGC service platform, and the target image of the "sunny beach" is displayed on the display screen of the electronic device.

[0125] The user data of the target object may include the user's gesture. Take the generation of a target image based on the user's gesture as an example:

[0126] The electronic device itself is equipped with a camera and supports gesture recognition algorithms. When a user sits in front of the electronic device and makes gestures facing the display screen of the electronic device, the electronic device still captures the user's actions in real time based on the camera. The actions include but are not limited to gestures such as likes, heart shapes, and waving. Then, these gestures with specific meanings are recognized by the gesture recognition algorithm, and corresponding image prompt data are generated based on these gestures. For example, the like gesture can correspond to the image prompt data of "favorite", the heart gesture can correspond to the image prompt data of "love", and the waving gesture corresponds to the image prompt data of "goodbye". Finally, the AIGC service platform is called to generate a target image that matches the content indicated by the image prompt data, and the corresponding target image is displayed on the display screen of the electronic device.

[0127] The current observation data may include the current weather. Take the example of generating a target image based on the current weather:

[0128] The electronic device itself is equipped with a positioning module, which can be used to locate the target image based on the local real-time weather information. Specifically, the electronic device monitors the current weather (such as sunny, rainy, snowy, etc.), and if the current weather is rainy, it generates image prompt data of "rainy scene", and then generates a "rainy day" target image through the AIGC service platform and displays it on the display screen of the electronic device.

[0129] The current observation data may include the current time, and the current time may include holidays, special dates, etc. Take the generation of target images based on holidays or special dates as an example:

[0130] The electronic device itself deploys an RTC (Real Time Clock) component, which can track time so as to generate a corresponding target image according to the current time. Specifically: when the electronic device detects that the current time is December 25, Christmas, it generates image prompt data of "Christmas", and then generates a target image related to the Christmas theme through the AIGC service platform and displays it on the display screen of the electronic device.

[0131] Of course, users can also input customized special days, such as birthdays, wedding anniversaries, etc., through electronic devices, so that electronic devices can automatically display target images of related themes on these special days. Specifically: when the electronic device detects that it is the user's birthday, it can generate "birthday" image prompt data when the user first turns on the electronic device on that day, and then generate a target image related to the birthday theme through the AIGC service platform and display it on the display screen of the electronic device.

[0132] The environmental data of the target space may include the surrounding environment of the identified target space. For example, generating a target image based on the surrounding environment:

[0133] Electronic devices can use image recognition technology and millimeter-wave radar technology to determine the surrounding environment so that the generated target image can adapt to the current scene. For example, if the electronic device detects a sudden increase in the number of people in the target space through millimeter-wave radar technology, and is in an active state, and the lighting is dim, it generates image prompt data for a "party atmosphere", and then generates a corresponding target image through the AIGC service platform and displays it on the display screen of the electronic device. Of course, as the number of people decreases and it is in a quiet state, the electronic device can also adaptively adjust the target image that meets the "party atmosphere" to a target image that meets the "quiet atmosphere", for example, regenerate a target image of "beach under the stars" through the AIGC service platform.

[0134] The target space environment data may include the target space environment light. Take the adaptive adjustment of the target image according to the environment light as an example:

[0135] The electronic device itself can also be equipped with a light sensor, and use the light sensor to monitor the ambient light, so as to adjust the hue, brightness, contrast, etc. of the target image according to the ambient light. For example, if the electronic device detects that the current ambient light is dim, it can adjust the brightness and contrast of the generated target image to adapt to the current dim environment, and display the adjusted target image on the screen of the electronic device. Of course, the electronic device can also first adjust the image prompt data to "dim", and then generate a target image with a dim hue through the AIGC service platform, so as to achieve adaptive adjustment of the target image.

[0136] Compared with the related technologies, the embodiments of the present application can provide more personalized and real-time image display services, improve user experience and satisfaction; enhance the interactivity and communication between users and images, deepen users' dependence on and trust in smart display devices, and add more functions and value to smart display devices; provide more diverse and flexible user input methods, increase user participation opportunities and fun; improve the display effect of images in different environments, improve user comfort and visual enjoyment; expand the spatial range and expression form of image display, enrich user visual experience and perception; enhance the overall coordination and immersion of images and the environment, and improve user satisfaction.

[0137] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0138] The following is an embodiment of the device of the present application, which can be used to execute the image processing method involved in the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the method embodiment of the image processing method involved in the present application.

[0139] See also Fig. 9 In an embodiment of the present application, an image processing device 900 is provided, including but not limited to: a data acquisition module 910, an image generation module 930, and an image display module 950.

[0140] The data acquisition module 910 is used to acquire image prompt data; the image prompt data is used to prompt the content of the target image to be generated, and the image prompt data is automatically generated based on at least one of the user data of the identified target object, the environmental data of the target space, and the current observation data;

[0141] An image generation module 930 is used to generate a target image that matches the content indicated by the image prompt data;

[0142] The image display module 950 is used to display the generated target image in the interface of the target device.

[0143] In an exemplary embodiment, the device 900 also includes: a data generation module, which is used to identify at least one of the activity of the target object in the target space, the environmental conditions of the target space, the current climate, the current time, and the current event to obtain target data; the target data includes at least one of the user data of the target object, the environmental data of the target space, and the current observation data; based on the user data of the target object, the environmental data of the target space, and at least one of the current observation data, image prompt data is automatically generated.

[0144] In an exemplary embodiment, the data generation module is further used to monitor the environmental state of the target space based on at least one first monitoring device in the target space to obtain environmental data of the target space; and use the environmental data of the target space as target data.

[0145] In an exemplary embodiment, the data generation module is also used to photograph the equipment and / or objects in the target space based on at least one second monitoring device in the target space to obtain a spatial image containing the equipment and / or objects in the target space; perform image recognition on each equipment and / or object in the spatial image to determine the equipment and / or objects existing around the target equipment; generate environmental data of the target space based on the determined equipment and / or objects, and use the environmental data of the target space as target data.

[0146] In an exemplary embodiment, the data generation module is also used to monitor whether there is a target object in the target space based on at least one first monitoring device in the target space; if so, based on at least one second monitoring device in the target space, photograph the target object in the target space to obtain a user image containing the target object; identify the emotion or action of the target object in the user image to determine the emotional state or action of the target object; generate user data of the target object based on the emotional state or action of the target object, and use the user data of the target object as target data.

[0147] In an exemplary embodiment, the data generation module is also used to obtain historical behavior data of the target object in the target space; the historical behavior data reflects the historical behavior of the target object with respect to the historical target image displayed by the target device and / or the historical usage data of the target object with respect to each device in the target space; preference learning is performed on the historical behavior data of the target object to obtain the preference data of the target object; user data of the target object is generated based on the preference data of the target object, and the user data of the target object is used as the target data.

[0148] In an exemplary embodiment, the data generation module is also used to monitor the current time and / or weather to determine the current time and / or current weather; if the current time meets the set conditions or the current weather is monitored to have changed, current observation data is generated based on the current time or current weather, and the current observation data is used as target data.

[0149] In an exemplary embodiment, the image display module 950 is also used to detect whether a target device is deployed in other spaces; the other spaces are different from the target space; if so, a linkage display of the target image is performed between the target device in the target space and the target devices in other spaces.

[0150] In an exemplary embodiment, the device 900 also includes: an image adjustment module, which is used to obtain environmental data of the target space and monitor whether the environmental state of the target space changes based on the environmental data of the target space; if so, the target image is adaptively adjusted according to the environmental data of the target space to display the adjusted target image in the interface of the target device.

[0151] In an exemplary embodiment, the image adjustment module is also used to determine the current light intensity and / or current temperature of the target space based on the environmental data of the target space; and adjust the brightness and contrast of the target image according to the current light intensity and / or current temperature of the target space.

[0152] In an exemplary embodiment, the image adjustment module is also used to determine whether a device or object newly deployed around the target device is identified in the target space based on the environmental data of the target space; if so, determine the image theme related to the identified device or object, and adjust the content of the target image based on the determined image theme.

[0153] In an exemplary embodiment, the image adjustment module is also used to determine the activity state of the target object in the target space based on the environmental data of the target space; the activity state is used to describe the number of target objects in the target space, and / or whether the target object is moving; and adjust the content of the target image to match the activity state of the target object.

[0154] It should be noted that, when the image processing device provided in the above embodiment performs image processing and displays, it only uses the division of the above-mentioned functional modules as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the image processing device will be divided into different functional modules to complete all or part of the functions described above.

[0155] In addition, the image processing device and the image processing method provided in the above embodiments belong to the same concept, wherein the specific manner in which each module performs the operation has been described in detail in the method embodiment and will not be repeated here.

[0156] See also Fig.10 In an embodiment of the present application, an electronic device 4000 is provided, and the electronic device 4000 may include: a smart phone, a tablet computer, a desktop computer, a laptop computer, a server, and other electronic devices equipped with a display screen.

[0157] exist Fig.10 In the embodiment, the electronic device 4000 includes at least one processor 4001 and at least one memory 4003.

[0158] The data interaction between the processor 4001 and the memory 4003 can be realized through at least one communication bus 4002. The communication bus 4002 may include a path for transmitting data between the processor 4001 and the memory 4003. The communication bus 4002 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The communication bus 4002 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0159] Optionally, the electronic device 4000 may further include a transceiver 4004, which may be used for data interaction between the electronic device and other electronic devices, such as data transmission and / or data reception. It should be noted that in actual applications, the transceiver 4004 is not limited to one, and the structure of the electronic device 4000 does not constitute a limitation on the embodiments of the present application.

[0160] Processor 4001 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. Processor 4001 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0161] The memory 4003 can be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compressed optical disk, laser disk, optical disk, digital versatile disk, Blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store a computer program in the form of instructions or data structures and can be accessed by the electronic device 4000, but is not limited to this.

[0162] The memory 4003 stores a computer program, and the processor 4001 can read the computer program stored in the memory 4003 through the communication bus 4002 .

[0163] The computer program is executed by one or more processors 4001 to implement the image processing method in the above-mentioned embodiments.

[0164] In addition, an embodiment of the present application provides a storage medium on which a computer program is stored. When the computer program is executed by one or more processors, the image processing method as described above is implemented.

[0165] A computer program product is provided in an embodiment of the present application, including a computer program, which implements the image processing method described above when executed by one or more processors.

[0166] The above description is only a partial implementation method of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. An image processing method, characterized in that: The method comprises: Acquire image prompt data; the image prompt data is used to prompt the content of the target image to be generated, and the image prompt data is automatically generated based on at least one of the user data of the identified target object, the environmental data of the target space, and the current observation data; Generate a target image that matches the content prompted by the image prompt data; The generated target image is displayed in the interface of the target device.

2. The method according to claim 1, characterized in that Before obtaining the image prompt data, the method further includes: Identify at least one of the activity of the target object in the target space, the environmental conditions of the target space, the current climate, the current time, and the current event to obtain target data; the target data includes at least one of the user data of the target object, the environmental data of the target space, and the current observation data; The image prompt data is automatically generated based on at least one of the target data including user data of the target object, environmental data of the target space, and current observation data.

3. The method according to claim 2, characterized in that The identifying the activity of the target object in the target space, the environment of the target space, or the current system weather to obtain target data includes: Based on at least one first monitoring device in the target space, monitoring the environmental state of the target space to obtain environmental data of the target space; The environmental data of the target space is used as the target data.

4. The method according to claim 2, characterized in that The identifying the activity of the target object in the target space, the environment of the target space, or the current system weather to obtain target data includes: Based on at least one second monitoring device in the target space, photographing the devices and / or objects in the target space to obtain a spatial image containing the devices and / or objects in the target space; Performing image recognition on each device and / or object in the spatial image to determine devices and / or objects existing around the target device; Environmental data of the target space is generated according to the determined equipment and / or object, and the environmental data of the target space is used as the target data.

5. The method according to claim 2, characterized in that The identifying the activity of the target object in the target space, the environment of the target space, or the current system weather to obtain target data includes: Based on at least one first monitoring device in the target space, monitoring whether the target object exists in the target space; If yes, then based on at least one second monitoring device in the target space, photograph the target object in the target space to obtain a user image containing the target object; Recognize the emotion or action of the target object in the user image to determine the emotional state or action of the target object; User data of the target object is generated based on the emotional state or action of the target object, and the user data of the target object is used as the target data.

6. The method according to claim 2, characterized in that The identifying the activity of the target object in the target space, the environment of the target space, or the current system weather to obtain target data includes: Acquire historical behavior data of the target object in the target space; the historical behavior data reflects the historical behavior of the target object with respect to the historical target image displayed by the target device and / or the historical usage data of the target object with respect to each device in the target space; Performing preference learning on the historical behavior data of the target object to obtain the preference data of the target object; The user data of the target object is generated based on the preference data of the target object, and the user data of the target object is used as the target data.

7. The method according to claim 2, characterized in that The identifying the activity of the target object in the target space, the environment of the target space, or the current system weather to obtain target data includes: Monitoring the current time and / or weather to determine the current time and / or current weather; If the current time meets the set conditions or the current weather is monitored to have changed, current observation data is generated based on the current time or the current weather, and the current observation data is used as the target data.

8. The method according to claim 1, characterized in that The displaying of the generated target image in the interface of the target device includes: Detecting whether the target device is deployed in other spaces; the other spaces are different from the target space; If yes, the target image is displayed in linkage between the target device in the target space and the target device in the other space.

9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: Acquiring environmental data of the target space, and monitoring whether the environmental state of the target space changes based on the environmental data of the target space; If yes, the target image is adaptively adjusted according to the environmental data of the target space, so as to display the adjusted target image in the interface of the target device.

10. The method according to claim 9, characterized in that The adaptively adjusting the target image according to the environmental data of the target space includes: Determine the current light intensity and / or the current temperature of the target space based on the environmental data of the target space; The brightness and contrast of the target image are adjusted according to the current light intensity and / or the current temperature of the target space.

11. The method according to claim 9, characterized in that The adaptively adjusting the target image according to the environmental data of the target space includes: Based on the environmental data of the target space, determining whether a device or object newly deployed around the target device is identified in the target space; If so, an image theme related to the identified device or object is determined, and the content of the target image is adjusted based on the determined image theme.

12. The method according to claim 9, characterized in that The adaptively adjusting the target image according to the environmental data of the target space includes: Determine, based on the environmental data of the target space, an activity state of the target object in the target space; the activity state is used to describe the number of the target objects in the target space and / or whether the target objects are moving; The content of the target image is adjusted to match the activity state of the target object.

13. An image processing device, characterized in that: include: A data acquisition module, used for acquiring image prompt data; The image prompt data is used to prompt the content of the target image to be generated, and the image prompt data is automatically generated based on at least one of the user data of the identified target object, the environmental data of the target space, and the current observation data; An image generation module, used to generate a target image matching the content prompted by the image prompt data; The image display module is used to display the generated target image in the interface of the target device.

14. An electronic device comprising at least one processor and at least one memory, wherein: The memory stores a computer program, wherein the computer program, when executed by the processor, implements the image processing method according to any one of claims 1 to 12.

15. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by one or more processors, the image processing method according to any one of claims 1 to 12 is implemented.

16. A computer program product comprising a computer program, characterized in that When the computer program is executed by one or more processors, the image processing method according to any one of claims 1 to 12 is implemented.

Images