Display method and three-dimensional display screen
By displaying and managing bonsai images on the three-dimensional display screen, the problem of difficulty in replacing and moving bonsai is solved, and the user's experience of cultivating bonsai in a virtual environment is realized, and the user's sense of participation and experience is enhanced.
Patent Information
- Application Number
- CN202510458265.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-11
- Publication Date
- 2025-07-01
AI Technical Summary
During the cultivation of bonsai, it is difficult to replace and move bonsai, which leads to many problems when growing bonsai at home.
By displaying images on a stereo display screen, such as displaying bonsai images, users can perform virtual replacement and movement of bonsai by operating the stereo display screen, solving the problem of difficulty in replacing and moving bonsai.
It realizes the experience of having cultivated bonsai on the three-dimensional display screen, avoiding the difficulties of replacing and moving the actual bonsai, and improving the user experience.
Smart Images

Figure CN120238643A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of display technologies, and more particularly, to a display method and a three-dimensional display screen. Background Art
[0002] With the improvement of users' living standards, users have more and more demands for bonsai cultivation, pet breeding, etc. Taking bonsai cultivation as an example, currently, the vast majority are to shape real plants in a pot-shaped container to imitate miniature natural landscapes such as trees and rockeries in natural landscapes. However, during the process of cultivating bonsai, problems such as difficult replacement and movement of bonsai are often encountered by householders who cultivate bonsai at home. Summary of the Invention
[0003] This application provides a display method and a three-dimensional display screen. By displaying an image on the three-dimensional display screen, such as a bonsai image, it can give users a sense of participation in cultivating bonsai. When the image is displayed on the three-dimensional display screen, there is no need for users to manually replace or move the bonsai. Therefore, problems such as difficult replacement and movement of bonsai can be solved.
[0004] In a first aspect, a display method is provided. The method is applied to a three-dimensional display screen and includes: in response to a first operation of a user, sending first information to a server, where the first information is used to request generation of a first image; receiving second information, where the second information includes the first image or multiple second images, and the multiple second images are images corresponding to different angles of the first image; and displaying images with different angles on multiple surfaces of the three-dimensional display screen according to the second information.
[0005] In combination with the first aspect, in a possible implementation, gratings are provided on multiple surfaces.
[0006] In combination with the first aspect, in a possible implementation, the first image is a first 3D bonsai image, and the second images are 2D bonsai images corresponding to different angles of the first 3D bonsai image.
[0007] In combination with the first aspect, in a possible implementation, the method further includes: sending third information to the server, where the third information is used to request the server to manage the first image; receiving fourth information, where the fourth information includes a third image or multiple fourth images, the third image is the first image after management, and the multiple fourth images are images corresponding to different angles of the third image; deleting the images displayed according to the second information, and displaying images with different angles on multiple surfaces of the three-dimensional display screen according to the fourth information.
[0008] In combination with the first aspect, in a possible implementation, sending the third information to the server includes: in response to a second operation of the user, sending the third information to the server.
[0009] In combination with the first aspect, in a possible implementation, the second operation includes at least one of the following: pest control operation, watering operation, fertilizing operation, pruning operation, scene replacement operation, style replacement operation.
[0010] In combination with the first aspect, in a possible implementation, the method further includes: tracking the user's eyes; adjusting the brightness of the stereoscopic display according to the user's eyes, or adjusting the size and / or position of the image on the stereoscopic display.
[0011] In combination with the first aspect, in a possible implementation, adjusting the brightness of the stereoscopic display according to the user's eyes, or adjusting the size and / or position of the image on the stereoscopic display, includes: when the distance between the user's eyes and the stereoscopic display gradually increases, reducing the brightness of the stereoscopic display or reducing the image on the stereoscopic display; or, when the distance between the user's eyes and the stereoscopic display gradually decreases, increasing the brightness of the stereoscopic display or increasing the image on the stereoscopic display; or, when the distance between the user's eyes and the stereoscopic display remains unchanged and the user's position changes, moving the position of the image on the stereoscopic display.
[0012] In combination with the first aspect, in a possible implementation, the method further includes: sending fifth information to the server, the fifth information being used to request the server to generate corresponding text for the first image; receiving sixth information, the sixth information including the text; and displaying the text on at least one of multiple faces.
[0013] In combination with the first aspect, in a possible implementation, sending the fifth information to the server includes: sending the fifth information to the server in response to the user's third operation.
[0014] In combination with the first aspect, in a possible implementation, the first information includes at least one of the following parameters corresponding to the first image: tree species, morphology, size, style, background.
[0015] In a second aspect, a display method is provided. The method is applied to a server and includes: receiving first information, the first information being used to request the generation of a first image; generating the first image according to the first information; and sending second information to the stereoscopic display, the second information including the first image or multiple second images, the multiple second images being images of different angles corresponding to the first image.
[0016] In combination with the second aspect, in a possible implementation, the first information includes at least one of the following parameters corresponding to the first image: tree species, morphology, size, style, background.
[0017] In combination with the second aspect, in a possible implementation manner, generating a first image according to the first information includes: inputting at least one parameter into an image generation model, and generating the first image based on the result output by the image generation model, where the image generation model is obtained through training.
[0018] In combination with the second aspect, in a possible implementation manner, the method further includes: receiving third information for requesting the server to manage the first image; managing the first image according to the second information; sending fourth information to the stereoscopic display screen, where the fourth information includes a third image or multiple fourth images, the third image is the image after managing the first image, and the multiple fourth images are images corresponding to different angles of the third image.
[0019] In combination with the second aspect, in a possible implementation manner, the management includes at least one of the following: pest control, watering, fertilizing, pruning, changing the scene, and changing the style.
[0020] In combination with the second aspect, in a possible implementation manner, the method further includes: receiving fifth information for requesting the server to generate corresponding text for the first image; generating text according to the fifth information; sending sixth information to the stereoscopic display screen, where the sixth information includes the text.
[0021] In a third aspect, a stereoscopic display screen is provided, and the stereoscopic display screen includes a module for executing the method of the first aspect or any possible implementation manner in the first aspect.
[0022] In a fourth aspect, a stereoscopic display screen is provided, including: one or more processors; one or more memories; one or more memories store one or more computer programs, and the one or more computer programs include instructions that, when executed by the one or more processors, cause the stereoscopic display screen to execute the method of the first aspect or any possible implementation manner in the first aspect.
[0023] In a fifth aspect, a server is provided, and the server includes a module for executing the method of the second aspect or any possible implementation manner in the second aspect.
[0024] In a sixth aspect, a server is provided, including: one or more processors; one or more memories; one or more memories store one or more computer programs, and the one or more computer programs include instructions that, when executed by the one or more processors, cause the server to execute the method of the second aspect or any possible implementation manner in the second aspect.
[0025] In a seventh aspect, there is provided a computer storage medium including computer instructions which, when running on a stereoscopic display screen or a server, cause the stereoscopic display screen to execute the method according to the first aspect or any possible implementation manner of the first aspect, or cause the server to execute the method according to the second aspect or any possible implementation manner of the second aspect.
[0026] In the embodiments of the present application, a user can interact with the stereoscopic display screen. The user can perform operations on the stereoscopic display screen to select corresponding parameters. After receiving the corresponding operations, the stereoscopic display screen sends the parameters selected by the user to the server. The server generates a corresponding first image based on the parameters and sends the first image or multiple images corresponding to the first image at different angles to the stereoscopic display screen. The stereoscopic display screen displays the corresponding images. In particular, when the first image is a bonsai image, the user can cultivate a bonsai on the stereoscopic display screen, thereby solving problems such as difficulty in replacing and moving bonsais and enhancing the user experience. Moreover, even if mosquitoes breed in the images displayed on the stereoscopic display screen, it will not affect the user's life, thus further enhancing the user experience.
[0027] In addition, in some embodiments, gratings are further provided on multiple surfaces of the stereoscopic display screen, so that the bonsais displayed on these multiple surfaces give the user a three-dimensional sense, enabling the user to have the feeling of actually planting a bonsai by himself / herself and further enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required to be used in the embodiments of the present application. Obviously, the following described drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained according to the drawings without creative efforts.
[0029] Figure 1 It is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application.
[0030] Figure 2 It is a schematic diagram of the software structure of an electronic device provided by an embodiment of the present application.
[0031] Figure 3 It is a schematic diagram of the modules included in a stereoscopic display screen and a server provided by an embodiment of the present application.
[0032] Figure 4 It is a schematic diagram of a group of GUIs provided by an embodiment of the present application.
[0033] Figure 5 It is a schematic diagram of another group of GUIs provided by an embodiment of the present application.
[0034] Figure 6 Schematic diagram of a display method provided by an embodiment of the present application.
[0035] Figure 7 Schematic diagram of a training method for a bonsai generation model provided by an embodiment of the present application.
[0036] Figure 8 Schematic diagram of a grating provided by an embodiment of the present application.
[0037] Fig. 9 Schematic diagram of a possible event provided by an embodiment of the present application.
[0038] Fig.10 Schematic diagram of the interaction between multiple servers and a stereoscopic display screen provided by an embodiment of the present application.
[0039] Fig.11 Another schematic diagram of the interaction between multiple servers and a stereoscopic display screen provided by an embodiment of the present application.
[0040] Fig.12 Schematic diagram of a stereoscopic display screen changing based on the changes of the user's eyeballs provided by an embodiment of the present application.
[0041] Fig.13 Schematic diagram of a display method provided by an embodiment of the present application.
[0042] Fig.14 Schematic block diagram of an electronic device provided by an embodiment of the present application.
[0043] Fig.15 Another schematic block diagram of an electronic device provided by an embodiment of the present application. Detailed implementation manners
[0044] To make the objectives, technical solutions and advantages of the present application clearer, the following will further describe in detail the embodiments of the present application with reference to the accompanying drawings.
[0045] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and appended claims of the present application, the singular forms "a", "an", "the", "above-mentioned", "said", and "this" are also intended to include expressions such as "one or more", unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of the present application, "at least one" and "one or more" mean one, two, or more than two. The term "and / or" is used to describe the association relationship of associated objects and indicates that three relationships may exist; for example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B may be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after.
[0046] Reference to "one embodiment", "some embodiments", "an embodiment", or "some embodiments" described in the embodiments of the present application means that a specific feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, statements such as "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc., which appear in different places in this specification, do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "comprise", "include", "have" and their variants all mean "including but not limited to", unless otherwise specifically emphasized in another way.
[0047] Those skilled in the art of the present technology can understand that, unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meaning as the general understanding of those of ordinary skill in the art to which the present application belongs. It should also be understood that terms such as those defined in a general dictionary should be understood to have a meaning consistent with the meaning in the context of the prior art, and will not be interpreted with an idealized or overly formal meaning unless specifically defined as here.
[0048] If there is no special indication, all embodiments and optional embodiments of the present application can be combined with each other to form new technical solutions, and all technical features and optional technical features of the present application can be combined with each other to form new technical solutions.
[0049] Exemplarily, Figure 1A schematic structural diagram of the electronic device 100 is shown. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a Subscriber Identification Module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0050] It can be understood that the structure schematically shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0051] The processor 110 may include one or more processing units. For example, the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and / or a Neural-Network Processing Unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.
[0052] Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.
[0053] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly retrieved from the said memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0054] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and / or a Universal Serial Bus (USB) interface, etc.
[0055] It can be understood that the interface connection relationships between the modules illustrated in the embodiments of the present application are only illustrative descriptions and do not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0056] The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.
[0057] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: the antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0058] The mobile communication module 150 may provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 may receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be disposed in the same device.
[0059] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor may be an independent device. In other embodiments, the modulation and demodulation processor may be independent of the processor 110 and disposed in the same device as the mobile communication module 150 or other functional modules.
[0060] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive signals to be sent from the processor 110, frequency-modulate them, amplify them, and convert them into electromagnetic waves through the antenna 2 for radiation.
[0061] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with a network and other devices via wireless communication technologies. The wireless communication technologies may include Global System For Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), Beidou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).
[0062] Electronic device 100 implements a display function via a GPU, display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, connected to display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
[0063] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a Microled, a Micro-Oled, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
[0064] The electronic device 100 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, etc.
[0065] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image through algorithms. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0066] The camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, etc. formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0067] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.
[0068] The video codec is used to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0069] The NPU is a Neural-Network (NN) computing processor. By learning from the biological neural network structure, such as learning from the transmission mode between human brain neurons, it can quickly process the input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized, such as: image recognition, face recognition, speech recognition, text understanding, etc.
[0070] The electronic device 100 can implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and the application processor, etc. Such as music playback, recording, etc.
[0071] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.
[0072] The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation from the electronic device 100. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
[0073] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In this embodiment of the application, the Android system with a layered architecture is taken as an example to exemplarily illustrate the software structure of the electronic device 100.
[0074] Figure 2It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely the application layer, the application framework layer, Android Runtime (AndroidRuntime) and system libraries, and the kernel layer. The application layer may include a series of application packages.
[0075] As Figure 2 shown, the application packages may include applications such as cameras, galleries, calendars, calls, maps, navigation, WLAN, Bluetooth, music, videos, text messages, etc.
[0076] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.
[0077] As Figure 2 shown, the application framework layer may include a window manager, a content provider, a view system, a telephone manager, a resource manager, a notification manager, etc.
[0078] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0079] The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audio, dialed and answered calls, browsing history and bookmarks, phone books, etc.
[0080] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
[0081] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.
[0082] The notification manager enables applications to display notification information in the status bar, can be used to convey notification-type messages, can automatically disappear after a short stay, without user interaction. The notification manager is used to inform of download completion, message reminders, etc.
[0083] The system library may include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0084] The solution of this application is mainly applied to a stereoscopic display screen (or called a stereoscopic screen) and a server (the server can be, for example, the server in an electronic device), or applied to a stereoscopic display screen, an electronic device (such as the electronic device Figure 1 shown above) and a server (the server is independent of the electronic device, and the function of the server is stronger or the performance is better than that of the server in the electronic device).
[0085] Among them, the stereoscopic display screen is a new generation of autostereoscopic display device based on the human eye stereoscopic vision mechanism. It can make excellent use of multi-channel autostereoscopic display technology and obtain images with complete depth information without the aid of any visual aids (such as 3D glasses, helmets, etc.). The inside of the stereoscopic display screen is driven by an intelligent Android board, and at the same time, it receives data from light sensors, humidity sensors, temperature sensors, and wind sensors in real time. By integrating each data and the current time, and combining with the intelligent bonsai cultivation algorithm, the image displayed by the bonsai is updated in real time.
[0086] A server refers to a special dedicated computer that provides various services for clients in a network environment. In a network, the server undertakes key tasks such as data storage, forwarding, and publishing, and is an essential and important part of various networks based on the client / server (C / S) mode or B / S mode. Since the server is a high-performance computer, its composition is similar to that of an ordinary computer in many aspects, such as having a central processing unit, memory, hard disk, various buses, etc. However, it can provide various shared services (network, web application, database, file, printing, etc.) and other high-performance applications. Its high performance is mainly reflected in aspects such as high-speed computing power, long-term reliable operation, and strong external data throughput capacity, and it is the center of the network and the core of informatization.
[0087] An electronic device refers to a device composed of electronic components such as integrated circuits, transistors, and electron tubes, and applies electronic technology (including software) to play a role, including electronic computers and robots, numerical control or programmable control systems controlled by electronic computers. The ionization device can be, for example, a mobile phone, a portable android device (PAD), a computer, etc.
[0088] To facilitate the understanding of the solution of this application, the following terms related to this application will be briefly introduced below.
[0089] Naked-eye 3D (Dimension, D): It is a general term for technologies that achieve a stereoscopic visual effect without external tools such as polarized glasses. The main representatives of this type of technology are the barrier technology and the lenticular lens technology.
[0090] AI Image Generation: AI image generation technology refers to the technology of using artificial intelligence, especially deep learning algorithms, to generate or modify images. This technology can create brand-new images or transform and enhance existing images.
[0091] Bonsai Cultivation Technology: Bonsai cultivation technology is a traditional art form that involves growing and shaping plants in small containers to imitate elements such as trees and rockeries in natural landscapes, creating miniature natural landscapes.
[0092] Internet of Things Technology: Internet of Things (IoT) technology refers to the technology of collecting real-time information of any objects or processes that need to be monitored, connected, and interacted with through various information sensing devices, such as radio frequency identification (RFID), infrared sensors, global positioning system (GPS), and network sensors, and then transmitting this information to a data processing center through a data transmission network for intelligent processing.
[0093] With the improvement of users' living standards, users have more and more demands for bonsai cultivation, pet breeding, etc. Taking bonsai cultivation as an example, at present, the vast majority are to shape real plants in pot containers to imitate miniature natural landscapes such as trees and rockeries in natural landscapes. However, during the process of cultivating bonsai, problems such as difficult replacement and movement of bonsai are often encountered by households cultivating bonsai at home.
[0094] To solve the above problems, this application provides a display method. By displaying images on a stereoscopic display screen, such as displaying bonsai images, problems such as difficult replacement and movement of bonsai can be solved. In addition, gratings are provided on multiple surfaces of the stereoscopic display screen, so that the bonsai displayed on these multiple surfaces gives users a 3D stereoscopic feeling, allowing users to have the feeling of growing real bonsai by themselves.
[0095] The following takes a stereoscopic display screen and a server as examples to introduce the modules included in the stereoscopic display screen and the server and the corresponding interaction process.
[0096] Such as Figure 3As shown, from the perspective of the application layer, the stereoscopic display screen includes a 3D bonsai rendering module, an interactive menu display module, a bonsai generation module, a bonsai growth information module, a bonsai management module, an interactive data statistics module, an environmental data statistics module, an AI text-to-bonsai generation module, and a communication module. The stereoscopic display screen includes a 3D rendering module, which contains a multi-screen image rendering component, a material download component, and an eye tracking + screen raster driving component.
[0097] From the perspective of the device layer, the stereoscopic display screen includes a three-dimensional four-sided screen, a light sensor, a temperature sensor, a humidity sensor, a wind sensor, and an Android system board.
[0098] From the perspective of the service layer, the server includes an AI text-to-bonsai module, Figure 2 a 2D to 3D module, an interactive data analysis module, an environmental data analysis module, and an AI image-to-poem module.
[0099] Among them, the application layer and the service layer can transmit data through the Message Queuing Telemetry Transport (MQTT) protocol and the Hypertext Transfer Protocol (HTTP); the service layer and the gateway layer can transmit data through HTTP; the gateway layer and the device layer can transmit data through the Transmission Control Protocol (TCP) and the User Datagram Protocol (UDP).
[0100] In an actual scenario, when the stereoscopic display screen detects that the user plants a new bonsai, after the user selects the corresponding parameters, the stereoscopic display screen can send the selected parameters to the server, and the server generates the corresponding 3D bonsai according to the parameters. In one implementation, the server can send the 3D bonsai image to the stereoscopic display screen, and the stereoscopic display screen analyzes the 3D bonsai image into multiple bonsai images at different angles and displays one bonsai image on each surface. In another implementation, the server analyzes the 3D bonsai image into multiple bonsai images at different angles and sends them to the stereoscopic display screen, and the stereoscopic display screen displays one bonsai image on each surface.
[0101] For ease of understanding, the following embodiments of the present application will take the stereoscopic display screen as an example and specifically elaborate on the display method provided by the embodiments of the present application in combination with the accompanying drawings.
[0102] Figure 4 shows a set of GUIs, where, from Figure 4 (a) in Figure 4(G) in it shows the specific process of bonsai cultivation that can be displayed on the stereoscopic display screen.
[0103] Refer to Figure 4 the GUI shown in (a) in it. This GUI is the main interface of the stereoscopic display screen. This main interface includes "xxxxx", which can correspond to a logo or an image, without limitation. It should be understood that this main interface is only an example and should not impose special limitations on this application. When the stereoscopic display screen detects the operation of the user clicking the icon 301 of the floating window on the main interface, the bonsai cultivation application can be launched, and the GUI shown in Figure 4 (b) in it can be displayed. This GUI can be called the bonsai cultivation interface.
[0104] Refer to Figure 4 the GUI shown in (b) in it. The interface displays the interactive menu display module. When the stereoscopic display screen detects the operation of the user clicking the icon 302 of the drop-down menu corresponding to the interactive menu display module, the GUI shown in Figure 4 (c) in it can be displayed.
[0105] Refer to Figure 4 the GUI shown in (c) in it. The interface also displays the bonsai generation module, the bonsai growth information module, the bonsai management module, the interactive data statistics module, the environmental data statistics module, and the AI text-to-bonsai module. Among them, the bonsai generation module is used to generate bonsai; the bonsai growth information module is used for the user to understand the growth status of the bonsai so that the user can take corresponding actions according to the growth status; the bonsai management module is used for the user to manage the bonsai; the interactive data statistics module is used for the user to understand the interactive information; the environmental data statistics module is used for the user to understand the current environmental information; the AI text-to-bonsai module is used to generate corresponding text (such as poems, etc.). When the stereoscopic display screen detects the operation of the user clicking the icon 303 of the drop-down menu corresponding to the bonsai generation module, the GUI shown in Figure 4 (d) in it can be displayed.
[0106] Refer to Figure 4 the GUI shown in (d) in it. The interface also displays the tree species, style, specification, bonsai form, and background. Among them, the tree species include ginkgo, magnolia, pine, cypress, etc.; the style includes traditional, Chinese, Japanese, etc.; the specification includes large, medium, small, etc.; the bonsai form includes straight trunk type, inclined trunk type, double trunk type, etc.; the background includes natural environment and indoor environment, etc. It should be understood that Figure 4 the parameters shown in (d) in it are only examples. In the actual scenario, there may be more options, which should not impose special limitations on this application. The user can determine the parameters of the bonsai to be cultivated according to their own needs. Refer to Figure 4In (d), the user selects pine tree, Chinese style, medium, slanting trunk style, and natural environment; after the user finishes selecting the parameters, the user can further click the "OK" function button; if the user does not want to cultivate the bonsai, the user can click the "Cancel" function button. When the stereoscopic display screen detects the operation of the user clicking the "Cancel" function button 304, it returns to display the GUI as shown in Figure 4 in (c). When the stereoscopic display screen detects the operation of the user clicking the "OK" function button 305, it displays the GUI as shown in Figure 4 in (e).
[0107] Refer to Figure 4 the GUI shown in (e). The interface shows a pine tree with a slanting trunk style. It can be seen that Figure 4 in the GUI shown in (e), two pine trees at different angles are shown on the front and the right side (the left side and the back are not shown. In the actual scenario, pine trees at different angles will be shown on the front, the right side, the left side, and the background). Thus, the user can appreciate pine trees at different angles, enhancing the user experience.
[0108] After the bonsai is planted, the user can manage it by watering, fertilizing, etc. to enable the normal growth of the bonsai. After the bonsai grows for a period of time, if the user hopes to query the growth information of the bonsai, it can be achieved through the above-mentioned bonsai growth information module. For example, referring to the above Figure 4 in (a) to Figure 4 in (b), the action is shown as the GUI shown in Figure 4 in (g). When the stereoscopic display screen detects the operation of the user clicking the icon 308 of the drop-down menu corresponding to the bonsai growth information module, it displays the GUI shown in Figure 4 in (h).
[0109] Refer to Figure 4 the GUI shown in (h). The interface shows the bonsai size, bonsai shape, presence or absence of mosquitoes in the bonsai, moisture of the bonsai, presence or absence of withered leaves in the bonsai, fertilizer of the bonsai, etc. The user can click any function button to understand the current state of the bonsai. When the stereoscopic display screen detects the operation of the user clicking the "Bonsai Size" function button 309, it displays the GUI shown in Figure 4 in (i). When the stereoscopic display screen detects the operation of the user clicking the "Bonsai Shape" function button 310, it displays the GUI shown in Figure 4 in (j).
[0110] Refer to Figure 4 the GUI shown in (i). The interface shows "medium", that is, the bonsai size is relatively appropriate.
[0111] Refer to Figure 4The GUI shown in (j) of [reference] shows "slant dry style", which means the bonsai is in the slant dry style.
[0112] After the stereoscopic display screen detects the user's operation of clicking the function button 311 of "whether there are mosquitoes in the bonsai", if there are no mosquitoes in the bonsai currently, the GUI shown in Figure 4 (k) of [reference] is displayed. If there are mosquitoes in the bonsai currently, the GUI shown in Figure 4 (l) of [reference] is displayed.
[0113] Refer to Figure 4 The GUI shown in (k) of [reference], the interface shows "none", indicating that there are no mosquitoes in the current bonsai, and the user can not perform further operations on the bonsai.
[0114] Refer to Figure 4 The GUI shown in (l) of [reference], the interface shows "yes", indicating that there are mosquitoes in the current bonsai, then the mosquitoes may be harmful to the growth of the bonsai, and the user can perform pest control operations on the bonsai. The user can click the drop-down menu corresponding to the bonsai growth information module. After the stereoscopic display screen detects the user's operation of clicking the icon 313 of "the drop-down menu corresponding to the bonsai growth information module", the GUI shown in Figure 4 (m) of [reference] is displayed.
[0115] Refer to Figure 4 The GUI shown in (m) of [reference], the user can further click the drop-down menu corresponding to the bonsai management module. After the stereoscopic display screen detects the user's operation of clicking the icon 314 of "the drop-down menu corresponding to the bonsai management module", the GUI shown in Figure 4 (n) of [reference] is displayed.
[0116] Refer to Figure 4 The GUI shown in (n) of [reference], the interface shows multiple options, including pest control, fertilization, watering, pruning, changing the scene, changing the style, etc. After the stereoscopic display screen detects the user's operation of clicking the function button 315 of "pest control", the GUI shown in Figure 4 (o) of [reference] is displayed. Comparing Figure 4 (o) of [reference] with Figure 4 (l) of [reference], it can be seen that the bugs in the bonsai have been cleared.
[0117] Referring to the above Figure 4 (h) of [reference], after the stereoscopic display screen detects the user's operation of clicking the icon 312 of "the moisture of the bonsai", if the bonsai has sufficient moisture, the GUI shown in Figure 4 (p) of [reference] is displayed. If the bonsai lacks moisture, the GUI shown in Figure 4 (q) of [reference] is displayed.
[0118] Refer to Figure 4The GUI shown in (p) in it shows "sufficient", indicating that the moisture in the current bonsai is sufficient, and the user can refrain from further operations on the bonsai.
[0119] See Figure 4 The GUI shown in (q) in it shows "insufficient", indicating that the moisture in the current bonsai is insufficient, and the user can water the bonsai. The user can click the drop-down menu corresponding to the bonsai growth information module. After the three-dimensional display screen detects the operation of the user clicking the icon 316 of the drop-down menu corresponding to the "bonsai growth information module", the displayed GUI is as shown in Figure 4 the GUI shown in (r) in it.
[0120] See Figure 4 the GUI shown in (r) in it. The user can further click the drop-down menu corresponding to the bonsai management module. After the three-dimensional display screen detects the operation of the user clicking the icon 317 of the drop-down menu corresponding to the "bonsai management module", the displayed GUI is as shown in Figure 4 the GUI shown in (s) in it.
[0121] See Figure 4 the GUI shown in (s) in it. The interface shows multiple options, including pest control, fertilization, watering, pruning, changing the scene, changing the style, etc. After the three-dimensional display screen detects the operation of the user clicking the function button 318 of "watering", the displayed GUI is as shown in Figure 4 the GUI shown in (t) in it.
[0122] See Figure 4 the GUI shown in (t) in it. It can be seen that the bonsai is in a watering state. In this way, the bonsai can obtain sufficient moisture, which is beneficial to the normal growth of the bonsai.
[0123] In addition, in some embodiments, see Figure 4 the GUI shown in (u) in it. The user further selects the scene where the bonsai is located. After the three-dimensional display screen detects the operation of the user clicking the function button 319 of "changing the scene", the displayed GUI is as shown in Figure 4 the GUI shown in (v) in it.
[0124] See Figure 4 the GUI shown in (v) in it. The interface also shows "change to indoor scene". After the three-dimensional display screen detects the operation of the user clicking the function button 320 of "change to indoor scene", the displayed GUI is as shown in Figure 4 the GUI shown in (w) in it.
[0125] See Figure 4 the GUI shown in (w) in it. It can be seen that the bonsai is in an indoor environment.
[0126] In addition, in some embodiments, see Figure 4 In the GUI shown by (x) in [reference], the user can further view the number of interactions. When the stereoscopic display screen detects the operation of the user clicking on the icon 321 of the "dropdown menu corresponding to the interaction data statistics module", it displays the GUI as shown by Figure 4 (y) in [reference].
[0127] See Figure 4 In the GUI shown by (y) in [reference], the interface displays: the number of interactions xx times, the number of watering times a times, the number of fertilizing times b times, the number of pest control times c times, the number of pruning times d times, the number of background replacement times d times, and the number of style replacement times e times. Thus, the user can clearly understand the number of times of managing this bonsai.
[0128] In addition, in some embodiments, see Figure 4 In the GUI shown by (z) in [reference], the user can further view the environmental status. When the stereoscopic display screen detects the operation of the user clicking on the icon 322 of the "dropdown menu corresponding to the environmental data statistics module", it displays the GUI as shown by Figure 4 (A) in [reference].
[0129] See Figure 4 In the GUI shown by (A) in [reference], the interface displays: temperature: t °C, humidity: rh, light intensity: p (cd), soil quality: excellent, air quality: excellent. Thus, the user can clearly understand the current environmental status of this bonsai.
[0130] In addition, the user can also configure corresponding text for this bonsai. For example, referring to Figure 4 In the GUI shown by (B) in [reference], the interface displays multiple modules, including the AI text-to-bonsai module. When the stereoscopic display screen detects the operation of the user clicking on the icon 323 of the "AI text-to-bonsai module", it displays the GUI as shown by Figure 4 (C) in [reference].
[0131] See Figure 4 In the GUI shown by (C) in [reference], the interface displays the corresponding text: xxxxxx, xxxxxx. Thus, the user experience can be enhanced.
[0132] In addition, the image of the bonsai displayed on the stereoscopic display screen can move as the user's eyes move. For example, referring to Figure 4 In the GUI shown by (D) in [reference], the interface displays a slanting-trunk pine tree. It can be seen that Figure 4 In the GUI shown by (D) in [reference], the front and the right side display two pine trees at different angles (the left side and the back are not shown. In the actual scenario, the front, the right side, the left side, and the background will all display pine trees at different angles).
[0133] When the user's eyeballs move in the direction indicated by the arrow in the x direction, in one implementation, the image of the bonsai in the stereoscopic display screen moves to the right as a whole, and in another implementation, the stereoscopic display screen rotates counterclockwise as a whole. When the stereoscopic display screen detects that the user's eyeballs move in the direction indicated by the arrow in the x direction, it displays the GUI shown in (E) of Figure 4 or the GUI shown in (F) of Figure 4 .
[0134] Comparing Figure 4 the GUI shown in (E) of Figure 4 with the GUI shown in (D) of Figure 4 , it can be seen that Figure 4 in the GUI shown in (E) of Figure 4 , the image of the bonsai in the GUI is shifted to the right as a whole compared to Figure 4 the image of the bonsai in the GUI shown in (D) of Figure 4 . Comparing Figure 4 the GUI shown in (F) of
[0135] with the GUI shown in (D) of Figure 4 , it can be seen that Figure 4 in the GUI shown in (F) of Figure 4 , the image of the bonsai in the GUI does not change, but the stereoscopic display screen rotates as a whole. It should be understood that the scheme of rotating the stereoscopic display screen as a whole can be implemented under certain conditions, such as when the stereoscopic display screen is set on a rotatable chassis or a rotating shaft.
[0135] When the user approaches or moves away from the stereoscopic display screen, the size of the image of the bonsai in the stereoscopic display screen will also change accordingly. For example, when the stereoscopic display screen detects that the user's eyeballs move away from itself, it displays the GUI shown in (G) of Figure 4 . Comparing Figure 4 the GUI shown in (G) of Figure 4 with the GUI shown in (D) of Figure 4 , it can be seen that Figure 4 in the GUI shown in (G) of
[0136] the image of the bonsai in the GUI is smaller as a whole compared to Figure 4 the image of the bonsai in the GUI shown in (D) of
[0137] It should be noted that in Figure 4In the GUI shown, when the user clicks on a certain icon or a certain function button and then does not operate for a long time, the stereoscopic display screen automatically returns to the main interface. For example, in the GUI shown in (d) of the above Figure 4 , if the user does not select the corresponding parameters for a long time or does not click the function button corresponding to "Cancel" or "OK" for a long time, the stereoscopic display screen returns to display the GUI shown in (a) of Figure 4 . And, usually, Figure 4 the floating window in the GUI shown in (a) can be hidden to provide a better viewing experience for the user.
[0138] Figure 5 shows another group of GUIs. Among them, from (a) in Figure 5 to (f) in Figure 5 shows the specific process of the user using the mobile phone for bonsai cultivation.
[0139] Refer to Figure 5 the GUI shown in (a). This GUI is the desktop of the mobile phone. When the mobile phone detects the operation of the user clicking on the icon 401 of the first application on the desktop, the bonsai cultivation application can be started, and the GUI shown in (b) of Figure 5 is displayed. This GUI can be called the bonsai cultivation interface.
[0140] Refer to Figure 5 the GUI shown in (b). The interface displays an interactive menu display module. When the mobile phone detects the operation of the user clicking on the icon 402 of the drop-down menu of the interactive menu display module, the GUI shown in (c) of Figure 5 is displayed.
[0141] Refer to Figure 5 the GUI shown in (c). The interface also displays a bonsai generation module, a bonsai growth information module, a bonsai management module, an interactive data statistics module, an environmental data statistics module, and an AI text-to-bonsai module. Among them, the bonsai generation module is used to generate bonsai; the bonsai growth information module is used for the user to understand the growth state of the bonsai so that the user can perform corresponding actions according to the growth state; the bonsai management module is used for the user to manage the bonsai; the interactive data statistics module is used for the user to understand the interactive information; the environmental data statistics module is used for the user to understand the current environmental information; the AI text-to-bonsai module is used to generate corresponding text. When the mobile phone detects the operation of the user clicking on the icon 403 of the drop-down menu corresponding to the bonsai generation module, the GUI shown in (d) of Figure 5 is displayed.
[0142] Refer to Figure 5The GUI shown in (d) of also displays tree species, styles, specifications, bonsai forms, and backgrounds. Among them, tree species include ginkgo, magnolia, pine, cypress, etc.; styles include traditional, Chinese, Japanese, etc.; specifications include large, medium, small, etc.; bonsai forms include straight trunk type, inclined trunk type, double trunk type, etc.; backgrounds include natural environment and indoor environment, etc. It should be understood that Figure 5 The parameters shown in (d) of are only examples. In actual scenarios, there may also be more options. Users can determine the parameters of the cultivated bonsai according to their own needs. Refer to Figure 5 In (d) of . Suppose the user selects pine, Chinese style, medium, inclined trunk type, and natural environment; after the user selects the parameters, the user can further click the function button "OK"; if the user does not want to cultivate a bonsai, the user can click the function button "Cancel". When the mobile phone detects the operation of the user clicking the function button 404 "Cancel", it returns to display the GUI shown in Figure 5 (c) of . When the mobile phone detects the operation of the user clicking the function button 405 "OK", it displays the GUI shown in Figure 5 (e) of .
[0143] Refer to Figure 5 The GUI shown in (e) of . The interface displays an inclined trunk type pine tree. The mobile phone is connected to the Figure 4 shown three-dimensional display screen, so that the inclined trunk type pine tree can be displayed in the Figure 4 shown three-dimensional display screen. Specifically refer to Figure 4 (e) of . As shown in Figure 4 (e) of . In the three-dimensional display screen, two different angles of the pine tree are shown on the front and right sides (the left side and the back are not shown. In actual scenarios, different angles of the pine tree will be shown on the front, right side, left side, and background). Thus, the user can appreciate the pine tree from different angles.
[0144] When the mobile phone detects the operation of the user clicking the icon 406 of the drop-down menu of the interactive menu display module, it displays the GUI shown in Figure 5 (f) of . The subsequent steps are similar to those in Figure 4 above, the difference is that Figure 5 the scheme shown in Figure 4 copies or migrates the functions of each module displayed on the
[0145] the above Figure 5The solution shown can be applied to a stereoscopic display screen and a mobile phone, or, applied to a stereoscopic display screen, a server, and a mobile phone. When this solution is applied to a stereoscopic display screen and a mobile phone, a processor with better performance can be set in the stereoscopic display screen. This processor can perform corresponding actions. The mobile phone is associated with the stereoscopic display screen, and the user can manage the bonsai in the stereoscopic display screen through the mobile phone. When this solution is applied to a stereoscopic display screen, a server, and a mobile phone, a processor may not be set in the stereoscopic display screen or a processor with lower performance may be set. The server independent of the display screen can perform corresponding actions. The mobile phone is associated with the stereoscopic display screen, and the user can manage the bonsai in the stereoscopic display screen through the mobile phone, thus realizing remote bonsai management by the user and avoiding the phenomenon that the bonsai withers due to the user's inability to manage the bonsai closely for a long time. Thereby, the possibility of the normal growth of the bonsai can be increased.
[0146] Similarly, in Figure 5 the solution shown, the stereoscopic display screen communicates with other devices and can communicate through, for example, IoT technology.
[0147] It should be noted that the above Figure 4 and Figure 5 Although the process of cultivating bonsai through a stereoscopic display screen is introduced by taking the bonsai image as an example. In some possible scenarios, the stereoscopic display screen can also display other images, such as animal images, and the user can directly participate in the growth process of the animals through the stereoscopic display screen. When this application is applied to animal breeding, the bonsai generation module in the stereoscopic display screen can be replaced with an animal generation module, and the bonsai management module can be replaced with an animal management module, etc.
[0148] The following takes a stereoscopic display screen and a server as examples and, in combination with the attached Figure 6 details the generation and management process of the bonsai displayed through the stereoscopic display screen.
[0149] Figure 6 It is a schematic diagram of a display method 600 provided by an embodiment of the present application. This method 600 may include steps 610 to 636.
[0150] 610, The stereoscopic display screen receives parameters input by the user.
[0151] In this step 610, the parameters input by the user may be, for example, those shown in (d) of the above Figure 4 : pine tree, Chinese style, medium, slanting dry style, natural environment, etc.
[0152] 612, The stereoscopic display screen sends the parameters to the server.
[0153] 614, The server generates a corresponding 3D bonsai image according to the parameters.
[0154] In the embodiments of the present application, the server generates corresponding 3D bonsai images according to parameters, which can be specifically generated by the AI bonsai generation module according to the bonsai generation model. Before generating the 3D bonsai images, the AI bonsai generation module first performs data preparation and model training. Among them, data preparation includes data collection, data annotation, and data augmentation. Data collection refers to collecting a large number of high-quality bonsai images to ensure that the data covers different tree species (such as ginkgo, locust tree, pine tree, willow tree, cypress tree, etc.), bonsai forms (such as straight trunk type, inclined trunk type, double trunk type, etc.), backgrounds (natural environment, indoor environment), and styles (such as traditional, Chinese, Japanese, etc.); data annotation refers to classifying and annotating images, including type information such as tree species, style, form, and color; data augmentation refers to using image enhancement techniques (such as rotation, flipping, cropping, brightness adjustment, etc.) to expand the scale of the dataset.
[0155] The following first combines Figure 7 to illustrate the training process of the bonsai generation model. Figure 7 The method shown includes steps 710 to 732.
[0156] 710, Text input.
[0157] For example, input the text for annotating the images in the above data annotation into the bonsai generation model.
[0158] 712, Image input.
[0159] For example, input the bonsai images collected in the above data collection into the bonsai generation model, and input the enhanced bonsai images in the data augmentation into the bonsai generation model.
[0160] 714, Parameter selection.
[0161] For example, parameters required during the model training process, such as the size of the model.
[0162] 716, Determine whether there is an image input.
[0163] If so, execute step 718; if not, return to execute step 712.
[0164] 718, Extract features from the image. For example, an image feature extraction model can be used to extract features from the image to obtain an image feature vector.
[0165] 720, Determine whether there is a text input.
[0166] If so, execute step 722; if not, return to execute step 710.
[0167] 722, Convert the text into a vector representation.
[0168] Specifically, for example, the text can be tokenized first, and then the tokenized text can be input into a Bidirectional Encoder Representations From Transformers (BERT) model. It will output the context vector representation of each word in the sentence. By appropriately processing these vectors (such as taking the average value, pooling, etc.), the vector representation of the entire text can be obtained.
[0169] 724, combine the vector with the extracted image features to generate an image.
[0170] For example, the image feature vector and the text vector can be concatenated to form a new vector.
[0171] 726, input the docked image into a generative adversarial network.
[0172] In the embodiments of the present application, the generative adversarial network consists of a Generator and a Discriminator. The role of the Generator is to generate an image according to the input random noise or other conditions, and the Discriminator is responsible for judging whether the input image is a real image or a fake image generated by the Generator. During the training process, the Generator and the Discriminator conduct an adversarial game. The Generator continuously adjusts its own parameters to make the generated image more realistic, so as to deceive the Discriminator; the Discriminator also continuously optimizes to better distinguish between real images and fake images. Through this adversarial training, the Generator can gradually generate high-quality images that are indistinguishable from real images.
[0173] 728, determine whether the generated image is real.
[0174] If so, execute step 730; if not, return to execute step 724.
[0175] 730, optimize the image parameters and refine the image with style transfer technology.
[0176] For example, change the style of the image, and the styles of the image include natural, fresh, retro, black and white, etc.
[0177] 732, generate the final image.
[0178] By executing Figure 7 the shown process, a relatively mature bonsai generation model can be obtained. Then, the server can input the parameters received in step 612 above into the bonsai generation model, and a corresponding 2D bonsai image can be obtained. Furthermore, the 2D bonsai image can be converted into a 3D bonsai image by using a conversion algorithm.
[0179] Among them, when the server converts the 2D bonsai image into a 3D bonsai image using the conversion algorithm, it can be achieved through the following process. Specifically, after receiving the parameters, the server first samples the Ntot viewport images according to the number of viewports Ntot required for synthesizing the stereoscopic image by the stereoscopic display screen and the resolution HxV. The vertical resolution of each viewport image is sampled into V / v, and the horizontal resolution is sampled into H / h, where Ntot≥2, vxh = Ntot, and v takes the integer value closest to Then, the RGB components of the Ntot sampled viewport images are filled into the RGB components of the stereoscopic image to obtain the required stereoscopic image. Among them, the number of viewports Ntot required for the stereoscopic display screen to synthesize the stereoscopic image and the resolution HxV can be sent to the server in advance so that the server can generate a 3D bonsai image according to this parameter.
[0180] In the embodiment of the present application, the reason why v takes the integer value closest to is that on the one hand, it is based on the generality of the synthesis algorithm, and on the other hand, the values of v and h are close, making the visual effect of the synthesized stereoscopic image the best. If the original horizontal resolution of the Ntot viewport images is greater than H / h, horizontal downsampling (i.e., reducing the image) is required, otherwise horizontal upsampling (i.e., enlarging the image) is performed; if the original vertical resolution of the Ntot viewport images is greater than V / v, vertical downsampling is required, otherwise vertical upsampling is performed.
[0181] In the above steps, filling the RGB components of the Ntot sampled viewport images into the RGB components of the stereoscopic image may specifically include:
[0182] (a) According to the optical formula (1), calculate the number X of RGB sub-pixels on the LCD display screen covered by the grating pitch of the prism grating in the horizontal direction.
[0183] X = Px * ppI
[0184] Px = P * Cosα (1)
[0185] P = m / k
[0186] Among them, as Figure 8 shown, X is the number of RGB sub-pixels, Px is an intermediate parameter, PPI is the pixel density, P is the grating pitch, α is the inclination angle, m is the screen size, and k is the number of lines.
[0187] (b) According to formulas (2) and (3), calculate the mapping table corresponding to the RGB components of the Ntot viewport images and the RGB components of the stereoscopic image.
[0188] Specifically, for the vertical direction, let the number of rows of the stereoscopic image be V, and the number of rows of the viewpoint image be V / v. For any row y of the stereoscopic image s , the corresponding row number y of the viewpoint image n can be determined by formula (2).
[0189]
[0190] Wherein, represents rounding down. This formula means that every v rows of the stereoscopic image correspond to 1 row of the viewpoint image.
[0191] For the horizontal direction, let the number of RGB components per row of the stereoscopic image be 3H (because each pixel has three RGB components), and the number of RGB components per row of the viewpoint image be 3H / h. For the RGB components x of a certain row in the stereoscopic image s , the position of the corresponding RGB component in the viewpoint image can be determined by formula (3).
[0192]
[0193] Wherein, mod is the modulo operation. This formula (3) means that every 3h RGB components in each row of the stereoscopic image correspond to one RGB component of the viewpoint image, and the cyclic correspondence is achieved through the modulo operation until all RGB components of the stereoscopic image are filled.
[0194] Thus, through formula (2) and formula (3), the mapping relationship (i.e., the mapping table) between each RGB component in the stereoscopic image and the RGB components in the Ntot viewpoint images can be determined, as shown in Table 1.
[0195] Table 1
[0196]
[0197] (c) According to the mapping table, fill the RGB components of the Ntot viewpoints into the RGB components of the stereoscopic image.
[0198] In the embodiment of the present application, for every v columns of RGB components of the stereoscopic image, use every 1 column of RGB components of the Ntot viewpoint images to fill. That is to say, the RGB components of the 1st to vth columns of the stereoscopic image correspond to the RGB components of the 1st column of the Ntot viewpoint images, the RGB components of the (v + 1)th to 2vth columns of the stereoscopic image correspond to the RGB components of the 2nd column of the Ntot viewpoint images, and so on.
[0199] For the RGB components in each row of the stereoscopic image, every 3h RGB components are filled with the RGB components of each of the Ntot viewpoint images until all the RGB components of the stereoscopic image are filled with the RGB components of the Ntot viewpoint images. That is to say, the 1st to 3h RGB components in a certain row of the stereoscopic image are filled with the 1st RGB components corresponding to the Ntot viewpoint images, the 3h + 1 to 6h RGB components in the same row of the stereoscopic image are filled with the 2nd RGB components corresponding to the Ntot viewpoint images, and so on until all the RGB components of the stereoscopic image are filled with the RGB components of the Ntot viewpoint images.
[0200] For example, taking Ntot = 9 as an example, then v = h = 3. Thus, the RGB components in the 1st to 3rd columns of the stereoscopic image correspond to the RGB components in the first column of the 9 viewpoint images, and the RGB components in the 4th to 6th columns of the stereoscopic image correspond to the RGB components in the 2nd column of the 9 viewpoint images. That is, for the 1st column of the stereoscopic image, it corresponds to the RGB components in the first column of the 1st viewpoint image; for the 2nd column of the stereoscopic image, it corresponds to the RGB components in the first column of the 2nd viewpoint image; for the 3rd column of the stereoscopic image, it corresponds to the RGB components in the first column of the 3rd viewpoint image; for the 4th column of the stereoscopic image, it corresponds to the RGB components in the second column of the 1st viewpoint image; for the 5th column of the stereoscopic image, it corresponds to the RGB components in the second column of the 2nd viewpoint image; for the 6th column of the stereoscopic image, it corresponds to the RGB components in the second column of the 3rd viewpoint image; and so on.
[0201] The 1st to 9th RGB components in a certain row of the stereoscopic image are filled with the 1st RGB components corresponding to the 9 viewpoint images, and the 10th to 18th RGB components in the same row of the stereoscopic image are filled with the 2nd RGB components corresponding to the 9 viewpoint images. That is, for the 1st RGB component in a certain row, it is filled with the 1st RGB component corresponding to the 1st viewpoint image, for the 2nd RGB component in this row, it is filled with the 1st RGB component corresponding to the 2nd viewpoint image, for the 3rd RGB component in this row, it is filled with the 1st RGB component corresponding to the 3rd viewpoint image,...; for the 10th RGB component in this row, it is filled with the 2nd RGB component corresponding to the 1st viewpoint image, for the 11th RGB component in this row, it is filled with the 2nd RGB component corresponding to the 2nd viewpoint image, for the 13th RGB component in this row, it is filled with the 2nd RGB component corresponding to the 3rd viewpoint image,...; and so on.
[0202] 616. The server sends a 3D bonsai image to the stereoscopic display screen, or sends multiple bonsai images at different angles. Correspondingly, the stereoscopic display screen receives the 3D bonsai image or multiple bonsai images at different angles, or rather, the stereoscopic display screen downloads the 3D bonsai image or multiple bonsai images at different angles.
[0203] As described above, the three-dimensional display screen includes a material download component, which is used to download corresponding bonsai images. The material download component includes:
[0204] ①. Download Manager: The core of the component, responsible for scheduling and executing download tasks, including adding, pausing, resuming, deleting download tasks, and listening to progress, etc.
[0205] ②. Download Task: Represents a download task, including the Uniform Resource Locator (URL) of the image material, the target file path, download progress, status, etc.
[0206] ③. Download Runnable: Executed through a thread pool, and uses the Http URL Connection to make actual network requests and data downloads.
[0207] ④. Download Service: Used to ensure that downloads can continue in the background and guarantee the execution of download tasks.
[0208] ⑤. Download Status: Uses the Android Live Data method to update the download progress status in real time.
[0209] ⑥. Retry Download: Handles download failures caused by network exceptions during the download process, and sets the number of retry downloads and the interval time.
[0210] In the embodiment of the present application, the number of bonsai images specifically sent by the server to the three-dimensional display screen is related to the number of faces of the three-dimensional display screen. For example, if the three-dimensional display screen is a cuboid, the server can send 4 bonsai images at different angles to the three-dimensional display screen, such as the GUI shown in (e) above; if the three-dimensional display screen is a prism, such as a hexagonal prism, the server can send 6 bonsai images at different angles to the three-dimensional display screen. Figure 4 As shown in (e) above; if the three-dimensional display screen is a prism, such as a hexagonal prism, the server can send 6 bonsai images at different angles to the three-dimensional display screen.
[0211] The three-dimensional display screen can send the number of its own screens to the server. This action can be executed when the three-dimensional display screen establishes a connection with the server, or when the three-dimensional display screen requests the server to generate bonsai images, without limitation.
[0212] In some embodiments, if the stereoscopic display screen is a cuboid, the server may send 6 bonsai images at different angles to the stereoscopic display screen, including 4 side faces, 1 top face, and 1 bottom face; if the stereoscopic display screen is a prism, such as a hexagonal prism, the server may send 8 bonsai images at different angles to the stereoscopic display screen, including 6 side faces, 1 top face, and 1 bottom face.
[0213] 618, the stereoscopic display screen displays the bonsai images on each screen according to the 3D bonsai image or multiple bonsai images at different angles.
[0214] In the embodiments of the present application, when the stereoscopic display screen receives the 3D bonsai image, the stereoscopic display screen may determine multiple bonsai images at different angles therefrom according to the 3D bonsai image, and display the bonsai images at different angles on different display screens.
[0215] When the stereoscopic display screen receives multiple bonsai images at different angles, the stereoscopic display screen may simply display these multiple different bonsai images on different display screen surfaces respectively.
[0216] As described above, the stereoscopic display screen includes a multi-screen image rendering component, and the multi-screen image rendering component includes a Display Manager, a Presentation, a GL Surface View, and an Open GL ES for an embedded system.
[0217] In a specific implementation, the Display Manager obtains the respective IDs of the stereoscopic display screen, the Presentation outputs the image to be rendered to the stereoscopic display screen, and the GL Surface View renders each image. The technology used during rendering may be, for example, Open GL ES.
[0218] In addition, in some embodiments, gratings are provided on multiple faces of the stereoscopic display screen. A grating is an optical device composed of a large number of parallel slits with equal width and equal spacing. Through the grating, a vivid three-dimensional world can be displayed on a plane. Thus, when a user views the bonsai through multiple faces of the stereoscopic display screen, the bonsai displayed on these multiple faces gives the user a three-dimensional sense, which can enable the user to have the feeling of actually planting a bonsai by themselves, further enhancing the user experience.
[0219] 620, when the stereoscopic display screen detects that the parameters of the bonsai have changed or detects a user operation, it sends information A to the server.
[0220] Among them, the parameters here may include leaves, bugs, temperature, humidity, etc. Changes in the parameters can be, for example, yellowing of the leaves, appearance of pests, too high temperature, too high humidity, etc. For example, when the stereoscopic display screen detects withered leaves in the bonsai, or when the stereoscopic display screen detects that the user clicks the trimming option, it sends information A to the server; this information A is used to instruct the server to trim the withered leaves.
[0221] For another example, when the stereoscopic display screen detects that the temperature of the environment where the bonsai is located is too high, or when the stereoscopic display screen detects that the user clicks the watering option, it sends information A to the server, and this information A is used to instruct the server to water the bonsai.
[0222] Fig. 9 Shows a variety of possible events. Among them, it includes sensor events, interaction events, and random events.
[0223] Sensor events include time interval events, light parameter events, temperature parameter events, and humidity parameter events. Interaction events include pest control events, fertilization events, watering events, pruning events, scene replacement events, style replacement events. Random events include random germination / new leaf events, random leaf fall events. After these events occur, it may trigger AI image optimization generation, that is, trigger the server to execute corresponding actions to generate a new bonsai image.
[0224] 622, the server performs corresponding actions on the bonsai according to the information.
[0225] In the embodiment of the present application, for example, if the information is used to instruct trimming of withered leaves, then after the server cuts off the withered leaves, it generates a new 3D bonsai image.
[0226] For another example, if the information is used to instruct watering, then the server waters the bonsai, as shown in the GUI of (t) above. Before and after watering the bonsai, the leaves of the bonsai may change, so that the server can generate a new 3D bonsai image. Figure 4 As shown in the GUI of (t) above, before and after watering the bonsai, the leaves of the bonsai may change, so that the server can generate a new 3D bonsai image.
[0227] 624, the server sends the new 3D bonsai image to the stereoscopic display screen, or sends multiple new bonsai images from different angles.
[0228] 626, the stereoscopic display screen displays the new bonsai image on each screen according to the new 3D bonsai image or multiple new bonsai images from different angles.
[0229] In the above embodiments, the number of servers may be one or multiple. When the number of servers is one, the above actions are performed by this server; when the number of servers is multiple, the performances of these multiple servers vary, so that a high-performance server (such as an algorithm server) can perform algorithm analysis, etc., and a low-performance server (such as a business server) can perform business processing.
[0230] The following combines Fig.10 to describe the interaction flowchart between multiple servers and a three-dimensional display screen when there are multiple servers.
[0231] Fig.10 shows a schematic diagram of a method for a server to regenerate a new bonsai image based on user triggering. Fig.10 The method shown includes steps 1010 to 1020.
[0232] 1010. The user triggers the option to trim withered leaves.
[0233] 1012. The three-dimensional display screen sends information indicating trimming withered leaves to the algorithm server.
[0234] 1014. The algorithm server analyzes the characteristics of the current bonsai image, determines the withered leaves, removes the withered leaves, and generates a new bonsai image.
[0235] 1016. The algorithm server sends the new bonsai image and the bonsai address to the business server.
[0236] It should be understood that in this embodiment, one algorithm server may be associated with multiple three-dimensional display screens. When there is a management requirement for the bonsai in a certain three-dimensional display screen, after the algorithm server performs corresponding management on this three-dimensional display screen, it can send the new bonsai image and the bonsai address of this three-dimensional display screen to the business server, so that the business server can accurately send the new bonsai image to the corresponding three-dimensional display screen.
[0237] 1018. The business server sends the new bonsai image to the three-dimensional display screen according to the bonsai address.
[0238] 1020. The three-dimensional display screen displays the new bonsai image.
[0239] Referring to Fig.10 , it can be seen that in the above process of removing withered leaves, the algorithm server removes the withered leaves and the business server sends the new bonsai image, so that part of the functions can be transferred to another server, thereby preventing the overall business from stagnating when the integrated server has lags or failures, and thus improving the efficiency and performance of bonsai management and further enhancing the user experience.
[0240] Fig.11Schematic diagram of a method for a server to regenerate a new bonsai image based on environmental triggers is shown. Fig.11 The method shown includes steps 1110 to 1122.
[0241] 1110, when the external environment changes, the stereoscopic display reports this event to the service server.
[0242] 1112, the service server combines the current image data and the reported sensor data. If the sensor data is in a steady state for a long time, new environmental parameters are generated.
[0243] 1114, the service server sends the new environmental parameters to the algorithm server.
[0244] 1116, a new bonsai image is generated according to the new environmental parameters.
[0245] 1118, the algorithm server sends the bonsai image and the bonsai address to the service server.
[0246] 1120, the service server sends the new bonsai image to the stereoscopic display according to the bonsai address.
[0247] 1122, the stereoscopic display shows the new bonsai image.
[0248] Reference Fig.11 , it can be seen that in the above process, the service server can determine whether to generate and send new environmental parameters according to the reported data, which can avoid the algorithm server from repeatedly generating new bonsai images. For example, when the external environment suddenly changes, but then returns to normal in a short time. If the external environment data is directly sent to the algorithm server, it will cause the algorithm server to repeatedly generate new bonsai images based on the external environmental parameters in a short time, thereby affecting the performance of the algorithm server. However, in the embodiments of the present application, the service server can determine whether to generate and send new environmental parameters according to the reported data. Therefore, it can avoid the algorithm server from repeatedly generating new bonsai images, thus preventing the reduction of the performance of the algorithm server.
[0249] In addition, in some embodiments, in 628, the stereoscopic display detects that the user clicks on the AI image to generate poem module and sends information B to the server.
[0250] Among them, the information B can be used to instruct the server to generate text, such as poems, based on the current bonsai image.
[0251] 630, the server generates corresponding text according to information B.
[0252] Specifically, the server can generate corresponding text based on Information B and the current bonsai image. For example, the server can first perform feature extraction on the image. For instance, it can use a Residual Neural Network (ResNet) model, or a Dense Connectivity Network (DenseNet) model, or a Mobile Neural Network (MobileNet), etc. to perform feature extraction on the image. Then, it maps the extracted features to the theme and emotional tone, and finally generates a poem that combines the image theme and emotion, such as using a natural language generation model.
[0253] Table 2 shows the relationship between a type of bonsai and the emotion or trait of the corresponding poem.
[0254] Table 2
[0255] Bonsai Types Corresponding emotions or traits Straight trunk bonsai of conifers Vitality, tranquility Willow bonsai by the water Freedom, vitality Plum blossom bonsai with slanted trunk Vitality, hesitation Banyan tree cliff bonsai Vitality, freedom Miscellaneous wood double trunk bonsai Tranquility, vitality
[0256] Optionally, in some embodiments, before generating the corresponding text, the server can also preprocess the bonsai image. The verification here can include, for example, adjusting the format and size to make the text generated by the server better match the corresponding bonsai.
[0257] 632. The server sends the text to the stereoscopic display screen.
[0258] 634. Display the text on at least one surface of the stereoscopic display screen. For example, the GUI shown in (C) above. Figure 4 as shown in the GUI in (C) above.
[0259] 636. The stereoscopic display screen detects a change in the user's eyes and refreshes the bonsai image. For example, the GUI shown in (E) above. Figure 4 as shown in the GUI in (E) above. Figure 4 as shown in the GUI in (G) above.
[0260] Specifically, as shown above. Figure 3 As shown, the stereoscopic display screen includes an eye tracking, a screen raster driving component, and a data processing and interaction component. Among them, the eye tracking component is mainly used to capture the user's eye movement, calculate the gaze point and movement trajectory. The raster driving component is mainly used to dynamically adjust the screen content according to the output of the eye tracking, and support fine-grained raster operations. The data processing and interaction component is used to link the raw data of the eye tracking with the raster driving module to achieve data stream processing and interaction feedback.
[0261] ① Eye tracking component
[0262] The key technologies include camera-based face recognition, eye feature point detection, and eye movement analysis.
[0263] Mainly rely on: the cross-platform computer vision library (OpenCV) or MediaPipe to provide eye tracking algorithms.
[0264] Android CameraX is used as the camera data source.
[0265] ②Raster driving component
[0266] Key technologies: Graphics rendering in the Android system (Canvas, OpenGL / ES), display refresh rate control.
[0267] Main dependencies: SurfaceView or TextureView is used as the rendering surface.
[0268] ③Data processing and interaction component
[0269] Key technologies: Event listening and data filtering.
[0270] The following combines Fig.12 Introduce the detailed process of the stereoscopic display changing based on the changes of the user's eyes. Fig.12 The method shown includes steps 1210 to 1222.
[0271] 1210, Camera initialization.
[0272] 1212, Facial detection.
[0273] In this step, the stereoscopic display can use MediaPipe or OpenCV for facial key point detection.
[0274] 1214, Eye feature extraction.
[0275] 1216, Gaze estimation.
[0276] In this step, the stereoscopic display can estimate the user's gaze point based on geometric methods. Alternatively, the stereoscopic display can also use other methods to estimate the user's gaze point, and this application does not make specific limitations.
[0277] 1218, Tracking optimization.
[0278] In this step, the stereoscopic display can use the Kalman filter smoothing algorithm to optimize the tracking accuracy. Alternatively, the stereoscopic display can also use other methods to optimize the tracking accuracy, and this application does not make specific limitations.
[0279] 1220, Rendering initialization.
[0280] In this step, the stereoscopic display can use SurfaceView to initialize the drawing environment.
[0281] 1222, Dynamic refresh.
[0282] In this step, the stereoscopic display screen can dynamically adjust the brightness of the stereoscopic display screen, or the size, position, etc. of the bonsai image according to the user's line of sight. For example, when the stereoscopic display screen detects that the user is moving away, it adjusts the stereoscopic display screen to become dimmer and adjusts the bonsai image on the stereoscopic display screen to become smaller; when the stereoscopic display screen detects that the user is approaching, it adjusts the stereoscopic display screen to become brighter and adjusts the bonsai image on the stereoscopic display screen to become larger. Another example is that when the stereoscopic display screen detects that the user is walking around it, it adjusts the position of the bonsai image on the stereoscopic display screen so that the user can better appreciate the scenery of the bonsai, thereby improving the user experience.
[0283] It should be noted that the above steps 1210 and 1220 can be executed simultaneously or not simultaneously, without limitation.
[0284] As Fig.13 shown, it is a schematic diagram of a display method provided by an embodiment of the present application. This method can be applied to stereoscopic display and a server, and this method can include steps 1310 to 1340.
[0285] 1310. The stereoscopic display screen sends the first information to the server in response to the user's first operation.
[0286] The first operation in the embodiment of the present application is an operation used to trigger the sending of the first information to the server. For example, this first operation can be the operation 303 above. The parameters included in the first information can be, for example, the parameters in step 612 above. Figure 4 The parameters included in the first information can be, for example, the parameters in step 612 above. Figure 6 in step 612.
[0287] 1320. The server generates the first image according to the first information.
[0288] For the specific generation process, reference can be made to the relevant content of step 614 above, which will not be elaborated here. Figure 6 in step 614 above, which will not be elaborated here.
[0289] 1330. The server sends the second information to the stereoscopic display screen.
[0290] 1340. The stereoscopic display screen displays images at different angles on multiple faces of the stereoscopic display screen according to the second information.
[0291] Optionally, in some embodiments, the first image is a first 3D bonsai image, and the second image is a 2D bonsai image at different angles corresponding to the first 3D bonsai image.
[0292] In the embodiments of the present application, a user can interact with a stereoscopic display screen. The user can perform operations on the stereoscopic display screen to select corresponding parameters. After the stereoscopic display screen receives the corresponding operations, it sends the parameters selected by the user to the server. The server generates a corresponding first image based on the parameters, and sends the first image or multiple images corresponding to different angles of the first image to the stereoscopic display screen. The stereoscopic display screen displays the corresponding bonsai image. In particular, when the first image is a bonsai image, it can enable the user to cultivate bonsai on the stereoscopic display screen, thereby solving problems such as difficult bonsai replacement and movement. Moreover, even if mosquitoes breed in the images displayed on the stereoscopic display screen, it will not affect the user's life, thus further improving the user experience.
[0293] Optionally, in some embodiments, gratings are provided on multiple surfaces of the stereoscopic display screen.
[0294] In this embodiment, a grating is also provided on the stereoscopic display screen, so that the bonsai displayed on the stereoscopic display screen gives the user a 3D stereoscopic feeling, enabling the user to have the feeling of actually planting bonsai by themselves.
[0295] Optionally, in some embodiments, the server generates the first image according to the first information, including: the server inputs the at least one parameter into an image generation model, and generates the first image based on the result output by the image generation model, and the image generation model is obtained through training.
[0296] Wherein, when the first image is a bonsai image, the image generation model is the bonsai generation model in the above embodiment.
[0297] Optionally, in some embodiments, the method further includes: the stereoscopic display screen sends third information to the server, and the third information is used to request the server to manage the first image; the server manages the first image according to the third information, and sends fourth information to the stereoscopic display screen, and the fourth information includes a third image or multiple fourth images, the third image is the image after managing the first image, and the multiple fourth images are images corresponding to different angles of the third image; the stereoscopic display screen deletes the image displayed according to the second information, and displays images with different angles on multiple surfaces of the stereoscopic display screen according to the fourth information.
[0298] The third information in the embodiments of the present application can be information A above Figure 6 The content included in the fourth information is the content in step 624 above Figure 6 The "management" performed by the server on the first image may include: pest control, watering, fertilizing, pruning, changing the scene, and changing the style.
[0299] In the embodiments of the present application, the server manages the first image according to the third information and sends the managed image to the stereoscopic display screen, so that the stereoscopic display screen displays a new image. In particular, when the first image is a bonsai image, the growth of the bonsai can be effectively managed through this solution, which is beneficial to the healthy growth of the bonsai.
[0300] Optionally, in some embodiments, the stereoscopic display screen sends the third information to the server, including: in response to the second operation of the user, the stereoscopic display screen sends the third information to the server.
[0301] The second operation in the embodiments of the present application is an operation that triggers the sending of the third information to the server. For example, the second operation may be the operation 317 of the GUI shown in (r) above, and Figure 4 the operation 318 of the GUI shown in (s) above. Figure 4
[0302] In the embodiments of the present application, the stereoscopic display screen sends the third information to the server based on the second operation of the user, which can enhance the user's sense of participation in cultivating bonsai and enable the user to have the feeling of actually growing bonsai by themselves.
[0303] Optionally, in some embodiments, the second operation includes at least one of the following: pest control operation, watering operation, fertilizing operation, pruning operation, scene replacement operation, style replacement operation.
[0304] Optionally, in some embodiments, the method further includes: the stereoscopic display screen tracks the user's eyes; and adjusts the brightness of the stereoscopic display screen according to the user's eyes, or adjusts the size and / or position of the image on the stereoscopic display screen.
[0305] Specifically, reference can be made to the GUI shown in (D) above ~ Figure 4 to the GUI shown in (G) above. Figure 4
[0306] In the embodiments of the present application, the stereoscopic display screen can adjust the brightness of the stereoscopic display screen according to the user's eyes, or adjust the size and / or position of the image on the stereoscopic display screen. For example, when the stereoscopic display detects that the user is moving away, that is, when the distance between the user's eyes and the stereoscopic display screen is gradually increasing, the brightness of the stereoscopic display screen is reduced and the image on the stereoscopic display screen is reduced. When the stereoscopic display detects that the user is approaching, that is, when the distance between the user's eyes and the stereoscopic display screen is gradually decreasing, the brightness of the stereoscopic display screen is increased and the image on the stereoscopic display screen is increased; for another example, when the stereoscopic display detects that the user is walking around it, that is, when the distance between the user's eyes and the stereoscopic display screen remains unchanged and the user's position changes, the position of the image on the stereoscopic display screen is adjusted so that the user can better view the image.
[0307] Optionally, in some embodiments, the method further includes: the stereoscopic display screen sending fifth information to the server, where the fifth information is used to request the server to generate corresponding text for the first image; the server generating text according to the fifth information and sending sixth information to the stereoscopic display screen, where the sixth information includes the text; the stereoscopic display screen displaying the text on at least one of the multiple faces according to the sixth information.
[0308] The fifth information in the embodiments of the present application may be, for example, the information B in the above Figure 6 , and the sixth information is the text in step 632 of Figure 6 .
[0309] In the embodiments of the present application, the server generates text according to the fifth information and sends the text to the stereoscopic display screen, so that the stereoscopic display screen displays the text, which is beneficial to improving the user's viewing experience.
[0310] Optionally, in some embodiments, the stereoscopic display screen sending the fifth information to the server includes: in response to the user's third operation, the stereoscopic display screen sending the fifth information to the server.
[0311] The third operation in the embodiments of the present application may be an operation that triggers sending the fifth information to the server. For example, the third operation may be the operation 323 of the GUI shown in (B) in the above Figure 4 .
[0312] In the embodiments of the present application, the stereoscopic display screen sending the fourth information to the server based on the user's third operation can enhance the user's sense of participation in cultivating bonsai, and thus is beneficial to improving the user's viewing experience.
[0313] Optionally, in some embodiments, the first information includes at least one parameter corresponding to the first image: tree species, form, size, style, background.
[0314] It can be understood that in order for the stereoscopic display screen or the server to implement the above functions, it includes corresponding hardware and / or software modules for executing each function. Combining the algorithm steps of each example described in the embodiments disclosed in this article, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the present application.
[0315] In this embodiment, the functional modules of the three-dimensional display screen or the server can be divided according to the above method examples. For example, each functional module can be corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is illustrative, only a logical function division, and there can be other division methods in actual implementation.
[0316] In the case of dividing each functional module corresponding to each function, Fig.14 FIG. shows a possible schematic composition of the electronic device 1400 involved in the above embodiment, as Fig.14 shown, the electronic device 1400 may include: a transceiver module 1410, a processing module 1420, and a display module 1430.
[0317] When the electronic device executes the method steps of the above three-dimensional display screen, the transceiver module 1410 can be used to support the electronic device 1400 to execute the above step 1310, etc., and / or for other processes of the technology described herein.
[0318] The display module 1430 can be used to support the electronic device 1400 to execute the above step 1340, etc., and / or for other processes of the technology described herein.
[0319] When the electronic device executes the method steps of the above server, the transceiver module 1410 can be used to support the electronic device 1400 to execute the above step 1330, etc., and / or for other processes of the technology described herein.
[0320] The processing module 1420 can be used to support the electronic device 1400 to execute the above step 1320, etc., and / or for other processes of the technology described herein.
[0321] It should be noted that all relevant contents of each step involved in the above method embodiment can be cited to the function description of the corresponding functional module, and will not be repeated here.
[0322] The electronic device provided in this embodiment is used to execute the method of the present application above, so the same effect as the above implementation method can be achieved.
[0323] In the case of adopting an integrated unit, the electronic device may include a processing module, a storage module, and a communication module. Among them, the processing module can be used to control and manage the actions of the electronic device. For example, it can be used to support the electronic device to execute the steps executed by the above respective units. The storage module can be used to support the electronic device to execute storing program codes and data, etc. The communication module can be used to support the communication of the electronic device with other devices.
[0324] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logic blocks, modules, and circuits described in connection with the disclosure of the present application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processing (DSP) and a microprocessor, and so on. The storage module can be a memory. The communication module can specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.
[0325] In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device involved in this embodiment can be a device with Figure 1 the structure shown.
[0326] Fig.15 Another possible schematic diagram of the composition of the electronic device 1500 involved in the above embodiment is shown. As Fig.15 shown, the electronic device 1500 can include a communication unit 1510, an input unit 1520, a processing unit 1530, an output unit (or also referred to as a display unit) 1540, a peripheral interface 1550, a storage unit 1560, a power supply 1570, a video decoder 1580, and an audio decoder 1590.
[0327] The communication unit 1510 is used to establish a communication channel so that the electronic device 1500 can be connected to a remote server through the communication channel and download media data from the remote server. The communication unit 1510 can include communication modules such as a WLAN module, a Bluetooth module, an NFC module, and a baseband module, as well as the corresponding radio frequency (RF) circuits of the communication modules, for performing wireless local area network communication, Bluetooth communication, NFC communication, infrared communication, and / or cellular communication system communication, such as wideband code division multiple access (W-CDMA) and / or high speed downlink packet access (HSDPA). The communication unit 1510 is used to control the communication of each component in the electronic device and can support direct memory access.
[0328] The input unit 1520 can be used to implement the interaction between the user and the electronic device and / or input information into the electronic device. In the specific implementation manner of the present application, the input unit can be a touch panel, or other human-computer interaction interfaces, such as physical input keys, microphones, etc., and can also be other external information acquisition devices, such as cameras, etc.
[0329] The processing unit 1530 is the control center of the electronic device. It can connect various parts of the entire electronic device through various interfaces and circuits. By running or executing software programs and / or modules stored in the storage unit, and by invoking data stored in the storage unit, it can execute various functions of the electronic device and / or process data.
[0330] The output unit 1540 includes, but is not limited to, an image output unit and a sound output unit. The image output unit is used to output text, pictures, and / or videos. In the specific implementation of this application, the touch panel adopted by the above input unit 1520 can also be used as the display panel of the output unit 1540. For example, when the touch panel detects a touch or proximity gesture operation on it, it transmits the information to the processing unit to determine the type of touch event. Subsequently, the processing unit provides corresponding visual output on the display panel according to the type of touch event. Although in Fig.15 the input unit 1520 and the output unit 1540 are implemented as two independent components to achieve the input and output functions of the electronic device, in some embodiments, the touch panel and the display panel can be integrated to achieve the input and output functions of the electronic device. For example, the image output unit can display various graphical user interfaces as virtual control components, including but not limited to windows, scroll bars, icons, and clipboards, for users to operate through touch.
[0331] The storage unit 1560 can be used to store software programs and modules. The processing unit executes various functional applications of the electronic device and realizes data processing by running the software programs and modules stored in the storage unit.
[0332] This embodiment also provides a computer storage medium. Computer instructions are stored in this computer storage medium. When these computer instructions run on an electronic device (such as the stereoscopic display screen or server in the above embodiment), the electronic device is enabled to execute the above-related method steps to implement the method in the above embodiment.
[0333] This embodiment also provides a computer program product. When this computer program product runs on a computer, the computer is enabled to execute the above-related steps to implement the method in the above embodiment.
[0334] In addition, the embodiment of this application also provides a device. This device can specifically be a chip, a component, or a module. The device can include a processor and a memory connected to each other. Among them, the memory is used to store computer execution instructions. When the device runs, the processor can execute the computer execution instructions stored in the memory so that the chip executes the methods in the above method embodiments.
[0335] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be elaborated here.
[0336] Through the description of the above embodiments, those skilled in the art can understand that for the convenience and conciseness of description, only the above-mentioned division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.
[0337] In several embodiments provided in this application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.
[0338] The unit described as a separated component may or may not be physically separated. The component displayed as a unit may be a physical unit or multiple physical units, that is, it may be located in one place, or it may be distributed to multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0339] In addition, each functional unit in each embodiment of this application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
[0340] When an integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to enable a device (which can be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the methods of the various embodiments of the present application. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs that can store program codes.
[0341] Those skilled in the art of the present technology can understand that the various operations, methods, steps, measures, and solutions in the processes discussed in the present application can be alternated, changed, combined, or deleted. Further, other steps, measures, and solutions in the various operations, methods, and processes discussed in the present application can also be alternated, changed, rearranged, decomposed, combined, or deleted. Further, the steps, measures, and solutions in the prior art that are the same as those disclosed in the present application can also be alternated, changed, rearranged, decomposed, combined, or deleted.
[0342] The terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" can explicitly or implicitly include one or more of such features. In the description of the present application, unless otherwise specified, the meaning of "a plurality" is two or more. Words such as "including" or "comprising" mean that the elements or objects appearing before this word cover the elements or objects listed after this word and their equivalents, without excluding other elements or objects. "Connection" or "coupling" and other similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect.
[0343] It should be understood that although the steps in the flowcharts of the accompanying drawings are shown sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless there is a clear indication in this document, there is no strict order restriction for the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowcharts of the accompanying drawings may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same moment, but can be executed at different moments, and their execution order is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.
[0344] Although the present application has been described with reference to the preferred embodiments, various improvements can be made to it and components or steps therein can be replaced with equivalents without departing from the scope of the present application. In particular, as long as there is no conflict in the structure or method steps, the various technical features mentioned in each embodiment can be combined in any way. The present application is not limited to the specific embodiments disclosed in the text, but includes all technical solutions falling within the scope of the claims.
Claims
1. A display method, characterized in that: The method is applied to a stereoscopic display screen, and the method comprises: In response to a first operation of a user, sending first information to a server, where the first information is used to request generation of a first image; receiving second information, where the second information includes the first image or multiple second images, where the multiple second images are images corresponding to different angles of the first image; Images at different angles are displayed on multiple surfaces of the three-dimensional display screen according to the second information.
2. The method according to claim 1, characterized in that Gratings are arranged on the multiple surfaces.
3. The method according to claim 1 or 2, characterized in that: The first image is a first 3D bonsai image, and the second image is a 2D bonsai image corresponding to a different angle of the first 3D bonsai image.
4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: Sending third information to the server, where the third information is used to request the server to manage the first image; receiving fourth information, the fourth information including a third image or a plurality of fourth images, the third image being the managed first image, and the plurality of fourth images being images corresponding to different angles of the third image; The image displayed according to the second information is deleted, and images at different angles are displayed on multiple surfaces of the three-dimensional display screen according to the fourth information.
5. The method according to claim 4, characterized in that The sending the third information to the server includes: In response to the second operation of the user, the third information is sent to the server.
6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Tracking users’ eyes; The brightness of the stereoscopic display screen is adjusted according to the eyeballs of the user, or the size and / or position of the image on the stereoscopic display screen is adjusted.
7. The method according to claim 6, characterized in that The adjusting the brightness of the stereoscopic display screen according to the eyeballs of the user, or adjusting the size and / or position of the image on the stereoscopic display screen, comprises: When the distance between the eyeball of the user and the stereoscopic display screen gradually increases, the brightness of the stereoscopic display screen is reduced or the image on the stereoscopic display screen is reduced; or, When the distance between the eyeball of the user and the stereoscopic display screen gradually decreases, the brightness of the stereoscopic display screen is increased or the image on the stereoscopic display screen is enlarged; or, When the distance between the eyeball of the user and the stereoscopic display screen remains unchanged and the position of the user changes, the position of the image on the stereoscopic display screen is moved.
8. The method according to any one of claims 1 to 7, characterized in that The method further comprises: Sending fifth information to the server, where the fifth information is used to request the server to generate corresponding text for the first image; receiving sixth information, wherein the sixth information includes the text; The text is displayed on at least one of the plurality of surfaces.
9. The method according to claim 8, characterized in that The sending fifth information to the server includes: In response to the third operation of the user, the fifth information is sent to the server.
10. A display method, characterized in that: The method is applied to a server, and the method comprises: receiving first information, wherein the first information is used to request generation of a first image; generating the first image according to the first information; Sending second information to the stereoscopic display screen, where the second information includes the first image or multiple second images, where the multiple second images are images corresponding to different angles of the first image.
11. The method according to claim 10, characterized in that The first information includes at least one parameter corresponding to the first image; The generating the first image according to the first information includes: The at least one parameter is input into an image generation model, and the first image is generated based on a result output by the image generation model, wherein the image generation model is obtained based on training.
12. The method according to claim 10 or 11, characterized in that: The method further comprises: receiving third information, wherein the third information is used to request the server to manage the first image; managing the first image according to the second information; Sending fourth information to the stereoscopic display screen, the fourth information including a third image or a plurality of fourth images, the third image being an image obtained by managing the first image, and the plurality of fourth images being images corresponding to different angles of the third image.
13. The method according to any one of claims 10 to 12, characterized in that The method further comprises: receiving fifth information, where the fifth information is used to request the server to generate corresponding text for the first image; generating the text according to the fifth information; Sending sixth information to the three-dimensional display screen, where the sixth information includes the text.
14. A three-dimensional display screen, characterized in that: The stereoscopic display screen comprises a module for executing the method according to any one of claims 1 to 9.
15. A three-dimensional display screen, characterized in that: include: one or more processors; one or more memories; The one or more memories store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the stereoscopic display screen executes the method according to any one of claims 1 to 9.
16. A computer storage medium, characterized in that: The method comprises computer instructions, which, when executed on a stereoscopic display screen, cause the stereoscopic display screen to execute the method as claimed in any one of claims 1 to 9; or, when executed on a server, cause the server to execute the method as claimed in any one of claims 10 to 13.