Augmented reality device for plant cultivation

Abstract

The invention provides an augmented reality device for plant cultivation in order to solve the problem that the general public lacks planting related experience and is difficult to correctly judge various appearances in the plant growth process. The augmented reality device for plant cultivation comprises a planting cavity, a display cavity, a semi-reflecting and semi-transmitting mirror, a camera array, a stereoscopic display and a computer system. According to the invention, reflection and stereo imaging principles are utilized, and mirror images of planted plants and theoretical normal states of the planted plants are simultaneously displayed at the same position in a space, so that planters can judge health conditions of the planted plants through image comparison under the condition that the planters do not have professional planting experience of the plants.

Description

Technical Field

[0001] The present invention belongs to the technical field of stereoscopic display, and more specifically, the present invention relates to an augmented reality device for plant cultivation. Background Art

[0002] The cultivation of plants and flowers is widely loved by the masses and has great market value. However, the general public lacks relevant experience in plant cultivation. Except for easily recognizable situations such as withering, it is difficult to make correct judgments on various appearances during the plant growth process. For example, the yellowing or whitening of leaves caused by lack of fertilizer. For this reason, the present invention proposes an augmented reality device for plant cultivation, specifically including a camera array, a stereoscopic display, a semi-reflective semi-transmissive lens, etc., and using the principles of reflection and stereoscopic imaging to simultaneously display the mirror image of the planted plant and its theoretically normal state at the same position in space, so that growers can judge the health status of the planted plants through image comparison without professional plant cultivation experience. Summary of the Invention

[0003] To solve the problem that the general public lacks relevant cultivation experience and it is difficult to make correct judgments on various appearances during the plant growth process, the present invention proposes an augmented reality device for plant cultivation.

[0004] The augmented reality device for plant cultivation includes a planting cavity, a display cavity, a semi-reflective semi-transmissive lens, a camera array, a stereoscopic display, and a computer system.

[0005] The planting cavity is used to place the planted plants.

[0006] The display cavity, the semi-reflective semi-transmissive lens, the camera array, and the stereoscopic display are used to simultaneously display the mirror image of the planted plant and its theoretically normal state.

[0007] The planting cavity and the display cavity are placed adjacent to each other, and the intersection surface of the planting cavity and the display cavity is transparent to allow light to pass through.

[0008] The camera array is placed in the display cavity and is composed of several cameras. The optical axis of each camera is aligned with the same point on the intersection surface of the planting cavity and the display cavity. The camera array is used to record the stereoscopic image of the planted plant.

[0009] The computer system performs mirror image processing on the images of the planted plants recorded by each camera in the camera array, swaps the left and right positions of each pixel in the image, and replaces the original image color with the color of the plant in its theoretically normal state to obtain a parallax image of the plant in its theoretically normal state.

[0010] After the images collected by each camera are all converted into parallax images of the plant in its theoretically normal state, a synthetic image is constructed according to the basic principle of stereoscopic display for the stereoscopic display to display.

[0011] A stereoscopic display is placed on the rear surface of the display cavity and displays a synthetic image obtained after being processed by a computer system, presenting the theoretical normal state of the planted plants.

[0012] A semi-transmissive semi-reflective lens is placed inside the display cavity and in front of the stereoscopic display. It displays the mirror image of the planted plants by reflection and the theoretical normal state of the planted plants displayed on the stereoscopic display behind it by transmission.

[0013] Since the optical axes of each camera are aligned with the same point on the intersection surface of the planting cavity and the display cavity, the mirror image of the planted plants displayed by reflection and the theoretical normal state of the planted plants displayed on the stereoscopic display overlap in space.

[0014] In summary, since the mirror image of the planted plants and the theoretical normal state of the planted plants overlap in space, the user can simultaneously see the current state and the desired state of the planted plants through the display cavity, so it is possible to intuitively judge whether the planted plants are healthy. Brief Description of the Drawings

[0015] Figure 1 It is a schematic structural diagram of the present invention.

[0016] Figure 2 It is a schematic diagram of the transmission optical path principle of the present invention.

[0017] Figure 3 It is a schematic diagram of the reflection optical path principle of the present invention.

[0018] Figure 4 It is a schematic diagram of the stereoscopic image processing of the present invention.

[0019] Reference Signs: 110 - planting cavity, 120 - display cavity, 200 - semi-transmissive semi-reflective lens, 310 - first camera, 320 - second camera, 400 - stereoscopic display, 500 - plant, 501 - theoretical normal state of the plant, 502 - mirror image of the plant, 610 - image of the planted plant, 620 - mirror image of the image of the planted plant, 630 - parallax image of the theoretical normal state of the plant.

[0020] It should be understood that the above drawings are schematic and not drawn to scale. Embodiment

[0021] Figure 1 An augmented reality device for plant cultivation provided in this embodiment.

[0022] The augmented reality device for plant cultivation includes a planting cavity 110, a display cavity 120, a semi-transmissive semi-reflective lens 200, a camera array, a stereoscopic display 400, and a computer system.

[0023] The planting cavity 110 is a cuboid for placing the planted plant 500.

[0024] The display cavity 120, the semi-reflective semi-transmissive lens 200, the camera array and the stereoscopic display 400 are used to simultaneously display the mirror image 502 of the planted plant image and the theoretically normal state 501 of the plant.

[0025] Please refer to Figure 1 , the planting cavity 110 and the display cavity 120 are placed adjacent to each other, and the interface CDEF between the planting cavity 110 and the display cavity 120 is transparent to allow light to pass through.

[0026] Please refer to Figure 2 , the camera array is placed in the display cavity 120, specifically including the first camera 310 and the second camera 320. The optical axes of the first camera 310 and the second camera 320 are both aligned with the same point P2 on the interface CDEF between the planting cavity 110 and the display cavity 120. The camera array is used to record the stereoscopic image of the planted plant 500.

[0027] Please refer to Figure 3 , in order to make the theoretically normal state 501 of the plant displayed on the stereoscopic display 400 coincide with the mirror image 502 of the planted plant image, the computer system performs mirror image processing on the positive image of the planted plant image 610 recorded by the first camera 310 and the second camera 320, swapping the left and right positions of each pixel in the image to obtain the mirror image 620 of the planted plant image, and replacing the original image color with the color of the theoretically normal state of the plant to obtain the parallax image 630 of the theoretically normal state of the plant.

[0028] After the images collected by the first camera 310 and the second camera 320 are both converted into the parallax image 630 of the theoretically normal state of the plant, a synthetic image is constructed according to the basic principle of stereoscopic display for the stereoscopic display 400 to display.

[0029] Please refer to Figure 1 and Figure 2 , the stereoscopic display 400 is placed on the rear surface CDGH of the display cavity 120 and displays the synthetic image obtained after being processed by the computer system, showing the theoretically normal state 501 of the planted plant.

[0030] Please refer to Figure 4 , the semi-reflective semi-transmissive lens 200 is placed on the ABCD surface within the display cavity 120 and in front of the stereoscopic display 400, and it is placed at a 45-degree angle with the stereoscopic display 400, and it displays the mirror image 502 of the planted plant through reflection. Any point P1 in the planting cavity will be imaged as P1R through the semi-reflective semi-transmissive lens 200. Let the length and width of the display cavity be s , and the distance from any point P1 to the interface CDEF between the planting cavity 110 and the display cavity 120 isd If it is 1, the distance from the mirror image point P1R of any point P1 to the rear surface CDGH of the display cavity 120 d should be equal to d 1. Finally, the distance from the mirror image point P1R of any point P1 to the front surface ABEF of the display cavity 120 is s + d 1.

[0031] Please refer to Figure 2 , the semi-reflective semi-transmissive lens 200 shows the theoretically normal state 501 of the planted plants displayed on the rear stereoscopic display 400 through transmission. Please refer to Figure 2 , since the optical axes of the first camera 310 and the second camera 320 are both aligned with the same point P2 on the intersection plane CDEF of the planting cavity 110 and the display cavity 120, the depth of point P2 on the stereoscopic display is 0, and the subsequent depth distance is d 1. Any point P1 with a depth distance of d will be displayed at a position with the same depth behind the stereoscopic display 400. Specifically, any point P1 is displayed as P1S on the stereoscopic display, and the depth of P1S is d 3, and there is d 3 = s + d 1. Finally, the distance from P1S, which is the display of any point P1 on the stereoscopic display, to the front surface ABEF of the display cavity 120 is also

[0032] In summary, since the mirror image 502 of the planted plants and the theoretically normal state 501 of the planted plants overlap in space, the user can simultaneously see the current state and the desired state of the planted plants through the display cavity, so it is possible to intuitively judge whether the planted plants 500 are healthy.

Claims

1. An augmented reality device for plant cultivation, characterized in that: The augmented reality device for plant cultivation includes a planting cavity, a display cavity, a semi-reflective and semi-transmissive lens, a camera array, a stereoscopic display, and a computer system; The planting cavity is used to place the planted plants; The display cavity, the semi-reflective and semi-transmissive lens, the camera array, and the stereoscopic display are used to simultaneously display the mirror image of the planted plants and their theoretically normal states; The planting cavity and the display cavity are placed adjacent to each other, and the interface between the planting cavity and the display cavity is transparent to allow light to pass through; The camera array is placed in the display cavity and is composed of several cameras. The optical axis of each camera is aligned with the same point on the interface between the planting cavity and the display cavity; the camera array is used to record the stereoscopic images of the planted plants; The computer system performs mirror image processing on the images of the planted plants recorded by each camera in the camera array, swaps the left and right positions of each pixel in the image, and replaces the original image color with the color of the plant in its theoretically normal state to obtain a parallax image of the plant in its theoretically normal state; After the images collected by each camera are all converted into parallax images of the plant in its theoretically normal state, a synthetic image is constructed according to the basic principle of stereoscopic display for the stereoscopic display to display; The stereoscopic display is placed on the rear surface of the display cavity and displays the synthetic image obtained after being processed by the computer system to display the theoretically normal state of the planted plants; The semi-reflective and semi-transmissive lens is placed inside the display cavity and in front of the stereoscopic display. It reflects and displays the mirror image of the planted plants and transmits and displays the theoretically normal state of the planted plants displayed on the stereoscopic display behind it; The mirror image of the planted plants reflected and the theoretically normal state of the planted plants displayed on the stereoscopic display overlap in space.

Images