Projection control method and electronic device

Abstract

The present application provides a projection control method and an electronic device, the method comprising: obtaining first depth data corresponding to a reference object; obtaining second depth data corresponding to a remote object; determining a first scaling ratio corresponding to the remote object based on the first depth data and the second depth data; and performing a holographic projection on the remote object based on the first scaling ratio and the second depth data to obtain a first projection image.

Description

Technical Field

[0001] The present application relates to the technical field of holographic projection, and in particular to a projection control method and electronic equipment. Background Art

[0002] Holographic projection technology (front-projected holographic display), also known as virtual imaging technology, is a technology that uses the principles of interference and diffraction to record and reproduce the real three-dimensional image of an object. The equipment that uses holographic projection technology is called holographic projection equipment.

[0003] With the development of holographic projection equipment, users can interact with holographic projection images in the same space, thereby improving the interactivity of holographic projection equipment. However, since the image sources of holographic projection images have a variety of different environmental conditions, the imaging ratio of holographic projection images generated by different environmental conditions is difficult to control, affecting the interactive effect. Summary of the invention

[0004] The present application provides a projection control method and an electronic device to at least solve the above technical problems existing in the prior art.

[0005] According to a first aspect of the present application, a projection control method is provided, the method comprising: obtaining first depth data corresponding to a reference object; obtaining second depth data corresponding to a remote object; determining a first scaling ratio corresponding to the remote object based on the first depth data and the second depth data; and performing a holographic projection on the remote object based on the first scaling ratio and the second depth data to obtain a first projection image.

[0006] In one possible implementation, determining a first scaling ratio corresponding to a remote object based on the first depth data and the second depth data includes: determining a first projection outline and a first original height based on the first depth data; determining a second scaling ratio based on the first projection outline and the first original height; determining a second projection outline and a second original height based on the second depth data; and determining a first scaling ratio corresponding to the second projection outline based on the second original height and the second scaling ratio.

[0007] In one possible implementation, the method further includes: adjusting the first projection image to obtain a second projection image.

[0008] In one possible implementation, the adjusting the first projection image to obtain the second projection image includes: proportionally adjusting the first depth data to obtain third depth data; adjusting the first scaling ratio based on the third depth data to obtain a third scaling ratio; and adjusting the projection of the first projection image according to the third scaling ratio to obtain the second projection image.

[0009] In one possible implementation, the adjusting the first projection image to obtain the second projection image includes: proportionally adjusting the second depth data to obtain fourth depth data; adjusting the first scaling ratio based on the fourth depth data to obtain a fourth scaling ratio; and adjusting the projection of the first projection image according to the fourth scaling ratio to obtain the second projection image.

[0010] In one possible implementation manner, the adjusting the first projection image to obtain the second projection image includes: collecting the gesture of the reference object to obtain first gesture information; adjusting the first projection image according to the first gesture information to obtain the second projection image; wherein the adjustment is at least one of a projection position adjustment and a projection ratio adjustment.

[0011] In one possible implementation, the adjusting the first projection image to obtain the second projection image includes: performing gesture capture on the gesture of the reference object to obtain second gesture information; determining a first virtual object based on the second gesture information; and holographically projecting the first virtual object based on the first scaling ratio to obtain a first interactive image for interaction between the reference object and the remote object.

[0012] In one possible implementation, the method further includes: collecting interactive gestures of the reference object and the remote object to obtain third gesture information; and adjusting the projection of the first interactive image according to the third gesture information to obtain a second interactive image.

[0013] In one possible implementation, the adjusting of the first projection image to obtain the second projection image includes: determining first position information corresponding to the reference object; determining second position information corresponding to the remote object; determining overlapping position information based on the first position information and the second position information; and masking the first projection image based on the overlapping position information to obtain the second projection image.

[0014] According to a second aspect of the present application, an electronic device is provided, comprising: a first acquisition module for obtaining first depth data corresponding to a reference object; a second acquisition module for obtaining second depth data corresponding to a remote object; a determination module for determining a first scaling ratio corresponding to the remote object based on the first depth data and the second depth data; and a holographic projection module for holographically projecting the remote object based on the first scaling ratio and the second depth data to obtain a first projection image.

[0015] In one possible implementation, the determination module includes: determining a first projection contour and a first original height based on the first depth data; determining a second scaling ratio based on the first projection contour and the first original height; determining a second projection contour and a second original height based on the second depth data; and determining a first scaling ratio corresponding to the second projection contour based on the second original height and the second scaling ratio.

[0016] In one possible implementation manner, the device further includes: an adjustment module, configured to adjust the first projection image to obtain a second projection image.

[0017] In one possible implementation, the adjustment module includes: a scale adjustment submodule, used to scale the first depth data to obtain third depth data; the scale adjustment submodule is also used to adjust the first scaling ratio based on the third depth data to obtain a third scaling ratio; and a projection adjustment submodule is used to perform projection adjustment on the first projection image according to the third scaling ratio to obtain the second projection image.

[0018] In one possible implementation, the scale adjustment submodule is further used to scale the second depth data to obtain fourth depth data; the scale adjustment submodule is further used to adjust the first scaling ratio based on the fourth depth data to obtain a fourth scaling ratio; the projection adjustment submodule is further used to adjust the projection of the first projection image according to the fourth scaling ratio to obtain the second projection image.

[0019] In one possible implementation, the adjustment module includes: a gesture acquisition submodule, used to acquire the gesture of the reference object to obtain first gesture information; the projection adjustment submodule, further used to adjust the first projection image according to the first gesture information to obtain the second projection image; wherein the adjustment is at least one of a projection position adjustment and a projection ratio adjustment.

[0020] In one possible implementation, the gesture acquisition submodule is further used to acquire the gesture of the reference object to obtain second gesture information; the determination submodule is used to determine the first virtual object according to the second gesture information; the projection submodule is used to perform holographic projection on the first virtual object according to the first scaling ratio to obtain a first interactive image for interaction between the reference object and the remote object.

[0021] In one possible implementation, the gesture acquisition submodule is further used to acquire interactive gestures of the reference object and the remote object to obtain third gesture information; the projection adjustment submodule is further used to adjust the projection of the first interactive image according to the third gesture information to obtain a second interactive image.

[0022] In one possible implementation, the determination submodule is further used to determine first position information corresponding to the reference object; the determination submodule is further used to determine second position information corresponding to the remote object; the determination submodule is further used to determine overlapping position information based on the first position information and the second position information; the adjustment module further includes: a mask submodule, used to mask the first projection image according to the overlapping position information to obtain the second projection image.

[0023] According to the third aspect of the present application, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in the present application.

[0024] According to a fourth aspect of the present application, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method described in the present application.

[0025] The present application provides a projection control method, which obtains first depth data corresponding to a reference object and second depth data corresponding to a remote object, and determines the proportional difference between the reference object and the remote object by comparing the first depth data and the second depth data, thereby determining a first scaling ratio of the remote object, so that the remote object can be holographically projected based on the reference object to obtain a corresponding first projection image. The first projection image thus obtained can be associated with the reference object, so that the projection effect of the first projection image is better.

[0026] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] By reading the detailed description below with reference to the accompanying drawings, the above and other purposes, features and advantages of the exemplary embodiments of the present application will become easily understood. In the accompanying drawings, several embodiments of the present application are shown in an exemplary and non-limiting manner, wherein:

[0028] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts.

[0029] Figure 1 A schematic diagram of the implementation flow of a projection control method according to the first embodiment of the present application is shown;

[0030] Figure 2 A schematic diagram of the implementation flow of a projection control method according to the second embodiment of the present application is shown;

[0031] Figure 3 A schematic diagram of the implementation flow of a projection control method according to the third embodiment of the present application is shown;

[0032] Figure 4 A schematic diagram of the implementation flow of a projection control method according to the fourth embodiment of the present application is shown;

[0033] Figure 5 A schematic diagram of the implementation flow of a projection control method according to the fifth embodiment of the present application is shown;

[0034] Figure 6a The sixth embodiment of the present application shows a schematic diagram of a projection control method for implementing the scene Figure 1 ;

[0035] Figure 6b The sixth embodiment of the present application shows a schematic diagram of a projection control method for implementing the scene Figure 2 ;

[0036] Figure 6c The sixth embodiment of the present application shows a schematic diagram of a projection control method for implementing the scene Figure 3 ;

[0037] Figure 7 A schematic diagram of an implementation module of an electronic device according to the first embodiment of the present application is shown. DETAILED DESCRIPTION

[0038] In order to make the purpose, features, and advantages of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0039] Figure 1 A schematic diagram of the implementation flow of a projection control method according to the first embodiment of the present application is shown;

[0040] See also Figure 1 According to a first aspect of the present application, a projection control method is provided, the method comprising: operation 101, obtaining first depth data corresponding to a reference object; operation 102, obtaining second depth data corresponding to a remote object; operation 103, determining a first scaling ratio corresponding to the remote object according to the first scaling ratio and the second depth data; operation 104, performing a holographic projection on the remote object according to the first scaling ratio and the second depth data to obtain a first projection image.

[0041] A projection control method provided by the present application obtains first depth data corresponding to a reference object and second depth data corresponding to a remote object, and determines the relative difference between the reference object and the remote object by comparing the first depth data and the second depth data, so that the first scaling ratio of the remote object can be determined using the first depth data and the second depth data, so that the remote object can be holographically projected based on the reference object to obtain a first projection image. The first projection image thus obtained can be associated with the reference object, so that the projection effect of the first projection image is better.

[0042] This method can be applied to a holographic projection device or a control center of a holographic projection device. In operation 101 of this method, in one implementation scenario, the device may include a depth camera, and the reference object is photographed by the depth camera to obtain the first depth data of the reference object. In another implementation scenario, the device may not include a depth camera, in which case the device can receive data from the depth camera to obtain the first depth data. It can be supplemented that the depth camera can be placed on any side around the reference object, which can be determined according to the placement requirements of the depth camera in the actual scene. For example, in one implementation scenario, the reference object is a real object in the scene, and the reference object stands behind the screen for holographic projection. In this case, in order to avoid the reference object being blocked, the depth camera can be placed behind or to the side of the reference object. In another implementation scenario, the reference object is also located at the remote end of the holographic projection device, and the reference object also needs to be projected. In this case, the reference object can be in a green screen studio, and the depth camera can be placed in front of the reference object.

[0043] In operation 102 of the present method, similarly, the second depth data of the remote object also needs to be obtained by shooting and analyzing with a depth camera. The device may include or not include a depth camera. When the device does not include a depth camera, the second depth data transmitted from a third-party device can be obtained through a communication connection. It should be added that a color camera can also be integrated in the depth camera to capture the specific appearance of the remote object. The data collected by the color camera and the second depth data are combined to achieve a holographic projection of the remote object.

[0044] In operation 103 of the method, the actual appearance difference between the reference object and the remote object, such as height difference, width difference, etc., can be determined through the first depth data and the second depth data. Based on this, the data of the remote object acquired, that is, the second depth data and other data used for holographic projection, can be scaled by a specific ratio according to the first depth data to obtain a first scaling ratio.

[0045] Specifically, the first scaling ratio is determined according to the set projection ratio, which can be a geometric scaling or non-geo-proportional scaling corresponding to the reference object. For example, in a geometric scaling scene, according to the first depth data and the second depth data, it can be known that the height of the reference object is 160 cm and the height of the remote object is 170 cm. When the height projection of the reference object on the screen is 160 cm, the height projection of the remote object on the screen is set to 170 cm; when the projection height of the reference object on the screen is 16 cm, the projection height of the remote object on the screen is set to 17 cm. Similarly, in a non-geo-proportional scaling scene, assuming that the projection ratio of the remote object and the reference object is set to 1:2, when the reference object is 160 cm tall and the remote object is 170 cm tall, assuming that the projection height of the reference object on the screen is 160 cm, the projection height of the remote object on the screen is set to 85 cm.

[0046] In operation 104 of the method, the holographic projection related data is scaled according to the first scaling ratio and holographic projection is performed to obtain a first projection image corresponding to the reference object. It should be understood that the first projection image changes in real time with the action of the remote object to achieve the purpose of real-time projection.

[0047] This method can be applied to interactive scenes of real objects and virtual objects, that is, there are real reference objects and screens at the projection location, and there are remote objects that need to interact with the reference objects at another location. Through this method, the remote objects can be projected onto the screen at a specific scale to interact with the reference objects. Specifically, the interactive scenes can be projection meetings, projection classrooms, etc.

[0048] This method can also be used for interactive scenes of two virtual objects, where there is a screen at the projection location, a first object to be projected at a remote location, and a second object to be projected at another remote location. The first object is used as a reference object, and the second object is used as a remote object. The two objects are projected onto the screen at a specific ratio to achieve interaction between the two objects. Specifically, the interactive scenes can be: projection conferences, projection classrooms, etc.

[0049] To facilitate the specific understanding of the above implementation mode, a specific implementation scenario is provided below for illustration.

[0050] In this scenario, this method is applied to a smart classroom. Through this method, the remote teacher can be projected onto the screen while the teacher in the classroom is giving a lecture. In this case, the projected image of the remote teacher is more realistic. Based on this, the remote teacher can communicate and interact with the teacher in the classroom to achieve teaching interaction and improve the fun of the class.

[0051] In one embodiment, operation 103, determining a first scaling ratio corresponding to the remote object based on the first depth data and the second depth data, includes: first, determining a first projection outline and a first original height based on the first depth data; then, determining a second scaling ratio based on the first projection outline and the first original height; then, determining a second projection outline and a second original height based on the second depth data; finally, determining a first scaling ratio corresponding to the second projection outline based on the second original height and the second scaling ratio.

[0052] In this method, the first depth data corresponding to the reference object is collected by the first depth camera, and the second depth data corresponding to the remote object is collected by the second camera. By analyzing the first depth data, the contour and skeleton data corresponding to the reference object can be obtained. Similarly, by analyzing the second depth data, the contour and skeleton data corresponding to the remote object can be obtained. By further analyzing the contour and skeleton data and other data, the first original height corresponding to the reference object and the second original height corresponding to the remote object can be calculated, wherein the original height refers to the actual height of the reference object and the remote object.

[0053] Afterwards, projection simulation is performed on the first depth data and other corresponding projection data to obtain a first projection outline of the reference object on the screen, and projection simulation is performed on the second depth data and other corresponding projection data to obtain a second projection outline of the remote object on the screen. It should be understood that the first projection outline and the second projection outline are simulated outlines and are not actually projected on the screen.

[0054] By comparing the first original height and the first projection profile, it can be determined whether the reference object is scaled on the screen, that is, a second scaling ratio corresponding to the reference object is obtained. It is understandable that when the reference object is a real object existing in the same scene as the projection device, the second scaling ratio can be preset to 1, that is, the projection of the reference object on the screen is a proportional projection by default. However, it is understandable that the second scaling ratio can be adjusted by adjusting the size of the first projection profile required by the reference object on the screen.

[0055] After obtaining the second scaling ratio, the second projection profile can be scaled by the second original height and the second scaling ratio so that there is a correlation between the second projection profile and the first projection profile, and the first scaling ratio is obtained. The remote object is holographically projected by the first scaling ratio, thereby obtaining a first projection image having a proportional correlation with the reference object.

[0056] Figure 2 A schematic diagram of the implementation flow of a projection control method according to the second embodiment of the present application is shown;

[0057] See also Figure 2 In one embodiment, after obtaining the first projection image in operation 104, the method further includes: operation 201, adjusting the first projection image to obtain a second projection image.

[0058] In order to further improve the correlation between the projection of the remote object and the reference object, and further improve the authenticity or interest of the projection, the method can also adjust the first projection image according to the actual scene requirements to obtain the second projection image. The adjustment of the first projection image includes but is not limited to color adjustment, size adjustment, position adjustment, etc.

[0059] Figure 3 A schematic diagram of the implementation flow of a projection control method according to the third embodiment of the present application is shown;

[0060] See also Figure 3 In one possible implementation, operation 201, adjusting the first projection image to obtain the second projection image, includes: operation 2011, proportionally adjusting the first depth data to obtain third depth data; operation 2012, adjusting the first scaling ratio based on the third depth data to obtain the third scaling ratio; operation 2013, adjusting the projection of the first projection image according to the third scaling ratio to obtain the second projection image.

[0061] In an implementation scenario, the projection adjustment of the first projection image can be achieved by adjusting at least one of the first depth data, the first projection profile and other data corresponding to the reference object, thereby improving the correlation between the reference object and the first projection image.

[0062] In operation 2011 and operation 2012, after acquiring the first depth data through the depth camera, the third depth data is obtained by adjusting the first depth data. Specifically, the corresponding coefficients can be preset or specified to adjust the first depth data. Thus, the first scaling ratio is adjusted to obtain the third scaling ratio. It can be supplemented that the method can also preset or specify the corresponding coefficients to adjust the first projection profile, and can also adjust the first scaling ratio to obtain the third scaling ratio; in another implementation scenario, the method can also directly adjust the first scaling ratio to obtain the third scaling ratio.

[0063] In operation 213, the projection of the first projection image is adjusted according to the third scaling ratio to obtain a second projection image. The method may also use various scaling methods to achieve scaling of the first projection image, including but not limited to gradual scaling, instantaneous scaling, and the like.

[0064] Figure 4 A schematic diagram of the implementation flow of a projection control method according to the fourth embodiment of the present application is shown;

[0065] See also Figure 4 In one embodiment, operation 201, adjusting the first projection image to obtain the second projection image, includes: operation 2014, proportionally adjusting the second depth data to obtain fourth depth data; operation 2015, adjusting the first scaling ratio based on the fourth depth data to obtain a fourth scaling ratio; operation 2016, adjusting the projection of the first projection image according to the fourth scaling ratio to obtain the second projection image.

[0066] The method can also adjust at least one of the other data such as the second depth data and the second projection profile corresponding to the remote object to achieve projection adjustment of the first projection image, thereby improving the variability of the first projection image. It should be supplemented that the adjustment methods of operations 2011 to 2013 and the adjustment methods of operations 2014 to 2016 of the method can be used separately or only one of them can be used, and can be used successively or simultaneously. That is, the method can adjust the data corresponding to the reference object and the data corresponding to the remote object simultaneously or successively, or can only adjust the data corresponding to the reference object, or can only adjust the data corresponding to the remote object.

[0067] In the process of adjusting and replying the data corresponding to the remote object, the method can adjust the second depth data or the second projection profile by a preset or specific coefficient to obtain the corresponding fourth depth data or the fourth projection profile, and use the fourth depth data or the fourth projection profile to adjust the first scaling ratio, thereby determining the corresponding fourth scaling ratio, and adjusting the projection of the first projection image according to the fourth scaling ratio to obtain the second projection image. Specifically, the scene causing the scaling can be based on a user gesture, or based on an indication of an audience or user in the scene, or from a preset or conditionally generated parameter of the projection device to adjust the data corresponding to the reference object and / or the remote object.

[0068] Figure 5 A schematic diagram of the implementation flow of a projection control method according to the fifth embodiment of the present application is shown;

[0069] See also Figure 5 In one possible implementation, operation 201, adjusting the first projection image to obtain a second projection image, includes: operation 2017, collecting the gesture of the reference object to obtain first gesture information; operation 2018, adjusting the first projection image according to the first gesture information to obtain the second projection image; wherein the adjustment is at least one of a projection position adjustment and a projection ratio adjustment.

[0070] In one implementation scenario, the adjustment of the first projection image can be triggered by the gesture of the reference object. For example, the corresponding gesture of the operating object is captured by the image acquisition device. When the reference object makes a specific gesture, the corresponding adjustment method is determined according to the gesture to achieve the adjustment of the first projection image. It should be added that in another implementation scenario, the method can also capture the gestures of the remote object, the audience or the user watching the projection to achieve the adjustment of the first projection image. Among them, the adjustment of the first projection image can be to adjust the position of the first projection image on the screen, adjust the size of the first projection image on the screen, or adjust the brightness of the first projection image on the screen or the color of the first projection image on the screen.

[0071] It should be understood that operations 2017 to 2018 provided by the present method may be set before operations 2011 to 2013 and / or operations 2014 to 2016. Specifically, the present method triggers the adjustment operation through operation 2017, and then uses operations 2011 to 2013 and / or operations 2014 to 2016 to adjust the first projection image.

[0072] For example, in an implementation scenario applied to a smart classroom, the local teacher makes a gesture, and the remote teacher appears next to the local teacher in a reduced posture. The local teacher makes a sliding gesture to enlarge the remote teacher and make him stand next to the local teacher. The local teacher pushes hard to push the remote teacher to the end of the screen away from the local teacher, etc., which will not be elaborated below.

[0073] It can be understood that based on this adjustment method of the first projection image, in an implementation scenario, the first projection image can be adjusted multiple times. Based on this, the method can redefine the adjusted second projection image as the first projection image to achieve multiple adjustments to the projection image corresponding to the remote object.

[0074] In one possible implementation, operation 201 adjusts the first projection image to obtain a second projection image, including: first, performing gesture capture on a reference object to obtain second gesture information; then, determining a first virtual object based on the second gesture information; and then, holographically projecting the first virtual object based on a first scaling ratio to obtain a first interactive image for interaction between the reference object and the remote object.

[0075] The gesture of the reference object can also be used to characterize the purpose of projecting other projection patterns. For example, according to the gesture of the reference object, a background projection image such as a blackboard, teaching aids, three-dimensional formulas, green space, balloons, the sun, etc. can be projected around the first projection image to increase the interest of the projection. It is understandable that the gesture can also be triggered by a remote object. It should be understood that when projecting the background projection image, at least one of the reference object, the remote object, and the first projection image can be used as a projection basis to determine the corresponding scaling ratio.

[0076] Furthermore, the method can also project a first interactive image for interaction between the reference object and the remote object. It is understandable that the first interactive image needs to be scaled according to the scaling ratio of the reference object and the remote object, that is, the first scaling ratio, to achieve better interaction between the reference object and the remote object. For example, the reference object and the remote object are geometrically scaled. When the first interactive image is a tug-of-war rope, the reference object and the remote object hold one end of the tug-of-war rope of the first interactive image. In this case, the two ends of the first interactive image can also be scaled geometrically. However, when the scaling ratio of the reference object and the remote object is 2:1, the scaling ratio of the two ends of the tug-of-war rope can be set to 2:1, and the middle can be presented in a uniform transition manner. In this way, the first interactive image does not produce an excessive sense of disobedience when the reference object and the remote object interact.

[0077] In one possible implementation, after obtaining a first interactive image for interaction between a reference object and a remote object, the method further includes: first, collecting interactive gestures of the reference object and the remote object to obtain third gesture information; and then, adjusting the projection of the first interactive image according to the third gesture information to obtain a second interactive image.

[0078] It is understandable that for some interactive scenes, when the reference object and the remote object interact, the projected first interactive image will change in shape. For example, during tug-of-war, when both parties exert force, the rope will be stretched straight; when the elastic material is squeezed by both parties, the elastic material will be compressed; when the spring scale is pulled, the distance between the two ends of the spring will increase. Based on this, when the first interactive image is a variable-shape interactive image, the method can determine whether it is necessary to adjust the projection of the first interactive image to change its shape by collecting interactive gestures of the reference object and the remote object. Furthermore, the shape adjustment of the first interactive image is a gradual adjustment to achieve no sense of disobedience during the interaction.

[0079] To facilitate further understanding of the above-mentioned implementation method, a specific implementation scenario is provided below. In this implementation scenario, the reference object is a local teacher, the remote object is a remote teacher, and the reference object and the remote object are projected in a 1:1 geometric ratio. The camera device captures the movements of the local teacher. When the projection device determines the second gesture information based on the captured movements, a spring scale is projected on the screen, and the two ends of the spring scale are respectively located at the forces of the local teacher and the remote teacher. Then the camera device continues to capture the movements of the local teacher. When the projection device determines the third gesture information based on the captured movements, the projection of the spring scale is adjusted to change its shape so that the two ends of the spring scale are stretched. At this time, the local teacher and the remote teacher cooperate with the spring scale to move to both sides, thereby achieving the purpose of demonstrating the relevant knowledge of force to students.

[0080] In one possible implementation, the first projection image is adjusted to obtain a second projection image, including: first, determining first position information corresponding to a reference object; then, determining second position information corresponding to a remote object; then, determining overlapping position information based on the first position information and the second position information; then, masking the first projection image based on the overlapping position information to obtain a second projection image.

[0081] When the reference object is a real object and the remote object is a projection object, since the screen used for holographic projection is usually a transparent screen, in order not to block the projection light, the real object needs to be located behind the screen. At this time, when the remote object and the reference object move, the two are prone to overlap. When the two overlap, the real object will be visible from behind the first projection image, affecting the projection effect. Based on this, the method needs to locate the first projection image corresponding to the reference object and the remote object by determining the first position information corresponding to the reference object and the second position information corresponding to the remote object, and determine whether the reference object and the first projection image overlap by comparing the first position information and the second position information, that is, when the reference object and the first projection image overlap, the overlapping position information is that the reference object and the first projection image overlap, and when the reference object and the first projection image do not overlap, the overlapping position information is that the reference object and the first projection image do not overlap. When the overlapping position information is that the reference object and the first projection image overlap, the first projection image needs to be masked to obtain the second projection image, so as to avoid the audience from finding that the reference object will be visible from behind the first projection image, thereby improving the projection quality.

[0082] To facilitate the overall understanding of the above implementation, a specific implementation scenario is provided below.

[0083] Figure 6a The sixth embodiment of the present application shows a schematic diagram of a projection control method for implementing the scene Figure 1 ; Figure 6b The sixth embodiment of the present application shows a schematic diagram of a projection control method for implementing the scene Figure 2 ; Figure 6c The sixth embodiment of the present application shows a schematic diagram of a projection control method for implementing the scene Figure 3 .

[0084] See also Figure 6a , 6b In this scenario, the projection control method provided by the present application is applied to a smart classroom 711. In the smart classroom 711, a transparent screen 712 for holographic projection is provided, such as a transparent glass screen, and a projection device for holographic projection (not shown in the figure) is provided at its corresponding position. The projection device is used to project the holographic image onto the transparent screen 712.

[0085] When the local teacher 713 needs to start an interactive class with the remote teacher to teach the students, the local teacher 713 stands directly behind the transparent screen 712. The remote teacher is in the remote classroom, which is a green screen studio. The projection device projects the first projection image 714 corresponding to the remote teacher on the transparent screen 712 by holographic projection, so that the local teacher 713 and the remote teacher appear in the same smart classroom in the students' vision.

[0086] See also Figure 6a First, the first depth data corresponding to the local teacher 713 is collected through the depth camera in the smart classroom, and the second depth data corresponding to the remote teacher is collected through the depth camera in the remote classroom. Then, the first real height of the local teacher is analyzed through the first depth data, and the first projection outline of the local teacher 713 on the transparent screen 712 is simulated. According to the first real height and the first projection outline, the proportion of the second projection outline corresponding to the remote teacher on the transparent screen 712 can be determined. It is preset that the remote teacher and the local teacher are projected on the transparent screen 712 in equal proportion to form a first projection image 714 on the transparent screen 712, so as to avoid the difference between the height and outline of the remote teacher and the local teacher 713 being too large to affect the students' visual experience.

[0087] See also Figure 6a and Figure 6b During the teaching process between the first projection image 714 corresponding to the remote teacher and the local teacher 712, the first projection image 714 can be adjusted by collecting the gestures of the local teacher 712. When the local teacher 712 makes a preset first specific gesture, the first projection image 714 is enlarged to obtain the second projection image 724. When the local teacher 712 makes a preset second specific gesture, the second projection image 714 is reduced to restore the first projection image 714.

[0088] See also Figure 6a and Figure 6c , during the teaching process of the first projection image 714 corresponding to the remote teacher and the local teacher 712, an interactive projection image 715 for the interaction between the first projection image 714 and the local teacher 712 can also be added according to the gesture of the local teacher 712. The interactive projection image 715 is also preset to be proportionally projected according to the ratio of the local teacher 712 and the first projection image 714, so as to facilitate the coordination between the local teacher 712, the first projection image 714 and the interactive projection image 715. It can be understood that the state and proportion of the interactive projection image 715 can also be changed through the gesture control of the local teacher 712.

[0089] Figure 7 A schematic diagram of an implementation module of an electronic device according to the first embodiment of the present application is shown.

[0090] See also Figure 7According to the second aspect of the present application, an electronic device is provided, including: a first acquisition module 601, used to obtain first depth data corresponding to a reference object; a second acquisition module 602, used to obtain second depth data corresponding to a remote object; a determination module 603, used to determine a first scaling ratio corresponding to the remote object according to the first depth data and the second depth data; a holographic projection module 604, used to perform holographic projection on the remote object according to the first scaling ratio and the second depth data to obtain a first projection image.

[0091] In one possible implementation, determination module 603 includes: determining a first projection profile and a first original height based on first depth data; determining a second scaling ratio based on the first projection profile and the first original height; determining a second projection profile and a second original height based on second depth data; and determining a first scaling ratio corresponding to the second projection profile based on the second original height and the second scaling ratio.

[0092] In one possible implementation, the device further includes: an adjustment module 605, configured to adjust the first projection image to obtain a second projection image.

[0093] In one embodiment, the adjustment module 605 includes: a scale adjustment submodule 6051, which is used to scale the first depth data to obtain third depth data; the scale adjustment submodule 6051 is also used to adjust the first scaling ratio based on the third depth data to obtain a third scaling ratio; and a projection adjustment submodule 6052 is used to adjust the projection of the first projection image according to the third scaling ratio to obtain a second projection image.

[0094] In one embodiment, the scale adjustment submodule 6051 is also used to scale the second depth data to obtain fourth depth data; the scale adjustment submodule 6051 is also used to adjust the first scaling ratio based on the fourth depth data to obtain a fourth scaling ratio; the projection adjustment submodule 6052 is also used to adjust the projection of the first projection image according to the fourth scaling ratio to obtain a second projection image.

[0095] In one possible implementation, the adjustment module 605 includes: a gesture collection submodule 6053, used to collect the gesture of the reference object to obtain first gesture information; a projection adjustment submodule 6052, further used to adjust the first projection image according to the first gesture information to obtain a second projection image; wherein the adjustment is at least one of a projection position adjustment and a projection ratio adjustment.

[0096] In one possible implementation, the gesture collection submodule 6053 is further used to collect the gesture of the reference object to obtain second gesture information; the determination submodule 6054 is used to determine the first virtual object according to the second gesture information; the projection submodule 6055 is used to perform holographic projection on the first virtual object according to the first scaling ratio to obtain a first interactive image for interaction between the reference object and the remote object.

[0097] In one possible implementation, the gesture collection submodule 6053 is further used to collect interactive gestures of the reference object and the remote object to obtain third gesture information; the projection adjustment submodule 6052 is further used to adjust the projection of the first interactive image according to the third gesture information to obtain a second interactive image.

[0098] In one embodiment, the determination submodule 6054 is also used to determine the first position information corresponding to the reference object; the determination submodule 6054 is also used to determine the second position information corresponding to the remote object; the determination submodule 6054 is also used to determine the overlapping position information based on the first position information and the second position information; the adjustment module 605 also includes: a mask submodule 6056, which is used to mask the first projection image according to the overlapping position information to obtain a second projection image.

[0099] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0100] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0101] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0102] In addition, all functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0103] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0104] Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention can be essentially or partly reflected in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0105] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A projection control method, the method comprising: Obtaining first depth data corresponding to a reference object; obtaining second depth data corresponding to the remote object; determining a first scaling ratio corresponding to the remote object based on the first depth data and the second depth data; Performing holographic projection on the remote object according to the first scaling ratio and the second depth data to obtain a first projection image; The method further comprises: Adjusting the first projection image to obtain a second projection image; The adjusting the first projection image to obtain a second projection image includes: Collecting the gesture of the reference object to obtain second gesture information; determining a first virtual object according to the second gesture information; Performing holographic projection on the first virtual object according to the first scaling ratio to obtain a first interactive image for interaction between the reference object and the remote object; The method further comprises: Performing interactive gesture collection on the reference object and the remote object to obtain third gesture information; The first interactive image is projected and adjusted according to the third gesture information to obtain a second interactive image.

2. The method according to claim 1, wherein determining a first scaling ratio corresponding to the remote object according to the first depth data and the second depth data comprises: determining a first projection profile and a first original height according to the first depth data; determining a second scaling ratio according to the first projection profile and the first original height; determining a second projection profile and a second original height according to the second depth data; A first scaling factor corresponding to the second projection profile is determined according to the second original height and the second scaling factor.

3. The method according to claim 1, wherein adjusting the first projection image to obtain the second projection image comprises: Performing proportional adjustment on the first depth data to obtain third depth data; Adjusting the first scaling ratio based on the third depth data to obtain a third scaling ratio; The first projection image is projection-adjusted according to the third scaling ratio to obtain the second projection image.

4. The method according to claim 1, wherein adjusting the first projection image to obtain the second projection image comprises: scaling the second depth data to obtain fourth depth data; Adjusting the first scaling ratio based on the fourth depth data to obtain a fourth scaling ratio; The first projection image is projection-adjusted according to the fourth scaling ratio to obtain the second projection image.

5. The method according to claim 1, wherein adjusting the first projection image to obtain the second projection image comprises: Collecting a gesture of the reference object to obtain first gesture information; Adjust the first projection image according to the first gesture information to obtain the second projection image; Wherein, the adjustment is at least one of a projection position adjustment and a projection ratio adjustment.

6. The method according to claim 1, wherein adjusting the first projection image to obtain the second projection image comprises: Determining first position information corresponding to the reference object; determining second location information corresponding to the remote object; Determine overlapping position information according to the first position information and the second position information; The first projection image is masked according to the overlapping position information to obtain the second projection image.

7. An electronic device comprising: A first obtaining module, used to obtain first depth data corresponding to a reference object; A second obtaining module, used to obtain second depth data corresponding to the remote object; A determination module, configured to determine a first scaling ratio corresponding to the remote object based on the first depth data and the second depth data; a holographic projection module, configured to perform holographic projection on the remote object according to the first scaling ratio and the second depth data to obtain a first projection image; The device also includes: An adjustment module, used for adjusting the first projection image to obtain a second projection image; The adjustment module comprises: A gesture collection submodule, used for collecting the gesture of the reference object to obtain second gesture information; a determination submodule, configured to determine a first virtual object according to the second gesture information; a projection submodule, configured to perform holographic projection on the first virtual object according to the first scaling ratio to obtain a first interactive image for interaction between the reference object and the remote object; The gesture collection submodule is further used to collect interactive gestures of the reference object and the remote object to obtain third gesture information; The projection adjustment submodule is further used to perform projection adjustment on the first interactive image according to the third gesture information to obtain a second interactive image.

Images