Image interaction system and image interaction method

Abstract

The present application provides an image interaction system and method. The system comprises a projector, a depth sensor and a processor. The projector projects an image onto a projection surface. The depth sensor detects depth information of the projection surface. The processor changes the image content of the image according to the change of the depth information. The present application can freely transform between microcosmic and macroscopic, thereby providing stability and intuitiveness of human-computer interaction operation.

Description

Technical Field

[0001] This invention relates to a human-computer interaction technology, and more particularly, to an image interaction system and an image interaction method. Background Technology

[0002] With the development of projection technology and human-computer interaction technology, immersive projection systems have been widely used in education, entertainment, and smart home fields. Most existing interactive projection technologies use depth cameras or image sensors to detect user gestures and thus operate on a fixed projected image.

[0003] It is worth noting that existing human-computer interaction technologies, whether using touch screens, optical detection, or depth cameras for gesture control, typically lack automatic adaptability to changes in the environment or operating distance. Particularly in projection interaction systems, the lack of an automatic image content switching mechanism when the distance between the projection device and the projection surface (i.e., depth or projection height) changes further complicates the interaction process. Summary of the Invention

[0004] This invention provides an image interaction system and image interaction method that can dynamically change the content of the projected image and the corresponding operation mode according to the changes in depth information between the projection device and the projection surface, thereby improving the intuitiveness of the interaction.

[0005] The image interaction system of this invention includes (but is not limited to) a projector, a depth sensor, and a processor. The projector projects an image onto a projection surface. The depth sensor detects depth information on the projection surface. The processor is connected to the projector and the depth sensor and is used to change the image content of the image according to changes in the depth information.

[0006] The image interaction method of this invention includes (but is not limited to) the following steps: projecting an image onto a projection surface using a projector; detecting depth information corresponding to the projection surface using a depth sensor; and changing the image content of the image according to the changes in the depth information using a processor.

[0007] Based on the above, the image interaction system and method of this invention establish a dynamic linkage between the projection distance and the macroscopic to microscopic levels of image content. When the projection distance changes, the system can present logically related hierarchical image content. Therefore, this invention provides a smoother, more intuitive, and user-friendly immersive interactive experience, significantly improving the efficiency and stability of human-computer interaction.

[0008] To make the above features and advantages of the present invention more apparent and understandable, specific embodiments are described below in conjunction with the accompanying drawings. Attached Figure Description

[0009] Figure 1 This is a block diagram of an image interaction system according to an embodiment of the present invention;

[0010] Figure 2 This is a schematic diagram illustrating a usage scenario of an image interaction system according to an embodiment of the present invention;

[0011] Figure 3 This is a flowchart of an image interaction method according to an embodiment of the present invention;

[0012] Figure 4 This is a flowchart of a method for changing image content according to an embodiment of the present invention;

[0013] Figure 5 This is a schematic diagram illustrating the changes in image content and operation mode with depth range according to an embodiment of the present invention;

[0014] Figure 6 This is a flowchart of a method for obtaining multimedia data based on a depth range according to an embodiment of the present invention;

[0015] Figure 7A and Figure 7B This is a schematic diagram illustrating the node parameters and hierarchical relationship in an Earth navigation scenario according to an embodiment of the present invention;

[0016] Figure 8 This is a flowchart illustrating a user operation detection method according to an embodiment of the present invention;

[0017] Figure 9 This is a flowchart illustrating a method for determining execution permissions based on a depth range according to an embodiment of the present invention;

[0018] Figure 10A and Figure 10B This is a schematic diagram of the node parameters and hierarchical relationship in a smart home application scenario according to another embodiment of the present invention. Detailed Implementation

[0019] Figure 1 This is a block diagram of an image interaction system 100 according to an embodiment of the present invention. Please refer to... Figure 1 The image interaction system 100 may be a computing host integrated into a desk lamp, a suspended projection device, or other position-adjustable electronic device. The image interaction system 100 includes (but is not limited to) a projector 110, a depth sensor 120, an image sensing device 130, a speaker 140, a communication transceiver 150, and a processor 160.

[0020] Projector 110 is, for example, an LCD projector, a digital light processing projector (DLP projector), or a laser projector. In an embodiment, projector 110 is used to receive image signals output by processor 160 and project images onto a projection surface (e.g., a wall, projection screen, whiteboard, or other surface).

[0021] The depth sensor 120 may be a structured light, time-of-flight (ToF), stereo vision, or laser scanning device. In an embodiment, the depth sensor 120 is used to detect the distance or depth value between its representative position or the image interaction system 100 and the projection surface, and to generate corresponding depth information.

[0022] Image sensing device 130 may be a complementary metal-oxide-semiconductor (CMOS) or charge-coupled device (CCD) camera. In an embodiment, image sensing device 130 is used to capture images of the area where the projection surface is located. In some applications, image sensing device 130 is used to sense user actions or movements in front of the projection surface. In an embodiment, depth sensor 120 may be integrated with image sensing device 130 into a single module, such as an RGB-D camera.

[0023] In this embodiment, the speaker 140 is used to receive the audio signal output by the processor 160 and play the corresponding sound to provide auditory feedback in conjunction with the image content.

[0024] The communication transceiver 150 is, for example, a wireless communication transceiver circuit such as Wi-Fi, mobile communication, Bluetooth, or Zigbee. In an embodiment, the communication transceiver 150 is used to enable the image interaction system 100 to exchange data with external devices (e.g., smart home devices) or a network.

[0025] Processor 160 is connected to projector 110, depth sensor 120, image sensing device 130, speaker 140, and communication transceiver 150. Processor 160 may be a central processing unit (CPU), graphics processing unit (GPU), application-specific integrated circuit (ASIC), or a combination thereof. In an embodiment, processor 160 is used to execute the image interaction method of the embodiments of the present invention, and may load and execute various program codes, software modules, and / or data stored in memory (not shown).

[0026] In this embodiment, the image interaction system 100 also includes a multimedia database 50. The multimedia database 50 may be built into the memory of the image interaction system 100, an external storage device, or a cloud server. In this embodiment, the multimedia database 50 is used to store multimedia data related to image content, such as images, videos, sound files, and corresponding node parameters. The processor 160 can read the required multimedia data from the multimedia database 50.

[0027] Figure 2 This is a schematic diagram illustrating a usage scenario of the image interaction system 100 according to an embodiment of the present invention. Please refer to... Figure 2 An image interaction system 100 (taking a desk lamp as an example) is positioned above a table DK. The tabletop of the table DK serves as the projection surface PP. A depth sensor 120 detects the vertical distance between a representative position of the image interaction system 100 (e.g., the lamp body) and the projection surface PP; this distance is the depth value D1, corresponding to depth information. The user can manually or electrically adjust the height of the projector 110 of the image interaction system 100, thereby changing the depth value D1.

[0028] To facilitate understanding of the operation flow of the embodiments of the present invention, numerous embodiments will be used to describe the operation flow of the embodiments of the present invention in detail below, along with examples. Figures 1 to 2 The various elements or devices described herein illustrate the methods of embodiments of the present invention.

[0029] Figure 3 This is a flowchart of an image interaction method according to an embodiment of the present invention. Please refer to... Figure 3 The processor 160 controls the projector 110 to project an image onto the projection surface PP (step S310). Specifically, in the initial state, the processor 160 can preset an initial image, such as the main menu screen or a wide-area macroscopic image.

[0030] The processor 160 continuously detects the depth information corresponding to the projection surface PP via the depth sensor 120 (step S320). Specifically, the depth information defines the spatial distance between the image interaction system 100 and the projection surface PP. This distance can be quantified into a depth value. In this embodiment, the processor 160 performs initial plane calibration when the system starts up, defines the projection surface PP with no object placed on it as the reference height zero, and calculates subsequent depth values ​​based on this reference.

[0031] The processor 160 changes the image content based on changes in depth information (step S330). Specifically, "changes in depth information" refers to a change in depth value sufficient to cross a preset (depth) range. When the user adjusts the position of the projector 110, causing a change in the depth value, the processor 160 detects this change, selects new multimedia data from the multimedia database 50, and then controls the projector 110 to project the image from the new multimedia data. Thus, the projected content dynamically changes with the position of the projector 110.

[0032] Figure 4 This is a flowchart of a method for changing image content according to an embodiment of the present invention. Please refer to... Figure 4 When the processor 160 determines that the change in depth information is a change in depth value from large to small, the processor 160 changes the image content from distant view content to close view content (step S410). Specifically, "distant view content" refers to a more macroscopic and general image, while "close view content" refers to a more microscopic and specific detail image. Figure 2 For example, when a user lowers the image interaction system 100 to bring it closer to the projection surface PP, the projected image will scale from a panoramic view of the entire Earth (distant view content) to a scene of the African continent (close view content).

[0033] Conversely, when the processor 160 determines that the change in depth information is a change in depth value from small to large, the processor 160 changes the image content from near-view content to far-view content (step S420). Figure 2 For example, when the user raises the image interaction system 100 away from the projection surface PP, the projected image will change from a scene of the African continent (close-up content) to a full view of the Earth (distant content).

[0034] Figure 5 This is a schematic diagram illustrating how image content and operation mode change with depth range according to an embodiment of the present invention. Please refer to... Figure 5 To enable content switching, the processor 160 can map detected depth values ​​to multiple pre-defined depth intervals. In this embodiment, the near-view content and the far-view content are in a hierarchical scaling relationship. The multiple depth intervals may include a first depth interval corresponding to a larger projection depth, a second depth interval corresponding to a medium projection depth, and a third depth interval corresponding to a smaller projection depth. Each depth interval is subject to defined upper and lower limits for its depth values. That is, each depth interval is a range of depth values ​​between a specific upper and lower limit.

[0035] Figure 6 This is a flowchart of a method for obtaining multimedia data based on depth ranges according to an embodiment of the present invention. Please refer to... Figure 6The processor 160 can determine the depth range corresponding to the currently detected depth value (step S610). That is, the processor 160 determines the depth range corresponding to which depth range the depth value falls.

[0036] When the depth value of the depth information is within the first depth range, the processor 160 can obtain the first multimedia data corresponding to the first depth range from the multimedia database 50 according to the first node parameters, and use the image in this first multimedia data as the image for projection by the projector 110 (step S620). Figure 5 For example, when the projection depth (e.g., depth value D1) is in the first depth range (e.g., 50 to 70 cm or 45 to 65 cm), the corresponding content range is the widest (most), and the image interaction system 100 will display the distant content.

[0037] When the depth value of the depth information is within the second depth range, the processor 160 can retrieve the second multimedia data corresponding to the second depth range from the multimedia database 50 according to the second node parameters, and use the image in this second multimedia data as the image for projection by the projector 110 (step S630). Figure 5 For example, when the projection depth (e.g., depth value D2) is in the second depth range (e.g., 30 to 50 cm or 25 to 45 cm), the corresponding content range is smaller (medium) than the first depth range, and the image interaction system 100 will display the content that is closer to the first multimedia data. In other words, the image of the first multimedia data is the content that is farther away from the second multimedia data.

[0038] When the depth value of the depth information is within the third depth range, the processor 160 can obtain the third multimedia data corresponding to the third depth range from the multimedia database 50 according to the third node parameters, and use the image in this third multimedia data as the image for projection by the projector 110 (step S640). Figure 5 For example, when the projection depth (e.g., depth value D3) is in the third depth range (e.g., 10 to 30 cm), the corresponding content range is smaller (less) compared to the second depth range, and the image interaction system 100 displays content that is closer to the second multimedia data. In other words, the images of the first and second multimedia data are content that is farther from the third multimedia data.

[0039] The aforementioned first, second, and third node parameters are used to define the hierarchy and correlation between corresponding multimedia data to ensure logical continuity in image content switching. The second node parameter is at a lower level than the first node parameter and includes some content from the first node parameter. Similarly, the third node parameter is at a lower level than the second node parameter and includes some content from the second node parameter.

[0040] For example, Figure 7A and Figure 7B This is a schematic diagram illustrating the node parameters and hierarchical relationships in an Earth navigation scenario according to an embodiment of the present invention. Please refer to... Figure 7A and Figure 7B This is an example of how the present invention can be applied to educational exploration or ecological learning. In this context, the image content of the first multimedia data is an aerial view of the Earth (L11), the image content of the second multimedia data is a scene of a specific continent (e.g., the African continent, L12), and the image content of the third multimedia data is a specific animal in that continent (e.g., an elephant, L13).

[0041] like Figure 7B As shown, the processor 160 manages these image contents through hierarchical node parameters. The first node parameter can be defined as [L11, Earth], which serves as the ancestor node at the top of the hierarchy. The second node parameter can be defined as [L12, Earth, Africa], which serves as the parent node at the next level and includes the content of the first node parameter (Earth). The third node parameter can be defined as [L13, Earth, Africa, Elephant], which serves as the child node at the bottom of the hierarchy and includes the content of the second node parameter (Earth, Africa). Through this structure, the processor 160 can provide a parent-child image zooming experience across different depth ranges, allowing viewers to explore from the macroscopic Earth layer by layer to the microscopic details of animals.

[0042] It should be noted that the above embodiment uses three depth intervals as an example, but the number of depth intervals and the corresponding depth value range can still be changed according to actual needs.

[0043] Please refer to Figure 5 Different depth ranges can also correspond to different user operation modes. For example, larger operation ranges are allowed in the first and second depth ranges, while smaller operation ranges are allowed in the third depth range. This will be discussed in detail later.

[0044] Figure 8 This is a flowchart illustrating a user operation detection method according to an embodiment of the present invention. In addition to changing image content based on depth information, the image interaction system 100 of the present invention can also detect user gesture operations. Please refer to... Figure 8 The processor 160 can capture images of user operations via the image sensor 130 (step S810). Figure 2 For example, a user operation image includes the user's hand or other operation objects on the projection surface PP.

[0045] Processor 160 can identify the object being operated on and its operation parameters in the user's operation image (step S820). Specifically, the object being operated on is, for example, the user's hand or fingers. The operation parameters are parameters obtained by quantifying or classifying the actions of the object being operated on. In an embodiment, processor 160 may have one or more built-in artificial intelligence hand recognition modules or may send the user's operation image to a cloud server via a communication transceiver 150 to analyze the user's operation image and generate key point information of the hand object. This key point information can be used to parse specific operation parameters. For example, gestures such as drag, wave, click, or touch. In another embodiment, processor 160 can identify the operation parameters of the object being operated on by comparing the image features of a reference gesture.

[0046] The processor 160 can determine the execution permission of the current operation parameters based on the depth information previously detected by the depth sensor 120 (step S830). Specifically, the execution permission defines whether the image interaction system 100 allows a certain gesture operation to be performed at a specific depth value or depth range.

[0047] The processor 160 can execute the operation corresponding to the operation parameters according to the determined execution permissions (step S840). The execution permissions determine whether the operation corresponding to the operation parameters is allowed. That is, if the current gesture operation is allowed, the processor 160 can execute the corresponding function (e.g., rotating the Earth image, switching scenes, or interacting with objects, but not limited to these); if it is not allowed, the processor 160 will ignore the gesture operation.

[0048] Figure 9 This is a flowchart illustrating a method for determining execution permissions based on a depth range according to an embodiment of the present invention. Figure 8 Detailed explanation of step S830. Please refer to... Figure 9 The processor 160 can determine the depth range corresponding to the depth value of the current depth information (step S910). That is, the processor 160 determines the depth value range corresponding to which depth range the depth value falls.

[0049] When the depth value of the depth information is within the first depth range or the second depth range, the processor 160 may allow operations corresponding to operation parameters with a larger amplitude, and prohibit / disallow operations corresponding to operation parameters with a smaller amplitude (step S920). Here, "operation with a larger amplitude" refers to a gesture with a large range of motion that does not require high precision. For example, the aforementioned drag gesture or Figure 5 The wave gesture shown is G1. "Smaller movements" refer to gestures with a concentrated range of motion that require high precision. For example, Figure 5The gesture shown is either a click (G2) or a touch gesture. In other words, when the projection depth is large and the image is expansive, users can interact using large gestures; conversely, they can interact using small gestures.

[0050] Conversely, when the depth value of the depth information is in the third depth range, the processor 160 can disable / disallow operations corresponding to larger amplitude operation parameters, and allow operations corresponding to smaller amplitude operation parameters (step S930). In other words, when the projection depth decreases and the image becomes more detailed and refined, the image interaction system 100 switches the operation mode to precise clicks or touches to facilitate accurate user interaction. Thus, the precision of the operation can match the detail of the image content.

[0051] by Figure 7A and Figure 7B For example, in one application scenario, when a user stands in front of the projection plane PP, and the projector 110 is 70 centimeters away from the projection plane PP, the image interaction system 100 displays a panoramic view of the Earth, allowing users to rotate the Earth image to select different continents or oceans, etc. For instance, the user can manipulate the Earth image using drag-and-drop gestures to make the Africa map face the user.

[0052] The user lowers the projector 110 to a distance of 50 centimeters from the projection surface PP. At this time, the image interaction system 100 magnifies the Earth image, displaying an African scene, allowing the user to switch between forest areas using hand gestures. For example, the user can use hand gestures to switch between scenes of the African savanna, national parks, and forests, and remain in the forest scene.

[0053] When the user lowers the projector 110 to a distance of 20 centimeters from the projection surface PP, the image interaction system 100 enters touch mode, displaying a specific microscopic scene (such as an elephant). The user can interact with the elephant image by clicking, and learn about its calls, habits, and anatomy.

[0054] Figure 10A and Figure 10B This is a schematic diagram illustrating the node parameters and hierarchical relationship in a smart home application scenario according to another embodiment of the present invention. Please refer to... Figure 10A and Figure 10B The embodiments of this invention can also be applied to the field of smart home control. In this context, the image content also follows a hierarchical relationship. For example, the image content of the first multimedia data is a floor plan L21 of the entire home environment. The image content of the second multimedia data is an interior view of a specific room (e.g., a room class diagram L22 of the living room, bedroom, etc.). The image content of the third multimedia data is a class diagram L23 of the home appliances and their control interfaces in the specific room.

[0055] like Figure 10B As shown, the node parameters in this application scenario also have a hierarchical relationship. The first node parameter can be defined as [L21, home]. The second node parameter can be defined as [L22, home, room], which is at a lower level than the first node parameter and includes the content of the first node parameter (L21, home). Following this structure, the third node parameter can be defined as [L23, home, room, controller], which is at a lower level than the second node parameter and includes the content of the second node parameter (L23, home, room).

[0056] In one application scenario, when a user stands in front of the projection surface PP and the projector 110 is 70 cm away from the projection surface PP, the image interaction system 100 displays a panoramic view of the entire home environment (such as each room and device). The user can select different rooms and view the current status of devices (such as lights, air conditioning, and sound system) by dragging and dropping gestures. For example, the user can drag and drop gestures to navigate to the living room.

[0057] The user lowers the projector 110 to a distance of 50 centimeters from the projection surface PP. At this point, the image interaction system 100 automatically zooms in to display the equipment in the selected room, such as the room's lighting, temperature, and appliance status. For example, the user can adjust the light brightness or switch room equipment by waving their hand.

[0058] When the user lowers the projector 100 to a distance of 20 centimeters from the projection surface PP, the image interaction system 100 enters touch mode and displays detailed device information and a control interface. For example, users can turn lights on or off, adjust the air conditioning temperature, or start the sound system to achieve precise home appliance management.

[0059] As a result, users can adjust the projection depth to move from an overview of the entire house floor plan to specific rooms, and finally perform precise touch operations on individual home appliances, achieving intuitive and efficient smart home management.

[0060] In summary, in the image interaction system and method of this invention, by detecting changes in depth information between the projection device and the projection surface, not only can the image content of the projected image be dynamically changed, but the corresponding operation mode can also be switched synchronously. Specifically, this invention establishes a direct correlation between the projection depth and the macroscopic and microscopic levels of the image content through hierarchical node parameters; simultaneously, it also matches the projection depth with the amplitude of the user's gestures (e.g., large waving or small clicking), establishing a dynamic switching mechanism for execution permissions. Therefore, this invention effectively solves the problem of inconsistency between visual presentation and operation methods in the prior art, providing a highly integrated, intuitive, and smooth immersive interactive experience, thereby significantly improving the convenience and efficiency of human-computer interaction.

[0061] Although the present invention has been disclosed above by way of embodiments, it is not intended to limit the present invention. Any person skilled in the art may make some modifications and refinements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the scope of the appended claims.

Claims

1. An image interaction system, comprising: A projector is used to project images onto a projection surface; A depth sensor is used to detect depth information corresponding to the projection surface; as well as The processor, connected to the projector and the depth sensor, is used for: The image content of the image is changed according to the changes in the depth information.

2. The image interaction system according to claim 1, wherein the processor is further configured to: When the change in depth information is a change in depth value from large to small, the image content of the image is changed from distant view content to close view content; and When the change in depth information is that the depth value increases from small to large, the image content of the image is changed from the near-view content to the far-view content.

3. The image interaction system according to claim 2, wherein the near-view content and the far-view content have a hierarchical scaling relationship. When the depth value of the depth information is within a first depth range, first multimedia data corresponding to the first depth range is obtained from the multimedia database according to the first node parameter, and the image in the first multimedia data is used as the image. When the depth value of the depth information is within a second depth range, second multimedia data corresponding to the second depth range is obtained from the multimedia database according to the second node parameter, and the image in the second multimedia data is used as the image. The second node parameter is at a lower level than the first node parameter, the second node parameter includes a portion of the content of the first node parameter, the image of the second multimedia data is the close-up content relative to the first multimedia data, and the image of the first multimedia data is the distant-up content relative to the second multimedia data. When the depth value of the depth information is located in the third depth range, the third multimedia data corresponding to the third depth range is obtained from the multimedia database according to the third node parameter, and the image in the third multimedia data is used as the image. The third node parameter is at a lower level than the second node parameter, the third node parameter includes part of the content of the second node parameter, the image of the third multimedia data is the close-up content compared to the first and second multimedia data, and the images of the first and second multimedia data are the distant-up content compared to the third multimedia data.

4. The image interaction system according to claim 1, further comprising: An image sensing device, connected to the processor, is used to capture images of user operations, wherein the processor is further used to: Identify the operation object in the user operation image and the operation parameters of the operation object; and The execution permissions of the operation parameters are determined based on the depth information; and The operation corresponding to the operation parameter is executed according to the execution permission, wherein the execution permission determines whether the operation corresponding to the operation parameter is allowed.

5. The image interaction system according to claim 4, wherein the processor is further configured to: When the depth value of the depth information is within a first depth range or a second depth range, operations corresponding to the larger amplitude of the operation parameter are permitted, while operations corresponding to the smaller amplitude of the operation parameter are not permitted; and When the depth value of the depth information is in the third depth range, operations corresponding to the larger amplitude of the operation parameter are not allowed, while operations corresponding to the smaller amplitude of the operation parameter are allowed.

6. An image interaction method, comprising: The image is projected onto the projection surface using a projector. The depth information corresponding to the projection surface is detected by a depth sensor; as well as The processor changes the image content of the image based on the changes in the depth information.

7. The image interaction method according to claim 6, wherein changing the image content of the image based on the change in the depth information includes: When the change in the depth information is that the depth value changes from large to small, the image content of the image is changed from distant view content to close view content; as well as When the change in depth information is that the depth value increases from small to large, the image content of the image is changed from the near-view content to the far-view content.

8. The image interaction method according to claim 7, wherein the near-view content and the far-view content have a hierarchical scaling relationship, and changing the image content of the image according to the change of the depth information includes: When the depth value of the depth information is within a first depth range, first multimedia data corresponding to the first depth range is obtained from the multimedia database according to the first node parameter, and the image in the first multimedia data is used as the image. When the depth value of the depth information is within the second depth range, second multimedia data corresponding to the second depth range is obtained from the multimedia database according to the second node parameter, and the image in the second multimedia data is used as the image. The second node parameter is at a lower level than the first node parameter, the second node parameter includes part of the content of the first node parameter, the image of the second multimedia data is the close-up content compared to the first multimedia data, and the image of the first multimedia data is the distant-up content compared to the second multimedia data. as well as When the depth value of the depth information is located in the third depth range, the third multimedia data corresponding to the third depth range is obtained from the multimedia database according to the third node parameter, and the image in the third multimedia data is used as the image. The third node parameter is at a lower level than the second node parameter, the third node parameter includes part of the content of the second node parameter, the image of the third multimedia data is the close-up content compared to the first and second multimedia data, and the images of the first and second multimedia data are the distant-up content compared to the third multimedia data.

9. The image interaction method according to claim 6, further comprising: Capture images of user operations using an image sensing device; The processor identifies the operation object in the user operation image and the operation parameters of the operation object. The processor determines the execution permissions of the operation parameters based on the depth information; as well as The processor executes the operation corresponding to the operation parameter according to the execution permission, wherein the execution permission determines whether the operation corresponding to the operation parameter is allowed.

10. The image interaction method according to claim 9, wherein determining the execution permission of the operation parameters based on the depth information includes: When the depth value of the depth information is within the first depth range or the second depth range, operations corresponding to the larger magnitude of the operation parameter are allowed, while operations corresponding to the smaller magnitude of the operation parameter are not allowed. as well as When the depth value of the depth information is in the third depth range, operations corresponding to the larger amplitude of the operation parameter are not allowed, while operations corresponding to the smaller amplitude of the operation parameter are allowed.

Images