Physical space interactive operating system

Abstract

The invention provides a physical space interaction operation system. The physical space interaction operation system comprises a space signal acquisition module, a space data module, a control module, a feedback module, an execution module and a selectable configuration terminal, the acquisition module acquires a spatial position indication signal and supports mode switching, the data module stores explicit / implicit mixed spatial relationship data, the control module determines target equipment through preprocessing and matching, the feedback module outputs differentiated physical feedback, and the execution module executes an instruction and returns a state. According to the invention, the method can achieve the convenient interaction of "what is what is what is what is what is what is what is what is what is what is what is what is what is what is what is what is what is what is what is, solves the problems of tedious operation and no clear feedback in the prior art, supports multi-

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and in particular to a physical space interaction operating system. Background Technology

[0002] With the rapid development of IoT technology, the number of smart devices in physical spaces (such as homes, offices, and production workshops) has surged, and the types of devices are becoming increasingly diverse. However, existing multi-device interaction technologies still have many shortcomings that urgently need to be addressed, severely restricting user experience and industry development: First, interaction relies on intermediaries. Users need to control devices through tools such as dedicated remote controls and mobile apps, and must search for the target among numerous device identifiers. Especially when there are many devices, the operation path is long and the efficiency is extremely low. Second, there is a lack of spatial correlation. Existing technologies cannot directly associate the user's spatial pointing action with the target device. Users need to manually confirm the device identifier, which can easily lead to misoperation due to identifier confusion. Third, there is no clear device selection feedback mechanism. After the user triggers the selection operation, they cannot confirm the selected target device in an intuitive way, further increasing the probability of misoperation. Fourth, the control architecture is rigid and singular. Most systems only support one architecture, either centralized or distributed, and cannot flexibly adapt to the needs of different scenarios such as space scale (such as small desktops and large workshops), device distribution (centralized or decentralized), and cost budget, resulting in poor compatibility and scalability.

[0003] Taking smart office scenarios as an example, when users need to control multiple printers, projectors, air conditioners, and other devices in the office area, they need to carry multiple dedicated remote controls or navigate through the control interfaces of the corresponding devices in a mobile app, which is cumbersome. Misselecting a device may lead to issues such as printing sensitive documents incorrectly or accidentally starting unrelated devices. In industrial production workshops, operators need to switch between device control interfaces at different workstations using a fixed control console, making it impossible to quickly select target devices and issue commands via long-distance spatial pointing, severely impacting production efficiency. These shortcomings of existing technologies highlight the necessity of developing physical space interaction solutions that are spatially relevant, convenient, and adaptable to various scenarios. Summary of the Invention

[0004] In view of this, the embodiments of this application provide a physical space interaction operating system, which addresses the problems of cumbersome operation, lack of spatial correlation, lack of clear selection feedback and poor architecture adaptability in existing multi-device interaction technologies. It realizes convenient "what you point to is what you get" interaction, realizes the mapping logic from spatial intention to device entity, and supports multiple architectures to adapt to different scenarios, thereby improving the efficiency, accuracy and flexibility of multi-device interaction.

[0005] The technical solution of this application embodiment is implemented as follows: In a first aspect, embodiments of this application provide a physical space interaction operating system and a space signal acquisition module for acquiring spatial position indication signals; Spatial data module, used to store or generate spatial relationship data of at least one controlled device; The control module is communicatively connected to the space signal acquisition module and the space data module. It is used to receive the space position indication signal, perform matching processing in combination with the space relationship data to determine the target controlled device, and output the device selection signal and control command. The feedback module, which is communicatively connected to the control module, is used to receive the device selection signal and output differentiated physical feedback to indicate the target controlled device. An execution module, integrated into the controlled device and communicatively connected to the control module, is used to receive control commands, execute corresponding operations, and return the operation execution status.

[0006] Secondly, embodiments of this application also provide a physical space interaction control method, including the following steps: Spatial position indication signals are acquired through a spatial signal acquisition module; The control module acquires spatial relationship data of the controlled devices stored or generated in the spatial data module; The control module matches the spatial position indication signal with the spatial relationship data to determine the target controlled device; The control module sends a device selection signal to the feedback module, and the feedback module outputs differentiated physical feedback. After receiving the confirmation command, the control module sends a control command to the execution module of the target controlled device; The execution module performs the corresponding operation and sends the execution status back to the control module.

[0007] The embodiments of this application have the following beneficial effects: Users can select target devices simply by pointing, without needing to physically touch the devices or search through complex interfaces, significantly shortening the operation path and improving interaction efficiency. The differentiated physical feedback from the feedback module solves the problem of no intuitive prompts for device selection in existing technologies, reducing the probability of misoperation and improving interaction accuracy from the source. The modular architecture design does not limit specific hardware forms or communication protocols, making it compatible with various controlled devices and different application scenarios, while reserving ample space for future technology iterations, possessing strong adaptability and scalability. The status feedback function of the execution module ensures the integrity of the control loop, allowing users to grasp the operation results in real time, further enhancing the reliability of system interaction and user experience. Attached Figure Description

[0008] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0009] Figure 1 This is a block diagram illustrating the principle of the physical space interactive operating system provided in this application embodiment; Figure 2 This is a schematic flowchart of the physical space interaction control method provided in the embodiments of this application; Figure 3 This is a schematic diagram of the composition structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0010] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. It should be understood that the accompanying drawings in this application are for illustrative and descriptive purposes only and are not intended to limit the scope of protection of this application. Furthermore, it should be understood that the schematic drawings are not drawn to scale. The flowcharts used in this application illustrate operations implemented according to some embodiments of this application. It should be understood that the operations in the flowcharts may not be implemented in sequence, and steps without logical contextual relationships may be reversed or implemented simultaneously. In addition, those skilled in the art, guided by the content of this application, may add one or more other operations to the flowcharts, or remove one or more operations from the flowcharts.

[0011] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0012] Furthermore, the described embodiments are merely some, not all, of the embodiments of this application. The components of the embodiments of this application described and illustrated herein can typically be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0013] In the following description, the terms "first, second, third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0014] It should be noted that the term "comprising" will be used in the embodiments of this application to indicate the presence of the features declared thereafter, but does not exclude the addition of other features.

[0015] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application and is not intended to limit this application.

[0016] See Figure 1 , Figure 1 This is a block diagram of the physical space interactive operating system provided in the embodiments of this application, such as... Figure 1 As shown in the embodiments of this application, the physical space interaction operating system includes: The space signal acquisition module is used to acquire space position indication signals; Spatial data module, used to store or generate spatial relationship data of at least one controlled device; The control module is communicatively connected to the space signal acquisition module and the space data module. It is used to receive the space position indication signal, perform matching processing in combination with the space relationship data to determine the target controlled device, and output the device selection signal and control command. The feedback module, which is communicatively connected to the control module, is used to receive the device selection signal and output differentiated physical feedback to indicate the target controlled device. An execution module, integrated into the controlled device and communicatively connected to the control module, is used to receive control commands, execute corresponding operations, and return the operation execution status.

[0017] The core of this application's embodiments lies in constructing the architecture of a physical space interactive operating system, thereby breaking the limitations of existing technologies that "rely on intermediate media and have no spatial association," and realizing the construction of a complete interactive closed loop of "spatial pointing - device matching - feedback - control - status feedback," fundamentally solving the pain points of "difficult selection, complicated control, and lack of confirmation" in multi-device scenarios.

[0018] The spatial signal acquisition module corresponds to the "input device," and its core function is to acquire the user's spatial position indication signal. The hardware can be a terminal integrating multiple sensors (such as a smart remote control with a UWB chip and AI camera, or a stylus with a gyroscope). Communication methods support Bluetooth, WiFi, or wired serial port, serving as the basic input unit for achieving "what you point to is what you get." The spatial data module corresponds to the "device spatial relationship data module." The hardware can use a combination of embedded storage chips (local storage) and a cloud server (remote backup), supporting real-time data updates and retrieval, providing accurate data support for device matching. The control module corresponds to the "control unit," and the hardware can be ARM-based. Cortex-A series processors (centralized architecture), ESP32 microcontrollers (distributed sub-units), or FPGA chips (high real-time scenarios) establish communication with other modules through standardized communication interfaces (such as RS485, MQTT protocol), and are responsible for signal parsing, data matching, instruction generation and issuance; the feedback module corresponds to the "feedback unit", the core of which is to provide physical visualization feedback, solving the problem of "no intuitive prompts for selected devices" in existing technologies. The hardware can be flexibly selected according to the type of device (such as micro vibration motors for small devices, and LED light strips + buzzers for large devices); the execution module corresponds to the "device execution end", which is integrated inside the controlled device and consists of relays, driver chips, etc. After receiving control commands, it drives the device to complete the corresponding actions, and at the same time, it sends the execution status (such as "action completed" or "fault alarm") back to the control module through feedback pins or wireless communication to ensure the integrity of the control closed loop.

[0019] It should be noted that the spatial signal acquisition module in this embodiment can be any device capable of acquiring spatial signals, such as a remote control, wristband, or camera. The control module can select processors with different performance levels depending on the scenario. For communication protocols, wireless protocols such as Bluetooth, WiFi, and LoRa, or wired protocols, can be selected according to scenario requirements. For the type of controlled device, it can cover various electrical appliances such as smart home devices, industrial equipment, and office equipment. This not only fully covers all system composition schemes, including centralized, distributed, and integrated systems, but also reserves ample space for subsequent technology iterations (such as adding new sensor types and expanding communication methods).

[0020] In some embodiments, the spatial signal acquisition module supports the acquisition of at least one signal type, which includes at least one of coordinate signals, distance signals, visual signals, and orientation signals.

[0021] Coordinate signals can be acquired in two ways. First, relative coordinates can be acquired via touch-enabled input devices (such as touchpads or joysticks). Hardware options include capacitive touch chips (such as the FT6236), suitable for precise positioning of desktop devices (such as printers and monitors). Second, absolute coordinates can be acquired via positioning modules (such as GPS, BeiDou, or indoor UWB positioning). UWB chips such as the DW1000 can be used, offering positioning accuracy up to 10cm, suitable for device positioning in large spaces (such as workshops and exhibition halls). Distance signal acquisition relies on ranging technology. Hardware options include Bluetooth 5.0 (supporting RSSI ranging with an error of ±1m), UWB ToF (time-of-flight ranging with an error of ±5cm), or ultrasonic sensors (such as the HC-SR04, suitable for short-range ranging). This is mainly used for positioning freely placed devices (such as Bluetooth speakers and portable projectors) without the need for preset coordinates. Visual signal acquisition relies on cameras with AI processing capabilities (such as modules equipped with OV5640 sensors + NPU), using image recognition algorithms (such as YOLOv5) to identify visual markings on the device surface (such as QR codes, custom logos), and can also capture user pointing gestures (such as finger pointing, arm waving), adapting to scenarios with dense devices and complex spaces (such as smart office areas with multiple computers and printers). Aspect signals are acquired through angle sensors; hardware options include Bluetooth AoA / AoD modules (such as Nordic nRF52840) or gyroscopes (such as MPU6050), measuring the azimuth angle of the user's pointing (accuracy ±2°), adapting to long-distance pointing scenarios (such as conference rooms where a user stands at the door pointing at a projector in the back row).

[0022] In some embodiments, the spatial signal acquisition module is configured to enter a spatial selection mode, in which the acquired spatial position indication signal is used exclusively for matching the target controlled device; the signal acquired in the non-spatial selection mode is used to control the functional parameters of the selected controlled device.

[0023] To address the problem of misoperation caused by the conflict and overlap of "device selection" and "function control" operations in the prior art, this application embodiment improves the smoothness of interaction by using signal processing logic with two different modes.

[0024] The spatial selection mode can be triggered by hardware (such as a dedicated "select" button on the input device, which turns the LED indicator red when pressed), software (such as a mode switching button on the configuration terminal APP), and gesture (such as the user waving their hand twice consecutively, which is recognized by the visual signal acquisition module). In this mode, the acquired spatial position indication signal is marked as a "selection signal" by the control module and is only used to match the device data in the spatial data module to determine the target controlled device. For example, after the user presses the selection button, the displacement signal of pushing the joystick is interpreted as "device coordinates" rather than adjusting the device parameters. The non-spatial selection mode is the default mode (the LED indicator turns green after triggering) and does not require active triggering. It is automatically entered after the spatial selection mode ends (or the user actively exits). In this mode, the acquired signal is marked as a "control signal," and the control module directly converts it into the corresponding function command and sends it to the selected controlled device. For example, after exiting the selection mode, the displacement signal of pushing the joystick can adjust the air conditioner temperature (push up to heat up, push down to cool down), and rotating the joystick can adjust the brightness of the lights.

[0025] The above approach establishes a standardized "select first, control later" interaction logic, fundamentally avoiding accidental operations. For example, when a user needs to control one of multiple printers, they first press the selection button (triggering selection mode), point to the target printer, and the system selects the device through signal matching and provides feedback. After confirming the selection, the user releases the selection button (entering control mode) and sends "print" or "copy" commands through the input device's buttons. At this time, the commands only affect the selected printer and will not affect other devices. This approach clarifies the triggering method, signal marking rules, and processing logic for mode switching, ensuring that it can cover all similar interaction scenarios such as industrial control and smart homes, while reserving interfaces for subsequent function expansion (such as adding a "batch selection" mode).

[0026] In some embodiments, the spatial relationship data includes explicit spatial relationship data, implicit spatial relationship data, or a mixture of both; the explicit spatial relationship data includes the identification information and preset physical parameters of the controlled device, and the implicit spatial relationship data includes the identification information and real-time detection parameters of the controlled device.

[0027] This application's embodiments adopt an "explicit + implicit" dual data system design, which is compatible with both "fixed deployment devices" and "free mobile devices," solving the problems of poor spatial data adaptability and inability to cover complex scenarios in the prior art.

[0028] Explicit spatial relationship data is pre-defined, fixed data, primarily used for standardized deployments and fixed-location devices (such as air conditioners, embedded printers, and fixed shelves). The data format uses a structured format of "Device ID - Occupancy Size - Physical Coordinate Range," where the Device ID is a unique code (e.g., "AC-001" represents air conditioner number 1), the occupancy size is expressed as "length × width × height" (unit: mm), and the physical coordinate range is defined using planar / 3D coordinates (e.g., planar coordinates "x1:0, y1:0-x2:500, y2:500," representing the device occupying that coordinate area). Implicit spatial relationship data is dynamically generated in real-time, primarily used for freely placed and variable-location devices (such as Bluetooth speakers, portable projectors, and laptops). The data format uses "Device ID - Relative Distance - Real-time Azimuth Angle - Visual Feature Code," where the relative distance is the real-time distance between the device and the spatial signal acquisition module (unit: cm), the real-time azimuth angle is the angle of the device relative to the acquisition module (range: 0-360°), and the visual feature code is the encoding of a unique identifier on the device's surface (e.g., the string corresponding to a QR code).

[0029] This application allows the use of "mixed data of both," adapting to complex scenarios of "fixed + mobile" hybrid deployments. The matching logic is as follows: After receiving a spatial location indication signal, the control module first determines the signal type (if it's a coordinate signal, explicit data is matched first; if it's a distance / direction signal, implicit data is matched first). If a single data match fails (e.g., a mobile device enters a fixed device area, and the coordinate signal fails to match explicit data), then the system automatically calls the mixed data for joint matching (combining coordinate and distance signals to determine the target device). For example, in a distributed architecture smart exhibition hall scenario, fixed lights and projectors in the exhibition hall use explicit data (preset coordinates and dimensions), while mobile speakers and demonstration computers brought by exhibitors use implicit data (real-time distance and direction). When a user points to a certain area, the system can accurately select the fixed or mobile device within that area through mixed data matching.

[0030] The above approach significantly improves the system's adaptability to complex deployment environments, while ensuring data readability and matching efficiency through structured data formats.

[0031] In some embodiments, the preset physical parameters include the footprint size and physical coordinate range, which are preset by the manufacturer or entered by the user through a configuration terminal; the real-time detection parameters include the relative distance to the spatial signal acquisition module, the real-time azimuth angle, and the visual feature code, which are automatically generated by the control module through an algorithm.

[0032] For explicit spatial relationship data, the preset physical parameters are clearly defined as the footprint size and physical coordinate range. These parameters come from two sources: First, manufacturer-preset parameters. When the equipment leaves the factory, the manufacturer writes the standard footprint size (e.g., "800×200×300mm" for an air conditioner indoor unit) and the recommended installation coordinate range (e.g., coordinates corresponding to "500mm from ceiling, 300mm from wall") into the device's storage chip, which is automatically synchronized to the spatial data module upon system access. Second, user input via a configuration terminal. For non-standard installations or custom deployment scenarios (e.g., placing a printer in a non-preset location), users can drag and drop the device icon to the actual location through the configuration terminal APP's visual interface (e.g., a room floor plan). The system automatically generates the corresponding physical coordinate range. Simultaneously, users can manually input the footprint size (if the actual device size differs from the standard size). After input, the system will use a visual signal acquisition module to photograph the device and verify the accuracy of the footprint size and coordinate range (error tolerance ±50mm).

[0033] For implicit spatial relationship data, the real-time detection parameters are explicitly defined as the relative distance to the spatial signal acquisition module, the real-time azimuth angle, and the visual feature code. These parameters are generated by the control module automatically identifying them using a specific algorithm: the relative distance is calculated using a UWB ToF algorithm; the acquisition module communicates bidirectionally with the device's built-in UWB chip, calculating the distance based on the signal's time of flight (formula: distance = speed of light × time of flight / 2), with a sampling frequency of 10Hz to ensure real-time performance; the real-time azimuth angle is calculated using a Bluetooth AoA algorithm; the acquisition module receives the device's Bluetooth signal through a multi-antenna array and determines the azimuth angle based on the signal's angle of arrival, achieving an accuracy of ±2°; the visual feature code is extracted using an AI image recognition algorithm (such as the SIFT algorithm); the acquisition module captures the device's unique markings (such as QR codes or logos) on its surface and matches them with a pre-stored feature code library to generate a unique visual feature code.

[0034] In some embodiments, the control module supports centralized, distributed, or integrated deployment architectures; the centralized architecture receives signals, constructs unified spatial relationship data, and issues instructions through an independent host; the distributed architecture processes signals and executes instructions by dividing the work between the acquisition module subunit and the device subunit; and the integrated architecture completes signal processing and instruction issuance locally through the built-in processing unit of the acquisition module.

[0035] The deployment architecture of the "control module" in this application embodiment supports three architectures: "centralized, distributed, and integrated," adapting to different hardware costs, scenario scale requirements, cost, and real-time requirements.

[0036] The core of the centralized architecture is "unified management and control." The hardware components include an independent control host (such as an industrial computer equipped with an Intel Core i5 processor), a data gateway, and communication modules. The deployment steps are as follows: deploy the control host in the center of the scenario (such as an office server room); connect all spatial signal acquisition modules and controlled devices through the data gateway; and build a unified spatial relationship database in the control host. Its communication logic is as follows: signals from all acquisition modules are uploaded to the control host. After the host completes data matching and command generation, it distributes the commands to the corresponding devices through the gateway. This approach is suitable for scenarios with concentrated equipment (≥20 units) requiring standardized management (such as large office areas and smart factory workshops). Its advantages include high management and control efficiency and strong data consistency.

[0037] The core of the distributed architecture is "partition autonomy." The hardware components include a main control unit, multiple acquisition module sub-units, and device sub-units. The main control unit uses an ARM Cortex-A9 processor, and the sub-units use ESP32 microcontrollers. The deployment steps are as follows: partition the space according to the scenario (e.g., an exhibition hall divided into areas A, B, and C); deploy one acquisition module sub-unit and one device sub-unit in each partition; establish communication between the main control unit and each sub-unit via the LoRa protocol (adapting to long-distance transmission). The communication logic is as follows: the sub-unit is responsible for signal acquisition, preliminary matching, and command execution within its partition, only uploading critical data (such as device status and operation logs) to the main control unit. This approach is suitable for large-area, multi-partition scenarios (such as large exhibition halls and industrial parks), and its advantages include low transmission latency (≤100ms) and strong anti-interference capabilities.

[0038] The core of the integrated architecture is "miniaturization and low cost." The hardware consists of a processing unit (such as an STM32 microcontroller) directly integrated into the spatial signal acquisition module, eliminating the need for a separate host. The deployment steps are: deploy the acquisition module with the integrated processing unit in the target area (such as a personal desktop); and directly connect a small number of controlled devices (≤5 units) via Bluetooth. Its communication logic is as follows: the acquisition module locally completes signal processing, data matching, and command issuance, eliminating the need for remote transmission. It is suitable for small-scale scenarios (such as personal desktops or small bedrooms), and its advantages are low cost and convenient deployment.

[0039] The three architectures described above can be flexibly switched according to the needs of the scenario (e.g., after the office area is expanded, it can be switched from centralized to distributed, and new partition sub-units can be added), while the core control logic (signal processing, data matching) remains consistent. The centralized architecture is adapted to the management and control of multiple devices in the office area, the distributed architecture is adapted to the management and control of multiple partitions in the exhibition hall, and the integrated architecture is adapted to the management and control of personal desktops.

[0040] In some embodiments, the control module has a signal preprocessing function, including at least one of coordinate normalization, distance signal noise reduction, and image signal enhancement.

[0041] The core purpose of coordinate normalization is to unify the range of coordinate signals from different sources and avoid coordinate deviations caused by different acquisition devices. A linear normalization algorithm (formula: normalized coordinates = (original coordinates - minimum value) / (maximum value - minimum value)) is used to uniformly map the coordinate signals output by different acquisition devices (such as joysticks and UWB positioning) to a standard range of 0-100. For example, the coordinate range output by a joystick is 0-4095. After normalization, it is converted to 0-100, which is consistent with the preset device coordinate range (0-100) in the spatial data module, and adapts to all scenarios that require coordinate matching.

[0042] The core of distance signal noise reduction is to filter out random noise (such as Bluetooth RSSI signal fluctuations) in the original distance signal. By using a moving average filtering algorithm, setting the sliding window size to 5 (i.e. taking the average of 5 consecutive sample values ​​as valid data), and the sampling frequency to 10Hz, the distance measurement error can be reduced from ±50cm to ±5cm. This is suitable for device matching scenarios based on distance signals (such as the positioning of free mobile devices).

[0043] The core of image signal enhancement is to improve the clarity of visual signals and provide high-quality images for subsequent feature recognition. It adopts a multi-step processing method: gamma correction (gamma value = 1.5) is used to improve image brightness; median filtering (window size 3×3) is used to remove noise; and edge enhancement algorithm (Sobel operator) is used to enhance the outline of equipment and visual identification. It is suitable for scenes with low light or a lot of dust (such as industrial workshops) and can improve the accuracy of visual feature recognition.

[0044] In centralized office environments, if the coordinate signals acquired by the joystick are not normalized, their 0-4095 range will not match the device's preset 0-100 coordinate range, leading to incorrect device selection. In smart home scenarios, the raw Bluetooth distance signal fluctuates significantly (±30cm). Without noise reduction, users may mistakenly select an adjacent lamp when pointing at a speaker. In industrial workshops, dim lighting causes blurred visual signals, making it impossible to recognize device visual identifiers without enhancement processing. The embodiments of this application effectively avoid these problems.

[0045] In some embodiments, the feedback module is integrated into the controlled device body or its carrier, including at least one of a light source unit, a vibration unit, a sound source unit and a mechanical unit, and achieves differentiated physical feedback through different state combinations.

[0046] Here, the integration location can be selected according to the device form. Small devices (such as Bluetooth speakers and remote controls) can integrate the feedback module into the device body (such as a vibration motor built into the bottom of the speaker). Large fixed devices (such as air conditioners and printers) can be integrated into their carrier (such as an LED light strip installed on a printer bracket). Devices without a carrier (such as hanging lights) can be directly integrated into the device shell. The hardware composition covers four core types, and each type has specific parameter requirements: the light source unit uses LED light strips (wavelength 505nm green, 620nm red, brightness ≥500cd / m²), supporting three states: on / off, flashing, and color switching; the vibration unit uses a miniature eccentric wheel vibration motor (voltage 3.3V, vibration frequency 100-200Hz), supporting vibrations of different frequencies and frequencies; the sound source unit uses a buzzer (frequency 2000-4000Hz), supporting different tones and durations of prompts; the mechanical unit uses a miniature servo motor (rotation angle 0-180°, response time ≤100ms), supporting mechanical actions such as pointer rotation and small-amplitude extension and retraction. The signal transmission delay of all feedback modules is required to be ≤100ms to ensure that users can receive feedback quickly after pointing at the device, thus improving the smoothness of interaction.

[0047] The core rule of "differentiated physical feedback" is that "one device corresponds to a unique set of feedback combinations." This application's embodiments can categorize basic feedback types according to device type (lighting devices prioritize light source feedback, and audio devices prioritize sound source feedback); or they can categorize auxiliary feedback parameters according to device location (multiple devices of the same type are distinguished by different colors / frequency). For example, in an office area with three printers, printer 1 (near the window) uses "red LED flashing 3 times (frequency 1Hz) + short tone (2000Hz, duration 0.2s)", printer 2 (middle) uses "green LED constantly on for 2s + medium-long tone (3000Hz, duration 0.5s)", and printer 3 (near the door) uses "blue LED flashing 2 times (frequency 2Hz) + long tone (4000Hz, duration 1s)". A Bluetooth speaker in a smart home uses "vibration 2 times (frequency 150Hz) + low-frequency tone (2000Hz)" to avoid confusion with the light source feedback. This design achieves an "interactive pointer" effect in physical space. After the user points to the target area, the selected device can be quickly confirmed by the feedback of color, frequency, and tone, without having to look down at the phone or screen, greatly reducing the probability of accidental operation.

[0048] In some embodiments, an optional configuration terminal is also included. The configuration terminal is communicatively connected to the control module and is used to register the controlled device, edit spatial relationship data, switch the control architecture, configure the feedback mode, and view the operation log.

[0049] Here, the hardware supports smartphone apps, tablet apps, and computer clients (Windows / macOS systems), allowing users to choose according to their preferences. Communication with the control module uses the MQTT lightweight protocol (adapting to wireless communication and reducing power consumption). The computer client also supports wired Ethernet connections (improving configuration stability). Communication encryption uses the AES-128 algorithm to ensure configuration data security. The operation flow of the core functions in this application embodiment is visualized. For example, controlled device registration: the user scans the device's QR code (containing device ID and model) through the configuration terminal, enters the device name (e.g., "living room air conditioner"), and the system automatically enters the device information into the control module to complete the registration; spatial relationship data editing: the terminal provides a scene floor plan (e.g., room layout), the user drags the device icon to the actual location, the system automatically generates the physical coordinate range, and also supports manual input of placeholder dimensions. After editing, clicking "synchronize" will update the spatial data module; control architecture switching: the terminal provides an architecture selection interface (centralized / distributed / integrated). After the user selects the target architecture, the system automatically prompts for the necessary new hardware (e.g., adding a sub-unit when switching to distributed architecture) and guides the deployment steps. Feedback mode configuration: The terminal provides a feedback combination editing interface (e.g., selecting LED color, vibration frequency, and prompt tone). Users can customize the feedback method for each device and support "scenario-based saving" (e.g., "office mode" and "home mode"). Operation log viewing: Log content includes "timestamp-device ID-operation type (optional / control setting)-instruction content-execution status-error information," supporting filtering by time range and device type. Logs can be exported to Excel format for easy troubleshooting and management. All configuration operations are performed offline or semi-offline. After configuration, the data is synchronized to the control module but does not participate in real-time signal acquisition or command issuance, ensuring that the efficiency of real-time interaction is not affected.

[0050] The above approach significantly reduces the barrier to entry and maintenance costs of the system, solving the problems of "complex configuration and the need for professional knowledge" in existing control systems. For ordinary users, no understanding of the underlying technology is required; device access and parameter configuration can be completed through a visual interface. For maintenance personnel, faults can be quickly located through operation logs (e.g., if a device fails to match, signal error information can be viewed in the logs). For new devices, registration and data editing are only required through a configuration terminal to connect them to the system, without modifying the core control logic, greatly improving the system's scalability.

[0051] See Figure 2 , Figure 2 This is a schematic diagram of the physical space interaction control method provided in the embodiments of this application, such as... Figure 2 As shown in the embodiments of this application, the physical space interaction control method includes the following steps: Spatial position indication signals are acquired through a spatial signal acquisition module; The control module acquires spatial relationship data of the controlled devices stored or generated in the spatial data module; The control module matches the spatial position indication signal with the spatial relationship data to determine the target controlled device; The control module sends a device selection signal to the feedback module, and the feedback module outputs differentiated physical feedback. After receiving the confirmation command, the control module sends a control command to the execution module of the target controlled device; The execution module performs the corresponding operation and sends the execution status back to the control module.

[0052] After triggering the spatial selection mode, signal acquisition is performed first, executed by the spatial signal acquisition module. The acquisition frequency is adjusted according to the signal type (10Hz for coordinate signals, 20Hz for distance signals, and 5Hz for visual signals). After acquisition, the raw signal is packaged in the format of "signal type-acquisition time-value" and uploaded to the control module via the corresponding communication protocol. Next, data acquisition is performed, executed by the control module. After receiving the signal, the control module retrieves the spatial relationship data (explicit / implicit / mixed data) of the corresponding scene from the spatial data module. The data transmission adopts structured JSON format. Then, matching processing is performed, executed by the control module. The corresponding matching algorithm is selected according to the signal type (coordinate matching for coordinate signals and distance matching for distance signals). If multiple candidate devices appear during the matching process (such as two devices that are close to each other), a secondary matching is triggered (calling other signal types). If a matching fails, a "No matching device" message is returned. Feedback is then provided: the control module generates a device selection signal (including device ID and feedback combination instructions) and sends it to the corresponding feedback module, while simultaneously sending a "Feedback Complete" signal back to the control module. The control module then sends control commands, and the user sends confirmation commands via input devices (e.g., pressing a confirmation button, saying "confirm," or nodding). Upon receiving the confirmation command, the control module converts the user's control signal into a standardized control command (e.g., "Air Conditioner - Temperature - 26℃") and sends it to the execution module of the target device. Finally, status feedback is performed. After completing the operation, the execution module generates an execution status signal (including device ID, command content, execution result (success / failure), and current device parameters), which is sent back to the control module via the communication module. The control module simultaneously feeds back the status to the configuration terminal (optional).

[0053] The embodiments of this application possess versatility and compatibility. In the integrated architecture, the processing unit built into the spatial signal acquisition module can complete the entire process (local interaction). In the centralized architecture, the control host coordinates the execution of steps two through six, while the acquisition module is only responsible for step one. In the distributed architecture, the partition sub-unit completes steps one through four within its partition, while the main control unit is responsible for steps five through six and cross-partition coordination. For example, in an integrated personal desktop scenario, the user points to the desktop printer (S1), the acquisition module locally acquires the printer's explicit data (S2), completes matching locally (S3), the printer's LED flashes as feedback (S4), the user presses the confirmation button (S5), the acquisition module issues a print command, the printer executes the command and returns the status (S6), and the entire process is completed locally with short processing time.

[0054] In some embodiments, the matching process includes at least one of coordinate region inclusion matching, relative distance minimum matching, azimuth angle matching, and signal strength sorting matching.

[0055] Here, the coordinate region includes matching applicable to fixed devices based on explicit spatial relationship data. The logic is to determine whether the collected coordinate signal falls within the device's preset coordinate range. The execution steps are as follows: the control module compares the preprocessed standardized coordinates (0-100) with the device's preset coordinate range (e.g., x1:20, y1:30-x2:50, y2:60); if it satisfies "x1≤collected x≤x2 and y1≤collected y≤y2", it is initially determined as a candidate device; if there are multiple candidate devices (e.g., two adjacent lights with overlapping coordinate ranges), the placeholder size is called to assist in the judgment (selecting the device whose center is closest to the collected coordinates) to adapt to fixed devices such as office printers and home air conditioners. The minimum relative distance matching is suitable for mobile devices based on implicit spatial relationship data. The core logic is to filter the device closest to the acquisition module. The execution steps are: the control module acquires real-time distance data (after noise reduction) from all mobile devices; calculates the difference between the distance value in the acquired signal and the real-time distance of each device; selects the device with the smallest difference as a candidate device. If the difference is ≤ the allowable error range, the match is confirmed successful, suitable for devices such as Bluetooth speakers and mobile projectors. Azimuth angle matching is suitable for long-distance pointing scenarios. The core logic is to match devices based on the azimuth angle pointed by the user. The execution steps are: the control module compares the acquired azimuth angle signal (0-360°) with the real-time azimuth angle of the device; filters devices with an azimuth angle difference ≤ 2° as candidate devices; further filters based on the distance signal (selecting devices within a reasonable distance range) to avoid matching with distant interfering devices, suitable for long-distance scenarios such as exhibition hall projectors and large workshop equipment. Signal strength ranking matching, as a supplementary algorithm, is suitable for scenarios with poor signal stability (such as industrial workshops and areas with severe signal obstruction). Its core logic is to rank the communication signal strength (RSSI value) between the device and the acquisition module, and select the device with the strongest signal strength as the candidate device. When used in combination with other algorithms (such as azimuth matching + signal strength matching), it can improve the overall matching accuracy.

[0056] The embodiments of this application will be described in detail below with reference to a practical application (smart home living room scenario, including controlled devices: 2 lights, 1 air conditioner, 1 TV, and 1 Bluetooth speaker).

[0057] The spatial signal acquisition module uses a smart remote control that integrates a UWB chip (DW1000), an AI camera (OV5640+NPU), and a Bluetooth AoA module (Nordic nRF52840), and is deployed on a wall bracket in the living room; it is equipped with a "selection / control" switch button, with a red light indicating spatial selection mode and a green light indicating non-spatial selection mode.

[0058] The spatial data module uses an SD card (local storage) + cloud backup via a home router; it pre-stores explicit spatial relationship data (device ID, occupancy size, installation coordinate range, pre-set by the manufacturer) for two lights, air conditioners, and televisions; the implicit spatial relationship data (relative distance, real-time azimuth angle, surface QR code feature code) for the Bluetooth speaker is generated and stored in real time by the control module.

[0059] The control module adopts a centralized architecture and communicates with the acquisition module, feedback module, execution module and mobile APP (configuration terminal) via WiFi. It has built-in linear normalization algorithm (mapping coordinate signal 0-4095 to 0-100), moving average filtering algorithm (distance noise reduction, window size 5), YOLOv5 recognition algorithm and "coordinate matching + distance matching" combined algorithm.

[0060] Feedback module: Light No. 1 integrates a red LED (blinks 3 times when selected, frequency 1Hz); Light No. 2 integrates a blue LED (blinks 2 times when selected, frequency 2Hz); Air conditioner integrates a vibration motor + buzzer (vibrates once + beeps once when selected); TV integrates a screen pop-up prompt (displays "selected" in the corner when selected); Bluetooth speaker integrates a green LED + bass prompt sound (stays on for 2 seconds + beeps once when selected).

[0061] Execution modules: The lighting execution module receives on / off and dimming commands; the air conditioner execution module receives temperature adjustment and mode switching commands; the TV execution module receives on / off and channel switching commands; and the Bluetooth speaker execution module receives on / off and volume adjustment commands; all of them transmit execution status back via WiFi.

[0062] Configuring the terminal: Use a smartphone APP that supports device registration (scanning QR codes), coordinate editing (dragging icons), architecture switching, customizable feedback modes, and viewing of operation logs (exporting to Excel).

[0063] Taking air conditioning control as an example, the system workflow is as follows: 1. The user presses the "Select / Control" button on the remote control to switch to the space selection mode (red light on), and points the remote control at the living room air conditioner; 2. The acquisition module synchronously acquires signals: the UWB chip acquires the air conditioner's coordinates (x:42, y:58, after standardization) and distance (2.3m), the AI ​​camera acquires the air conditioner's appearance features and the user's pointing gestures, and the Bluetooth AoA module acquires the azimuth angle (32°), and uploads them to the control host in a package; 3. Control host preprocessing signals: coordinates are normalized to a range of 0-100, and distance signals are filtered and noise-reduced using a moving average; at the same time, the explicit data of the air conditioner in the spatial data module is called; 4. Matching Process: The control host confirms that the collected coordinates (x:42, y:58) fall within the preset coordinate range (x:30-60, y:50-70) of the air conditioner by matching the coordinate area. Then, it verifies that the air conditioner is the closest device by matching the distance, thus confirming that the target device is the air conditioner. 5. Differentiated Feedback: The control unit sends a selection signal to the air conditioner feedback module, the air conditioner vibration motor vibrates once, the buzzer emits a "beep" sound, and the user confirms that the air conditioner has been selected; 6. The user presses the switch button again to enter the non-space selection mode (green light on), and inputs "adjust temperature to 26℃" through the remote control buttons. The control unit converts this into a standardized command and sends it to the air conditioner execution module. 7. Execution and Feedback: The air conditioning execution module adjusts the temperature to 26℃ and sends a status signal of "temperature adjusted to 26℃" back to the control host. The control host then sends a synchronous feedback to the mobile APP, and the process is complete.

[0064] If the scenario is expanded to a large smart exhibition hall (multiple zones, multiple mobile devices), the control module can be switched to a distributed architecture, with each zone deploying an ESP32 sub-unit. The main control unit communicates with the sub-units via the LoRa protocol. The acquisition module adds a laser positioning sensor to adapt to long-distance signal acquisition. The feedback module uses a high-brightness warning light and a high-power buzzer to adapt to noisy environments.

[0065] In summary, the embodiments of this application have the following beneficial effects: (1) More convenient interaction: Users can select devices by pointing in space without relying on intermediate media to find devices, which greatly shortens the operation path and is especially suitable for multi-device scenarios; (2) More precise operation: Through the differentiated physical feedback mechanism, users can intuitively confirm the selected device, which fundamentally reduces the probability of misoperation and improves the reliability of interaction; (3) Strong scene adaptability: It supports multi-signal acquisition, multi-data type management and three deployment architectures, and can be flexibly adapted to different scenarios such as small desktops and large workshops, and is compatible with fixed and mobile devices; (4) Excellent ease of use and scalability: The configuration terminal provides a visual operation interface, and ordinary users can complete the configuration without professional knowledge; adding a new device only requires registration and data entry, without modifying the core logic, and has strong scalability; (5) Excellent stability: The signal preprocessing and multi-algorithm matching design of the control module improves signal quality and matching accuracy, and the modular architecture facilitates maintenance and upgrades.

[0066] like Figure 3 As shown, Figure 3 This is a schematic diagram of the composition structure of the electronic device 300 provided in the embodiments of this application. The electronic device 300 includes: The device includes a processor 301, a storage medium 302, and a bus 303. The storage medium 302 stores machine-readable instructions that can be executed by the processor 301. When the electronic device 300 is running, the processor 301 communicates with the storage medium 302 via the bus 303. The processor 301 executes the machine-readable instructions to perform the steps of the physical space interaction control method described in the embodiments of this application.

[0067] In practical applications, the various components in the electronic device 300 are coupled together via bus 303. It is understood that bus 303 is used to achieve communication between these components. In addition to a data bus, bus 303 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 3 The general designated all buses as Bus 303.

[0068] The above-mentioned electronic devices have the following beneficial effects: (1) More convenient interaction: Users can select devices by pointing in space without relying on intermediate media to find devices, which greatly shortens the operation path and is especially suitable for multi-device scenarios; (2) More precise operation: Through the differentiated physical feedback mechanism, users can intuitively confirm the selected device, which fundamentally reduces the probability of misoperation and improves the reliability of interaction; (3) Strong scene adaptability: It supports multi-signal acquisition, multi-data type management and three deployment architectures, and can be flexibly adapted to different scenarios such as small desktops and large workshops, and is compatible with fixed and mobile devices; (4) Excellent ease of use and scalability: The configuration terminal provides a visual operation interface, and ordinary users can complete the configuration without professional knowledge; adding a new device only requires registration and data entry, without modifying the core logic, and has strong scalability; (5) Excellent stability: The signal preprocessing and multi-algorithm matching design of the control module improves signal quality and matching accuracy, and the modular architecture facilitates maintenance and upgrades.

[0069] This application also provides a computer-readable storage medium storing executable instructions. When the executable instructions are executed by at least one processor 301, the physical space interaction control method described in this application is implemented.

[0070] In some embodiments, the storage medium may be a magnetic random access memory (FRAM), a read-only memory (ROM), or a programmable read-only memory (PROM). Erasable Programmable Read-Only Memory (EPROM) Electrically Erasable Programmable Read-Only Memory (EEPROM) Read-only memory, flash memory, magnetic surface storage, optical disc, or CD-ROM ROM, Compact Disc Read It can be a memory such as a memory only; or it can be a device that includes one or any combination of the above-mentioned memories.

[0071] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0072] As an example, executable instructions may, but do not necessarily, correspond to files in the file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple collaborating files (e.g., a file that stores one or more modules, subroutines, or code sections).

[0073] As an example, executable instructions can be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.

[0074] The aforementioned computer-readable storage media have the following beneficial effects: (1) More convenient interaction: Users can select devices by pointing in space without relying on intermediate media to find devices, which greatly shortens the operation path and is especially suitable for multi-device scenarios; (2) More precise operation: Through the differentiated physical feedback mechanism, users can intuitively confirm the selected device, which fundamentally reduces the probability of misoperation and improves the reliability of interaction; (3) Strong scene adaptability: It supports multi-signal acquisition, multi-data type management and three deployment architectures, and can be flexibly adapted to different scenarios such as small desktops and large workshops, and is compatible with fixed and mobile devices; (4) Excellent ease of use and scalability: The configuration terminal provides a visual operation interface, and ordinary users can complete the configuration without professional knowledge; adding a new device only requires registration and data entry, without modifying the core logic, and has strong scalability; (5) Excellent stability: The signal preprocessing and multi-algorithm matching design of the control module improves signal quality and matching accuracy, and the modular architecture facilitates maintenance and upgrades.

[0075] In the several embodiments provided in this application, it should be understood that the disclosed methods and electronic devices can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components may be combined, or integrated into another system, or some features may be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0076] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0077] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0078] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a platform server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0079] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A physical space interactive operating system, characterized in that, include: The space signal acquisition module is used to acquire space position indication signals; Spatial data module, used to store or generate spatial relationship data of at least one controlled device; The control module is communicatively connected to the space signal acquisition module and the space data module. It is used to receive the space position indication signal, perform matching processing in combination with the space relationship data to determine the target controlled device, and output the device selection signal and control command. The feedback module, which is communicatively connected to the control module, is used to receive the device selection signal and output differentiated physical feedback to indicate the target controlled device. An execution module, integrated into the controlled device and communicatively connected to the control module, is used to receive control commands, execute corresponding operations, and return the operation execution status.

2. The physical space interactive operating system according to claim 1, characterized in that, The spatial signal acquisition module supports the acquisition of at least one type of signal, including at least one of coordinate signals, distance signals, visual signals, and orientation signals.

3. The physical space interactive operating system according to claim 2, characterized in that, The spatial signal acquisition module is configured to enter spatial selection mode, in which the acquired spatial position indication signal is used exclusively for matching the target controlled device; the signal acquired in non-spatial selection mode is used to control the functional parameters of the selected controlled device.

4. The physical space interactive operating system according to claim 1, characterized in that, The spatial relationship data includes explicit spatial relationship data, implicit spatial relationship data, or a mixture of both; the explicit spatial relationship data includes the identification information and preset physical parameters of the controlled device, and the implicit spatial relationship data includes the identification information and real-time detection parameters of the controlled device.

5. The physical space interactive operating system according to claim 4, characterized in that, The preset physical parameters include the footprint size and physical coordinate range, which are preset by the manufacturer or entered by the user through the configuration terminal; the real-time detection parameters include the relative distance to the spatial signal acquisition module, the real-time azimuth angle, and the visual feature code, which are automatically generated by the control module through an algorithm.

6. The physical space interactive operating system according to claim 1, characterized in that, The control module supports centralized, distributed, or integrated deployment architectures. The centralized architecture receives signals, constructs unified spatial relationship data, and issues instructions through an independent host. The distributed architecture processes signals and executes instructions by dividing the work between the acquisition module subunit and the device subunit. The integrated architecture completes signal processing and instruction issuance locally through the built-in processing unit of the acquisition module.

7. The physical space interactive operating system according to claim 6, characterized in that, The control module has signal preprocessing functions, including at least one of coordinate normalization, distance signal noise reduction, and image signal enhancement.

8. The physical space interactive operating system according to claim 1, characterized in that, The feedback module is integrated into the controlled device body or its carrier, and includes at least one of a light source unit, a vibration unit, a sound source unit and a mechanical unit, and achieves differentiated physical feedback through different state combinations.

9. The physical space interactive operating system according to claim 1, characterized in that, It also includes an optional configuration terminal, which is communicatively connected to the control module and is used to register the controlled device, edit spatial relationship data, switch the control architecture, configure the feedback mode, and view the operation log.

10. A physical space interactive control method, characterized in that, Includes the following steps: Spatial position indication signals are acquired through a spatial signal acquisition module; The control module acquires spatial relationship data of the controlled devices stored or generated in the spatial data module; The control module matches the spatial position indication signal with the spatial relationship data to determine the target controlled device; The control module sends a device selection signal to the feedback module, and the feedback module outputs differentiated physical feedback. After receiving the confirmation command, the control module sends a control command to the execution module of the target controlled device; The execution module performs the corresponding operation and sends the execution status back to the control module.

11. The physical space interactive control method according to claim 10, characterized in that, The matching process includes at least one of coordinate region inclusion matching, minimum relative distance matching, azimuth angle matching, and signal strength sorting matching.

12. An electronic device, characterized in that, include: The device includes a processor, a storage medium, and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is in operation, the processor communicates with the storage medium via the bus, and the processor executes the machine-readable instructions to perform the physical space interaction control method as described in any one of claims 10 to 11.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a processor, performs the physical space interaction control method as described in any one of claims 10 to 11.

Images