Modularized man-machine interaction system and interaction method

Abstract

The invention relates to a modular man-machine interaction system and method, and the system comprises a sensor module which is used for converting a collected signal into an electric signal; the protocol conversion module is used for reading the electric signal, performing first protocol conversion on the electric signal according to a preset protocol, and sending the converted signal according to the configuration corresponding to the current scene; the main control module is used for receiving the converted signal and processing the converted signal; and the upper computer module is used for configuring a scene, processing a signal from the protocol conversion module and / or the main control module according to the configuration of the scene, and outputting a processed result. According to the scheme of the invention, due to the modular splitting of the man-machine interaction system, the support of different module protocols of the protocol conversion module and the configuration of each module in different scenes, the sensor module can be replaced according to different scenes.

Description

Technical Field

[0001] The present application relates to the field of human-computer interaction technology, and in particular to a modular human-computer interaction system and interaction method. Background Art

[0002] At present, traditional human-computer interaction devices are non-modular, can only perceive fixed signals, and are not scalable. If a new interaction method is needed, new interaction devices need to be replaced, such as virtual reality devices, smart treadmills, etc. Users need to purchase multiple independent interaction devices, and the application software matching different interaction devices are incompatible with each other. The old interaction devices that users already have (such as ordinary treadmills) cannot be converted into intelligent interaction devices for use. Users need to purchase intelligent interaction devices as a whole, change their usage habits for new devices, are inconvenient to use, and the interaction logic of the upper computer module is not universal, resulting in high learning and purchasing costs for users, and the user experience needs to be optimized. Summary of the invention

[0003] In response to the problems existing in the prior art, the present application modularizes the human-computer interaction system. In the modularized modules, the sensor module (or the human-computer interaction module) can be replaced according to different scenarios. The signals uploaded by each sensor are converted by the protocol conversion module and sent to the main control module and the host computer module. The main control module and the host computer module process and output the results of the signals converted by the protocol conversion module and collected by the sensor module according to the pre-set scenario configuration, thereby realizing human-computer interaction.

[0004] According to a first aspect of the present application, a modular human-computer interaction system is provided, characterized in that it includes:

[0005] A sensor module, used for converting the collected signals into electrical signals;

[0006] A protocol conversion module, used to read the electrical signal, perform a first protocol conversion on the electrical signal according to a preset protocol, and send the converted signal according to a configuration corresponding to the current scenario;

[0007] A main control module, used for receiving the converted signal and processing the converted signal; and

[0008] The host computer module is used to configure the scene, process the signal from the protocol conversion module and / or the main control module according to the configuration of the scene, and output the processed result.

[0009] According to a second aspect of the present application, a modular human-computer interaction method is provided, characterized in that it includes:

[0010] The collected signals are converted into electrical signals through the sensor module;

[0011] The protocol conversion module reads the electrical signal, performs a first protocol conversion on the electrical signal according to a preset protocol, and sends the converted signal according to a configuration corresponding to the current scenario;

[0012] receiving the converted signal through the main control module and processing the converted signal; and

[0013] The scenario is configured through the host computer module, the signal from the protocol conversion module and / or the main control module is processed according to the configuration of the scenario, and the processed result is output.

[0014] According to a third aspect of the present application, a computer-readable storage medium is provided, characterized in that the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in the second aspect is implemented.

[0015] According to the modular human-computer interaction system and interaction method provided by the present application, due to the modular decomposition of the human-computer interaction system, the support of different module protocols of the protocol conversion module, and the configuration of each module in different scenarios, the sensor module (or including the human-computer interaction module) can be replaced according to different scenarios. In this way, different scenarios correspond to different sensor modules and human-computer interaction modules, which is convenient for users to use. Using a unified host computer module, the user learning cost is low, and the main control module and the protocol conversion module are universal, which can reduce the user's purchase cost. The present application provides a unified module configuration, management, and use process, which is convenient for users to quickly switch between multiple usage scenarios, reduce the user's use learning cost, and improve user interest and product use stickiness. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without exceeding the scope of protection required by the present application.

[0017] Figure 1 It is an architecture diagram of a modular human-computer interaction system according to an embodiment of the present application.

[0018] Figure 2 It is a schematic diagram of the cloud architecture.

[0019] Figure 3 Schematic diagram of a virtual reality human-computer interaction system according to an embodiment of the present application.

[0020] Figure 4 It is a schematic diagram of a treadmill scene human-computer interaction system according to an embodiment of the present application.

[0021] Figure 5 It is a flowchart of the use of a modular human-computer interaction system according to an embodiment of the present application.

[0022] Figure 6 It is a flowchart of a modular human-computer interaction method according to the first embodiment of the present application.

[0023] Figure 7 It is a flowchart of a modular human-computer interaction method according to the second embodiment of the present application.

[0024] Figure 8 It is a flowchart of a modular human-computer interaction method according to the third embodiment of the present application.

[0025] Fig. 9 It is a flowchart of a modular human-computer interaction method according to the fourth embodiment of the present application.

[0026] Fig.10 It is a structural diagram of an electronic device provided by this application. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0028] The present application relates to the technical field of mobile phones, tablets, computers, AR devices, VR and other devices that require device-human interaction, and requires the perception of human behavior so that the application program in the device can interact with the human. A modular system and method. It is often used in scenes such as fitness, games, entertainment, scientific research, social interaction, and teaching. Through modular design, users' traditional non-intelligent devices can be transformed into intelligent human-computer interaction methods at low cost, using a rich set of upper computer applications. Through a universal purchase, management, and use process, the user's learning and purchase costs are reduced; in addition, through the unified cloud-managed user information, points, malls, and ranking systems, the user's interest and stickiness are improved, and the user retention rate of the entire system is improved.

[0029] Figure 1 is an architecture diagram of a modular human-computer interaction system according to an embodiment of the present application. Figure 1As shown in the figure, the modular human-computer interaction system includes a host computer module, a main control module, a protocol conversion module, a sensor module, a human-computer interaction module, and an expansion module. The host computer module can run on any smart device, including but not limited to mobile phones, tablets, computers, smart watches, bracelets, etc., and is responsible for coordinating user application scenarios for interaction. The main control module is responsible for processing and displaying data from the lower-level hardware system. The protocol conversion module is responsible for digitizing the data collected by the sensor and reporting it to the main control module, or for converting the communication protocol between the main control module and the host computer module. The communication protocol includes but is not limited to USB, I2C, RS485, RS232, Bluetooth, wifi, zigbee and other wired or wireless communication protocols. A protocol conversion module can connect multiple sensors, or connect multiple sensors of the same type. Sensors include but are not limited to electromagnetic sensors, optical sensors, mechanical sensors, electrical signal sensors, sound sensors, gyroscopes, etc.; The human-computer interaction module is responsible for interacting with the user's operation behavior, so that the user's behavior can be sensed by the sensor and converted into signal data that the system can recognize. A human-computer interaction module can connect multiple sensors, or connect multiple sensors of the same type. Human-computer interaction modules such as virtual reality handles, treadmills, game handles, etc.; Extension modules are mainly used to complete modules with specific functions, such as realizing special functions such as vibration feedback in virtual reality scenes. Extension modules can be used in multiple types or multiple of the same type. In some aspects, the extension module is a type of sensor module. For example, in some game scenes, it is necessary to collect the movement of the user's finger joints, and an extension module similar to a glove is required. According to the actual scenario, the human-computer interaction module can carry different modules, such as Figure 3 and Figure 4 In the illustrated embodiment, the device carries a sensor module, or carries a sensor module and a protocol conversion module, or carries a sensor module, a protocol conversion module and a main control module.

[0030] According to one embodiment, if data sharing is required, such as maintaining user points, rankings and other information, the system may also include a cloud. The cloud is used for user account registration, login, storage and management of related data, and maintaining user points, rankings and other information. User points can be used to purchase props in shopping malls and applied to interactive scenes. Multiple people can participate in competitions and rankings, which increases fun and user stickiness.

[0031] According to a specific embodiment, Figure 2The cloud architecture is demonstrated. The cloud includes access layer, verification layer, application logic layer and infrastructure layer. The access layer is responsible for providing cloud service interfaces to the Internet, including but not limited to http, https, FTP, SSH interfaces, etc.; the verification layer mainly verifies the legitimacy of the identity and parameters of the cloud service interfaces requested, and illegal identities and parameters will be intercepted; the application logic layer is mainly responsible for implementing the logic of specific cloud services, such as user registration, login, points usage, item usage, module device registration and access, scene configuration and other specific logical processes, and responding to the processing receipt to the access layer, which will be returned to the front-end request client; the infrastructure layer is mainly responsible for providing basic services such as database, cache, message queue, etc. that are needed to implement the logic of the application layer, including but not limited to mysql, redis, kafka, elastic search, etc. According to one embodiment, the cloud can receive data from the host computer module, including the results of the host computer module processing the data collected by the sensor module, the data processed by the main control module, and the configuration of each scene by the host computer module, such as the results of rendering according to the coordinates reported by the VR locator, the speed, acceleration and mileage in the treadmill scene, and the configuration of the main control module, protocol conversion module and sensor module in a specific scenario.

[0032] According to one embodiment, the host computer module is an application program written in languages ​​including but not limited to C, C++, JAVA, HTML, CSS, JAVASCRIPT, etc., which can be installed and run on systems including but not limited to Windows, iOS, Android, MacOS, Linux, etc., or can be run directly on a browser, and can request the cloud service interface provided by the cloud access layer to obtain data, such as online PK, points ranking data, configuration of the scene selected by the user, etc., and process and display data locally according to business logic requirements (such as configuration for the scene), and render corresponding outputs according to the functions used by the user, including but not limited to text, pictures, videos, sounds, vibrations, etc. The host computer module can also obtain reported data including but not limited to keyboards, mice, touchpads, module devices of human-computer interaction systems, etc. according to the communication capabilities of the system such as USB, LAN, Bluetooth, and serial ports, process it locally, and report it to the cloud for storage according to the scene calculation results.

[0033] According to some embodiments, the host computer module has a module library including a main control module, a protocol conversion module, a sensor module, a human-computer interaction module, and an extension module. In the process of configuring the scene through the host computer module, first, the scene application is selected, and the module associated with the selected scene is selected in the module library, and these modules include one or more of the main control module, the protocol conversion module, the sensor module, the human-computer interaction module, and the extension module. Then, these associated modules are configured, including: configuring the main control module to be responsible for processing the signal, for example, configuring the main control module to be responsible for processing the signal with a relatively simple process; configuring whether the signal processed by the main control module is to be uploaded to the host computer module; configuring the conversion protocol used by the protocol conversion module, for example, for a specific protocol conversion module, what protocol is used for conversion; configuring the identification information and position of the sensor module in the scene, for example, the unique identification of the sensor module in the scene, rendering the specific position of the sensor module in the scene, so that the user can install or place it easily.

[0034] According to a specific embodiment, the main control module integrates a high-performance processing unit and peripheral circuits, an input module, a high-resolution display screen, a custom communication interface, etc., and is responsible for processing and displaying data of the lower-level hardware system. The high-performance processing unit uses, for example, an ESP32 single-chip microcomputer, which is responsible for processing local data of the system and processing interactive business logic. For example, according to the configuration of the scene in the host computer module, the signals from some sensor modules are processed, and the processed results are reported to the host computer module, or the processed results are not reported to the host computer module, but displayed locally, for example, in Figure 4 In the illustrated embodiment, the screen of the main control module can display the speed, acceleration and total mileage in the treadmill scene. The input module includes but is not limited to switches, buttons, touch pads, joysticks, microphones, etc., providing local user input capabilities. Depending on the scenario, the high-resolution display screen may not be installed or replaced with other types of display devices, including but not limited to digital tubes, LEDs, liquid crystal screens, LCDs, etc., to provide display of local data or interactive functions. The custom communication interface is responsible for communicating with the protocol conversion module, host computer module, cloud, sensor module, etc. The specific communication protocol is determined by the scenario of use. For example, the ESP32 microcontroller has built-in Bluetooth and WiFi communication capabilities.

[0035] According to a specific embodiment, the protocol conversion module is used to convert the main control module, sensor module, expansion module, etc. into other general protocols (protocols that the other party can recognize), responsible for communicating with the host computer module and the underlying hardware of the sensor, and the communication protocol includes but is not limited to USB, I2C, RS485, RS232, Bluetooth, wifi, zigbee, nbIot and other wired or wireless protocols, which facilitates the communication between the sensor module and other modules, or facilitates the communication between the main control module and the host computer software; in implementation, for example, the main control module already includes communication capabilities such as Bluetooth, wifi, serial port, etc., then these protocol conversion modules of the main control module can be omitted. Therefore, the protocol conversion module is optional according to the actual scenario. The protocol conversion module itself does not require too much computing power, only the conversion and reporting of data protocols, using relatively inexpensive single-chip microcomputers, such as esp8266 single-chip microcomputers, with built-in wifi communication capabilities, and multiple IO interfaces are reserved. Different types of electrical signals can be read, such as high and low levels, voltage, frequency, etc., and multiple sensor modules can be adapted to report data. According to some embodiments, according to the corresponding configuration of the current scene, the protocol conversion module is used to read the electrical signal from the sensor signal, perform protocol conversion on the electrical signal according to a preset protocol, and send the converted signal according to the configuration corresponding to the current scene, wherein, in the process of protocol conversion, the preset protocol matches the protocol supported by the object to which the converted signal is sent. If the object to which the converted signal is sent is a main control module, the preset protocol matches the object supported by the main control module, and the converted signal is sent to the main control module; and if the object to which the converted signal is sent is a host computer module, the preset protocol matches the object supported by the host computer module, and the converted signal is sent to the host computer module.

[0036] According to a specific embodiment, the sensor module is mainly responsible for converting the collected physical signals of the real world into electrical signals. The sensor module itself cannot report electrical signals, so multiple or multiple sensors can use the same protocol conversion module to report data at the same time. Depending on the usage scenario, it can be reported to the main control module or directly to the host computer module. For example, the Hall sensor will convert the magnetic field size into a voltage value, input a voltage measurement interface of the protocol conversion module, and report the value to the main control module. The main control module will process the attribute value preset according to the user scenario locally or continue to report it to the host computer module. The host computer module converts the corresponding result according to the value and makes output feedback. Because the protocol conversion module has multiple resource interfaces, it can connect multiple or multiple sensors until the resources are exhausted, and a protocol conversion module can be added for expansion. All the module quantities and wiring methods required are in the host computer module, and have been configured in advance when the user scenario is configured.

[0037] like Figure 3As shown, in the scenario of the virtual reality human-computer interaction system and method, the host computer module uses a specified application program, which can be installed on a mobile phone, tablet or virtual reality device, and integrates a variety of interactive scenarios adapted to virtual reality, and uses the user login, ranking system, points system, prop mall and other functions provided by the cloud;

[0038] The main control module integrates high-performance processing units and peripheral circuits, input modules, high-resolution display screens, custom communication interfaces, etc. It is responsible for processing and displaying data from the underlying hardware system, parsing and processing user inputs, such as grabbing and releasing objects in the virtual reality world, entering the distribution network mode, and other user inputs;

[0039] In a virtual reality scenario, the sensor modules on the interactive handle or interactive glove include gyroscopes, accelerometers, ultrasonic radars, etc., which are used to sense the posture, position, speed, rotation direction, and rotation angle of the user's hand during interaction. The spatial positioning sensor module senses the posture, position, and other information of the user's interaction through vision, ultrasound, laser, etc., and reports it to the protocol conversion module. Joint sensors can be placed on the elbows, waist, knees, ankles, toes, etc., and can sense the spatial position, posture, movement direction, acceleration, and other information of key parts of the human body.

[0040] In the virtual reality scene, the human-computer interaction module includes a virtual reality handle or glove and a virtual reality head-mounted display module that can be installed with a main control module, a protocol conversion module, and a sensor module. The user can view the scene in the virtual reality world through the virtual reality head-mounted display module; the user can use a pair of handles or gloves to conduct human-computer interaction with the host computer module; the user can feel the changing feedback of grip pressure, vibration, climate, smell, etc. in virtual reality through feedback clothing plus a vibration feedback extension module, a pressure feedback extension module, a climate feedback extension module (for example, simulating weather conditions such as humidification (using a humidifier), heating (using a heating rod), freezing (using a water cooling cycle), and strong winds (using a fan)), an odor feedback extension module, etc., making the user experience more realistic.

[0041] For example, in a virtual reality shooting game, users can jump and walk, and the spatial positioning sensor module and joint sensors will sense the user's posture and control the synchronous movements of the character in virtual reality. Users can control the hands in the game to perform corresponding actions through virtual reality handles or gloves. The feedback service can provide feedback on the resistance of the object's shape when the user grabs the object. Ultimately, completing the tasks in the game is used as a score, participating in the ranking, and winning points as rewards. Users can use the points to purchase props in the mall, and the props can be used in the game.

[0042] like Figure 4As shown in the scenario of the human-computer interaction system and method for a smart treadmill, the host computer module uses a specified application program, which can be installed on a mobile phone or tablet, and integrates a variety of small games adapted to the smart treadmill. It uses the user login, ranking system, points system, prop mall and other functions provided by the cloud; in this scenario, users can fully reuse Figure 3 The main control module, protocol conversion module, human-computer interaction module feedback service, etc. have the same functions and will not be repeated here; the sensor module uses 3 Hall sensors, and the user perceives the speed, rotation direction and other information of the treadmill; the human-computer interaction module can use a tablet, mobile phone or virtual reality head-mounted display module installed with the host computer software; for example, in the forward rush game, the user controls the speed of the character in the game by running speed, and makes evasive actions to avoid obstacles in the game. Finally, the game target score achieved within the specified time is used as the final score to participate in the ranking and win points rewards. Users can use points to purchase props in the mall, and the props can be used in the game.

[0043] The scenarios listed in the examples above only account for a small part of the actual scenarios. In actual scenarios, due to the modular design, users can be multiple or single users, and multiple modules can be combined to adapt to various scenarios. All user interaction behaviors use unified host computer software and cloud, and the purchase and learning costs of the entire system are low.

[0044] On the basis of the above description, in order to facilitate the understanding of the present application scheme, the present application also provides a unified module scene management combination use process method to reduce the user's use, learning, and management costs, such as Figure 5 shown.

[0045] First, users need to register an account in the designated application in order to use subsequent user points, personal information, rankings, etc.;

[0046] Then, the user follows the configuration prompts to configure the purchased main control module, protocol conversion module, sensor module, human-computer interaction module, expansion module and other modules into the specified application;

[0047] Then, the user selects the scenario application according to the scenario to be used, associates the corresponding modules (including the main control module, protocol conversion module, sensor module, human-computer interaction module, extension module, etc.), and sets the position of the module in the application. For example, in the treadmill human-computer interaction scenario, the user installs the sensor to the specified position of the treadmill according to the prompts, and chooses to associate other modules, and finally saves the configuration. If it is necessary to upload to the cloud, upload the configuration to the cloud.

[0048] Finally, the user can select a saved scene configuration for human-computer interaction. Some modules need to be initialized before use. For example, in the treadmill human-computer interaction scene, the spatial positioning sensor module needs to be calibrated according to the prompts to sense the spatial position of other positioning modules.

[0049] After completing the human-computer interaction scene, users can earn points and purchase props in the designated application mall, such as resurrection props. In the treadmill human-computer interaction scene, after the task fails due to operational errors, they can use the resurrection props to continue the interaction in order to obtain higher points.

[0050] Based on the above description, according to one aspect of the present application, a modular human-computer interaction method is provided, such as Figure 6 As shown, the method comprises the following steps:

[0051] Step S601, converting the collected signal into an electrical signal through the sensor module;

[0052] Step S602, reading the electrical signal through a protocol conversion module, performing a first protocol conversion on the electrical signal according to a preset protocol, and sending the converted signal according to a configuration corresponding to the current scenario;

[0053] Step S603, receiving the converted signal through the main control module and processing the converted signal; and

[0054] Step S604: configure the scene through the host computer module, process the signal from the protocol conversion module and / or the main control module according to the configuration of the scene, and output the processed result.

[0055] According to some embodiments, the sensor module includes but is not limited to electromagnetic sensors, optical sensors, mechanical sensors, electrical signal sensors, sound sensors, gyroscopes, etc., which collect physical signals from the real world and convert them into electrical signals. The sensor module itself cannot report electrical signals, so multiple or multiple sensors can use the same protocol conversion module or different protocol conversion modules to report data at the same time.

[0056] According to some embodiments, the protocol conversion module reads the electrical signal from the sensor module, performs protocol conversion on the electrical signal according to a preset protocol, and sends the converted signal according to the configuration corresponding to the current scene. In the process of protocol conversion, the preset protocol matches the protocol supported by the object to which the converted signal is sent. If the object to which the converted signal is sent is a main control module, the preset protocol matches the object supported by the main control module, and the converted signal is sent to the main control module; and if the object to which the converted signal is sent is a host computer module, the preset protocol matches the object supported by the host computer module, and the converted signal is sent to the host computer module.

[0057] According to some embodiments, according to the configuration of the scene in the host computer module, the signals from some sensor modules are processed and the processed results are reported to the host computer module, or the processed results are not reported to the host computer module but displayed locally, for example, Figure 4 In the illustrated embodiment, the screen of the main control module can display the speed, acceleration and total mileage in the treadmill scene.

[0058] According to some embodiments, according to some embodiments, the host computer module has a module library including modules such as a main control module, a protocol conversion module, a sensor module, a human-computer interaction module, and an extension module. In the process of configuring the scene through the host computer module, first, a scene application is selected, and a module associated with the selected scene is selected in the module library, and these modules include one or more of the main control module, the protocol conversion module, the sensor module, the human-computer interaction module, and the extension module. Then, these associated modules are configured, including: configuring the main control module to be responsible for processing the signal, for example, configuring the main control module to be responsible for processing the signal with a relatively simple process; configuring whether the signal processed by the main control module is to be uploaded to the host computer module; configuring the conversion protocol used by the protocol conversion module, for example, for a specific protocol conversion module, what protocol is used for conversion; configuring the identification information and position of the sensor module in the scene, for example, the unique identification of the sensor module in the scene, rendering the specific position of the sensor module in the scene, so that the user can install or place it easily.

[0059] According to the scene configuration, the signals to be processed by the host computer module may come from the main control module, or directly from the sensor module, or both, and may need to be processed by the protocol conversion module in the middle. The host computer module processes these signals to obtain processing results. According to some embodiments, the host computer module can render and display these processing results, and / or upload these processing results to the cloud.

[0060] According to another aspect of the present application, a modular human-computer interaction method is also provided. Figure 7 As shown. Figure 6compared to, Figure 7 Steps S701 to S704 are Figure 6 The steps S601 to S604 are the same as above, except that: Figure 7 The method shown also includes:

[0061] Step S705, receiving the processed result and / or the scene configuration from the host computer module through the cloud.

[0062] According to one embodiment, the cloud can receive data from the host computer module, including the results of the host computer module processing the data collected by the sensor module, the data processed by the main control module, and the configuration of each scene by the host computer module, such as the results of rendering according to the coordinates reported by the VR locator, the speed, acceleration and mileage in the treadmill scene, and the configuration of the main control module, protocol conversion module and sensor module in a specific scenario.

[0063] According to another aspect of the present application, a modular human-computer interaction method is also provided. Figure 8 As shown. Figure 7 compared to, Figure 8 Steps S801 to S805 are Figure 7 The steps S701 to S705 are the same as those in the embodiment except that: Figure 8 The method shown also includes:

[0064] Step S806, obtaining data related to the current scene from the cloud through the host computer module, and processing and displaying the obtained data according to the current scene configuration.

[0065] According to some embodiments, the host computer module can request the cloud service interface provided by the cloud access layer to obtain data, such as online PK, points ranking data, configuration of the scene selected by the user, etc., and process and display the data locally according to business logic requirements, and render the corresponding output according to the functions used by the user, including but not limited to text, pictures, videos, sounds, vibrations and other forms.

[0066] According to another aspect of the present application, a modular human-computer interaction method is also provided. Fig. 9 As shown. Figure 6 compared to, Fig. 9 Steps S901 to S904 are Figure 6 The steps S601 to S604 are the same as above, except that: Fig. 9 The method shown also includes:

[0067] Step S905: Perform a second protocol conversion on the signal from the main control module through the protocol conversion module, and send the converted signal to the host computer module.

[0068] According to some embodiments, according to the corresponding configuration of the current scene, the protocol conversion module is used to read the electrical signal from the sensor signal, perform protocol conversion on the electrical signal according to a preset protocol, and send the converted signal according to the configuration corresponding to the current scene, wherein, in the process of protocol conversion, the preset protocol matches the protocol supported by the object to which the converted signal is sent. If the object to which the converted signal is sent is a main control module, the preset protocol matches the object supported by the main control module, and the converted signal is sent to the main control module; and if the object to which the converted signal is sent is a host computer module, the preset protocol matches the object supported by the host computer module, and the converted signal is sent to the host computer module.

[0069] According to the modular human-computer interaction system and interaction method provided by the present application, due to the modular decomposition of the human-computer interaction system, the support of different module protocols of the protocol conversion module, and the configuration of each module in different scenarios, the sensor module (or including the human-computer interaction module) can be replaced according to different scenarios. In this way, different scenarios correspond to different sensor modules and human-computer interaction modules, which is convenient for users to use. Using a unified host computer module, the user learning cost is low, and the main control module and the protocol conversion module are universal, which can reduce the user's purchase cost. The present application provides a unified module configuration, management, and use process, which is convenient for users to quickly switch between multiple usage scenarios, reduce the user's use learning cost, and improve user interest and product use stickiness.

[0070] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0071] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present application.

[0072] In the several embodiments provided in the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the device or unit can be electrical connection or other forms.

[0073] See also Fig.10 , Fig.10 An electronic device is provided, comprising a processor and a memory. The memory stores computer instructions, and when the computer instructions are executed by the processor, the processor executes the computer instructions to achieve the following Figures 6 to 9 The method and refinement scheme shown.

[0074] It should be understood that the above device embodiments are only illustrative, and the device disclosed in the present invention can also be implemented in other ways. For example, the division of units / modules described in the above embodiments is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.

[0075] In addition, unless otherwise specified, each functional unit / module in each embodiment of the present invention may be integrated into one unit / module, each unit / module may exist physically separately, or two or more units / modules may be integrated together. The above-mentioned integrated unit / module may be implemented in the form of hardware or in the form of a software program module.

[0076] If the integrated unit / module is implemented in the form of hardware, the hardware may be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes but is not limited to transistors, memristors, etc. Unless otherwise specified, the processor or chip may be any appropriate hardware processor, such as a CPU, a GPU, an FPGA, a DSP, an ASIC, etc. Unless otherwise specified, the on-chip cache, the off-chip memory, and the memory may be any appropriate magnetic storage medium or magneto-optical storage medium, such as a resistive random access memory RRAM (Resistive Random Access Memory), a dynamic random access memory DRAM (Dynamic Random Access Memory), a static random access memory SRAM (Static Random-Access Memory), an enhanced dynamic random access memory EDRAM (Enhanced Dynamic Random Access Memory), a high-bandwidth memory HBM (High-Bandwidth Memory), a hybrid memory cube HMC (Hybrid Memory Cube), etc.

[0077] If the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer electronic device (which can be a personal computer, a server or a network electronic device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0078] The present application also provides a non-transitory computer storage medium storing a computer program. When the computer program is executed by multiple processors, the processors execute the following Figures 6 to 9 The method and refinement scheme shown.

[0079] The embodiments of the present application are described in detail above. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and its core idea of ​​the present application. At the same time, changes or deformations made by those skilled in the art based on the ideas of the present application, the specific implementation methods and the scope of application of the present application, all belong to the scope of protection of the present application. In summary, the content of this specification should not be construed as a limitation on the present application.

Claims

1. A modular human-computer interaction system, characterized in that: include: A sensor module, used for converting the collected signals into electrical signals; A protocol conversion module, used to read the electrical signal, perform a first protocol conversion on the electrical signal according to a preset protocol, and send the converted signal according to a configuration corresponding to the current scenario; A main control module, used for receiving the converted signal and processing the converted signal; as well as The host computer module is used to configure the scene, process the signal from the protocol conversion module and / or the main control module according to the configuration of the scene, and output the processed result.

2. The system according to claim 1, characterized in that The host computer module is also used for: Determine a module associated with the scene, where the module associated with the scene includes the main control module, the protocol conversion module and / or the sensor module; Performing scenario configuration on the modules associated with the scenario; and Save the scene configuration.

3. The system according to claim 2, characterized in that The host computer module is also used for: configuring the main control module to process the signal; and / or Configuring the conversion protocol used by the protocol conversion module; and / or The identification information and the position of the sensor module in the scene are configured.

4. The system according to claim 2 or 3, characterized in that Also includes: The cloud is used to receive the processed results and / or the scene configuration from the host computer module.

5. The system according to claim 4, characterized in that The host computer module is also used for: The data related to the current scene is obtained from the cloud, and the obtained data is processed and displayed according to the current scene configuration.

6. The system according to any one of claims 1 to 3, characterized in that: The protocol conversion module is also used for: The signal from the main control module is converted into a second protocol, and the converted signal is sent to the host computer module.

7. The system according to any one of claims 1 to 3, characterized in that: Also includes: The human-computer interaction module is used to carry the sensor module, or to carry the sensor module and the protocol conversion module, or to carry the sensor module, the protocol conversion module and the main control module.

8. A modular human-computer interaction method, characterized in that: include: The collected signals are converted into electrical signals through the sensor module; The protocol conversion module reads the electrical signal, performs a first protocol conversion on the electrical signal according to a preset protocol, and sends the converted signal according to a configuration corresponding to the current scenario; receiving the converted signal through the main control module and processing the converted signal; and The scenario is configured through the host computer module, the signal from the protocol conversion module and / or the main control module is processed according to the configuration of the scenario, and the processed result is output.

9. The method according to claim 8, characterized in that The configuration of the scene through the host computer module includes: Determine a module associated with the scene, where the module associated with the scene includes the main control module, the protocol conversion module and / or the sensor module; Performing scenario configuration on the modules associated with the scenario; and Save the scene configuration.

10. The method according to claim 9, characterized in that The performing scene configuration on the module associated with the scene includes: configuring the main control module to process the signal; and / or Configuring the conversion protocol used by the protocol conversion module; and / or The identification information and the position of the sensor module in the scene are configured.

11. The method according to claim 9 or 10, characterized in that Also includes: The processed result and / or the scene configuration are received from the host computer module via the cloud.

12. The method according to claim 11, characterized in that Also includes: The host computer module obtains data related to the current scene from the cloud, and processes and displays the obtained data according to the current scene configuration.

13. The method according to any one of claims 8 to 10, characterized in that Also includes: The signal from the main control module is converted into a second protocol by the protocol conversion module, and the converted signal is sent to the host computer module.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 8 to 13 is implemented.

Images