Equipment control method and device, equipment and storage medium
By responding to the operation instructions of the participants in real-time interactive scenarios and controlling the target device, the problem that users cannot intuitively experience the operation of the hardware device is solved, interactivity is improved, and the operation permissions and interactive experience of the second participant are realized.
Patent Information
- Application Number
- CN202410804890.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-20
- Publication Date
- 2024-11-12
AI Technical Summary
In real-time interactive scenarios based on the Internet, users cannot intuitively experience the operation experience of hardware devices, which affects interactivity.
By responding to the operation instructions of the participants in a real-time interactive scenario, the target device is controlled to perform corresponding operations, allowing the second participant to actively control and operate the target device to improve interactivity.
The second participant can intuitively experience the operation experience of the target device, and improve the interactivity of real-time interactive scenarios.
Smart Images

Figure CN118945143A_ABST
Abstract
Description
Technical Field
[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to a device control method, apparatus, device, and computer-readable storage medium. Background Art
[0002] With the development of network technology, the Internet has become an important source for people to obtain and share content. In Internet-based content sharing, real-time interactive scenarios (for example, online meetings or live broadcasts) are one of the important forms. However, the current implementation of real-time interactive scenarios still has some problems that affect interactivity. Summary of the invention
[0003] In a first aspect of the present disclosure, a device control method is provided. The method includes: in response to a first operation instruction initiated by a first participant in a real-time interactive scene, controlling a target device in the real-time interactive scene to perform a first operation indicated by the first operation instruction; receiving a second operation instruction initiated by a second participant in the real-time interactive scene; and in response to receiving the second operation instruction, controlling the target device to perform a second operation of the second operation instruction.
[0004] In a second aspect of the present disclosure, a device control apparatus is provided. The apparatus comprises: a first control module configured to, in response to a first operation instruction initiated by a first participant in a real-time interactive scene, control a target device in the real-time interactive scene to perform a first operation indicated by the first operation instruction; a receiving module configured to receive a second operation instruction initiated by a second participant in the real-time interactive scene; and a second control module configured to, in response to receiving the second operation instruction, control the target device to perform a second operation of the second operation instruction.
[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.
[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.
[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:
[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;
[0010] Figure 2 An example interaction diagram of a first client, a second client, a third client, and a target device according to some embodiments of the present disclosure is shown;
[0011] Figure 3 Another example interaction diagram of a first client, a second client, a third client, and a target device according to some embodiments of the present disclosure is shown;
[0012] Figure 4 An example flow chart of a device control method according to some embodiments of the present disclosure is shown;
[0013] Figure 5 A block diagram showing a device control apparatus according to some embodiments of the present disclosure; and
[0014] Figure 6 A block diagram of an electronic device is shown in which one or more embodiments of the present disclosure may be implemented. DETAILED DESCRIPTION
[0015] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0016] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.
[0017] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0018] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0019] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.
[0020] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0021] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.
[0022] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.
[0023] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.
[0024] Figure 1A schematic diagram of an example environment 100 in which an embodiment of the present disclosure can be implemented is shown. In the example environment 100, an application 120 is installed in a target device 110. A user can interact with the application 120 via a server 130 using a client to control the target device 110. A first participant 150 corresponds to a first client 140 and is a creator of a real-time interactive scene. A second participant 151 is a user who accesses the real-time interactive scene through a third client 142 and interacts with the first participant 150. A third participant 152 is a user who accesses the real-time interactive scene only through the third client 142. The second client 141 can communicate with the server 130 via the first client 140, or directly communicate with the server 130. The third client 142 communicates with the first client 140 to obtain a content stream pushed by the first client 140. In some embodiments, the target device 110 is associated with the first participant 150. For example, the first participant 150 can operate the target device 110 on site. In such an embodiment, the first client 140 can be implemented in the target device 110.
[0025] Exemplarily, the target device 110 may be a computer, and the application 120 may be a content sharing application or a collaboration application set in the computer. The application 120 can provide users with services related to real-time interactive scenarios, including browsing, creating, and editing content. It should be understood that this is only exemplary, and the target device 110 may be any suitable device.
[0026] although Figure 1 A single first participant 150, a single second participant 151 and a single third participant 152 are shown, but there may be multiple such users and clients. These users can obtain the services provided by the real-time interactive scene through their own clients.
[0027] As an example, the real-time interaction scenario may be an online conference. The target device 110 may be an access device (e.g., a computer) of the speaker, or may be a hardware device such as a computer or a microphone in the conference room. In such a real-time interaction scenario, one or more speakers may interact through corresponding speech content. As an example, the real-time interaction scenario may be a live broadcast. The target device 110 may be, for example, a device operated by a host in a live broadcast, such as a computer, a game console, etc.
[0028] In some embodiments, the first client 140, the second client 141, and the third client 142 communicate with the target device 110 via the server 130 to achieve interaction with the application 120. In some embodiments, the second client 141 and the third client 142 can communicate with the target device 110 via the first client 140 without going through the server 130.
[0029] The target device 110 can be any type of hardware device such as a mobile terminal, a fixed terminal or a portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a mechanical device controller, a vehicle controller, a gaming device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the target device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The server 130 can be various types of computing systems / servers 130 that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.
[0030] It should be understood that the structure and function of each element in the environment 100 are described for exemplary purposes only, and do not imply any limitation on the scope of the present disclosure. For example, the embodiments of the present disclosure can be applied to any suitable one or more applications, and are not limited to office suites.
[0031] As briefly mentioned above, in the content sharing based on the Internet, real-time interactive scenes (e.g., online conferences or live broadcasts) are one of the important forms, but they also expose some problems. For example, in real-time interactive scenes such as online conferences and live broadcasts, users can only watch the operator operate the hardware device and the feedback information of the hardware device. This makes it impossible for users to intuitively experience the operation of the hardware device, affecting the user's participation experience.
[0032] The embodiments of the present disclosure provide a scheme for device control. According to various embodiments of the present disclosure, in response to a first operation instruction initiated by a first participant in a real-time interactive scene, a target device in the real-time interactive scene is controlled to perform a first operation indicated by the first operation instruction. A second operation instruction initiated by a second participant in the real-time interactive scene is received. And in response to receiving the second operation instruction, the target device is controlled to perform a second operation of the second operation instruction.
[0033] In this way, the second participant can control the target device on the first participant's side, thereby enabling the second participant to intuitively experience the operation of the target device and improve the interactivity of the real-time interactive scene.
[0034] Figure 2An example interaction diagram 200 of a first client 140, a second client 141, a third client 142, and a target device 110 according to some embodiments of the present disclosure is shown. The target device 110 is a hardware device equipped with an application 120 to execute an operation instruction under the control of the application 120. The client corresponds to each participant of the real-time interactive scene, such as at least one audience or anchor participating in the real-time interactive scene. It should be understood that the actions described with reference to the first participant, the second participant, and the third participant can be performed by the corresponding client.
[0035] like Figure 2 As shown, the first participant 150 (e.g., the anchor) initiates a first operation instruction through the first client 140. The first client 140 sends (210) the first operation instruction to the target device 110. After the target device 110 obtains the first operation instruction, it executes (211) the first operation instruction and pushes (212) the content stream at the target device 110 to the first client 140, so that the first client 140 can share the content stream through the real-time interactive scene.
[0036] In some embodiments, the content stream includes video, audio, etc. The data contained in the content stream is related to the type of the target device 110. In some embodiments, if the target device 110 is an image acquisition device (such as a camera), the content stream includes the captured image and audio. If the target device 110 is a mobile terminal running a virtual scene (such as a computer running a game), the content stream includes the real-time content of the virtual scene. In some embodiments, the content stream may also include the status information of the target device 110 and the execution result of the operation instruction, so that the first participant 150 can determine the real-time status of the target device 110.
[0037] The second client 141 establishes (213) a connection with the first client 140 to enter the real-time interactive scene. The third client 142 establishes (214) a connection with the first client 140 to enter the real-time interactive scene. After the second participant 151 enters the real-time interactive scene through the second client 141, the first client 140 pushes (215) a content stream to the second client 141 for the second participant 151 to watch. Similarly, after the third client 142 enters the real-time interactive scene, the first client 140 pushes (216) a content stream to the third client 142 for the third participant 152 to watch.
[0038] In some embodiments, the first participant 150 is a participant with control authority over the target device 110, and the target device control authority of the first participant 150 is higher than that of the second participant 151 and the third participant 152. For example, the real-time interactive scene can be created by the first participant 150, or another user can create it and then transfer the ownership to the first participant 150. The first participant 150 has higher control authority over the real-time interactive scene than the second participant 151 and the third participant 152.
[0039] During the operation of the real-time interactive scene, the second participant 151 initiates an interactive request through the second client 141. The second client 141 sends (217) an interactive request to the first client 140. After the first client 140 agrees to the interactive request, it sends (218) interactive request feedback to the second client 141, so that the first participant 150 interacts through the first client 140 and the second participant 151 interacts through the second client 141 in the real-time interactive scene. For example, after the second participant 151 accesses the real-time interactive scene through the second client 141, it actively sends an interactive request to the first client 140 through the interactive means (e.g., interface interactive elements) provided in the real-time interactive scene. For another example, the second client 141 can send an interactive request to the first client 140 corresponding to the first participant 150 in response to the invitation sent by the first client 140.
[0040] As an example, the real-time interactive scene can be a live broadcast room, and the target device 110 can be a drone. Accordingly, the first participant 150 can be an anchor, who shares the drone control process with other participants through the live broadcast room. The second participant 151 is a guest who interacts with the anchor, and the third participant 152 is an audience watching the content stream in the live broadcast room. After the anchor starts the live broadcast, the audience enters the live broadcast room to view the content of the live broadcast room. The guest (i.e., the second participant 151) sends an interaction request to the anchor through the second client 141 to interact with the anchor.
[0041] The second client 141 sends (219) a control request for the target device 110 to the first client 140. After receiving the control request, the first party 150 may determine whether to grant the second party 151 the operation authority for the target device 110. Figure 2 In the example of FIG. 1 , the first party 150 confirms the granting of the operation authority through the first client 140 . Accordingly, the first client 140 grants ( 220 ) the second client 141 the operation authority for the target device 110 .
[0042] In some embodiments, the first participant 150 may grant the full control authority to the second participant 151, or only grant partial control authority to the second participant 151. For example, the second participant 151 is only granted the operation authority for some actions. The first participant 150 can freely choose the combination of operation authorities to be granted to the second participant 151. In some embodiments, the first participant 150 can determine whether to grant the second participant operation authority based on the information of the second participant 151. The information of the second participant 151 is, for example, but not limited to, operation experience information. In some embodiments, if there are multiple second participants 151 sending control requests to the first client 140 through the second client 141 at the same time, the control authority may be granted to the second client 141 corresponding to one of the second participants 151. Alternatively, the overall control authority may be granted to the second clients 141 corresponding to different second participants 151, so that each second participant 151 can collaboratively control the target device 110 through the second client 141.
[0043] The first client 140 sends (221) control authority information corresponding to the control request to the second client 141, so that the second participant 151 can determine the authority it has. After obtaining the control request feedback information, the second client 141 corresponding to the second participant 151 can display the granted authority to the second participant 151 in the form of prompt information, so that the second participant 151 can operate the target device 110 according to the control authority granted to it.
[0044] The second client 141 sends (222) the second operation instruction to the first client 140. The first client 140 verifies (223) the validity of the second operation instruction. If the second operation instruction fails to pass the verification, an instruction illegality feedback is sent (224) to the second client 141. If the second operation instruction passes the verification, the second operation instruction is sent (225) to the target device 110. In some embodiments, the validity of the second operation instruction can be verified by the target device 110. Accordingly, the second operation instruction can be sent directly to the target device 110 by the second client 141, or can be transparently transmitted to the target device 110 via the first client 140.
[0045] After the target device 110 executes (226) the second operation instruction, it pushes (227) the content stream at the target device 110 to the first client 140. The first client 140 pushes (228) the content stream to the second client 141 through the real-time interactive scene, and pushes (229) the content stream to the third client 142. In some embodiments, the target device 110 may send the execution result of the second operation instruction to the first client 140, so that the first participant 150 corresponding to the first client 140 obtains the real-time status of the target device 110.
[0046] In some embodiments, the first party 150 may cancel (230) the operation authority granted to the second party 151. In some embodiments, the first party 150 may actively send a cancellation authorization instruction to the first client 140 to cancel the second party 151's authority to operate the target device 110. In some embodiments, when granting the operation authority to the second client 141 corresponding to the second party 151, preset conditions such as the operation authority authorization time and the number of illegal operations allowed may be set. When the operation of the second party 151 does not meet the preset conditions (for example, the number of illegal operations is greater than a threshold, the operation time is greater than the authorization time), the operation authority of the second party 151 is automatically canceled. After the cancellation of authorization, the first client 140 sends (231) control authority information to the second client 141, so that the second party 151 corresponding to the second client 141 determines the authority it has. In this way, on the one hand, multiple parties (for example, the first party 150 and the second party 151) can all operate the target device 110, thereby improving the participation experience of the second party 151. On the other hand, the operation process of the second participant 151 is under the control of the first participant 150. The first participant 150 can terminate the operation authority granted to the second participant 151 at any time, thereby improving the security of the operation process.
[0047] Figure 3 Another example interaction diagram 300 of the first client 140 , the second client 141 , the third client 142 , and the target device 110 is shown according to some embodiments of the present disclosure.
[0048] like Figure 3 As shown, the first participant 150 (e.g., anchor) sends (310) a first operation instruction to the target device 110 through the first client 140. After the target device 110 obtains the first operation instruction from the first client 140, it executes (311) the first operation instruction and pushes (312) the content stream at the target device 110 to the first client 140, so that the first client 140 can share the content stream through the real-time interactive scene.
[0049] The second client 141 establishes (313) a connection with the first client 140 to enter the real-time interactive scene. The third client 142 establishes (314) a connection with the first client 140 to enter the real-time interactive scene. After the second participant 151 enters the real-time interactive scene through the second client 141, the first client 140 pushes (315) a content stream to the second client 141, and after the third participant 152 enters the real-time interactive scene through the third client 142, the first client 140 pushes (316) a content stream to the third client 142.
[0050] During the process of the first participant 150 controlling the target device 110 through the first client 140, the second participant 151 sends (317) an interaction request to the first participant 150 through the second client 141. After the first participant 150 agrees to the interaction request, the first client 140 sends (318) an interaction request feedback to the second client 141, so that the second participant 151 interacts with the first participant 150 in the real-time interaction scene.
[0051] The second party 151 sends (319) a control request for the target device 110 to the target device 110 through the second client 141. After receiving the control request, the target device 110 sends (320) a permission verification request to the first client 140. After obtaining the permission verification request, the first client 140 sends (321) permission verification information to the target device 110, so that the target device 110 determines whether to grant the second party 151 the operation permission for the target device 110 according to the permission verification information. In some embodiments, the target device 110 can send the information of the second party 151 to the first client 140, and the first party 150 corresponding to the first client 140 determines whether to grant the second party 151 the operation permission. After the second party 151 completes the judgment, it sends the judgment result to the target device 110. In some embodiments, the authorization condition information can be set in advance at the first client 140. After obtaining the control request from the second client 141, the target device 110 may send an information request to the first client 140 to obtain the authorization condition information, and determine whether to grant the second participant 151 corresponding to the second client 141 the operation permission based on the authorization condition information. In some embodiments, the authorization condition information may be stored at the target device 110, and the authorization condition information may be managed and updated by the first client 140. For example, if the authorization condition information indicates that the operation experience of the second participant 151 corresponding to the second client 141 is greater than 1 hour, then after obtaining the control request from the second participant 151 through the second client 141, the target device 110 determines whether the operation experience of the second participant 151 is greater than 1 hour based on the information of the second participant 151. If it is greater than 1 hour, the second participant 151 is granted the operation permission. After the target device 110 grants (322) the second participant 151 corresponding to the second client 141 the operation authority for the target device 110, the control authority information corresponding to the control request is sent (323) to the second client 141, so that the second participant 151 corresponding to the second client 141 can determine the authority it has. The second client 141 sends (324) the second operation instruction to the first client 140. The first client 140 verifies (325) the validity of the second operation instruction. If the second operation instruction fails to pass the verification, an instruction illegality feedback is sent (326) to the second participant 151. If the second operation instruction passes the verification, the second operation instruction is sent (327) to the target device 110.
[0052] After the target device 110 executes (328) the second operation instruction, it pushes (329) the content stream at the target device 110 to the first client 140. The first client 140 pushes (330) the content stream to the second client 141 through the real-time interactive scene push stream (330), and pushes (331) the content stream to the third client 142. In some embodiments, the target device 110 sends the execution result of the second operation instruction to the first client 140 so that the first participant 150 corresponding to the first client 140 obtains the real-time status of the target device 110. In some embodiments, a long connection can be established between the second client 141 and the target device 110. The second client 141 sends the second operation instruction to the target device 110 through the long connection, and the target device 110 executes the second operation instruction after determining that the second operation instruction is a valid instruction. Accordingly, the target device 110 can push the content stream to the second client 141 through the long connection to prevent data delay caused by data transmission via the first client 140.
[0053] The first party 150 sends (332) an instruction to cancel the operation authority granted to the second party 151 to the second client 141 corresponding to the second party 151 through the first client 140. After canceling the authorization, the first client 140 sends (333) control authority information to the second client 141, so that the second party 151 corresponding to the second client 141 can determine the authority it has.
[0054] Figure 4 FIG. 4 is a flow chart showing an example of a device control method 400 according to some embodiments of the present disclosure. Figure 4 As shown, process 400 may be implemented at a first client or a target device.
[0055] In block 410 , in response to a first operation instruction initiated by a first participant in the real-time interactive scene, a target device in the real-time interactive scene is controlled to perform a first operation indicated by the first operation instruction.
[0056] In some embodiments, the first participant is the initiator of the real-time interactive scenario.
[0057] In block 420 , a second operation instruction initiated by a second participant in the real-time interactive scenario is received.
[0058] In block 430 , in response to receiving the second operation instruction, the target device is controlled to perform a second operation of the second operation instruction.
[0059] In some embodiments, controlling the target device to execute the second operation of the second operation instruction includes: verifying the validity of the second operation instruction, and in response to the second operation instruction passing the verification, controlling the target device to execute the second operation.
[0060] In some embodiments, the device control method is executed at a client of the first participant, and controlling the target device to execute the second operation of the second operation instruction includes: sending the second operation instruction to the target device so that the target device executes the second operation.
[0061] In some embodiments, the device control method further includes receiving an execution result of the second operation from the target device.
[0062] In some embodiments, the device control method further includes receiving a content stream for the real-time interactive scene from the target device; and pushing the content stream to a second client of the second participant.
[0063] In some embodiments, the device control method is executed at the target device, and the first operation instruction is received from a first client of a first party, and the second operation instruction is received from the first client of the first party or the second client of a second party.
[0064] In some embodiments, the device control method further includes receiving a control request for the target device from the second party; and in response to an affirmative indication of the control request by the first party, granting the second party permission to operate the target device.
[0065] In some embodiments, the device control method further includes revoking the second party's permission to operate the target device in response to a revocation instruction from the first party to the second party.
[0066] In some embodiments, the device control method further includes sending an execution result of the first operation instruction and an execution result of the second operation instruction to the first client.
[0067] Figure 5 A block diagram of a device control apparatus 500 according to some embodiments of the present disclosure is shown. The apparatus 500 may be implemented as or included in a first client or a target device. Each module / component in the apparatus 500 may be implemented by hardware, software, firmware, or any combination thereof.
[0068] like Figure 5 As shown, the apparatus 500 includes a first control module 510, which is configured to control a target device in the real-time interactive scene to perform a first operation indicated by the first operation instruction in response to a first operation instruction initiated by a first participant in the real-time interactive scene. A receiving module 520 is configured to receive a second operation instruction initiated by a second participant in the real-time interactive scene; and a second control module 530 is configured to control the target device to perform a second operation of the second operation instruction in response to receiving the second operation instruction.
[0069] In some embodiments, the second control module 530 is further configured to verify the validity of the second operation instruction; and in response to the second operation instruction passing the verification, control the target device to perform the second operation.
[0070] In some embodiments, the device control apparatus 500 is implemented as or included in the first client. The second control module 530 is further configured to send the second operation instruction to the target device so that the target device performs the second operation.
[0071] In some embodiments, the device control apparatus 500 is implemented as or included in the target device. The first control module 510 is further configured to receive a first operation instruction from a first client of the first participant, and the second control module 530 is further configured to receive a second operation instruction from the first client of the first participant or the second client of the second participant.
[0072] In some embodiments, the second participant may directly send the second operation instruction to the target device, or transparently transmit the data to the target device through the first client of the first participant.
[0073] In some embodiments, the device control apparatus 500 further includes a permission granting module configured to receive a control request for the target device from the second party; and in response to a positive indication of the control request from the first party, grant the second party permission to operate the target device.
[0074] In some embodiments, the device control apparatus 500 further includes a deauthorization module configured to revoke the second party's permission to operate the target device in response to a deauthorization instruction from the first party to the second party.
[0075] In some embodiments, the device control apparatus 500 further includes an execution result receiving module configured to receive an execution result of the second operation from the target device.
[0076] In some embodiments, the device control apparatus 500 further includes a push module configured to receive a content stream for the real-time interactive scenario from a target device; and push the content stream to a second client of a second participant.
[0077] In some embodiments, the device control apparatus 500 further includes an execution result sending module configured to send the execution result of the first operation instruction and the execution result of the second operation instruction to the first client.
[0078] Figure 6 1 shows a block diagram of an electronic device 600 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 6The electronic device 600 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Figure 6 The electronic device 600 shown can be used to implement Figure 1 a first client, a second client, or a target device.
[0079] like Figure 6 As shown, the electronic device 600 is in the form of a general electronic device. The components of the electronic device 600 may include, but are not limited to, one or more processors or processing units 610, a memory 620, a storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. The processing unit 610 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 620. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 600.
[0080] The electronic device 600 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 620 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 630 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 600.
[0081] The electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 6 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.
[0082] The communication unit 640 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 600 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 600 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0083] The input device 650 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 660 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 600 may also communicate with one or more external devices (not shown) through the communication unit 640 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 600, or communicate with any device that allows the electronic device 600 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0084] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.
[0085] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0086] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0087] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0088] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0089] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.
Claims
1. A device control method, comprising: In response to a first operation instruction initiated by a first participant in the real-time interactive scene, controlling a target device in the real-time interactive scene to perform a first operation indicated by the first operation instruction; Receiving a second operation instruction initiated by a second participant in the real-time interactive scenario; as well as In response to receiving the second operation instruction, the target device is controlled to execute a second operation of the second operation instruction.
2. The method according to claim 1, further comprising: receiving a control request for the target device from the second participant; as well as In response to an affirmative indication of the control request by the first party, the second party is granted permission to operate the target device.
3. The method according to claim 2, further comprising: In response to a deauthorization instruction from the first party to the second party, the permission of the second party to operate the target device is revoked.
4. The method according to claim 1, wherein the second operation of controlling the target device to execute the second operation instruction comprises: Verifying the validity of the second operation instruction; as well as In response to the second operation instruction being verified, controlling the target device to perform the second operation.
5. The method according to claim 1, wherein the method is performed at a client of the first participant, and the second operation of controlling the target device to execute the second operation instruction comprises: The second operation instruction is sent to the target device so that the target device performs the second operation.
6. The method according to claim 5, further comprising: The execution result of the second operation is received from the target device.
7. The method according to claim 5, further comprising: receiving a content stream for the real-time interactive scenario from the target device; as well as The content stream is pushed to a second client of the second party.
8. The method according to claim 1, wherein the method is performed at the target device, and the first operation instruction is received from a first client of the first participant, The second operation instruction is received from a first client of the first participant or a second client of the second participant.
9. The method according to claim 1, wherein the method is performed at the target device, and the method further comprises: Sending the execution result of the first operation instruction and the execution result of the second operation instruction to the first client.
10. The method according to claim 1, wherein the first participant is an initiator of the real-time interactive scenario.
11. A device control apparatus, comprising: A first control module is configured to control a target device in the real-time interactive scene to perform a first operation indicated by the first operation instruction in response to a first operation instruction initiated by a first participant in the real-time interactive scene; A receiving module, configured to receive a second operation instruction initiated by a second participant in the real-time interactive scenario; as well as The second control module is configured to control the target device to execute a second operation of the second operation instruction in response to receiving the second operation instruction.
12. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 10 when executed by the at least one processing unit.
13. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 10.
