Control method of information processing system, control method of processing device, and control method of terminal

Abstract

To provide a control method of an information processing system with improved convenience of a user.SOLUTION: A control method of an information processing system comprises steps of: acquiring identification information of an external device 50 connected with a projector 100 by the projector 100; transmitting screen information as information regarding a screen for accepting operation to the external device 50 and corresponding to the identification information to a terminal 200 connected with the projector 100 by the projector 100; displaying an operation screen 500 on the basis of the screen information by the terminal 200; transmitting control information for controlling the external device 50 to the projector 100 on the basis of the operation to the operation screen 500 by the terminal 200; and controlling the external device 50 on the basis of the control information by the projector 100.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a method for controlling an information processing system, a method for controlling a processing device, and a method for controlling a terminal device.

Background Art

[0002] Conventionally, a system for remotely operating a controlled device has been known.

[0003] For example, Patent Document 1 discloses a remote operation system including a controlled device and a remote operation terminal device that remotely operates the controlled device via a network.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when an external device is connected to the controlled device, it has been impossible to remotely operate the external device from the remote operation terminal device. For this reason, in order to operate the external device, another operation device is required, and there is a problem that the operability is reduced.

Means for Solving the Problems

[0006] The present disclosure relates to a control method for an information processing system, including: the first device acquiring identification information for identifying at least one device connected to the first device; the first device transmitting screen information corresponding to the identification information to a terminal device connected to the first device, where the screen information is related to an operation screen for receiving an operation on the at least one device; the terminal device displaying the operation screen based on the screen information; the terminal device transmitting control information for controlling the at least one device to the first device based on an operation on the operation screen; and the first device controlling the at least one device based on the control information.

[0007] The present disclosure relates to a control method for a processing device executed by a processor mounted on the processing device, including: the processor acquiring identification information for identifying an external device connected to the processing device; the processor transmitting screen information corresponding to the identification information to a terminal device connected to the processing device, where the screen information is related to an operation screen for receiving an operation on the external device; and the processor receiving control information based on an operation on the operation screen from the terminal device. The control method for the processing device further includes controlling the external device based on the control information.

[0008] The present disclosure relates to a control method for a terminal device executed by a processor mounted on the terminal device, including: the processor receiving information related to an operation screen for receiving an operation on a second device connected to a first device; the processor receiving, from the first device, screen information corresponding to identification information acquired by the first device from the second device; the processor displaying the operation screen based on the screen information; the processor receiving an operation on the operation screen; and the processor transmitting control information corresponding to the operation to the first device. BRIEF DESCRIPTION OF THE DRAWINGS

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0011] [1. System Configuration of Embodiment 1] FIG. 1 is a diagram showing the system configuration of the information processing system 1. The information processing system 1 includes a projector 100, an external device 50, and a terminal device 200, and is configured such that the external device 50 and the terminal device 200 are connected to the projector 100. Although FIG. 1 shows a configuration in which a plurality of external devices 50 are connected to the projector 100, a configuration in which one external device 50 is connected to the projector 100 may also be used. The projector 100 corresponds to the first device and the processing device. The plurality of external devices 50 correspond to at least one device.

[0012] The projector 100 and the external device 50 are connected by a display cable such as a DVI (Digital Visual Interface) cable, an HDMI (High-Definition Multimedia Interface) cable, or a Displayport cable. Also, the projector 100 and the external device 50 may be connected by a data communication cable such as a USB (Universal Serial Bus). Furthermore, the projector 100 and the external device 50 may be connected by short-range wireless communication such as Bluetooth, Wi-Fi, or Miracast. Also, the projector 100 and the external device 50 may be network-connected by a wired LAN (Local Area Network). HDMI, Bluetooth, Wi-Fi, and Miracast are registered trademarks.

[0013] The external device 50 is, for example, a device that supplies the projector 100 with image data that is the source of the image to be displayed on the projector 100, such as a personal computer or a DVD player. Also, the external device 50 may be a device that provides functions not equipped on the projector 100, such as a speaker, a camera, a microphone, or a document camera. Furthermore, the external device 50 may be an auxiliary storage device such as a USB memory or an HDD (Hard Disk Drive).

[0014] FIG. 1 shows a camera 50A, a speaker 50B, and a personal computer 50C as the external device 50. Hereinafter, when collectively referring to the camera 50A, the speaker 50B, and the personal computer 50C, they are referred to as the external device 50. The camera 50A, the speaker 50B, and the personal computer 50C correspond to an example of a second device or a third device.

[0015] The projector 100 generates image light based on, for example, the image data supplied from the personal computer 50C, and projects the generated image light onto the screen 10. As a result, an image corresponding to the image data is displayed on the screen 10.

[0016] Further, the projector 100 transmits information for causing the terminal device 200 to generate an operation screen for receiving an operation on the external device 50 to the terminal device 200. Details of this operation will be described later.

[0017] The terminal device 200 generates an operation screen capable of operating the external device 50 based on the information received from the projector 100, and displays the generated operation screen. Further, the terminal device 200 receives an operation on the operation screen, and transmits control information corresponding to the received operation to the projector 100. The projector 100 generates a control command for controlling the external device 50 based on the control information received from the terminal device 200, and transmits the generated control command to the external device 50.

[0018] [2. Configuration of Projector] FIG. 2 is a block diagram showing the configuration of the projector 100. The configuration of the projector 100 will be described with reference to FIG. 2.

[0019] The projector 100 includes an input interface 110, a network interface 120, an image processing unit 130, a frame memory 135, an image projection unit 150, and a first control unit 170. Hereinafter, the interface will be abbreviated as I / F.

[0020] The input I / F 110 includes, for example, an interface for image communication such as HDMI, Displayport, DVI, etc., and an interface for data communication such as USB. FIG. 2 shows a case where the input I / F 110 includes an HDMI_IF 111 and a USB_IF 113.

[0021] HDMI_IF111 includes a connector for connecting an HDMI cable and an interface circuit that executes a communication protocol compliant with the HDMI communication standard. USB_IF113 includes a connector for connecting a USB cable and an interface circuit that executes a communication protocol compliant with the USB communication standard.

[0022] Network I / F120 includes a wired communication I / F121 and a first wireless communication I / F123.

[0023] The wired communication I / F121 includes a communication module such as a LAN (Local Area Network) card. The wired communication I / F121 connects to a network (not shown) and performs data communication with devices connected to this network.

[0024] The first wireless communication I / F123 includes a wireless communication module such as a wireless LAN (Local Area Network) card and performs wireless communication in the Wi-Fi mode based on, for example, the IEEE 802.11 standard or a standard equivalent thereto. The communication mode of the first wireless communication I / F123 is not limited to Wi-Fi and may be, for example, short-range wireless communication such as Bluetooth or Miracast.

[0025] A frame memory 135 is connected to the image processing unit 130. The image processing unit 130 expands an image based on the image data received by the input I / F110 in the frame memory 135. The image processing unit 130 performs image processing on the image expanded in the frame memory 135, such as resolution conversion processing, resizing processing, correction of distortion aberration, shape correction processing, digital zoom processing, adjustment of the color tone and brightness of the image, etc. The image processing unit 130 outputs image information, which is information on the image expanded in the frame memory 135, to the panel driving unit 156 of the image projection unit 150.

[0026] The frame memory 135 and the image processing unit 130 are constituted by, for example, an integrated circuit. The integrated circuit includes LSI (Large Scale Integrated Circuit), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field-Programmable Gate Array), SoC (System-on-a-chip), and the like. Further, the frame memory 135 and the image processing unit 130 may include an analog circuit as a part of the configuration of the integrated circuit, or may have a configuration in which the first control unit 170 and the integrated circuit are combined.

[0027] The image projection unit 150 includes a light source 151, a light modulation device 152, and a panel drive unit 156. The light modulation device 152 includes three liquid crystal panels 153(R), 153(G), 153(B) and a projection lens 155 which is an optical system unit.

[0028] As the light source 151, a solid light source such as a light emitting diode or a semiconductor laser is used. As the light source 151, a discharge type light source lamp such as an ultra-high pressure mercury lamp or a metal halide lamp may be used. The light source 151 emits light that becomes the source of image light under the control of the first control unit 170. The light emitted from the light source 151 is converted into light with a substantially uniform luminance distribution by an integrator optical system (not shown), and is separated into respective color light components of red (R), green (G), and blue (B), which are the three primary colors of light, by a color separation optical system (not shown). Thereafter, the light separated into the respective color light components of red (R), green (G), and blue (B) is incident on the liquid crystal panels 153(R), 153(G), 153(B), respectively. The light separated into the respective color light components incident on the liquid crystal panels 153(R), 153(G), 153(B) is referred to as color light.

[0029] The liquid crystal panels 153(R), 153(G), and 153(B) are each composed of a transmissive liquid crystal panel or the like in which liquid crystal is enclosed between a pair of transparent substrates. In the liquid crystal panels 153(R), 153(G), and 153(B), rectangular image formation regions 154(R), 154(G), and 154(B) composed of a plurality of pixels arranged in a matrix are formed, and a drive voltage can be applied to each pixel. The projector 100 is configured to use the liquid crystal panels 153(R), 153(G), and 153(B), but is not limited thereto. A reflective liquid crystal panel or a liquid crystal panel of LCOS (Liquid Crystal On Silicon) may be provided. The projector 100 may be configured to include one or more DMDs (Digital Mirror Devices).

[0030] The panel drive unit 156 forms an image on the image formation regions 154(R), 154(G), and 154(B) of the liquid crystal panels 153(R), 153(G), and 153(B). Specifically, the panel drive unit 156 applies a drive voltage corresponding to the image information input from the image processing unit 130 to each pixel of the image formation regions 154(R), 154(G), and 154(B) under the control of the first control unit 170. As a result, each pixel of the image formation regions 154(R), 154(G), and 154(B) is set to a light transmittance corresponding to the image information. The light emitted from the light source 151 is modulated for each pixel by passing through the image formation regions 154(R), 154(G), and 154(B) of the liquid crystal panels 153(R), 153(G), and 153(B), and image light corresponding to the image information is formed for each color light. The formed image light of each color is synthesized for each pixel by a color synthesis optical system (not shown) to become image light representing a color image, and is enlarged and projected onto the screen 10 by the projection lens 155.

[0031] The first control unit 170 includes a first storage unit 180 and a first processor 190.

[0032] The first memory unit 180 includes at least a non-volatile memory device. Additionally, the first memory unit 180 may be configured to further include a volatile memory device. The non-volatile memory device is composed of, for example, a ROM (Read Only Memory), a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), or the like.

[0033] The first memory unit 180 is used as the operation area of the first processor 190. Also, the first memory unit 180 stores a control program 181 executed by the first processor 190, setting data related to the operation of the projector 100, and the like. Further, the first memory unit 180 stores PJ manufacturer information 183, third manufacturer information 185, and a device class database 187. Hereinafter, the database is abbreviated as DB.

[0034] The PJ manufacturer information 183 registers manufacturer information indicating the manufacturer of the projector 100 and model information indicating the model of the device provided by this manufacturer. The manufacturer information and model information registered in the PJ manufacturer information 183 correspond to the second manufacturer information and the second model information. The third manufacturer information 185 registers, in association with each other, manufacturer information indicating a third manufacturer that is a manufacturer other than the manufacturer of the projector 100 and model information indicating the model of the device provided by this third manufacturer. The manufacturer information and model information registered in the third manufacturer information 185 correspond to the second manufacturer information and the second model information. The device class DB 187 registers information indicating the USB device class and the types of devices classified into this USB device class. The device class DB 187 corresponds to the information of the USB device class.

[0035] The first processor 190 is an arithmetic processing device equipped with a processor such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The first processor 190 may be composed of a single processor or may be composed of a plurality of processors. Further, the first processor 190 may be composed of a part or all of the first storage unit 180 or a SoC (System on a Chip) integrated with other circuits. Also, the first processor 190 may be composed of a combination of a CPU that executes a program and a DSP (Digital Signal Processor) that executes predetermined arithmetic processing. Furthermore, all the functions of the first processor 190 may be implemented in hardware or may be configured using a programmable device.

[0036] [3. Configuration of the terminal device] FIG. 3 is a block diagram showing the configuration of the terminal device 200. The configuration of the terminal device 200 will be described with reference to FIG. 3.

[0037] The terminal device 200 includes a second wireless communication I / F 210, a touch panel 220, and a second control unit 230.

[0038] The second wireless communication I / F 210 includes hardware such as a wireless LAN card and performs wireless communication in the Wi-Fi system based on, for example, the IEEE 802.11 standard or a standard equivalent thereto. The communication system of the second wireless communication I / F 210 is not limited to Wi-Fi and may be, for example, short-range wireless communication such as Bluetooth or Miracast.

[0039] The touch panel 220 includes a display panel 221 such as a liquid crystal panel or an organic EL (Electro Luminescence) panel, and a touch sensor 223 disposed on top of the display panel 221. The touch sensor 223 detects a touch operation at the position of the touch panel 220 where the user's finger touches. The touch sensor 223 outputs an operation signal including coordinate information indicating the position of the detected touch operation to the second control unit 230. Also, the touch panel 220 may be provided with hardware buttons.

[0040] The second control unit 230 includes a second storage unit 240 and a second processor 250.

[0041] The second storage unit 240 includes at least a non-volatile storage device. The second storage unit 240 may be configured to include a volatile storage device in addition to the non-volatile storage device. The second storage unit 240 is configured by, for example, a ROM, a flash memory, an EEPROM, etc.

[0042] The second storage unit 240 stores an OS (Operating System) 241 and an application program 243 as control programs executed by the second processor 250. Also, the second storage unit 240 is used as an arithmetic area of the second processor 250. Hereinafter, the application program 243 is abbreviated as APP243.

[0043] The second processor 250 is an arithmetic processing device including a processor such as a CPU or an MPU. The second processor 250 may be configured by a single processor, or may be configured by a plurality of processors. Also, the second processor 250 may be configured by a SoC integrated with a part or all of the second storage unit 240 and other circuits. Also, the second processor 250 may be configured by a combination of a CPU that executes a program and a DSP that executes predetermined arithmetic processing. Furthermore, all the functions of the second processor 250 may be implemented in hardware, or may be configured using a programmable device.

[0044] [4. Operations of the Projector and the Terminal Device] When an external device 50 is connected to the input I / F 110 or the network I / F 120, the first control unit 170 acquires identification information of the external device 50 from the connected external device 50. The first control unit 170 generates screen information based on the acquired identification information.

[0045] The identification information is, for example, information indicating the manufacturer and model of the external device 50. For example, when the projector 100 and the external device 50 are connected by an HDMI cable, a Displayport cable, a DVI cable, etc., the projector 100 acquires the identification information of the external device 50 as EDID (Extended Display Identification Data) from the external device 50.

[0046] Also, when the projector 100 and the external device 50 are connected by a USB cable, the identification information includes information such as a vendor ID, a product ID, and a USB device class. The vendor ID is an identifier that uniquely identifies the vendor who is the manufacturer of the external device 50. The product ID is an identifier indicating the model of the device that is the external device 50. The USB device class is information obtained by classifying the USB device that is the external device 50 according to the functions provided by the USB device. By specifying the USB device class of the external device 50, for example, the type of the external device 50 such as a camera, a speaker, a mouse, etc. can be specified.

[0047] Also, when the external device 50 is connected to the projector 100 via a network, the projector 100 may send a request for acquiring information indicating the manufacturer and model of the external device 50 to the external device 50 and acquire the information indicating the manufacturer and model from the external device 50. For example, when the external device 50 executes an application program installed in the external device 50 and this application program communicates with the projector 100, the identification information of the application program may be acquired.

[0048] In addition, the identification information acquired by the projector 100 when the external device 50 is connected includes information on the interface to which the external device 50 is connected. For example, when the external device 50 is connected to the HDMI_IF111 via an HDMI cable, the first control unit 170 acquires HDMI as the interface information. Also, when the external device 50 is connected to the USB_IF113 via a USB cable, the first control unit 170 acquires USB as the interface information. For example, HDMI corresponds to information regarding the first interface, and USB corresponds to information regarding the second interface.

[0049] The screen information is information necessary for generating an operation screen. The operation screen is generated by the terminal device 200 and displayed on the touch panel 220 of the terminal device 200. Also, the operation screen is a screen for operating the external device 50. For example, when the external device 50 is the camera 50A, operation elements for adjusting zoom, focus, illumination, etc. are displayed on the operation screen.

[0050] The screen information includes, for example, information on operation elements such as buttons and sliders included in the operation screen, position information indicating the display positions of these operation elements on the operation screen, information indicating the range of operation values accepted by the operation of the operation elements, etc. Also, the screen information includes interface information for connecting the projector 100 and the external device 50. The interface information corresponds to information regarding the interface. By transmitting the screen information including the interface information to the terminal device 200, the information on the interface for connecting the projector 100 and the external device 50 can be displayed on the operation screen.

[0051] When the first control unit 170 acquires the identification information, it acquires the manufacturer information and the model information from the acquired identification information. Hereinafter, the manufacturer information and the model information acquired from the identification information are referred to as the device manufacturer information and the device model information. The first control unit 170 determines whether information that matches the device manufacturer information and the device model information is registered in the PJ manufacturer information 183. That is, the first control unit 170 determines whether the external device 50 is a device manufactured by the manufacturer of the projector 100. The device manufacturer information corresponds to the first manufacturer information, and the device model information corresponds to the first model information.

[0052] When information that matches the manufacturer information and the device model information is registered in the PJ manufacturer information 183, the first control unit 170 acquires first screen information, which is screen information necessary to generate a dedicated operation screen prepared in advance by this manufacturer. The first control unit 170 transmits the acquired first screen information to the terminal device 200. The manufacturer is the manufacturer of the projector 100 and the external device 50. Also, the dedicated operation screen is referred to as a dedicated operation screen. The dedicated operation screen is a screen associated with the manufacturer and the model, and is, for example, an operation screen corresponding to one or a plurality of specific models of devices among the products of a specific manufacturer.

[0053] The first screen information may be stored in advance in the first storage unit 180, or may be acquired, for example, from a server device (not shown) connected to the network. Also, in the first storage unit 180, the functions provided in the external device 50 corresponding to the device manufacturer information and the device model information and the setting ranges of the respective functions are registered, and the first control unit 170 may generate the first screen information based on this information.

[0054] The dedicated operation screen includes an operator that accepts an operation for changing the settings of functions that the external device 50 generally has. For example, when the external device 50 is the camera 50A, the operator that accepts an operation for changing the settings of functions that the external device 50 generally has includes a button for shutter operation and the like. Further, the dedicated operation screen includes an operator that accepts an operation for changing the settings of functions that are commonly mounted in the models of the external device 50 provided by the manufacturer of the external device 50. Furthermore, the dedicated operation screen includes an operator that accepts an operation for changing the settings of functions that are mounted only in the external device 50. The operator included in the dedicated operation screen can also be referred to as an operation unit.

[0055] When the information that matches the device manufacturer information and the device model information is not registered in the PJ manufacturer information 183, the first control unit 170 determines whether the information that matches the device manufacturer information and the device model information is registered in the third manufacturer information 185.

[0056] When the information that matches the device manufacturer information and the device model information is registered in the third manufacturer information 185, the first control unit 170 acquires second screen information, which is the screen information necessary for generating an operation screen for operating the functions provided by the model of the external device 50 indicated by the device model information. The first control unit 170 transmits the acquired second screen information to the terminal device 200. The operation screen for operating the functions provided by the corresponding model of the external device 50 is referred to as a model operation screen. That is, the model operation screen is an operation screen corresponding to a device of a specific model.

[0057] The second screen information may also be stored in the first storage unit 180 in advance, or may be acquired from a server device (not shown) connected to the network, for example. Further, the functions provided by the external device 50 and the setting ranges of the respective functions may be registered in the first storage unit 180, and the first control unit 170 may generate the second screen information based on this information.

[0058] The model operation screen includes an operator that accepts an operation to change the settings of functions that the external device 50 generally has. For example, when the external device 50 is the camera 50A, the operator that accepts an operation to change the settings of functions that the external device 50 generally has includes buttons for shutter operation and the like. Also, the dedicated operation screen includes an operator that accepts an operation to change the settings of functions that are commonly mounted on the models of the external device 50 provided by the manufacturer of the external device 50. The operator included in the model operation screen can also be referred to as an operation unit. The number of operators included in the model operation screen is smaller than the number of operators included in the dedicated operation screen.

[0059] When the information that matches the device manufacturer information and the device model information is not registered in the third manufacturer information 185, the first control unit 170 determines whether the USB device class is included in the identification information acquired from the external device 50. When the external device 50 is connected to the USB_IF113 via a USB cable, the identification information acquired from the external device 50 includes the USB device class.

[0060] When the USB device class is included in the identification information, the first control unit 170 acquires this USB device class. The first control unit 170 determines whether the acquired USB device class is registered in the device class DB187.

[0061] When the acquired USB device class is registered in the device class DB187, the first control unit 170 acquires the type of device corresponding to the acquired USB device class from the device class DB187.

[0062] When the first control unit 170 acquires the type of the device, it acquires third screen information, which is screen information necessary for generating an operation screen for operating the functions provided by the device of the acquired type. The first control unit 170 transmits the acquired third screen information to the terminal device 200. An operation screen for operating the functions provided by the corresponding model of the external device 50 is referred to as a general-purpose operation screen. The general-purpose operation screen includes operation elements for accepting operations to change the settings of the functions generally provided by the external device 50. The number of operation elements included in the general-purpose operation screen is smaller than the number of operation elements included in the dedicated operation screen or the model operation screen. The operation elements included in the general-purpose operation screen can also be referred to as the operation unit.

[0063] The third screen information may also be stored in advance in the first storage unit 180, or may be acquired, for example, from a server device (not shown) connected to the network. Also, the type of the external device 50, the functions generally provided by this type of external device 50, and the setting range of each function may be registered in the first storage unit 180, and the first control unit 170 may generate the third screen information based on these information.

[0064] When the USB device class is not included in the identification information, the first control unit 170 does not transmit the screen information to the terminal device 200. That is, the terminal device 200 does not display the operation screen. Also, when the first control unit 170 cannot acquire the type of the device corresponding to the acquired USB device class from the device class DB 187, the first control unit 170 does not transmit the screen information to the terminal device 200. In this case as well, the terminal device 200 does not display the operation screen.

[0065] The second control unit 230 of the terminal device 200 performs processing by the second processor 250 executing the APP 243. When the second control unit 230 receives the first screen information from the projector 100, it generates a dedicated operation screen 510 based on the received first screen information. The dedicated operation screen 510 is generated, for example, in a data format such as HTML or XML. The second control unit 230 displays the generated dedicated operation screen 510 on the touch panel 220. Also, when the second control unit 230 receives the second screen information from the projector 100, it generates a model operation screen 530 based on the received second screen information. The model operation screen 530 is also generated, for example, in a data format such as HTML or XML. The second control unit 230 displays the generated model operation screen 530 on the touch panel 220. Furthermore, when the second control unit 230 receives the third screen information from the projector 100, it generates a general-purpose operation screen 550 based on the received third screen information. The general-purpose operation screen 550 is also generated, for example, in a data format such as HTML or XML. The second control unit 230 displays the generated general-purpose operation screen 550 on the touch panel 220.

[0066] FIG. 4 is a diagram showing a dedicated operation screen 510A when the external device 50 is the camera 50A. FIG. 5 is a diagram showing a model operation screen 530A when the external device 50 is the camera 50A. FIG. 6 is a diagram showing a general-purpose operation screen 550A when the external device 50 is the camera 50A. Hereinafter, when collectively referring to the dedicated operation screen 510, the model operation screen 530, and the general-purpose operation screen 550, it is denoted as the operation screen 500.

[0067] On the dedicated operation screen 510A, as operation elements, a slider bar 511A for zoom adjustment, a focus adjustment button 512A, a shutter button 513A, a pause button 514A, an illumination ON button 515A, and a power ON / OFF button 516A are displayed. On the model operation screen 530A, as operation elements, a slider bar 531A for zoom adjustment, a shutter button 533A, and a power ON / OFF button 536A are displayed. On the general-purpose operation screen 550A, as operation elements, a shutter button 553A and a power ON / OFF button 556A are displayed.

[0068] FIG. 7 is a diagram showing a dedicated operation screen 510B when the external device 50 is the speaker 50B. FIG. 8 is a diagram showing a model operation screen 530B when the external device 50 is the speaker 50B. FIG. 9 is a diagram showing a general-purpose operation screen 550B when the external device 50 is the speaker 50B.

[0069] On the dedicated operation screen 510B, as operation elements, a slider bar 511B for volume adjustment, a noise cancellation button 512B, a mute button 513B, and an equalizer 514B are displayed. On the model operation screen 530B, as operation elements, a slider bar 531B for volume adjustment and a mute button 533B are displayed. On the general-purpose operation screen 550B, as an operation element, a slider bar 551B for volume adjustment is displayed.

[0070] When an operation element is operated by the user, the second control unit 230 transmits control information indicating the received operation to the projector 100. The control information includes information indicating the operation element operated on the operation screen and information indicating the operation value received by the operation of the operation element.

[0071] When the first control unit 170 receives control information from the terminal device 200, it generates a control command for controlling the external device 50 based on the received control information. The control information includes information for controlling the external device 50. The control command includes a command for instructing an operation and information indicating an operation value. When the first control unit 170 generates a control command, it transmits the generated control command to the external device 50.

[0072] In this embodiment, a case where the projector 100 generates a control command based on the control information received from the terminal device 200 and transmits the generated control command to the external device 50 will be described. In addition, a configuration in which the terminal device 200 generates a control command and transmits the generated control command to the projector 100 may be adopted. The projector 100 transmits the control command received from the terminal device 200 to the corresponding external device 50 as it is.

[0073] Figure 10 is a flowchart showing the operation of the projector 100. The operation of the projector 100 will be described with reference to the flowchart shown in Figure 10. First, the first control unit 170 determines whether or not it has detected the connection of the external device 50 to the input I / F 110 or the network I / F 120 (step S1).

[0074] If the first control unit 170 has not detected the connection of the external device 50 to the input I / F 110 or the network I / F 120 (step S1 / NO), it repeats the determination in step S1. Also, when the first control unit 170 detects the connection of the external device 50 to the input I / F 110 or the network I / F 120 (step S1 / YES), it acquires identification information from the detected external device 50 (step S2).

[0075] Next, the first control unit 170 acquires the device manufacturer information and device model information included in the acquired identification information (step S2). Next, the first control unit 170 determines whether or not information matching the acquired device manufacturer information and device model information is registered in the PJ manufacturer information 183 (step S3).

[0076] If information matching the acquired device manufacturer information and device model information is registered in the PJ manufacturer information 183 (step S3 / YES), the first control unit 170 acquires the first screen information (step S4). The first control unit 170 may acquire the first screen information by generating the first screen information based on the information on the functions provided by the external device 50 corresponding to the device model information, or may acquire the first screen information stored in the first storage unit 180 in advance by reading it from the first storage unit 180. Also, the first control unit 170 may acquire the first screen information from a server device (not shown) connected to the network. The first control unit 170 transmits the acquired first screen information to the terminal device 200 (step S5), and returns to the determination in step S1.

[0077] Also, when the information that matches the acquired device manufacturer information and device model information is not registered in the PJ manufacturer information 183 (step S3 / NO), the first control unit 170 determines whether the information is registered in the third manufacturer information 185. The first control unit 170 determines whether the information that matches the acquired device manufacturer information and device model information is registered in the third manufacturer information 185 (step S6).

[0078] When the information that matches the acquired device manufacturer information and device model information is registered in the third manufacturer information 185 (step S6 / YES), the first control unit 170 acquires the second screen information (step S7). Also in this case, the second screen information may be acquired by generating the second screen information based on the information on the functions provided by the external device 50 corresponding to the device model information, or the second screen information stored in the first storage unit 180 in advance may be acquired by reading it from the first storage unit 180. Further, the first control unit 170 may acquire the second screen information from a server device (not shown) connected to the network. The first control unit 170 transmits the acquired second screen information to the terminal device 200 (step S8), and returns to the determination in step S1.

[0079] When the information that matches the acquired device manufacturer information and device model information is not registered in the third manufacturer information 185 (step S6 / NO), the first control unit 170 determines whether the USB device class is included in the identification information (step S9). When the USB device class is not included in the identification information (step S9 / NO), the first control unit 170 returns to the determination in step S1.

[0080] When the USB device class is included in the identification information (step S9 / YES), the first control unit 170 determines whether the USB device class included in the identification information is registered in the device class DB 187 (step S10).

[0081] When the USB device class is registered in the device class DB187 (step S10 / YES), the first control unit 170 acquires the type of the device corresponding to the acquired USB device class from the device class DB187. The first control unit 170 acquires third screen information for operating the functions provided by the device of the acquired type (step S11). The first control unit 170 transmits the acquired third screen information to the terminal device 200 (step S12), and returns to the determination in step S1.

[0082] When the USB device class is not registered in the device class DB187 (step S10 / NO), the first control unit 170 returns to the determination in step S1.

[0083] FIG. 11 is a flowchart showing the operation of the projector 100 when control information is received from the terminal device 200. The operation of the projector 100 will be described with reference to the flowchart shown in FIG. 11.

[0084] The first control unit 170 determines whether control information has been received from the terminal device 200 (step S21). When the first control unit 170 receives control information from the terminal device 200 (step S21 / YES), it generates a control command based on the received control information (step S22).

[0085] Next, the first control unit 170 transmits the generated control command to the corresponding external device 50 (step S23). Next, the first control unit 170 determines whether a notification of the end of operation has been received from the terminal device 200 (step S24). Also, when the first control unit 170 determines in step S21 that no control information has been received (step S21 / NO), it also determines whether a notification of the end of operation has been received from the terminal device 200 (step S24).

[0086] When the first control unit 170 has not received a notification of the end of operation from the terminal device 200 (step S24 / NO), it returns to the determination in step S21. Also, when the first control unit 170 receives a notification of the end of operation from the terminal device 200 (step S24 / YES), it ends this processing flow.

[0087] FIG. 12 is a flowchart showing the operation of the terminal device 200. The operation of the terminal device 200 will be described with reference to the flowchart shown in FIG. 12.

[0088] The second control unit 230 determines whether it has received screen information from the projector 100 (step T1). When the second control unit 230 has not received screen information from the projector 100 (step T1 / NO), it waits until it receives the screen information.

[0089] When the second control unit 230 receives screen information from the projector 100 (step T1 / YES), it generates an operation screen 500 based on the received screen information (step T2). The second control unit 230 displays the generated operation screen 500 on the touch panel 220 (step T3).

[0090] Next, the second control unit 230 determines whether it has received an operation on the operation screen 500 displayed on the touch panel 220 (step T4). When the second control unit 230 has not received an operation on the operation screen 500 (step T4 / NO), it proceeds to the determination in step T7. The determination in step T7 will be described later.

[0091] When the second control unit 230 receives an operation on the operation screen 500 (step T4 / YES), it generates control information corresponding to the received operation (step T5). The second control unit 230 transmits the generated control information to the projector 100 (step T6).

[0092] Next, the second control unit 230 determines whether an operation to erase the operation screen 500 is received from the touch panel 220 (step T7). If the second control unit 230 has not received an operation to erase the operation screen 500 (step T7 / NO), it returns to the determination in step T4.

[0093] When the second control unit 230 receives an operation to erase the operation screen 500 from the touch panel 220 (step T7 / YES), it erases the display of the operation screen 500 (step T8). Then, the second control unit 230 sends a notification of the end of the operation to the projector 100 (step T9) and ends this processing flow.

[0094] [5. Modification Example 1] In the first embodiment, the projector 100 generates any one of the first screen information, the second screen information, and the third screen information and transmits it to the terminal device 200, causing the terminal device 200 to generate the operation screen 500.

[0095] In Modification Example 1, the projector 100 generates a dedicated operation screen 510, a model operation screen 530, or a general-purpose operation screen 550 based on the first screen information, the second screen information, or the third screen information. The projector 100 transmits the data of the generated dedicated operation screen 510, model operation screen 530, or general-purpose operation screen 550 to the terminal device 200 as screen information. The terminal device 200 acquires the data included in the screen information received from the projector 100 and displays the acquired data on the touch panel 220. As a result, the dedicated operation screen 510, the model operation screen 530, or the general-purpose operation screen 550 is displayed on the touch panel 220.

[0096] In addition, when information that matches the manufacturer information and device model information included in the identification information is registered in the PJ manufacturer information 183, the first control unit 170 may obtain data of a dedicated operation screen prepared in advance by this manufacturer from the first storage unit 180. Further, when information that matches the manufacturer information and device model information included in the identification information is registered in the third manufacturer information 185, the first control unit 170 may obtain data of a model operation screen 530 corresponding to the model of the external device 50 from the first storage unit 180. The first control unit 170 transmits the obtained data of the dedicated operation screen or the data of the model operation screen 530 to the terminal device 200.

[0097] [6. Modification Example 2] In the above-described Embodiment 1, when the USB device class acquired by the projector 100 from the identification information was not registered in the device class DB 187, or when the USB device class could not be acquired from the identification information, the projector 100 did not transmit screen information to the terminal device 200. That is, the operation screen 500 was not generated.

[0098] In this Modification Example 2, when the USB device class acquired by the projector 100 from the identification information was not registered in the device class DB 187, or when the USB device class could not be acquired from the identification information, the projector 100 transmits the identification information to the terminal device 200. Further, when the projector 100 acquires identification information from the external device 50, the projector 100 may be configured to transmit the identification information to the terminal device 200 without performing processing for specifying the manufacturer and model of the external device 50 based on the acquired identification information.

[0099] In Modification Example 2, the second storage unit 240 of the terminal device 200 stores the PJ manufacturer information 183, the third manufacturer information 185, and the device class DB 187. It is assumed that the manufacturer of the projector 100 is the same as the manufacturer of the APP 243 installed in the terminal device 200. The terminal device 200 enables easy update of the APP 243. Since the update frequencies of the PJ manufacturer information 183, the third manufacturer information 185, and the device class DB 187 are high, the accuracy of identifying the manufacturer, model, and type is high. Therefore, the projector 100 transmits the identification information of the external device 50 to the terminal device 200, and the terminal device 200 performs a process of identifying the manufacturer and model of the external device 50.

[0100] When the second control unit 230 determines that the manufacturer of the external device 50 is the same as the provider of the APP 243, it generates a dedicated operation screen 510 and displays the generated dedicated operation screen 510 on the touch panel 220. Also, when the second control unit 230 determines that the manufacturer of the external device 50 is not the same as the provider of the APP 243 and identifies the model of the external device 50, it generates a model operation screen 530 and displays the generated model operation screen 530 on the touch panel 220. Furthermore, when the second control unit 230 determines that the manufacturer of the external device 50 is not the same as the provider of the APP 243 and identifies the type of the external device 50 based on the USB device information, it generates a general-purpose operation screen 550 and displays the generated general-purpose operation screen 550 on the touch panel 220.

[0101] [7. Modification Example 3] When a plurality of external devices 50 are connected to the projector 100, the operation screens 500 of these plurality of external devices 50 may be displayed on the touch panel 220. The projector 100 respectively obtains identification information from the plurality of connected external devices 50, and when the manufacturers and models of these plurality of external devices 50 are the same as the manufacturer and model of the projector 100, it transmits the first screen information to the terminal device 200. Also, when the manufacturers and models of the external devices 50 are not the same as the manufacturer and model of the projector 100 and the projector 100 identifies the models of the external devices 50, it transmits the second screen information to the terminal device 200. Furthermore, when the manufacturer and model of the external device 50 are not the same as those of the projector 100 and the projector 100 identifies the type of the external device 50 based on the USB device information, the projector 100 transmits the third screen information to the terminal device 200.

[0102] The terminal device 200 receives a plurality of pieces of screen information from the projector 100. This screen information may include a plurality of pieces of first screen information, second screen information, or third screen information, or may be a combination of different screen information. The terminal device 200 generates an operation screen 500 based on the received screen information.

[0103] Also, the screen information transmitted from the projector 100 to the terminal device 200 may include priority information. The priority information may be set in advance based on, for example, the interface connecting the projector 100 and the external device 50. For example, the priority of the external device 50 connected by the USB interface may be set to the first place, the priority of the external device 50 connected by the HDMI interface may be set to the second place, and the priority of the externally device 50 connected by network connection may be set to the third place. Also, when a plurality of external devices 50 are connected to the projector 100, the priority of the source switching screen for switching the source, which is the device that supplies the image data to be displayed on the projector 100, may be set to the first place. Since the source switching screen requires information on a plurality of interfaces to which the external device 50 is connected to the projector 100, the priority of the source switching screen can also be set to the first place.

[0104] The terminal device 200 generates an operation screen 500 based on a plurality of pieces of screen information received from the projector 100. This operation screen 500 may include a plurality of dedicated operation screens 510, model operation screens 530, or general-purpose operation screens 550, or may include different screens such as the dedicated operation screen 510 and the general-purpose operation screen 550.

[0105] FIG. 13 is a diagram showing an example of the operation screen 500. On the operation screen 500, the screen with a higher priority is displayed in front of the screen with a lower priority on the operation screen 500. In the example shown in FIG. 13, on the operation screen 500, the source switching screen 610, which is a screen with a higher priority, is displayed in front of the speaker control screen 630, which is a screen with a lower priority.

[0106] [8. Other Embodiments] The above-described embodiments are preferred embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the invention.

[0107] For example, in the above-described embodiment, the case where the optical modulation device includes three transmissive liquid crystal panels 153(R), 153(G), and 153(B) is described. However, the embodiments of the present invention are not limited to this. The optical modulation device may be a reflective liquid crystal panel or a digital micromirror device.

[0108] Also, each functional unit shown in FIGS. 2 and 3 shows a functional configuration, and the specific implementation form is not particularly limited. That is, it is not necessarily the case that hardware corresponding to each functional unit is individually mounted. Of course, it is also possible to adopt a configuration in which one processor executes a program to realize the functions of a plurality of functional units. Further, a part of the functions realized by software in the above-described embodiment may be realized by hardware, or a part of the functions realized by hardware may be realized by software.

[0109] Also, when realizing the control method of the information processing system using the computers provided in the projector 100 and the terminal device 200, it is also possible to configure it in the form of a recording medium for recording a program to be executed by this computer or a transmission medium for transmitting this program. As the recording medium, a magnetic, optical recording medium or a semiconductor memory device can be used. Specifically, portable or fixed recording media such as flexible disks, HDDs (Hard Disk Drives), CD-ROMs, DVDs, Blu-ray Discs, magneto-optical disks, flash memories, card-type recording media, etc. can be mentioned. Also, the above recording medium may be a non-volatile storage device such as a RAM, ROM, HDD, etc., which is an internal storage device provided in the server device. Blu-ray is a registered trademark.

[0110] [Summary of the present disclosure] Hereinafter, a summary of the present disclosure is appended.

[0111] (Appended Note 1) A control method of an information processing system, including: the first device acquiring identification information for identifying at least one device connected to the first device; the first device being information regarding an operation screen for receiving an operation on the at least one device, and transmitting screen information corresponding to the identification information to a terminal device connected to the first device; the terminal device displaying the operation screen based on the screen information; the terminal device transmitting control information for controlling the at least one device to the first device based on an operation on the operation screen; and the first device controlling the at least one device based on the control information.

[0112] As a result, screen information corresponding to identification information for identifying at least one device is transmitted from the first device to the terminal device, and an operation screen for receiving an operation on at least one device is displayed on the terminal device. Based on an operation on this operation screen, control information for at least one device is transmitted to the first device, and the first device controls at least one device based on the control information. Thereby, by operating the operation screen displayed on the terminal device, it becomes possible to operate at least one device, and the convenience for the user can be improved.

[0113] (Appendix 2) The at least one device includes a second device, and obtaining the identification information includes obtaining information regarding an interface for connecting the first device and the second device. Transmitting the screen information to the terminal device includes transmitting the screen information including the information regarding the interface to the terminal device. The control method of the information processing system according to Appendix 1 includes this.

[0114] As a result, screen information including information regarding an interface for connecting the first device and the second device is transmitted to the terminal device. Therefore, information regarding the interface for connecting the first device and the second device can be displayed on the operation screen, and the user can select the interface for connecting the first device and the second device by operating the operation screen.

[0115] (Appendix 3) The at least one device includes a third device, and obtaining the identification information includes obtaining information regarding a first interface for connecting the first device and the second device and information regarding a second interface for connecting the first device and the third device. Transmitting the screen information to the terminal device includes transmitting the screen information including the information regarding the first interface and the information regarding the second interface to the terminal device. The control method of the information processing system according to Appendix 2 includes this.

[0116] As a result, screen information including information on the first interface connecting the first device and the second device and information on the second interface connecting the first device and the third device is transmitted to the terminal device. Therefore, information on the interface connecting the first device and the second device and information on the second interface connecting the first device and the third device can be displayed on the operation screen. For example, the user can switch the device that transmits data to the first device between the second device and the third device by operating the operation screen.

[0117] (Appendix 4) Obtaining the identification information includes obtaining, from the at least one device, the identification information including first manufacturer information indicating the manufacturer of the at least one device and first model information identifying the model of the device manufactured by the manufacturer, and the control method of the information processing system according to Appendix 1.

[0118] As a result, it is possible to obtain, from at least one device, identification information including first manufacturer information indicating the manufacturer of the at least one device and first model information identifying the model of the device manufactured by the manufacturer. Therefore, the manufacturer and model of at least one device can be identified.

[0119] (Appendix 5) The first device includes a storage unit that stores second manufacturer information for identifying the manufacturer and second model information for identifying the model of the device. Transmitting the screen information to the terminal device includes determining whether the first manufacturer information matches the second manufacturer information and whether the first model information matches the second model information, and when the first manufacturer information matches the second manufacturer information and the first model information matches the second model information, transmitting the pre-registered data of the operation screen to the terminal device as the screen information, and the control method of the information processing system according to Appendix 4.

[0120] As a result, when the first manufacturer information obtained from at least one device matches the second manufacturer information stored in the storage unit and the first model information obtained from at least one device matches the second model information stored in the storage unit, the data of the operation screen registered in advance can be transmitted to the terminal device. For this reason, an operation screen corresponding to the functions provided by at least one device can be displayed on the terminal device. Therefore, the operability of the operation screen can be improved.

[0121] (Appendix 6) The obtaining of the identification information includes, when the interface connecting the first device and the at least one device is a USB (Universal Serial Bus) interface, obtaining information on the USB device class of the at least one device indicating the type of the device to which the at least one device belongs. The control method of the information processing system according to any one of Appendices 1 to 5.

[0122] As a result, when the first device and at least one device are connected by a USB interface, information on the USB device class indicating the type of the device to which the at least one device belongs can be obtained. Therefore, it becomes possible to display an operation screen corresponding to the type of the device to which at least one device belongs on the terminal device, and the convenience of the user operating the operation screen can be improved.

[0123] (Appendix 7) The first device stores information on the USB device class for identifying the type of the device in the storage unit. The obtaining of the identification information includes obtaining information on the USB device class of the at least one device from the at least one device. The transmitting of the screen information to the terminal device includes determining the type of the at least one device based on the information on the USB device class of the at least one device and the information on the USB device class stored in the storage unit, and transmitting the screen information corresponding to the type of the at least one device to the terminal device. The control method of the information processing system according to Appendix 6.

[0124] Accordingly, it is possible to determine the type of at least one device based on the information of the USB device class acquired from at least one device and the information of the USB device class stored in the storage unit. Therefore, it is possible to cause the terminal device to display an operation screen corresponding to the type of the device to which at least one device belongs, and it is possible to improve the convenience of the user who operates the operation screen.

[0125] (Appendix 8) Sending the screen information to the terminal device includes sending the screen information including information indicating the type of an operator to be displayed on the operation screen and information indicating the range of an operation value to be received by the operation of the operator to the terminal device, and is the control method of the information processing system according to any one of Appendices 1 to 7.

[0126] Accordingly, screen information including information indicating the type of an operator to be displayed on the operation screen and information indicating the range of an operation value to be received by the operation of the operator is sent from the first device to the terminal device. Accordingly, an operator corresponding to the type of the operator included in the screen information is displayed on the operation screen displayed by the terminal device, and when this operator is operated, an operation value corresponding to the operation can be received.

[0127] (Appendix 9) Sending the screen information to the terminal device includes sending the data of the operation screen to the terminal device as the screen information, and is the control method of the information processing system according to any one of Appendices 1 to 7.

[0128] Accordingly, the data of the operation screen is sent from the first device to the terminal device. For this reason, the terminal device displays the data included in the screen information received from the first device, so that the operation screen is displayed on the terminal device.

[0129] (Appendix 10) A control method for a processing device executed by a processor mounted on the processing device, the method comprising: the processor obtaining identification information for identifying an external device connected to the processing device; transmitting, to a terminal device connected to the processing device, screen information corresponding to the identification information, the screen information being information regarding an operation screen for receiving an operation on the external device; receiving, from the terminal device, control information based on an operation on the operation screen; and controlling the external device based on the control information.

[0130] As a result, screen information corresponding to identification information for identifying at least one device is transmitted from a first device to a terminal device, and an operation screen for receiving an operation on the at least one device is displayed on the terminal device. Based on an operation on this operation screen, control information for the at least one device is transmitted to the first device, and the first device controls the at least one device based on the control information. Thereby, it becomes possible to operate at least one device by operating the operation screen displayed on the terminal device, and the convenience for the user can be improved.

[0131] (Appendix 11) A control method for the terminal device executed by a processor mounted on the terminal device, the method comprising: the processor receiving, from a first device, screen information corresponding to identification information obtained by the first device from a second device, the screen information being information regarding an operation screen for receiving an operation on the second device connected to the first device; displaying the operation screen based on the screen information; receiving an operation on the operation screen; and transmitting control information corresponding to the operation to the first device.

[0132] As a result, screen information corresponding to identification information for identifying at least one device is transmitted from the first device to the terminal device, and an operation screen for receiving an operation on at least one device is displayed on the terminal device. Based on an operation on this operation screen, control information for at least one device is transmitted to the first device, and the first device controls at least one device based on the control information. Thereby, by operating the operation screen displayed on the terminal device, it becomes possible to operate at least one device, and the convenience for the user can be improved.

Explanation of Signs

[0133] 1... Information processing system, 10... Screen, 50... External device, 50A... Camera, 50B... Speaker, 50C... Personal computer, 100... Projector, 110... Input I / F, 111... HDMI_IF, 113... USB_IF, 120... Network I / F, 121... Wired communication I / F, 123... First wireless communication I / F, 130... Image processing unit, 135... Frame memory, 150... Image projection unit, 151... Light source, 152... Optical modulation device, 153... Liquid crystal panel, 154... Image formation area, 155... Projection lens, 156... Panel drive unit, 170... First control unit, 180... First memory unit, 181... Control program, 183... PJ manufacturer information, 185... Third manufacturer information, 187... Device class database, 190... First processor, 200... Terminal device, 210... Second wireless communication I / F, 220... Touch panel, 223... Touch sensor, 230... Second control unit, 240... Second memory unit, 243... APP, 245... Control program, 250... Second processor, 500... Operation screen, 510, 510A, 510B... Dedicated operation screen, 511A, 511B... Slider bar, 512A... Focus adjustment button, 512B... Noise cancellation button, 513A... Shutter button, 513B... Mute button, 514A... Pause button, 514B... Equalizer, 516A... ON / OFF button, 530, 530A, 530B... Model operation screen, 531A, 531B... Slider bar, 533A... Shutter button, 533B... Mute button, 536A... ON / OFF button, 550, 550A, 550B... General-purpose operation screen, 551B... Slider bar, 553A... Shutter button, 556A... ON / OFF button, 610... Source switching screen, 630... Speaker control screen.

Claims

1. The first device obtains identification information for identifying at least one device connected to the first device; The first device transmits screen information corresponding to the identification information, which is information regarding an operation screen for receiving an operation on the at least one device, to a terminal device connected to the first device; The terminal device displays the operation screen based on the screen information; The terminal device transmits control information for controlling the at least one device to the first device based on an operation on the operation screen; The first device controls the at least one device based on the control information; A control method for an information processing system, including the above.

2. The at least one device includes a second device, The obtaining of the identification information includes obtaining information regarding an interface for connecting the first device and the second device, The transmitting of the screen information to the terminal device includes transmitting the screen information including the information regarding the interface to the terminal device. The control method for an information processing system according to Claim 1, including the above.

3. The at least one device includes a third device, The obtaining of the identification information includes obtaining information regarding a first interface for connecting the first device and the second device and information regarding a second interface for connecting the first device and the third device, The transmitting of the screen information to the terminal device includes transmitting the screen information including the information regarding the first interface and the information regarding the second interface to the terminal device. The control method for an information processing system according to Claim 2, including the above.

4. The obtaining of the identification information includes obtaining the identification information including first manufacturer information indicating a manufacturer of the at least one device and first model information for identifying a model of the device manufactured by the manufacturer from the at least one device. The control method for an information processing system according to Claim 1, including the above.

5. The first device includes a storage unit that stores second manufacturer information for identifying a manufacturer and second model information for identifying a model of the device, The transmitting of the screen information to the terminal device includes determining whether the first manufacturer information matches the second manufacturer information and whether the first model information matches the second model information. When the first manufacturer information matches the second manufacturer information and the first model information matches the second model information, transmitting the pre-registered data of the operation screen to the terminal device as the screen information; The control method of the information processing system according to claim 4, including this.

6. Obtaining the identification information includes: When the interface connecting the first device and the at least one device is a USB (Universal Serial Bus) interface, obtaining information on the USB device class of the at least one device indicating the type of device to which the at least one device belongs. The control method of the information processing system according to claim 1.

7. The first device stores information on the USB device class for identifying the type of device in the storage unit. Obtaining the identification information includes: Obtaining information on the USB device class of the at least one device from the at least one device. Transmitting the screen information to the terminal device includes: Determining the type of the at least one device based on the information on the USB device class of the at least one device and the information on the USB device class stored in the storage unit; Transmitting the screen information corresponding to the type of the at least one device to the terminal device. The control method of the information processing system according to claim 6, including this.

8. Transmitting the screen information to the terminal device means: Transmitting the screen information including information indicating the type of operator to be displayed on the operation screen and information indicating the range of operation values received by the operation of the operator to the terminal device. The control method of the information processing system according to any one of claims 1 to 7, including this.

9. Transmitting the screen information to the terminal device includes: Transmitting the data of the operation screen to the terminal device as the screen information. The control method of the information processing system according to any one of claims 1 to 7, including this.

10. A control method of a processing device executed by a processor mounted on the processing device, wherein The processor Obtains identification information for identifying an external device connected to the processing device; Transmits screen information corresponding to the identification information, which is information regarding an operation screen for receiving an operation on the external device, to a terminal device connected to the processing device. Receiving control information based on an operation on the operation screen from the terminal device; Controlling the external device based on the control information; A control method for a processing device, comprising the above steps.

11. A control method for the terminal device executed by a processor mounted on the terminal device, wherein: The processor: Receives, from the first device, screen information corresponding to identification information acquired by the first device from a second device, the screen information being information regarding an operation screen for receiving an operation on the second device connected to the first device; Displays the operation screen based on the screen information; Receives an operation on the operation screen; Transmits control information corresponding to the operation to the first device; A control method for a terminal device, comprising the above steps.

Images