Information processing device, information processing system, control method for information processing device, and storage medium

Abstract

An information processing device comprises: an operation means for receiving an operation by a user; an acquisition means for acquiring relationship information regarding the relationship between a user and a function executed when the operation means is operated by the user, for each of a plurality of users; a identifying means for identifying the user using its device; and an execution means for executing the function related to the identified user in the relationship information when the operation means is operated by the user. The operation means comprises a first operation means and a second operation means different from the first operation means. The relationship information includes information regarding the relationship between the user and a function executed when the first operation means is operated by the user, and information regarding the relationship between the user and a function executed when the second operation means is operated by the user.

Description

Technology Field

[0001] The present disclosure relates to an information processing device, an information processing system, a method for controlling an information processing device, and a storage medium. Background Technology

[0002] Conventionally, there exists an information processing device, such as an imaging device, that is equipped with an operating unit that receives user operations and executes a function when the operating unit is operated. Additionally, there exists a technology that executes a function corresponding to the user when the operating unit is operated. For example, Japanese Patent Publication No. 2013-172432 discloses that, when displaying a user interface that receives camera operations on a head-mounted display, a method of determining which function operation button to display on the user interface based on the input frequency of camera operation instructions.

[0003] Here, multiple users may use the same information processing device. In this case, if only a function suitable for a specific user among the multiple users is configured as a function executed when the control unit of the information processing device is operated, there is a concern that the convenience of users different from the specific user among the multiple users may be compromised.

[0004] The present disclosure aims to realize the execution of a function corresponding to a user who operates an operating part of an information processing device among a plurality of users using an information processing device having a plurality of functions.

[0005] An information processing device according to one aspect of the present disclosure comprises: an operation means for receiving an operation by a user; an acquisition means for acquiring relationship information regarding the relationship between a user and a function executed when the operation means is operated by the user for each of a plurality of users; a specification means for specifying the user using its device; and an execution means for executing the function related to the specified user in the relationship information when the operation means is operated by the user, wherein the operation means comprises a first operation means and a second operation means different from the first operation means, and the relationship information comprises information regarding the relationship between the user and a function executed when the first operation means is operated by the user, and information regarding the relationship between the user and a function executed when the second operation means is operated by the user.

[0006] The features of the present disclosure will become apparent from the description of the following embodiments with reference to the accompanying drawings. The description of the following embodiments is explained by example. Brief explanation of the drawing

[0007] FIG. 1a is a drawing illustrating an example of the configuration of a shooting system, and FIG. 1b is a drawing illustrating the configuration of a glass device. Figure 2 is a diagram illustrating the functional configuration of the camera and the functional configuration of the glass device. Figure 3 is a drawing illustrating the configuration of the operation reception unit. Figure 4 is a drawing illustrating an image. Figure 5 is a flowchart illustrating the flow of function setting processing. FIGS. 6a to 6c are drawings illustrating a method of registering a glass device to a camera. FIGS. 7a to 7c are drawings illustrating a method for a user to select a camera function that is executed when the operation reception unit is operated. Figure 8 is a flowchart illustrating user-specific processing. Figure 9 is a diagram illustrating a user management table. Figure 10 is a flowchart illustrating the flow of execution processing. FIG. 11 is a diagram illustrating information displayed on the display of a glass device by performing execution processing. Figure 12 is a drawing illustrating an image. Figure 13 is a diagram illustrating a user management table. FIG. 14 is a diagram illustrating information displayed on the display of a glass device by performing execution processing. Specific details for implementing the invention

[0008] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0009] FIG. 1a is a drawing illustrating an example configuration of a shooting system (100). A shooting system (100), which is an example of an information processing system, comprises a camera (102) and a plurality of glass devices (104).

[0010] In this embodiment, multiple users take turns using the camera (102). In this case, among the multiple users using the camera (102), the function of the camera (102) corresponding to the user who operated the camera (102) is executed. Additionally, in this embodiment, the function executed when the camera (102) is operated is displayed on each glass device (104).

[0011] A camera (102), which is an example of an information processing device, photographs a subject (103). In this embodiment, the camera (102) is used alternately by three people, User 1, User 2, and User 3.

[0012] A glass device (104), which is an example of a user terminal, is a terminal device that is mounted on a user to display information. In the shooting system (100) of the present embodiment, a glass device (104) is installed for each user who uses the camera (102). More specifically, the shooting system (100) is equipped with a glass device 104A used by User 1, a glass device 104B used by User 2, and a glass device 104C used by User 3. Examples of glass devices (104) include augmented reality (AR) glasses and smart glasses. Hereinafter, it is assumed that glass devices 104A and 104B are AR glasses, and glass device 104C is smart glasses.

[0013] FIG. 1b is a drawing illustrating the configuration of a glass device (104).

[0014] The glass device (104) is equipped with a display (110), a camera (111), and an input / output unit (112).

[0015] As an example of a display unit, the display (110) displays information. In this embodiment, when the user is wearing the glass device (104), information is displayed on the glass device (104), and the displayed information enters the user's field of vision.

[0016] As an example of a means of imaging, the camera (111) images the direction in which the gaze of a user wearing a glass device (104) is directed.

[0017] The input / output unit (112) receives sound input and outputs sound. User 1, User 2 and User 3 communicate with each other via voice through the glass device (104).

[0018] The configuration of the glass device 104 may vary depending on each glass device (104). For example, the camera (111) may not be installed in the glass device 104C.

[0019] In this embodiment, it is assumed that User 1, User 2, and User 3 use the camera (102) according to their respective roles to shoot video such as movies. More specifically, it is assumed that User 1 is in charge of the amount of light or the direction of the light, User 2 is in charge of adjusting the image quality, and User 3 is in charge of operations such as adjusting the angle of the camera (102) or shooting. However, the users of the shooting system (100) are not limited to the above examples. The users of the shooting system (100) may include users such as a focus man, a director, and a camera assistant. In addition, the shooting system (100) may be equipped with a lighting operator for each light. Furthermore, a glass device (104) may be installed in the shooting system (100) for each user who uses the camera (102). In addition, the user of the shooting system (100) may be a single user.

[0020] FIG. 2 is a drawing illustrating the functional configuration of the camera (102) and the functional configuration of the glass device (104).

[0021] The camera (102) is equipped with an imaging unit (201), a memory (202), a communication unit (203), an operation reception unit (204), a management unit (205), and a system control unit (206).

[0022] An imaging unit (201), which is an example of an imaging means, captures a subject (103). A memory (202) stores information such as an image captured by the imaging unit (201). A communication unit (203), which is an example of an acquisition means, communicates with an external device, such as a glass device (104), via wireless communication technology, and transmits and receives information to and from the external device. An operation receiving unit (204), which is an example of an operation means, receives an operation of the user's camera (102). Examples of the operation receiving unit (204) include a touch panel and a push button. Additionally, examples of operations received by the operation receiving unit (204) include operations regarding various settings of the camera (102). A management unit (205) manages the functions executed when the operation receiving unit (204) is operated for each user. A system control unit (206), which is an example of an execution means, is equipped with a CPU, ROM, RAM, etc., and the CPU loads and executes a program stored in ROM in the work area of ​​RAM to control the operation of the entire camera (102). In addition, the system control unit (206) executes a program stored in ROM to realize each process of the present embodiment described later. The RAM loads constants, variables, and a program read from ROM that are used during the operation of the system control unit (206).

[0023] The glass device (104) is equipped with a display control unit (121), an imaging unit (122), a judgment unit (123), a detection unit (124), and a communication unit (125).

[0024] The communication unit (125) communicates with an external device, such as a camera (102), via wireless communication technology, and transmits and receives information to and from the external device. A display control unit (121), which is an example of a display control means, displays information acquired by the glass device (104) or information generated by the glass device (104) on the display (110) through the communication unit (125). The imaging unit (122) captures the direction in which the gaze of a user wearing the glass device (104) is directed. The judgment unit (123) determines whether the user wearing the glass device (104) is using the camera (102). The detection unit (124) detects the camera (102) and the operation reception unit (204) of the camera (102) where the image captured by the imaging unit (122) appears.

[0025] FIG. 3 is a diagram illustrating the configuration of the operation reception unit (204) of the camera (102). In this embodiment, the operation reception unit (204) of the camera (102) is equipped with a touch panel (204a), a button 204b, a button 204c, and a button 204d.

[0026] The touch panel (204a) displays information corresponding to user operation. For example, the touch panel (204a) displays a menu screen, etc., that accepts various settings regarding the camera (102) according to user operation. In this embodiment, the system control unit (206) controls the information displayed on the touch panel (204a).

[0027] Buttons 204b, 204c, and 204d are push buttons that receive user operations. Hereinafter, when describing buttons 204b, 204c, and 204d without special distinction, they will simply be referred to as "buttons." These buttons are also considered as operation parts that receive user operations.

[0028] When a button of the camera (102) is operated, a function of the camera (102) corresponding to whether the operated button is button 204b, button 204c, or button 204d is executed. In addition, in this embodiment, depending on whether User 1, User 2, or User 3 operates a button of the camera (102), different functions are executed even when the same button of the camera (102) is operated.

[0029] Next, an image captured by the imaging unit (122) of the glass device (104) will be described.

[0030] For example, when User 1, equipped with the glass device 104A, is looking at the camera (102) and the subject (103) (see FIG. 1a and FIG. 1b), imaging is performed by the imaging unit (122) of the glass device 104A. In this case, an image (304) as shown in FIG. 4 is generated. The image (304) shows a camera area (301), which is a display area of ​​the camera (102), a subject area (302), which is a display area of ​​the subject (103), and a lighting area (303), which is a display area of ​​the lighting that User 1 is remotely controlling. This image (304) corresponds to the scene visible in User 1's field of vision.

[0031] FIG. 5 is a flowchart illustrating the flow of function setting processing. Function setting processing is a process of setting a function that is executed for each user when the camera (102) is operated by the operation reception unit (204). In this embodiment, for example, function setting processing is started at a predetermined time interval. The predetermined time interval may be any time interval, or for example, 1 second.

[0032] The system control unit (206) of the camera (102) determines whether there has been a request for registration of the camera (102) of the glass device (104) (step (hereinafter referred to as “S”) S401). The system control unit (206) determines that there has been a request for registration of the glass device (104) when the operation of the operation receiving unit (204) for requesting registration of the camera (102) of the glass device (104) is performed by the user. Additionally, the system control unit (206) determines that there has been a request for registration of the glass device (104) when it receives information indicating a request for registration of the camera (102) of the glass device (104) from the glass device (104) through the communication unit (203).

[0033] When there is a request for registration of the glass device (104) to the camera (102) (Yes in S401), the system control unit (206) registers the glass device (104) that is the subject of the request to the camera (102) (S402).

[0034] The system control unit (206) transmits detection information stored in memory (202) to the glass device (104) registered in step S402 (S403). The detection information is information used for detection by the glass device (104) approaching the camera (102) when the glass device (104) approaches the camera (102).

[0035] The above detection information may include information used to detect the camera (102) from an image obtained when the glass device (104) captures the camera (102) as a subject. Additionally, the information used to detect the camera (102) from an image obtained when the glass device (104) captures the camera (102) as a subject may include an image showing the appearance of the camera (102) or a 3D model of the camera (102). Furthermore, the identifier of the camera (102) when the glass device (104) and the camera (102) communicate may also be the above detection information.

[0036] If there is no request for registration to the camera (102) of the glass device (104) (No in S401), or after step S403, proceed to the next step. The system control unit (206) determines whether there is a request for a function setting that is executed when the operation receiving unit (204) is operated (S404). The system control unit (206) determines that there is a request for a function setting if an operation to the operation receiving unit (204) for requesting a function setting that is executed when the operation receiving unit (204) is operated is performed by a user. Additionally, the system control unit (206) determines that there is a request for a function setting if it receives information indicating that a request for a function setting is made from the glass device (104) through the communication unit (203).

[0037] If there is no request for function setting (No in S404), the function setting process is terminated.

[0038] Additionally, if there is a request for function setting (Yes in S404), the system control unit (206) sets a function that is executed when the operation receiving unit (204) is operated (S405). More specifically, the system control unit (206) sets a function that is executed when the operation receiving unit (204) is operated according to the user's operation of the operation receiving unit (204).

[0039] FIGS. 6a to 6c are drawings illustrating a method of registering a glass device (104) to a camera (102).

[0040] Below, an example is described of a case where the glass device 104A equipped by User 1 is registered with the camera (102).

[0041] First, when the user operates the touch panel (204a) of the camera (102), a registration acceptance screen is displayed on the touch panel (204a), as shown in FIG. 6a. This registration acceptance screen is a screen for accepting registration to the camera (102) of the glass device (104). On the registration acceptance screen, text such as "connected terminal," "smart glass 1," and "AR glass 2" is displayed. This indicates that "smart glass 1" and "AR glass 2" have already been registered to the camera (102). "Smart glass 1" corresponds to glass device 104C, and "AR glass 2" corresponds to glass device 104B.

[0042] Here, when the user selects "Add Terminal" on the touch panel (204a), it is determined in the function setting process that there has been a request for registration to the camera (102) of the glass device (104) (Yes in S401 of FIG. 5). In this case, as shown in FIG. 6b, a list of devices that can be registered with the camera (102) is displayed on the touch panel (204a). On the touch panel (204a), devices that can be registered with the camera (102) and that are capable of communicating with the camera (102) and whose communication is permitted by the camera (102) may be displayed. In the illustrated example, the text "AR Glass 1" is displayed as a device that can be registered with the camera (102). "AR Glass 1" corresponds to the glass device 104A.

[0043] Here, when the user selects "AR Glasses 1" on the touch panel (204a), the system control unit (206) registers the glasses device 104A with the camera (102) (S402 in FIG. 5). In this case, as shown in FIG. 6c, "AR Glasses 1" is displayed on the touch panel (204a) as a "connected terminal."

[0044] Registration of the camera (102) of the glass device (104) may be performed by any user.

[0045] In addition, in the example described above, registration of the glass device (104) to the camera (102) was explained, but the present disclosure is not limited thereto.

[0046] For example, instead of the glass device (104), a user who will use the camera (102) may be registered with the camera (102). In this case, the target registered with the camera (102) may be identification information that identifies the user, such as a user count.

[0047] FIGS. 7a to 7c are drawings illustrating a method for a user to select a function of a camera (102) that is executed when the operation reception unit (204) is operated.

[0048] Below, an example is described of a user 1 selecting a function of the camera (102) that is executed when the operation reception unit (204) is operated.

[0049] First, when User 1 operates the touch panel (204a) of the camera (102), a function reception screen is displayed on the touch panel (204a) as shown in FIG. 7a. The function reception screen is a screen that receives the selection of a function of the camera (102) that is executed when the operation reception unit (204) is operated. Additionally, the function reception screen shown in FIG. 7a is a screen that receives the selection of a function of the camera (102) that is executed when the operation reception unit (204) is operated by User 1. The function reception screen shows the functions that are executed when each of the buttons 204b, 204c, and 204d of the operation reception unit (204) is operated.

[0050] In the illustrated example, the text "Button 1: Display Menu" is illustrated. This means that when Button 1 is operated, the function of the camera (102) that is executed displays a menu screen on the touch panel (204a). Button 1 represents Button 204b.

[0051] Additionally, in the illustrated example, the text "Button 2: Start recording" is illustrated. This means that when Button 2 is operated, the function of the camera (102) executed is the start of recording. Button 2 represents Button 204c.

[0052] In the illustrated example, the text "Button 3: Playback Mode" is illustrated. This means that the function of the camera (102) executed when Button 3 is operated is video playback. Button 3 represents Button 204d.

[0053] The function assignment for each button shown in Fig. 7a is the initial setting.

[0054] Here, for example, if User 1 selects "Button 1" on the function reception screen, it is determined that there is a request for a function setting in the function setting process (Yes in S404). In this case, as shown in FIG. 7b, a list of functions that can be executed when the operation reception unit (204) is operated is displayed. User 1 selects a function from the screen so that a function that is frequently used when using the camera (102) is executed when the button of the operation reception unit (204) is operated.

[0055] As described above, since User 1 is in charge of lighting, it is necessary to check the brightness of the image captured by the camera (102). Therefore, it is assumed that User 1 selects "Waveform Monitor Display" on the touch panel (204a). "Waveform Monitor Display" is a function that displays a waveform monitor on the UI of the camera (102). In this case, the system control unit (206) sets the function of the camera (102) that is executed when User 1 operates button 204b to Waveform Monitor Display (S405 of FIG. 5). As shown in FIG. 7c, on the function reception screen, the function associated with "Button 1" is changed from "Menu Display" to "Waveform Monitor Display".

[0056] Additionally, User 1 selects a function from the screen so that, just like with "Button 1," for "Button 2" and "Button 3," a function that is frequently used when using the camera (102) is executed when the button of the operation reception unit (204) is operated. Accordingly, the function of the camera (102) that is executed when User 1 operates button 204c is set to ND insertion, and the function related to "Button 2" on the function reception screen is changed to "ND insertion." Additionally, the function of the camera (102) that is executed when User 1 operates button 204d is set to ND removal, and the function related to "Button 3" on the function reception screen is changed to "ND removal."

[0057] As described above, the function reception screen illustrated in FIG. 7a is a function reception screen intended for User 1. When User 2 or User 3 sets a function corresponding to a button of the operation reception unit (204), the function reception screen intended for the user being operated is used. By doing so, even if User 2 or User 3 sets a function corresponding to a button of the operation reception unit (204), the setting of User 1 illustrated in FIG. 7c is maintained.

[0058] FIG. 8 is a flowchart illustrating user-specific processing. User-specific processing is a process in which the glass device (104) determines whether the user of the glass device (104) is using the camera (102). In this embodiment, user-specific processing is initiated whenever the glass device (104) takes an image.

[0059] The glass device (104) acquires an image by capturing with the imaging unit (122) (S501).

[0060] The detection unit (124) of the glass device (104) detects the camera (102) from the image acquired in step 501 (S502). The detection unit (124) detects the camera (102) using detection information. The detection unit (124) transmits information indicating the detection result to the display control unit (121) and the judgment unit (123). An example of the information indicating the detection result includes information indicating the area in which the camera (102) is displayed in the image.

[0061] The judgment unit (123) determines whether a user equipped with a glass device (104) is using a camera (102) and generates result information indicating the judgment result and the likelihood of the judgment result (S503).

[0062] When a user is using the camera (102), it is assumed that the camera (102) is located near the user and in the direction of the user's gaze. Accordingly, the determination unit (123) determines that the user is using the camera (102) if, for example, the ratio of the display area of ​​the camera (102) shown in the image to the display area of ​​the image acquired in step 501 is greater than or equal to a predetermined value. The predetermined value may be any value, but for example, 10%. In addition, in this embodiment, the ratio of the display area of ​​the camera (102) shown in the image to the display area of ​​the image is used as the likelihood of the determination result.

[0063] An example of the above result information is described. It is assumed that the captured image (304) shown in FIG. 4 is obtained in the user-specific processing of the glass device 104A. Additionally, it is assumed that the ratio of the display area of ​​the camera area (301) to the display area of ​​the captured image (304) is 15%. In this case, the judgment unit (123) determines that User 1 is using the camera (102). The judgment unit (123) generates result information indicating that User 1 is using the camera (102) and that the likelihood of the judgment result is 15% as a result of the determination.

[0064] The glass device (104) transmits the result information generated in step 503 to the camera (102) (S504).

[0065] In this embodiment, user-specific processing is performed for each glass device (104), and result information for each glass device (104) is transmitted to the camera (102). Accordingly, the camera (102) determines which glass device (104) user is using the camera (102).

[0066] FIG. 9 is a drawing illustrating a user management table. The user management table is a table for managing information about users. The user management table is stored in the memory (202) of the camera (102).

[0067] In the user management table, "User 1 (AR Glasses 1)," "User 2 (AR Glasses 2)," and "User 3 (Smart Glasses 1)" are shown as "Users." That is, in the camera (102), the user is associated with the glasses device (104) worn by this user. Additionally, in the user management table, for each "User," "Usage Status," "Judgment Likelihood," "Button 1," "Button 2," and "Button 3" are shown.

[0068] Explain the contents of the user management table in detail.

[0069] In the "Usage Status," a determination result specified from result information regarding whether the user is using the camera (102) is displayed. "In Use" shown in the "Usage Status" means that the determination unit (123) has determined that the user is using the camera (102). Additionally, "Not in Use" shown in the "Usage Status" means that the determination unit (123) has determined that the user is not using the camera (102).

[0070] In the "judgment likelihood," a value specified from result information is shown as the likelihood of the judgment result of the judgment unit (123).

[0071] "8%" is indicated in the "judgment likelihood" of "User 2". This means that the ratio of the display area of ​​the camera (102) shown in the captured image to the display area of ​​the captured image obtained from the user-specific processing of the glass device 104B is 8%. Accordingly, it is determined by the judgment unit (123) of the glass device 104B that User 2 is not using the camera (102).

[0072] Additionally, "0%" is indicated in the "judgment likelihood" of "User 3". This means that the camera (102) is not shown in the captured image obtained from the user-specific processing of the glass device 104C. Accordingly, it is determined by the judgment unit (123) of the glass device 104C that User 3 is not using the camera (102).

[0073] "Button 1" illustrates a function that is executed when Button 204b is operated. In the illustrated example, "Waveform Monitor Display" is illustrated on "Button 1" of "User 1", "Zebra" is illustrated on "Button 1" of "User 2", and "Magnification Display" is illustrated on "Button 1" of "User 3".

[0074] "Button 2" illustrates a function that is executed when button 204c is operated. In the illustrated example, "ND insertion" is illustrated on "Button 2" of "User 1", "white balance mode change" is illustrated on "Button 2" of "User 2", and "peaking" is illustrated on "Button 2" of "User 3".

[0075] "Button 3" illustrates a function that is executed when button 204d is operated. In the illustrated example, "ND removal" is illustrated on "Button 3" of "User 1", "White balance set" is illustrated on "Button 3" of "User 2", and "recording start" is illustrated on "Button 3" of "User 3".

[0076] When a function that is executed when a button is operated is newly set by operation on the function reception screen of User 1 to User 3 (see FIG. 7a and FIG. 7c), the management unit (205) updates the contents of the user management table according to the new setting.

[0077] Additionally, whenever new result information is acquired by the camera (102), the management unit (205) updates the contents of the user management table to reflect the content of the acquired result information.

[0078] FIG. 10 is a flowchart illustrating the flow of execution processing. Execution processing is a process in which the camera (102) executes a function corresponding to the user who operated the operation receiving unit (204) when the operation receiving unit (204) is operated. In this embodiment, for example, execution processing is started whenever a predetermined period has elapsed. The predetermined period may be any period, but for example, 0.1 seconds.

[0079] The system control unit (206) of the camera (102) determines whether the camera (102) is being used by a user (S601). The system control unit (206) performs the determination of step 601 based on whether there is a user whose "Usage Status" in the user management table is marked as "In Use". If a user is not using the camera (102) (No in S601), the execution process is terminated.

[0080] If the camera (102) is in use by a user (Yes in S601), the system control unit (206) specifies a function that is executed when the operation reception unit (204) is operated (S602). More specifically, the system control unit (206) specifies a function related to the user specified as being in use of the camera (102) as a function that is executed when the operation reception unit (204) is operated. The function related to the user is a function displayed on "Button 1," "Button 2," and "Button 3" related to the target "User" in the user management table.

[0081] Additionally, if "in use" is displayed in the "usage status" of multiple "users" in the user management table, the system control unit (206) identifies the "user" associated with the highest "judgment likelihood" as the user currently using the camera (102). In this way, the system control unit (206) can also be considered as a specific unit that identifies the user currently using the camera (102).

[0082] In the illustrated example, since "in use" is illustrated only in the "usage status" of "User 1," it is assumed below that the system control unit (206) specifies the function executed when the operation receiving unit (204) is operated as a function related to User 1.

[0083] The system control unit (206) transmits information indicating the function of each button specified in step 602 to each glass device (104) (S603). Although details will be described later, accordingly, information indicating the function of each button specified in step 602 is displayed on the display (110) of each glass device (104).

[0084] The system control unit (206) determines whether the button of the operation reception unit (204) has been operated (S604). If the button has not been operated, the execution process is terminated.

[0085] Additionally, if it is determined that a button has been operated (Yes in S604), the system control unit (206) executes the function specified in step 602 according to the operated button (S605). More specifically, the system control unit (206) executes "waveform monitor display" when it is determined that button 204b has been operated. Additionally, the system control unit (206) executes "ND insertion" when it is determined that button 204c has been operated. Additionally, the system control unit (206) executes "ND removal" when it is determined that button 204d has been operated.

[0086] FIG. 11 is a drawing illustrating information displayed on the display (110) of the glass device 104A by performing execution processing.

[0087] When User 1, equipped with the glass device 104A, is looking at the camera (102) and the subject (103), if imaging is performed by the imaging unit (122) of the glass device 104A, an image is generated. In addition, in this case, if execution processing is performed, information transmitted from the camera (102) in step 603 of the execution processing is acquired by the glass device 104A. In this case, the display control unit (121) of the glass device 104A displays the generated image (904) on the display (110), as shown in FIG. 11.

[0088] In the captured image (904), a camera area (901), which is a display area of ​​the camera (102), a subject area (902), which is a display area of ​​the subject (103), and a lighting area (903), which is a display area of ​​the lighting being remotely operated by User 1, are shown. This captured image (904) corresponds to the scene displayed in User 1's field of vision.

[0089] In addition, the operation area (905), which is the display area of ​​the operation reception unit (204) within the camera area (901), shows the function of each button specified in step 602 of the execution process.

[0090] A first function information section (907) is shown on the upper side of the button 1 area (906), which is the display area of ​​button 204b within the operation area (905). The first function information section (907) is information indicating a function specified in the execution process as a function executed when button 204b is operated. In the illustrated example, the text "Waveform monitor display" is shown in the first function information section (907).

[0091] A second function information section (909) is shown on the upper side of the button 2 area (908), which is the display area of ​​button 204c within the operation area (905). The second function information section (909) is information indicating a function specified in the execution process as a function executed when button 204c is operated. In the illustrated example, the text "ND insertion" is shown in the second function information section (909).

[0092] A third function information section (911) is shown on the upper side of the button 3 area (910), which is the display area of ​​button 204d within the operation area (905). The third function information section (911) is information indicating a function specified in the execution process as a function executed when button 204d is operated. In the illustrated example, the text "ND removal" is shown in the third function information section (911).

[0093] In this way, the first function information section (907), the second function information section (909), and the third function information section (911) are superimposed on the captured image (904).

[0094] The system control unit (206) of the glass device 104A determines the display positions of the first function information unit (907), the second function information unit (909), and the third function information unit (911) so that a function executed when the button is operated is displayed near the display area of ​​the button of the operation reception unit (204).

[0095] Likewise, the system control unit (206) of the glass device (104), which is different from the glass device 104A, also superimposes the first function information unit (907), the second function information unit (909), and the third function information unit (911) on the image captured by the imaging unit (122) in the display (110).

[0096] In the display (110) of the glass device (104), a captured image may not be displayed, and a first function information section (907), a second function information section (909), and a third function information section (911) may be displayed. More specifically, the system control unit (206) may display the first function information section (907), the second function information section (909), and the third function information section (911) near an area overlapping with the button of the camera (102) that is displayed in the user's field of view on the display (110). In this case as well, since the first function information section (907), the second function information section (909), and the third function information section (911) are displayed near the button of the camera (102) that is displayed in the user's field of view, the function of each button becomes easier for the user to recognize.

[0097] In the case of a user who does not use the camera (102), the camera (102) may not be in their line of sight. Here, in the glass device (104) equipped by a user who is not looking at the camera (102), the system control unit (206) may display the first function information unit (907), the second function information unit (909), and the third function information unit (911) in a predetermined area of ​​the display (110). The predetermined area may be any area, but, for example, it may be any of the four corners of the display (110).

[0098] Next, user-specific processing (see FIG. 8) and execution processing (see FIG. 10) performed as time progresses, when User 1 moves away from the camera (102) and User 2 approaches the camera (102) to operate the camera (102) will be described.

[0099] In the user-specific processing of the glass device 104B, an image is acquired (S501), and a camera (102) is detected from the image (S502). Hereinafter, it is assumed that in step 501, the image (1004) shown in FIG. 12 is acquired.

[0100] In the captured image (1004), a camera area (1001), which is a display area of ​​the camera (102), a subject area (1002), which is a display area of ​​the subject (103), and a lighting area (1003), which is a display area of ​​the lighting being remotely operated by User 1, are shown. This captured image (1004) corresponds to the scene displayed in the field of view of User 2.

[0101] Hereinafter, it is assumed that the ratio of the display area of ​​the camera (1001) to the display area of ​​the captured image (1004) is 15%. In this case, the judgment unit (123) of the glass device 104B determines that User 2 is using the camera (102). The judgment unit (123) generates result information indicating that User 2 is using the camera (102) and that the probability of the judgment result is 15% as a result of the determination (S503). Additionally, the glass device (104) transmits the generated result information to the camera (102) (S504).

[0102] Additionally, user-specific processing is performed on glass device 104A and glass device 104C, and result information is transmitted to the camera (102). The management unit (205) of the camera (102) updates the user management table with the content shown in FIG. 13 based on the result information obtained for each glass device (104).

[0103] In the user management table after the update, regarding "Usage Status," "Not in Use" is indicated for "User 1" and "User 3", and "In Use" is indicated for "User 2".

[0104] Next, execution processing is performed. Based on the user management table shown in FIG. 13, it is determined that User 2 is using the camera (102) (Yes in S601), and a function to be executed when the operation reception unit (204) is operated is specified as a function related to User 2 (S602). In addition, information indicating the function of each button specified in step 602 is transmitted to each glass device (104) (S603). Accordingly, the information shown in FIG. 14 is displayed on the display (110) of the glass device 104B.

[0105] As illustrated in FIG. 14, a captured image (1204) is displayed on the display (110) of the glass device 104B. The captured image (1204) is an image obtained by the capturing of the capturing unit (122) of the glass device 104B when User 2, equipped with the glass device 104B, is looking at the camera (102) and the subject (103). Additionally, the captured image (1204) shows a camera area (1201), which is the display area of ​​the camera (102), a subject area (1202), which is the display area of ​​the subject (103), and a lighting area (1203), which is the display area of ​​the lighting being remotely operated by User 1. This captured image (1204) corresponds to the scene seen in the field of view of User 2.

[0106] In addition, the operation area (1205), which is the display area of ​​the operation reception unit (204) within the camera area (1201), displays the function of each button specified in step 602 of the execution process.

[0107] A first function information section (907) is shown on the upper side of the button 1 area (1206), which is the display area of ​​button 204b within the operation area (1205). In the illustrated example, the text "Zebra display" is displayed in the first function information section (907).

[0108] A second function information section (909) is shown on the upper side of the button 2 area (1208), which is the display area of ​​button 204c within the operation area (1205). In the illustrated example, the second function information section (909) displays the text "WB mode change".

[0109] A third function information section (911) is shown on the upper side of the button 3 area (1210), which is the display area of ​​button 204d within the operation area (1205). In the illustrated example, the text "WB set" is displayed in the third function information section (911).

[0110] In this way, the display (110) shows the functions of “Button 1”, “Button 2”, and “Button 3” associated with “User 2” in the user management table (see FIG. 13).

[0111] After that, if any button of the operation reception unit (204) of the camera (102) is operated by User 2 (Yes in S604 of FIG. 10), the function corresponding to the operated button is executed (S605).

[0112] In this way, the camera (102) executes a function corresponding to the user using the camera (102) when the button of the operation reception unit (204) is operated. Therefore, when multiple users take turns using the camera (102), a function suitable for the user using the camera (102) is executed when the button of the operation reception unit (204) is operated. Accordingly, the operability of each user sharing the camera (102) is improved.

[0113] In this embodiment, an example has been described in which the system control unit (206) of the camera (102) transmits information indicating the function of each button specified in step 602 of the execution process to any glass device (104) registered in the camera (102), but the present disclosure is not limited thereto.

[0114] The system control unit (206) may transmit information indicating a function that is executed when a user wearing the glass device (104) operates the operation reception unit (204) to the glass device (104) that is the target of information transmission. For example, even if the function that is executed when the operation reception unit (204) is operated is specified as a function related to User 1, the system control unit (206) may transmit information indicating a function related to User 2 to the glass device 104B. Additionally, the camera (102) may receive a setting regarding whether to transmit information indicating a function related to the user using the camera (102) or information indicating a function related to the user wearing the target glass device (104). This reception may be performed by user operation on the touch panel (204a) of the camera (102) or by communication from the glass device (104). Accordingly, the touch panel (204a) may also be considered as a reception unit. Additionally, when reception is performed via communication from the glass device (104), the reception unit (not shown) of the glass device (104), upon receiving the user's settings, transmits information indicating the received content to the camera (102), thereby executing the settings on the camera (102). Furthermore, whether to transmit information indicating a function related to the user using the camera (102) or to transmit information indicating a function related to the user wearing the glass device (104) to be transmitted may be set for each user or may be set collectively for all users.

[0115] In the present embodiment, an example has been described in which multiple buttons are assigned functions corresponding to the user, but the present disclosure is not limited thereto.

[0116] There may be at least one control part, such as a button, to which a function corresponding to the user is assigned.

[0117] In addition, in this embodiment, an example was described in which the information processing device equipped with an operating unit to which a function corresponding to the user is assigned is a camera (102), but the present disclosure is not limited to this.

[0118] The device equipped with a control unit to which a function corresponding to the user is assigned may be a device other than the camera (102). For example, the function corresponding to the user may be assigned to a control unit of a mobile body such as a drone or an autonomous mobile vehicle. Additionally, the camera (102) described above may be installed on this mobile body. The device equipped with a control unit to which a function corresponding to the user is assigned may be any device as long as it is an information processing device.

[0119] As described above, in this embodiment, the acquisition unit of the camera (102) acquires relationship information regarding the relationship between a user and a function that is executed when the operation unit is operated by the user for each of a plurality of users. Examples of the acquisition unit include a communication unit (203), a management unit (205), and a system control unit (206). In addition, examples of the relationship information include information indicating the relationship between "User" and "Button 1," "Button 2," and "Button 3" in a user management table. When the operation unit is operated by the user, the system control unit (206) executes a function related to the user specified by the system control unit (206) in the relationship information.

[0120] In this case, among the multiple users using the camera (102) having multiple functions, the function corresponding to the user who operated the control part of the camera (102) is executed.

[0121] Additionally, in the present embodiment, the operating unit comprises a first operating unit and a second operating unit different from the first operating unit. An example of the first operating unit includes buttons 204b, 204c, and 204d. An example of the second operating unit includes a button among buttons 204b, 204c, and 204d that is different from the first operating unit. The relationship information includes information regarding the relationship between a user and a function executed when the first operating unit is operated by the user, and information regarding the relationship between the user and a function executed when the second operating unit is operated by the user.

[0122] In this case, the execution of a function corresponding to the control unit operated by the user using the camera (102) among the multiple control units is realized.

[0123] In addition, in this embodiment, a receiving unit is further provided for each of a plurality of users to receive a setting of a function that is executed when the operating unit is operated by a user (see FIG. 7a and FIG. 7c). Examples of the receiving unit include a touch panel (204a) and a system control unit (206).

[0124] In this case, among the multiple users using the camera (102) having multiple functions, a function suitable for the user who operates the control unit of the camera (102) is executed.

[0125] In this embodiment, the acquisition unit acquires its own device information indicating that its own device appears in an image obtained by capturing a user terminal used by a user. Examples of its own device information include result information. The system control unit (206) identifies the user using its own device from its own device information.

[0126] In this case, among the multiple users using the camera (102) having multiple functions, the function corresponding to the user who possesses the user terminal that captured the camera (102) is executed.

[0127] In this embodiment, the detection information is described as information indicating the appearance of the camera (102), but the present disclosure is not limited thereto.

[0128] The detection information may be location information indicating the position of the camera (102). In this case, a detection unit (not shown) of the camera (102) detects the position of the camera (102) and generates location information indicating the detected position. Additionally, the system control unit (206) of the camera (102) transmits location information indicating the latest position of the camera (102) to each glass device (104) registered with the camera (102) at predetermined intervals (e.g., every second). Additionally, a detection unit (124) of the glass device (104) detects the position of the glass device (104). Based on the relationship between the position of the camera (102) and the position of the glass device (104) determined from the location information transmitted from the camera (102), the detection unit (124) detects the distance from the glass device (104) to the camera (102) and transmits distance information indicating the detected distance to the camera (102). The system control unit (206) of the camera (102), upon acquiring the distance information for each glass device (104), may identify the user equipped with the glass device (104) with the shortest distance to the camera (102) as the user currently using the camera (102).

[0129] Additionally, the detection unit (not shown) of the camera (102) may specify the radio wave strength in communication with each glass device (104). The system control unit (206) of the camera (102) may specify the user equipped with the glass device (104) having the strongest radio wave strength as the user using the camera (102).

[0130] That is, the system control unit (206) identifies the user using its device based on the communication relationship or location relationship between its device and the user terminal used by each of the multiple users. In this case, among the multiple users using the camera (102) having multiple functions, the function corresponding to the user who possesses the user terminal with which the communication relationship or location relationship with the camera (102) is specific is executed.

[0131] Additionally, by the camera (102) acquiring an image in which a user is displayed for each user using the camera (102), the user using the camera (102) can be registered with the camera (102). The system control unit (206) of the camera (102) captures images at predetermined intervals, and if a user registered as a user of the camera (102) appears in the captured image, the system control unit (206) may determine that this user is using the camera (102). Additionally, if multiple users registered as users of the camera (102) appear in the image captured by the camera (102), the user with the largest display area among these multiple users may determine that the camera (102) is using the camera.

[0132] That is, the system control unit (206) identifies the user using its device from the image obtained by capturing when the user is included in the field of view of the imaging device. In this case, among the multiple users using the camera (102) having multiple functions, the execution of the function corresponding to the user shown in the image captured by the camera (102) is realized.

[0133] Additionally, the display control unit (121) displays on the display (110) an image obtained by capturing when the operating unit is included in the field of view of the imaging device of the user terminal, and information regarding functions related to the user using the user terminal in relation information (see FIG. 11).

[0134] In this case, among the multiple functions of the camera (102), the function that is executed when the user operates the control unit is recognized by the user using the control unit.

[0135] In this embodiment, the user terminal includes a first user terminal used by a first user and a second user terminal used by a second user. Examples of the first user may include User 1, User 2, and User 3. Additionally, examples of the second user may include a user different from the first user among User 1, User 2, and User 3. If the user using the camera (102) is the second user, it may be specified in the system control unit (206). In this case, the display control unit (121) of the first user terminal displays information regarding a function related to the first user in relational information on the display (110) of the first user terminal.

[0136] In this case, even when the first user is not using the camera (102), the function that is executed when the first user operates the control unit among the multiple functions of the camera (102) is recognized by the first user.

[0137] If the user using the camera (102) is a second user, there is a case where it is specified in the system control unit (206). In this case, the display control unit (121) of the first user terminal displays information about the function related to the second user in the related information on the display (110) of the first user terminal.

[0138] In this case, even when the first user is not using the camera (102), the function that is executed when the second user operates the control unit among the multiple functions of the camera (102) is recognized by the first user.

[0139] If the user using the camera (102) is a second user, there is a case where it is specified in the system control unit (206). In this case, the receiving unit receives a setting indicating whether to display information regarding functions related to the first user in relation information and information regarding functions related to the second user in relation information on the display (110) of the first user terminal.

[0140] In this case, when the first user is not using the camera (102), the function recognized by the first user can be switched between the function executed when the first user operates the control unit and the function executed when the second user operates the control unit.

[0141] <Other embodiments>

[0142] Although the present disclosure has been described in detail based on preferred embodiments, the present disclosure is not limited to these specific embodiments and various modifications that do not depart from the essence of the present disclosure may be included. Some of the above-described embodiments may be appropriately combined.

[0143] In addition, the present disclosure includes cases where a program of software realizing the function of the above-described embodiment is supplied from a recording medium directly or via wired / wireless communication to a system or device having a computer capable of executing the program, and the program is executed.

[0144] Accordingly, in order to realize the functional processing of the present disclosure on a computer, the program code itself supplied to and installed on the computer also realizes the present disclosure. That is, the computer program itself for realizing the functional processing of the present disclosure is also included in the present disclosure.

[0145] In this case, if it has the function of a program, the form of the program is not limited and may be object code, a program executed by an interpreter, or script data supplied to the OS.

[0146] Examples of recording media for supplying a program may include magnetic recording media such as hard disks and magnetic tapes, optical or optical magnetic memory media, and non-volatile semiconductor memory.

[0147] In addition, as a method of supplying the program, a computer program forming the present disclosure can be stored on a server on a computer network, and a connected client computer can download the computer program to perform programming.

[0148] According to the present disclosure, among a plurality of users using an information processing device having a plurality of functions, the execution of a function corresponding to a user who operates the control unit of the information processing device can be realized.

[0149] (Other examples)

[0150] The present invention can also be realized in a process in which a program realizing one or more functions of the above-described embodiment is supplied to a system or device via a network or storage medium, and one or more processors in a computer of the system or device read and execute the program. In addition, it can also be realized by a circuit (e.g., an ASIC) realizing one or more functions.

[0151] Although the present disclosure has been described with reference to embodiments, it will be understood that the present disclosure is not limited to the embodiments disclosed above. The scope of the claims below should be broadly interpreted to include all variations and equivalent structures and functions.

[0152] The present application claims the benefits of Japanese Patent Application No. 2025-012544 filed on January 29, 20250, which is incorporated herein by reference in its entirety.

Claims

Claim 1 An information processing device comprising: an operation means for receiving operation by a user; an acquisition means for acquiring relationship information regarding the relationship between a user and a function executed when the operation means is operated by the user, for each of a plurality of users; a specifying means for specifying the user using its own device; and an execution means for executing the function related to the specified user in the relationship information when the operation means is operated by the user, wherein the operation means comprises a first operation means and a second operation means different from the first operation means, and the relationship information comprises information regarding the relationship between the user and a function executed when the first operation means is operated by the user, and information regarding the relationship between the user and a function executed when the second operation means is operated by the user. Claim 2 An information processing device according to claim 1, further comprising a receiving means for receiving the setting of the function executed when the operating means is operated by the user for each of the plurality of users. Claim 3 In claim 1, the specific means is an information processing device that identifies a user using the device based on a communication relationship or location relationship between the device and a user terminal used by each of the plurality of users. Claim 4 In claim 1, the acquisition means acquires its own device information indicating that its own device is shown in an image captured by capturing a user terminal used by the user, and identifies the user using its own device based on the own device information. Claim 5 An information processing device according to claim 1, further comprising a first imaging means for imaging a subject, wherein the specifying means specifies the user using the device based on an image obtained by imaging when the user is included in the field of view of the first imaging means. Claim 6 An information processing device according to any one of claims 1 to 5; and A second imaging means for imaging a subject, Display means for displaying information, and An information processing system comprising a user terminal used by a user, the display control means for displaying on the display means an image obtained by imaging when the above-described operation means is included in the field of view of the second imaging means of the user terminal, and information regarding the function related to the user using the user terminal in the above-described relational information. Claim 7 In claim 6, the user terminal comprises a first user terminal used by a first user and a second user terminal used by a second user, and the display control means of the first user terminal displays information regarding the function related to the first user in the relational information on the display means of the first user terminal when the user using the information processing device is identified as the second user. Claim 8 In claim 6, the user terminal comprises a first user terminal used by a first user and a second user terminal used by a second user, and the display control means of the first user terminal displays information regarding the function related to the second user in the relationship information on the display means of the first user terminal when the user using the information processing device is identified as the second user. Claim 9 In claim 6, the user terminal comprises a first user terminal used by a first user and a second user terminal used by a second user, and the information processing system further comprises a receiving means for receiving a setting to display on the display means of the first user terminal which of the information regarding the function related to the first user and the information regarding the function related to the second user in the relationship information is to be displayed when the user using the information processing device is identified as the second user. Claim 10 A control method for an information processing device having an operation means for receiving operation by a user, comprising: an acquisition step of acquiring relationship information regarding the relationship between a user and a function executed when the operation means is operated by the user for each of a plurality of users; a specification step of specifying the user who uses the device; and an execution step of executing the function related to the specified user in the relationship information when the operation means is operated by the user, wherein the operation means comprises a first operation means and a second operation means different from the first operation means, and the relationship information comprises information regarding the relationship between the user and a function executed when the first operation means is operated by the user, and information regarding the relationship between the user and a function executed when the second operation means is operated by the user. Claim 11 A non-temporary storage medium storing a program of an information processing device for executing each step of a control method for an information processing device equipped with an operation means for receiving operation by a user on a computer, wherein the control method comprises: an acquisition step of acquiring relationship information regarding the relationship between a user and a function executed when the operation means is operated by the user for each of a plurality of users; a specification step of specifying the user using its own device; and an execution step of executing the function related to the specified user in the relationship information when the operation means is operated by the user, wherein the operation means comprises a first operation means and a second operation means different from the first operation means, and the relationship information comprises information regarding the relationship between the user and a function executed when the first operation means is operated by the user, and information regarding the relationship between the user and a function executed when the second operation means is operated by the user.

Images