Information processing apparatus, information processing method and computer-readable medium
By automatically adjusting the light source parameters through the processor to optimize user rendering, the problem of manually adjusting the light source in online meetings is solved, thus improving the efficiency of rendering optimization.
Patent Information
- Application Number
- CN202110976061.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-01-22
- Filing Date
- 2021-08-24
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2041-08-24
AI Technical Summary
In online meetings, users need to manually adjust the light source to improve the projection, which makes the operation complicated and inefficient.
The processor automatically adjusts parameters such as light intensity, position, orientation, and type of the light source based on the user's input to optimize light source control.
This reduces the need for users to manually adjust the light source, improving the efficiency of image optimization in online meetings.
Smart Images

Figure CN114780047B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to information processing apparatus, information processing methods, and computer-readable media. Background Technology
[0002] Japanese Patent Application Publication No. 2011-244080 discloses technology for controlling a device that acquires an image of a subject and outputs image data, acquires voice and outputs voice data, transmits and receives image data and voice data via a network, displays received image data, outputs received voice data, and illuminates the subject using a light source.
[0003] Japanese Patent Application Publication No. 2012-529831 describes a device that analyzes image data, detects the presence of multiple subjects within a scene, and displays an indicator indicating that the subject is not within the range of the light source for each detected subject that is not within the range of the light source.
[0004] Japanese Patent Application Publication No. 2019-205205 discloses an image processing apparatus that acquires a color image obtained by photographing a subject, identifies the area of the subject's face in the color image as a face region, and generates an altered image in which the brightness of at least a portion of the face region in the color image is altered. Summary of the Invention
[0005] The purpose of this disclosure is to reduce the user's workload for making corrections, compared to the situation where the user only manually corrects the user's input in an online meeting.
[0006] According to a first aspect of this disclosure, an information processing apparatus is provided, which has a processor that changes the control of a light source illuminating a user based on the presence of a user in an online meeting.
[0007] According to the second aspect of this disclosure, the processor controls the amount of light from the light source based on the user's input.
[0008] According to the third aspect of this disclosure, the processor changes the positional relationship between the light source and the user based on the user's presence.
[0009] According to the fourth aspect of this disclosure, the processor changes the orientation of the light source toward the user based on the user's presence.
[0010] According to the fifth aspect of this disclosure, the processor selects one or more light sources to illuminate the user based on the user's input.
[0011] According to the sixth aspect of this disclosure, the processor changes the color of the light source based on the user's input.
[0012] According to the seventh aspect of this disclosure, the processor changes the type of the light source based on the user's input.
[0013] According to the eighth aspect of this disclosure, the processor changes the positional relationship between the light source and the camera that is capturing the user based on the user's presence.
[0014] According to the ninth aspect of this disclosure, the processor also changes the control of the light source based on changes in the user's position.
[0015] According to the 10th aspect of this disclosure, the processor further controls the cutting off of light other than the light source based on light other than the light source.
[0016] According to the 11th aspect of this disclosure, the image of the user displayed in the online meeting is an image captured by a camera held by the user.
[0017] According to the 12th aspect of this disclosure, the processor also performs image processing on the image of the user displayed in the online meeting based on the user's presence.
[0018] According to the 13th aspect of this disclosure, the processor also notifies the user of a prompt for correction of the user's mapping based on the user's mapping.
[0019] According to the 14th aspect of this disclosure, the processor further adjusts the control of the light source based on the user's usage of the online meeting.
[0020] According to the 15th aspect of this disclosure, the processor changes the output of the light source based on the user's usage of the online meeting.
[0021] According to the 16th aspect of this disclosure, the processor changes the output of the light source when the image of the user's facial region is enlarged and when the image of the user's facial region is not enlarged on the screen of the online meeting.
[0022] According to the 17th aspect of this disclosure, the processor changes the output of the light source when the user speaks in the online meeting and when the user does not speak.
[0023] According to embodiment 18 of this disclosure, the processor also changes the control of the light source illuminating the user based on the presence of another user participating in the online meeting.
[0024] According to embodiment 19 of this disclosure, the processor also alters the control of the light source illuminating the user based on the expectation of changing the mapping of the user participating in the online meeting.
[0025] According to the 20th aspect of this disclosure, the processor also causes a light source pre-set in the location used for the online meeting to cooperate with a light source held by the user.
[0026] According to embodiment 21 of this disclosure, the processor also turns off the light source used only to illuminate the user when the online meeting ends.
[0027] According to the 22nd aspect of this disclosure, before the user participates in the online meeting, the user confirms entry, and with the user's permission, the processor enables the user to participate in the online meeting.
[0028] According to the 23rd aspect of this disclosure, a computer-readable medium is provided that stores a program that causes a computer to perform processing in which the control of a light source illuminating a user is changed based on the presence of a user in an online meeting.
[0029] According to the 24th aspect of this disclosure, an information processing method is provided that changes the control of a light source illuminating a user based on the presence of a user in an online meeting.
[0030] (Effect)
[0031] According to the solutions described in points 1, 23, and 24, the user's workload for making such corrections can be reduced compared to the situation where the user only manually corrects the user's entry in the online meeting.
[0032] According to the second scheme, the amount of light from the light source can be changed to correct the user's projection.
[0033] According to the third scheme, the positional relationship between the light source and the user can be changed to correct the user's projection.
[0034] According to the fourth scheme, the orientation of the light source can be changed to correct the user's image.
[0035] According to the fifth scheme, the user's image can be corrected by selecting the light source.
[0036] According to the sixth scheme, the user's input can be corrected based on the color of the light source.
[0037] According to the seventh scheme, the user's image can be corrected based on the type of light source.
[0038] According to the eighth scheme, the user's image can be corrected based on the positional relationship between the light source and the camera.
[0039] According to the ninth scheme, the user's image can be corrected according to changes in the user's location.
[0040] According to the 10th scheme, the influence of light from sources other than the light source illuminating the user can be suppressed.
[0041] According to the 11th solution, images captured by a camera held by a user can be used in online meetings.
[0042] According to the 12th scheme, the user's image can be corrected through image processing.
[0043] According to the 13th scheme, it is possible to notify the user that the user's mapping needs to be corrected.
[0044] According to the 14th and 15th schemes, online meetings can be utilized by controlling the light source based on the utilization status of the online meeting.
[0045] According to the 16th scheme, the user can be illuminated with an output corresponding to the size of the image of the user's facial region.
[0046] According to the 17th scheme, the user can be illuminated with an output corresponding to the presence or absence of the user's speech.
[0047] According to the 18th scheme, it is possible to illuminate a user in conjunction with the projection of another user.
[0048] According to the 19th scheme, the light source can be controlled according to the user's expectations.
[0049] According to the 20th solution, the user can be illuminated by a light source located at the location and a light source held by the user.
[0050] According to the 21st scheme, power consumption can be reduced compared to not turning off the light source.
[0051] According to the 22nd scheme, it is possible to prevent users from participating in online meetings during the phase in which user entry is not permitted by the user. Attached Figure Description
[0052] Figure 1 This is a block diagram illustrating the structure of the information processing system according to this embodiment.
[0053] Figure 2 This is a block diagram illustrating the structure of the server involved in this embodiment.
[0054] Figure 3 This is a block diagram illustrating the structure of the terminal device involved in this embodiment.
[0055] Figure 4 This is a picture showing the screen.
[0056] Figure 5 This diagram shows terminal devices and the like installed at the location.
[0057] Figure 6 This diagram shows terminal devices and the like installed at the location.
[0058] Figure 7 This is a diagram showing the light source.
[0059] Figure 8 This is a diagram showing the appearance of the compartment.
[0060] Figure 9 This is a diagram showing the appearance of the compartment. Detailed Implementation
[0061] Reference Figure 1 The information processing system involved in this embodiment will be described. Figure 1 An example of the structure of the information processing system involved in this embodiment is shown.
[0062] As an example, the information processing system involved in this embodiment includes a server 10 and N (N is an integer of 1 or more) terminal devices. Figure 1 In the example shown, the information processing system involved in this embodiment includes terminal devices 12A, 12B, 12C, ..., 12N. Figure 1 The number of terminal devices shown is only one example; it is sufficient for one or more terminal devices to be included in the information processing system according to this embodiment. Hereinafter, without distinguishing between terminal devices 12A, 12B, 12C, ..., 12N, they will be referred to as "terminal device 12". The information processing system according to this embodiment may also include other devices besides server 10 and terminal device 12.
[0063] Server 10 and each terminal device 12 have the function of communicating with other devices. This communication can be wired communication using cables or wireless communication. That is, each device can physically connect to other devices via cables to send and receive information, or it can send and receive information wirelessly. Wireless communication includes, for example, short-range wireless communication (NRCM) and Wi-Fi. Examples of NRCM include Bluetooth, RFID (Radio Frequency Identifier), and NFC. For example, each device can also communicate with other devices via communication paths N such as LAN (Local Area Network) or the Internet.
[0064] Server 10 provides online services via communication path N. Users can utilize the online services using terminal device 12. For example, by utilizing the online services, users can transmit information such as sound, images, moving images, strings, and vibrations to other parties.
[0065] Online services include, for example, online meetings, online content delivery services, online games, online shopping, social networking services (SNS), or combinations thereof. Online meetings are sometimes referred to as web conferencing, remote conferencing, or video conferencing. Content includes, for example, entertainment programs (such as concerts, plays, movies, animated images, music, etc.), sports, esports, etc. For example, animated image delivery services or music delivery services are examples of online content delivery services. Users can enjoy entertainment programs online, or watch sports or esports.
[0066] Online services can be those that use virtual space or those that do not. Virtual space is a concept contrasted with real space. Examples include virtual spaces created by computers, virtual spaces formed on networks such as the internet, virtual spaces realized through VR (Virtual Reality) technology, and cyberspace. For instance, virtual three-dimensional or two-dimensional space is an example of virtual space.
[0067] Furthermore, server 10 stores and manages the account information of users utilizing the online service. Account information, such as a user ID and password, is used to log in to and utilize the online service. For example, by sending account information to server 10 and logging in to the online service, users associated with that account information are allowed to participate in and utilize the online service. Of course, users can also utilize the online service without registering their account information. Furthermore, users can utilize the online service without logging in. Additionally, server 10 can adjust the services provided based on whether or not a user is logged in.
[0068] Terminal device 12 is, for example, a personal computer (hereinafter referred to as "PC"), a tablet PC, a smartphone, a wearable device (such as AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, an audio device, etc.) or a mobile phone.
[0069] Alternatively, it could be an automated response system, such as a chatbot, participating in an online service. For example, the automated response system functions as a response assistant, answering user inquiries, receiving user messages, analyzing their content, generating responses, and notifying the user. Automated response systems can be implemented, for example, by executing a program. This program might be stored, for example, on server 10 or other devices (e.g., other servers or terminal devices 12). Automated response systems can also be implemented using artificial intelligence (AI). The algorithm used for AI can be any algorithm.
[0070] As an example, a user uses an online meeting where sound, images, GIFs, strings, vibrations, etc., are transmitted to the other party in the communication.
[0071] The following is for reference Figure 2 The hardware structure of server 10 is described below. Figure 2 An example of the hardware structure of server 10 is shown in the figure.
[0072] Server 10 includes, for example, a communication device 14, a UI 16, a memory 18, and a processor 20.
[0073] The communication device 14 has a communication interface including a communication chip and communication circuits, and has the function of sending information to other devices and receiving information from other devices. The communication device 14 can have wireless communication capabilities or wired communication capabilities. For example, the communication device 14 can communicate with other devices using short-range wireless communication or via communication path N.
[0074] UI16 is a user interface that includes at least one of a display and an input device. The display is an LCD or EL display, etc. The input device is a keyboard, mouse, input keys, or operation panel, etc. UI16 can also be a touch panel or other UI that combines a display and an input device.
[0075] The memory 18 is a device that constitutes one or more storage areas for storing various types of information. The memory 18 is, for example, a hard disk drive, various types of memory (such as RAM, DRAM, or ROM), other storage devices (such as optical discs), or combinations thereof. One or more memories 18 are included in the server 10.
[0076] Processor 20 is configured to control the operation of various parts of server 10. Processor 20 may also have memory. For example, processor 20 provides online services to users.
[0077] The following is for reference Figure 3 The hardware structure of terminal device 12 will be described. Figure 3An example of the hardware structure of the terminal device 12 is shown in the figure.
[0078] Terminal device 12 includes, for example, a communication device 22, a UI 24, a memory 26, and a processor 28.
[0079] The communication device 22 has a communication interface with a communication chip, communication circuits, etc., and has the function of sending information to other devices and receiving information sent from other devices. The communication device 22 can have wireless communication function or wired communication function. For example, the communication device 22 can communicate with other devices by using short-range wireless communication or by communicating with other devices via communication path N.
[0080] UI24 is a user interface that includes at least one of a display and an input device. The display is an LCD or EL display, etc. The input device is a keyboard, mouse, input keys, or operation panel, etc. UI24 can also be a touch panel or other UI that combines a display and an input device.
[0081] Furthermore, the terminal device 12 may include a camera or other video recording device, a microphone, and a speaker, and all or part of these devices may be connected to the terminal device 12. Additionally, headphones or headsets may be connected to the terminal device 12.
[0082] The memory 26 is a device that constitutes one or more storage areas for storing various types of information. The memory 26 is, for example, a hard disk drive, various types of memory (e.g., RAM, DRAM, or ROM), other storage devices (e.g., optical discs), or combinations thereof. One or more memories 26 are included in the terminal device 12.
[0083] The processor 28 is configured to control the operation of various parts of the terminal device 12. The processor 28 may also have memory.
[0084] For example, the processor 28 can display images, videos, strings, etc. sent via online meetings on the display of the terminal device 12, or generate sound sent via online meetings from the speakers, or send images, videos, etc. generated by a camera to the other party via online meetings, or send sound collected by a microphone to the other party via online meetings.
[0085] The terminal device 12 may include at least one of various sensors, such as a sensor for acquiring the location information of the terminal device 12 (e.g., a GPS (Global Positioning System) sensor), a gyroscope sensor for detecting orientation and attitude, and an accelerometer sensor.
[0086] Hereinafter, various embodiments of this implementation will be described. The processes involved in each embodiment can be executed by the processor 20 of the server 10 or the processor 28 of the terminal device 12, or the processes involved in each embodiment can be executed by the processor 20 and the processor 28 cooperating. Alternatively, the processor 20 can execute a part of a process, while the processor 28 executes other parts of that process. Furthermore, the server 10, the terminal device 12, or a combination thereof corresponds to an example of the information processing apparatus according to this embodiment.
[0087] The following is an example of an online service where users use online meetings to send information such as audio, images, GIFs, strings, and signals to the other party in the communication.
[0088] In this embodiment, a light source is used to illuminate users participating in an online meeting, and the control of this light source is changed according to the presence of users in the online meeting.
[0089] User presence can be determined based on factors such as brightness, shadow, contrast, color, whitening (i.e., excessive light exceeding a threshold), backlighting, the presence of glasses (e.g., light reflected in the lenses of glasses), or at least two of these factors. Of course, user presence can also be determined based on factors other than these.
[0090] User projection can be, for example, a full-body projection of the user or a projection of the user's upper body area. The upper body area could include, for example, the area above the user's shoulders, the area above the user's neck, or the area of the user's face. The facial area could include, for example, the face of a user not wearing a mask or similar object, or the face of a user wearing a mask or similar object.
[0091] For example, a user takes a picture using a camera, and image processing is applied to the resulting image or video to analyze it, thereby determining the user's presence. The user's presence can be determined by the processor 20 of server 10 or by the processor 28 of terminal device 12 (e.g., the terminal device 12 used by the user).
[0092] The light source can be a light source pre-installed in the venue used for online meetings, or it can be a light source held by the user participating in the online meeting. The light source held by the user can be, for example, a light source installed on the terminal device 12, or a light source held by the user but not installed on the terminal device 12.
[0093] There are no particular limitations on the type, shape, size, light intensity, and color of a light source. For example, a light source can be a fluorescent lamp, a light-emitting diode (LED), an incandescent lamp, a discharge lamp, a HID lamp, an electroluminescent lamp, a laser, an electric lamp, or a combination of at least two of these. Furthermore, the color, brightness, and shadow of light can be altered by directly placing various filters, such as color filters, on the light source or placing them away from the light source.
[0094] The control of the light source can be performed by the processor 20 of the server 10 or by the processor 28 of the terminal device 12. For example, the settings of the light source can be changed according to the user's input. The settings of the light source may include, for example, the type, number, light intensity, color, orientation, angle, position, wavelength, or at least two of these elements.
[0095] The following is an example of users A, B, C, and D participating in the same online meeting. User A logs in to the online meeting using terminal device 12A and participates. User B logs in to the online meeting using terminal device 12B and participates. User C logs in to the online meeting using terminal device 12C and participates. User D logs in to the online meeting using terminal device 12D and participates.
[0096] Multiple users can also log in to the online meeting using the same terminal device 12 to participate in the online meeting. Alternatively, they can participate in the online meeting without logging in.
[0097] Authorized users or administrators can also allow or disallow users to participate in online meetings. In this case, the user who is allowed to participate will be able to attend the online meeting. If a user invites another user to the online meeting and that user expresses their willingness to participate, that other user will also be able to attend the online meeting.
[0098] The terminal devices 12A, 12B, 12C, and 12D each display a screen for online conferencing. Each user participating in the online meeting is assigned a display area formed on the screen. This display area shows an image or moving image generated by a camera associated with that area, or an image or moving image (e.g., an icon, avatar, etc.) schematically representing the user assigned to that area. Alternatively, images or moving images may be displayed, or instead of images or moving images, strings used to identify the user (e.g., name, user ID, account, or nickname) may be displayed.
[0099] The display areas assigned to user A, user B, user C, and user D are displayed on the screen used in the online meeting.
[0100] Alternatively, if a monitor is provided in the venue where the online meeting is being conducted, the monitor can be connected to the terminal device 12 so that the screen used for the online meeting is displayed on the monitor.
[0101] There are no particular restrictions on the location for online meetings. They can be enclosed spaces (such as rooms, cubicles, meeting rooms, or other indoor spaces) or open spaces (such as squares, parks, sports fields, or other outdoor spaces).
[0102] exist Figure 4 The image shown is screen 32 displayed on display 30A. Display 30A is the display of user A's terminal device 12A. The same screen as screen 32 is also displayed on the displays of terminal devices 12B, 12C, and 12D.
[0103] For example, a display area corresponding to the number of users participating in the online meeting is formed on screen 32. Figure 4 In the example shown, display areas 32A, 32B, 32C, and 32D are formed on screen 32. Display area 32A is assigned to user A, display area 32B is assigned to user B, display area 32C is assigned to user C, and display area 32D is assigned to user D.
[0104] The size of each display area can be changed by the user or based on whether a user speaks. For example, the display area for users who speak can be increased, while the display area for users who do not speak can be decreased.
[0105] Furthermore, information used to identify each user participating in the online meeting (e.g., account information, name, ID, etc.) can also be displayed on screen 32. Figure 4 The example shown displays the account information for users A, B, C, and D.
[0106] exist Figure 4In the example shown, camera 34, microphone 36, and speaker 38 are mounted on display 30A. Camera 34 can also be referred to as a built-in camera, front-facing camera, etc. The location where camera 34, microphone 36, and speaker 38 are mounted is not limited to display 30A; it can also be located outside display 30A in terminal device 12A. All or part of camera 34, microphone 36, and speaker 38 can be mounted on terminal device 12A (e.g., all or part can be built into terminal device 12A), or all or part can be not mounted on terminal device 12A (e.g., all or part can be not built into terminal device 12A), but can be mounted around terminal device 12A and connected to terminal device 12A. Multiple cameras 34, multiple microphones 36, and multiple speakers 38 can be connected to terminal device 12A. Furthermore, microphones can be installed on user A, or headphones or headsets can be installed on user A. If terminal device 12A is a wearable device such as AR glasses or VR glasses, the microphone and speaker can also be mounted on the wearable device.
[0107] For ease of explanation, the camera 34 installed in terminal device 12A (i.e., the built-in camera) and the camera connected to terminal device 12A but not installed in terminal device 12A (i.e., the external camera) will be referred to as the cameras of terminal device 12A. That is, the concept of cameras of terminal device 12A includes not only the camera 34 installed in terminal device 12A, but also the cameras connected to terminal device 12A but not installed in terminal device 12A. The same applies to terminal devices 12B, 12C, and 12D; the concept of cameras for each of terminal devices 12B, 12C, and 12D includes both built-in and external cameras.
[0108] Similarly, the microphone 36 (i.e., the built-in microphone) located in terminal device 12A and the microphone connected to terminal device 12A but not located in terminal device 12A (i.e., the external microphone) are referred to as the microphones of terminal device 12A. That is, the concept of microphones of terminal device 12A includes not only the microphone 36 located in terminal device 12A, but also the microphones connected to terminal device 12A but not located in terminal device 12A. The same applies to terminal devices 12B, 12C, and 12D; the concept of microphones for each of terminal devices 12B, 12C, and 12D includes both built-in and external microphones.
[0109] Similarly, the speaker 38 installed in terminal device 12A (i.e., the built-in speaker) and the speaker connected to terminal device 12A but not installed in terminal device 12A (i.e., the externally connected speaker) are referred to as the speakers of terminal device 12A. That is, the concept of speakers of terminal device 12A includes not only the speaker 38 installed in terminal device 12A, but also the speaker connected to terminal device 12A but not installed in terminal device 12A. The same applies to terminal devices 12B, 12C, and 12D; the concept of speakers for each of terminal devices 12B, 12C, and 12D includes both built-in speakers and external speakers.
[0110] For example, the camera of terminal device 12A is associated with user A, and the image or video generated by the camera of terminal device 12A is displayed in the display area 32A of the screen 32 for online conferencing, which is allocated to user A. The data of the image or video generated by the camera of terminal device 12A is sent to each terminal device 12 via terminal device 12A and server 10, and displayed on the display area 32A of the screen 32 for online conferencing on the monitor of each terminal device 12. For example, the user is photographed by a camera held by user A (e.g., a camera built into the user's terminal device 12A (e.g., a smartphone camera)), and the image or video generated by the photograph is displayed in display area 32A. Of course, the user can also be photographed by an external camera, and the image or video generated by the photograph is displayed in display area 32A. In addition, instead of the image or video generated by the camera, an image or video schematically representing user A can be displayed, or a string used to identify user A can be displayed.
[0111] The same applies to users B, C, and D. Images or moving images generated by the camera of terminal device 12B are displayed in display area 32B assigned to user B. Images or moving images generated by the camera of terminal device 12C are displayed in display area 32C assigned to user C. Images or moving images generated by the camera of terminal device 12D are displayed in display area 32D assigned to user D. Instead of images or moving images generated by the camera, images or moving images schematically representing the user may be displayed, or strings used to identify the user may be displayed.
[0112] Additionally, it can display images or animated GIFs of all users participating in the online meeting, or it can display images or animated GIFs of a subset of users. The display or non-display of images or animated GIFs can be specified by the user.
[0113] If sound is collected through the microphone of terminal device 12A, the collected sound data is sent from terminal device 12A to terminal devices 12B, 12C, and 12D via server 10, and the sound is emitted from the speakers of each of terminal devices 12B, 12C, and 12D. Similarly, if sound is collected through the microphones of terminal devices 12B, 12C, and 12D, the collected sound is emitted from the speakers of the other terminal devices 12. The user's speech can also be displayed as a string.
[0114] Users can exchange information such as audio, images, GIFs, and strings with other users through online meetings.
[0115] The following explanation focuses on user A to illustrate the processing involved in the implementation method, but the same processing is performed for users B, C, and D.
[0116] exist Figure 5 The image shows a terminal device 12A, etc., installed in location 40. Location 40 is a location used by user A. The user participates in an online meeting in location 40. Location 40 is a partitioned space, such as a cubicle or room.
[0117] A table 42 and a chair are provided in location 40, for example. (The chair is not shown.) A terminal device 12A (e.g., a laptop PC), light sources 44R and 44L, and a monitor 46 are provided on the table 42. From the user A's perspective, light source 44R is positioned to the right of terminal device 12A, and light source 44L is positioned to the left of terminal device 12A. Furthermore, light source 44C is mounted on the wall between light sources 44R and 44L. Terminal device 12A can be a device brought into location 40 by user A, or it can be a device pre-installed in location 40. That is, user A can bring their own terminal device 12A into location 40 for use, or they can use a terminal device 12A pre-installed in location 40.
[0118] Figure 5 The number, location, orientation, and type of light sources shown are just one example. For instance, such as... Figure 6 As shown, a light source 48 can be placed on one side (e.g., the right side) of the terminal device 12A. Alternatively, the light source can be installed on the ceiling, walls, floor, etc., of the location 40. Furthermore, the types, shapes, and sizes of the light sources 44R, 44L, and 44C can be the same or different.
[0119] Figure 5 as well as Figure 6 The light source shown is, for example, a rod-shaped light source or a rectangular light source, but this is just one example. (e.g.) Figure 7As shown, multiple light sources 50a can also be configured into a ring shape. Alternatively, a spherical light source can also be used. Thus, the shape, size, etc., of the light source are not limited.
[0120] Each light source can be pre-set in location 40, or it can be brought into location 40 by user A. Each light source can also be a light source held by user A.
[0121] The light sources within location 40 are controlled based on the presence of user A in an online meeting. For example, light sources 44R, 44L, and 44C are controlled based on the presence of user A. All or part of light sources 44R, 44L, and 44C can be connected to terminal device 12A and controlled by its processor 28, or connected to server 10 and controlled by its processor 20. For example, light sources connected to terminal device 12A can be controlled by its processor 28, while light sources not connected to terminal device 12A but located in location 40 can be controlled by server 10's processor 20.
[0122] Hereinafter, as an example, the processor 28 of the terminal device 12A controls light sources 44R, 44L, and 44C. Alternatively, user A can specify the light sources to be controlled based on user A's input. For example, if user A specifies light sources 44R and 44L as the controlled objects, then light sources 44R and 44L are controlled based on user A's input. Furthermore, the settings of each light source can also be changed by the user. For example, the user can fine-tune the settings of each light source.
[0123] The processor 28 of the terminal device 12A changes the control of the light sources 44R, 44L, and 44C illuminating user A based on the presence of user A in the online meeting. That is, the processor 28 of the terminal device 12 changes the settings of the light sources 44R, 44L, and 44C (e.g., the type, number, intensity, color, orientation, angle, position, wavelength, or at least two of these elements) based on the presence of the user in the online meeting. The embodiments will be described in detail below.
[0124] (Example 1)
[0125] In Embodiment 1, the processor 28 of the terminal device 12A controls the light intensity of at least one of the light sources 44R, 44L, and 44C based on the input of user A.
[0126] For example, the camera of terminal device 12A captures a picture of user A's face. The processor 28 of terminal device 12A analyzes the image or video generated by the capture to detect the brightness of user A's face. Known image processing techniques can be used for this analysis. If the detected brightness is within a predefined acceptable range, the processor 28 of terminal device 12A does not change the light intensity of light sources 44R, 44L, and 44C. If the detected brightness is not within the acceptable range, the processor 28 of terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that ensures the brightness of user A's face is within the acceptable range. For example, the processor 28 of terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that brightens the entire face of user A. The processor 28 of terminal device 12A can set the light intensity of light sources 44R, 44L, and 44C to the same intensity or to different intensity levels. For example, an ideal brightness can be predetermined, and the allowable range can be determined based on this ideal brightness. The allowable range of brightness can also be changed by the user.
[0127] The processor 28 of the terminal device 12A can detect the brightness of a portion (e.g., a designated area) of the user A's face and change the amount of light from the light source based on the detected brightness. It can also detect the brightness of the entire facial area of the user A and change the amount of light from the light source based on the detected brightness.
[0128] The processor 28 of the terminal device 12A can also detect the brightness distribution of part or all of the user A's facial area and change the amount of light from the light source based on the detected brightness distribution. For example, the processor 28 of the terminal device 12A can change the amount of light from the light source in a way that makes the brightness distribution of part or all of the user A's facial area more uniform.
[0129] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area to detect whether a shadow has been generated on part or all of the user A's facial area. If no shadow is detected, the processor 28 of the terminal device 12A does not change the light intensity of light sources 44R, 44L, and 44C. If a shadow is detected, the processor 28 of the terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that prevents the detection of a shadow. The processor 28 of the terminal device 12A can also change the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that prevents the detection of a shadow and ensures that the brightness of the user A's facial area is within an acceptable range.
[0130] The processor 28 of the terminal device 12A can also detect the distribution of shadows on part or all of the user A's facial area and change the amount of light from the light source based on the detected shadow distribution. For example, the processor 28 of the terminal device 12A can change the amount of light from the light source in such a way that the distribution of shadows on part or all of the user A's facial area becomes uniform.
[0131] The processor 28 of the terminal device 12A can also detect the contrast of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected contrast is within a predefined allowable contrast range, the processor 28 of the terminal device 12A does not change the light intensity of light sources 44R, 44L, and 44C. If the detected contrast is not within the allowable contrast range, the processor 28 of the terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C in such a way that the contrast of the user A's facial region is within the allowable range. For example, an ideal contrast is predetermined, and the allowable range is determined based on this ideal contrast. The allowable contrast range can also be changed by the user.
[0132] The processor 28 of the terminal device 12A can detect the contrast of a portion of the user A's facial area and change the amount of light from the light source based on the detected contrast, or it can detect the contrast of the entire facial area of the user A and change the amount of light from the light source based on the detected contrast.
[0133] The processor 28 of the terminal device 12A can also detect the color of user A's facial region by analyzing an image or dynamic image of user A's facial region. If the detected color is within a predefined permissible color range, the processor 28 of the terminal device 12A does not change the light intensity of light sources 44R, 44L, and 44C. If the color of user A's facial region is not within the permissible range, the processor 28 of the terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C in such a way that the color of user A's facial region is within the permissible range. For example, an ideal color is predefined, and the permissible range is determined based on this ideal color. The permissible color range can also be changed by the user.
[0134] The processor 28 of the terminal device 12A can detect the color of a portion of the user A's facial area and change the amount of light from the light source based on the detected color, or it can detect the color of the entire facial area of the user A and change the amount of light from the light source based on the detected color.
[0135] The processor 28 of the terminal device 12A can also detect the color distribution of part or all of the user A's facial area and change the amount of light from the light source based on the detected color distribution. For example, the processor 28 of the terminal device 12A can change the amount of light from the light source in a way that makes the color distribution of part or all of the user A's facial area more uniform.
[0136] The processor 28 of the terminal device 12A can also detect whitening in all or part of the user A's facial area by analyzing an image or dynamic image of the user A's facial area. Whitening occurs when the brightness exceeds a threshold, and the processor 28 of the terminal device 12A detects whether the brightness of all or part of the user A's facial area exceeds the threshold. If no whitening is detected, the processor 28 of the terminal device 12A does not change the light intensity of light sources 44R, 44L, and 44C. If whitening is detected, the processor 28 of the terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that prevents the detection of whitening. The processor 28 of the terminal device 12A can also change the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that prevents the detection of whitening and ensures that the brightness of the user A's facial area is within an acceptable range.
[0137] The processor 28 of the terminal device 12A can also detect the presence of backlight by analyzing an image or dynamic image of the user A's facial area. If no backlight is detected, the processor 28 of the terminal device 12A does not change the light intensity of light sources 44R, 44L, and 44C. If backlight is detected, the processor 28 of the terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C. For example, the processor 28 of the terminal device 12A increases the light intensity of at least one of the light sources 44R, 44L, and 44C (i.e., brightens the light source).
[0138] When user A is wearing glasses, the processor 28 of terminal device 12A can also detect the reflection of the glasses (e.g., the presence or absence of light reflection in the lenses) by analyzing an image or dynamic image of user A's facial area. For example, if no light reflection in the lenses is detected, the processor 28 of terminal device 12A does not change the light intensity of light sources 44R, 44L, and 44C. If light reflection in the lenses is detected, the processor 28 of terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that does not detect light reflection in the lenses. If the amount of light reflected in the lenses (e.g., the brightness of the reflected light) exceeds a threshold, the processor 28 of terminal device 12A can also change the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that makes the amount of light reflected in the lenses below the threshold.
[0139] The processor 28 of the terminal device 12A can also change the light intensity of at least one of the light sources 44R, 44L, and 44C based on at least two of the following factors: brightness of the user A's facial area, presence or absence of shadows, contrast, color, presence or absence of whitening, presence or absence of backlighting, and presence or absence of reflection from the glasses. For example, the processor 28 of the terminal device 12A can also change the light intensity of the light sources 44R, 44L, and 44C such that the brightness of the user A's facial area is within the allowable range of brightness and the color of the user A's facial area is within the allowable range of color.
[0140] The processor 28 of the terminal device 12A can also change the control of the light sources 44R, 44L, and 44C according to the change in the position of user A. In embodiment 1, the processor 28 of the terminal device 12A can also change the light intensity of at least one of the light sources 44R, 44L, and 44C according to the position of user A.
[0141] The processor 28 of the terminal device 12A can detect the location of user A by using GPS to detect the location of the device (e.g., smartphone, wearable device, etc.) held by user A, or by using the camera of the terminal device 12A to photograph user A.
[0142] For example, if the position of user A changes, the processor 28 of terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that keeps the brightness or color of user A's facial area unchanged. Furthermore, if the position of user A changes, the processor 28 of terminal device 12A changes the light intensity of at least one of the light sources 44R, 44L, and 44C in a manner that does not produce shadows, whitening, or reflections in glasses.
[0143] The processor 28 of the terminal device 12A can also send a reminder to user A to correct the loading of user A based on the loading of user A. For example, the processor 28 of the terminal device 12A can display a reminder message on the display of the terminal device 12A, generate a reminder voice from the speaker of the terminal device 12A, or transmit the reminder to user A through vibration.
[0144] For example, upon receiving a request from user A, the processor 28 of terminal device 12A sends a notification to user A urging user A to change the light intensity of at least one of the light sources 44R, 44L, and 44C. When user A receives this notification, user A can also manually change the light intensity of at least one of the light sources 44R, 44L, and 44C. The processor 28 of terminal device 12A accepts user A's change in light intensity and changes the light intensity of the light source accordingly. Alternatively, when urging the user to change the light intensity, the processor 28 of terminal device 12A may not automatically change the light intensity of the light source.
[0145] Alternatively, the processing described in Embodiment 1 can also be performed by the processor 20 of the server 10.
[0146] (Example 2)
[0147] In embodiment 2, the processor 28 of the terminal device 12A changes the positional relationship between at least one of the light sources 44R, 44L, and 44C and the user A based on the presence of the user A.
[0148] The processor 28 of the terminal device 12A changes the positional relationship between the light source and user A by changing the position of at least one of the light source and user A.
[0149] If at least one of the light sources 44R, 44L, and 44C is a light source capable of automatically changing its location, the processor 28 of the terminal device 12A can also change the positional relationship between the light source and user A by changing the location of the light source. If user A is sitting in a chair that is capable of automatically changing its location, the processor 28 of the terminal device 12A can also change the positional relationship between the light source and user A by changing the location of the chair.
[0150] The light source or chair can be movable along a track, or it can be equipped with wheels that allow it to move by rotating the wheels. For example, by using and controlling components such as motors, the light source or chair can be moved to change its location.
[0151] For example, the processor 28 of the terminal device 12A analyzes an image or dynamic image of the user A's facial area to detect the brightness of the user A's facial area. If the detected brightness is within a predefined allowable brightness range, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the user A. If the detected brightness is not within the allowable brightness range, the processor 28 of the terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the user A in such a way that the brightness of the user A's facial area is within the allowable range, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the user A. For example, the processor 28 of the terminal device 12A changes the positional relationship between the light sources 44R, 44L, 44C and the user A in such a way that the entire facial area of the user A becomes brighter.
[0152] The processor 28 of the terminal device 12A can detect the brightness of a portion (e.g., a designated area) of the user A's face and change the positional relationship between the light sources 44R, 44L, 44C and the user A according to the detected brightness. It can also detect the brightness of the entire facial area of the user A and change the positional relationship between the light sources 44R, 44L, 44C and the user A according to the detected brightness.
[0153] The processor 28 of the terminal device 12A can also detect the brightness distribution of part or all of the user A's facial area and change the positional relationship between the light sources 44R, 44L, 44C and the user A according to the detected brightness distribution. For example, the processor 28 of the terminal device 12A can change the positional relationship between the light sources 44R, 44L, 44C and the user A in a way that makes the brightness distribution of part or all of the user A's facial area more uniform.
[0154] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area to detect whether a shadow has been generated in part or all of the user A's facial area. If no shadow is detected, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the user A. If a shadow is detected, the processor 28 of the terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the user A in a manner that prevents the detection of a shadow, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the user A. The processor 28 of the terminal device 12A can also change the positional relationship between the light sources 44R, 44L, 44C and the user A in a manner that prevents the detection of a shadow and ensures that the brightness of the user A's facial area is within an acceptable range.
[0155] The processor 28 of the terminal device 12A can also detect the distribution of shadows on part or all of the user A's facial area and change the positional relationship between the light sources 44R, 44L, 44C and the user A based on the detected shadow distribution. For example, the processor 28 of the terminal device 12A can also change the positional relationship between the light sources 44R, 44L, 44C and the user A in a way that the distribution of shadows on part or all of the user A's facial area becomes uniform.
[0156] The processor 28 of the terminal device 12A can detect the contrast of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected contrast is within a predefined allowable range, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the user A. If the detected contrast is not within the allowable range, the processor 28 of the terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the user A in such a way that the contrast of the user A's facial region is within the allowable range, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the user A.
[0157] The processor 28 of the terminal device 12A can detect the contrast of a portion of the user A's facial area and change the positional relationship between the light sources 44R, 44L, 44C and the user A based on the detected contrast. It can also detect the contrast of the entire facial area of the user A and change the positional relationship between the light sources 44R, 44L, 44C and the user A based on the detected contrast.
[0158] The processor 28 of the terminal device 12A can also detect the color of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected color is within a predefined permissible range, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the user A. If the color of the user A's facial region is not within the permissible range, the processor 28 of the terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the user A in such a way that the color of the user A's facial region is within the permissible range, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the user A.
[0159] The processor 28 of the terminal device 12A can detect the color of a portion of the user A's facial area and change the positional relationship between the light sources 44R, 44L, 44C and the user A according to the detected color. It can also detect the color of the entire facial area of the user A and change the positional relationship between the light sources 44R, 44L, 44C and the user A according to the detected color.
[0160] The processor 28 of the terminal device 12A can also detect the color distribution of part or all of the user A's facial area and change the positional relationship between the light sources 44R, 44L, 44C and the user A according to the detected color distribution. For example, the processor 28 of the terminal device 12A can change the positional relationship between the light sources 44R, 44L, 44C and the user A in a way that makes the color distribution of part or all of the user A's facial area more uniform.
[0161] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area and detect whitening in all or part of the user A's facial area. If no whitening is detected, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the user A. If whitening is detected, the processor 28 of the terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the user A in a manner that prevents the detection of whitening, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the user A. The processor 28 of the terminal device 12A can also change the positional relationship between the light sources 44R, 44L, 44C and the user A in a manner that prevents the detection of whitening and ensures that the brightness of the user A's facial area is within an acceptable range.
[0162] The processor 28 of the terminal device 12A can also detect the presence of backlight by analyzing an image or dynamic image of the user A's facial area. If no backlight is detected, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the user A. If backlight is detected, the processor 28 of the terminal device 12A changes the positional relationship between the light sources 44R, 44L, 44C and the user A by changing the position of at least one of the light sources 44R, 44L, 44C and the user A.
[0163] When user A is wearing glasses, the processor 28 of terminal device 12A can also detect the presence of glasses (e.g., the presence or absence of light reflection in the lenses) by analyzing images or dynamic images of user A's facial area. For example, if no light reflection in the lenses is detected, the processor 28 of terminal device 12A does not change the positional relationship between light sources 44R, 44L, 44C and user A. If light reflection in the lenses is detected, the processor 28 of terminal device 12A changes the position of at least one of light sources 44R, 44L, 44C and user A in a manner that does not detect light reflection in the lenses, thereby changing the positional relationship between light sources 44R, 44L, 44C and user A. If the amount of light reflected in the lenses (e.g., the brightness of the reflected light) exceeds a threshold, the processor 28 of terminal device 12A can also change the positional relationship between light sources 44R, 44L, 44C and user A in a manner that makes the amount of light reflected in the lenses below the threshold.
[0164] The processor 28 of the terminal device 12A can also change the positional relationship between the light sources 44R, 44L, and 44C and the user A based on at least two of the following factors: brightness of the user A's facial area, presence or absence of shadows, contrast, color, presence or absence of whitening, presence or absence of backlighting, and presence or absence of reflection from the glasses. For example, the processor 28 of the terminal device 12A can change the positional relationship between the light sources 44R, 44L, and 44C and the user A in such a way that the brightness of the user A's facial area is within the allowable range of brightness and the color of the user A's facial area is within the allowable range of color.
[0165] The processor 28 of the terminal device 12A can also change the control of the light sources 44R, 44L, and 44C according to the change in the position of user A. In embodiment 2, the processor 28 of the terminal device 12A can also change the position of at least one of the light sources 44R, 44L, and 44C according to the position of user A.
[0166] For example, if the position of user A changes, the processor 28 of terminal device 12A changes the position of at least one of the light sources 44R, 44L, and 44C in a manner that does not change the brightness or color of the user A's facial area. Furthermore, if the position of user A changes, the processor 28 of terminal device 12A changes the position of at least one of the light sources 44R, 44L, and 44C in a manner that does not produce shadows, whitening, or reflections in the eyes. For example, the processor 28 of terminal device 12A follows the change in the position of user A and changes the position of the light source in a manner that allows user A to be illuminated by the light source.
[0167] The processor 28 of the terminal device 12A can also send a reminder to user A to correct the loading of user A based on the loading of user A. For example, the processor 28 of the terminal device 12A can display a reminder message on the display of the terminal device 12A, generate a reminder voice from the speaker of the terminal device 12A, or transmit the reminder to user A through vibration.
[0168] For example, upon receiving a notification from user A, the processor 28 of terminal device 12A sends a notification urging user A to change the position of at least one of the light sources 44R, 44L, 44C, and user A. When user A receives this notification, user A may also manually change the position of at least one of the light sources 44R, 44L, 44C, and user A. Alternatively, in the case of urging the user to change positions, the processor 28 of terminal device 12A may not automatically change the positions of the light sources and the user.
[0169] Alternatively, the processing described in Embodiment 2 can also be performed by the processor 20 of the server 10.
[0170] (Example 3)
[0171] In embodiment 3, the processor 28 of the terminal device 12A changes the orientation of at least one of the light sources 44R, 44L, and 44C toward user A based on the presence of user A.
[0172] If at least one of the light sources 44R, 44L, and 44C is a light source capable of automatically changing its orientation, the processor 28 of the terminal device 12A can also change the orientation of the light source toward user A by changing the orientation of that light source. If user A is sitting in a chair that is capable of automatically changing its orientation, the processor 28 of the terminal device 12A can also change the orientation of the light source toward user A by changing the orientation of the chair.
[0173] For example, the processor 28 of the terminal device 12A analyzes an image or dynamic image of the user A's facial area to detect the brightness of the user A's facial area. If the detected brightness is within a predefined allowable brightness range, the processor 28 of the terminal device 12A does not change the orientation of the light sources 44R, 44L, and 44C towards the user A. If the detected brightness is not within the allowable brightness range, the processor 28 of the terminal device 12A changes the orientation of at least one of the light sources 44R, 44L, and 44C and the user A in such a way that the brightness of the user A's facial area is within the allowable range, thereby changing the orientation of the light sources 44R, 44L, and 44C towards the user A. For example, the processor 28 of the terminal device 12A changes the orientation of the light sources 44R, 44L, and 44C towards the user A in such a way that the entire facial area of the user A becomes brighter.
[0174] The processor 28 of the terminal device 12A can detect the brightness of a portion (e.g., a designated area) of the user A's face and change the orientation of the light sources 44R, 44L, and 44C toward the user A based on the detected brightness. It can also detect the brightness of the entire facial area of the user A and change the orientation of the light sources 44R, 44L, and 44C toward the user A based on the detected brightness.
[0175] The processor 28 of the terminal device 12A can also detect the brightness distribution of part or all of the facial area of user A, and change the orientation of the light sources 44R, 44L, and 44C toward user A according to the detected brightness distribution. For example, the processor 28 of the terminal device 12A can also change the orientation of the light sources 44R, 44L, and 44C toward user A in a way that makes the brightness distribution of part or all of the facial area of user A more uniform.
[0176] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area to detect whether a shadow has been generated on part or all of the user A's facial area. If no shadow is detected, the processor 28 of the terminal device 12A does not change the orientation of the light sources 44R, 44L, and 44C towards the user A. If a shadow is detected, the processor 28 of the terminal device 12A changes the orientation of at least one of the light sources 44R, 44L, and 44C and the user A in a manner that prevents the detection of a shadow, thereby changing the orientation of the light sources 44R, 44L, and 44C towards the user A. The processor 28 of the terminal device 12A can also change the orientation of the light sources 44R, 44L, and 44C towards the user A in a manner that prevents the detection of a shadow and ensures that the brightness of the user A's facial area is within an acceptable range.
[0177] The processor 28 of the terminal device 12A can also detect the distribution of shadows on part or all of the user A's facial area and change the orientation of the light sources 44R, 44L, and 44C toward the user A based on the detected shadow distribution. For example, the processor 28 of the terminal device 12A can change the orientation of the light sources 44R, 44L, and 44C toward the user A in a manner that makes the distribution of shadows on part or all of the user A's facial area more uniform.
[0178] The processor 28 of the terminal device 12A can also detect the contrast of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected contrast is within a predefined allowable range, the processor 28 of the terminal device 12A does not change the orientation of the light sources 44R, 44L, and 44C towards the user A. If the detected contrast is not within the allowable range, the processor 28 of the terminal device 12A changes the orientation of at least one of the light sources 44R, 44L, and 44C and the user A in such a way that the contrast of the user A's facial region is within the allowable range, thereby changing the orientation of the light sources 44R, 44L, and 44C towards the user A.
[0179] The processor 28 of the terminal device 12A can detect the contrast of a portion of the user A's facial area and change the orientation of the light sources 44R, 44L, and 44C toward the user A based on the detected contrast. It can also detect the contrast of the entire facial area of the user A and change the orientation of the light sources 44R, 44L, and 44C toward the user A based on the detected contrast.
[0180] The processor 28 of the terminal device 12A can also detect the color of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected color is within a predefined permissible color range, the processor 28 of the terminal device 12A does not change the orientation of the light sources 44R, 44L, and 44C towards the user A. If the color of the user A's facial region is not within the permissible range, the processor 28 of the terminal device 12A changes the orientation of at least one of the light sources 44R, 44L, and 44C and the user A in such a way that the color of the user A's facial region is within the permissible range, thereby changing the orientation of the light sources 44R, 44L, and 44C towards the user A.
[0181] The processor 28 of the terminal device 12A can detect the color of a portion of the user A's facial area and change the orientation of the light sources 44R, 44L, and 44C toward the user A based on the detected color. It can also detect the color of the entire facial area of the user A and change the orientation of the light sources 44R, 44L, and 44C toward the user A based on the detected color.
[0182] The processor 28 of the terminal device 12A can also detect the color distribution of part or all of the facial area of user A, and change the orientation of the light sources 44R, 44L, and 44C toward user A according to the detected color distribution. For example, the processor 28 of the terminal device 12A can change the orientation of the light sources 44R, 44L, and 44C toward user A in a way that makes the color distribution of part or all of the facial area of user A more uniform.
[0183] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area to detect whitening in all or part of the user A's facial area. If no whitening is detected, the processor 28 of the terminal device 12A does not change the orientation of the light sources 44R, 44L, and 44C towards the user A. If whitening is detected, the processor 28 of the terminal device 12A changes the orientation of at least one of the light sources 44R, 44L, and 44C and the user A in a manner that prevents the detection of whitening, thereby changing the orientation of the light sources 44R, 44L, and 44C towards the user A. The processor 28 of the terminal device 12A can also change the orientation of the light sources 44R, 44L, and 44C towards the user A in a manner that prevents the detection of whitening and ensures that the brightness of the user A's facial area is within an acceptable range.
[0184] The processor 28 of the terminal device 12A can also detect the presence of backlight by analyzing an image or dynamic image of the user A's facial area. If no backlight is detected, the processor 28 of the terminal device 12A does not change the orientation of the light sources 44R, 44L, and 44C towards the user A. If backlight is detected, the processor 28 of the terminal device 12A changes the orientation of the light sources 44R, 44L, and 44C towards the user A by changing the orientation of at least one of the light sources 44R, 44L, and 44C and the user A.
[0185] When user A is wearing glasses, the processor 28 of terminal device 12A can also detect the reflection of glasses (e.g., the presence or absence of light reflection in the lenses) by analyzing an image or dynamic image of user A's facial area. For example, if no light reflection in the lenses is detected, the processor 28 of terminal device 12A does not change the orientation of light sources 44R, 44L, and 44C towards user A. If light reflection in the lenses is detected, the processor 28 of terminal device 12A changes the orientation of at least one of light sources 44R, 44L, and 44C and user A in a manner that no light reflection in the lenses is detected, thereby changing the orientation of light sources 44R, 44L, and 44C towards user A. If the amount of light reflected in the lenses (e.g., the brightness of the reflected light) exceeds a threshold, the processor 28 of terminal device 12A can also change the orientation of light sources 44R, 44L, and 44C towards user A in a manner that the amount of light reflected in the lenses is below the threshold.
[0186] The processor 28 of the terminal device 12A can also change the orientation of the light sources 44R, 44L, and 44C toward the user A based on at least two of the following factors: brightness of the user A's facial area, presence or absence of shadows, contrast, color, presence or absence of whitening, presence or absence of backlighting, and presence or absence of reflection from the glasses. For example, the processor 28 of the terminal device 12A can change the orientation of the light sources 44R, 44L, and 44C toward the user A in such a way that the brightness of the user A's facial area is within an acceptable range of brightness and the color of the user A's facial area is within an acceptable range of color.
[0187] The processor 28 of the terminal device 12A can also change the control of the light sources 44R, 44L, and 44C according to the change in the position of user A. In embodiment 3, the processor 28 of the terminal device 12A can also change the orientation of at least one of the light sources 44R, 44L, and 44C according to the position of user A.
[0188] For example, if the position of user A changes, the processor 28 of terminal device 12A changes the orientation of at least one of the light sources 44R, 44L, and 44C in a manner that keeps the brightness or color of user A's facial area unchanged. Furthermore, if the position of user A changes, the processor 28 of terminal device 12A changes the orientation of at least one of the light sources 44R, 44L, and 44C in a manner that does not produce shadows, whitening, or reflections in the eyes. For example, the processor 28 of terminal device 12A follows the change in user A's position and changes the orientation of the light source in a manner that allows user A to be illuminated by the light source.
[0189] The processor 28 of the terminal device 12A can also send a reminder to user A to correct the loading of user A based on the loading of user A. For example, the processor 28 of the terminal device 12A can display a reminder message on the display of the terminal device 12A, generate a reminder voice from the speaker of the terminal device 12A, or transmit the reminder to user A through vibration.
[0190] For example, upon receiving a notification from user A, the processor 28 of terminal device 12A sends a notification urging user A to change the orientation of at least one of the light sources 44R, 44L, and 44C. When user A receives this notification, user A may also manually change the orientation of at least one of the light sources 44R, 44L, and 44C. Alternatively, in the case of urging the user to change the orientation of the light sources, the processor 28 of terminal device 12A may choose not to automatically change the orientation of the light sources.
[0191] Alternatively, the processing described in Embodiment 3 can also be performed by the processor 20 of the server 10.
[0192] (Example 4)
[0193] In embodiment 4, the processor 28 of the terminal device 12A selects one or more light sources from light sources 44R, 44L, and 44C to illuminate user A based on the input of user A.
[0194] For example, the processor 28 of the terminal device 12A detects the brightness of the user A's facial area by analyzing an image or dynamic image of the user A's facial area. The processor 28 of the terminal device 12A selects one or more light sources from light sources 44R, 44L, and 44C to illuminate the user A, such that the brightness of the user A's facial area is within an acceptable range of brightness. For example, the processor 28 of the terminal device 12A selects a light source in such a way that the entire surface of the user A's facial area becomes brighter.
[0195] The processor 28 of the terminal device 12A can detect the brightness of a portion (e.g., a designated area) of the user A's face and select a light source based on the detected brightness, or it can detect the brightness of the entire facial area of the user A and select a light source based on the detected brightness.
[0196] The processor 28 of the terminal device 12A can also detect the brightness distribution of part or all of the user A's facial area and select a light source based on the detected brightness distribution. For example, the processor 28 of the terminal device 12A selects a light source in such a way that the brightness distribution of part or all of the user A's facial area becomes uniform.
[0197] The processor 28 of the terminal device 12A can also analyze images or dynamic images of the user A's facial area to detect whether shadows have been generated on part or all of the user A's facial area. The processor 28 of the terminal device 12A selects one or more light sources from light sources 44R, 44L, and 44C to illuminate the user A in a manner that no shadows are detected. The processor 28 of the terminal device 12A can also select light sources in a manner that no shadows are detected and the brightness of the user A's facial area is within an acceptable range.
[0198] The processor 28 of the terminal device 12A can also detect the distribution of shadows in part or all of the user A's facial area and select a light source based on the detected shadow distribution. For example, the processor 28 of the terminal device 12A can select a light source in such a way that the distribution of shadows in part or all of the user A's facial area becomes uniform.
[0199] The processor 28 of the terminal device 12A can also detect the contrast of the user A's facial region by analyzing the image or dynamic image of the user A's facial region. The processor 28 of the terminal device 12A selects one or more light sources from the light sources 44R, 44L, and 44C to illuminate the user A in such a way that the contrast of the user A's facial region is included within the allowable range of contrast.
[0200] The processor 28 of the terminal device 12A can detect the contrast of a portion of the user A's facial area and select a light source based on the detected contrast, or it can detect the contrast of the entire facial area of the user A and select a light source based on the detected contrast.
[0201] The processor 28 of the terminal device 12A can also detect the color of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. The processor 28 of the terminal device 12A selects one or more light sources from the light sources 44R, 44L, and 44C to illuminate the user A in such a way that the color of the user A's facial region is included within the permissible range of colors.
[0202] The processor 28 of the terminal device 12A can detect the color of a portion of the user A's facial area and select a light source based on the detected color, or it can detect the color of the entire facial area of the user A and select a light source based on the detected color.
[0203] The processor 28 of the terminal device 12A can also detect the color distribution of part or all of the user A's facial area and select a light source based on the detected color distribution. For example, the processor 28 of the terminal device 12A selects a light source in such a way that the color distribution of part or all of the user A's facial area becomes uniform.
[0204] The processor 28 of the terminal device 12A can also analyze images or dynamic images of the user A's facial area to detect whitening in all or part of the user A's facial area. The processor 28 of the terminal device 12A selects one or more light sources from the light sources 44R, 44L, and 44C to illuminate the user A in a manner that does not detect whitening.
[0205] The processor 28 of the terminal device 12A can also detect the presence of backlight by analyzing images or dynamic images of the user A's facial area. The processor 28 of the terminal device 12A selects one or more light sources from the light sources 44R, 44L, and 44C to illuminate the user A in a manner that does not detect backlight.
[0206] Even when user A is wearing glasses, the processor 28 of the terminal device 12A can detect the reflection of the glasses (e.g., the presence or absence of light reflection in the lenses of the glasses) by analyzing images or dynamic images of user A's facial area. The processor 28 of the terminal device 12A selects one or more light sources from light sources 44R, 44L, and 44C to illuminate user A in a manner that does not detect light reflection in the lenses.
[0207] The processor 28 of the terminal device 12A can also select one or more light sources from light sources 44R, 44L, and 44C to illuminate user A based on at least two of the following factors: brightness of user A's facial area, presence or absence of shadows, contrast, color, presence or absence of whitening, presence or absence of backlighting, and presence or absence of reflection from glasses.
[0208] The processor 28 of the terminal device 12A can also change the control of the light sources 44R, 44L, and 44C according to the change in the position of user A. In embodiment 4, the processor 28 of the terminal device 12A selects one or more light sources to illuminate user A according to the position of user A.
[0209] For example, if user A's position changes, the processor 28 of terminal device 12A selects one or more light sources in a manner that keeps the brightness or color of user A's facial area constant. Furthermore, if user A's position changes, the processor 28 of terminal device 12A selects one or more light sources in a manner that does not produce shadows, whitening, or reflections in the eyes. For example, the processor 28 of terminal device 12A follows changes in user A's position, selects one or more light sources capable of illuminating user A, and illuminates user A with the selected one or more light sources.
[0210] The processor 28 of the terminal device 12A can also send a reminder to user A to correct the loading of user A based on the loading of user A. For example, the processor 28 of the terminal device 12A can display a reminder message on the display of the terminal device 12A, generate a reminder voice from the speaker of the terminal device 12A, or transmit the reminder to user A through vibration.
[0211] For example, upon receiving a notification from user A, the processor 28 of terminal device 12A sends a notification to user A urging user A to select one or more light sources from light sources 44R, 44L, and 44C to illuminate user A. When user A receives this notification, user A can also select one or more light sources from light sources 44R, 44L, and 44C to illuminate user A. The processor 28 of terminal device 12A then turns on the power to the one or more light sources selected by user A. Alternatively, when prompting the user to select a light source, the processor 28 of terminal device 12A may not automatically select a light source.
[0212] Alternatively, the processing described in Embodiment 4 can also be performed by the processor 20 of the server 10.
[0213] (Example 5)
[0214] In embodiment 5, the processor 28 of the terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C based on the input of user A. The color of the light emitted by the light source can be changed, or it can be changed by using a color filter or similar device.
[0215] For example, the processor 28 of the terminal device 12A analyzes an image or dynamic image of the user A's facial area to detect the brightness of the user A's facial area. If the detected brightness is within a predefined allowable brightness range, the processor 28 of the terminal device 12A does not change the color of the light sources 44R, 44L, and 44C. If the detected brightness is not within the allowable brightness range, the processor 28 of the terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C in a manner that ensures the brightness of the user A's facial area is within the allowable range. For example, the processor 28 of the terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C in a manner that brightens the entire facial area of the user A.
[0216] The processor 28 of the terminal device 12A can detect the brightness of a portion (e.g., a designated area) of the user A's face and change the color of the light source according to the detected brightness, or it can detect the brightness of the entire facial area of the user A and change the color of the light source according to the detected brightness.
[0217] The processor 28 of the terminal device 12A can also detect the brightness distribution of part or all of the user A's facial area and change the color of the light source according to the detected brightness distribution. For example, the processor 28 of the terminal device 12A can also change the color of the light source in a way that makes the brightness distribution of part or all of the user A's facial area more uniform.
[0218] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area to detect whether shadows have been generated on part or all of the user A's facial area. If no shadows are detected, the processor 28 of the terminal device 12A does not change the color of the light sources 44R, 44L, and 44C. If shadows are detected, the processor 28 of the terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C in a manner that prevents the detection of shadows. The processor 28 of the terminal device 12A can also change the color of at least one of the light sources 44R, 44L, and 44C in a manner that prevents the detection of shadows and ensures that the brightness of the user A's facial area is within acceptable limits.
[0219] The processor 28 of the terminal device 12A can also detect the distribution of shadows on part or all of the user A's facial area and change the color of the light source according to the detected shadow distribution. For example, the processor 28 of the terminal device 12A changes the color of the light source in such a way that the distribution of shadows on part or all of the user A's facial area becomes uniform.
[0220] The processor 28 of the terminal device 12A can also detect the contrast of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected contrast is within a predefined allowable contrast range, the processor 28 of the terminal device 12A does not change the color of the light sources 44R, 44L, and 44C. If the detected contrast is not within the allowable contrast range, the processor 28 of the terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C in such a way that the contrast of the user A's facial region is within the allowable range.
[0221] The processor 28 of the terminal device 12A can detect the contrast of a portion of the user A's facial area and change the color of the light source according to the detected contrast, or it can detect the contrast of the entire facial area of the user A and change the color of the light source according to the detected contrast.
[0222] The processor 28 of the terminal device 12A can also detect the color of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected color is within a predefined acceptable range, the processor 28 of the terminal device 12A does not change the color of the light sources 44R, 44L, and 44C. If the color of the user A's facial region is not within the acceptable range, the processor 28 of the terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C in such a way that the color of the user A's facial region is within the acceptable range.
[0223] The processor 28 of the terminal device 12A can detect the color of a portion of the user A's facial area and change the color of the light source according to the detected color, or it can detect the color of the entire facial area of the user A and change the color of the light source according to the detected color.
[0224] The processor 28 of the terminal device 12A can also detect the color distribution of part or all of the user A's facial area and change the color of the light source according to the detected color distribution. For example, the processor 28 of the terminal device 12A can also change the color of the light source in a way that makes the color distribution of part or all of the user A's facial area more uniform.
[0225] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area and detect whitening in all or part of the user A's facial area. If no whitening is detected, the processor 28 of the terminal device 12A does not change the color of the light sources 44R, 44L, and 44C. If whitening is detected, the processor 28 of the terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C in a manner that prevents the detection of whitening. The processor 28 of the terminal device 12A can also change the color of at least one of the light sources 44R, 44L, and 44C in a manner that prevents the detection of whitening and ensures that the brightness of the user A's facial area is within an acceptable range.
[0226] The processor 28 of the terminal device 12A can also detect the presence of backlight by analyzing an image or dynamic image of the user A's facial area. If no backlight is detected, the processor 28 of the terminal device 12A does not change the color of the light sources 44R, 44L, and 44C. If backlight is detected, the processor 28 of the terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C.
[0227] Even when user A is wearing glasses, the processor 28 of terminal device 12A can detect the presence of glasses (e.g., the presence or absence of light reflection in the lenses) by analyzing images or dynamic images of user A's facial area. For example, if no light reflection in the lenses is detected, the processor 28 of terminal device 12A does not change the color of light sources 44R, 44L, and 44C. If light reflection in the lenses is detected, the processor 28 of terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C in a manner that prevents the detection of light reflection in the lenses.
[0228] The processor 28 of the terminal device 12A can also change the color of the light sources 44R, 44L, and 44C based on at least two of the following factors: brightness of the user A's facial area, presence or absence of shadows, contrast, color, presence or absence of whitening, presence or absence of backlighting, and presence or absence of reflection from the glasses. For example, the processor 28 of the terminal device 12A can change the color of the light sources 44R, 44L, and 44C such that the brightness of the user A's facial area is within the allowable range of brightness and the color of the user A's facial area is within the allowable range of color.
[0229] The processor 28 of the terminal device 12A can also change the control of the light sources 44R, 44L, and 44C according to the change in the position of user A. In embodiment 5, the processor 28 of the terminal device 12A can also change the color of at least one of the light sources 44R, 44L, and 44C according to the position of user A.
[0230] For example, if the position of user A changes, the processor 28 of terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C in a manner that does not change the brightness or color of the user A's facial area. Furthermore, if the position of user A changes, the processor 28 of terminal device 12A changes the color of at least one of the light sources 44R, 44L, and 44C in a manner that does not produce shadows, whitening, or reflections in the eyes.
[0231] The processor 28 of the terminal device 12A can also send a reminder to user A to correct the loading of user A based on the loading of user A. For example, the processor 28 of the terminal device 12A can display a reminder message on the display of the terminal device 12A, generate a reminder voice from the speaker of the terminal device 12A, or transmit the reminder to user A through vibration.
[0232] For example, upon receiving a notification from user A, the processor 28 of terminal device 12A sends a notification urging user A to change the color of at least one of the light sources 44R, 44L, and 44C. When user A receives this notification, user A can also manually change the color of at least one of the light sources 44R, 44L, and 44C. The processor 28 of terminal device 12A accepts user A's change to the light source color and changes the color of the light source accordingly. Alternatively, in the case of urging the user to change the light source color, the processor 28 of terminal device 12A may not automatically change the color of the light source.
[0233] Alternatively, the processing described in Embodiment 5 can also be performed by the processor 20 of the server 10.
[0234] (Example 6)
[0235] In embodiment 6, the processor 28 of the terminal device 12A changes the type of light source illuminating user A according to the presence of user A.
[0236] For example, when light sources 44R, 44L, and 44C are different types of light sources (e.g., light sources 44R and 44L are LEDs and light source 44C is a fluorescent lamp), the processor 28 of the terminal device 12A selects the light source from light sources 44R, 44L, and 44C to illuminate user A based on the input of user A. As another example, when light sources 44R, 44L, and 44C have multiple light sources and can switch between these multiple light sources to illuminate, the processor 28 of the terminal device 12A changes the type of light source possessed by light sources 44R, 44L, and 44C based on the input of user A. Changing the type of light source can be arbitrary.
[0237] For example, the processor 28 of the terminal device 12A analyzes an image or dynamic image of the user A's facial area to detect the brightness of the user A's facial area. If the detected brightness is within a predefined allowable brightness range, the processor 28 of the terminal device 12A does not change the type of light source. If the detected brightness is not within the allowable brightness range, the processor 28 of the terminal device 12A changes the type of light source in a way that the brightness of the user A's facial area is within the allowable range. For example, the processor 28 of the terminal device 12A changes the type of light source in a way that brightens the entire facial area of the user A.
[0238] The processor 28 of the terminal device 12A can detect the brightness of a portion (e.g., a designated area) of the user A's face and change the type of light source according to the detected brightness, or it can detect the brightness of the entire facial area of the user A and change the type of light source according to the detected brightness.
[0239] The processor 28 of the terminal device 12A can also detect the brightness distribution of part or all of the user A's facial area and change the type of light source according to the detected brightness distribution. For example, the processor 28 of the terminal device 12A can change the type of light source in a way that makes the brightness distribution of part or all of the user A's facial area more uniform.
[0240] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area to detect whether shadows have been generated on part or all of the user A's facial area. If no shadows are detected, the processor 28 of the terminal device 12A does not change the type of the light source 44. If shadows are detected, the processor 28 of the terminal device 12A changes the type of the light source in a way that shadows are not detected. The processor 28 of the terminal device 12A can also change the type of the light source in a way that shadows are not detected and the brightness of the user A's facial area is within an acceptable range.
[0241] The processor 28 of the terminal device 12A can also detect the distribution of shadows on part or all of the user A's facial area and change the type of light source according to the detected shadow distribution. For example, the processor 28 of the terminal device 12A changes the type of light source in such a way that the distribution of shadows on part or all of the user A's facial area becomes uniform.
[0242] The processor 28 of the terminal device 12A can also detect the contrast of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected contrast is within a predefined allowable range, the processor 28 of the terminal device 12A does not change the type of light source. If the detected contrast is not within the allowable range, the processor 28 of the terminal device 12A changes the type of light source in such a way that the contrast of the user A's facial region is within the allowable range.
[0243] The processor 28 of the terminal device 12A can detect the contrast of a portion of the user A's facial area and change the type of light source based on the detected contrast, or it can detect the contrast of the entire facial area of the user A and change the type of light source based on the detected contrast.
[0244] The processor 28 of the terminal device 12A can also detect the color of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected color is within a predefined acceptable range, the processor 28 of the terminal device 12A does not change the type of light source. If the color of the user A's facial region is not within the acceptable range, the processor 28 of the terminal device 12A changes the type of light source in such a way that the color of the user A's facial region is within the acceptable range.
[0245] The processor 28 of the terminal device 12A can detect the color of a portion of the user A's facial area and change the type of light source according to the detected color, or it can detect the color of the entire facial area of the user A and change the type of light source according to the detected color.
[0246] The processor 28 of the terminal device 12A can also detect the color distribution of part or all of the user A's facial area and change the type of light source according to the detected color distribution. For example, the processor 28 of the terminal device 12A can change the type of light source in a way that makes the color distribution of part or all of the user A's facial area more uniform.
[0247] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area and detect whitening in all or part of the user A's facial area. If no whitening is detected, the processor 28 of the terminal device 12A does not change the type of light source. If whitening is detected, the processor 28 of the terminal device 12A changes the type of light source in a way that prevents whitening from being detected. The processor 28 of the terminal device 12A can also change the type of light source in a way that prevents whitening from being detected and the brightness of the user A's facial area is within an acceptable range.
[0248] The processor 28 of the terminal device 12A can also detect the presence of backlight by analyzing images or dynamic images of the user A's facial area. If no backlight is detected, the processor 28 of the terminal device 12A does not change the type of light source. If backlight is detected, the processor 28 of the terminal device 12A changes the type of light source.
[0249] Even when user A is wearing glasses, the processor 28 of the terminal device 12A can detect the presence of glasses (e.g., the presence or absence of light reflection in the lenses) by analyzing images or dynamic images of user A's facial area. For example, if no light reflection in the lenses is detected, the processor 28 of the terminal device 12A does not change the type of light source. If light reflection in the lenses is detected, the processor 28 of the terminal device 12A changes the type of light source in a way that prevents the detection of light reflection in the lenses.
[0250] The processor 28 of the terminal device 12A can also change the type of light source based on at least two of the following factors: brightness of the user A's facial area, presence or absence of shadows, contrast, color, presence or absence of whitening, presence or absence of backlighting, and presence or absence of reflection from the glasses. For example, the processor 28 of the terminal device 12A can change the type of light source in such a way that the brightness of the user A's facial area is within the allowable range of brightness and the color of the user A's facial area is within the allowable range of color.
[0251] The processor 28 of the terminal device 12A can also change the control of the light sources 44R, 44L, and 44C according to the change in the position of user A. In embodiment 6, the processor 28 of the terminal device 12A can also change the type of light source according to the position of user A.
[0252] For example, if user A's position changes, the processor 28 of the terminal device 12A changes the type of light source in a way that keeps the brightness or color of user A's facial area unchanged. Furthermore, if user A's position changes, the processor 28 of the terminal device 12A changes the type of light source in a way that does not produce shadows, whitening, or reflections in the eyes.
[0253] The processor 28 of the terminal device 12A can also notify user A of the correction of the input based on the input of user A. For example, the processor 28 of the terminal device 12A can display a message indicating the reminder on the display of the terminal device 12A, generate a voice indicating the reminder from the speaker of the terminal device 12A, or transmit the reminder to user A through vibration.
[0254] For example, upon receiving a notification from user A, the processor 28 of terminal device 12A sends a notification urging user A to change the type of at least one of the light sources 44R, 44L, and 44C. When user A receives this notification, user A can also manually change the type of at least one of the light sources 44R, 44L, and 44C. Alternatively, in the case of urging the user to change the type of light source, the processor 28 of terminal device 12A may not automatically change the type of light source.
[0255] Alternatively, the processing described in Embodiment 6 can also be performed by the processor 20 of the server 10.
[0256] (Example 7)
[0257] In embodiment 7, the processor 28 of the terminal device 12A changes the positional relationship between at least one of the light sources 44R, 44L, and 44C and the camera (e.g., the camera of the terminal device 12A) that is capturing user A, based on the presence of user A. The processor 28 of the terminal device 12A changes the positional relationship between the light source and the camera by changing the position of at least one of the light sources and the camera.
[0258] The light source or camera can move along a track, or it can be equipped with wheels, which are rotated to move the light source or camera. For example, by using and controlling components such as motors, the light source or camera can be moved to change its location.
[0259] For example, the processor 28 of terminal device 12A detects the brightness of the facial region of user A by analyzing an image or dynamic image of user A's face. If the detected brightness is within a predefined allowable brightness range, the processor 28 of terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the camera of terminal device 12A. If the detected brightness is not within the allowable brightness range, the processor 28 of terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the camera of terminal device 12A in such a way that the brightness of user A's facial region is within the allowable range, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the camera of terminal device 12A. For example, the processor 28 of terminal device 12A changes the positional relationship between the light sources 44R, 44L, 44C and the camera of terminal device 12A in such a way that the entire facial region of user A becomes brighter.
[0260] The processor 28 of the terminal device 12A can detect the brightness of a portion (e.g., a designated area) of the user A's face and change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A according to the detected brightness. It can also detect the brightness of the entire facial area of the user A and change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A according to the detected brightness.
[0261] The processor 28 of the terminal device 12A can also detect the brightness distribution of part or all of the user A's facial area and change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A according to the detected brightness distribution. For example, the processor 28 of the terminal device 12A can change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A in a way that makes the brightness distribution of part or all of the user A's facial area more uniform.
[0262] The processor 28 of the terminal device 12A can also detect whether a shadow has been generated on part or all of the user A's facial area by analyzing an image or dynamic image of the user A's facial area. If no shadow is detected, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A. If a shadow is detected, the processor 28 of the terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the camera of the terminal device 12A in a manner that prevents the detection of a shadow, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A. The processor 28 of the terminal device 12A can also change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A in a manner that prevents the detection of a shadow and ensures that the brightness of the user A's facial area is within an acceptable range.
[0263] The processor 28 of the terminal device 12A can also detect the distribution of shadows on part or all of the user A's facial area, and change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A according to the detected shadow distribution. For example, the processor 28 of the terminal device 12A can change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A in a way that makes the distribution of shadows on part or all of the user A's facial area more uniform.
[0264] The processor 28 of the terminal device 12A can also detect the contrast of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected contrast is within a predefined allowable range, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A. If the detected contrast is not within the allowable range, the processor 28 of the terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the camera of the terminal device 12A in such a way that the contrast of the user A's facial region is within the allowable range, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A.
[0265] The processor 28 of the terminal device 12A can detect the contrast of a portion of the user A's facial area and change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A based on the detected contrast. It can also detect the contrast of the entire facial area of the user A and change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A based on the detected contrast.
[0266] The processor 28 of the terminal device 12A can also detect the color of the user A's facial region by analyzing an image or dynamic image of the user A's facial region. If the detected color is within a predefined permissible range, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A. If the color of the user A's facial region is not within the permissible range, the processor 28 of the terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the camera of the terminal device 12A in such a way that the color of the user A's facial region is within the permissible range, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A.
[0267] The processor 28 of the terminal device 12A can detect the color of a portion of the user A's facial area and change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A according to the detected color. It can also detect the color of the entire facial area of the user A and change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A according to the detected color.
[0268] The processor 28 of the terminal device 12A can also detect the color distribution of part or all of the user A's facial area, and change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A according to the detected color distribution. For example, the processor 28 of the terminal device 12A can change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A in a way that makes the color distribution of part or all of the user A's facial area more uniform.
[0269] The processor 28 of the terminal device 12A can also analyze an image or dynamic image of the user A's facial area and detect whitening in all or part of the user A's facial area. If no whitening is detected, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A. If whitening is detected, the processor 28 of the terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the camera of the terminal device 12A in a manner that prevents whitening from being detected, thereby changing the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A. The processor 28 of the terminal device 12A can also change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A in a manner that prevents whitening from being detected and the brightness of the user A's facial area is within an acceptable range.
[0270] The processor 28 of the terminal device 12A can also detect the presence of backlight by analyzing images or dynamic images of the user A's facial area. If no backlight is detected, the processor 28 of the terminal device 12A does not change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A. If backlight is detected, the processor 28 of the terminal device 12A changes the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A by changing the position of at least one of the light sources 44R, 44L, 44C and the camera of the terminal device 12A.
[0271] Even when user A is wearing glasses, the processor 28 of terminal device 12A can detect the presence of glasses (e.g., the presence or absence of light reflection in the lenses) by analyzing images or dynamic images of user A's facial area. For example, if no light reflection in the lenses is detected, the processor 28 of terminal device 12A does not change the positional relationship between light sources 44R, 44L, 44C and the camera of terminal device 12A. If light reflection in the lenses is detected, the processor 28 of terminal device 12A changes the position of at least one of light sources 44R, 44L, 44C and the camera of terminal device 12A in a manner that prevents the detection of light reflection in the lenses, thereby changing the positional relationship between light sources 44R, 44L, 44C and the camera of terminal device 12A. If the amount of light reflected in the lens (e.g., the brightness of the reflected light) exceeds a threshold, the processor 28 of the terminal device 12A can also change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A in such a way that the amount of light reflected in the lens is below the threshold.
[0272] The processor 28 of the terminal device 12A can also change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A based on at least two of the following factors: brightness of the user A's facial area, presence or absence of shadows, contrast, color, presence or absence of whitening, presence or absence of backlight, and presence or absence of reflection from the glasses. For example, the processor 28 of the terminal device 12A can change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A in such a way that the brightness of the user A's facial area is within the allowable range of brightness and the color of the user A's facial area is within the allowable range of color.
[0273] The processor 28 of the terminal device 12A can also change the positional relationship between the light sources 44R, 44L, 44C and the camera of the terminal device 12A according to the change of the user A's position. In embodiment 7, the processor 28 of the terminal device 12A can also change the position of at least one of the light sources 44R, 44L, 44C and the camera of the terminal device 12A according to the position of the user A.
[0274] For example, if user A's position changes, the processor 28 of terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the camera of terminal device 12A in a manner that keeps the brightness or color of user A's facial area unchanged. Furthermore, if user A's position changes, the processor 28 of terminal device 12A changes the position of at least one of the light sources 44R, 44L, 44C and the camera of terminal device 12A in a manner that does not produce shadows, whitening, or reflections from glasses. For example, the processor 28 of terminal device 12A follows changes in user A's position, changing the position of the light sources as if user A were illuminated by them, and changing the position of the camera of terminal device 12A as if capturing user A in that state.
[0275] The processor 28 of the terminal device 12A can also notify user A of the correction of the input based on the input of user A. For example, the processor 28 of the terminal device 12A can display a message indicating the reminder on the display of the terminal device 12A, generate a voice indicating the reminder from the speaker of the terminal device 12A, or transmit the reminder to user A through vibration.
[0276] For example, upon receiving a notification from user A, the processor 28 of terminal device 12A sends a notification urging user A to change the position of at least one of the light sources 44R, 44L, 44C, and the camera of terminal device 12A. When user A receives this notification, user A may also manually change the position of at least one of the light sources 44R, 44L, 44C, and the camera of terminal device 12A. Alternatively, in the case of urging the user to change the position, the processor 28 of terminal device 12A may not automatically change the positions of the light sources and the camera of terminal device 12A.
[0277] At least two of the embodiments 1 to 7 described above can also be combined. That is, the processor 28 of the terminal device 12A can also control at least two of the following elements based on the presence of user A: the light intensity of the light source, the positional relationship between the light source and user A, the orientation of the light source towards user A, the selection of the light source illuminating user A, the color of the light source, the type of light source, and the positional relationship between the light source and the camera. For example, the processor 28 of the terminal device 12A can change the light intensity of the light source and the positional relationship between the light source and user A or the positional relationship between the light source and the camera based on the presence of user A. As another example, the processor 28 of the terminal device 12A can also change the light intensity, the orientation of the light source, and the color of the light source based on the presence of user A.
[0278] In embodiments 1 to 7 described above, the processor 28 of the terminal device 12A can also perform image processing on the image or dynamic image of user A displayed in the online meeting based on the input of user A.
[0279] For example, the processor 28 of the terminal device 12A can change the brightness of the image or moving image of user A in a manner that ensures the brightness of the user A's facial area is within an acceptable range. If a shadow is detected, it can also perform a process to eliminate the shadow generated in the image or moving image. Alternatively, it can change the brightness of the image or moving image of user A in a manner that ensures the contrast of the user A's facial area is within an acceptable range, and it can also change the color of the image or moving image of user A in a manner that ensures the color of the user A's facial area is within an acceptable range. If whitening, backlighting, or the reflection of glasses is detected, it can also perform a process to correct the whitening, backlighting, or the reflection of glasses generated in the image or moving image. The processor 28 of the terminal device 12A can execute at least one of the embodiments 1 to 7 and execute at least one of their image processing processes, or it can execute at least one of their image processing processes without executing embodiments 1 to 7.
[0280] If, through image processing alone, the brightness, contrast, and color of the image or dynamic image of user A's facial area are contained within acceptable limits, thereby correcting issues such as shadows, washouts, backlighting, and reflections of glasses, the processor 28 of the terminal device 12A can also maintain control of the light source without altering it. For example, if power consumption increases when the control of the light source is changed, this increase in power consumption can be prevented by maintaining control of the light source.
[0281] Alternatively, the processing described in Embodiment 7 can also be performed by the processor 20 of the server 10.
[0282] (Example 8)
[0283] Hereinafter, Embodiment 8 will be described. In Embodiment 8, the processor 28 of the terminal device 12A controls the cutting off of light other than the light source illuminating the user, based on the light illuminating the user. For example, light other than the light source illuminating the user is external light, light in the factory (e.g., the light from an arc discharge during welding), etc.
[0284] The following is for reference Figure 8 as well as Figure 9 Example 8 will be described in detail. Figure 8 as well as Figure 9 The diagram schematically illustrates the appearance of a cubicle 52 as an example of a venue for online meetings. The cubicle 52 has walls and a ceiling, and the space within the cubicle 52 is a space surrounded by walls and a ceiling. For example, within the cubicle 52, there are... Figure 5 The light source, monitor, chair, etc. shown allow users to utilize online meetings within cubicle 52.
[0285] A door 54 is provided in compartment 52 for entering and exiting compartment 52. Door 54 may contain, for example, a transparent glass or acrylic panel, through which external light enters compartment 52. The external light is not light from a source that illuminates user A.
[0286] If the brightness of the external light entering the compartment 52 is above a threshold, the processor 28 of the terminal device 12A cuts off the external light; if the brightness of the external light entering the compartment 52 is below the threshold, the external light is not cut off. For example, a sensor is installed near the door 54 to detect the brightness of the external light entering the compartment 52.
[0287] For example, if the brightness of the external light entering compartment 52 is above a threshold, such as Figure 9 As shown, the processor 28 of the terminal device 12A closes the shutter 56 installed on the door 54. By closing the shutter 56, the amount of external light entering the compartment 52 can be reduced. When the brightness of the external light entering the compartment 52 is less than a threshold, such as... Figure 8As shown, the processor 28 of the terminal device 12A opens the blinds 56.
[0288] As another example, if a dimming glass is installed in door 54, the processor 28 of terminal device 12A can also cut off external light entering compartment 52 by reducing the transparency of the dimming glass (e.g., by making the dimming glass opaque). As another example, a dimming film can also be used.
[0289] By cutting off external light entering the compartment 52, it is possible to suppress backlighting in images or moving images of user A displayed in an online meeting.
[0290] The processor 28 of the terminal device 12A can automatically close the blinds 56, or automatically set the dimming glass to opaque, or urge the user to close the blinds 56 or make the dimming glass opaque. For example, the processor 28 of the terminal device 12A can display a message urging this content on the display, or generate an urging voice from the speaker.
[0291] Alternatively, the processing described in Embodiment 8 can also be performed by the processor 20 of the server 10.
[0292] (Example 9)
[0293] Hereinafter, Example 9 will be described. In Example 9, the processor 28 of the terminal device 12A changes the control of the light sources 44R, 44L, and 44C according to the user A's usage of the online meeting.
[0294] For example, the processor 28 of the terminal device 12A changes the output of light sources 44R, 44L, and 44C based on user A's usage of the online meeting. Specifically, by setting an energy-saving mode, the processor 28 of the terminal device 12A switches the mode of light sources 44R, 44L, and 44C to an energy-saving mode based on user A's usage of the online meeting, thereby reducing power consumption. The energy-saving mode is a mode that turns off at least one of the light sources 44R, 44L, and 44C or reduces the light output of at least one light source.
[0295] To illustrate with specific examples, the processor 28 of the terminal device 12A changes the output of the light source depending on whether it is necessary to illuminate user A with the light source or not. When it is necessary to illuminate user A with the light source, the processor 28 of the terminal device 12A does not switch the light source mode to an energy-saving mode; when it is not necessary to illuminate user A with the light source, it switches the light source mode to an energy-saving mode. For example, when user A is being followed or will be followed in an online meeting, the light source mode does not switch to an energy-saving mode; when user A is not being followed or is unlikely to be followed, the light source mode switches to an energy-saving mode.
[0296] For example, when displaying an image or animated image of user A's face on screen 32 for an online meeting, the processor 28 of terminal device 12A does not switch the light source mode to energy-saving mode. When the image or animated image of user A's face is not displayed on screen 32, the processor 28 of terminal device 12A switches the light source mode to energy-saving mode. The magnification of the image or animated image can be performed by user A, or by users B, C, or D who are the other party in the communication. For example, by user A performing a magnification operation on display area 32A, the image or animated image of user A's face is displayed in magnified form. As another example, when user A speaks, display area 32A can also be magnified, thereby magnifying the image or animated image of user A's face.
[0297] The processor 28 of the terminal device 12A can also change the light intensity of at least one of the light sources 44R, 44L, and 44C according to the size of the image or dynamic image of the user A's facial area displayed on the screen 32. For example, the processor 28 of the terminal device 12A can increase the light intensity of the light source as the image or dynamic image of the user A's facial area becomes larger. In addition, the light intensity can also be adjusted in stages.
[0298] As another example, when user A is speaking in an online meeting, the processor 28 of terminal device 12A does not switch the light source mode to energy-saving mode. When user A is not speaking in the online meeting, the processor 28 of terminal device 12A switches the light source mode to energy-saving mode. For example, if the camera of terminal device 12A captures a picture of user A's face, the processor 28 of terminal device 12A analyzes the image or moving image generated by the capture to determine whether user A is speaking. The processor 28 of terminal device 12A can also determine that user A is speaking if sound is collected by the microphone of terminal device 12A. In this case, the processor 28 of terminal device 12A can also determine whether the collected sound is user A's voice by analyzing the collected sound, and determine that user A is speaking if user A's voice is collected.
[0299] As another example, when user A is designated as the counterpart in an online meeting, the processor 28 of terminal device 12A does not switch the light source mode to energy-saving mode. When user A is not designated as the counterpart in an online meeting, the processor 28 of terminal device 12A switches the light source mode to energy-saving mode. For example, in an online meeting with three or more users, if a user other than user A designates user A as the counterpart, the processor 28 of terminal device 12A does not switch the light source mode to energy-saving mode. When user A is not designated as the counterpart by any other user, the processor 28 of terminal device 12A switches the light source mode to energy-saving mode.
[0300] For example, the processor 28 of the terminal device 12A uses speech recognition technology to determine whether user A is designated as the other party in a conversation. For example, when user B sends out information for identifying user A in the form of speech (e.g., account information, name, ID, etc.), the processor 28 of the terminal device 12A determines that the other party in user B's conversation is user A by analyzing the speech.
[0301] As another example, the processor 28 of terminal device 12A analyzes images or moving images of users other than user A to detect the gaze of other users and determine whether the other users are looking at user A. For example, if other users are looking at display area 32A (i.e., display area 32A is positioned in front of the other users' gaze), the processor 28 of terminal device 12A determines that the other user's conversation partner is user A. Furthermore, the processor 28 of terminal device 12, which is the other party in user A's conversation, can also determine that the other party in the conversation is user A by detecting that other party's gaze and send the determination result to terminal device 12A.
[0302] As another example, the processor 28 of the terminal device 12A can also determine who is talking to whom based on the context of the conversation between multiple users participating in an online meeting, the actions of each user (such as nodding), etc.
[0303] Alternatively, the processing described in Embodiment 9 can also be performed by the processor 20 of the server 10.
[0304] (Example 10)
[0305] The following describes Embodiment 10. In Embodiment 10, the processor 28 of the terminal device 12A changes the control of light sources 44R, 44L, and 44C based on the light source or condition of other users (i.e., users other than user A) participating in the online meeting with user A. Here, as an example, the other user is user B.
[0306] The processor 28 of terminal device 12A used by user A and the processor 28 of terminal device 12B used by user B share the setting information of the light source used by users A and B respectively, so that the imaging of users participating in the online meeting (e.g., user A and user B) is the same, and the light source is controlled in a way that users A and B are imaging in the online meeting in the same environment. Of course, it is also possible not to have all participants in the online meeting participate in the online meeting in the same environment, but to allow a specific user A to participate in the online meeting and user A themselves to participate in the online meeting in the same environment.
[0307] Furthermore, if other users participating in the online meeting are not using specially configured light sources, but users want their environments to match those of user A, the processor 28 of the terminal device 12A can acquire information about the brightness or color of those other users' environments and adjust user A's environment using a light source or similar means to match that brightness or color. Examples of components that acquire information about other users' environments include illuminance sensors, cameras, and other imaging devices. Additionally, when adjusting the light source using this function, if the mapping between other users and user A is consistent before the online meeting begins, or if the difference in mapping is within an acceptable range, the processor 28 of the terminal device 12A can allow user A to participate in the online meeting without making the aforementioned adjustments.
[0308] (Example 11)
[0309] Hereinafter, Embodiment 11 will be described. In Embodiment 11, the processor 28 of the terminal device 12A changes the control of the light sources 44R, 44L, and 44C according to the expectations of other users (i.e., users other than user A) who are participating in an online meeting with user A.
[0310] In online meeting services, it is sometimes desirable for the service provider to control the other party's image. For example, in online meetings such as job interviews, if the other party's image is dimmed and their face is unclear, it becomes difficult to verify their identity, potentially leading to the interviewing of someone else. To address this, a function is needed for another user to control the other party's image online. Therefore, when a user specifying the target (e.g., an interviewer) delegates image control to the online connected party, and the other party agrees to this control, the processor 28 of the terminal device 12 controls the other party's image. For example, the processor 28 of the terminal device 12 can control the light source located on the terminal device 12 used by the other party or the light source located around the other party. The processor 28 of the terminal device 12 can also apply image processing to the image representing the other party. Furthermore, a mode can be set to control the light source without the other party's consent.
[0311] In embodiments 1 to 11 described above, the processor 28 of the terminal device 12A can also cause light sources (e.g., light sources 44R, 44L, 44C, or ceiling lighting) pre-installed in the venue 40 for online meetings to cooperate with the light source held by user A, and change the control of these light sources according to user A's arrival. The light sources pre-installed in the venue 40 are light sources 44R, 44L, 44C, or lighting installed on the ceiling, walls, etc. The light source held by user A is, for example, the light source installed on the terminal device 12A brought into the venue 40 by user A (e.g., the lighting of a smartphone, etc.).
[0312] In embodiments 1 to 9 described above, when user A ends the online meeting, the processor 28 of the terminal device 12A may also turn off the light sources used only to illuminate user A (e.g., light sources 44R, 44L, 44C). In this case, the processor 28 of the terminal device 12A does not turn off the ceiling lighting installed in the location 40. The situation where user A ends the online meeting refers to situations such as: users A, B, C, and D all leaving the online meeting; user A leaving the online meeting; or user A temporarily leaving the online meeting without leaving. For example, when user A leaves the online meeting, the processor 28 of the terminal device 12A turns off light sources 44R, 44L, and 44C.
[0313] In embodiments 1 to 11 described above, the processor 28 of the terminal device 12A can also allow user A to confirm the login before user A starts an online meeting, and allow user A to participate in the online meeting with user A's permission. Alternatively, the processor 28 of the terminal device 12A can prevent user A from participating in the online meeting without user A's permission. As another example, without user A's permission, the processor 28 of the terminal device 12A can either not display the image or video image of user A generated by taking a picture in the display area 32A, but instead display an image or video image schematically representing user A in the display area 32A; or it can not display the image or video image of user A in the display area 32A, but instead display a string used to identify user A in the display area 32A.
[0314] For example, user A is photographed by the camera of terminal device 12A, and the resulting image or video is displayed on the monitor of terminal device 12A. The processor 28 of terminal device 12A confirms user A's presence based on the image or video, and adjusts the control of light sources 44R, 44L, and 44C accordingly, or performs image processing on user A's image or video. User A confirms the image or video after the light source control or image processing has been performed, and may or may not allow the display of the image or video in the online meeting while participating in the online meeting.
[0315] With user A's permission, the processor 28 of the terminal device 12A enables user A to log in to the online meeting and participate in the online meeting, and displays the image or video of user A generated by the camera of the terminal device 12A on the display area 32A.
[0316] If the user does not allow it, the processor 28 of the terminal device 12A will not allow the user A to participate in the online meeting, or will allow the user A to participate in the online meeting but will not display the image or video of the user A generated by photography in the display area 32A.
[0317] As an example, the functions of each part of the server 10 and terminal device 12 are realized through the cooperation of hardware and software. For example, the processor of each device reads and executes the program stored in the memory of each device, thereby realizing the function of each device. The program is stored in the memory via a recording medium such as a CD or DVD, or via a communication path such as a network.
[0318] In the above embodiments, "processor" refers to a processor in a broad sense, including general-purpose processors (e.g., CPU: Central Processing Unit) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic devices, etc.). Furthermore, the operation of the processor in the above embodiments can be performed not only by a single processor, but also by multiple processors located in physically separate locations working together. Moreover, the order of the processor's actions is not limited to the order described in the above embodiments and can be appropriately modified.
Claims
1. An information processing device comprising a processor, The processor adjusts the control of the light source illuminating the user based on the user's presence in the online meeting. The processor sets an energy-saving mode for the output of the light source. This energy-saving mode is a mode that turns off at least one of the multiple light sources or reduces the light output of at least one of the light sources. When the image of the user's facial area is magnified and displayed on the screen of the online meeting, the processor does not switch the output of the light source to the energy-saving mode. When the image of the user's facial area is not magnified on the screen of the online meeting, the processor converts the output of the light source to the energy-saving mode.
2. The information processing apparatus according to claim 1, wherein, The processor controls the amount of light from the light source based on the user's input.
3. The information processing apparatus according to claim 1, wherein, The processor changes the positional relationship between the light source and the user based on the user's presence.
4. The information processing apparatus according to claim 1, wherein, The processor changes the orientation of the light source toward the user based on the user's presence.
5. The information processing apparatus according to claim 1, wherein, The processor selects one or more light sources to illuminate the user based on the user's input.
6. The information processing apparatus according to claim 1, wherein, The processor changes the color of the light source based on the user's input.
7. The information processing apparatus according to claim 1, wherein, The processor changes the type of light source based on the user's input.
8. The information processing apparatus according to claim 1, wherein, The processor changes the positional relationship between the light source and the camera that is capturing the user based on the user's presence.
9. The information processing apparatus according to claim 1, wherein, The processor also changes the control of the light source based on changes in the user's position.
10. The information processing apparatus according to any one of claims 1 to 9, wherein, The processor also controls the cutting off of light other than the light source based on the light source itself.
11. The information processing apparatus according to any one of claims 1 to 9, wherein, The image of the user displayed in the online meeting was taken by a camera held by the user.
12. The information processing apparatus according to any one of claims 1 to 9, wherein, The processor also performs image processing on the user's image displayed in the online meeting based on the user's presence.
13. The information processing apparatus according to any one of claims 1 to 9, wherein, The processor also notifies the user of a prompt for correction of the user's mapping based on the user's mapping.
14. The information processing apparatus according to claim 1, wherein, The processor adjusts the output of the light source based on how the user utilizes the online meeting.
15. The information processing apparatus according to claim 14, wherein, The processor changes the output of the light source when the user speaks in the online meeting and when the user does not speak.
16. The information processing apparatus according to claim 1, wherein, The processor also changes the control of the light source illuminating the user based on the presence of another user participating in the online meeting.
17. The information processing apparatus according to claim 1, wherein, The processor also changes the control of the light source illuminating the user based on a request to modify the mapping of the user participating in the online meeting.
18. The information processing apparatus according to any one of claims 1 to 9, wherein, The processor also enables a light source pre-set in the location used for the online meeting to cooperate with a light source held by the user.
19. The information processing apparatus according to any one of claims 1 to 9, wherein, The processor also turns off the light source used only to illuminate the user when the online meeting ends.
20. The information processing apparatus according to any one of claims 1 to 9, wherein, Before the user participates in the online meeting, the processor prompts the user to confirm their participation. With the user's permission, the processor enables the user to participate in the online meeting.
21. A computer-readable medium storing a program that causes a computer to perform processing. In this process, the control of the light source illuminating the user is changed based on the presence of the user in the online meeting. An energy-saving mode is set for the output of the light source. This energy-saving mode is a mode that turns off at least one of the multiple light sources or reduces the light output of at least one of the light sources. When the image of the user's facial area is magnified and displayed on the screen of the online meeting, the output of the light source is not switched to the energy-saving mode. Without enlarging the image of the user's facial area on the screen of the online meeting, the output of the light source is switched to the energy-saving mode.
22. An information processing method that adjusts the control of a light source illuminating a user based on the presence of the user in an online meeting. An energy-saving mode is set for the output of the light source. This energy-saving mode is a mode that turns off at least one of the multiple light sources or reduces the light output of at least one of the light sources. When the image of the user's facial area is magnified and displayed on the screen of the online meeting, the output of the light source is not switched to the energy-saving mode. Without enlarging the image of the user's facial area on the screen of the online meeting, the output of the light source is switched to the energy-saving mode.
23. A computer program product comprising a program that causes a computer to perform processing. In this process, the control of the light source illuminating the user is changed based on the presence of the user in the online meeting. An energy-saving mode is set for the output of the light source. This energy-saving mode is a mode that turns off at least one of the multiple light sources or reduces the light output of at least one of the light sources. When the image of the user's facial area is magnified and displayed on the screen of the online meeting, the output of the light source is not switched to the energy-saving mode. Without enlarging the image of the user's facial area on the screen of the online meeting, the output of the light source is switched to the energy-saving mode.
Citation Information
Patent Citations
Television conference apparatus
JP2011244080A
Camera system and method for photographing with flash.
JP2012529831A
Image processing apparatus, image processing method, and program
JP2019205205A
Illumination systems and methods for computer imagers
US20090175555A1
