Server

The server system addresses the issue of inappropriate focusing area setting by detecting hands on desks and setting the focus area above them, stabilizing focus on notes and reducing user discomfort.

JP2024166961AInactive Publication Date: 2024-11-29TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023083408
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-19
Publication Date
2024-11-29
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing systems fail to appropriately set the focusing area of cameras when capturing images, particularly when frame rates and resolutions differ between multiple cameras.

Method used

A server system that communicates with imaging and display devices, detects the presence of a hand on a desk, and sets the focus area above the detected hand within the camera's field of view, allowing for stable focusing on objects like notes while writing.

Benefits of technology

Enables appropriate setting of the focusing area, reducing user discomfort by avoiding unnecessary focusing on the desk or hand, and ensuring stable focus on the note during writing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024166961000001_ABST
    Figure 2024166961000001_ABST
Patent Text Reader

Abstract

To set a camera's focus area appropriately.SOLUTION: A server 2 is capable of communicating with an imaging device 1 and a display device 2, and performs operations including capturing an image of a desk using the imaging device 1, displaying the captured image on the display device 2, and, setting a focus area to an area within the angle of view of the imaging device 1 above the area in which a hand is detected when detecting the presence of the hand on the desk from the captured image.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a server. [Background technology]

[0002] Conventionally, a system is known in which an image of a person captured by a first camera at a first location and information written on an information recording medium captured by a second camera are transmitted to an image display device at a second location, and the frame rate of the image captured by the second camera is lower than the frame rate of the image captured by the first camera, and the resolution of the image captured by the second camera is higher than the resolution of the image captured by the first camera (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2022 / 259375 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned background art, proper setting of the focal area of ​​the camera is not considered.

[0005] In view of the above circumstances, an object of the present disclosure is to appropriately set the focus area of ​​a camera. [Means for solving the problem]

[0006] The server according to an embodiment of the present disclosure includes: A server capable of communicating with an imaging device and a display device, taking an image of a desk using the imaging device and displaying the image on the display device; when detecting the presence of a hand on a desk from the captured image, setting a focus area to an area above an area where the hand is detected within an angle of view of the imaging device; The operation includes: Effect of the Invention

[0007] According to an embodiment of the present disclosure, the focal area of ​​the camera can be appropriately set. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram of an information processing system. [Diagram 2] FIG. [Diagram 3] FIG. 13 illustrates another region of interest. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] 1 is a schematic diagram of an information processing system S according to the present embodiment. The information processing system S includes an imaging device 1, a server 2, and a display device 3 that are capable of communicating with each other via a network NW. The network NW includes, for example, a mobile communication network, a fixed communication network, or the Internet.

[0010] 1, for ease of explanation, one imaging device 1, one server 2, and one display device 3 are illustrated. However, the number of imaging devices 1, one server 2, and one display device 3 is not limited to this. For example, the process executed by the server 2 in this embodiment may be executed by multiple servers 2 that are distributed.

[0011] The imaging device 1 includes a camera. The imaging device 1 can capture images of the surroundings. The imaging device 1 may transmit the captured images to the server 2 for image analysis. The images include still images or video images.

[0012] The server 2 is installed in a facility such as a data center, etc. The server 2 is a computer such as a server belonging to a cloud computing system or other computing system.

[0013] The server 2 includes a control unit, a communication unit, and a storage unit. The components of the server 2 are connected to each other so as to be able to communicate with each other.

[0014] The control unit includes, for example, one or more general-purpose processors including a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The control unit may include one or more dedicated processors specialized for specific processing. Instead of including a processor, the control unit may include one or more dedicated circuits. The dedicated circuits may be, for example, a FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit may include an ECU (Electronic Control Unit). The control unit transmits and receives any information via the communication unit.

[0015] The communication unit includes a communication module for connecting to the network NW. The communication unit may include a module compatible with one or more mobile communication standards including LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation). The communication unit may include a communication module compatible with one or more short-range communication standards or specifications including Bluetooth (registered trademark), AirDrop (registered trademark), IrDA, ZigBee (registered trademark), Felica (registered trademark), or RFID. The communication unit transmits and receives any information via the network NW.

[0016] The storage unit includes, but is not limited to, for example, a semiconductor memory, a magnetic memory, an optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a RAM or a ROM. The RAM is, for example, an SRAM or a DRAM. The ROM is, for example, an EEPROM. The storage unit may function, for example, as a main storage device, an auxiliary storage device, or a cache memory. The storage unit may store information resulting from analysis or processing by the control unit. The storage unit may store various information related to the operation or control of the server 2, etc. The storage unit may store system programs, application programs, embedded software, etc. The storage unit may be provided outside the server 2 and accessed by the server 2.

[0017] The display device 3 includes a control unit, a communication unit, and a storage unit. The display device 3 further includes a display as a display unit. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electro luminescence.

[0018] A detailed description will now be given of the information processing method executed in the information processing system S. As an example, the information processing system S may be incorporated in a next-generation online learning tool.

[0019] The imaging device 1 captures an image of a desk. The server 2 acquires the captured image from the imaging device 1. The server 2 determines from the captured image whether or not a hand has been detected on the desk.

[0020] As shown in Fig. 1, when the server 2 detects the hand of the imaging device 1 (step S10), it sets a region of interest (ROI) within a range at a predetermined distance from the hand HA in the field of view (FOV) (step S20). The imaging device 1 focuses on the desk by performing autofocus (AF). Focusing is performed based on the region of interest ROI within the field of view FOV. For example, focusing is performed in a region including the region of interest ROI. Focusing is performed using at least one of phase difference AF and contrast AF.

[0021] The region of interest ROI is set on the upper side of the hand HA, but may alternatively be set on the lower side, left side, or right side. The region of interest ROI may be set in a first direction intersecting with the optical axis direction of the imaging device 1 and in a second direction opposite to the first direction in which the hand HA exists.

[0022] The region of interest ROI is set at a predetermined distance from the edge of the field of view FOV, because the location where the imaging device 1 is installed is not uniquely determined.

[0023] The server 2 determines whether or not a note has been recognized from the captured image (step S30). If the server 2 recognizes a note, it further sets a region of interest ROI-2 within the region of interest ROI and within the region of the note NT, as shown in FIG.

[0024] Additionally or alternatively, the server 2 may determine whether the note is written vertically or horizontally from the captured image (step S31). If the server 2 determines that the note is written vertically, it may set a region of interest ROI-2 within the region of interest ROI and within the region of the note on either the left or right side of the hand HA (step S32). On the other hand, if the server 2 determines that the note is written horizontally, it may set a region of interest ROI-2 within the region of interest ROI and within the region of the note.

[0025] The server 2 judges whether or not an object other than the hand HA is recognized. As shown in Fig. 3, when the server 2 recognizes a predetermined object or medium other than the hand (an eraser ER in this case), it sets a region of interest ROI-3 on either the left or right side of the hand HA. As an alternative example, the object may be a pencil case.

[0026] ROI-3 may be set at a predetermined distance from the hand HA in order to accommodate sudden movements.

[0027] The server 2 causes the display device 3 to display the captured image.

[0028] As described above, according to this embodiment, when the server 2 detects the presence of the hand HA on the desk from the captured image, it sets the focus area to an area above the area where the hand HA is detected within the angle of view of the imaging device 1. This configuration allows the server 2 to stably focus on the notes even while the notes are being written. By setting the focus area above the position of the hand, the server 2 can reduce discomfort to the user caused by unnecessary repeated focusing on the desk or the hand.

[0029] Although the present disclosure will be described based on various drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Other modifications are possible within the scope of the present disclosure. For example, the functions included in each means or step can be rearranged so as not to cause logical inconsistencies, and multiple means or steps can be combined into one or divided.

[0030] For example, in the above embodiment, a program for executing all or part of the functions or processes of the server 2 can be recorded in a computer-readable recording medium. The computer-readable recording medium includes a non-transitory computer-readable medium, such as a magnetic recording device, an optical disk, a magneto-optical recording medium, or a semiconductor memory. The program is distributed, for example, by selling, transferring, or lending a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. The program may also be distributed by storing the program in the storage of an arbitrary server and transmitting the program from the arbitrary server to another computer. The program may also be provided as a program product. The present disclosure can also be realized as a program executable by a processor. [Explanation of symbols]

[0031] 2 Server

Claims

[Claim 1] A server capable of communicating with an imaging device and a display device, taking an image of a desk using the imaging device and displaying the image on the display device; when detecting the presence of a hand on a desk from the captured image, setting a focus area to an area above an area where the hand is detected within an angle of view of the imaging device; Server that performs operations including

Citation Information

Patent Citations

  • Information sharing system, image processing device, information sharing method, and program

    WO2022259375A1