lighting system

Abstract

To provide an illumination system that is applicable for improving productivity.SOLUTION: An illumination system includes an illuminating device with a first camera, an illuminating device with a second camera, and a management device. The illuminating device with the first camera includes a first illuminating unit and a first photographing unit, and is placed at a first height. The illuminating device with the second camera includes a second illuminating unit and a second photographing unit, and is placed at a second height different from the first height. The management device includes: a detection unit that detects a status in a photographing range that is obtained by photographing by at least either the first photographing unit or the second photographing unit; and a control unit that performs predetermined control in coordination between the illuminating device with the first camera and the illuminating device with the second camera according to the status detected by the detection unit.SELECTED DRAWING: Figure 4A

Description

[Technical Field]

[0001] FIELD OF THE INVENTION An embodiment of the present invention relates to a lighting system.

[0002] The area illuminated by multiple lighting devices installed in the space is photographed with a camera. shadow For such lighting systems, it has been proposed to apply them to monitoring systems that monitor production lines in factories or the status of employees in offices. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-162682 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional lighting systems are limited to simply monitoring workers and have not been designed to improve productivity.

[0005] The problem to be solved by the present invention is to provide a lighting system that can be applied to improve productivity. [Means for solving the problem]

[0006] The lighting system according to the embodiment includes a first lighting unit and a first imaging unit, By the first filming department Photography shadow The photo was taken shadow a first camera-equipped lighting device installed at a first height that includes all people located in a predetermined area in the range; a second lighting unit and a second photographing unit; The height relative to the hand assumed by the person, a second camera-equipped lighting device installed at a second height different from the first height; A state in a photographing range photographed by at least one of the first photographing unit and the second photographing unit is detected, and the first photographing unit shadow a detection unit that detects the number of people included in a predetermined area in the photographed range photographed by the image capturing unit; a control unit that performs predetermined control by coordinating the first camera-equipped lighting device and the second camera-equipped lighting device in accordance with the state detected by the detection unit; and a management device comprising: [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a lighting system that can be applied to improving productivity. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a perspective view showing an example of the appearance of a lighting device included in a lighting system according to an embodiment. [Figure 2] FIG. 2 is a block diagram schematically illustrating an example of the configuration of a lighting device included in the lighting system according to the embodiment. [Figure 3] FIG. 3 is a schematic diagram showing an example of the appearance of another lighting device included in the lighting system according to the embodiment. [Figure 4A] FIG. 4A is a diagram showing an overview of a lighting system according to an embodiment. [Figure 4B] FIG. 4B is a diagram illustrating an overview of a lighting system according to another example of the embodiment. [Figure 5A] FIG. 5A is a schematic diagram showing an example of installation of a lighting device with a camera that can be applied to an embodiment. [Figure 5B] FIG. 5B is a schematic diagram showing an example of installation of a lighting device with a camera that can be applied to the embodiment. [Figure 6] FIG. 6 is a functional block diagram of an example illustrating the functions of the management device according to the embodiment. [Figure 7A] FIG. 7A is a diagram schematically showing a photographed image photographed using the first photographing data. [Figure 7B] FIG. 7B is a diagram schematically showing a photographed image photographed using the first photographing data. [Figure 8] FIG. 8 is a flowchart illustrating an example of an abnormality detection process using the first captured data according to the embodiment. [Figure 9A] FIG. 9A is a schematic diagram showing an example of a captured image based on first capture data captured by a capture unit of a lighting device with a camera. [Figure 9B] FIG. 9B is a schematic diagram showing an example of a captured image based on twelfth capturing data captured by the capturing section of the camera-equipped lighting device. [Figure 10] FIG. 10 is a flowchart illustrating an example of an abnormality detection process using the first captured data and the second captured data according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Lighting systems 1a and 1b according to the embodiments described below include a first camera-equipped lighting device 10a, a second camera-equipped lighting device 10b, and a management device 100. The first camera-equipped lighting device 10a includes a first lighting unit 20a and a first photographing unit 30a and is installed at a first height. The second camera-equipped lighting device 10b includes a second lighting unit 20b and a second photographing unit 30b and is installed at a second height different from the first height. The management device 100 includes a detection unit 4b that detects the state of an image capture range captured by at least one of the first photographing unit 30a and the second photographing unit 30b, and a control unit 4 that performs predetermined control by coordinating the first camera-equipped lighting device 10a and the second camera-equipped lighting device 10b in accordance with the state detected by the detection unit 4b.

[0010] In the embodiment described below, when the detection unit 4b detects an abnormality in the condition, the control unit 4 associates the first photographing data captured by the first photographing unit 30a with the second photographing data captured by the second photographing unit 30b based on the time when the abnormality was detected.

[0011] The first height in the embodiments described below is greater than the second height.

[0012] In the embodiment described below, the first height is a height that includes all of the people 80 positioned in a specified area 75 in the shooting range photographed by the first shooting unit 30a, and the second height is a height that corresponds to the expected hands of the people 80.

[0013] The control unit 4 in the embodiment described below changes the lighting mode of the second lighting unit 20b when the detection unit 4b detects an abnormality in a predetermined area 75 in the shooting range photographed by the first shooting unit 30a.

[0014] The control unit 4 according to the embodiment described below changes the illumination mode of the second illumination unit 20b in response to the detected abnormality.

[0015] The detection unit 4b in the embodiment described below detects an abnormality when the distance between people 80 included in the specified area 75 is less than a predetermined value, and the control unit 4 outputs a notification when an abnormality is detected based on the distance between people 80.

[0016] The control unit 4 according to the embodiment described below outputs a notification when the detection unit 4b detects an abnormal state.

[0017] The control unit 4 according to the embodiment described below measures the motion interval of the subject based on the state of the subject included in the imaging range detected by the detection unit 4b.

[0018] Lighting systems 1a and 1b according to the embodiments described below include a camera-equipped lighting device 10a and a management device 100. The camera-equipped lighting device 10a includes a lighting unit 20a and an image capturing unit 30a. The management device 100 includes a detection unit 4b that detects the number of people included in a predetermined area 75 within the image capturing range captured by the image capturing unit 30a, and a control unit 4 that outputs a notification when the detection unit 4b does not detect the specified number of people in the predetermined area 75.

[0019] [Embodiment] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the embodiments described below do not limit the technology disclosed by the present invention. Furthermore, the embodiments and modifications described below can be combined as appropriate within a range that does not cause inconsistencies. Furthermore, in the following description, the same components are given the same reference numerals, and subsequent description will be omitted as appropriate.

[0020] (Regarding a camera-equipped lighting device applicable to the embodiment) Fig. 1 is a perspective view showing an example of the appearance of a camera-equipped lighting device included in a lighting system according to an embodiment. As shown in Fig. 1, the camera-equipped lighting device 10a includes a lighting unit 20a, an image capturing unit 30a, and a main body 40a. The camera-equipped lighting device 10a is a ceiling-mounted lighting device in which the main body 40a is installed on a ceiling surface and light output from the lighting unit 20a is irradiated toward a floor surface, which is an example of an illumination surface. The camera-equipped lighting device 10a is primarily used indoors for applications such as monitoring production lines in factories or monitoring the status of employees in offices.

[0021] For ease of understanding, Fig. 1 illustrates a three-dimensional Cartesian coordinate system including a Z axis, with the positive direction being vertically downward and the negative direction being vertically upward. The X axis is illustrated as extending along the length of the camera-equipped lighting device 10a, and the Y axis is illustrated as extending along the width of the camera-equipped lighting device 10a. This Cartesian coordinate system may also be illustrated in other drawings used in the following explanations.

[0022] The lighting unit 20a is an illumination bar having a plurality of light-emitting elements (not shown) arranged at predetermined intervals on a long chassis or substrate (not shown) arranged along the Y-axis direction, and a diffusion cover 21a is provided on the floor side, i.e., on the positive side of the Z-axis, so that the light-emitting elements are accommodated between the chassis and the light-emitting elements.

[0023] The diffusion cover 21a is made of a light-transmitting material such as acrylic or polycarbonate. The diffusion cover 21a is frosted to diffuse the light emitted from the multiple light-emitting elements. A diffusing material or colorant may be mixed into the diffusion cover 21a as appropriate.

[0024] The photographing unit 30a has a light-shielding cover 31a and a camera, which will be described later, and is arranged adjacent to the illumination unit 20a on the negative side of the X axis.

[0025] The main body 40a holds the lighting unit 20a and the photographing unit 30a, and also serves as a mounting member for mounting the camera-equipped lighting device 10a on a ceiling or other predetermined position.

[0026] The light-shielding cover 31a is disposed on the positive side of the main body 40a in the Z-axis direction so as to cover the camera between the main body 40a and the cover 31a. The light-shielding cover 31a also has a through-hole disposed in a position facing the camera lens. By disposing the light-shielding cover 31a in this manner, it is possible to prevent light emitted from the diffusion cover 21a of the illumination unit 20a from entering the camera lens.

[0027] In the above description, the camera-equipped lighting device 10a has been described as having an elongated lighting unit 20a, but this is not limited to this example. For example, the camera-equipped lighting device 10a may be a disk-shaped ceiling light or may be annular.

[0028] Next, the functional configuration of the camera-equipped lighting device 10a will be described. Fig. 2 is a block diagram showing a schematic example of the configuration of the camera-equipped lighting device 10a included in the lighting system according to the embodiment.

[0029] 2, the camera-equipped lighting device 10a includes a connection unit 50, a main body unit 40a, a lighting unit 20a, and an image capturing unit 30a. The connection unit 50 is a terminal block on which terminals for connecting various cables that operate the camera-equipped lighting device 10a are arranged.

[0030] The main body 40a has a power supply unit 41 and a control microcomputer 42. The power supply unit 41 has a power supply circuit that converts AC power supplied from an AC power supply 60 via a connection unit 50 into DC power and outputs the DC power. The AC power supply 60 is, for example, a commercial power supply.

[0031] Furthermore, the power supply unit 41 supplies direct current at a predetermined voltage (for example, 50 V) to the illumination unit 20a and controls the lighting of the light emitting element 22, which will be described later. The power supply unit 41 is an example of a lighting control unit. Furthermore, the power supply unit 41 converts the direct current into a predetermined voltage (for example, 5 V) and supplies the power to the imaging unit 30a.

[0032] The control microcomputer 42 is a processing unit that generates control signals that are preset in a memory (not shown) and outputs them to the power supply unit 41, the lighting control unit, and the photography control unit (described later).

[0033] The illumination unit 20a has a plurality of light-emitting elements 22. The light-emitting elements 22 are each connected to a wiring pattern on the chassis, and are supplied with DC output from a power supply unit 41, and their lighting is controlled by a lighting control unit. The light-emitting elements 22 include an LED (Light Emitting Diode) chip disposed in a body made of, for example, ceramic, and a light-transmitting molding resin such as epoxy resin or silicone resin that seals the LED chip.

[0034] The LED chip is, for example, a blue LED chip that emits blue light. A phosphor is mixed into the translucent resin, and a yellow phosphor that emits yellow light, which is complementary to blue light, is used to enable the emission of white light. The LED chip may also emit, for example, red light, green light, or white light. The translucent resin may also be a diffusion material that has a milky white color and diffuses light.

[0035] Furthermore, the LED may be mounted by mounting an LED chip directly on the chassis or substrate of the lighting unit 20a, or by mounting a bullet-shaped LED, and the mounting method and format are not particularly limited.

[0036] The photographing unit 30a has a photographing control unit 32 and a camera 33. The photographing control unit 32 controls photographing by the camera 33. The camera 33 has an image sensor that electronically acquires an image, such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and a lens, and photographs an image at a predetermined angle of view according to the image sensor, lens, etc. shadow The photographing unit 30a photographs the object with the camera 33. shadow The image processing device may have a storage unit (not shown) for recording the captured image.

[0037] Fig. 3 is a schematic diagram showing an example of the appearance of another camera-equipped lighting device 10b included in the lighting system according to the embodiment. The camera-equipped lighting device 10b shown in Fig. 3 has a shape similar to that of the lighting unit 20a of the camera-equipped lighting device 10a shown in Fig. 1, but shortened in the longitudinal direction of the camera-equipped lighting device 10a. The lighting unit 20b includes a diffusion cover 21b, a photographing unit 30b includes a light-shielding cover 31b, and a main body 40b. The functions and configurations of the lighting unit 20b, diffusion cover 21b, photographing unit 30b, light-shielding cover 31b, and main body 40b of the camera-equipped lighting device 10b are the same as those of the lighting unit 20a, diffusion cover 21a, photographing unit 30a, light-shielding cover 31a, and main body 40a of the camera-equipped lighting device 10a described with reference to Fig. 1, and therefore will not be described in detail here.

[0038] The camera-equipped lighting device 10b is installed on a wall, shelf, desk, etc., with the main body 40b attached by a mounting member such as an arm member so that light output from the lighting unit 20b is directed toward the worker's hands, which is an example of an illumination target. The camera-equipped lighting device 10b is primarily used indoors for purposes such as monitoring the work of workers in a factory or the status of employees in an office. The shape of the camera-equipped lighting device 10b is not limited to the shape shown in FIG. 3. For example, the camera-equipped lighting device 10b may be disk-shaped or annular.

[0039] (Lighting system according to an embodiment) Next, a lighting system according to an embodiment will be described with reference to FIGS. 4A and 4B. 4A is a diagram showing an overview of a lighting system according to an embodiment. Note that the following description will be given taking as an example a case where the lighting system 1a is installed in a factory.

[0040] A lighting system 1a according to the embodiment shown in Fig. 4A is an example configured as an on-premise system that is completed within a factory or an organization that operates a factory. As shown in Fig. 4A, the lighting system 1a according to the embodiment includes a plurality of camera-equipped lighting devices 10a and 10b (both of which are referred to as lighting devices in Fig. 4A) and a management device 100. The example shown in Fig. 4A illustrates a case where each of the camera-equipped lighting devices 10a and 10b is installed at a work site (e.g., a production line) in a factory.

[0041] The management device 100 is a device that manages the camera-equipped lighting devices 10a and 10b installed at the work site. For example, the management device 100 manages the lighting modes of the lighting units 20a and 20b of the camera-equipped lighting devices 10a and 10b, and the photographing modes of the photographing units 30a and 30b. shadow The direction, magnification, etc. are controlled remotely via network 65.

[0042] Furthermore, the management device 100 collects and stores images or videos captured by the respective imaging units 30a and 30b. For example, the images or videos collected by the management device 100 are used for monitoring the work site.

[0043] As described above, the photographic data captured by each of the photographing units 30a and 30b is accumulated in the management device 100. However, in the past, the accumulated photographic data was merely stored in the management device and displayed to the manager, and no consideration was given to its application to improving productivity.

[0044] Therefore, the management device 100 according to the embodiment detects an abnormality at the shooting site from the first shooting data acquired by the camera-equipped lighting device 10a, and associates the location of the first shooting data where the abnormality was detected with the location of the second shooting data corresponding to that location. This allows the management device 100 according to the embodiment to be applied to improving productivity.

[0045] In the following, a case will be described in which the shooting location where the camera-equipped lighting devices 10a and 10b take photos is a workplace. An abnormality in a workplace refers to a predetermined state other than the state that the workplace should be in. For example, an abnormality in a workplace occurs when the number of workers assigned to the workplace is different from the predetermined number, or when a predetermined amount of products or parts are not in a predetermined position in the workplace. That is, the management device 100 according to the embodiment detects, for example, the number of people assigned to the workplace or the amount of goods in a predetermined position, and compares the detection results with a specified value to detect whether or not there is an abnormality.

[0046] 4A has been described as an example in which the lighting system 1a according to the embodiment is configured as an on-premise system in a factory, etc. The lighting system according to the embodiment is not limited to this, and the lighting system according to the embodiment can be configured to communicate between a work site and the management device 100 via an external network such as the Internet.

[0047] FIG. 4B is a diagram illustrating an overview of a lighting system according to another example of the embodiment. In FIG. 4B, lighting system 1b includes camera-equipped lighting devices 10a and 10b (both of which are referred to as lighting devices in FIG. 4B) installed at work sites in a factory, and connected to server 200 via an external network 66 such as the Internet. Server 200 includes the functions of management device 100 shown in FIG. 4A. Network 66 and server 200 may be a cloud network and a cloud server, respectively. In the example of FIG. 4B, a monitor device 201 installed in a factory, for example, is connected to server 200 via network 66.

[0048] In the above description, the server 200 is described as including all the functions of the management device 100, but this is not limited to this example. For example, the management device 100 can be installed in a factory or an organization that operates a factory, and some of the functions of the management device 100 (such as a learning function) can be provided to the server 200.

[0049] (Installation of a camera-equipped lighting device applicable to the embodiment) Figures 5A and 5B are schematic diagrams showing installation examples of camera-equipped lighting devices 10a and 10b that can be applied to the embodiments. In the examples of Figures 5A and 5B, the work site is a unit configured such that a predetermined number of people 80 (four in this example) (hereinafter referred to as workers 80) are lined up at work tables 72. Figure 5A is a schematic diagram of the work site viewed from the lined-up direction of the workers 80, and Figure 5B is a schematic diagram of the work site viewed from a direction parallel to the lined-up direction of the workers 80.

[0050] The camera-equipped lighting device 10a is attached to the ceiling 70 by the main body 40a so as to irradiate light in the direction of the floor surface 71. In the example of FIG. 5B, the camera-equipped lighting device 10a is installed so that the lighting unit 20a is parallel to the workbench 72 and so that all of the multiple workers 80 (four in this example) who are to be photographed by the photographing unit 30a are included in the photographing range. The height H (first height) and position at which the camera-equipped lighting device 10a is installed are determined by, for example, the length W in the alignment direction in which all of the predetermined number of workers 80 (four in this example) who are to be photographed are lined up, and the photographing range of the camera-equipped lighting device 10a. shadow The angle of view α of the camera 33 included in the unit 30a in the alignment direction and the height h of the head of the worker 80 are assumed to be determined based on the angle of view α.

[0051] 5A and 5B, it is assumed that each worker 80 performs work while standing on the floor surface 71. Therefore, the workbench 72 is provided at a height that allows the standing worker 80 to easily work with the table at hand. However, it is also possible for each worker to perform work while sitting on a chair or the like, and the workbench 72 to be provided at a corresponding height.

[0052] A camera-equipped lighting device 10b is installed for each worker 80. The camera-equipped lighting device 10b is attached to a wall, shelf, workbench 72, etc. by an attachment member 74 such as an arm member. In the example of FIG. 5B , the camera-equipped lighting device 10b is attached to the wall surface in front of the workbench 72 by the attachment member 74.

[0053] The camera-equipped lighting device 10b is installed at a height (second height) lower than the height at which the camera-equipped lighting device 10a is installed, for example, at a height and position that illuminates the hands of each worker 80. By installing it in this manner, the image capturing unit 30a of the camera-equipped lighting device 10b can capture in more detail the hands of the worker 80 corresponding to the camera-equipped lighting device 10b.

[0054] 5B, the camera-equipped lighting device 10b is provided in a one-to-one relationship with the worker 80, but this is not limited to this example. One camera-equipped lighting device 10b may be provided for a plurality of workers 80, for example, two or three workers 80. In this case, the position where each worker 80 is positioned is associated with the image captured by the second capture data captured by the capture unit 30b of the camera-equipped lighting device 10b.

[0055] (Details of the management device according to the embodiment) Next, the management device 100 according to the embodiment will be described in more detail. Here, the management device 100 described using Fig. 4A will be described. The server 200 described using Fig. 4B includes the same functions as the management device 100 shown in Fig. 4A, which will be described below.

[0056] 6 is a functional block diagram illustrating an example of functions of the management device 100 according to the embodiment. As shown in FIG. 6, the management device 100 according to the embodiment includes a communication unit 2, a storage unit 3, and a control unit 4. The communication unit 2 is a communication module that performs data communication with the camera-equipped lighting devices 10a and 10b via a network 65.

[0057] The storage unit 3 is, for example, a semiconductor memory element such as a flash memory, or a storage device capable of non-volatilely storing data such as an HDD (Hard Disk Drive), an optical disk, etc. In the example shown in Fig. 6, the storage unit 3 has an imaging data database 3a, a specific information database 3b, and an operation data database 3c.

[0058] The photography data database 3a is a database that stores photography data captured by each of the camera-equipped lighting devices 10a and 10b.

[0059] The specific information database 3b is a database that stores specific information for detecting abnormalities in the workplace. Examples of the specific information include the number of people assigned to a predetermined area in the workplace, data indicating the state of predetermined locations in the workplace where products, parts, etc. are stored, data indicating the shapes of these products, parts, etc., and data indicating the actions related to the work of each worker 80. At least a portion of the specific information may be generated, for example, by a learning unit 4f, which will be described later.

[0060] The work data database 3c is a database that stores information about the work efficiency of each production line. For example, the information about the work efficiency is generated by a measurement unit 4e, which will be described later.

[0061] Next, a description will be given of the control unit 4. The control unit 4 is, for example, a CPU (Central Processing Unit). It includes a microcomputer and various circuits that have a memory unit (RAM), ROM (Read Only Memory), RAM (Random Access Memory), input / output ports, etc.

[0062] 6, the control unit 4 includes an acquisition unit 4a, a detection unit 4b, a tagging unit 4c, a playback unit 4d, a measurement unit 4e, a learning unit 4f, and a notification unit 4g. The functions of the acquisition unit 4a, the detection unit 4b, the tagging unit 4c, the playback unit 4d, the measurement unit 4e, the learning unit 4f, and the notification unit 4g are realized, for example, by the CPU of the control unit 4 reading and executing a program stored in the RAM or ROM of the control unit 4 or the storage unit 3.

[0063] In addition, the acquisition unit 4a, detection unit 4b, tagging unit 4c, reproduction unit 4d, measurement unit 4e, learning unit 4f and notification unit 4g may each be partially or entirely configured using hardware such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

[0064] The acquisition unit 4a acquires first photographic data of the work site photographed by the photographing unit 30a included in the camera-equipped lighting device 10a, and second photographic data of the work site photographed by the photographing unit 30b included in the camera-equipped lighting device 10b. For example, the acquisition unit 4a acquires the first and second photographic data from the photographing units 30a and 30b in real time, and stores the acquired first and second photographic data in the photographic data database 3a each time it is acquired.

[0065] At this time, for example, first photographed data photographed by one camera-equipped lighting device 10a and second photographed data photographed by each camera-equipped lighting device 10b corresponding to a predetermined number of workers 80 included in the photographing range of that camera-equipped lighting device 10a can be associated and stored in the photographed data database 3a. In this way, by associating the first photographed data with the second photographed data related to the first photographed data and storing them in the photographed data database 3a, it becomes easy to review and verify the work content, which can lead to improved work efficiency.

[0066] If there are multiple production lines, the first image data and the second image data are associated with each other for each production line and stored in the photographing data database 3a in sequence.

[0067] The detection unit 4b detects the state of the workplace (photography site) based on the first and second photography data and the identification information acquired by the acquisition unit 4a. Here, the state of the workplace includes an abnormality in the workplace. Here, as described above, "an abnormality in the workplace" may refer to a predetermined state other than the state that the workplace should be in, such as the number of workers assigned to the workplace being different from the predetermined number, or the absence of a predetermined amount of products or parts in a predetermined position in the workplace.

[0068] For example, the detection unit 4b performs image analysis on the first photographed data captured by the photographing unit 30a of the camera-equipped lighting device 10a and acquired by the acquisition unit 4a, and can recognize people included in the photographed range of the first photographed data. The detection unit 4b detects an abnormality, for example, when the number of recognized people is other than a predetermined number.

[0069] Furthermore, for example, the detection unit 4b can recognize an object at a predetermined position within the image capture range of the first image capture data by image analysis of the first image capture data. The detection unit 4b can recognize people and objects using a model learned by the learning unit 4f. Alternatively, the detection unit 4b may recognize people and objects using pattern matching or the like for the first image capture data. The detection unit 4b detects an abnormality, for example, when the amount of recognized objects differs from a predetermined amount or an expected amount.

[0070] Furthermore, the detection unit 4b performs image analysis on the second photographed data captured by the photographing unit 30b of the camera-equipped lighting device 10b acquired by the acquisition unit 4a, recognizes people included in the photographed range of the second photographed data, and can recognize the movements of the recognized people. Based on the recognized movements, the detection unit 4b can detect whether the movements are normal or not.

[0071] When the detection unit 4b detects an abnormality based on the first photographed data, the tagging unit 4c tags the location of the first photographed data where the abnormality was detected (the abnormality detection location) with abnormality information related to the abnormality. For example, the abnormality information is a flag, and the flag of a frame in which the abnormality was detected in the first photographed data can be set to "1" and the flag of a frame in which no abnormality was detected can be set to "0."

[0072] Furthermore, when the detection unit 4b detects an abnormality based on the first photographed data, the tagging unit 4c can tag a location in the second photographed data that corresponds to the location in the first photographed data where the abnormality was detected. This allows the first photographed data and the second photographed data to be associated based on the abnormality information, making it easy to check the content of the second video data that corresponds to the abnormality detected in the first photographed data, and enabling efficient review and verification of work.

[0073] The playback unit 4d can cut out and play back the first photographed data tagged with abnormality information by the tagging unit 4c. That is, the playback unit 4d extracts the first photographed data tagged with abnormality information from the photographed data database 3a and plays back the data. Similarly, the playback unit 4d can cut out and play back the second photographed data tagged by the tagging unit 4c at a location corresponding to the abnormality detection location in the first photographed data.

[0074] The playback unit 4d then plays back the first and second photographed data while displaying the photographed time. This allows only the portion of the first photographed data that indicates an abnormality to be played back, making it possible to easily grasp the abnormality. Furthermore, for the second photographed data, it allows only the portion corresponding to the abnormality detected based on the first photographed data to be played back, making it possible to grasp the abnormality in more detail.

[0075] In this case, it is preferable to play back a predetermined period (for example, one minute before and after) based on the time when the abnormality was detected.

[0076] The measurement unit 4e performs various measurements based on the first imaging data or the second imaging data.

[0077] The measurement unit 4e can measure the work efficiency per unit time of each worker 80, for example, from the second photographed data. More specifically, the measurement unit 4e can measure the takt time (action interval) of the work performed by each worker 80, based on the actions of each worker 80 corresponding to each piece of second photographed data, which are recognized by the detection unit 4b based on each piece of second photographed data. The measurement unit 4e can also measure, from the first photographed data, the time interval between the movements of each of a predetermined number of workers 80 included in the photographed range of the first photographed data. These measurement results can be used, for example, to facilitate the work manager's consideration of reassigning each worker 80.

[0078] The learning unit 4f can, for example, learn the above-mentioned work movements of the worker 80 from past second photographed data for the worker 80 corresponding to the second photographed data, and generate and update a model. For example, the learning unit 4f generates a model by machine learning using normal work movements of the worker 80 as training data. The learning unit 4f generates such a model for each worker 80. The detection unit 4b can detect abnormalities in the movements of each worker 80 based on this model.

[0079] Furthermore, for example, the learning unit 4f can learn from past first photography data about items such as products and parts at predetermined positions included in the photography range of the first photography data, as well as the speed at which the items increase or decrease, and generate and update a model. The detection unit 4b can detect abnormalities related to products and items based on this model.

[0080] In the configuration shown in FIG. 4A, the learning unit 4f may be provided in a device (for example, a cloud network) separate from the management device 100.

[0081] When an abnormality is detected by the detection unit 4b, the notification unit 4g notifies the worker or the work manager. That is, the management device 100 immediately notifies the occurrence of the abnormality. For example, the notification unit 4g can notify the worker 80 corresponding to the camera-equipped lighting device 10b of the abnormality by changing the lighting mode of the lighting unit 20b in the camera-equipped lighting device 10b corresponding to the detected abnormality.

[0082] Here, the lighting mode includes, for example, the frequency at which the lighting is driven and the illuminance of the lighting. Furthermore, the lighting mode can be changed by turning the lighting on and off, changing the color temperature, etc. In this case, if work is stopped due to a change in the lighting mode, it will result in a decrease in work efficiency, so it is preferable to change the lighting mode within a range that does not interfere with work.

[0083] Without being limited to this, the notification unit 4g may notify the worker 80 of the abnormality by sound output from a speaker in the workplace, a patrol lamp, etc. Furthermore, the notification unit 4g may change the lighting mode of the lighting unit 20a in the camera-equipped lighting device 10a corresponding to the detected abnormality.

[0084] (Specific example of abnormality detection according to the embodiment) Next, abnormality detection according to the embodiment will be described in more detail.

[0085] First example First, as a first specific example, an example of abnormality detection using first image data captured by the image capture unit 30a of the camera-equipped lighting device 10a will be described. In the first specific example, the management device 100 recognizes people (workers 80) included in a predetermined area within the image capture range of the image capture unit 30a from the first image data and counts the number of recognized people. The management device 100 outputs a notification when the counted number of people is other than the predetermined number.

[0086] 7A and 7B are diagrams showing images captured using the first imaging data. In Fig. 7A and Fig. 7B, it is assumed that the normal state of the predetermined area 75 closest to the workbench 72 is one in which four workers 80 are included. That is, in this case, the predetermined number of people in the predetermined area 75 is four.

[0087] In the management device 100, the detection unit 4b recognizes each of the workers 801-804 included in the predetermined area 75 from the first photographic data acquired by the acquisition unit 4a from the photographing unit 30a of the camera-equipped lighting device 10a, and counts the number of recognized workers. In the example of Fig. 7A, four workers 801-804 are recognized in the predetermined area 75, and therefore the detection unit 4b determines that there is no abnormality.

[0088] In contrast, in the example of FIG. 7B, the predetermined area 75 includes worker 805 in addition to the above-mentioned workers 801 to 804, and the detection unit 4b recognizes five workers 801 to 805 in the predetermined area. In this case, since the predetermined area 75 includes workers 801 to 805, which is more than the predetermined number of four, the detection unit 4b detects an abnormality. For example, in the example of FIG. 7B, a problem may have occurred in the work of worker 804, and worker 805 may have been called in to deal with the problem. In response to the detection of an abnormality by the detection unit 4b, the notification unit 4g notifies, for example, the work manager.

[0089] In this way, by detecting abnormalities at the shooting site based on the first shooting data captured by the shooting unit 30a of the camera-equipped lighting device 10a, it is possible to respond quickly and appropriately to problems, etc., and improve productivity.

[0090] Fig. 8 is a flowchart illustrating an example of an abnormality detection process using the first photographic data according to the embodiment. In Fig. 8, the camera-equipped lighting device 10a is shown as a "high-altitude camera." The process according to the flowchart in Fig. 8 is repeatedly executed at a predetermined cycle (for example, the frame cycle of the first photographic data).

[0091] In step S100, the management device 100 acquires first photographic data captured by the photographing unit 30a of the high-altitude camera (camera-equipped lighting device 10a) using the acquisition unit 4a. In the next step S101, the management device 100 performs image analysis on the first photographic data acquired by the acquisition unit 4a in step S100 using the detection unit 4b, and recognizes people included in the image captured by the first photographic data. In the next step S102, the management device 100 acquires first photographic data captured by the photographing unit 30a of the high-altitude camera (camera-equipped lighting device 10a) using the detection unit 4b. shadow The number of people recognized within the detection area (predetermined region 75) in the image is measured.

[0092] In the next step S103, the management device 100 determines whether the number of people measured in step S102 is a predetermined number of people using the detection unit 4b. If the management device 100 determines that the measured number of people is the predetermined number of people (step S103, "Yes"), it ends the series of processes according to the flowchart in FIG.

[0093] On the other hand, if the management device 100 determines that the measured number of people is not the specified number (more than the specified number of people or less than the specified number of people) (step S103, "No"), it transitions the processing to step S104 and outputs a notification via the notification unit 4g.

[0094] Second example Next, a second specific example of abnormality detection according to the embodiment will be described. The second specific example is an example in which the camera-equipped lighting device 10a and the camera-equipped lighting device 10b are linked together.

[0095] 9A is a schematic diagram showing an example of a captured image 300 based on first captured data captured by the image capturing unit 30a of the camera-equipped lighting device 10a. As shown in FIG. 9A, the captured image 300 includes a plurality of workers 80. 10 , 80 11 and 80 12 In the captured image 300, the shelf 76 is, for example, a view of each worker 80 working on the work table 72. 10 ~80 12It is provided for placing products produced by the above work or parts used in production.

[0096] 9B is a schematic diagram showing an example of a captured image 301 based on second captured data captured by the image capturing unit 30b of the camera-equipped lighting device 10b. In the example of FIG. 9B, the image capturing unit 30b captures, for example, the images of each worker 80 shown in FIG. 10 ~80 12 80 workers on the left side 10 The subject of the shoot is:

[0097] In a second specific example, when the detection unit 4b detects an abnormality based on the first photographed data, the management device 100 causes the tagging unit 4c to tag the location (frame or time) in the first photographed data where the abnormality was detected. At the same time, the tagging unit 4c tags the location (frame or time) in the second photographed data that corresponds to the location in the first photographed data where the abnormality was detected.

[0098] At this time, the tagging unit 4c tags the location of the second photographed data captured by the photographing unit 30b of the camera-equipped lighting device 10b that corresponds to the position where the abnormality was detected in the photographed image 300 based on the first photographed data. However, the tagging unit 4c may tag the location of each piece of second photographed data captured by the photographing units 30b of all camera-equipped lighting devices 10b related to the photographed image 300.

[0099] Not limited to this, when an abnormality is detected based on the second photographed data, the management device 100 can tag the location in the second photographed data where the abnormality was detected, and can also tag the location in the first photographed data that corresponds to the location in the second photographed data where the abnormality was detected.

[0100] In this way, by tagging and associating the locations (frames or times) where abnormalities were detected in the first and second shooting data, it becomes easier to review and verify the work content, which can lead to improved work efficiency.

[0101] Fig. 10 is a flowchart illustrating an example of an abnormality detection process using the first photographed data and the second photographed data according to an embodiment. In Fig. 10, the camera-equipped lighting device 10a is shown as the "high camera," and the camera-equipped lighting device 10b is shown as the "low camera." The process according to the flowchart in Fig. 10 is repeatedly executed at a predetermined cycle (for example, the frame cycle of the first photographed data).

[0102] In step S120, the management device 100 acquires, via the acquisition unit 4a, first image data captured by the image capture unit 30a of the high-altitude camera (camera-equipped lighting device 10a) and second image data captured by the image capture unit 30b of the low-altitude camera (camera-equipped lighting device 10b). In the next step S121, the management device 100 performs, via the detection unit 4b, image analysis on the first image data acquired by the acquisition unit 4a in step S120. In the next step S122, the management device 100 detects, via the detection unit 4b, the presence or absence of an abnormality based on the first image data.

[0103] In the next step S123, the management device 100 determines whether the detection unit 4b detected an abnormality in step S122. If the management device 100 determines that an abnormality was not detected (step S123, "No"), it ends the series of processes according to the flowchart in FIG.

[0104] On the other hand, if the management device 100 determines that an abnormality has been detected (step S123, "Yes"), the processing proceeds to step S124. In step S124, the management device 100 causes the tagging unit 4c to tag the portion (frame or time) of the second photographed data acquired in step S120 that corresponds to the portion where the abnormality in the first photographed data was detected. This enables the management device 100 to associate the abnormality detected based on the first photographed data with the second photographed data, and enables the camera-equipped lighting device 10a and the camera-equipped lighting device 10b to cooperate with each other.

[0105] A more specific example will be used for explanation. Referring to the above-mentioned FIGS. 7A and 7B, it is assumed that the management device 100 detects, by the detection unit 4b, that the predetermined area 75 contains five workers 801-805, which is more than the predetermined number (four in this example), and that an abnormality has been detected based on the first photographed data (step S123 of FIG. 10, "Yes"). In this case, the management device 100 causes the tagging unit 4c to tag a portion of the second photographed data that corresponds to the portion of the first photographed data where the abnormality was detected. As a result, the abnormality detected based on the first photographed data is associated with the second photographed data.

[0106] For example, the work manager can easily verify the cause of the abnormality by checking the images captured within a predetermined time range that include the tagged portion of the second captured data.

[0107] As another example, the management device 100 detects, based on the first photographed data, that the predetermined area 75 contains fewer than the predetermined number of workers (four in this example), for example, three workers 801-803, and detects an abnormality (step S123, FIG. 10 , “Yes”). That is, in this case, it indicates that the worker 804 who should be in the predetermined area 75 is not present in the predetermined area 75. The management device 100 uses the tagging unit 4c to tag the location in the second photographed data captured by the photographing unit 30b of the camera-equipped lighting device 10b corresponding to the worker 804, where the abnormality was detected in the first photographed data. By playing back the second photographed data with the tagged location in the second photographed data as the center, it is possible to verify the reason why the worker 804 is not where he or she should be (for example, a supply of parts necessary for the work has been interrupted).

[0108] 10, instead of or in addition to the process of step S124, an abnormality detected based on the first photographed data can be notified using the camera-equipped lighting device 10b corresponding to the abnormality. This notification can be performed, for example, by changing the lighting mode of the lighting unit 20b of the camera-equipped lighting device 10b.

[0109] As an example, referring to FIGS. 9A and 9B, a worker 80 12 Consider a case where a predetermined amount of products is to be placed on the shelf unit 76 at a predetermined time (predetermined time period). In this case, if the predetermined amount of products is not recognized on the shelf unit 76 based on the first photographed data photographed by the photographing unit 30a of the camera-equipped lighting device 10a, the detection unit 4b considers that an abnormality has been detected (step S123 in FIG. 10, "Yes"). Then, the management device 100 notifies the worker 80 by the notification unit 4g. 12 The lighting unit 20b of the camera-equipped lighting device 10b corresponding to the worker 80 changes the lighting mode (for example, blinks). This allows the camera-equipped lighting device 10a and the camera-equipped lighting device 10b to cooperate with each other. 12 The worker can then realize that he or she has forgotten to place the product on the shelf 76, thereby improving productivity.

[0110] As another example, referring to FIGS. 9A and 9B, when the inventory amount of parts on the shelf unit 76 falls below a predetermined amount or becomes excessive, the lighting mode of the lighting unit 20b of the camera-equipped lighting device 10b is changed to notify each worker 80 10 ~80 12 may be notified of this.

[0111] For example, the management device 100 uses the detection unit 4b to recognize parts stocked on the shelf unit 76 based on first photographed data captured by the photographing unit 30a of the camera-equipped lighting device 10a. The management device 100 uses the measurement unit 4e to measure the rate of increase or decrease of the recognized parts, and calculates the predicted time for the inventory amount to become zero or to exceed the storage capacity of the shelf unit 76 based on the measured rate of increase or decrease and the current inventory amount of parts on the shelf unit 76. If the calculated time is equal to or shorter than a predetermined time, the management device 100 considers that an abnormality has been detected (step S123 in FIG. 10, "Yes"). Then, the management device 100 uses the notification unit 4g to notify, for example, each worker 80 10 ~80 12The lighting state of the lighting unit 20b of each of the camera-equipped lighting devices 10a and 10b corresponding to each worker 80 is changed (for example, blinked). This allows the camera-equipped lighting device 10a and the camera-equipped lighting device 10b to cooperate with each other. 10 ~80 12 For example, a request for replenishing parts or a request for stopping replenishing can be issued appropriately, thereby improving productivity.

[0112] In this example, the lighting mode of the lighting unit 20b of the camera-equipped lighting device 10b is changed in response to the detection of an abnormality, but this is not limited to this example. That is, the management device 100 changes the lighting mode of the lighting unit 20a of the camera-equipped lighting device 10a using the notification unit 4g, thereby linking the first photographed data and the second photographed data, and notifying each worker 80 of the detected abnormality. 10 ~80 12 Notification may be given to

[0113] In the above description, a notification is given in response to an abnormality detected based on the first photographed data captured by the photographing unit 30a of the camera-equipped lighting device 10a, but this is not limited to this example. For example, the lighting system 1a according to the embodiment may be configured to give a notification when an abnormality is detected based on at least one of the first photographed data and the second photographed data captured by the photographing unit 30b of the camera-equipped lighting device 10b.

[0114] Another example Next, another specific example of abnormality detection applicable to the embodiments will be described. In the first specific example described above, an example of abnormality detection is performed based on first image data captured by the image capturing unit 30a of the camera-equipped lighting device 10a installed at a first height. In the second specific example, an example of abnormality detection and notification is performed by coordinating the camera-equipped lighting device 10a with the camera-equipped lighting device 10b installed at a second height lower than the first height.

[0115] In this embodiment, the present invention is not limited to this, and it is also possible for the camera-equipped lighting device 10a and the camera-equipped lighting device 10b to perform abnormality detection independently.

[0116] For example, referring to FIGS. 7A and 7B, the management device 100 measures the number of people in a predetermined area 75 and the distances between each of the workers 801-804 based on first image data captured by the image capture unit 30a of the camera-equipped lighting device 10a. The management device 100 detects an abnormality using the detection unit 4b, for example, when the measured distance is shorter than a predetermined distance. At the same time, the management device 100 detects abnormalities and measures takt time for the movements of each of the workers 801-804 based on second image data captured by the image capture unit 30b of the camera-equipped lighting device 10b. When an abnormality is detected, the management device 100 may notify the work manager or may change the lighting mode of the lighting unit 20a of the camera-equipped lighting device 10a or the lighting unit 20b of the camera-equipped lighting device 10b.

[0117] In the above-described embodiment, the lighting system 1a or 1b is installed in a factory, but the present invention is not limited to this. In other words, the lighting system 1a or 1b may be installed in other places such as an office or a hospital.

[0118] Although an embodiment of the present invention has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. This embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its modifications are included within the scope and spirit of the invention, as well as the invention described in the claims and their equivalents. [Explanation of symbols]

[0119] 1a, 1b Lighting system 4 Control unit 4a Acquisition unit 4b Detection unit 4c Tagging unit 4d Playback unit 4e Measurement unit 4f Learning unit 4g Notification unit 10a, 10b Camera-equipped lighting device 20a, 20b Lighting unit 30a, 30b Photography unit 40a, 40b Main body unit 70 Ceiling 71 Floor surface 72 Work table 75 Predetermined area 76 Shelf unit 80, 801, 802, 803, 804, 805, 80 10 ,80 11 ,80 12 100 Management device

Claims

1. a first camera-equipped lighting device including a first lighting unit and a first photographing unit, the first lighting unit being installed at a first height that includes all people located in a predetermined area in a photographing range photographed by the first photographing unit; a second lighting device with a camera, the second lighting device having a second lighting unit and a second photographing unit, and installed at a second height that is a height relative to an assumed hand of the person and that is different from the first height; a detection unit that detects a state in a photographing range photographed by at least one of the first photographing unit and the second photographing unit, and detects the number of people included in a predetermined area in the photographing range photographed by the first photographing unit; a control unit that performs predetermined control by coordinating the first camera-equipped lighting device and the second camera-equipped lighting device in accordance with the state detected by the detection unit; a management device comprising: A lighting system including:

2. a first camera-equipped lighting device including a first lighting unit and a first photographing unit, the first lighting unit being installed at a first height that includes all people located in a predetermined area in a photographing range photographed by the first photographing unit; a second camera-equipped lighting device having a second lighting unit and a second photographing unit and installed at a second height different from the first height; a detection unit that detects a state in a photographing range photographed by at least one of the first photographing unit and the second photographing unit, and detects the number of people included in a predetermined area in the photographing range photographed by the first photographing unit; a control unit that performs predetermined control by coordinating the first lighting device with a camera and the second lighting device with a camera in accordance with the state detected by the detection unit, and that changes the lighting mode of the second lighting unit when the detection unit detects an abnormality in a predetermined area within the shooting range photographed by the first photographing unit; a management device comprising: A lighting system including:

3. a first camera-equipped lighting device including a first lighting unit and a first photographing unit, the first lighting unit being installed at a first height that includes all people located in a predetermined area in a photographing range photographed by the first photographing unit; a second camera-equipped lighting device having a second lighting unit and a second photographing unit and installed at a second height different from the first height; a detection unit that detects a state in a photographing range photographed by at least one of the first photographing unit and the second photographing unit, and detects the number of people included in a predetermined area in the photographing range photographed by the first photographing unit; a control unit that performs predetermined control by coordinating the first lighting device with a camera and the second lighting device with a camera in accordance with the state detected by the detection unit, and that measures a movement interval of the subject based on the state of the subject included in the shooting range detected by the detection unit; a management device comprising: A lighting system including:

4. The control unit 2. The lighting system according to claim 1, wherein, when the detection unit detects an abnormality in the state, the first photographing data captured by the first photographing unit and the second photographing data captured by the second photographing unit are associated with each other based on the time at which the abnormality was detected.

5. The control unit changing the illumination mode of the second illumination unit corresponding to the detected abnormality; 3. The lighting system of claim 2.

6. The detection unit Detecting an abnormality when the distance between people included in the predetermined area is less than a predetermined value, The control unit outputting a notification when an abnormality is detected based on the distance between the people; 6. A lighting system according to claim 2 or 5.

7. The control unit outputting a notification when the detection unit detects an abnormality in the state; 3. The lighting system according to claim 1 or claim 2.

Images