Projection device, projection method and memory
By introducing a determination and projection control unit for identification marks into the projection device, the projection position and size are dynamically adjusted, and the problem of high projection image processing load in the prior art is solved, and a projection effect that is easier to observe is achieved.
Patent Information
- Application Number
- CN202210246213.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2022-02-21
- Filing Date
- 2022-03-14
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2042-03-14
AI Technical Summary
When the existing projection device projects images on the shelves, the detected cargo is regarded as an obstacle, resulting in increased processing load and the projection position and size cannot be effectively adjusted to ensure the ease of view of the image.
A projection device is designed, including a projector, a photographing machine, a determination unit and a projection control unit. By determining and adjusting the identification mark, the projection position or size is changed if the conditions are met to ensure the normal display of the image.
It reduces the load in projected image processing, improves the ease of observation of the image, and adapts to changes in different environments and obstacles by dynamically adjusting the projection position and size.
Smart Images

Figure CN115118942B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a projection device, a projection method and a memory. Background Art
[0002] Patent Document 1 discloses a projection device. In the projection device disclosed in Patent Document 1, obstacles existing on a projection surface are detected to determine a free area, and the device projects an image onto the determined free area.
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2017-163532 Summary of the invention
[0006] Problem that the invention aims to solve
[0007] In the projection device described in Patent Document 1, when projecting an image onto a commodity shelf, the goods placed on the shelf are detected as obstacles. This process is performed to project the image in an easy-to-view manner. However, the objects detected as obstacles include various objects, so the projection device described in Patent Document 1 has a problem that the load for this process becomes high.
[0008] The present disclosure is completed to solve the above-mentioned problems. The purpose of the present disclosure is to provide a projection device and a projection method that can reduce the load required in the process of projecting images in an easy-to-observe manner. In addition, another purpose of the present disclosure is to provide a memory that stores a program for realizing such a function in a projection device.
[0009] Means used to solve problems
[0010] The projection device disclosed in the present invention comprises: a projector for projecting an image including an identification mark; a camera for photographing the image projected from the projector; a determination unit for determining whether the identification mark is normally displayed in the image photographed by the camera; and a projection control unit for changing the position of the image projected from the projector if a specific first condition is satisfied, and changing the size of the image projected from the projector if a specific second condition is satisfied, when the determination unit determines that the identification mark is not normally displayed.
[0011] The projection device disclosed in the present invention comprises: a projector for projecting an image including an identification mark; a camera for photographing the image projected from the projector; a determination unit for determining whether the identification mark is normally displayed in the image photographed by the camera; and a projection control unit for changing the position of the image projected from the projector when the determination unit determines that the identification mark is not normally displayed.
[0012] The projection method disclosed in the present invention comprises: a projection step of projecting an image including an identification mark from a projector; a photographing step of photographing the image projected from the projector by a camera; a determination step of determining whether the identification mark is normally displayed in the image photographed by the camera; and a projection control step of changing the position of the image projected from the projector if a specific first condition is met, and changing the size of the image projected from the projector if a specific second condition is met, when it is determined in the determination step that the identification mark is not normally displayed.
[0013] The memory of the present invention stores a program for causing a computer to execute determination processing and projection control processing. The computer is capable of communicating with a projector for projecting an image including an identification mark and a camera for capturing the image projected from the projector. In the determination processing, it is determined whether the identification mark is normally displayed in the image captured by the camera. In the projection control processing, when it is determined in the determination processing that the identification mark is not normally displayed, if a specific first condition is met, the position of the image projected from the projector is changed, and if a specific second condition is met, the size of the image projected from the projector is changed.
[0014] Effects of the Invention
[0015] The projection device disclosed in the present invention, for example, includes a projector, a camera, a determination unit, and a projection control unit. The determination unit determines whether the identification mark is normally displayed in the image captured by the camera. When the determination unit determines that the identification mark is not normally displayed, the projection control unit changes the position of the image projected from the projector if a specific first condition is satisfied, and changes the size of the image projected from the projector if a specific second condition is satisfied. According to the projection device disclosed in the present invention, it is possible to reduce the load required in the process of projecting an image in an easy-to-observe manner. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 1 is a diagram showing an example of a projection device in Embodiment 1.
[0017] Figure 2 It is a perspective view showing an example of use of the projection device.
[0018] Figure 3 The diagram shows an example of an image captured by a camera.
[0019] Figure 4 1 is a flowchart showing an example of the operation of the projection device in the first embodiment.
[0020] Figure 5 It is a diagram for explaining the function of changing the projection position.
[0021] Figure 6It is a diagram for explaining the function of changing the projection size.
[0022] Figure 7 1 is a flowchart showing another operation example of the projection device in Embodiment 1.
[0023] Figure 8 1 is a flowchart showing another operation example of the projection device in Embodiment 1.
[0024] Fig. 9 1 is a flowchart showing another operation example of the projection device in Embodiment 1.
[0025] Fig.10 is a diagram showing an example of hardware resources of a computer.
[0026] Fig.11 This is a diagram showing another example of the hardware resources of a computer.
[0027] Description of symbols
[0028] 1 projection device; 2 housing; 3 projector; 4 camera; 5 computer; 6 router; 7 projection unit; 8 speaker; 9 camera unit; 10 information providing image; 11 identification mark; 12 wireless communication unit; 13 tablet terminal; 15 acquisition unit; 16 analysis unit; 17 determination unit; 18 projection control unit; 19 notification control unit; 20 processing circuit; 21 processor; 22 memory; 23 dedicated hardware. DETAILED DESCRIPTION
[0029] The following is a detailed description with reference to the accompanying drawings. The repeated description is appropriately simplified or omitted. In each figure, the same reference numeral represents the same part or a corresponding part.
[0030] Implementation method 1.
[0031] Figure 1 1 is a diagram showing an example of the projection device 1 in the first embodiment. Figure 2 It is a perspective view showing a usage example of the projection device 1 .
[0032] The projection device 1 includes a housing 2. The projection device 1 also includes a projector 3, a camera 4, a computer 5, and a router 6. The projector 3, the camera 4, the computer 5, and the router 6 are supported by the housing 2. Figure 1 and Figure 2 The example in which the projector 3, the camera 4, the computer 5, and the router 6 are arranged inside the housing 2 is shown. The projection device 1 may also be a device in which the computer 5 is connected to the projector 3, the camera 4, and the router 6 respectively by wire or wireless. In this case, the computer 5 may also be a computer capable of communicating with the projector 3, the camera 4, and the router 6.
[0033] The projector 3 includes a projection unit 7 for projecting an image and a speaker 8 for outputting sound. The speaker 8 is an example of an alarm. A lamp may be provided in the projector 3 as an alarm. The speaker 8 may be provided in the projection device 1 as a device different from the projector 3.
[0034] Figure 2 An example is shown in which the image projected from the projector 3 is projected onto the same surface as the surface on which the housing 2 is placed. For example, the projection device 1 is placed in the lobby of a building. The image from the projector 3 is projected onto the floor of the lobby. As another example, the projection device 1 is placed in the landing of an elevator. The image from the projector 3 is projected onto the floor of the landing.
[0035] The imaging device 4 includes an imaging unit 9 . The imaging unit 9 captures an image projected from the projector 3 . Figure 3 1 is a diagram showing an example of an image captured by the camera 4. The image projected from the projector 3 includes an information providing image 10. The image includes an identification mark 11. Figure 3 An example is shown in which nine identification marks 11-1 to 11-9 are included in the image projected from the projector 3. Hereinafter, when it is not necessary to identify an identification mark included in the image individually, it is simply represented as an identification mark 11.
[0036] The information providing image 10 is an image used to provide specific information to the user who observes the image. The information providing image 10 may include an image for guidance or an image for attracting attention. The information providing image 10 may also be an image accompanied by movement, that is, a dynamic image. The information providing image 10 may also be an image without movement, that is, a static image. The information providing image 10 may also be an image composed of a dynamic image and a static image. Figure 3 The information providing video 10 shown includes a pattern showing an arrow and characters such as “Exit 5a.” A user who views the information providing video 10 understands that he or she can go to “Exit 5a” by following the direction shown by the arrow.
[0037] The identification mark 11 may be any mark that can be identified from the captured image. Figure 3 The example in which the identification mark 11 is a two-dimensional color barcode is shown. The identification mark 11 may also be a two-dimensional code. The identification mark 11 may also be a barcode. In the image projected from the projector 3, the identification marks 11 are preferably present at the four corners of the image. The number of identification marks 11 included in the image can be arbitrarily set.
[0038] The router 6 includes a wireless communication unit 12. The router 6 is responsible for a communication function with external devices. Figure 1 The example in which the external device is the tablet terminal 13 is shown. Figure 1In the illustrated example, the projection device 1 can be operated from the tablet terminal 13 .
[0039] The computer 5 includes an acquisition unit 15, an analysis unit 16, a determination unit 17, a projection control unit 18, and a notification control unit 19. The projection control unit 18 and the notification control unit 19 control the projector 3. The notification control unit 19 controls the speaker 8 of the projector 3. Figures 4 to 6 , the functions of the projection device 1 are described in detail. Figure 4 1 is a flowchart showing an operation example of the projection device 1 in the first embodiment.
[0040] In S101, the projection control unit 18 projects an image including the information providing image 10 and the identification mark 11 from the projector 3 toward a standard position and a standard size. The standard position is set in advance. The standard size is set in advance. Next, in S102, the camera 4 captures the image projected from the projector 3. The acquisition unit 15 acquires the captured data from the camera 4 (S103).
[0041] The analyzing unit 16 analyzes the image data acquired by the acquiring unit 15 (S104). As an example, the analyzing unit 16 determines each identification mark 11. The analyzing unit 16 may also determine the position of each identification mark 11. The analyzing unit 16 may also determine the position of each identification mark 11 as a relative position relative to a reference position. The reference position may also be one of the identification marks 11.
[0042] Next, the determination unit 17 determines whether the identification mark 11 is normally displayed in the image captured by the camera 4 (S105). The determination of the determination unit 17 in S105 is performed based on the analysis result of the analysis unit 16. As an example, when the identification mark 11 cannot be determined in the image captured by the camera 4, the determination unit 17 determines that the identification mark 11 is not normally displayed ("No" in S105). For example, even if the identification marks 11-1 to 11-8 can be determined, if the identification mark 11-9 cannot be determined, it is determined as "No" in S105.
[0043] As another example, when the position of the identification mark 11 in the image captured by the camera 4 deviates from the pre-registered position, the determination unit 17 determines that the identification mark 11 is not normally displayed ("No" in S105). For example, even if the identification mark 11-9 can be identified, if the distance between the detected position of the identification mark 11-9 and the position pre-registered as the position where the identification mark 11-9 should be located exceeds the threshold, it is determined as "No" in S105.
[0044] If the analysis result of the analyzing unit 16 is that all the identification marks 11 can be identified and the positions of all the identification marks 11 are not offset, the determining unit 17 determines that the identification marks 11 are displayed normally ("Yes" in S105). If the determination in S105 is "Yes", the process returns to S101. That is, if the determining unit 17 does not determine that the identification marks 11 are not displayed normally, the projection control unit 18 projects an image from the projector 3 toward the standard position with a standard size.
[0045] If the determination in S105 is "No", the projection control unit 18 performs adjustment processing for projecting the image from the projector 3 in an easily observable manner. The adjustment processing includes processing for changing the projection position and processing for changing the projection size. Figure 4 In the illustrated example, when a “NO” is determined in S105 , the projection control unit 18 first changes the position of the image projected from the projector 3 ( S106 ).
[0046] Figure 5 This is a diagram for explaining the function of changing the projection position. For example, when the determination in S105 is "No" because the identification mark 11-9 cannot be determined, the projection control unit 18 moves the image projected from the projector 3 in a manner that the identification mark 11-9 approaches the center of the image, that is, in the direction indicated by the arrow A. The distance to move the image is preset. The position of the identification mark 11-9 after the movement may be arranged at the position of the identification mark 11-5 before the movement. The identification mark 11-5 is an identification mark arranged at the center of the image.
[0047] Next, in S107, the same processing as that in S102 to S104 is performed. Thereafter, the determination unit 17 determines again whether the identification mark 11 is normally displayed in the image captured by the camera 4 in S107 (S108). The processing in S108 is the same as that in S105.
[0048] If it is determined as "NO" in S108, the projection control unit 18 performs adjustment processing again for projecting the image from the projector 3 in an easily visible manner. Figure 4 In the illustrated example, when a “NO” is determined in S108 , the projection control unit 18 changes the size of the image projected from the projector 3 ( S109 ).
[0049] The process of changing the size of the image by the projection control unit 18 is a process of reducing or enlarging the image. Whether the process of reducing the image or enlarging the image is performed by the projection control unit 18 in S109 is determined according to a predetermined rule. For example, in the case where a relatively large size is set as the standard size, it can be predetermined that the process of reducing the image is performed in S109. Thus, each time it is determined as "No" in S108, the image is gradually reduced by executing S109. Similarly, in the case where a relatively small size is set as the standard size, it can be predetermined that the process of enlarging the image is performed in S109. In this case, each time it is determined as "No" in S108, the image is gradually enlarged by executing S109. In addition, it is also possible that the projection control unit 18 basically reduces the image projected from the projector 3 in S109, and on the other hand, when the degree of reduction exceeds a predetermined reference, the process of enlarging the image is performed instead of the process of reducing the image. Similarly, the projection control unit 18 may basically enlarge the image projected from the projector 3 in S109, and on the other hand, when the degree of the enlargement exceeds a preset reference, the image may be reduced instead of the image enlargement process. Hereinafter, a simple example in which the process of the projection control unit 18 in S109 is a process of reducing the image will be described.
[0050] Figure 6 This is a diagram for explaining the function of changing the projection size. For example, when it is determined as "No" in S108 because the identification mark 11-9 cannot be determined, the projection control unit 18 reduces the image projected from the projector 3 by a certain ratio in such a way that the identification mark 11-9 approaches the center of the image, that is, in the direction indicated by the arrow B. The ratio of reducing the image is preset.
[0051] In addition, Figure 6 In the example shown, in S109, the position of the image projected from the projector 3 is also changed. As another example, in S109, the image projected from the projector 3 may be reduced in size without changing the position of the image. That is, the image projected from the projector 3 may be reduced in size without changing the center position of the image.
[0052] Next, in S110, the same processing as that shown in S102 to S104 is performed. After that, the determination unit 17 again determines whether the identification mark 11 is normally displayed in the image captured by the camera 4 in S110 (S111). The processing shown in S111 is the same as the processing shown in S105. A series of processing shown in S106 to S111 is repeated until it is determined as "yes" in S108 or S111.
[0053] When it is determined as "yes" in S108 or S111, it is determined whether a certain time has passed (S112). When a certain time has passed after it is determined as "yes" in S108 or S111, the process returns to S101. That is, when it is determined as "yes" in S112, the projection control unit 18 projects an image with a standard size from the projector 3 toward the standard position.
[0054] In the projection device 1 shown in the present embodiment, the projection control unit 18 performs adjustment processing for projecting the image from the projector 3 in an easy-to-observe manner based on the determination result of whether the identification mark 11 is normally displayed. That is, the projection control unit 18 changes the position or size of the image projected from the projector 3. According to the projection device 1 shown in the present embodiment, the load required for the adjustment processing can be reduced.
[0055] The following describes other functions that can be employed by the projection device 1. The projection device 1 can also employ a plurality of functions shown below in combination when possible.
[0056] like Figure 2 As shown in FIG. 1 , when the image from the projector 3 is projected onto the same surface as the surface on which the projection device 1 is placed, the lens of the projector 3 may be arranged at a position where children can easily peek. In order to prevent such peeping, the notification control unit 19 may also make a specific notification from the speaker 8 when the projection position is changed in S106 and when the projection size is changed in S109. As the above notification, the notification control unit 19 may also display a message such as "Please do not peek" on the display.
[0057] exist Figure 4 In the example shown, as an adjustment process for projecting an image from the projector 3 in an easy-to-observe manner, a preferred example of performing a process of changing the projection position in S106 and performing a process of changing the projection size in S109 is described. In S109, the projection size may be changed in a manner that the position of the image projected from the projector 3 is always changed. As another example, when it is determined as "No" in S108, the process may return to S106. That is, as the above-mentioned adjustment process, only the process of changing the projection position may be performed.
[0058] As the above adjustment process, Figure 4 An example is shown in which the projection position is changed when a specific first condition is satisfied, and the projection size is changed when a specific second condition is satisfied. Figure 4 An example is shown in which the first condition and the second condition are determined to be satisfied based on the number of times the determination unit 17 continuously determines that the identification mark 11 is not normally displayed. Hereinafter, "the number of times the determination unit 17 continuously determines that the identification mark 11 is not normally displayed" is also referred to as "the number of consecutive determinations".
[0059] Figure 7 FIG. 1 is a flowchart showing another operation example of the projection device 1 in Embodiment 1. Figure 4 In the example shown, if the number of consecutive determinations is an odd number, the first condition is satisfied. If the number of consecutive determinations is an even number, the second condition is satisfied. Figure 4 In the example shown, if "No" is continuously determined in S108 and S111 after S105 is determined as "No", the image from the projector 3 will continue to move and be continuously reduced. Such a phenomenon may occur when many people stand in front of the projection device 1, etc.
[0060] Figure 7 The following is an action flow for preventing such an incident from occurring. Specifically, Figure 7 Equivalent to Figure 4 The example shown in FIG. 1 adds an example of the determination process of S213. Figure 7 In the example shown, the processing other than the determination processing of S213 is the same as Figure 4 The examples shown are essentially the same. Figure 7 Also in the example shown, if the number of consecutive determinations is an odd number, the first condition is satisfied, and if the number of consecutive determinations is an even number, the second condition is satisfied.
[0061] exist Figure 7 In the example shown, n=1 is set in S200 . Figure 7 The processing shown in S201 to S205 is the same as Figure 4 The processing shown in S101 to S105 is the same.
[0062] When the determination unit 17 determines that the identification mark 11 is normally displayed (Yes in S205 ), the process returns to S200 after the process of S212 is performed. Figure 7 The processing shown in S212 is the same as Figure 4 That is, when n=1 and it is determined to be "YES" in S205, the projection control unit 18 continues to project the image in the standard size from the projector 3 toward the standard position.
[0063] When it is determined as "No" in S205, it is determined in S213 whether n is greater than the reference number nth. The reference number nth is preset. n represents the number of consecutive determinations. That is, when the number of consecutive determinations reaches the reference number nth, it is determined as "Yes" in S213. When it is determined as "Yes" in S213, n=1 is set again. In addition, when it is determined as "Yes" in S213, the projection control unit 18 projects an image with a standard size from the projector 3 toward the standard position.
[0064] If the number of consecutive determinations does not reach the reference number nth, it is determined as "No" in S213. If it is determined as "No" in S213, the projection control unit 18 determines whether n is an odd number in S214. If n is an odd number, it is determined as "Yes" in S214. If it is determined as "Yes" in S214, the projection control unit 18 changes the position of the image projected from the projector 3 (S206). Figure 7 The processing shown in S206 is the same as Figure 4 The processing shown in S106 of is the same as that of S202. Then, in S215, the current value of n is incremented by 1. The processing from S202 to S205 performed immediately after the judgment of "yes" in S214 is the same as that of S206. Figure 4 The processing shown in S107 and S108 is the same.
[0065] When it is determined as “No” in S213 , if n is an even number, it is determined as “No” in S214 . When it is determined as “No” in S214 , the projection control unit 18 changes the size of the image projected from the projector 3 ( S209 ). Figure 7 The processing shown in S209 is the same as Figure 4 The processing shown in S109 is the same as that in S215. Then, in S215, the current value of n is increased by 1. The processing from S202 to S205 performed immediately after the judgment of "No" in S214 is the same as that in S215. Figure 4 The processing shown in S110 and S111 is the same.
[0066] In addition, Figure 7 In the example shown, the process shown in S209 may be performed when the determination in S214 is "Yes". In this case, the process shown in S206 is performed when the determination in S214 is "No".
[0067] exist Figure 7 In the example shown, in S213, it is also possible to determine whether a specific time has passed after n=1 is set. The time is preset. In this case, if the time has passed, it is determined as "yes" in S213. If the time has not passed, it is determined as "no" in S213.
[0068] If Figure 7 In the example shown, the adjustment process for projecting the image from the projector 3 in an easily observable manner can be limited until the number of consecutive determinations reaches the reference number nth. Figure 7 In the example shown, it is possible to prevent the image from the projector 3 from continuously moving and being continuously reduced in size.
[0069] As another example, when the number of consecutive determinations reaches the reference number nth, the projection control unit 18 may change the content of the information providing image 10 projected from the projector 3. For example, the projection control unit 18 may project from the projector 3 an information providing image 10 that prompts a standing person to move.
[0070] Figure 8 1 is a flowchart showing another operation example of the projection device in Embodiment 1. Figure 8 An example is shown in which the first condition is satisfied if the number of consecutive determinations is N or less, and the second condition is satisfied if the number of consecutive determinations is N+1 or more. The value of N is preset. Figure 8 In the example shown, the reference number nth is preferably a value greater than N+1. Figure 8 Equivalent to Figure 7 In the example shown, the determination process shown in S214 is changed to an example of the determination process shown in S316.
[0071] Specifically, in Figure 8 In the example shown, when it is determined as "No" in S305, it is determined in S313 whether n is greater than the reference number nth. When the number of consecutive determinations reaches the reference number nth, it is determined as "Yes" in S313. When it is determined as "Yes" in S313, n=1 is set again. In addition, when it is determined as "Yes" in S313, the projection control unit 18 projects an image with a standard size from the projector 3 toward the standard position.
[0072] If the number of consecutive determinations does not reach the reference number nth, it is determined as "No" in S313. When it is determined as "No" in S313, in S316, the projection control unit 18 determines whether the value of n is less than N. As described above, n represents the number of consecutive determinations. That is, if the number of consecutive determinations is less than N times, it is determined as "Yes" in S316. When it is determined as "Yes" in S316, the projection control unit 18 changes the position of the image projected from the projector 3 (S306).
[0073] On the other hand, when the number of consecutive determinations exceeds N times, it is determined as “No” in S316 . When it is determined as “No” in S316 , the projection control unit 18 changes the size of the image projected from the projector 3 ( S309 ).
[0074] exist Figure 8 In the example shown, the process shown in S309 may be performed when the determination in S316 is "Yes". In this case, the process shown in S306 is performed when the determination in S316 is "No".
[0075] exist Figure 3The information providing image 10 shown includes a pattern representing an arrow. Therefore, it is not preferred that the projection position is too far away from the standard position. For this reason, the area where the image from the projector 3 can be projected can also be set in advance. Hereinafter, this area will also be referred to as a projectable area. In this case, the first condition is established when the image falls into the projectable area even if the position of the image projected from the projector 3 is changed. The second condition is established when the image no longer falls into the projectable area if the position of the image projected from the projector 3 is changed. In the case of projecting the image from the projector 3 onto the ground, the projectable area can also be set to match the position of the wall.
[0076] For example, the projection target area is obtained using the parameters used in the process of changing the position of the image. The projection target area is the area where the image is projected when the position of the image is changed using the parameters. In this case, a process is performed to determine whether the obtained projection target area falls within the projectable area. If the projection target area falls within the projectable area, the first condition is met. If the projection target area does not fall within the projectable area, the second condition is met.
[0077] exist Figure 3 The information providing image 10 shown includes text. Therefore, when the projection size is too small compared to the standard size, the text cannot be read. For this reason, the satisfaction of the first condition and the satisfaction of the second condition can also be determined based on the content of the information providing image 10 projected from the projector 3.
[0078] Fig. 9 1 is a flowchart showing another operation example of the projection device in Embodiment 1. Fig. 9 An example is shown in which the first condition is satisfied when the information provision image 10 includes text, and the second condition is satisfied when the information provision image 10 does not include text. Fig. 9 Equivalent to Figure 7 In the example shown, the determination process shown in S214 is changed to an example of the determination process shown in S417.
[0079] Specifically, in Fig. 9 In the example shown, when it is determined as "No" in S405, it is determined in S413 whether n is greater than the reference number nth. When the number of consecutive determinations reaches the reference number nth, it is determined as "Yes" in S413. When it is determined as "Yes" in S413, n=1 is set again. In addition, when it is determined as "Yes" in S413, the projection control unit 18 projects an image with a standard size from the projector 3 toward the standard position.
[0080] If the number of consecutive determinations does not reach the reference number nth, it is determined as "No" in S413. When it is determined as "No" in S413, in S417, the projection control unit 18 determines whether the information providing image 10 contains text. The determination processing in S417 is performed, for example, based on the analysis result of the analysis unit 16. The analysis unit 16 analyzes the captured data acquired by the acquisition unit 15 and detects the text included in the information providing image 10. When the text is detected by the analysis of the captured data by the analysis unit 16, it is determined as "Yes" in S417. When it is determined as "Yes" in S417, the projection control unit 18 changes the position of the image projected from the projector 3 (S406).
[0081] On the other hand, if the analyzing unit 16 does not detect any characters by analyzing the image data, it is determined as “No” in S417. If it is determined as “No” in S417, the projection control unit 18 changes the size of the image projected from the projector 3 (S409).
[0082] exist Fig. 9 In the example shown, the process shown in S409 may be performed when the determination in S417 is "Yes". In this case, the process shown in S406 is performed when the determination in S417 is "No".
[0083] As another example, the first condition may be satisfied when a graphic symbol such as a pictogram or a specific pattern such as an icon is included in the information providing image 10. In this case, when the graphic symbol or pattern is not included in the information providing image 10, the second condition is satisfied.
[0084] The projection device 1 may be built into a movable robot. Only the projector 3 may be built into a movable robot. In this case, the position of the image projected from the projector 3 may be changed by the movement of the robot.
[0085] Fig.10 2 is a diagram showing an example of hardware resources of the computer 5. As hardware resources, the computer 5 includes a processing circuit 20 including a processor 21 and a memory 22. The processing circuit 20 may include a plurality of processors 21. The processing circuit 20 may include a plurality of memories 22.
[0086] In this embodiment, the components shown by reference numerals 15 to 19 represent functions of the computer 5. The functions of the components shown by reference numerals 15 to 19 can be implemented by software, firmware, or a combination of software and firmware described in the form of a program. The program is stored in the memory 22. The computer 5 implements the functions of the components shown by reference numerals 15 to 19 by executing the program stored in the memory 22 by the processor 21.
[0087] The processor 21 is also called a CPU (Central Processing Unit), a central processing device, a processing device, an arithmetic device, a microprocessor, a microcomputer, or a DSP. As the memory 22, a semiconductor memory, a magnetic disk, a floppy disk, an optical disk, a high-density disk, a mini disk, or a DVD may also be used. The semiconductor memory that can be used includes a RAM, a ROM, a flash memory, an EPROM, and an EEPROM.
[0088] Fig.11 FIG. 5 is a diagram showing another example of hardware resources of the computer 5. Fig.11 In the example shown, the computer 5 includes a processing circuit 20 including a processor 21 , a memory 22 , and dedicated hardware 23 . Fig.11 The example in which a part of the functions of the computer 5 is implemented by the dedicated hardware 23 is shown. All the functions of the computer 5 may be implemented by the dedicated hardware 23. As the dedicated hardware 23, a single circuit, a complex circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof can be used.
[0089] Projector 3 hardware resources and Fig.10 or Fig.11 The example shown is the same. As hardware resources, the projector 3 has a processing circuit including a processor and a memory. The projector 3 realizes the above-mentioned functions by executing a program stored in the memory by the processor. As hardware resources, the projector 3 may also have a processing circuit including a processor, a memory and dedicated hardware. It is also possible to realize part or all of the functions of the projector 3 by dedicated hardware.
[0090] Camera 4 hardware resources and Fig.10 or Fig.11 The example shown is the same. As a hardware resource, the camera 4 has a processing circuit including a processor and a memory. The camera 4 implements the above-mentioned functions by executing a program stored in the memory by the processor. As a hardware resource, the camera 4 may also have a processing circuit including a processor, a memory and dedicated hardware. Some or all of the functions of the camera 4 may also be implemented by dedicated hardware.
Claims
1. A projection device, in, The projection device comprises: A projector for projecting an image including the identification mark; a camera that captures the image projected from the projector; a determination unit configured to determine whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control unit that, when the determination unit determines that the identification mark is not normally displayed, changes the position of the image projected from the projector if a first condition is satisfied, and changes the size of the image projected from the projector if a second condition is satisfied, If the number of times the determination unit continuously determines that the identification mark is not normally displayed is an odd number, one of the first condition and the second condition is satisfied, and if the number is an even number, the other of the first condition and the second condition is satisfied.
2. A projection device, in, The projection device comprises: A projector for projecting an image including the identification mark; a camera that captures the image projected from the projector; a determination unit configured to determine whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control unit that, when the determination unit determines that the identification mark is not normally displayed, changes the position of the image projected from the projector if a first condition is satisfied, and changes the size of the image projected from the projector if a second condition is satisfied, If the number of times the determination unit continuously determines that the identification mark is not displayed normally is less than a preset value, one of the first condition and the second condition is satisfied; if the number of times exceeds the value, the other of the first condition and the second condition is satisfied.
3. A projection device, in, The projection device comprises: A projector for projecting an image including the identification mark; a camera that captures the image projected from the projector; a determination unit configured to determine whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control unit that, when the determination unit determines that the identification mark is not normally displayed, changes the position of the image projected from the projector if a first condition is satisfied, and changes the size of the image projected from the projector if a second condition is satisfied, The image projected from the projector includes an information providing image, and the information providing image includes text. If text is detected in the image captured by the camera, the first condition is satisfied. If no text is detected in the image captured by the camera, the second condition is satisfied.
4. A projection device, in, The projection device comprises: A projector for projecting an image including the identification mark; a camera that captures the image projected from the projector; a determination unit configured to determine whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control unit that, when the determination unit determines that the identification mark is not normally displayed, changes the position of the image projected from the projector if the first condition is satisfied and the second condition is not satisfied, and changes the size of the image projected from the projector if the second condition is satisfied and the first condition is not satisfied, When the position or size of the image projected from the projector is changed by the projection control unit, the determination unit determines again whether the identification mark is normally displayed. If the determination unit does not determine that the identification mark is not displayed normally, the projection control unit projects an image with a standard size from the projector toward a standard position, When the number of times the determination unit continuously determines that the identification mark is not normally displayed reaches a specific number of times, the projection control unit projects an image in the standard size from the projector toward the standard position.
5. A projection device, in, The projection device comprises: A projector for projecting an image including the identification mark; a camera that captures the image projected from the projector; a determination unit configured to determine whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control unit that, when the determination unit determines that the identification mark is not normally displayed, changes the position of the image projected from the projector if the first condition is satisfied and the second condition is not satisfied, and changes the size of the image projected from the projector if the second condition is satisfied and the first condition is not satisfied, When the position or size of the image projected from the projector is changed by the projection control unit, the determination unit determines again whether the identification mark is normally displayed. The image projected from the projector includes an information providing image, The projection control unit changes the content of the information providing image projected from the projector when the number of times the determination unit continuously determines that the identification mark is not normally displayed reaches a specific number of times.
6. A projection device, in, The projection device comprises: A projector for projecting an image including the identification mark; a camera that captures the image projected from the projector; a determination unit configured to determine whether the identification mark is normally displayed in the image captured by the camera; a projection control unit for changing the position of the image projected from the projector if the first condition is satisfied and the second condition is not satisfied, and for changing the size of the image projected from the projector if the second condition is satisfied and the first condition is not satisfied, when the determination unit determines that the identification mark is not normally displayed; a housing supporting the projector; as well as The alarm control unit controls the alarm. The image from the projector is projected onto the same surface as the surface on which the housing is placed. The notification control unit performs notification from the notification device when the projection control unit changes the position of the image projected from the projector and when the size of the image projected from the projector is changed.
7. A projection method, in, The projection method comprises: a projecting step of projecting an image including the identification mark from a projector; A photographing step, photographing the image projected from the projector by a camera; a determination step of determining whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control step, when it is determined in the determination step that the identification mark is not normally displayed, if the first condition is satisfied, then changing the position of the image projected from the projector, and if the second condition is satisfied, then changing the size of the image projected from the projector, If the number of times that the identification mark is continuously determined not to be displayed normally in the determination step is an odd number, one of the first condition and the second condition is satisfied, and if the number is an even number, the other of the first condition and the second condition is satisfied.
8. A projection method, in, The projection method comprises: a projecting step of projecting an image including the identification mark from a projector; A photographing step, photographing the image projected from the projector by a camera; a determination step of determining whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control step, when it is determined in the determination step that the identification mark is not normally displayed, if the first condition is satisfied, then changing the position of the image projected from the projector, and if the second condition is satisfied, then changing the size of the image projected from the projector, If the number of times the identification mark is continuously determined to be not displayed normally in the determination step is less than a preset value, one of the first condition and the second condition is satisfied; if the number of times exceeds the value, the other of the first condition and the second condition is satisfied.
9. A projection method, in, The projection method comprises: a projecting step of projecting an image including the identification mark and an information providing image from a projector, wherein the information providing image includes text; A photographing step, photographing the image projected from the projector by a camera; a determination step of determining whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control step, when it is determined in the determination step that the identification mark is not normally displayed, if the first condition is satisfied, then changing the position of the image projected from the projector, and if the second condition is satisfied, then changing the size of the image projected from the projector, If text is detected in the image captured by the camera, the first condition is satisfied. If no text is detected in the image captured by the camera, the second condition is satisfied.
10. A projection method, in, The projection method comprises: a projecting step of projecting an image including the identification mark from a projector; A photographing step, photographing the image projected from the projector by a camera; a determination step of determining whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control step, when it is determined in the determination step that the identification mark is not normally displayed, if the first condition is satisfied and the second condition is not satisfied, then changing the position of the image projected from the projector, and if the second condition is satisfied and the first condition is not satisfied, then changing the size of the image projected from the projector, When the position or the size of the image projected from the projector is changed in the projection control step, the determination step is performed again, If it is not determined in the determination step that the identification mark is not normally displayed, then in the projection control step, an image is projected from the projector toward a standard position with a standard size, When the number of times that the identification mark is not normally displayed reaches a specific number in the determination step, the image is projected from the projector toward the standard position in the projection control step.
11. A projection method, in, The projection method comprises: a projecting step of projecting an image including the identification mark and the information providing image from a projector; A photographing step, photographing the image projected from the projector by a camera; a determination step of determining whether the identification mark is normally displayed in the image captured by the camera; as well as a projection control step, when it is determined in the determination step that the identification mark is not normally displayed, if the first condition is satisfied and the second condition is not satisfied, then changing the position of the image projected from the projector, and if the second condition is satisfied and the first condition is not satisfied, then changing the size of the image projected from the projector, When the position or the size of the image projected from the projector is changed in the projection control step, the determination step is performed again, When the number of times that the identification mark is continuously determined not to be normally displayed reaches a specific number in the determination step, the content of the information providing image projected from the projector is changed in the projection control step.
12. A projection method, in, The projection method comprises: a projecting step of projecting an image including the identification mark from a projector; A photographing step, photographing the image projected from the projector by a camera; a determination step of determining whether the identification mark is normally displayed in the image captured by the camera; a projection control step, when it is determined in the determination step that the identification mark is not normally displayed, if the first condition is satisfied and the second condition is not satisfied, changing the position of the image projected from the projector, and if the second condition is satisfied and the first condition is not satisfied, changing the size of the image projected from the projector; as well as a notification control step of providing notification from a notification device when the position of the image projected from the projector is changed and when the size of the image projected from the projector is changed in the projection control step, The image from the projector is projected onto the same surface as the surface on which the housing supporting the projector is placed.
13. A memory storing a program for causing a computer to execute a determination process and a projection control process, The computer is capable of communicating with a projector for projecting an image including the identification mark and a camera for photographing the image projected from the projector. In the determination process, it is determined whether the identification mark is normally displayed in the image captured by the camera. In the projection control process, when it is determined in the determination process that the identification mark is not normally displayed, if the first condition is satisfied, the position of the image projected from the projector is changed, and if the second condition is satisfied, the size of the image projected from the projector is changed. If the number of times that the identification mark is continuously determined not to be normally displayed in the determination process is an odd number, one of the first condition and the second condition is satisfied, and if the number is an even number, the other of the first condition and the second condition is satisfied.
14. A memory storing a program for causing a computer to execute a determination process and a projection control process, The computer is capable of communicating with a projector for projecting an image including the identification mark and a camera for photographing the image projected from the projector. In the determination process, it is determined whether the identification mark is normally displayed in the image captured by the camera. In the projection control process, when it is determined in the determination process that the identification mark is not normally displayed, if the first condition is satisfied, the position of the image projected from the projector is changed, and if the second condition is satisfied, the size of the image projected from the projector is changed. If the number of times the identification mark is continuously determined to be not displayed normally in the determination process is less than a preset value, one of the first condition and the second condition is met; if the number of times exceeds the value, the other of the first condition and the second condition is met.
15. A memory storing a program for causing a computer to execute a determination process and a projection control process, The computer is capable of communicating with a projector for projecting an image including an identification mark and an information providing image and a camera for photographing the image projected from the projector, the information providing image including text, In the determination process, it is determined whether the identification mark is normally displayed in the image captured by the camera. In the projection control process, when it is determined in the determination process that the identification mark is not normally displayed, if the first condition is satisfied, the position of the image projected from the projector is changed, and if the second condition is satisfied, the size of the image projected from the projector is changed. If text is detected in the image captured by the camera, the first condition is satisfied. If no text is detected in the image captured by the camera, the second condition is satisfied.
16. A memory storing a program for causing a computer to execute a determination process and a projection control process, The computer is capable of communicating with a projector for projecting an image including the identification mark and a camera for photographing the image projected from the projector. In the determination process, it is determined whether the identification mark is normally displayed in the image captured by the camera. In the projection control process, when it is determined in the determination process that the identification mark is not normally displayed, if the first condition is satisfied and the second condition is not satisfied, the position of the image projected from the projector is changed, and if the second condition is satisfied and the first condition is not satisfied, the size of the image projected from the projector is changed. When the position or the size of the image projected from the projector is changed in the projection control process, the determination process is performed again. If it is not determined in the determination process that the identification mark is not normally displayed, then in the projection control process, an image is projected from the projector toward a standard position with a standard size, When the number of times that the identification mark is not normally displayed reaches a specific number in succession in the determination process, the image is projected from the projector toward the standard position in the projection control process with the standard size.
17. A memory storing a program for causing a computer to execute a determination process and a projection control process, The computer is capable of communicating with a projector for projecting an image including an identification mark and an information providing image and a camera for photographing the image projected from the projector. In the determination process, it is determined whether the identification mark is normally displayed in the image captured by the camera. In the projection control process, when it is determined in the determination process that the identification mark is not normally displayed, if the first condition is satisfied and the second condition is not satisfied, the position of the image projected from the projector is changed, and if the second condition is satisfied and the first condition is not satisfied, the size of the image projected from the projector is changed. When the position or the size of the image projected from the projector is changed in the projection control process, the determination process is performed again. When the number of times that the identification mark is continuously determined not to be normally displayed reaches a specific number in the determination process, the content of the information providing image projected from the projector is changed in the projection control process.
18. A memory storing a program for causing a computer to execute a determination process, a projection control process, and a notification control process, The computer is capable of communicating with a projector and a camera, wherein the projector is supported by the housing and is used to project an image including the identification mark onto the same surface as the surface on which the housing is placed, and the camera captures the image projected from the projector. In the determination process, it is determined whether the identification mark is normally displayed in the image captured by the camera. In the projection control process, when it is determined in the determination process that the identification mark is not normally displayed, if the first condition is satisfied and the second condition is not satisfied, the position of the image projected from the projector is changed, and if the second condition is satisfied and the first condition is not satisfied, the size of the image projected from the projector is changed. In the notification control process, when the position of the image projected from the projector is changed and when the size of the image projected from the projector is changed in the projection control process, notification is performed from the notification device.
Citation Information
Patent Citations
Method and system for automatically identifying projection exception by projector
CN107463902A
Display controller, information terminal device and display control program
JP2007306613A
Multi-screen display device
JP2016095362A
Projection system
WO2015170680A1
Projection control device, projection device, projection control method, and projection control program
WO2019167527A1
