Digital signage with Anti-crime capability

A digital signage system with integrated security functions addresses the challenge of maintaining user convenience and crime prevention in unmanned stores by using an avatar to communicate suspicious behavior alerts, achieving cost-effective crime prevention and enhanced safety.

JP2025135658AActive Publication Date: 2025-09-19EARTH EYES CO LTD +1
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024033522
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-06
Publication Date
2025-09-19
Estimated Expiration
2044-03-06

AI Technical Summary

Technical Problem

Existing unmanned or labor-reduced stores face challenges in maintaining both user convenience and crime prevention at a cost-effective level, as conventional methods often require separate systems for each function.

Method used

Integrating a digital signage system with security functions, including an imaging unit, information output unit, and arithmetic processing unit, which combines user support and suspicious behavior monitoring to provide both functions through an avatar interface.

Benefits of technology

The integrated digital signage system maintains user convenience while effectively preventing crimes, such as shoplifting, by using an avatar to communicate suspicious behavior alerts, thereby reducing overall costs and enhancing safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025135658000001_ABST
    Figure 2025135658000001_ABST
Patent Text Reader

Abstract

To sustain both user friendliness and anti-crime performance at a lower cost than conventionally in an unmanned or labor-saving shop.SOLUTION: A digital signage 1 with an anti-crime capability includes an imaging unit 10, information output unit 30, and arithmetic processing unit 40. The arithmetic processing unit 40 includes a user support block 41 and suspicious action monitoring block 42. The user support block 41 includes user support information generation means that generates user support information. The suspicious action monitoring block 42 includes suspicious action extraction means that analyzes an image taken by the imaging unit 10 and extracts a suspicious action of a person in the image. The information output unit 30 outputs user support information in the event that no suspicious action has been extracted, and outputs suspicious action alert information in the event that a suspicious action has been extracted.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a "digital signage with a security function." More specifically, the present invention relates to a "digital signage with a security function" that can contribute to improving convenience for customers and crime prevention by installing it in an unmanned store or the like. [Background technology]

[0002] In recent years, digital signage that provides various user support information has been installed in stores and other places where unmanned or labor-saving operations are becoming more common to maintain user convenience. Here, "digital signage" refers to an information display device that can display information consisting of images and text on a flat screen or the like by utilizing digital technology for display and communication (see Patent Document 1).

[0003] As an example of the use of "digital signage" in recent years, a type of display device that presents the above-mentioned user support information to users through two-way communication via an avatar image of a guide providing customer service, instead of a staff member providing customer service, is becoming increasingly popular (see Patent Document 2).

[0004] On the other hand, in the unmanned or labor-reduced stores mentioned above, in addition to ensuring convenience for customers, it is also essential to introduce security systems to prevent criminal acts such as shoplifting and tampering with cash registers (see Patent Document 3).

[0005] In unmanned or staff-reduced stores, the costs of maintaining convenience for customers and the costs of maintaining security are compounded, and measures to improve this are needed. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent No. 6647612 [Patent Document 2] Japanese Patent Publication No. 2023-7309 [Patent Document 3] Patent No. 7039084 Summary of the Invention [Problem to be solved by the invention]

[0007] In view of the above circumstances, the present invention aims to provide a technical means that can maintain both user convenience and crime prevention at a lower cost than conventional methods in unmanned or labor-reduced stores and the like. [Means for solving the problem]

[0008] The present inventors came up with the idea that the above-mentioned problems could be solved by adding a security function to a conventional digital signage with user support functions, creating a "digital signage with security functions," and thus completed the present invention.

[0009] (1) A digital signage with a crime prevention function, comprising an imaging unit, an information output unit, and an arithmetic processing unit, the arithmetic processing unit including a user support unit and a suspicious behavior monitoring unit, the user support unit having a user support information generation means for generating user support information, the suspicious behavior monitoring unit having a suspicious behavior extraction means for extracting suspicious behavior of a person in an image by analyzing an image captured by the imaging unit, and the information output unit outputting the user support information if the suspicious behavior is not extracted, and outputting suspicious behavior alert information if the suspicious behavior is extracted.

[0010] (1) Digital signage with security functions can maintain both user convenience and security at lower costs than before in unmanned or labor-reduced stores. For example, it can significantly reduce losses due to shoplifting in unmanned convenience stores, improving their safety and convenience. Furthermore, in exhibition halls where customers are infrequent but where expensive precious metals or artworks are on display, installing this digital signage with security functions can provide both concierge and security services, reducing the labor costs associated with both services.

[0011] (2) A digital signage with a security function as described in (1), in which a guide's avatar is displayed on the information output unit, and the user support information is output as information transmitted by the avatar.

[0012] (2) Digital signage with security functions allows guide avatars to communicate with each other in a way that is similar to communication with a real guide, making it possible to move to unmanned or labor-saving stores while maintaining a high level of convenience for users. Furthermore, security, which becomes an issue when moving to unmanned or labor-saving stores, can be maintained at a desirable level without the need for a separate security system.

[0013] (3) The digital signage with security functions described in (2), wherein the suspicious behavior alert information is output as information transmitted by the avatar.

[0014] With the digital signage with security functions (3), suspicious behavior alert information is usually transmitted from the avatar of a guide who transmits user support information, making it relatively easy to establish initial communication between the suspicious person and the system without alerting the suspicious person. This communication (e.g., communication equivalent to a real store clerk discreetly warning a shoplifter) can increase the likelihood of preventing crimes before they occur. With the digital signage with security functions (3), this function can further improve security in unmanned or labor-saving stores.

[0015] (4) A digital signage with security functions described in any of (1) to (3), further comprising an information input unit into which a user inputs questions, wherein the user support unit has a machine learning information processing device with a neural network or other artificial intelligence (AI) as a user support information generation means, and the information processing device or the artificial intelligence uses the questions as input values ​​and outputs the user support information corresponding to the input values.

[0016] The digital signage with security functions of (4) allows users to have two-way communication with an avatar of a real guide, thereby maintaining a high level of convenience for users at the store while also maintaining a high level of security, compared to the digital signage with security functions of any of (1) to (3).

[0017] (5) A digital signage system with a crime prevention function, in which an image capture unit, an information output unit, and an arithmetic processing unit are connected to each other so that they can communicate with each other, the arithmetic processing unit including a user support unit and a suspicious behavior monitoring unit, the user support unit having a user support information generation means for generating user support information, the suspicious behavior monitoring unit having a suspicious behavior extraction means for extracting suspicious behavior of a person in an image by analyzing an image captured by the image capture unit, and the information output unit outputs the user support information if the suspicious behavior is not extracted, and outputs suspicious behavior alert information if the suspicious behavior is extracted.

[0018] (5) The digital signage system with security functions can maintain both user convenience and security at lower costs than before in unmanned or labor-reduced stores. For example, it can significantly reduce losses due to shoplifting in unmanned convenience stores, improving their safety and convenience. Furthermore, in exhibition halls where customers are infrequent but where expensive precious metals or art objects are on display, installing this digital signage with security functions can provide both concierge and security services, reducing the labor costs associated with both services.

[0019] (6) A digital signage system with security functions described in (5), in which a guide avatar is displayed on the information output unit, and the user support information is output as information transmitted by the avatar.

[0020] (6) The digital signage system with security functions allows guide avatars to communicate with customers in a way that is similar to real-life guides, making it possible to move to unmanned or labor-saving stores while maintaining a high level of convenience for customers. Furthermore, security, which is an issue when moving to unmanned or labor-saving stores, can be maintained at a desirable level without the need for a separate security system. [Effects of the Invention]

[0021] According to the present invention, it is possible to maintain both user convenience and crime prevention at lower costs than before in unmanned or labor-reduced stores, etc. As a specific example, it is possible to significantly reduce losses due to shoplifting in unmanned convenience stores, etc., thereby improving the safety and convenience of unmanned convenience stores. Furthermore, in exhibition halls where customers are infrequent but where expensive precious metals, art pieces, etc. are exhibited, the installation of this digital signage with crime prevention functions can provide both concierge services and security services, thereby reducing the labor costs associated with both services. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a block diagram showing the components of a digital signage with a security function according to the present invention; [Figure 2] 1 is a front view showing an example of a specific form of a digital signage with a security function of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0023] <Digital signage with security features> The best mode for carrying out the present invention will be described below with reference to the accompanying drawings. The "digital signage with crime prevention function" of the present invention is a hybrid digital signage that combines the well-known "digital signage" that can provide various user support information to maintain user convenience with the added function of a surveillance device to enhance crime prevention.

[0024] Incidentally, "digital signage" typically stores a large amount of display information in an internal storage device, allowing for a variety of visual representations, such as switching display content every second if necessary or displaying moving images. Taking advantage of this diverse visual representation capability, it is already widely practiced to provide users with the above-mentioned user assistance information through two-way communication via an avatar image that functions as a pseudo-guide. In the "digital signage with security functions" of the present invention, a preferred embodiment is one in which information is provided to users and warnings to suspicious individuals are provided through two-way communication via an avatar 100, as exemplified by the digital signage with security functions 1 illustrated in FIG. 2.

[0025] [Overall configuration] The basic configuration of the digital signage with security functions 1, which is an example of a preferred embodiment of the "digital signage with security functions" of the present invention, is as shown in the block diagram of Figure 1. The digital signage with security functions 1 is configured to include at least an imaging unit 10, an information output unit 30, and a processing unit 40 having a user support unit 41 and a suspicious behavior monitoring unit 42. In addition to the above components, the digital signage with security functions 1 preferably further includes an information input unit 20.

[0026] As a specific example of the "digital signage with security functions" of the present invention, it can be in the form of a digital signage with security functions 1 shown in FIG. 2. As shown in FIG. 2, the digital signage with security functions 1 is a device configured to integrate a photographing unit 10 (for example, a digital camera for shooting video), an information output unit 30 (for example, an image display means such as a monitor and an audio output means such as a speaker), and an information input unit 20 (for example, a microphone or touch panel). The arithmetic processing unit 40 can be connected as an external device and placed separately so as to be able to communicate with each other, or the integrated device can be configured so that the arithmetic processing unit 40 is further built into it. This allows the "digital signage with security functions" of the present invention to be an integrated information processing device in which all components are integrated.

[0027] On the other hand, the present invention can also be implemented as a distributed information processing system, i.e., a "digital signage system with security functions," that can achieve the same effects as the digital signage with security functions 1 by distributing all or some of the components of the digital signage with security functions 1 shown in FIG. 1 in any suitable location away from the other components. For example, the "digital signage system with security functions" of the present invention can be configured by distributing one or more digital cameras as the image capture units 10 in the vicinity of a conventional "digital signage" that has an information output unit 30 but does not have an image capture unit 10, and further by appropriately controlling each of these units using a cloud-based arithmetic processing unit 40. When the present invention is configured as a distributed system in this manner, the above components may be communicatively connected via various communication means, such as a wired connection using a dedicated communication cable, a wired LAN, a wireless LAN, short-range wireless communication, or a mobile phone line.

[0028] [Photography Department] The photographing unit 10 can be configured with various cameras capable of photographing the user or other people present within the photographable area of ​​the photographing unit. The cameras constituting the photographing unit 10 preferably have the function of outputting the photographed images (hereinafter also referred to as "monitoring images") as digital image data so that they can be processed by the arithmetic processing unit 40. Specifically, various existing digital cameras with video shooting functions can be used as the cameras constituting the photographing unit 10 without any particular restrictions.

[0029] Furthermore, a general monocular camera capable of continuously capturing images of a three-dimensional space that is the captureable area as two-dimensional images can be used as the camera that constitutes the imaging unit 10. Alternatively, a 3D camera that can directly obtain three-dimensional position information within the space that is the captureable area can also be used as the camera that constitutes the imaging unit 10.

[0030] When the monocular camera described above is used as the camera constituting the photographing unit 10, it is more preferable that the security-enabled digital signage 1 further includes a coordinate setting unit (not shown in FIG. 1) that sets identifiable coordinates by relating a position in the "surveillance image" to an actual position in a three-dimensional space that is the photographable area. The coordinate setting unit may be built into the photographing unit 10, or may be incorporated into the arithmetic processing unit 40. By providing a coordinate setting unit that can generate three-dimensional coordinates from two-dimensional image information, human movements can be detected with high accuracy even from images that contain only two-dimensional information that can be acquired by an inexpensive monocular camera, without introducing an expensive 3D camera.

[0031] 2, the photographing unit 10 can be configured such that a small camera is connected to or built into the information output unit 30 as the photographing unit 10, that is, the photographing unit 10 is incorporated into the device as part of the digital signage with security functions 1. In the digital signage with security functions 1 with a camera shown in FIG. 2, the area to be monitored is the area to be photographed by the photographing unit (camera) 10. In this case, by placing such a device (digital signage with security functions) in multiple locations as needed, facing in appropriate directions, any area can be made the area to be monitored.

[0032] [Information input section] The information input unit 20 is configured with various input devices that enable the user to input questions entered by the user as input values ​​to the calculation processing unit 40 (user support unit 41) when generating user support information as answers corresponding to the questions. Specifically, the information input unit 20 can be configured with a microphone that collects the user's voice, a touch panel input device, or the like.

[0033] [Information output section] The information output unit 30 is a device that displays to the user (the viewer of the security-enabled digital signage 1) the "user support information" or "suspicious behavior alert information" generated by the user support unit 41. For example, the information output unit 30 can be configured by a plasma display, an LED display, a VFD display, or any other type of projector, or other device capable of displaying text, video, or still images, and any type of speaker capable of outputting audio.

[0034] A preferred embodiment of the present invention is a display device of the same shape and size as a typical digital signage for sales promotions placed in a store, measuring between 1 and 2 meters in length and width, to which various components for realizing the security functions unique to the present invention are added. However, the display surface area of ​​the various displays constituting the information output unit 30 is not particularly limited. For example, the present invention can be applied to a wide range of displays, from small displays measuring a few square centimeters, such as those in small windows built into vending machines, to huge displays measuring several tens of square meters, installed on the wall of a building.

[0035] Of the "user support information" output by the information output unit 30, it is preferable that audio information, etc. that can be output through the avatar 100 as shown in Figure 2 be output in an output form that is output through the avatar 100 as information transmitted by the avatar 100.

[0036] The output of the "suspicious behavior alert information" by the information output unit 30 can also be output through the avatar 100 as information transmitted by the avatar 100 as shown in FIG. 2. This allows the suspicious behavior alert information to be transmitted from the avatar of a guide who normally transmits user assistance information, making it relatively easy to establish initial communication between the suspicious person and the system without raising the suspicious person's alarm. This communication (e.g., communication equivalent to a real store clerk calling out to prevent shoplifting) can increase the possibility of preventing crimes before they occur.

[0037] Alternatively, when necessary or effective depending on the output content, the output of "suspicious behavior alert information" by the information output unit 30 can be output in an output mode in which the avatar 100 in Figure 2, which resembles a guide, is instantly changed to an avatar that resembles a security guard, using the functions of digital signage that are capable of various visual expressions, such as switching the display content every second or displaying videos, as described above, and the information transmitted by the avatar that resembles a security guard is output through the avatar.

[0038] [Calculation processing unit] The arithmetic processing unit 40 essentially comprises a user support unit 41 and a suspicious behavior monitoring unit 42. The user support unit 41 performs arithmetic processing for generating user support information, and the suspicious behavior monitoring unit 42 performs arithmetic processing related to image analysis for extracting suspicious behavior of people in images ("surveillance images") captured by the imaging unit 10. To this end, the user support unit 41 has user support information generation means, and the suspicious behavior monitoring unit 42 has suspicious behavior extraction means.

[0039] When no suspicious behavior is detected (normal times), the calculation processing unit 40 controls the operation of the digital signage with security function 1 so that the user support information generated by the user support unit 41 is output from the information output unit 30. Furthermore, when suspicious behavior is detected by the suspicious behavior monitoring unit 42 (emergency times), the calculation processing unit 40 controls the overall operation of the digital signage with security function 1 so that suspicious behavior alert information is output from the information output unit 30.

[0040] The arithmetic processing unit 40 can be configured as a dedicated information processing device specialized for the above-described operations according to the implementation of the present invention. Alternatively, the arithmetic processing unit 40 can be configured using a personal computer, a tablet terminal, a smartphone, etc. Furthermore, the arithmetic processing unit 40 can be configured as an information processing device capable of operating as the user support unit 41 and the suspicious behavior monitoring unit 42, configured as a server on the cloud, which can be shared by a large number of clients.

[0041] In any of the above configurations, the arithmetic processing unit 40 can be configured by various known information processing devices, such as a computer equipped with hardware such as a CPU, memory, a communication unit, etc. The arithmetic processing unit 40 having the above configuration can specifically execute various operations of the security-enabled digital signage 1 using a computer "program."

[0042] (User Support Department) The user support unit 41 has a user support information generation means capable of generating various types of user support information to be output from the information output unit 30 as image information and / or audio information. User support information refers to all types of guidance information that can contribute to the convenience of users in the store, etc. The user support information includes information that is automatically output as appropriate by a program without being requested by the user, and information that is generated and output as answers to questions (input values) input by the user through the information input unit 20.

[0043] A specific example of user support information that is automatically and appropriately output by a program without being requested by the user is the "sales promotion content (video information of recommended products)" disclosed in Japanese Patent No. 6647612 (Patent Document 1) by the inventor of the present application. Furthermore, this type of user support information can also be generated by various publicly known video and audio content generation methods, including the method disclosed in Patent Document 1.

[0044] Furthermore, in order to generate and output user assistance information as answers to questions input by a user through the information input unit 20, it is preferable that the user assistance unit 41 be equipped with a machine learning information processing device having a neural network or various other types of artificial intelligence (AI). Various types of artificial intelligence systems on the cloud can also be used as such artificial intelligence (AI). This allows, for example, two-way communication via the avatar 100 to maintain a higher level of convenience for users in stores and other locations where the digital signage with security functions 1 is installed. This can also contribute to improving the security of such stores and other locations.

[0045] (Suspicious Behavior Monitoring Unit) The suspicious behavior monitoring unit 42 has a suspicious behavior extraction means that extracts suspicious behavior of a person (hereinafter also referred to as a "monitoring target") in the "monitoring image" by analyzing the image ("monitoring image") captured by the imaging unit 10. The suspicious behavior extraction means is an image analysis means that is employed in various known monitoring devices, and various known image analysis means that can extract specific movements and actions of a "monitoring target" through image analysis can be appropriately selected and employed without any particular limitations.

[0046] As an example, the image analysis means for detecting "specific actions" corresponding to suspicious behavior of a "surveillance target" from the image ("surveillance image") captured by the image capture unit 10 can be configured using various machine learning type image analysis devices having neural networks (so-called "image recognition devices using deep learning technology"). Specific examples of image recognition technology using deep learning are disclosed below. "Deep Learning and Image Recognition, Operations Research" (http: / / www.orsj.o.jp / archive2 / or60-4 / or60_4_198.pdf)

[0047] Furthermore, in order to mechanically recognize the details of the movements of the "surveillance target" in the "surveillance image," a known image analysis technology called "OpenPose" can be used, for example. As disclosed by the inventor of the present application in Japanese Patent No. 6534499, by using "OpenPose," it is possible to extract skeletal information of the person in the image and recognize the movements of the person in the image by analyzing the position and speed of each feature point that makes up the skeleton.

[0048] Furthermore, by using image analysis technology such as "OpenPose," it is possible to extract the hand movements of the "surveillance target" and the movements of merchandise, etc. (hereinafter referred to as "surveillance target items") in the "surveillance image" as separate pieces of information from the "surveillance image." By utilizing such a function, it is possible to mechanically detect the details of the "surveillance target"'s behavior toward the "surveillance target item" by analyzing the respective movements of the "surveillance target" and the "surveillance target item," as well as the difference between the two movements. This makes it possible to comprehensively determine the degree of suspiciousness of a "person"'s behavior toward an "item," such as "a person grabbing an object and taking it away."

[0049] An example of a specific configuration of the suspicious behavior monitoring unit 42 is a configuration in which, similar to the "monitoring device" disclosed by the inventor of the present application in Patent Publication No. 6534499, an information processing device or information processing system equipped with a "monitoring target identification unit" that can identify "monitoring target persons" and "monitoring target items" in "monitoring images", a "skeleton extraction unit" that extracts the skeletons of these monitoring targets, a "position identification unit" that identifies the positions of feature points extracted by the skeleton extraction unit, a "movement recognition unit" that recognizes the movement of the monitoring target based on information related to changes in the positions of the feature points, and a "suspicious movement determination unit" that determines the suspiciousness of the movement of the monitoring target by comparing the velocity vector of the "person" or "object" that is the monitoring target recognized by the "movement recognition unit" with a predetermined threshold and outputs the degree of suspiciousness of the movement of the monitoring target, can be used as the suspicious behavior extraction means of the suspicious behavior monitoring unit 42.

[0050] The suspicious behavior monitoring unit 42 may further include various ID information acquisition means and a determination history storage means including a database including various storage devices, so that the storage means can store combinations of ID information (preferably facial authentication information) of each "monitored person," the past behavioral history of the "monitored person," and the suspiciousness level determination results for each behavior. This allows the stored behavioral history of the "monitored person" to be referenced to adjust the suspiciousness level determination results, further improving the accuracy of the suspiciousness level determination. For example, for a "monitored person" who is determined to be a suspicious customer based on the behavioral history, the threshold used to determine suspicious behavior may be lowered. Alternatively, a separate alert message indicating that the "monitored person" is a "suspicious customer" may be sent to a monitoring operator, regardless of the suspiciousness level determination results for the "monitored person"'s current behavior.

[0051] [Digital signage with security features in operation] In the digital signage 1 with security functions, a surveillance and photography step and a suspicious behavior extraction step are constantly performed. If no suspicious behavior is extracted by the suspicious behavior extraction step (normal times), a user support information output step is performed. On the other hand, if suspicious behavior is extracted by the suspicious behavior extraction step (emergency times), a suspicious behavior alert information output step is performed.

[0052] (Surveillance shooting step) In the surveillance photographing step, the actions of the "surveillance target" are photographed by the photographing unit 10. The "surveillance image" photographed in the surveillance photographing step is output as image data in a digital format, input to the calculation processing unit 40, and subjected to predetermined calculation processing.

[0053] (Suspicious behavior extraction step) In the suspicious behavior extraction step, a "specific behavior" of the "person being monitored" is extracted by image analysis processing of the "monitoring image" obtained in the monitoring and photographing step. If the suspiciousness level of the extracted "specific behavior" exceeds a predetermined threshold, a suspicious behavior alert information output step is performed. If the suspiciousness level of the "specific behavior" does not exceed the predetermined threshold, the process returns to the monitoring and photographing step and monitoring work continues.

[0054] (User support information output step) In the user assistance information output step, various types of user assistance information are generated in the user assistance unit 41 and output from the information output unit 30. One example of the user assistance information is "sales promotion content" that includes images of related items that are effective in stimulating the desire to purchase a product. In the user assistance information output step, in addition to generating user assistance information such as the above-mentioned "sales promotion content," it is preferable that a "display schedule" that controls the timing of displaying the user assistance information is also automatically generated.

[0055] Furthermore, the output of the user assistance information in the user assistance information output step can be output as information transmitted by avatar 100 displayed on information output unit 30. Furthermore, user assistance information generated and output as an answer to a question input by the user through information input unit 20 can also be output as information transmitted by avatar 100.

[0056] (Suspicious behavior alert information output step) In the suspicious behavior alert information output step, if the result of the judgment in the suspicious behavior extraction step indicates that the suspiciousness level of the "specific behavior" of the "person to be monitored" exceeds a predetermined threshold, appropriate suspicious behavior alert information according to the suspiciousness level of the "person to be monitored" is output from the information output unit 30. As an example, an avatar 100 displayed on the information output unit 30 of the digital signage 1 with security functions placed in a store can effectively prevent crimes from occurring by calling out to the suspicious person, such as "Is there something I can help you with?", depending on the content of the suspicious behavior alert information.

[0057] Furthermore, in the suspicious behavior alert information output step, it is preferable to simultaneously transmit the suspicious behavior alert information to the information processing terminals of guides or security guards located in the store where the security-enabled digital signage is installed, or to security guards remotely monitoring the store. In this way, the suspicious behavior alert information can be transmitted to guides or security guards of the monitored store as information that is effective in deterring crime.

[0058] (Avatar movement) In the digital signage 1 with security functions, the avatar 100 displayed on the information output unit 30 can respond to users, thereby promoting unmanned or labor-saving operations in stores and other facilities. Users can interact with the avatar 100, which acts as a guide, through two-way communication to obtain user support information such as product information tailored to their purchasing needs and store information on product locations. Furthermore, if suspicious behavior that could lead to crimes such as shoplifting is detected, the avatar 100 can automatically speak to the user (suspicious person) to prevent crimes from occurring. The avatar 100 can respond to users by remotely controlling the avatar with an operator, by fully automatically controlling the avatar with AI (artificial intelligence), or by a hybrid approach that combines these two methods. [Explanation of symbols]

[0059] 1. Digital signage with security features 10. Photography Department 20 Information input section 30 Information output section 40 Processing unit 41 User Support Department 42 Suspicious Behavior Monitoring Department 100 Avatars

Claims

1. The imaging device includes an imaging unit, an information output unit, and an arithmetic processing unit, the arithmetic processing unit includes a user support unit and a suspicious behavior monitoring unit, the user support unit has a user support information generation means for generating user support information, the suspicious behavior monitoring unit has a suspicious behavior extraction means that extracts suspicious behavior of a person in the image by analyzing the image captured by the image capturing unit, the information output unit outputs the user support information when the suspicious behavior is not extracted, and outputs suspicious behavior alert information when the suspicious behavior is extracted. Digital signage with security features.

2. The information output unit displays a guide's avatar, The user support information is output as information transmitted by the avatar. The digital signage with a security function according to claim 1 .

3. The suspicious behavior alert information is output as information transmitted by the avatar. The digital signage with a security function according to claim 2.

4. further comprising an information input unit for a user to input questions; The user support unit has, as a user support information generation means, a machine learning type information processing device having a neural network or other artificial intelligence (AI), The information processing device or the artificial intelligence (AI) uses the questions as input values ​​and outputs the user support information corresponding to the input values.

4. The digital signage with a security function according to claim 1.

5. An information processing system in which an imaging unit, an information output unit, and an arithmetic processing unit are communicatively connected, the arithmetic processing unit includes a user support unit and a suspicious behavior monitoring unit, the user support unit has a user support information generation means for generating user support information, the suspicious behavior monitoring unit has a suspicious behavior extraction means that extracts suspicious behavior of a person in the image by analyzing the image captured by the image capturing unit, the information output unit outputs the user support information when the suspicious behavior is not extracted, and outputs suspicious behavior alert information when the suspicious behavior is extracted. Digital signage system with security features.

6. The information output unit displays a guide's avatar, The user support information is output as information transmitted by the avatar. The digital signage system with a security function according to claim 5.

Citation Information

Patent Citations

  • Information processing system, information processing device, information processing method, and program

    JP2023007309A

  • Information processing device, information processing method, and program

    JP2023020307A

  • Digital Signage

    JP6647612B1

  • Self-checkout register monitoring system and self-checkout register monitoring method

    JP7039084B1

  • KR20230113877A