Information processing system, information processing method and program

Abstract

To provide an information output device that generates and outputs information capable of identifying a person from acquired information and information not capable of identifying the person.SOLUTION: An information output device comprises: an acquisition unit that acquires acquired information from a camera; a first output unit that outputs first output information, with which a person can be identified, on the basis of the acquired information acquired by the acquisition unit; and a second output unit that outputs data which is generated by analyzing attribute information based on an action of a person included in the acquired information, as second output information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] With the spread of IoT (Internet of Things) technology, various solutions using real-world data captured by cameras are being offered. A typical example is a security company remotely monitoring image data captured by security cameras and using it for security purposes such as crime prevention. Another possible use is setting up observation cameras in sales areas to capture images of customer purchasing behavior, analyzing the captured image data, and using it for marketing purposes.

[0003] Images captured by cameras often show individuals' faces, making the handling of this image data problematic. Furthermore, while systems for security purposes require personal information (image information that can identify individuals), systems for marketing purposes only require identifying attribute information such as the age group and gender of customers, and do not require the identification of individuals. For this reason, surveillance cameras and systems for security purposes and observation cameras and systems for marketing purposes are generally installed separately. This configuration prevents the leakage of personal information (image information that can identify individuals) captured for security purposes in the marketing system.

[0004] As a related technology, Patent Document 1 describes a system that protects the privacy of children when a parent of a child attempts to view image data captured at a kindergarten or other facility by distributing image data with the faces of other children masked, thereby protecting the privacy of other children. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2009-159221 A Summary of the Invention [Problem to be solved by the invention]

[0006] As mentioned above, installing security cameras and systems for security purposes and observation cameras and systems for marketing purposes separately entails issues such as high costs due to the need for twice the installation space, incurring equipment costs, installation costs, operating costs, and a lack of installation space.

[0007] An example of an object of the present invention is to provide an information processing system, an information processing method, and a program that solve the above-mentioned problems. [Means for solving the problem]

[0008] According to one aspect of the present invention, an information processing system is provided with a camera, a first server terminal device on which a security system operates, and a second server terminal device on which a marketing system operates, wherein the camera is provided with an imaging means for performing imaging, an image acquisition means for acquiring the captured image information, and an output means for outputting the image information to the first server terminal device as first output information by which an individual can be identified, and for outputting attribute information based on the movements of a person contained in the image information to the second server terminal device as second output information.

[0009] According to one aspect of the present invention, the first output information is the image information that has been encrypted, and the first server terminal device includes a decryption means for decrypting the acquired first output information.

[0010] According to one aspect of the present invention, an information processing method includes a camera performing image capture, acquiring the captured image information, outputting the image information as first output information capable of identifying an individual to a first server terminal device in which a security system is operating, and outputting attribute information based on the movements of the person contained in the image information as second output information to a second server terminal device in which a marketing system is operating.

[0011] According to one aspect of the present invention, the program causes a computer equipped with a camera to perform the following processes: cause the camera to capture an image, acquire the captured image information, output the image information as first output information capable of identifying an individual to a first server terminal device in which a security system is operating, and output attribute information based on the movements of the person contained in the image information as second output information to a second server terminal device in which a marketing system is operating. Effect of the Invention

[0012] According to the embodiment of the present invention, it is possible to output information obtained by encrypting image data captured by one camera and information obtained by converting personal information into attribute information. [Brief description of the drawings]

[0013] [Figure 1] FIG. 2 is a diagram showing a configuration of an edge terminal device according to the first embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing a specific configuration of an edge terminal device according to the first embodiment of the present invention. [Diagram 3] 1 is a diagram showing an example of an information output system according to a first embodiment of the present invention. [Figure 4] FIG. 4 is a diagram showing a processing flow of the edge terminal device according to the first embodiment of the present invention. [Diagram 5] FIG. 2 is a diagram showing a processing flow of a server terminal device in which the security system according to the first embodiment of the present invention operates. [Figure 6] A diagram showing a processing flow of a server terminal device on which a marketing system according to the first embodiment of the present invention operates. [Figure 7] FIG. 11 is a diagram showing an example of an information output system according to a second embodiment of the present invention. [Figure 8] FIG. 13 is a diagram showing an example of an information output system according to a third embodiment of the present invention. [Figure 9] FIG. 13 is a diagram showing a configuration of an edge terminal device according to a fifth embodiment of the present invention. [Figure 10]FIG. 13 is a diagram showing the configuration of a camera according to a sixth embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] First Embodiment An edge terminal device 1 according to a first embodiment of the present invention will be described below with reference to FIGS. FIG. 1 is a diagram showing the configuration of an edge terminal device 1 according to the first embodiment of the present invention. As shown in FIG. 1, the edge terminal device 1 includes at least a first output unit 12 and a second output unit 13. The first output unit 12 outputs the information acquired by the sensor. The second output unit 13 converts personal information included in the acquired information acquired by the sensor into attribute information that does not identify an individual and outputs the converted information. The acquired information acquired by the sensor includes, for example, image data captured by a camera, voice collected by a microphone, fingerprints, palm prints, vein patterns, iris patterns, etc.

[0015] FIG. 2 is a diagram showing a specific configuration of the edge terminal device according to the first embodiment of the present invention. As shown in FIG. 2, the edge terminal device 1 includes an information acquisition unit 11, a first output unit 12, a second output unit 13, a communication unit 14, an output determination unit 15, a storage unit 16, and a first connection unit 18.

[0016] The first connection portion 18 is connected to a sensor S installed in a space where a customer is present. The information acquisition unit 11 acquires various sensing data (real world information) related to the behavior of the customer and the environment surrounding the customer from the sensor S via the first connection unit 18. The sensing data is, for example, image data of an image of the customer. In the following, an example will be described in which the sensor S is a camera and the acquired information is image data captured by the camera. The image data includes moving images and still images. The first output unit 12, for example, scrambles (encrypts) the image data acquired by the information acquisition unit 11, and outputs the scrambled data to another device via the communication unit 14. The other device is, for example, an information processing device such as a server constituting a security system of a security company.

[0017] The second output unit 13 performs a personal information conversion process to convert personal information (information that can identify an individual) included in the acquired information into attribute information that cannot identify an individual. For example, the second output unit 13 may pixelate the face of an individual that appears in the image data acquired by the information acquisition unit 11, or replace it with an avatar. The second output unit 13 may analyze the image of the customer that appears in the image data using an image recognition technology, and estimate the age group, sex, location information, and the like of the customer. The second output unit 13 may calculate the movement line and the behavior in front of the shelf of the customer that appears in the image data from the image data captured over a predetermined period, and generate data (text data, etc.) that indicates the behavior of the customer that is necessary for marketing. The second output unit 13 outputs the image data that has been subjected to the personal information conversion process to another device via the communication unit 14. The other device is, for example, an information processing device such as a server that constitutes a marketing system that analyzes marketing information in a data center or the like. The movement line is information that indicates the movement route of the customer. The behavior in front of the shelf is the behavior related to the selection of a product that a customer performs in front of the product shelf.

[0018] The communication unit 14 communicates with other devices. The output determination unit 15 determines whether or not to output the data obtained by the personal information conversion process performed by the second output unit 13 from the second output unit 13 . The storage unit 16 stores programs and various types of information. The first output unit 12, the second output unit 13, and the output determination unit 15 are functions that are provided by a CPU (Central Processing Unit) provided in the edge terminal device 1 executing a program.

[0019] FIG. 3 is a diagram showing an example of an information output system according to the first embodiment of the present invention. The information output system shown in FIG. 3 includes at least one edge terminal device 1, at least one camera (sensor) 4, a server terminal device 2, and a server terminal device 3. The edge terminal device 1 is installed in a store 100. The camera 4 is connected to the edge terminal device 1. The server terminal device 2 is provided in a data center 200. The server terminal device 3 is provided in a data center 300. The edge terminal device 1 is installed relatively close to customers, and performs a process that is appropriate to be performed before transmitting to the server terminal devices 2 and 3 of the data centers 200 and 300. In the first embodiment, for example, the edge terminal device 1 performs a process of encrypting personal information and a process of converting personal information into attribute information that does not allow an individual to be identified. The edge terminal device 1, the server terminal device 2, and the server terminal device 3 are connected via a network NW. A security system for monitoring is operated in the server terminal device 2. A marketing system is operated in the server terminal device 3.

[0020] 3, the server terminal device 2 includes a communication unit 21, a decryption unit 22, an application execution unit 23, and a storage unit 24. The communication unit 21 communicates with other devices such as the edge terminal device 1 and the server terminal device 3. The decryption unit 22 decrypts scrambled (encrypted) image data acquired from the edge terminal device 1. The application execution unit 23 executes each application program of the security system. The storage unit 24 stores various application programs and decrypted image data.

[0021] 3, the server terminal device 3 includes a communication unit 31, an application execution unit 33, and a storage unit 34. The communication unit 31 communicates with other devices such as the edge terminal device 1 and the server terminal device 2. The application execution unit 33 executes each application program of the marketing system. The storage unit 24 stores various application programs and image data that has been acquired from the edge terminal device 1 and has undergone personal information conversion processing.

[0022] The camera 4 is installed, for example, at a position overlooking the store 100, and continues to capture images of the inside of the store 100. Image data captured by the camera 4 is used for the purpose of monitoring shoplifting, robbery, etc., as well as for the purpose of understanding the behavior of customers shopping at the store 100 and using it for marketing. The camera 4 outputs the captured image data to the edge terminal device 1. The edge terminal device 1 performs scrambling processing on the acquired image data for crime prevention purposes. The edge terminal device 1 transmits the scrambled image data to a server terminal device (outside the edge terminal device 1) 2. The edge terminal device 1 also performs personal information conversion processing on the acquired image data for marketing purposes. The edge terminal device 1 transmits the image data that has been subjected to the personal information conversion processing to a server terminal device (outside the edge terminal device 1) 3. A security system is running in the server terminal device 2. For example, a security guard monitors the image data received by the server terminal device 2. The image data received by the server terminal device 2 is stored as evidence in a storage device (or storage unit 24) provided in the data center 200 for a predetermined period of time. The server terminal device 3 performs analysis on image data received from the edge terminal device 1 and data that has been image-recognized and converted to text. Based on the analysis results, the server terminal device 3 may determine best-selling items for each age group and gender. Based on the analysis results, the server terminal device 3 may perform marketing analysis, such as calculating locations where many customers pass through from the customer movement lines within the store and generating information that can be used as a reference for product placement locations. The movement lines are information that indicate the routes taken by customers.

[0023] It is preferable that the security image data is image data including personal information (for example, an image in which a face can be recognized). This is because the security system needs to identify a person who has committed shoplifting or the like. However, if the image data including personal information is transmitted as is from the edge terminal device 1 of the store 100 to the server terminal device 2 of the data center 200 via the network NW, for example, the personal information may be leaked by capturing packets during network transmission. For this reason, in the edge terminal device 1, the first output unit 12 scrambles (encrypts) the image data to be transmitted using a predetermined method. The communication unit 14 transmits the scrambled image data to the server terminal device 2. This makes it possible to prevent leakage of personal information during network transmission. The server terminal device 2 performs descrambling on the received image data to return it to the original image before the scrambling process. Only the server terminal device 2 has a decryption key for decrypting the image data scrambled by the first output unit 12. For this reason, only the server terminal device 2 can decrypt the acquired image data and restore it to the original image data including the personal information. On the other hand, even if a third party obtains the image data transmitted by the first output unit 12, they cannot restore the original image data including the personal information. This makes it possible to prevent leakage of personal information. The server terminal device 2 may enable surveillance by a security guard using the decrypted image data. The server terminal device 2 may check whether the decrypted security image data includes a person registered on a blacklist by comparing the decrypted image data with image data of a person who has engaged in some problematic behavior in the past and is registered on a so-called blacklist.

[0024] Next, the marketing data (or image data) does not need to include data that can identify an individual. This is because the marketing system only needs to acquire attribute information such as the age group and sex of the customer. In addition, transmitting and receiving image data that includes personal information as it is through the network NW or storing it in the server terminal device 3 or the like is problematic in terms of the leakage of personal information. Therefore, the second output unit 13 extracts attribute information of the customer reflected in the image composed of the image data from the image data captured by the camera 4, and transmits the extracted attribute information and image data converted so that the personal information cannot be recognized to the server terminal device 3 of the data center 300. The process of converting the personal information so that it cannot be recognized is performed by the second output unit 13. For example, the second output unit 13 may recognize the face of the customer by image recognition and perform image processing to pixelate the area of ​​the face. In this case, the second output unit 13 records the attribute information of the customer such as the age group and sex in the storage unit 16 by linking it to the identification information of the customer. The second output unit 13 may replace the face image of the customer with an avatar image. In this case, the replaced avatar image is an avatar image linked to attribute information such as the age group and sex of the customer. The second output unit 13 may record the attribute information of the customer in the storage unit 16 by linking it to the identification information of the avatar image. The second output unit 13 transmits to the server terminal device 3 data linking the attribute information of the customer with the customer and the avatar image together with the image data with the personal information converted. If the image data with the personal information converted is used, there is no need to worry about the personal information being leaked even if it is intercepted during transmission and reception via the network NW. Furthermore, even if the image data with the personal information converted is stored in the server terminal device 3 for marketing analysis, there is no need to be careful about how the personal information is handled.

[0025] The server terminal device 3 acquires image data converted so that personal information cannot be recognized and attribute information of the customer, and therefore can perform marketing analysis. For example, the server terminal device 3 may acquire image data after personal information conversion processing and attribute information of the customer, and analyze the movement line indicating the movement route of each customer in the store, and the behavior in front of the shelf, such as which product was picked up and actually purchased or returned to the shelf. In this specification, the attribute information includes not only the age group and sex of the customer, but also the movement line, the behavior in front of the shelf, and the position information of the customer. In other words, the second output unit 13 may have a function of performing marketing analysis, and may analyze the movement line and the behavior in front of the shelf by using the function, and generate information including the age group, sex, movement line, behavior in front of the shelf, and the like of the customer as text data. Furthermore, the second output unit 13 may transmit this text data to the server terminal device 3.

[0026] Next, the output process by the edge terminal device 1 will be described. FIG. 4 is a first diagram showing the processing flow of the edge terminal device 1 according to the first embodiment of the present invention. The process in which the edge terminal device 1 converts and outputs image data will be described with reference to Fig. 4. It is assumed that the camera 4 is capturing an image of the store 100. First, in the edge terminal device 1, the information acquisition unit 11 acquires image data captured by the camera 4 from the camera 4 (step S11). The information acquisition unit 11 outputs the acquired image data to the first output unit 12. Next, the first output unit 12 acquires an encryption key recorded in advance in, for example, the storage unit 16 (step S12). Next, the first output unit 12 performs a scrambling process on the image data acquired from the information acquisition unit 11 using the encryption key (step S13). The encryption key is, for example, a public key or a common key provided by the security system side. The scrambling process may be performed using a known image encryption method. Next, the first output unit 12 transmits the security image data after the scrambling process to the server terminal device 2 via the communication unit 14 (step S14).

[0027] The edge terminal device 1 performs the following processes in parallel with the processes of steps S12 to S14. First, the output determination unit 15 determines whether or not to output marketing image data from the second output unit 13 (step S15). For example, if the current time is not within the business hours of the store 100, there are no customers in the store 100 and no purchasing behavior occurs. For this reason, the useful value of the marketing image data is low. Therefore, it is not necessary to output the marketing image data during the time period when there are no customers. In this case, for example, the business hours of the store 100 are recorded in advance in the storage unit 16. The output determination unit 15 reads out the information on the business hours from the storage unit 16 and determines whether the current time is included in the business hours. If the current time is included in the business hours, the output determination unit 15 determines to output the marketing image data. If the current time is within the business hours but there are no customers, it is not necessary to output the marketing image data. In this case, a face image of the store clerk is recorded in advance in the storage unit 16. The output determination unit 15 obtains image data from the information acquisition unit 11, and uses image recognition to check whether or not a person other than a store clerk is shown in the obtained image data. If a person other than a store clerk is shown in the image data, the output determination unit 15 may determine to output the marketing image data.

[0028] When the output determination unit 15 determines that the marketing image data is to be output (step S15: Yes), the information acquisition unit 11 outputs the acquired image data to the second output unit 13. The second output unit 13 performs a personal information conversion process on the acquired image data (step S16). The second output unit 13 recognizes people appearing in the video from the acquired image data, and estimates the age group and sex of each person based on the face image of each person using a known face recognition technology or the like. The second output unit 13 may, for example, recognize the color of the clothes worn by the person using a known color recognition technology, use it as a mark to identify the person, and associate attribute information such as the estimated gender with the person and record it in the storage unit 16. Information that associates attribute information with a person is, for example, information in which a person called "customer wearing red clothes" is associated with attribute information such as "gender: female" and "age group: 20s". Alternatively, the second output unit 13 may perform the following process. That is, the second output unit 13 reads out a pre-stored avatar image corresponding to the estimated age group and gender from the storage unit 16. The second output unit 13 recognizes the face image of the person by face recognition technology. The second output unit 13 replaces the face image of the person with an avatar image that has a similar facial contour to the person. Alternatively, when the second output unit 13 has a marketing analysis function, the following process may be performed. That is, the second output unit 13 acquires image data captured over a predetermined time period. The second output unit 13 calculates the position information of the person in each video by using known techniques such as feature point extraction and object tracking technology, using the clothes worn by each person as a marker. Furthermore, the second output unit 13 may calculate the movement line of each person based on the time-series position information. The second output unit 13 may detect arm movements and changes in face direction from multiple time-series image data, and analyze the person's behavior in front of the shelf from the movement of the person reaching out to the product shelf and the direction of the person's gaze. The second output unit 13 may generate text data of information such as the movement line and the behavior in front of the shelf in addition to the age group and gender. The text data is, for example, information such as "Customer 001, male, in his 20s, moved from shelf A to shelf B, picked up and purchased product C". The second output unit 13 outputs image data converted so that personal information cannot be identified, or text data. The second output unit 13 transmits the marketing image data (including the attribute information and the text data) to the server terminal device 3 (step S17).

[0029] If the output determination unit 15 determines that the marketing image data is not to be output (step S15: No), the process proceeds to step S18. Next, when the camera 4 ends image capture due to, for example, an administrator's operation to stop image capture (step S18: Yes), this processing flow ends. If the camera 4 continues image capture (step S18: No), the processing from step S11 is repeated.

[0030] In step S13, the case where the encryption key is pre-recorded in the storage unit 16 has been described as an example, but the first embodiment is not limited to this configuration. As an example, a case where the server terminal device 2 is equipped with an encryption key generation unit 25 (see FIG. 3) will be described. In this case, the encryption key generation unit 25 generates an encryption key (one-time password) at predetermined time intervals. The communication unit 21 transmits the encryption key. The communication unit 14 acquires the encryption key via the network NW. The first output unit 12 performs scrambling processing with the encryption key. The output determination unit 15 may determine whether the image data includes a person by image recognition, and the first output unit 12 may perform scrambling only when the image data includes a person. The first output unit 12 may recognize a human face by image recognition, and perform scrambling only on an image of a human face.

[0031] FIG. 5 is a diagram showing a process flow of the server terminal device 2 on which the security system according to the first embodiment of the present invention operates. With reference to FIG. 5, a process in which the security system running on the server terminal device 2 uses image data acquired from the edge terminal device 1 will be described. First, in the server terminal device 2, the communication unit 21 acquires security image data via a network (step S21). The communication unit 21 outputs the acquired security image data to the decryption unit 22. Next, the decryption unit 22 performs a descrambling process to decrypt the acquired security image data, for example, by using a private key corresponding to the public key used by the first output unit 12 for the scrambling process (step S22). The decryption unit 22 records the decrypted image data including the personal information in the storage unit 24. Next, the application execution unit 23 executes an application program of the security system to use the descrambled image data (step S23). A specific example of the use of image data will be described. For example, the application execution unit 23 may compare image data of a person appearing in an image composed of image data with image data of a person registered on a blacklist, etc., by face recognition technology, and determine whether a person considered to be dangerous is present in the store 100. As another example, when a security guard monitors in real time and finds an occurrence of a robbery, shoplifting, or the like in the store 100, the image data may be used to identify a person involved in the incident.

[0032] FIG. 6 is a diagram showing a processing flow of the server terminal device 3 on which the marketing system according to the first embodiment of the present invention operates. With reference to FIG. 6, a process in which the marketing system running on the server terminal device 3 uses image data acquired from the edge terminal device 1 will be described. First, in the server terminal device 3, the communication unit 31 acquires marketing image data via the network NW (step S31). The communication unit 31 records the acquired marketing image data in the storage unit 34. Next, the application execution unit 33 executes an application program of the marketing system to use the image data and attribute information in which personal information has been converted into attribute information (step S32). A specific example of the use of image data and attribute information will be described. For example, the application execution unit 33 may generate information useful for sales promotion by predicting product demand and analyzing purchasing trends according to age group, sex, region, season, etc. from attribute information of customers shown in the image data (age group, sex, movement line, behavior in front of the shelf).

[0033] According to the first embodiment, it is possible to output data containing personal information for security purposes and data containing customer attribute information for marketing purposes without having to separately install security cameras and systems for security purposes and observation cameras and systems for marketing purposes.

[0034] Second Embodiment Hereinafter, an information output system according to a second embodiment of the present invention will be described with reference to FIG. Fig. 7 is a diagram showing an example of an information output system according to the second embodiment of the present invention, with reference to Fig. 7, differences between the second embodiment and the first embodiment will be described. As shown in Fig. 7, in the information output system according to the second embodiment, an external terminal unit 5 is connected to an edge terminal device 1. The external terminal unit 5 is provided, for example, by an operator of the security system of the server terminal device 2 to a store 100 that uses the services of the security system. The external terminal unit 5 is, for example, a USB dongle. An encryption program for performing scrambling and an encryption key are recorded in the external terminal unit 5. The first output unit 12 of the edge terminal device 1 calls and executes the encryption program recorded in the external terminal unit 5, and performs scrambling on the image data acquired from the information acquisition unit 11. If the external terminal unit 5 is not connected, the first output unit 12 does not operate and image data cannot be output. In the server terminal device 2, a decryption key corresponding to the encryption key recorded in the external terminal unit 5 is recorded in the storage unit 24. The decryption unit 22 performs a descrambling process on the image data using this decryption key.

[0035] In this way, part of the scrambling function of the first output unit 12 is distributed to the external terminal unit 5. Furthermore, the provider of the external terminal unit 5 is the operator of the security system. This allows the operator of the security system to keep information regarding the encryption of image data secret. As a result, security can be easily ensured. Furthermore, since the edge terminal device 1 does not need to implement a scrambling function, development costs can be reduced.

[0036] <Third embodiment> Hereinafter, an information output system according to a third embodiment of the present invention will be described with reference to FIG. Fig. 8 is a diagram showing an example of an information output system according to a third embodiment of the present invention. Referring to Fig. 8, differences between the third embodiment and the first and second embodiments will be described. As shown in FIG. 8, in the information output system according to the third embodiment, a card reading device 6 is connected to an edge terminal device 1. That is, the edge terminal device 1 has a second connection unit 19 to which the card reading device 6 is connected. A key card 7 on which an encryption key is recorded is attached to the card reading device 6. A first output unit 12 of the edge terminal device 1 reads out the encryption key recorded in the key card 7 via the second connection unit 19. The first output unit 12 uses the read encryption key to perform a scramble process on the image data acquired from the information acquisition unit 11. Similarly, a card reading device 8 is connected to a server terminal device 2. That is, the server terminal device 2 has a connection unit 26 to which the card reading device 8 is connected. For example, a key card 9 is attached to the card reading device 8. A decryption key corresponding to the encryption key of the key card 7 is recorded on the key card 9. In the server terminal device 2, a decryption unit 22 decrypts the scrambled image data acquired from the edge terminal device 1 using the decryption key recorded on the key card 9. The key cards 7 and 9 may be, for example, IC cards. In this way, in the third embodiment, the encryption key is modularized and recorded on a removable medium (key card). By using the key cards 7 and 9 that store a digital certificate issued by a formal certification authority, the reliability of the encryption system can be guaranteed and the risk of personal information leakage can be reduced.

[0037] <Fourth embodiment> In the first to third embodiments, the case where the acquired information acquired by the information acquiring unit 11 is image data has been described as an example. In the fourth embodiment, the acquired information is other than image data.

[0038] [When acquired information is audio] When the acquired information is voice, the sensor S connected to the edge terminal device 1 is, for example, a microphone equipped with a sound collection function. The first output unit 12 encrypts and outputs the voice data acquired by the microphone. The second output unit 13 estimates the age group and sex of the speaker from the acquired voice data, and records the estimated information in the storage unit 16 in association with the voice data. The second output unit 13 performs processing such as band compression and noise addition on the acquired voice data so that the individual cannot be identified by voiceprint analysis as a personal information conversion process. Then, the second output unit 13 outputs the voice data after the personal information conversion process. The second output unit 13 may output attribute information together with the voice data after the personal information conversion process. The second output unit 13 may convert not only the age group of the speaker but also the content of the speaker into text data or the like using a voice recognition technology and output the text data or the like. When the acquired information is voice, information such as gender, age group, and what is being said is attribute information.

[0039] In the server terminal device 2, the decryption unit 22 decrypts the encrypted audio. The application program of the security system executed by the application execution unit 23 may use the decrypted audio data for monitoring. The application execution unit 23 may record the decrypted audio data in the storage unit 24 as evidence. In the server terminal device 3, the application program of the marketing system executed by the application execution unit 33 performs an analysis of the needs of customers who visit the store 100 using the attribute information and converted voice data or voice-recognized text data acquired via the communication unit 31. For example, by having each salesperson wear a microphone and analyzing the conversation between the salesperson and the customer, it is possible to analyze, for example, what kind of products the customer is looking for or customer complaints, and use this information to create a better store.

[0040] [When acquired information is fingerprint, palm print, vein pattern, iris pattern, etc.] When the acquired information is fingerprint data, the sensor S is a fingerprint sensor. Nowadays, biometric authentication using fingerprint data and the like is increasingly being used. A specific example in which a fingerprint sensor is provided in the store 100 will be described below. The store 100 has introduced a special customer system in which various benefits are given. As a condition for a customer to become a special customer of the store 100, the customer's fingerprint data and personal information are recorded in advance in association with the storage unit 16 of the edge terminal device 1. When the customer touches his / her finger to a fingerprint sensor at the entrance or at the cash register for authentication, points are added to the customer, for example, for each visit to the store. When fingerprint authentication is performed at the cash register, points according to the amount of purchase are given. In this case, the first output unit 12 encrypts and outputs fingerprint data acquired from the fingerprint sensor connected to the edge terminal device 1. The second output unit 13 acquires information such as the age group and sex of the customer from the personal information of the customer recorded in association with the fingerprint data in the storage unit 16 of the edge terminal device 1 from the acquired fingerprint data. If information such as whether the customer is a good customer or not, the number of visits to the store, etc. is recorded in association with the fingerprint data for each customer in the storage unit 16, the second output unit 13 may read out such information. Such information, that is, information such as gender, age group, whether or not the customer is a good customer, and the number of visits to the store, is attribute information. The second output unit 13 outputs attribute information corresponding to the fingerprint data acquired from the information acquisition unit 11 .

[0041] In the server terminal device 2, the decryption unit 22 decrypts the encrypted fingerprint data. The security system application program executed by the application execution unit 23 records the decrypted fingerprint data in the storage unit 24 in association with, for example, the location information of the store 100 or the time when the fingerprint data was acquired. This serves as evidence that the customer was in the store 100 at that time. In the server terminal device 3, the application program of the marketing system executed by the application execution unit 33 performs an analysis of the purchasing behavior of special customers who visited the store 100 using the attribute information acquired via the communication unit 31. For example, if the store 100 is a chain store, it is possible to know the purchasing behavior of special customers across multiple stores. The same applies to cases where the acquired information is a palm print, vein pattern, or iris pattern as to fingerprint data.

[0042] <Fifth embodiment> The fifth embodiment is an embodiment in which there is only one output unit. The edge terminal device 1 according to the fifth embodiment of the present invention will be described below with reference to FIG. FIG. 9 is a diagram showing the configuration of the edge terminal device 1 according to the fifth embodiment of the present invention. As shown in FIG. 9, the edge terminal device 1 includes at least an output unit 17. The output unit 17 outputs at least one of first output information that outputs the acquired information acquired by the sensor, and second output information that converts personal information included in the acquired information acquired by the sensor into attribute information that cannot identify an individual.

[0043] An example of a specific configuration of the edge terminal device 1 in the fifth embodiment will be described. The edge terminal device 1 in the fifth embodiment includes an information acquisition unit 11, a communication unit 14, an output determination unit 15, and a storage unit 16 in addition to the output unit 17. These configurations are similar to those described with reference to FIG. 2.

[0044] The processing flow of the fifth embodiment will be described with reference to Fig. 4. First, the information acquisition unit 11 acquires image data captured by the camera 4 (step S11). The information acquisition unit 11 outputs the acquired image data to the output unit 17. Next, the output unit 17 acquires an encryption key (step S12) and performs a scrambling process on the image data acquired from the information acquisition unit 11 (step S13). Next, the output unit 17 selects a communication interface of the communication unit 14 that is connected to the server terminal device 2, and transmits the security image data (first output information) after the scrambling process to the server terminal device 2 via the communication interface (step S14). The output determination unit 15 determines whether to output the marketing image data (step S15), and outputs the result to the output unit 17. The output determination unit 15 may determine whether the image data includes a person by image recognition, and may determine to output the marketing image data only when the image data includes a person. If the output determination unit 15 determines to output the marketing image data, the output unit 17 performs a personal information conversion process on the image data acquired from the information acquisition unit 11 (step S16) to generate marketing image data (including attribute information and text data). Next, the output unit 17 selects a communication interface connected to the server terminal device 3 from the communication unit 14, and transmits the generated marketing image data (second output information) to the server terminal device 3 via the communication interface (step S17). Other processing steps are the same as those in the first embodiment. The output determination unit 15 may determine whether or not the image data includes a person by image recognition, and transmit the security image data to the server terminal device 2 only if the image data includes a person.

[0045] Sixth Embodiment A camera 5 according to a sixth embodiment of the present invention will now be described with reference to FIG. As shown in Fig. 10, the camera 5 has an edge terminal device 1 and a camera function unit 51. The configuration and function of the edge terminal device 1 shown in Fig. 10 are the same as those of the edge terminal device 1 shown in Fig. 1, except that the camera function unit 51 is connected to the first connection unit 18 instead of the sensor S. The configuration and function of the camera function unit 51 are the same as those of the camera 4 shown in Fig. 3.

[0046] The above-mentioned edge terminal device 1 has a computer inside. Each process of the above-mentioned edge terminal device 1 is stored in a computer-readable recording medium in the form of a program, and the above-mentioned processes are performed by the computer reading and executing this program. Here, the computer-readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, etc. Also, this computer program may be distributed to a computer via a communication line, and the computer that receives this distribution may execute the program.

[0047] The above program may be a program for realizing part of the above-mentioned functions. The above program may be a so-called differential file (differential program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0048] In addition, the components in the above-described embodiments can be replaced with well-known components as appropriate without departing from the spirit of the present invention. For example, video data may be audio data or image data of still images. Furthermore, the technical scope of this invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention. The edge terminal device 1 is an example of an information output device. The server terminal device 2 is an example of a first server terminal device. The server terminal device 3 is an example of a second server terminal device. The external terminal unit 5 is an example of an external connection device.

[0049] This application claims priority based on Japanese Patent Application No. 2015-005538, filed on January 15, 2015, the disclosure of which is incorporated herein in its entirety. [Industrial Applicability]

[0050] The present invention may be applied to an information processing system, an information processing method, and a program. [Explanation of symbols]

[0051] 1. Edge terminal device 2. Server terminal device 3. Server terminal device 4. Camera 5. External terminal unit 6, 8: Card reader 7, 9...Key card 11...Information acquisition section 12...First output section 13 Second output section 14. Communications Department 15 Output judgment section 16...Storage section 18... First connection part 19...Second connection part 21, 31 Communications Department 22. Decoding section 23, 33: Application execution unit 24, 34...Storage section 26 Connection 51 Camera function section

Claims

1. An information processing system including a camera, a first server terminal device in which a security system operates, and a second server terminal device in which a marketing system operates, The camera includes: An imaging means for performing imaging; image acquisition means for acquiring the captured image information; an output means for outputting the image information to the first server terminal device as first output information capable of identifying an individual, and outputting attribute information based on a motion of a person included in the image information to the second server terminal device as second output information; Equipped with Information processing system.

2. the first output information is the encrypted image information, the first server terminal device includes a decryption means for decrypting the acquired first output information; The information processing system according to claim 1 .

3. the second output information is information based on a change in a position of the person; 3. The information processing system according to claim 1 or 2.

4. The second output information includes information indicating a movement route of the individual calculated from time-series position information of the individual.

3. The information processing system according to claim 1 or 2.

5. The image information further includes a determination unit for determining whether or not personal information is included in the image information. The output means outputs the second output information when the determination means determines that the image information includes the personal information. The information processing system according to any one of claims 1 to 4.

6. The camera, Perform imaging, Acquire the captured image information; The image information is output as first output information capable of identifying an individual to a first server terminal device in which a security system is operated, and attribute information based on the actions of the person included in the image information is output as second output information to a second server terminal device in which a marketing system is operated. Information processing methods.

7. the first output information is the encrypted image information, The first server terminal device decrypts the acquired first output information. The information processing method according to claim 6.

8. The camera has a computer, causing the camera to capture an image; Acquire the captured image information; a process of outputting the image information as first output information capable of identifying an individual to a first server terminal device in which a security system is operated, and outputting attribute information based on the actions of the person included in the image information as second output information to a second server terminal device in which a marketing system is operated; A program that executes the following.

9. the first output information is the encrypted image information, The first server terminal device decrypts the acquired first output information. The program according to claim 8.

Images