Server device, online learning system, program and storage medium
By comparing the user registration data with the official certificate data in the online learning system and deleting the comparison data, the problem of user information outflow risk is solved to ensure the security and authenticity of the data.
Patent Information
- Application Number
- CN202280043727.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-07-09
- Filing Date
- 2022-06-03
- Publication Date
- 2025-01-10
- Estimated Expiration
- 2042-06-03
AI Technical Summary
In the existing online learning system, the official certificate data registered by users is stored on the authentication server with a risk of outflow, which may lead to user information leakage and affect data security.
A server device is designed, including a registered data storage unit, a temporary data storage unit and a comparison processing unit. By comparing user registration data with official certificate data, and immediately deleting official certificate data after comparison, ensuring that the data is not Long-term storage.
It effectively reduces the risk of user information outflow, ensures the authenticity and security of user registration data, and prevents official certificate data leakage.
Smart Images

Figure CN117501267B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a server device, an online learning system, a program and a storage medium. Background Art
[0002] In recent years, so-called e-learning (electronic learning) has been widely used, which is a kind of lecture delivered in real time or recorded via the Internet or other online learning. In this kind of online learning, in order to prevent someone other than the person from attending the lecture (impersonation), the user's data (biometric authentication information) is registered in advance in the authentication server. In addition, for example, Japanese Patent Publication No. 2009-276950 discloses a system for performing personal authentication (biometric authentication) by comparing the biometric authentication information registered in the authentication server with the biometric authentication information obtained at a random time during the lecture. In addition, Japanese Patent Publication No. 2009-276950 discloses the use of inherent information such as fingerprints, veins, irises, and retinas as biometric authentication information.
[0003] Prior Art Literature
[0004] Patent Literature
[0005] Patent Document 1: Patent Publication No. 2009-276950 SUMMARY OF THE INVENTION
[0006] Problem that the invention aims to solve
[0007] Here, the system of Japanese Patent Publication No. 2009-276950 is constructed on the premise that the biometric authentication information registered in advance in the authentication server is the information of the attendee himself. However, in reality, in order to ensure that the data registered in advance in the authentication server is the data of the attendee himself (the user himself), the user is sometimes required to submit a copy of the official certificate. However, in the case where the information of the copy of the official certificate is registered in the authentication server, if the information of the copy of the official certificate is leaked from the authentication server due to human error or improper access from the outside, it may cause great harm to the user.
[0008] In view of the above problems, an object of the present invention is to provide a server device, an online learning system, a program, and a storage medium that can reduce the risk of user information leakage while ensuring that the registered user data is the user's own data.
[0009] Means of solving the problem
[0010] To achieve the above object, the server device of the present invention comprises:
[0011] A registration data storage unit that stores user registration data corresponding to the information recorded in the official certificate;
[0012] A temporary data storage unit that temporarily stores official certificate data; and
[0013] a comparison processing unit for comparing the user registration data stored in the registration data storage unit with the official certificate data stored in the temporary data storage unit, wherein
[0014] After the comparison by the comparison processing unit, the temporary data storage unit does not retain the official certificate data used for the comparison.
[0015] Effects of the Invention
[0016] According to the present invention, by comparing the user registration data with the official certificate data, it is possible to ensure that the user registration data is the user's own data. Furthermore, since the official certificate data used for comparison is not retained after the comparison, it is possible to prevent the official certificate data from leaking out. As a result, it is possible to reduce the risk of leakage of user information while ensuring that the registered user data is the user's own data.
[0017] BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 This is a block diagram showing a schematic configuration of an online learning system according to the first embodiment.
[0019] Figure 2 This is a block diagram showing the schematic structure of an educational institution server.
[0020] Figure 3 It is a block diagram showing a schematic configuration of a user terminal.
[0021] Figure 4 It is a diagram showing items of online learning materials.
[0022] Figure 5 FIG. 1 is a diagram showing an example of user registration data stored in the registration data storage unit.
[0023] Figure 6 This is a diagram showing an example of official certificate data with a facial photo stored in the temporary data storage unit.
[0024] Fig. 7A This is a schematic diagram showing an example of a student registration screen.
[0025] Figure 7B This is a schematic diagram showing an example of a lecturer registration screen.
[0026] Fig. 8A This is a schematic diagram showing an example of obtaining facial photograph data for authentication using a camera.
[0027] Figure 8BThis is a schematic diagram showing an example of obtaining facial photograph data for authentication using a camera.
[0028] Fig. 9 This is a schematic diagram showing an example of a screen when the comparison is successful.
[0029] Fig.10 This is a schematic diagram showing an example of a screen when the comparison fails.
[0030] Fig.11 This is a diagram for explaining that the official certificate data with facial photograph has been deleted from the temporary data storage unit.
[0031] Fig.12 This is a schematic diagram showing an example of a login screen displayed on a user terminal.
[0032] Fig.13 This is a schematic diagram showing an example of a screen displayed on the user terminal after login.
[0033] Fig.14 This is a schematic diagram showing an example of a list of items displayed on a user terminal.
[0034] Fig.15 This is a schematic diagram showing an example of a screen of an online learning material displayed on a user terminal (personal computer, etc.).
[0035] Fig.16 This is a schematic diagram showing an example of a screen (lecture video) of an online learning material, that is, an example in which the face of the audience is correctly arranged in the recognition frame.
[0036] Fig.17 This is a schematic diagram showing an example of a screen (question and answer data) of an online learning material, that is, an example in which the face of the audience is correctly arranged in the recognition frame.
[0037] Fig.18 This is a schematic diagram showing an example of a screen of an online learning material, that is, an example in which the face of the student is not correctly arranged within the recognition frame.
[0038] Fig.19 This is a schematic diagram showing an example of a screen of an online learning material displayed on a user terminal (smartphone).
[0039] Fig. 20 This is a schematic diagram showing an example of an authentication window displayed on a user terminal (smartphone), that is, an example in which the face of the attendee is correctly arranged in the recognition frame.
[0040] Fig.21This is a schematic diagram showing an example of an authentication window displayed on a user terminal (smartphone), that is, an example in which the face of the attendee is not correctly arranged in the recognition frame.
[0041] Fig. 22 This is a block diagram showing a schematic configuration of an information management system according to the second embodiment.
[0042] Fig.23 This is a schematic diagram showing an example of a user registration screen.
[0043] Modes for Carrying Out the Invention
[0044] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same or corresponding parts in the drawings are denoted by the same reference numerals and their description will not be repeated.
[0045] [First embodiment]
[0046] Figure 1 1 is a schematic diagram showing the schematic structure of the online learning system 100a of the present embodiment. The online learning system 100a includes a distribution device 100 for distributing online learning teaching materials (content) via the Internet 10. The online learning teaching materials can be distributed in real time or on demand. Moreover, the online learning teaching materials can be videos or static images. Furthermore, the online learning teaching materials can be unidirectional teaching materials (one-way explanation from the lecturer to the audience) or bidirectional teaching materials. Moreover, in addition to teaching materials in the form of explanations, online learning teaching materials also include reading materials, or online training in which questions are presented to the audience and the audience is scored by inputting answers.
[0047] like Figure 1 As shown, the online learning system 100a includes educational institution servers 201a, 201b, 201c, etc. connected to the distribution device 100 via the Internet 10. Moreover, the distribution device 100 is connected to user terminals 301a, 301b, 301c, etc. via the Internet 10. Hereinafter, when there is no need to distinguish between the user terminals, it is simply expressed as "user terminal 301". The same is true for the educational institution server. When there is no need to distinguish between them, it is simply expressed as "education institution server 201". In addition, the so-called "users" of the online learning system 100a include not only users (listeners) who use the online learning system 100a for learning, but also lecturers, staff, managers, etc. of the educational institution who use the online learning system 100a for education. That is, the user terminal 301 is a terminal used by these "users". Users of the online learning system 100a register as users in the educational institution server 201. Figure 2 It is a block diagram showing the structure of the educational institution server 201. Figure 32 is a block diagram showing the configuration of the user terminal 301. As the user terminal 301, any terminal can be used as long as it is a terminal such as a personal computer, a tablet computer, or a smart phone that can be connected to the Internet 10 and can use a web browser. The educational institution server 201 is a server of an educational institution that implements lectures that require strict lecture management (for example, statutory lectures, qualification or unit certification lectures, etc.). "Educational institution" is not limited to this, and includes schools, lecture venues, qualification certification institutions, etc.
[0048] The structure and operation of the delivery device 100 are described below. Figure 1 As shown, the delivery device 100 includes a lecture data storage unit 11, a lecture progress management unit 12, a lecturer management unit 13, an authentication processing unit 14, a delivery control unit 15, and a communication unit 16. The lecture data storage unit 11 is implemented as a storage device such as a hard disk. The lecture progress management unit 12, the lecturer management unit 13, the authentication processing unit 14, the delivery control unit 15, and the communication unit 16 are implemented by a processor of a server or a computer. In addition, each of these units can be implemented by a single computer and its peripheral devices, or by multiple computers and peripheral devices.
[0049] The lecture data storage unit 11 stores online learning materials. Figure 4 This is a diagram showing an example of items of the online learning material stored in the lecture data storage unit 11. For example, after listening to the "Introduction" of item number 1-1, the audience listens to the "Basics" of item number 1-2, the "Application" of item number 1-3, and the "Development" of item number 1-4 in this order.
[0050] The lecture progress management unit 12 stores the lecture history of each listener (whether the lecture of which project of the online learning material has been completed). The lecture progress management unit 12 further cooperates with the authentication processing unit 14 to manage where the listener has watched during the playback of the explanation video. Moreover, in the case of real-time delivery of the lecturer's explanation (explanation video) rather than the explanation video pre-stored in the explanation data storage unit 11, the lecture progress management unit 12 cooperates with the authentication processing unit 14 to manage where the listener has watched during the delivery of the explanation video. Moreover, in the case of delivering the image data of the teaching material or the question and answer data (data of online training, etc.) to the listener, the lecture progress management unit 12 cooperates with the authentication processing unit 14 to manage where the listener has watched during the delivery of the image data of the teaching material or the question and answer data (during the display of the explanation video, the image data of the teaching material, or the question and answer data on the user terminal 301).
[0051] The student management unit 13 manages the login process from the student. The authentication processing unit 14 performs the identity verification and progress verification of the student during the distribution of the online learning materials. The distribution control unit 15 controls the distribution of the lecture video. The communication unit 16 communicates with the user terminal 301 and the educational institution server 201 via the Internet 10.
[0052] The educational institution server 201 is a server for managing students (attendees) and lecturers in each educational institution. The educational institution server 201 can be set up in each educational institution, or can be set up as a cloud server that can be accessed by each educational institution. Figure 2 As shown, the system includes a registered data storage unit 21 , a progress data receiving unit 22 , a reservation management unit 23 , a temporary data storage unit 24 , a matching processing unit 25 , and a communication unit 26 .
[0053] Figure 5 1 is a diagram showing an example of user registration data stored in the registration data storage unit 21. The user registration data is input from the user terminal 301 by a student or a lecturer using the online learning system 100a, and is stored in the registration data storage unit 21. Figure 5 As shown, the registration data storage unit 21 stores the name (name), address, date of birth (omitted in the figure), and facial photo data for authentication as user registration data. In addition to the above data, the registration data storage unit 21 can also store information of each student studying in the educational institution (for example, telephone number (omitted in the figure), email address (omitted in the figure), progress data indicating the progress of the lecture, grades, etc. (omitted in the figure)) as user registration data. In addition, the registration data storage unit 21 stores information of lecturers who give lectures in the educational institution and administrators who manage the educational institution server 201 in addition to the student information. In addition, the user registration data in this embodiment and the following embodiments includes data corresponding to the information recorded in the official certificate (data that can be proved to be the person through the official certificate) to prevent impersonation. That is, the user registration data includes at least a part of the name, address, date of birth, facial image, etc. recorded in the official certificate. And, as described later, when performing user registration, the user registration data entered by the user is compared with the data on the official certificate.
[0054] Moreover, if Figure 5 As shown, a login ID and a password for using the online learning materials are issued to students who apply to use the online learning materials, and these information are also stored in the registration data storage unit 21. In addition, a login ID and a password requested when accessing the educational institution server 201 are also issued to lecturers or managers, and these information are also stored in the registration data storage unit 21.
[0055] Furthermore, in order to receive the delivery of online learning materials, it is necessary to pre-register the user's authentication facial photo data (facial image data) for identification during delivery. In this embodiment, for lecturers or administrators, authentication facial photo data (facial image data) is also registered for identification when accessing the educational institution server 201. The authentication facial photo data can be as follows: Fig. 7A and Figure 7B As shown and described later, the facial image uploaded by the user terminal 301 may be a facial image of a student, lecturer or administrator taken in an educational institution. Furthermore, the facial photo data for authentication is not limited to the facial image itself, but may be feature data for authentication extracted from the facial image. The facial photo data for authentication is stored in the registered data storage unit 21.
[0056] The progress data receiving unit 22 receives information every time a student completes the online learning material (content) and manages it as progress data. The reservation management unit 23 manages reservations from students for online lectures conducted in real time by lecturers and reservations from students for face-to-face lectures conducted by lecturers in educational institutions.
[0057] Figure 6 : is a diagram showing an example of official certificate data with facial photo temporarily stored in the temporary data storage unit 24. The temporary data storage unit 24 temporarily stores official certificate data with facial photo. In the temporary data storage unit 24, the official certificate data with facial photo is temporarily stored by associating it with at least a part of the user registration data (for example, login ID). Here, "official certificate with facial photo" refers to a certificate with facial photo issued by an official agency, that is, something that specifies the identity and status of the person, or something that proves legal qualifications. The official certificate with facial photo in the present embodiment is not limited to this, and certificates such as personal number card, driver's license, temporary residence card, passport, etc. can be used.
[0058] Figure 2 The comparison processing unit 25 shown in the figure compares the user registration data stored in the registration data storage unit 21 with the official certificate data with facial photo stored in the temporary data storage unit 24. Fig. 9 and Fig.10 The communication unit 26 controls the communication between the user terminal 301 and the delivery device 100 .
[0059] Figure 3 3 is a block diagram showing the configuration of the user terminal 301. Figure 3As shown, the user terminal 301 includes a display control unit 31, an operation unit 32, a camera 33, a display 34, a storage unit 35, and a communication unit 36. The display control unit 31 is implemented by, for example, a web browser. The operation unit 32 is implemented by, for example, a touch panel integrated with the display 34, and receives input from the audience. The camera 33 is a camera built into the user terminal 301, and as a so-called built-in camera, it is configured to capture the image of the audience while the audience is viewing the display 34. The communication unit 36 controls the communication with the distribution device 100 and the education institution server 201. In the storage unit 35, the user's facial photo data (facial photo data for authentication) taken by the camera 33 and the official certificate data with the facial photo digitized by the user are stored.
[0060] Fig. 7A It is a figure which shows an example of a student registration screen. Figure 7B 3 is a diagram showing an example of a lecturer registration screen. The student registration screen, the lecturer registration screen, and each screen described later are displayed, for example, on the display 34 of the user terminal 301. Fig. 7A and Figure 7B , the entire screen is illustrated, but the entire screen does not need to be displayed in a manner that is included at once on the display surface of the user terminal 301. For example, in a smart phone or the like, the entire screen can also be browsed by scrolling the screen.
[0061] like Fig. 7A and Figure 7B As shown, in the student registration screen and the lecturer registration screen, input fields 41a to 41e, a button 42a for uploading facial photo data for authentication, a button 42b for uploading official certificate data with facial photo, and a confirmation button 43 for confirming the input content are displayed. In the input field 41a, the name of the educational institution to which the student or lecturer belongs is input by the student or lecturer. In the input field 41b, the name (name) of the student or lecturer is input by the student or lecturer. In the input field 41c, the email address of the student or lecturer is input by the student or lecturer. In the input field 41d, the password of the student or lecturer is input by the student or lecturer. In addition, in the student registration screen, an input field 41f for the student to input the date of birth, an input field 41g for the address, an input field for the student to input the contract plan between the student and the educational institution, and an input field for the student to input the contract period of the contract plan can be further displayed.
[0062] When students, lecturers, etc. perform user registration, it is necessary to upload facial photo data for authentication and official certificate data with facial photo from the user terminal 301 to the educational institution server 201. Therefore, the user uses the camera 33 of the user terminal 301 to capture his / her own face. The captured image is stored in the storage unit 35. Alternatively, an image captured in advance and stored in the storage unit 35 may be used instead of capturing the face when the user registers. Similarly, when the user captures the official certificate with facial photo using the camera 33, the captured image is stored in the storage unit 35. If the official certificate is captured in advance, the image stored in the storage unit 35 may be used instead of capturing the official certificate when the user registers. When the button 42a is operated, the facial photo data for authentication stored in the storage unit 35 on the user terminal 301 is uploaded to the educational institution server 201. When the button 42b is operated, the official certificate data with facial photo stored in the storage unit 35 on the user terminal 301 is uploaded to the educational institution server 201 and temporarily stored in the temporary data storage unit 24.
[0063] Moreover, if Fig. 7A and Figure 7B As shown, on the student registration screen and the lecturer registration screen, a button 142a for photographing the user's face for use as facial photo data for authentication, a button 142b for photographing an official certificate with a facial photo, a display 142c for confirming the photographed facial photo data for authentication, and a display 142d for confirming the photographed official certificate data with a facial photo are further displayed. When the user operates (touches) the button 142a or 142b, the camera 33 of the user terminal 301 is automatically activated. In addition, although not shown in the figure, when the camera 33 is activated, a screen for obtaining permission to activate the camera 33 may be displayed to the user.
[0064] Fig. 8A This is a schematic diagram showing an example of acquisition of facial photograph data for authentication using the camera 33, that is, a diagram of a screen after the button 142a is operated. Figure 8B 1 is a schematic diagram showing an example of obtaining official certificate data with a facial photo using the camera 33, that is, a diagram of a screen after operating the button 142b. Fig. 8A and Figure 8B As shown, on the display 34 of the user terminal 301, an image display portion 34a captured by the camera 33, a guide frame 34b, a capture button 34c, a decision button 34d, and a delete button 34e are displayed.
[0065] First, when the button 142a or 142b is operated by the user, the image currently captured by the camera 33 is displayed on the image display unit 34a. Furthermore, when the shooting button 34c is operated by the user, the image captured at the time of operating the shooting button 34c is temporarily retained (captured) in the memory as image data. Furthermore, when the shooting button 34c is operated, the captured image (still image) is displayed on the image display unit 34a. Furthermore, when the delete button 34e is operated, the captured image data is deleted. Thereafter, the image currently captured by the camera 33 is displayed on the image display unit 34a. Furthermore, the guide frame 34b is a guide display for capturing the face and official certificate in an appropriate size. As shown in FIG. Fig. 8A and Figure 8B As shown, the shapes of the guide frame 34b are set to shapes corresponding to the photographing of the face and the photographing of the official certificate, respectively.
[0066] When the user operates the confirmation button 34d, the screen displayed on the user terminal 301 returns to Fig. 7A or Figure 7B The captured image is displayed on a screen, and the captured image is displayed on the corresponding one of the display 142c for confirming the photographed facial photo data for authentication and the display 142d for confirming the photographed official certificate data with the facial photo. If the user wishes to take the photo again after confirming the displays 142c and 142d, the user can re-take the image by operating the button 142a or 142b again.
[0067] Furthermore, when the confirmation button 43 is operated, the comparison processing unit 25 extracts the facial image or facial feature data from the official certificate data with facial photo. Furthermore, the comparison processing unit 25 matches (compares) the facial photo data for authentication with the facial image or facial feature data extracted from the official certificate data with facial photo. Furthermore, the comparison processing unit 25 extracts text data such as name, address, and date of birth from the official certificate data with facial photo. Furthermore, the comparison processing unit 25 matches (compares) the data (user registration data) input on the student registration screen or the lecturer registration screen with the text data extracted from the official certificate data with facial photo.
[0068] If the above matching results are consistent (if the comparison is successful), then Fig. 9 As shown in FIG. 1 , a registration button 44 is displayed on the user terminal 301. The registration button 44 is a button for registering data (user registration data) other than the official certificate data with the facial photo among the data inputted on the student registration screen or the lecturer registration screen in the registration data storage unit 21. When the registration button 44 is operated, the user registration data (see FIG. 1 ) including the facial photo data for authentication is stored in the registration data storage unit 21. Figure 5 ) is registered in the registration data storage unit 21. Furthermore, if the matching results are inconsistent (if the comparison fails), Fig.10 As shown, a message urging re-entry such as "Verification failed. Please re-enter." and a button 45 for returning to the student registration screen or the lecturer registration screen are displayed on the user terminal 301. When the button 45 is operated, the student registration screen or the lecturer registration screen is displayed again. Thereafter, while the student registration screen or the lecturer registration screen is displayed, the user can correct the input information or re-upload the facial photo data for authentication or the official certificate data with the facial photo.
[0069] Fig.11 2 is a diagram for explaining the temporary data storage unit 24 after the comparison by the comparison processing unit 25. Fig.11 As shown, in this embodiment, the temporary data storage unit 24 does not retain the official certificate data with facial photo used for the comparison after the comparison by the comparison processing unit 25. The temporary data storage unit 24 deletes the official certificate data with facial photo used for the comparison when the comparison by the comparison processing unit 25 is successful. That is, in the educational institution server 201 or the distribution device 100, the official certificate data with facial photo is not saved after the comparison is completed. Moreover, in the case where the communication with the user terminal 301 is cut off or the registration is terminated for other reasons, the temporary data storage unit 24 deletes the official certificate data with facial photo. According to this, by comparing the user registration data with the official certificate data with facial photo, it is possible to ensure that the user registration data is the user's own data. Moreover, since the official certificate data with facial photo used for the comparison is not retained after the comparison, it is possible to prevent the official certificate data with facial photo from flowing out. As a result, it is possible to reduce the risk of user information flowing out while ensuring that the user registration data is the user's own data.
[0070] Fig.12 2 is a diagram showing an example of a login screen after the comparison by the comparison processing unit 25 is successful and the user registration data is registered in the registration data storage unit 21. Fig.12 As shown, after receiving the issuance of a login ID and a password, the user can access the online learning system 100 a by logging into the delivery device 100 from his / her user terminal 301 .
[0071] Here, the following will describe the attendance at an online course using the delivery device 100, and the identification of the person and the progress during the attendance. The user can log in to the delivery device 100 by inputting the login ID and password assigned by the educational institution and performing facial authentication. In addition, the login ID and password assigned to the student by the educational institution are stored in the registration data storage unit 21 of the educational institution server 201, and are sent from the educational institution server 201 to the delivery device 100 and stored in a memory accessible to the lecturer management unit 13. Furthermore, in order to identify the person during online learning, the name stored in the educational institution server 201 and the facial photo data for authentication stored in the registration data storage unit 21 are sent to the delivery device 100 together with the login ID and password, and are stored in a memory accessible to the lecturer management unit 13.
[0072] like Fig.12 As shown, the URL of the login screen is notified to the attendees by the educational institution using a URL or a QR code (registered trademark) or the like. Fig.12 3 is a schematic diagram showing an example of a login screen displayed on the user terminal 301. Fig.12 As shown in FIG. 1 , the login screen displays input fields 51a and 51b for login ID and password. The user can use the online learning system 100a by inputting the login ID and password and touching the "Login" button 51c below them. In addition, at the top of the login screen, a logo 51d of the educational institution that issued the login ID and password (the educational institution where the student is studying) is displayed.
[0073] Fig.13 2 is a schematic diagram showing an example of "My Page" displayed on the user terminal 301 after logging in. Fig.13 In the example shown, user information 52a of the attendee including name, status, etc. is displayed on the screen of the user terminal 301. In addition, the items to be attended next are displayed as scheduled lectures 52b. Fig.13 In the example of FIG. 5 , some of the items in the first stage that have not been attended are displayed by their titles 52b2 and index images 52b1 indicating the contents. If there are many items that have not been attended, only some of them may be displayed on the screen, and when the lecture list button 52c is touched, a list of all the items in the first stage may be displayed (see FIG. 5 ). Fig.14 ). In addition, for those who have not completed the first stage, only the first stage lecture items are displayed, and they cannot select the second stage lectures. Title 52b2 is a hyperlink. When the listener touches the title, a distribution request for the online learning materials of the project is sent from the user terminal 301 to the distribution device 100.
[0074] like Fig.14As shown, when the lecture list button 52c is touched, all the items of the first stage of the lecture are displayed at a glance. The list displays the item number 53a, title 53b, lecture status 53c, and lecture selection button 53d. For the items that have been listened to, the "○" mark is displayed in the lecture status 53c, and the "×" mark and "Listen" button are displayed for the items that have not been listened to. In addition, a "Listen Again" button is displayed for the items that have been listened to, and the lecture can be listened to again by touching this button. When the listener selects the "Listen" button or the "Listen Again" button, a distribution request for the online learning materials of the selected item is sent from the user terminal 301 to the distribution device 100.
[0075] As described above, in the first stage, the student must first listen to the "Introduction" of item number 1-1. Therefore, before the student listens to item number 1-1, the "Listen" button is displayed only for item number 1-1, and no listening selection button is displayed for other items.
[0076] In the distribution device 100, the communication unit 16 receives a distribution request for online learning materials from the user terminal 301 and delivers it to the distribution control unit 15. The distribution request includes the login ID of the student and the item number of the online learning materials to be distributed. The distribution control unit 15 inquires with the student management unit 13 to confirm whether the login ID included in the received distribution request is a legitimately issued login ID. If the login ID is correct, the distribution control unit 15 extracts the online learning materials of the item number requested for distribution from the lecture data storage unit 11, and distributes it to the user terminal 301 via the communication unit 16 and the Internet 10.
[0077] Fig.15 This is an example of a display screen of an online learning material (explanation video) delivered to the user terminal 301. Fig.15 This is an example of a display screen when the user terminal 301 has a relatively large display, such as a personal computer or a tablet computer. The following is an example of a display screen of an online learning material when the display is relatively small, such as a smartphone. Fig.15 As shown, in the display screen of the online learning materials, a display column 54d showing the item number and title of the lecture in the delivery process and a lecture status column 54e are displayed. Fig.15 In the example, since the student is attending the "Introduction" of item number 1-1 for the first time, "Not attending" is displayed in the lecture status bar 54e. Fig.15 (in the figure, the explanation video) is displayed in the teaching material display window 54a. Fig.15In the example of , a sign language translation video is displayed in the upper left corner of the teaching material display window 54a. Moreover, Japanese subtitles are displayed in the lower part of the teaching material display window 54a. By displaying the sign language translation video and Japanese subtitles simultaneously with the explanation video, listeners with hearing impairments can also fully understand the explanation content. In addition, it can also be set to be able to select the subtitle language from a language other than Japanese. Below the teaching material display window 54a, an operation window 54b is displayed for controlling the pause and restart of playback, and the current playback point. Further below it, the title of the textbook used in the lecture, the number of pages to be referenced, the summary information of the lecture, etc. are displayed as lecture information 54c. Moreover, in the case of distributing image data of teaching materials, the display of controlling page forward or page return can also be performed in the operation window 54b. Moreover, in the case of distributing question answer data, the display of controlling forward to the next question or returning to the previous question can also be performed in the operation window 54b.
[0078] Furthermore, an authentication window 54f is displayed on the right side of the teaching material display window 54a. In the authentication window 54f, the image captured by the camera 33 built into the user terminal 301 is displayed as a video or a still image played frame by frame. The authentication window 54f displays the range captured by the camera 33. An identification frame 54g is displayed in the authentication window 54f. The identification frame 54g indicates the area of the object set to match the facial image (authentication facial photo data) registered in the delivery device 100 in the image captured by the camera 33 and displayed in the authentication window 54f. Therefore, the audience can Fig.16 As shown, one needs to study the online learning materials by putting one's face into the recognition frame 54g.
[0079] The authentication processing unit 14 samples (captures) the image within the identification frame 54g at regular time intervals, and matches it with the facial photo data of the attendee for authentication. If the matching results are consistent, the authentication processing unit 14 determines that the attendee himself is studying the online learning material (in the case of a lecture video, attending a lecture), and sends the information of the time when the match is performed to the lecture progress management unit 12. Based on the time information received from the authentication processing unit 14, the lecture progress management unit 12 marks the point in the online learning material that can be authenticated (from the start of the video playback to the point where it can be confirmed that the attendee has attended the lecture) as the end of the lecture. Fig.16 In the case of the lecture video shown in FIG. 1 , the lecture is considered complete from the point at which the video starts playing until the point at which the listener can confirm that he or she has listened to the lecture. Fig.17 In the case of the question answering data (data of online training, etc.) shown in the figure, the question until it can be confirmed that the student has studied it is regarded as completed (answered). In addition, when the authentication processing unit 14 performs matching every 10 seconds, the authentication processing unit 14 updates the point of completion of the lecture in the online learning material every 10 seconds.
[0080] For example, Fig.16 and Fig.17 As shown in FIG. 5 , if the face of the lecturer himself / herself enters the recognition frame 54g, the matching result of the authentication processing unit 14 is that it is highly likely that the lecturer himself / herself is attending the lecture. On the other hand, even if the face of the lecturer himself / herself enters the recognition frame 54g, if the lecturer is not himself / herself, the captured face image is different from the registered image, so the possibility of personal authentication failure is high. Fig.18 As shown, even if the listener is the real person, if he / she falls asleep and lowers his / her head, the face does not enter the identification frame 54g, and the person authentication fails. Moreover, if the listener leaves his / her seat, the person authentication also fails because the face does not enter the identification frame 54g. The authentication processing unit 14 determines that the person has not listened to the lecture correctly when the person authentication fails more than a specified number of times during the lecture of a project, or when the person authentication fails more than a specified number of times in a row. In this case, even if the lecture has been conducted halfway or at the end, the lecture progress management unit 12 sets the item being listened to as "not listened to", and the person must listen to the lecture again from the beginning of the lecture. In addition, during the lecture of a project, when the person authentication fails more than a specified number of times, or when the person authentication fails more than a specified number of times in a row, the distribution control unit 15 may stop the distribution of online learning materials.
[0081] When the audience is concentrating on listening to the lecture, it is easier to maintain the posture in the form of entering the recognition frame 54g with the face. Moreover, since the recognition frame 54g is displayed next to the teaching material display window 54a, it is not difficult for the audience to confirm whether the face enters the recognition frame 54g while watching the teaching material display window 54a. Therefore, according to the online learning system 100a, it is easy and reliable to judge whether the audience who is listening to the online learning teaching material is the person himself. Therefore, even if the lecture is attended to the subject lecture online, it is possible to provide a learning environment equivalent to the situation of attending lectures in the classroom of an educational institution, and the learning results can be guaranteed. Moreover, in the online learning system 100a, during the distribution process (display process) of the online learning teaching material, face recognition is performed behind the scenes based on the image captured by the camera 33 set in the user terminal 301. Therefore, compared with the previous system in which the audience needs to spontaneously and deliberately perform biometric authentication during the lecture, face recognition will not hinder the study of online learning teaching materials and will not reduce the audience's concentration on learning.
[0082] This way, there are no restrictions on the time or location of lectures, and students can study online according to their own circumstances, which is very convenient for students. For example, since students can study at any time 24 hours a day, it is convenient for students who have to go to work or school during the day, or those who want to attend lectures in areas with time differences while on business trips overseas. In addition, there is also the advantage that educational institutions do not need to secure a large venue, etc.
[0083] In the above example, the authentication is performed at a certain time interval (for example, every 10 seconds), but the timing of authentication can be set to be random. In this case, since the audience cannot predict the timing of authentication, it is possible to more reliably prevent improper behavior such as impersonation.
[0084] Here, in Fig.19 This is an example of a display screen showing a lecture video when the user terminal 301 has a relatively small display such as a smartphone. Fig.16 and Fig.19 It can be seen that the display screen of the lecture video used in the smartphone ( Fig.19 ) in the present invention, there is no authentication window 54f displayed on the display of a personal computer or the like (see Fig.16 ). Instead of this, Fig.19 As shown, an authentication check button 54h is displayed near the teaching material display window 54a on the display screen of the smartphone. In addition, even if the authentication window is not displayed on the screen, the identity confirmation using face authentication is performed behind the scenes at regular intervals or at random times while the online learning teaching material is displayed.
[0085] The audience operates the authentication check button 54h to confirm whether they are in a suitable position for face authentication with respect to the user terminal 301. That is, before or during the lecture, when the audience touches the authentication check button 54h, the screen display of the smartphone is switched to display the following information: Fig. 20 The authentication window 54f is shown. An identification frame 54g is displayed in the authentication window 54f. Fig. 20 As shown in FIG. 54 , if the face enters the recognition frame 54g, the person is correctly authenticated during the lecture. Fig.21 As shown in the figure, if the face does not enter the recognition frame 54g, the person's identity authentication is not performed correctly during the lecture. Therefore, the listener adjusts the angle or position of the user terminal 301 while watching the screen. When the face enters the recognition frame 54g, the user can return to the display screen of the online learning material by touching the "return to lecture" button 54i. In addition, when playing the lecture video, Fig.21 As shown, while the authentication window 54f is displayed, the playback of the explanation video is suspended so that the explanation does not continue.
[0086] Other, Fig.21 In the example shown, the authentication window 54f is displayed by touching the authentication check button 54h. However, instead of the authentication check button 54h, the pause button displayed in the operation window 54b may be operated during the playback of the explanation video to pause the playback of the explanation video and display the authentication window 54f.
[0087] Alternatively, the authentication window 54f may be displayed by sliding the screen of the smartphone instead of operating the authentication check button 54h.
[0088] [Second embodiment]
[0089] Next, refer to Fig. 22 and Fig.23 , an information management system 100b of the second embodiment will be described. The second embodiment is different from the first embodiment which is configured as an online learning system, and is configured as an information management system 100b for managing user information. In addition, the same reference numerals are attached to the same structures as the first embodiment, and the description thereof is omitted.
[0090] The information management system 100b of the second embodiment is used, for example, to manage user information of services provided online. Examples of services provided online include, but are not limited to, online shopping, matching (dating) services, transaction intermediary services, content distribution services, online medical services, reservation management services, and email services. Fig. 22 As shown, the information management system 100b includes a server device 401 that communicates with the user terminal 301. The server device 401 includes a registered data storage unit 21a, a temporary data storage unit 24a, a matching processing unit 25a, and a communication unit 26a.
[0091] User registration data such as the user's name, telephone number, login ID, password, address, and date of birth are input by the user from the user terminal 301 and stored in the registration data storage unit 21a. The official certificate data is temporarily stored in the temporary data storage unit 24a. The official certificate data may be official certificate data with a facial photo attached as in the first embodiment, or may be official certificate data without a facial photo attached (e.g., a health insurance card, etc.) as in the first embodiment.
[0092] Fig.23 301a to 301c is a diagram showing an example of a user registration screen displayed on the user terminal 301 (any of the user terminals 301a to 301c). Fig.23As shown, the user registration screen displays input fields 41b to 41g, a button 42b2 for uploading official certificate data, a confirmation button 43, and a button 142b2. When the button 42b2 is operated, the official certificate data stored in the user terminal 301 is stored in the temporary data storage unit 24a. Furthermore, when the button 142b2 is operated, the camera 33 of the user terminal 301 is activated and the user's mobile phone number is displayed. Figure 8B Also, when photographing an official certificate in the same manner as in the first embodiment, Fig.23 As shown, on the user registration screen, the captured image is displayed on the image display unit 142d2.
[0093] The comparison processing unit 25a extracts the text data such as name, date of birth, and address from the official certificate data. Then, the comparison processing unit 25a compares the extracted text data with the information input on the user registration screen. If the comparison is successful, the comparison processing unit 25a will Fig. 9 As shown in FIG. 1 , a screen notifying successful comparison is displayed on the user terminal 301. Furthermore, by operating the register button 44, the information input on the user registration screen is registered in the registration data storage unit 21a. Furthermore, in the case of a failed comparison, the comparison processing unit 25a Fig.10 As shown, a screen notifying the failure of the comparison is displayed on the user terminal 301. Moreover, the temporary data storage unit 24a does not retain the official certificate data after the comparison. For example, the temporary data storage unit 24a deletes the official certificate data when the comparison is successful. Moreover, the temporary data storage unit 24a cuts off the communication with the user terminal 301 (in the case of terminating the registration operation) and deletes the official certificate data. Therefore, in the second embodiment, it is also possible to reduce the risk of outflow of user information while ensuring that the registered user data is the user's own data.
[0094] [Modifications]
[0095] The specific examples described in the first and second embodiments are merely examples, and are not intended to limit the embodiments of the present invention to these examples.
[0096] For example, in the first and second embodiments described above, an example is shown in which the temporary data storage unit deletes the official certificate data after comparison. However, in order not to keep the official certificate data in the temporary data storage unit, in addition to individually and actively deleting the official certificate data as described above, the temporary data storage unit may be configured in such a way that the official certificate data before the overwriting is not retained by overwriting other official certificate data. Alternatively, the temporary data storage unit may be configured in such a way that all stored contents are deleted at a specific time.
[0097] Furthermore, in the above-mentioned first embodiment, an example in which the delivery device and the education institution server are separately configured has been shown, but the delivery device and the education institution server may be integrally configured.
[0098] Moreover, in the above-mentioned first embodiment, an example is shown in which the comparison processing unit, in addition to comparing the facial photo data with the official certificate data with the facial photo, also extracts text data from the official certificate data with the facial photo, and matches (compares) the user registration data input on the student registration screen or the lecturer registration screen with the extracted text data, but the comparison processing unit may also only compare the facial photo data with the official certificate data with the facial photo.
[0099] Moreover, in the above-mentioned first embodiment, although the user terminal 301 is illustrated as having a built-in camera (front camera) as the composition of the camera 33, the camera used to photograph the listeners during the lecture is not limited to the built-in camera, but may also be an external camera connected to the user terminal 301 for use.
[0100] Furthermore, in the first embodiment described above, an example is shown in which either the authentication image data uploaded from the storage unit 35 of the user terminal 301 or the authentication image data photographed by the camera 33 of the user terminal 301 is compared with the official certificate data with a facial photo, but the present invention is not limited thereto. For example, the educational institution server 201 may be configured to compare the authentication image data uploaded from the storage unit 35 of the user terminal 301 with the official certificate data with a facial photo, and to compare the facial image photographed by the camera 33 with the official certificate data with a facial photo, and only when the comparison between the two is successful, the user registration data is permitted to be registered in the registration data storage unit 21.
[0101] In the above embodiment, the example of implementing the delivery device 100 as one or more computers and their peripheral devices, i.e., as hardware, is described. However, the present invention can also be implemented as a program for causing one or more computers, etc. to execute the functions of the delivery device 100 or a recording medium storing the program.
[0102] Alternatively, the present invention can also be described as follows.
[0103] [First Structure]
[0104] The server device of the first configuration includes:
[0105] A registration data storage unit that stores user registration data corresponding to the information recorded in the official certificate;
[0106] A temporary data storage unit that temporarily stores official certificate data; and
[0107] a comparison processing unit for comparing the user registration data stored in the registration data storage unit with the official certificate data stored in the temporary data storage unit, wherein
[0108] After the comparison by the comparison processing unit, the temporary data storage unit does not retain the official certificate data used for the comparison.
[0109] According to the first configuration, by comparing the user registration data with the official certificate data, it is possible to ensure that the user registration data is the user's own data. Furthermore, since the official certificate data used for comparison is not retained after the comparison, it is possible to prevent the official certificate data from leaking out. As a result, it is possible to reduce the risk of leakage of user information while ensuring that the registered user data is the user's own data.
[0110] [Second Structure]
[0111] The server device of the second configuration is a server device in the first configuration,
[0112] The above user registration data includes facial photo data;
[0113] The above official certificate data includes certificate data with facial photograph;
[0114] The comparison processing unit compares the facial photo data stored in the registered data storage unit with the official certificate data with the facial photo stored in the temporary data storage unit.
[0115] According to the second configuration, even when the user registration data includes facial photo data, it is possible to reduce the risk of leakage of user information while ensuring that the facial photo data is the data of the user himself.
[0116] [Third Structure]
[0117] The third component of the online learning system includes:
[0118] A server device of the second configuration;
[0119] A distribution control unit that distributes online learning materials to user terminals; and
[0120] The authentication processing unit performs face authentication of the user when the online learning material is distributed by the distribution control unit, based on the image photographed by the user terminal and the facial photo data stored in the registered data storage unit.
[0121] According to the third configuration, since the facial photo data compared with the official certificate data with the facial photo can be used to perform facial authentication of the user when distributing the online learning materials, an online learning system can be provided that can ensure that the user has attended the online learning.
[0122] The invention disclosed herein can also be implemented as a program executed by a processor of a computer that can be accessed from a user terminal, or as a recording medium recording the program.
[0123] Explanation of symbols
[0124] 100a: Online Learning System
[0125] 100b: Information Management System
[0126] 14: Authentication Processing Department
[0127] 15: Delivery Control Department
[0128] 16: Ministry of Communications
[0129] 21, 21a: Registration data storage unit
[0130] 24, 24a: Temporary data storage unit
[0131] 25, 25a: Control treatment section
[0132] 100: Distribution device
[0133] 201: Educational institution server
[0134] 301: User terminal
[0135] 401: Server Device
Claims
1. A server device, comprising: a registration data storage unit that stores user registration data corresponding to the information recorded in the official certificate, that is, user registration data including facial photo data; A communication unit that communicates with a user terminal; A temporary data storage unit that acquires from a user terminal and temporarily stores official certificate data with a facial photo taken with the user terminal; and a comparison processing unit, which obtains the facial photo data to be stored in the registration data storage unit as the user registration data from the user terminal, and compares the acquired facial photo data with the official certificate data with the facial photo stored in the temporary data storage unit, wherein The temporary data storage unit does not retain the official certificate data with the facial photo used for the comparison after the comparison by the comparison processing unit, and the registration data storage unit registers the user registration data including the facial photo data used for the comparison after the comparison by the comparison processing unit and when the comparison by the comparison processing unit is successful.
2. The server device according to claim 1, further comprising: an authentication processing unit that performs identity verification based on the facial photo data acquired from the user terminal and the user registration data including the facial photo data used for the comparison; and The registered data storage unit continues to store the user registered data including the facial photo data used for the comparison even after the authentication by the authentication processing unit.
3. Online learning system, including: The server device according to claim 1 or 2; A distribution control unit that distributes online learning materials to user terminals; and A face authentication processing unit performs face authentication of a user when the online learning material is distributed by the distribution control unit, based on an image photographed by a user terminal and the face photo data stored in the registered data storage unit.
4. A program product, for causing a processor of a computer to store user registration data corresponding to information recorded in an official certificate in a user registration data storage unit, which performs: Processing of acquiring official certificate data with a facial photo taken by the user terminal from the user terminal and temporarily storing it in a temporary data storage unit; Comparison processing: acquiring facial photo data to be stored in the registration data storage unit as user registration data from the user terminal, and comparing the acquired facial photo data with the official certificate data with facial photo stored in the temporary data storage unit; and Data processing: After the comparison in the comparison processing, the official certificate data with the facial photo used for the comparison is not maintained in the temporary data storage unit, but after the comparison processing and if the comparison is successful, the user registration data including the facial photo used for the comparison is registered in the user registration data storage unit.
5. A computer-readable recording medium recording a program for causing a processor of a computer to store user registration data corresponding to information recorded in an official certificate in a user registration data storage unit, the program performing: Processing of acquiring official certificate data with a facial photo taken by the user terminal from the user terminal and temporarily storing it in a temporary data storage unit; Comparison processing: acquiring facial photo data to be stored in the registration data storage unit as user registration data from the user terminal, and comparing the acquired facial photo data with the official certificate data with facial photo stored in the temporary data storage unit; and Data processing: After the comparison in the comparison processing, the official certificate data with the facial photo used for the comparison is not maintained in the temporary data storage unit, but after the comparison processing and if the comparison is successful, the user registration data including the facial photo used for the comparison is registered in the user registration data storage unit.
Citation Information
Patent Citations
Individual confirmation method in e-learning learning utilizing biometrics
JP2009276950A
Age verification system
JP2010079877A
KR20210056622A