Video distribution system, video distribution method, video distribution device, and program
The video distribution system addresses the issue of unintended information sharing by allowing subjects to control their video distribution through a viewing user management system, ensuring privacy by limiting access to authorized users.
Patent Information
- Application Number
- JP2024038728
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-13
- Publication Date
- 2025-09-29
AI Technical Summary
Conventional video distribution systems for remote medical care do not reflect the subject's wishes regarding the distribution destination of their video, potentially leading to unintended sharing of private information.
A video distribution system that includes a viewing user management mechanism to control and manage who can view the subject's video, allowing the subject to register and authorize viewing users through manual, voice, or gaze inputs, and supports 360-degree video streaming for flexible viewing angles.
Ensures that the subject's private information is distributed only to intended recipients, respecting the subject's wishes and maintaining privacy.
Smart Images

Figure 2025139734000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a video distribution system, a video distribution method, a video distribution device, and a program. [Background technology]
[0002] BACKGROUND ART Technology for delivering video of a patient receiving care to an application installed on a tablet device or smartphone of a medical professional or family member who is located in a remote location has been known for some time.
[0003] For example, Patent Document 1 discloses a technology that enables videophone conversations between the patient and the doctor in charge, with the aim of enabling medical and nursing care providers to carry out medical and nursing care activities efficiently. Summary of the Invention [Problem to be solved by the invention]
[0004] However, in conventional technologies for streaming video of a patient receiving care to a tablet or smartphone app installed on a remote medical professional or family member, the video destination is set by a streamer other than the patient. Therefore, with conventional technologies, the subject's wishes are not reflected, and private information may be shared with unintended people.
[0005] An object of one embodiment of the present invention is to provide a video distribution system that controls the distribution destination of a video captured by a subject user so as to reflect the subject user's intention. [Means for solving the problem]
[0006] One embodiment of the present invention is a video distribution system having one or more first terminal devices operated by viewing users and an information processing device that controls the distribution of video taken by subject users to the first terminal devices, wherein the information processing device has a viewing user management means that manages the viewing users who are permitted to view video taken by the subject users, a distribution means that distributes video taken by the subject users to the first terminal devices of the viewing users managed by the viewing user management means, and a registration means that, if the subject user takes an action to register the viewing user, registers the viewing user in accordance with the action as the viewing user managed by the viewing user management means, and the first terminal device has a display means that displays the distributed video taken by the subject users. [Effects of the Invention]
[0007] According to one embodiment of the present invention, the distribution destination of the video captured by the subject user can be controlled so as to reflect the subject user's wishes. [Brief explanation of the drawings]
[0008] [Figure 1] 1 is a configuration diagram of an example of a video distribution system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a smartphone according to the present embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer according to the present embodiment. [Figure 4] FIG. 1 is a diagram illustrating an example of a hardware configuration of an omnidirectional imaging device according to an embodiment of the present invention. [Figure 5] 1 is a diagram illustrating an example of an overview of a video distribution system according to an embodiment of the present invention. [Figure 6] 1 is a functional configuration diagram of an example of a video distribution system according to an embodiment of the present invention. [Figure 7] FIG. 10 is a sequence diagram illustrating an example of a process for setting a viewing user in the video distribution system according to the embodiment. [Figure 8]FIG. 10 is a diagram illustrating an example of information about a subject user. [Figure 9] FIG. 10 is a diagram illustrating an example of a configuration of browsing user candidate data. [Figure 10] FIG. 10 is an explanatory diagram of an example of a table in which team IDs, family IDs, and group IDs are associated with each other. [Figure 11] FIG. 10 is an image diagram illustrating an example of a screen of a viewing management application. [Figure 12] FIG. 10 is a sequence diagram illustrating an example of a process for setting a viewing user in the video distribution system according to the present embodiment. [Figure 13] FIG. 10 is a sequence diagram illustrating an example of a process for setting a viewing user in the video distribution system according to the embodiment. [Figure 14] FIG. 10 is a sequence diagram illustrating an example of a process for setting a viewing user in the video distribution system according to the present embodiment. [Figure 15] FIG. 10 is a sequence diagram of an example of a process for controlling the distribution destination of a video captured by a subject user in a video distribution system according to the present embodiment so as to reflect the subject user's intention. [Figure 16] FIG. 1 is a diagram illustrating an example of a use case of a video distribution system according to an embodiment of the present invention. [Figure 17] FIG. 10 is a sequence diagram of an example of a process for requesting a viewing user to be set to take a photograph. DETAILED DESCRIPTION OF THE INVENTION
[0009] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
[0010] <System configuration> Fig. 1 is a configuration diagram of an example of a video distribution system 1 according to this embodiment. The video distribution system 1 in Fig. 1 includes a video distribution device 10, a first terminal device 12, a second terminal device 14, a card reading device 16, and an image capturing device 18. The video distribution device 10, the first terminal device 12, the second terminal device 14, the card reading device 16, and the image capturing device 18 are communicatively connected via a network 20. The network 20 may be the Internet or a LAN (Local Area Network), for example.
[0011] The second terminal device 14, the card reading device 16, and the photographing device 18 are present at the location of the subject user. The subject user is a user who is the subject of the video distributed by the video distribution system 1, and is, for example, a person receiving medical treatment. The location of the subject user may be a hospital, a person receiving medical treatment, a nursing home, or the like.
[0012] The photographing device 18 is an example of a device that photographs a subject user and transmits the photographed video to the video distribution device 10. The photographing device 18 that has a function of communicating with the network 20 transmits the photographed video to the video distribution device 10 via the network 20. Note that the photographing device 18 that does not have a function of communicating with the network 20 may connect to the network 20 via a communication terminal that has a function of communicating with the network 20, and transmit the photographed video to the video distribution device 10 via the communication terminal and the network 20. The photographing device 18 may also be a communication terminal such as a smartphone that has a photographing function.
[0013] The image capturing device 18 may be a wide-angle camera such as a spherical image capturing device, or may not be a wide-angle camera. The spherical image capturing device may be a digital camera that captures a 360-degree image in one shot. The 360-degree image is just one example, and may be a panoramic image capturing a wide range.
[0014] The second terminal device 14 or the card reading device 16 is an example of a device that accepts an action of a subject user. The video distribution system 1 according to this embodiment includes at least one of the second terminal device 14 or the card reading device 16.
[0015] The second terminal device 14 is an example of a device operated by the subject user. The second terminal device 14 is a mobile phone, a smartphone, a tablet terminal, a PC (Personal Computer), a game console, a PDA (Personal Digital Assistant), etc. The second terminal device 14 accepts operations by manual input, voice input, or gaze input from the subject user as an action of the subject user.
[0016] The card reader 16 is an example of a device that reads information from a recording medium such as a magnetic card or an IC card. In this embodiment, the recording medium such as a magnetic card or an IC card is, for example, a My Number card or a patient card of the subject user. The card reader 16 accepts, as an action of the subject user, an operation to read information from a recording medium associated with information of the viewing user.
[0017] The first terminal device 12 is an example of a device operated by a viewing user. The viewing user is a user who views the video of a subject distributed by the video distribution system 1, and is a user who is not in the location where the subject is located. The first terminal device 12 is a mobile phone, a smartphone, a tablet terminal, a PC, a game console, a PDA, or the like.
[0018] The video distribution device 10 receives the video of the subject user captured by the camera device 18. The video distribution device 10 manages viewing users who are permitted to view the video of the subject user captured by the camera device 18, and distributes the video of the subject user captured by the camera device 18 to the first terminal device 12 of the viewing user who is permitted to view the video.
[0019] The video distribution device 10 may distribute and play back the video of the subject user captured by the imaging device 18 to the first terminal device 12 of the viewing user by live streaming via the network 20. If the video of the subject user captured by the imaging device 18 is a 360-degree image, the viewing user can select the angle of view of the video of the subject user played back on the first terminal device 12, and view the video from any angle for each viewing user.
[0020] When second terminal device 14 or card reader 16 accepts the subject user's action as described below, video distribution device 10 controls the distribution destination of the subject user's video so as to reflect the subject user's intention.
[0021] The video distribution device 10 is a PC, a workstation, etc. The video distribution device 10 may be realized by a server, an ASP (Application Service Provider), or cloud computing.
[0022] The video distribution system 1 of this embodiment controls the distribution destination of the subject user's video to reflect the subject user's intentions, thereby ensuring that the subject user's private information is distributed within an appropriate range and is not distributed to unintended users.
[0023] The configuration of the video distribution system 1 shown in Fig. 1 is an example. For example, at least some of the functions of the video distribution device 10 may be provided in another device. The video distribution device 10 may be an MFP (Multifunction Peripheral), which is an example of an image forming device. The video distribution device 10 may be an output device such as a PJ (Projector), an IWB (Interactive White Board: a white board with an electronic blackboard function), or digital signage, industrial machinery, an imaging device, a sound collection device, a medical device, a network home appliance, or an automobile (Connected Car).
[0024] <Hardware configuration> Smartphone The first terminal device 12 and the second terminal device 14 are realized by, for example, a smartphone 400 having a hardware configuration shown in Fig. 2. Fig. 2 is a diagram showing an example of the hardware configuration of the smartphone 400 according to this embodiment.
[0025] The smartphone 400 includes a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, an EEPROM 404, a CMOS (Complementary Metal Oxide Semiconductor) sensor 405, an image sensor I / F (Interface) 406, an acceleration / azimuth sensor 407, a media I / F 409, and a GPS receiver 411.
[0026] The CPU 401 controls the overall operation of the smartphone 400. The ROM 402 stores the CPU 401 and programs used to drive the CPU 401, such as the IPL. The RAM 403 is used as a work area for the CPU 401. The EEPROM 404 reads and writes various data, such as smartphone programs, under the control of the CPU 401.
[0027] The CMOS sensor 405 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) under the control of the CPU 401 to obtain image data. Note that instead of a CMOS sensor, an imaging means such as a CCD (Charge Coupled Device) sensor may be used. The imaging element I / F 406 is a circuit that controls the driving of the CMOS sensor 405. The acceleration / azimuth sensor 407 is one of various sensors, such as an electronic magnetic compass or gyrocompass that detects geomagnetism, and an acceleration sensor. The media I / F 409 controls the reading or writing (storage) of data from or to a recording medium 408, such as a flash memory. The GPS receiver 411 receives GPS signals from GPS satellites.
[0028] The smartphone 400 also includes a long-distance communication circuit 412, a CMOS sensor 413, an image sensor I / F 414, a microphone 415, a speaker 416, an audio input / output I / F 417, a display 418, an external device connection I / F 419, a short-distance communication circuit 420, an antenna 420a of the short-distance communication circuit 420, and a touch panel 421.
[0029] The long-distance communication circuit 412 is a circuit that communicates with other devices via the network 20. The CMOS sensor 413 is a type of built-in imaging means that captures an image of a subject and obtains image data under the control of the CPU 401. The image sensor I / F 414 is a circuit that controls the driving of the CMOS sensor 413. The microphone 415 is a built-in circuit that converts sound into an electrical signal. The speaker 416 is a built-in circuit that converts an electrical signal into physical vibrations to produce sound such as music or voice.
[0030] The audio input / output I / F 417 is a circuit that processes input and output of audio signals between the microphone 415 and the speaker 416 under the control of the CPU 401. The display 418 is a type of display means such as a liquid crystal or organic EL (Electro Luminescence) that displays an image of a subject, various icons, etc. The external device connection I / F 419 is an interface for connecting various external devices.
[0031] The short-range communication circuit 420 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 421 is a type of input means that allows a user to operate the smartphone 400 by pressing the display 418. The smartphone 400 also includes a bus line 410. The bus line 410 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 401 shown in FIG. 2 .
[0032] "computer" The video distribution device 10 is realized, for example, by a computer 500 having the hardware configuration shown in Fig. 3. The first terminal device 12 and the second terminal device 14 may also be realized by a computer 500 having the hardware configuration shown in Fig. 3. Fig. 3 is a diagram showing an example of the hardware configuration of the computer 500 according to this embodiment.
[0033] The computer 500 includes a CPU 501, a ROM 502, a RAM 503, a HD 504, an HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F 508, a network I / F 509, a data bus 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516.
[0034] The CPU 501 controls the overall operation of the computer 500 in accordance with a program. The ROM 502 stores programs used to drive the CPU 501, such as the IPL. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls the reading and writing of various data from and to the HD 504 in accordance with the control of the CPU 501.
[0035] The display 506 displays various types of information such as a cursor, menus, windows, characters, or images. The display 506 may be, for example, an HMD or HUD (Head Up Display) device. The external device connection I / F 508 is an interface for connecting various types of external devices. In this case, the external device may be, for example, a USB (Universal Serial Bus) memory or the like.
[0036] The network I / F 509 is an interface for performing data communication using the network 20. The data bus 510 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 501.
[0037] The keyboard 511 is a type of input means having multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 514 controls reading and writing of various data from a DVD-RW 513, which is an example of a removable recording medium. Note that this is not limited to a DVD-RW, and may be a DVD-R, etc. The media I / F 516 controls reading and writing (storing) of data from a recording medium 515, such as a flash memory.
[0038] Note that the hardware configuration shown in FIG. 3 is an example, and the configuration may not include some of the components shown in FIG. 3, or may include components other than those shown in FIG.
[0039] <<Spherical photography device>> The imaging device 18 is realized by, for example, an omnidirectional imaging device 600 having a hardware configuration shown in Fig. 4. Fig. 4 is a diagram showing the hardware configuration of an example of the omnidirectional imaging device 600 according to this embodiment. The omnidirectional imaging device 600 shown in Fig. 4 is an example of an omnidirectional imaging device using two imaging elements, but may be an omnidirectional imaging device using two or more imaging elements.
[0040] Furthermore, the omnidirectional imaging device 600 does not necessarily have to be a device dedicated to omnidirectional imaging. An ordinary digital camera, a smartphone, or the like may have substantially the same functions as the omnidirectional imaging device 600 by attaching an omnidirectional imaging unit thereto as a retrofit.
[0041] The omnidirectional imaging device 600 shown in FIG. 4 includes an imaging unit 601, an image processing unit 604, an imaging control unit 605, a microphone 608, a sound processing unit 609, a CPU 611, a ROM 612, an SRAM (Static RAM) 613, a DRAM (Dynamic RAM) 614, an operation unit 615, an external device connection I / F 616, a communication unit 617, an antenna 617a, and an acceleration / azimuth sensor 618.
[0042] The imaging unit 601 includes wide-angle lenses (so-called fisheye lenses) 602a and 602b, each having a field angle of 180 degrees or more for forming a hemispherical image, and two imaging elements 603a and 603b provided corresponding to each wide-angle lens. The imaging elements 603a and 603b include an image sensor such as a CMOS sensor or a CCD sensor that converts optical images captured by the wide-angle lenses 602a and 602b into image data electrical signals and outputs the image data, a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks for the image sensors, and a group of registers that set various commands or parameters required for the operation of the imaging elements 603a and 603b.
[0043] The imaging elements 603a and 603b of the imaging unit 601 are each connected to an image processing unit 604 via a parallel I / F bus. The imaging elements 603a and 603b are also connected to an imaging control unit 605 via a serial I / F bus (such as an I2C bus). The image processing unit 604, imaging control unit 605, and sound processing unit 609 are connected to a CPU 611 via a bus 610. Furthermore, a ROM 612, an SRAM 613, a DRAM 614, an operation unit 615, an external device connection I / F 616, a communication unit 617, an acceleration / direction sensor 618, and the like are also connected to the bus 610.
[0044] The image processing unit 604 takes in the image data output from the image sensors 603a and 603b via a parallel I / F bus, performs predetermined processing on each piece of image data, and then synthesizes the image data to create equirectangular projection image data.
[0045] The imaging control unit 605 generally sets commands and the like in the registers of the imaging elements 603a and 603b using an I2C bus, with the imaging control unit 605 acting as a master device and the imaging elements 603a and 603b acting as slave devices. Necessary commands and the like are received from the CPU 611. The imaging control unit 605 also uses the I2C bus to retrieve status data and the like from the registers of the imaging elements 603a and 603b and send it to the CPU 611.
[0046] Furthermore, when the shutter button of the operation unit 615 is pressed, the imaging control unit 605 instructs the image sensors 603a and 603b to output image data. The omnidirectional imaging device 600 may also have a preview display function or a function for displaying moving images on a display (for example, a smartphone display). In this case, the image data is output continuously from the image sensors 603a and 603b at a predetermined frame rate (frames per minute).
[0047] As will be described later, the imaging control unit 605 also functions as a synchronization control unit that synchronizes the output of image data from the image sensors 603a and 603b in cooperation with the CPU 611. Although no display is provided in the omnidirectional imaging device 600 in FIG. 4, a display unit may be provided.
[0048] The microphone 608 converts sound into sound (signal) data. The sound processing unit 609 takes in the sound data output from the microphone 608 via the I / F bus and performs predetermined processing on the sound data.
[0049] The CPU 611 controls the overall operation of the omnidirectional imaging device 600 and executes necessary processes. The ROM 612 stores various programs for the CPU 611. The SRAM 613 and DRAM 614 are work memories that store programs executed by the CPU 611, data in the middle of processing, etc. In particular, the DRAM 614 stores image data in the middle of processing by the image processing unit 604 and data of processed equirectangular projection images.
[0050] The operation unit 615 is a general term for operation buttons such as a shutter button. A user operates the operation unit 615 to input various shooting modes, shooting conditions, and the like. The external device connection I / F 616 is an interface for connecting various external devices. The various external devices are, for example, USB memory or a PC. Data of the equirectangular projection image stored in the DRAM 614 is recorded in an external device such as external media via the external device connection I / F 616, or transmitted to an external device such as a smartphone via the external device connection I / F 616 as needed.
[0051] The communication unit 617 communicates with a communication terminal such as the smartphone 400 by using a short-range wireless communication technology such as Wi-Fi, NFC, or Bluetooth (registered trademark) via an antenna 617a provided in the omnidirectional imaging device 600. By using the communication unit 617, the omnidirectional imaging device 600 can transmit data of the equirectangular projection image to a communication terminal such as the smartphone 400.
[0052] The acceleration and orientation sensor 618 calculates the orientation of the omnidirectional imaging device 600 from the Earth's magnetism and outputs the orientation information. The orientation information is an example of related information (metadata) conforming to Exif, and is used for image processing such as image correction of captured images. The related information also includes data such as the date and time the image was captured and the data size of the image data. The acceleration and orientation sensor 618 is a sensor that detects angle changes (roll angle, pitch angle, yaw angle) that accompany the movement of the omnidirectional imaging device 600. The angle changes are an example of related information (metadata) conforming to Exif, and are used for image processing such as image correction of captured images. The acceleration and orientation sensor 618 is a sensor that detects acceleration in three axial directions.
[0053] The celestial sphere imaging device 600 calculates the attitude (angle with respect to the direction of gravity) of its own device (the celestial sphere imaging device 600) based on the acceleration detected by the acceleration / orientation sensor 618. Providing the acceleration / orientation sensor 618 in the celestial sphere imaging device 600 improves the accuracy of image correction.
[0054] <Summary> Here, to facilitate understanding of this embodiment, an example of a video distribution system 1 will be described in which the subject user is a patient receiving home nursing care, the viewing user is a nursing school student, and the distributor is a nurse providing home nursing care.
[0055] Fig. 5 is a diagram illustrating an example of an overview of the video distribution system 1 according to this embodiment. In Fig. 5, a visiting nursing station and a nursing school have a training partnership. The visiting nursing station is a business that provides visiting nursing services.
[0056] In step S10, a nurse, who is an example of a distributor, visits the home of a patient in need of care with camera 18. In step S12, the nurse sets up camera 18 so that the nursing care provided to the patient can be filmed. In step S14, the nurse starts filming with camera 18 and then performs nursing care for the patient. The nursing care provided by the nurse to the patient is filmed by camera 18.
[0057] The video distribution device 10 manages viewing users (distribution destinations) who are permitted to view the video captured by the imaging device 18. For example, in the example of Fig. 5, students of a nursing school that has a practical training partnership with the visiting nursing station are managed as viewing users who are permitted to view the video captured by the imaging device 18.
[0058] The video captured by the imaging device 18 is distributed and played back by live streaming to the first terminal device 12 of the nursing school students who are managed by the video distribution device 10 as viewing users who are permitted to view the video. If the video captured by the imaging device 18 is a 360-degree image, the nursing school students operating the first terminal device 12 can view the video from any angle by operating the first terminal device 12 to select the angle of view.
[0059] In the video distribution system 1 according to the present embodiment, a recuperating person, who is an example of a subject user, controls the distribution destination of the video captured by the imaging device 18 as described below, thereby controlling the distribution destination of the video so as to reflect the wishes of the recuperating person. Therefore, the video distribution system 1 according to the present embodiment can prevent the private information of the recuperating person from being viewed by users unintended by the recuperating person.
[0060] <Functional configuration> The video distribution system 1 according to this embodiment is realized by, for example, the functional configuration shown in FIG. 6. FIG. 6 is a functional configuration diagram of an example of the video distribution system 1 according to this embodiment. The functional configuration diagram shown in FIG. 6 omits configurations that are not necessary for explaining this embodiment. The video distribution device 10, first terminal device 12, second terminal device 14, and card reader 16 of the video distribution system 1 execute programs such as an OS and an app, thereby realizing, for example, the functional configuration shown in FIG. 6.
[0061] 6 includes a communication unit 30, a viewing user management unit 32, a distribution unit 34, a registration unit 36, an authentication unit 38, and a storage unit 40. The first terminal device 12 includes an operation reception unit 50, a display unit 52, and a communication unit 54. The second terminal device 14 includes an operation reception unit 50, a display unit 62, and a communication unit 64. The card reading device 16 includes a reading unit 80 and a communication unit 82.
[0062] An operation reception unit 50 of the first terminal device 12 receives various operations from viewing users such as nursing school students. A display unit 52 displays various information to the viewing users. The display unit 52 also displays video captured by the imaging device 18. A communication unit 54 communicates with the video distribution device 10.
[0063] The operation reception unit 60 of the second terminal device 14 receives various operations from a subject user such as a patient receiving medical treatment. The display unit 62 displays various information to the subject user. The communication unit 64 communicates with the video distribution device 10.
[0064] The reading unit 80 of the card reader 16 reads information from a recording medium such as a magnetic card or an IC card. The recording medium such as a magnetic card or an IC card may be any recording medium associated with information of the viewing users who the subject user permits to view the video. For example, the subject user's patient card is an example of a recording medium associated with information of personnel at the hospital used by the subject user. Also, the subject user's My Number card is an example of a recording medium associated with information of the viewing users' family members set by the subject user.
[0065] The communication unit 30 of the video distribution device 10 communicates with the first terminal device 12, the second terminal device 14, the card reading device 16, and the photographing device 18. The viewing user management unit 32 manages viewing users who are permitted to view videos photographed by the photographing device 18, as described below. The distribution unit 34 distributes the videos photographed by the photographing device 18 to the first terminal devices 12 of the viewing users managed by the viewing user management unit 32.
[0066] If there is an action of the subject user to register a viewing user, the registration unit 36 registers the viewing user corresponding to the action as a viewing user managed by the viewing user management unit 32. The action of the subject user to register a viewing user is an operation by manual input, voice input, or eye-gaze input by the subject user to set the viewing user from the second terminal device 14. In addition, the action of the subject user to register a viewing user is an operation to read information from a recording medium associated with the information of the viewing user.
[0067] The authentication unit 38 authenticates the user operating the first terminal device 12 or the second terminal device 14. The storage unit 40 stores information necessary for processing by the video distribution device 10, such as subject user, viewing user, and viewing user candidate data.
[0068] 6 is an example, and some of the functions of video distribution device 10 may be provided in first terminal device 12, second terminal device 14, card reading device 16, or photographing device 18. The division of video distribution device 10 in FIG. 6 is an example, and it may be realized by dividing it into two or more devices.
[0069] <Processing> The processing procedure of the video distribution system 1 according to this embodiment will be described.
[0070] 《Viewing User Settings》 FIG. 7 is a sequence diagram of an example of a process for setting a viewing user in the video distribution system 1 according to this embodiment.
[0071] In step S10, the subject user operates the operation reception unit 60 of the second terminal device 14 to launch the viewing management app and input the subject user's authentication information. In step S12, the communication unit 64 of the second terminal device 14 notifies the video distribution device 10 of the input subject user's authentication information.
[0072] In step S14, authentication unit 38 of video distribution device 10 performs authentication processing using the notified authentication information. If authentication is successful, authentication unit 38 performs list generation processing in step S16. If authentication is not successful, authentication unit 38 ends the processing in the sequence diagram of Fig. 7. Here, the description will continue assuming that authentication is successful.
[0073] In step S16, the registration unit 36 uses the information of the successfully authenticated subject user, for example, shown in FIG. 8, as a key to generate a list to be presented to the subject user from the viewing user candidate data, for example, shown in FIG.
[0074] Fig. 8 is a diagram showing an example of the structure of the subject user's information. The subject user's information has the following items: user ID, password, subject user name, team ID, family ID, and group ID. The subject user's information in Fig. 8 has the items of team ID, family ID, and group ID related to the subject user.
[0075] The user ID and password are examples of authentication information for the subject user. The subject user name is the name of the subject user. The team ID, family ID, and group ID are examples of keys used to select a default viewing user or a viewing user candidate to be presented to the subject user from the viewing user candidate data in FIG. 9, for example.
[0076] The default viewing user is permitted to view on the screen of the viewing management app described below, and check control to set whether viewing is permitted or not is not possible. Also, the viewing user candidate who can be checked is permitted to view on the screen of the viewing management app described below.
[0077] The team ID is an example of information for identifying, for example, a person associated with the hospital where the subject user is hospitalized. The family ID is an example of information for identifying, for example, a family member of the subject user. The group ID is an example of information for identifying, for example, a person associated with the business where the subject user uses home nursing services or a person associated with the nursing care facility where the subject user uses nursing care services. The group ID is also an example of information for identifying, for example, a person associated with a nursing school or a care school.
[0078] FIG. 9 is a configuration diagram of an example of viewing user candidate data. The viewing user candidate data is information on viewing user candidates who can become viewing users. The viewing user candidate data in FIG. 9 has the following items: user ID, password, user name, team ID, family ID, group ID, and supplementary explanation. The user ID and password are examples of authentication information for the viewing user candidate. The user name is the name of the viewing user candidate. The team ID is an example of information for identifying, for example, a hospital to which the viewing user candidate belongs. The family ID is an example of information for identifying, for example, a family member of the viewing user candidate. Furthermore, the group ID is an example of information for identifying, for example, a business operator, care facility, nursing school, or care school to which the viewing user candidate belongs.
[0079] The team ID, family ID, and group ID are associated with each other in the table shown in Fig. 10, for example. Fig. 10(A) is an example of a team table associated with team IDs. Fig. 10(B) is an example of a family table associated with family IDs. Fig. 10(C) is an example of a group table associated with group IDs.
[0080] For example, in the case of the subject user information in FIG. 8 and the viewing user candidate data in FIG. 9, the registration unit 36 searches the viewing user candidate data in FIG. 9 using the family ID “1001” of the subject user information as a key, and the viewing user candidates with user IDs “0001” and “0002” are selected as default viewing users.
[0081] Furthermore, the registration unit 36 searches the viewing user candidate data in FIG. 9 using the team ID "101" of the subject user information as a key, and the viewing user candidates with user IDs "0005" and "0006" are selected as default viewing users.
[0082] Furthermore, the registration unit 36 searches the viewing user candidate data in FIG. 9 using the group ID "10001" of the subject user information as a key, and the viewing user candidates with user IDs "0007" and "0008" are selected as default viewing users.
[0083] The registration unit 36 can search the viewing user candidate data in FIG. 9 using the values of the team ID, family ID, and group ID items of the photographed user information as keys, and set the selected viewing user candidate as the default viewing user.
[0084] The list generated in step S16 includes information on the default viewing user and candidate viewing users who can be checked. In step S18, the communication unit 30 of the video distribution device 10 responds to the second terminal device 14 with the list generated in step S16.
[0085] In step S20, the display unit 62 of the second terminal device 14 displays, for example, a screen 1000 of the viewing management app shown in Fig. 11. Fig. 11 is an image diagram of an example of the viewing management app screen 1000. The display unit 62 can display the viewing management app screen 1000 of Fig. 11 by using the list received from the video distribution device 10.
[0086] 11, the default viewing user included in the list has a check mark in the check box 1004 by default, and viewing is permitted. Note that the check box 1004 for the default viewing user cannot be checked, and therefore viewing is not prohibited.
[0087] Furthermore, the screen 1000 of the view management application in FIG. 11 provides a check box 1004 that allows check control to set whether or not to permit viewing for the viewer user candidates included in the list who can be checked.
[0088] In step S22, the subject user selects a viewing user by checking the check box 1004 of the viewing user to whom the subject user wants to allow viewing in addition to the default viewing user on the viewing management app screen 1000 of FIG. 11 displayed on the second terminal device 14, and then pressing the setting reflect button 1002.
[0089] For example, on the screen 1000 of the viewing management application in FIG. 11, the subject user checks the check boxes 1004 for nursing trainee and instructor to cooperate with the nursing training, thereby permitting viewing of the video.
[0090] In step S24, the communication unit 64 of the second terminal device 14 notifies the video distribution device 10 of the viewing users set on the screen 1000 of the viewing management app in Fig. 11. When the viewing users set on the screen 1000 of the viewing management app in Fig. 11 are notified, the registration unit 36 of the video distribution device 10 registers the viewing users notified from the second terminal device 14 in step S26.
[0091] The process of setting a viewing user in the video distribution system 1 according to this embodiment may be performed, for example, as shown in Fig. 12. Fig. 12 is a sequence diagram of an example of the process of setting a viewing user in the video distribution system 1 according to this embodiment.
[0092] In step S30, the subject user sets or brings close to card reading device 16 a recording medium such as a My Number card or a patient card that corresponds to information about a viewing user who is authorized to view the video. Reading unit 80 of card reading device 16 reads information from the recording medium such as a My Number card or a patient card. In step S32, communication unit 82 of card reading device 16 notifies video distribution device 10 of the information read by reading unit 80.
[0093] In step S34, the viewing user management unit 32 of the video distribution device 10 acquires information about the viewing user associated with the recording medium, using the information about the recording medium notified from the card reading device 16. For example, when the viewing user management unit 32 reads information from the patient card of the hospital where the subject user is hospitalized, it acquires information about personnel at the hospital as information about the viewing user who is permitted to view. Also, when the viewing user management unit 32 reads information from the subject user's My Number card, it may acquire information about the subject user's family as information about the viewing user who is permitted to view. Also, in step S36, the registration unit 36 of the video distribution device 10 registers the viewing user based on the viewing user information acquired in step S34.
[0094] According to the process of the sequence diagram of FIG. 12, by performing an operation to read information from a recording medium associated with the information of the viewing user, the viewing user can be registered using the information of the viewing user associated with that recording medium.
[0095] In the processing of the sequence diagrams of FIGS. 7 and 12, the viewing user is set using the action of the subject user as a trigger, but the viewing user may be set using a request from the viewing user as a trigger.
[0096] 13 and 14 are sequence diagrams of an example of a process for setting a viewing user in the video distribution system 1 according to this embodiment.
[0097] In step S50, the viewing user operates the operation reception unit 50 of the first terminal device 12 to start the viewing application, enters the viewing user's authentication information, and then performs an operation to request viewing of the video captured by the subject user. In step S52, the communication unit 54 of the first terminal device 12 notifies the video distribution device 10 of the request to view the video.
[0098] If the viewing user who notified the video viewing request in step S52 is a new user not managed by the viewing user management unit 32, the video distribution device 10 proceeds to the processing of step S54. In step S54, the authentication unit 38 requests the registration unit 36 to register the new user. In step S56, the registration unit 36 notifies the second terminal device 14 of the registration request for the new user.
[0099] In step S60, the display unit 62 of the second terminal device 14 displays the registration request for the new user. By displaying the registration request for the new user on the display unit 62, the subject user can recognize that the new user has notified the subject user of a request to view the video.
[0100] The processes of steps S62 to S70 are performed when the subject user denies the notified request to view the video. In step S62, the subject user operates operation reception unit 60 of second terminal device 14 to deny the viewing. In step S64, communication unit 64 of second terminal device 14 notifies video distribution device 10 of the denial of the user's registration request.
[0101] In step S66, the registration unit 36 of the video distribution device 10 notifies the authentication unit 38 of the denial of the user's registration request notified in step S64. In step S68, the authentication unit 38 notifies the first terminal device 12 of the denial of the user's registration request.
[0102] In step S70, the display unit 52 of the first terminal device 12 displays a view refusal screen, allowing the user who made the view request in step S50 to recognize that the request to view the video has been refused by the subject user.
[0103] The processes of steps S72 to S80 are performed when the subject user replies with approval in response to the notified request to view the video. In step S72, the subject user operates operation acceptance unit 60 of second terminal device 14 to respond with approval for viewing. In step S74, communication unit 64 of second terminal device 14 notifies video distribution device 10 of approval of the user's registration request.
[0104] In step S76, the registration unit 36 of the video distribution device 10 notifies the authentication unit 38 of approval of the user's registration request notified in step S74. In step S78, the authentication unit 38 notifies the first terminal device 12 of approval of the user's registration request.
[0105] In step S80, the display unit 52 of the first terminal device 12 displays a viewing approval screen. The user who made the viewing request in step S50 can recognize that the request to view the video has been approved by the subject user.
[0106] If the viewing user who notified the request to view the video in step S52 is a registered user managed by viewing user management unit 32, video distribution device 10 notifies second terminal device 14 of the registered user's viewing request and causes the registered user's viewing request to be displayed. By displaying the registered user's viewing request on display unit 62 of second terminal device 14, the subject user can recognize that a request to view the video has been notified by the registered user.
[0107] The processes of steps S82 to S90 are performed when the subject user denies the notified request to view the video. In step S82, the subject user operates operation reception unit 60 of second terminal device 14 to deny the viewing. In step S84, communication unit 64 of second terminal device 14 notifies video distribution device 10 of the user's denial of viewing.
[0108] In step S86, the registration unit 36 of the video distribution device 10 notifies the authentication unit 38 of the denial of the user's viewing notified in step S84. In step S88, the authentication unit 38 notifies the first terminal device 12 of the denial of the user's viewing.
[0109] In step S90, the display unit 52 of the first terminal device 12 displays a view refusal screen, allowing the user who made the view request in step S50 to recognize that the request to view the video has been refused by the subject user.
[0110] The processing of steps S92 to S100 is performed when the subject user replies with approval in response to the notified request to view the video. In step S92, the subject user operates operation acceptance unit 60 of second terminal device 14 to respond with approval for viewing. In step S94, communication unit 64 of second terminal device 14 notifies video distribution device 10 of the user's approval for viewing.
[0111] In step S96, the registration unit 36 of the video distribution device 10 notifies the authentication unit 38 of the approval of the user's viewing notified in step S94. In step S98, the authentication unit 38 notifies the first terminal device 12 of the approval of the user's viewing.
[0112] In step S100, the display unit 52 of the first terminal device 12 displays a viewing approval screen. The user who made the viewing request in step S50 can recognize that the request to view the video has been approved by the subject user.
[0113] <<Distribution of footage taken by the subject user>> FIG. 15 is a sequence diagram of an example of processing for controlling the distribution destination of a video captured by a subject user in the video distribution system 1 according to this embodiment so as to reflect the subject user's intention.
[0114] Before performing the processing of the sequence diagram in Fig. 15, the subject user sets the viewing users to whom the subject user will permit distribution of the video captured by the subject user, for example, as shown in Fig. 7. During the processing of the sequence diagram in Fig. 15, the subject user may set the viewing users to whom the subject user will permit distribution of the video captured by the subject user, for example, as shown in Figs. 13 and 14.
[0115] After the distributor sets up the image capturing device 18, the subject user instructs the distributor to start distribution in step S110. In step S112, the distributor operates the video distribution device 10 to start video distribution.
[0116] In step S114, the viewing user performs a viewing start operation on the operation reception unit 50 of the first terminal device 12. In step S116, the first terminal device 12 starts up a viewing application. In step S118, the first terminal device 12 displays a viewing screen on the display unit 52.
[0117] The processes of steps S120 to S124 are repeated until the end of distribution of the video captured by the image capturing device 18. In step S120, the distribution unit 34 of the video distributing device 10 checks with the viewing user management unit 32 for information on viewing users who are permitted to view the video.
[0118] In step S122, the distribution unit 34 distributes the video captured by the imaging device 18 to the first terminal device 12 of the viewing user who is permitted to view the video. In step S124, the display unit 52 of the first terminal device 12 displays the video distributed from the video distribution device 10, and in step S125, the viewing user who is permitted to view the video can view the video captured by the subject user.
[0119] In the video distribution system 1 of this embodiment, the subject user sets the viewing users that the subject user is willing to allow to view the video, and the distribution destination of the video is controlled according to that setting, so that the distribution destination of the video can be controlled to reflect the subject user's intentions.
[0120] In step S126, the subject user instructs the distributor to end distribution. In step S128, the distributor performs an operation to end video distribution on the video distribution device 10. The distribution unit 34 of the video distribution device 10 performs distribution end processing. In step S132, the distribution unit 34 notifies the first terminal device 12 that distribution has ended. In step S134, the first terminal device 12 displays a distribution end screen on the display unit 52.
[0121] In step S136, the viewing user performs a viewing end operation on the operation acceptance unit 50 of the first terminal apparatus 12. In step S138, the first terminal apparatus 12 ends the viewing application.
[0122] As described above, the video distribution system 1 of this embodiment controls the distribution destination of the subject user's video so as to reflect the subject user's intentions, thereby ensuring that the subject user's private information is distributed within an appropriate range and is not distributed to unintended users.
[0123] The video distribution system 1 according to this embodiment can be used in a use case such as that shown in Fig. 16. Fig. 16 is a diagram showing an example of a use case of the video distribution system 1 according to this embodiment.
[0124] Use case A illustrates the subject, broadcaster, and viewer when using nursing practice conducted at a hospital. Use case B illustrates the subject, broadcaster, and viewer when using nursing practice conducted at a patient's home. Use case C illustrates the subject, broadcaster, and viewer when using nursing practice conducted at a care facility.
[0125] 《Photo provided by a viewer》 11, if the photos of the default browsing user and the candidate browsing user who can be checked and included in the list are registered, they are displayed as icons. On the other hand, if the photos of the default browsing user and the candidate browsing user who can be checked and included in the list are not registered, a display (for example, "NO IMAGE") is displayed to indicate that the photos are not registered.
[0126] When a subject user decides whether to permit or deny viewing, the photograph may be helpful in making the decision, so it is desirable to register photographs of candidate viewing users that can be checked.
[0127] Therefore, in the video distribution system 1 according to the present embodiment, in the processing of the sequence diagrams shown in Fig. 13 and Fig. 14, the viewing user to be set may be requested to take a photo, as shown in Fig. 17. Fig. 17 is a sequence diagram of an example of processing of requesting the viewing user to be set to take a photo.
[0128] In step S150, the viewing user operates the operation accepting unit 50 of the first terminal device 12 to start the viewing app, enters the viewing user's authentication information, and then performs an operation to request viewing of the video captured by the subject user. In step S152, the communication unit 54 of the first terminal device 12 notifies the video distribution device 10 of the request to view the video.
[0129] If the viewing user who has notified the request to view the video is a new user who is not managed by the viewing user management unit 32, the video distribution device 10 proceeds to the processing of step S154. In step S154, the authentication unit 38 requests the first terminal device 12 to take a photograph of the viewing user.
[0130] In step S156, the first terminal device 12 displays a photography permission screen requesting permission to take a photograph on the display unit 52. In step S158, the viewing user operates the first terminal device 12 to respond (permit or deny) to the photography permission screen.
[0131] The processes of steps S160 to S170 are performed when the response to the photography permission screen indicates permission. In step S160, the first terminal device 12 activates the camera and takes a photo of the viewer. In step S162, the communication unit 54 of the first terminal device 12 transmits a photo image of the viewing user to the video distribution device 10.
[0132] In step S164, the authentication unit 38 of the video distribution device 10 requests the registration unit 36 to register a photo image of the viewing user. In step S166, the authentication unit 38 requests the registration unit 36 to register a new user. In step S168, the registration unit 36 notifies the second terminal device 14 of the registration request for the new user.
[0133] In step S170, the display unit 62 of the second terminal device 14 displays the registration request for the new user. By displaying the registration request for the new user on the display unit 62, the subject user can recognize that a request to view the video has been notified by the new user.
[0134] Furthermore, the process of step S172 is a process performed when the response to the photography permission screen is not permitted. In step S172, the display unit 52 of the first terminal device 12 displays a viewing refusal screen. The viewing user who was not permitted to respond to the photography permission screen in step S158 can recognize that the request to view the video has been rejected by the subject user.
[0135] The processing after step S170 is the same as the processing shown in steps S62 to S80 in Fig. 13, and therefore description thereof will be omitted. Also, if the viewing user who notified the request to view the video in step S52 is a registered user managed by the viewing user management unit 32, processing similar to steps S82 to S100 in Fig. 14 is performed, and therefore description thereof will be omitted.
[0136] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or a conventional circuit module designed to perform each function described above.
[0137] The devices described in the examples merely represent one of multiple computing environments for implementing the embodiments disclosed herein. The present invention is not limited to these embodiments, and the components in these embodiments include those that would be easily conceived by a person skilled in the art, those that are substantially identical, and those that are within the scope of what is called equivalents. Furthermore, various omissions, substitutions, modifications, and combinations of the components can be made without departing from the spirit of the present embodiments. [Explanation of symbols]
[0138] 1. Video distribution system 10 Video distribution equipment 12 First terminal device 14 Second terminal device 16 Card reader 18 Imaging equipment 32 Viewing User Management Department 34 Distribution Department 36 Registration Department 38 Authentication Department 52 Display section [Prior art documents] [Patent documents]
[0139] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-82147
Claims
1. A video distribution system including one or more first terminal devices operated by a viewing user, and an information processing device that controls distribution of a video captured by a subject user to the first terminal devices, The information processing device includes: a viewing user management means for managing the viewing users who are permitted to view the video captured by the subject user; a distribution means for distributing the video captured by the subject user to the first terminal device of the viewing user managed by the viewing user management means; a registration means for, if there is an action of the subject user to register the viewing user, registering the viewing user corresponding to the action as the viewing user managed by the viewing user management means; and The first terminal device a display means for displaying the distributed video captured by the subject user; A video distribution system having the above.
2. The registration means receives, from the subject user, an operation to register the viewing user from a second terminal device operated by the subject user as an action of the subject user to register the viewing user. The video distribution system according to claim 1.
3. The registration means receives, as an action of the subject user to register the viewing user, an operation to register the viewing user using a recording medium associated with information of the viewing user to be registered, from the subject user. The video distribution system according to claim 1.
4. When the subject user approves the registration request received from the viewing user, the registration means registers the viewing user who responded to the registration request as the viewing user managed by the viewing user management means. The video distribution system according to claim 1.
5. The registration means requests the browsing user to take a photo if the photo of the browsing user who has made the registration request is not registered in the browsing user management means.
5. The video distribution system according to claim 4.
6. The action of the subject user is an operation by the subject user's manual input, voice input, or eye gaze input to the second terminal device.
3. The video distribution system according to claim 2.
7. A video distribution method performed by a video distribution system having one or more first terminal devices operated by a viewing user and an information processing device that controls distribution of a video captured by a subject user to the first terminal devices, comprising: The information processing device, a viewing user management procedure for managing the viewing users who are permitted to view the video captured by the subject user; a distribution procedure for distributing a video captured by the subject user to the first terminal device of the viewing user managed by the viewing user management procedure; a registration step of, if there is an action of the subject user to register the viewing user, registering the viewing user corresponding to the action as the viewing user to be managed by the viewing user management step; and The first terminal device, a display step of displaying the delivered video captured by the subject user; A video distribution method having the above.
8. A video distribution device that controls distribution of a video captured by a subject user to one or more first terminal devices operated by a viewing user, a viewing user management means for managing the viewing users who are permitted to view the video captured by the subject user; a distribution means for distributing the video captured by the subject user to the first terminal device of the viewing user managed by the viewing user management means; a registration means for, if there is an action of the subject user to register the viewing user, registering the viewing user corresponding to the action as the viewing user managed by the viewing user management means; A video distribution device having the above.
9. a video distribution device that controls distribution of a video captured by a subject user to one or more first terminal devices operated by a viewing user; a viewing user management procedure for managing the viewing users who are permitted to view the video captured by the subject user; a distribution procedure for distributing the video captured by the subject user to the first terminal device of the viewing user managed by the viewing user management procedure; a registration step of, if there is an action of the subject user to register the viewing user, registering the viewing user corresponding to the action as the viewing user to be managed by the viewing user management step; A program that executes the following.
Citation Information
Patent Citations
Medical care support system and medical care support server
JP2015082147A