Video viewing system and video switching method

Abstract

To adaptively change over moving images to be displayed on a viewing terminal correspondingly to a situation of a visiting customer who visits a shop, to support improvement of satisfaction of the visiting customer with the shop.SOLUTION: A moving image viewing system comprises: an imaging terminal that is located behind a user in a shop and comprises an imaging unit for imaging appearance of the user from behind; and a viewing terminal that is located in front of the user in the shop, is connected so as to be communicable with the imaging terminal, and comprises a display unit for displaying imaged video of the appearance of the user from behind imaged by the imaging terminal. The viewing terminal comprises a memory storing a moving image with respect to the shop. When imaged video is transmitted from the imaging terminal, the viewing terminal displays the transmitted imaged video. When no imaged video is transmitted from the imaging terminal, the viewing terminal reproduces and displays the moving image with respect to the shop stored in the memory.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present disclosure relates to a video viewing system and a video switching method. [Background technology]

[0002] Patent Document 1 discloses a rearview mirror system that includes a camera that is placed behind the user and captures the user's rear view, a mirror monitor that displays the mirror image in front of the user and the captured image captured by the camera, a user terminal that sets information about the beauty salon that is the destination of the captured image sent from the mirror monitor and transmits it to a server, and a beauty salon terminal that displays the captured image sent from the user terminal via the server. The user terminal receives and displays the contents of the comments on hair arrangement from the hairdresser who has viewed the captured image via the beauty salon terminal and the server. This makes it easy to obtain accurate advice on hair arrangement from the hairdresser. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-136971 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the configuration of Patent Document 1, a mirror monitor placed in front of the user displays either a mirror image in front of the user, a video of the user's rear view captured by a camera placed behind the user, or both. For this reason, in a store (e.g., a beauty salon), the customer is made to wait for a certain period of time while a staff member (e.g., a hairdresser) performs a service (e.g., a haircut) on the customer, or while waiting for the service to be temporarily suspended and then resumed. Therefore, it is considered that there is room for improvement compared to Patent Document 1 in terms of effectively utilizing the time that the customer is made to wait for a certain period of time to improve the customer's satisfaction with the store.

[0005] The present disclosure has been devised in consideration of the above-mentioned conventional circumstances, and aims to provide a video viewing system and video switching method that adaptively switches the video displayed on a viewing terminal according to the situation of a customer visiting a store, thereby helping to improve the customer's satisfaction with the store. [Means for solving the problem]

[0006] The present disclosure provides a video viewing system comprising: a photographing terminal positioned behind a user in a store and equipped with an imaging unit that captures an image of the user's rear; and a viewing terminal positioned in front of the user in the store, communicatively connected to the photographing terminal, and equipped with a display unit that displays a photographed image of the rear of the user captured by the photographing terminal, wherein the viewing terminal has a memory for storing videos related to the store, and when the photographed video is transmitted from the photographing terminal, the transmitted photographed video is displayed on the display unit, and when the photographed video is not transmitted from the photographing terminal, the video related to the store stored in the memory is played and displayed on the display unit.

[0007] The present disclosure also provides a video switching method that is executed by a video viewing system that includes an imaging terminal located behind a user in a store and capturing an image of the user's rear view, and a viewing terminal located in front of the user in the store, connected to the imaging terminal for communication with the imaging terminal, and displaying a captured image of the rear view of the user captured by the imaging terminal, and that stores videos related to the store in a memory, and when the captured video is transmitted from the imaging terminal, displays the transmitted captured video, and when the captured video is not transmitted from the imaging terminal, plays and displays the video related to the store stored in the memory. Effect of the Invention

[0008] According to the present disclosure, the video displayed on the viewing terminal can be adaptively switched according to the situation of a customer visiting a store, thereby helping to improve the customer's satisfaction with the store. [Brief description of the drawings]

[0009] [Figure 1] A diagram showing an example of the layout of imaging and viewing terminals in a beauty salon. [Diagram 2] FIG. 1 is a diagram showing an example of a system configuration of a video viewing system according to a first embodiment; [Diagram 3] A block diagram showing an example of the hardware configuration of a photographing terminal. [Figure 4] Block diagram showing an example of the hardware configuration of a viewing terminal [Diagram 5] A diagram showing an example of switching between videos displayed on a viewing device [Figure 6] FIG. 1 is a sequence diagram showing an example of an operation procedure of a photographing terminal and a viewing terminal according to the first embodiment. [Figure 7] A diagram showing an example of the transition of the time-series display content of a video displayed on a viewing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, with reference to the drawings as appropriate, a detailed description will be given of an embodiment specifically disclosing a video viewing system and a video switching method according to the present disclosure. However, more detailed description than necessary may be omitted. For example, detailed description of already well-known matters or duplicate description of substantially the same configuration may be omitted. This is to avoid the following description becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the attached drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0011] The following description will be given assuming that the imaging terminal and the viewing terminal constituting the video viewing system according to the embodiment 1 are installed in a store. Here, a beauty salon will be taken as an example of the store, but as the imaging terminal captures images of the back of the user who is to be photographed (details will be described later), the store is not limited to a beauty salon and may be a barber's shop, a kimono dressing class, or the like.

[0012] In the following description, the term "video" includes the concept of video in a broad sense. For example, video includes not only video (including images) obtained by shooting (capturing) images using a shooting terminal constituting the video viewing system, but also advertising videos that serve as store introductions, such as store campaigns, stored in a viewing terminal constituting the video viewing system.

[0013] First, an example of the arrangement of the photographing terminal 10 and the viewing terminal 20 constituting the video viewing system 100 according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the arrangement of the photographing terminal 10 and the viewing terminal 20 in a beauty salon SL1. In the beauty salon SL1, a styling chair CHR1 on which a user GST1, who is a customer, sits and a mirror dresser MR1 attached to the wall in front of the styling chair CHR1 are paired so that the user GST1 can have his / her hair cut or styled by a staff member (e.g., a hairdresser SYL1).

[0014] The photographing terminal 10 is located behind (on the back side of) the user GST1 in the beauty salon SL1. The photographing terminal 10 is arranged, for example, to be fixed to the top of a stand STD1 erected behind a styling chair CHR1. The photographing terminal 10 is a device (for example, a mobile phone or a smartphone) with a photographing (imaging) function, and captures an image of the back of the user GST1. The photographing terminal 10 generates photographed video data showing the back of the user GST1 being treated by the hairdresser SYL1 through this imaging. The photographing terminal 10 is connected to the viewing terminal 20 via a wireless router C1 (see FIG. 2) arranged in the beauty salon SL1 so as to be able to wirelessly communicate with the viewing terminal 20, and sends the photographed video data to the viewing terminal 20 via the wireless router C1. Note that, as long as an environment is maintained in which the back of the user GST1 can be captured, the location of the photographing terminal 10 is not limited to the top of the stand STD1, and may be attached to, for example, the tip of a wearable neck strap (not shown) worn around the neck of the hairdresser SYL1.

[0015] The viewing terminal 20 is located in front of the user GST1 in the beauty salon SL1. The viewing terminal 20 is fixed to a stand placed on a table TBL1 provided between the styling chair CHR1 and the mirror dresser MR1 and in the vicinity of the mirror dresser MR1. The viewing terminal 20 is a device (for example, a tablet terminal having a wide display device) that has a function of playing or displaying video data in a viewable manner, and displays the data of the captured video of the user GST1's back image captured by the photographing terminal 10. The viewing terminal 20 is connected to the photographing terminal 10 via a wireless router C1 (see FIG. 2) that is located in the beauty salon SL1 so that wireless communication is possible, and receives the captured video data sent from the photographing terminal 10 via the wireless router C1. It is preferable that the viewing terminal 20 is located so that the top of the viewing terminal 20 is considerably lower than the line of sight of the user GST1 so that the user GST1 can see his or her own image reflected in the mirror of the mirror dresser MR1 in front of him or her.

[0016] Next, a system configuration example of the video viewing system 100 according to the first embodiment will be described with reference to FIG. 2. FIG. 2 is a diagram showing a system configuration example of the video viewing system 100 according to the first embodiment. The video viewing system 100 includes a photographing terminal 10 and a viewing terminal 20. As described above, the photographing terminal 10 and the viewing terminal 20 are arranged as one pair P1 in a store (e.g., a beauty salon SL1) and are connected to each other via a wireless router C1 arranged in the beauty salon SL1 so as to enable data communication between them. Although only one pair of the photographing terminal 10 and the viewing terminal 20 is illustrated in FIG. 2, multiple pairs of the photographing terminal 10 and the viewing terminal 20 may be provided in the beauty salon SL1. Furthermore, although the video viewing system 100 is illustrated as being provided only in one beauty salon SL1, it may be provided in each of multiple stores (e.g., beauty salons).

[0017] In the video viewing system 100, the wireless router C1 is connected to the management server S1 via the network NW so as to be able to communicate data with the management server S1. The network NW may be, for example, a wired network such as a wired LAN (Local Area Network) or a wireless network such as a wireless LAN. The wireless router C1 relays data transmission and reception between the photographing terminal 10 and the viewing terminal 20 in the beauty salon SL1, and also performs data communication with the management server S1 via the network NW (see above). Therefore, each of the photographing terminal 10 and the viewing terminal 20 can transmit and receive data to and from the management server S1 via the wireless router C1.

[0018] The management server S1 transmits and receives data to and from a wireless router C1 in the beauty salon SL1 via the network NW. The management server S1 manages the account IDs and passwords of the photographing terminals 10 and the viewing terminals 20 arranged in each shop (e.g., each beauty salon) constituting the video viewing system 100, and performs authentication processing to determine the legitimacy of use of each of the photographing terminals 10 and the viewing terminals 20. This authentication processing is performed, for example, when the execution of applications for the different video viewing systems 100 installed in each of the photographing terminals 10 and the viewing terminals 20 is started.

[0019] The management server S1 holds and manages the availability status of each of the photographing terminal 10 and the viewing terminal 20 (i.e., information indicating whether the account ID is valid or not), and sends an authentication result to the corresponding terminal, which indicates that the use of the photographing terminal 10 or the viewing terminal 20 whose account ID is determined to be invalid in the above-mentioned authentication process is denied. As a result, for example, if a business model is implemented in which a monthly usage fee is collected from a beauty salon SL1 that uses the video viewing system 100, the management server S1 can remotely restrict the use of the video viewing system 100 by refusing to allow unpaid beauty salons to use their terminals (e.g., the photographing terminal 10, the viewing terminal 20).

[0020] Next, a hardware configuration example of the photographing terminal 10 constituting the video viewing system 100 according to the first embodiment will be described with reference to FIG. 3. FIG. 3 is a block diagram showing a hardware configuration example of the photographing terminal 10. The photographing terminal 10 includes an imaging unit 101, a memory 102, a processor 103, a display operation unit 104, an audio input / output controller 105, a bus 106, a public line controller 107, a public line communication interface 108, a wireless LAN controller 109, a wireless LAN communication interface 110, and a rechargeable battery 111. Note that in FIG. 3 and FIG. 4, the interface is abbreviated as "IF". Note that, in FIG. 3, the configuration will be described by taking as an example a case where the photographing terminal 10 is a smartphone, but the photographing terminal 10 does not have to be a smartphone.

[0021] The imaging unit 101 is configured to have at least a lens (not shown) and an image sensor (not shown). The image sensor is, for example, a solid-state imaging element such as a CCD (Charged Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and converts an optical image of a subject formed on an imaging surface through the lens into an electrical signal. The image sensor also generates data of a captured image (see above) in a format recognizable by humans (for example, RGB format or YUV format) based on the electrical signal. The imaging unit 101 starts capturing images based on a command output from the processor 103, and transmits the captured image data obtained by capturing images to the processor 103, the public line controller 107, or the wireless LAN controller 109 via the bus 106.

[0022] The memory 102 has at least a RAM (Random Access Memory) as a work memory used when executing each process of the processor 103, and a ROM (Read Only Memory) for storing a program and data that defines the operation of the processor 103. The RAM temporarily stores data or information generated or acquired by the processor 103. The ROM stores a program that defines the operation of the processor 103 and data used when executing the program. The memory 102 stores, for example, identification information of the imaging terminal 10 and identification information of the viewing terminal 20 that is registered (paired) in advance as a distribution destination to which data of the captured video captured by the imaging unit 101 is distributed.

[0023] Furthermore, the memory 102 may include storage such as a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).

[0024] The processor 103 is configured using, for example, a CPU (Central Processing Unit), a DSP (Digital Signal Processor), or an FPGA (Field Programmable Gate Array). The processor 103 functionally includes an OS (Operating System) processing unit 103A and an application processing unit 103B, and performs various processes and controls in cooperation with the OS processing unit 103A and the application processing unit 103B and the memory 102. For example, the processor 103 executes various processes such as distribution and recording of data of a video captured by the imaging unit 101.

[0025] The OS processing unit 103A executes processing and control related to basic operations related to various processes performed by the photographing terminal 10.

[0026] The application processing unit 103B executes processing of various applications including applications suitable for the imaging terminal 10 of the video viewing system 100.

[0027] The display operation unit 104, which is an example of a display unit or operation unit, is configured using a touch panel that accepts operations by a store clerk (e.g., hairdresser SYL1) and displays data generated by the processor 103, forming a so-called user interface. The display operation unit 104 may display various screens generated by the processor 103 while an application (see above) of the photographing terminal 10 is running. The display operation unit 104 accepts operations by a store clerk (e.g., hairdresser SYL1) on the various displayed screens, generates input signals, and sends them to the processor 103.

[0028] Furthermore, when the display operation unit 104 receives an operation by a staff member (e.g., hairdresser SYL1) to put the photographing terminal 10 into a sleep state (i.e., a temporary power saving mode) or to cancel the sleep state, the display operation unit 104 generates a signal based on the operation and sends it to the processor 103. In the photographing terminal 10, the processor 103 may automatically put the photographing terminal 10 into a sleep state if there is no operation on the display operation unit 104 for a certain period of time.

[0029] As a result, the processor 103 stops transmitting the data of the captured video captured by the imaging unit 101 to the viewing terminal 20 when an operation for transitioning to the sleep state is received or in response to the above-mentioned automatic transition to the sleep state. In other words, when the photographing terminal 10 transitions to the sleep state, the viewing terminal 20 stops receiving the data of the captured video from the photographing terminal 10. In addition, when the processor 103 receives an operation for canceling the sleep state during the sleep state, it resumes transmitting the data of the captured video captured by the imaging unit 101 to the viewing terminal 20. In other words, when the photographing terminal 10 transitions from the sleep state to a normal operating state (in other words, a non-sleep state), the viewing terminal 20 begins to receive the data of the captured video from the photographing terminal 10. Although the details will be described later (see FIG. 5), the viewing terminal 20 switches between displaying the data of the captured video and playing and displaying the data of the advertising video (see later) depending on whether or not the data of the captured video is transmitted from the photographing terminal 10.

[0030] When the processor 103 receives an operation by a store clerk (e.g., the hairdresser SYL1) to put the photographing terminal 10 into a sleep state (i.e., a temporary power saving mode) or an operation to cancel the sleep state, the processor 103 may send a pause notification (e.g., a signal to put the photographing terminal 10 into a sleep state) or a start notification (e.g., a signal to cancel the sleep state) to the viewing terminal 20 via the bus 106, the wireless LAN controller 109, the wireless LAN communication interface 110, the antenna ANT2, and the wireless router C1. When the processor 103 receives an operation by a store clerk (e.g., the hairdresser SYL1) to terminate an application of the photographing terminal 10 or to resume the application, the processor 103 may send a termination notification (e.g., a signal to terminate an application) or a resume notification (e.g., a signal to resume an application) to the viewing terminal 20 via the bus 106, the wireless LAN controller 109, the wireless LAN communication interface 110, the antenna ANT2, and the wireless router C1.

[0031] Based on instructions output from the processor 103, the audio input / output controller 105 sends audio data picked up by the microphone MK1 to the processor 103 via the bus 106, or causes audio data input via the bus 106 to be output from the speaker SP1.

[0032] The microphone MK1 picks up the voice based on the speech of a staff member (e.g., hairdresser SYL1) using the photographing terminal 10, converts it into a voice signal, and sends the converted voice signal (voice data) to the voice input / output controller 105. The voice data picked up by the microphone MK1 is input to the processor 103 via the voice input / output controller 105 and the bus 106. The processor 103 may perform voice recognition processing on this input voice data, and execute processing for transitioning the photographing terminal 10 to a state (e.g., a sleep state) or canceling the sleep state according to the result of the voice recognition processing. This allows the staff member (e.g., hairdresser SYL1) to easily transition to the sleep state or cancel the sleep state by the voice of the staff member (e.g., hairdresser SYL1) even if both hands are occupied during treatment, thereby improving the convenience of operation by the staff member (e.g., hairdresser SYL1).

[0033] The speaker SP1 acoustically outputs the audio data from the audio input / output controller 105.

[0034] The bus 106 inputs captured video data from the imaging unit 101. The bus 106 also inputs and outputs captured video data and audio data to and from the processor 103, audio data to and from the audio input / output controller 105, captured video data and audio data to and from the public line controller 107, and captured video data and audio data to and from the wireless LAN controller 109.

[0035] The public line controller 107 executes control relating to input and output of data between the bus 106 and the public line communication interface 108. The public line controller 107 may be omitted from the configuration of the photographing terminal 10.

[0036] The public line communication interface 108 is connected to an antenna ANT1 included in the photographing terminal 10, and performs wireless communication (for example, data transmission from the public line controller 107) using a public line with a public base station (not shown). The public line communication interface 108 may be omitted from the configuration of the photographing terminal 10.

[0037] The wireless LAN controller 109 executes control related to input and output of data between the bus 106 and the wireless LAN communication interface 110. The wireless LAN controller 109 sends at least one of a command output from the processor 103 and captured video data and audio data input via the bus 106 to the wireless LAN communication interface 110. The wireless LAN controller 109 may also send at least one of the captured video data and audio data input from the wireless LAN communication interface 110 to the processor 103.

[0038] The wireless LAN communication interface 110 is connected to an antenna ANT2 included in the photographing terminal 10, and performs wireless communication (e.g., data transmission from the wireless LAN controller 109) with the wireless router C1 via wireless LAN. The wireless LAN communication interface 110 also transmits and receives data to and from the management server S1 via the wireless router C1.

[0039] The rechargeable battery 111 is a battery (e.g., a cell) capable of storing electric charge supplied from an external commercial power source, and supplies power to the photographing terminal 10. The rechargeable battery 111 may be detachable. The rechargeable battery 111 may directly obtain power supply from an external commercial power source, or may be capable of supplying power to the photographing terminal 10 in a state where it is disconnected from the external commercial power source.

[0040] Next, a hardware configuration example of the viewing terminal 20 constituting the video viewing system 100 according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing a hardware configuration example of the viewing terminal 20. The viewing terminal 20 includes an imaging unit 201, a memory 202, a processor 203, a display operation unit 204, an audio input / output controller 205, a bus 206, a public line controller 207, a public line communication interface 208, a wireless LAN controller 209, a wireless LAN communication interface 210, and a rechargeable battery 211. Note that, although the configuration will be described with an example in which the viewing terminal 20 is a tablet terminal in Fig. 4, the viewing terminal 20 does not have to be a tablet terminal.

[0041] The imaging unit 201 is configured to have at least a lens (not shown) and an image sensor (not shown). The image sensor is, for example, a solid-state imaging element such as a CCD or a CMOS, and converts an optical image of a subject formed on an imaging surface through the lens into an electrical signal. The image sensor also generates video data in a format recognizable by humans (for example, RGB format or YUV format) based on the electrical signal. The imaging unit 201 starts imaging based on a command output from the processor 203, and sends the video data obtained by imaging to the processor 203, the public line controller 207, or the wireless LAN controller 209 via the bus 206. Note that the imaging unit 201 may be omitted from the configuration of the viewing terminal 20.

[0042] The memory 202 has at least a RAM as a work memory used when executing each process of the processor 203, and a ROM for storing a program and data that defines the operation of the processor 203. The RAM temporarily stores data or information generated or acquired by the processor 203. The ROM stores a program that defines the operation of the processor 203 and data used when the program is executed. The memory 202 stores, for example, identification information of the viewing terminal 20 and identification information of the imaging terminal 10 that is registered (paired) in advance as a transmission source of the captured video data.

[0043] Furthermore, the memory 202 may have storage such as a flash memory, HDD, or SSD. The memory 202 stores data of advertising videos that show campaigns related to a store (e.g., beauty salon SL1) or introduce products handled by the store. The advertising video data may be stored in the memory 202 by transferring data (so-called copying) from a PC (not shown) that stores the advertising video data when the PC is connected to the viewing terminal 20, or the advertising video data corresponding to the store (e.g., beauty salon SL1) may be downloaded from the management server S1 by the viewing terminal 20 and stored in the memory 202.

[0044] The processor 203 is configured using, for example, a CPU, a DSP, or an FPGA. The processor 203 functionally has an OS processing unit 203A and an application processing unit 203B, and performs various processes and controls by cooperation between the OS processing unit 203A and the application processing unit 203B and the memory 202. For example, the processor 203 executes various processes such as displaying the data of the photographed video transmitted (distributed) from the photographing terminal 10, and playing and displaying the data of the advertisement video stored in the memory 202.

[0045] The OS processing unit 203A executes processing and control related to basic operations concerning various processes performed by the audio-visual terminal 20.

[0046] The application processing unit 203B executes processing of various applications including applications suitable for the viewing terminal 20 of the video viewing system 100.

[0047] The display operation unit 204, which is an example of a display unit or an operation unit, is configured using a touch panel that accepts operations by a clerk (e.g., hairdresser SYL1) and displays data generated by the processor 203, forming a so-called user interface. Here, while the clerk (e.g., hairdresser SYL1) is performing a treatment such as a haircut for the user GST1, the clerk (e.g., hairdresser SYL1) is away from the viewing terminal 20 (see FIG. 1), so it is difficult for the clerk (e.g., hairdresser SYL1) to operate the display operation unit 204. However, as will be described later with reference to FIG. 5, according to the first embodiment, the contents of the video displayed by the viewing terminal 20 can be easily switched by operating the imaging terminal 10, which is located in a position where the clerk (e.g., hairdresser SYL1) can easily operate. The display operation unit 204 may display various screens generated by the processor 203 while an application (see above) of the viewing terminal 20 is running. The display operation unit 204 accepts operations by the clerk (e.g., hairdresser SYL1) on the various displayed screens, generates input signals, and sends them to the processor 203. Also, the display operation unit 204 may receive operations not from a clerk (e.g., hairdresser SYL1) but from the user GST1. For example, when the user GST1 is holding the viewing terminal 20 and viewing, pressing a record icon displayed on an application screen (not shown) displayed on the display operation unit 204, the display operation unit 204 may record (store) the data of the captured video displayed based on the pressing operation in the memory 202. Alternatively, when the viewing terminal 20 detects the pressing operation of the record icon, it may send a recording start notification to the imaging terminal 10, and when the imaging terminal 10 receives the recording start notification from the viewing terminal 20, it may record (store) the data of the captured video in the memory 102.

[0048] Based on instructions output from the processor 203, the audio input / output controller 205 sends audio data picked up by the microphone MK2 to the processor 203 via the bus 206, or causes audio data input via the bus 206 to be output from the speaker SP2.

[0049] The microphone MK2 picks up voice based on the speech of a store clerk (e.g., hairdresser SYL1) using the audio terminal 20 or a user GST1, converts it into a voice signal, and sends the converted voice signal (voice data) to the voice input / output controller 205. The voice data picked up by the microphone MK2 is input to the processor 203 via the voice input / output controller 205 and the bus 206. The processor 203 may perform voice recognition processing on this input voice data, and execute processing according to the results of the voice recognition processing.

[0050] The speaker SP2 acoustically outputs the audio data from the audio input / output controller 205.

[0051] The bus 206 inputs captured video data from the imaging unit 201. The bus 206 also inputs and outputs captured video data and audio data to and from the processor 203, audio data to and from the audio input / output controller 205, captured video data and audio data to and from the public line controller 207, and captured video data and audio data to and from the wireless LAN controller 209.

[0052] The public line controller 207 executes control relating to input and output of data between the bus 206 and the public line communication interface 208 .

[0053] The public line communication interface 208 is connected to an antenna ANT3 included in the audiovisual terminal 20, and performs wireless communication (for example, data transmission from the public line controller 207) using a public line with a public base station (not shown).

[0054] The wireless LAN controller 209 executes control related to input and output of data between the bus 206 and the wireless LAN communication interface 210. The wireless LAN controller 209 sends at least one of a command output from the processor 203 and captured video data and audio data input from the wireless LAN communication interface 210 to the processor 203. The wireless LAN controller 209 may also send at least one of the captured video data and audio data output from the processor 203 to the wireless LAN communication interface 210.

[0055] The wireless LAN communication interface 210 is connected to an antenna ANT4 included in the audiovisual terminal 20, and performs wireless communication (e.g., data transmission from the wireless LAN controller 209) with the wireless router C1 via wireless LAN. The wireless LAN communication interface 210 also transmits and receives data to and from the management server S1 via the wireless router C1.

[0056] The rechargeable battery 211 is a battery (e.g., a cell) capable of storing electric charge supplied from an external commercial power source, and supplies power to the audio-visual terminal 20. The rechargeable battery 211 may be detachable. The rechargeable battery 211 may obtain power directly from an external commercial power source, or may be capable of supplying power to the audio-visual terminal 20 in a state where it is disconnected from the external commercial power source.

[0057] Next, a general example of switching between videos on the photographing terminal 10 and the viewing terminal 20 constituting the video viewing system 100 according to the first embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram showing a general example of switching between videos displayed on the viewing terminal.

[0058] While a staff member (e.g., hairdresser SYL1) is providing a service (e.g., a haircut) to user GST1 in a shop (e.g., beauty salon SL1), the photographing terminal 10 is positioned behind the user GST1 and captures an image of the back of the user GST1 (e.g., the back of the hair). This allows the photographing terminal 10 to distribute (transmit) data of the photographed video showing the back of the user GST1 to the viewing terminal 20, for example, by an operation on the screen SC1 by the hairdresser SYL1. The viewing terminal 20 can receive the data of the photographed video distributed from the photographing terminal 10 and display it on the screen SC2 of the display operation unit 204.

[0059] However, in the beauty salon SL1, there are cases where the staff member (e.g., hairdresser SYL1) in charge of the user GST1 cannot always be present to provide treatment. In this case, the treatment (e.g., a haircut, etc.) for the user GST1 is temporarily suspended and the user has to wait a certain period of time until it is resumed. Similarly, the user has to wait a certain period of time from when the user GST1 arrives at the salon and is led into the styling chair CHR1 until the staff member (e.g., hairdresser SYL1) begins treatment. While the user GST1 is made to wait in this manner, there is a possibility that the user GST1 will become bored.

[0060] Therefore, in the first embodiment, when the hairdresser SYL1 manually switches the photographing terminal 10 to a sleep state or when the photographing terminal 10 automatically switches to a sleep state (see screen SC3), the viewing terminal 20 detects that photographed video data is not being distributed from the photographing terminal 10, or detects a pause notification (e.g., that the photographing terminal 10 has switched to a sleep state) or an end notification (e.g., that an application of the photographing terminal 10 has been terminated) from the photographing terminal 10, and based on the detection, reads out the advertising video data stored in the viewing terminal 20 from the memory 202 and plays and displays it on the screen SC4. In other words, the viewing terminal 20 can freely switch between displaying the photographed video of the back of the user GST1 captured by the photographing terminal 10 and the advertising video of the shop (e.g., beauty salon SL1) depending on whether photographed video data is being distributed from the photographing terminal 10, whether a pause notification or end notification has been received from the photographing terminal 10, or whether the photographing terminal 10 has switched to a sleep state.

[0061] The following methods are possible for the audiovisual terminal 20 to detect the transition of the photographing terminal 10 to the sleep state, but the method is not limited to these.

[0062] For example, in the first method, the photographing terminal 10 proactively sends a pause notification (e.g., a notification that the photographing terminal 10 is going to sleep) to the viewing terminal 20 immediately before the photographing terminal 10 goes to sleep, and the viewing terminal 20 receives the notification, thereby being able to detect the photographing terminal 10 going to sleep. This allows the viewing terminal 20 to accurately detect that the photographing terminal 10 is going to sleep, and therefore allows the viewing terminal 20 to quickly play and display advertising video data prepared in advance for the user GST1, and allows efficient introduction of the store (e.g., beauty salon SL1) to the user GST1.

[0063] For example, in the second method, the viewing terminal 20 can detect the transition of the photographing terminal 10 to the sleep state when the viewing terminal 20 detects that it has stopped receiving photographed video data from the photographing terminal 10 or has not received the data for a certain period of time. This allows the viewing terminal 20 to detect that the photographing terminal 10 is going to the sleep state by simply determining that it has stopped receiving photographed video data or has not received the data for a certain period of time, even if the viewing terminal 20 does not receive an active notification from the photographing terminal 10 that the terminal is going to the sleep state.

[0064] Next, an example of the operation procedure of the photographing terminal 10 and the viewing terminal 20 constituting the video viewing system 100 according to the first embodiment will be described with reference to Figs. 6 and 7. Fig. 6 is a sequence diagram showing an example of the operation procedure of the photographing terminal 10 and the viewing terminal 20 according to the first embodiment. Fig. 7 is a diagram showing an example of the transition of the time-series display contents of the video displayed on the viewing terminal 20. Hereinafter, the operation procedure of the photographing terminal 10 and the viewing terminal 20 will be described with reference to Fig. 6, and the contents of the video displayed on the viewing terminal 20 will be described with reference to Fig. 7. Note that, as a premise for the description of Figs. 6 and 7, the photographing terminal 10 and the viewing terminal 20 are registered (paired) with each other as a destination and a source for transmitting and receiving data to each other.

[0065] In FIG. 6, the hairdresser SYL1 performs an operation to start an application for the photographing terminal 10 and an application for the viewing terminal 20 (St1). As a result, the photographing terminal 10 starts the application for the photographing terminal 10 by the operation of the hairdresser SYL1 in step St1 (St2), and establishes a wireless connection with the wireless router C1. Similarly, the viewing terminal 20 starts the application for the viewing terminal 20 by the operation of the hairdresser SYL1 in step St1 (St3), and establishes a wireless connection with the wireless router C1. For example, assume that the user GST1 (in other words, a customer) has not yet visited the salon at this time. When the viewing terminal 20 starts the application for the viewing terminal 20 in step St3, it reads out the data of the advertisement video MV1 stored in the memory 202 of the viewing terminal 20 and plays and displays it on the display operation unit 204 (St4, see time t1 in FIG. 7). As a result, the advertising video that teaches about the business campaign of the beauty salon SL1 or the introduction of the products (e.g., coloring materials) handled by the beauty salon SL1 is played and displayed from the viewing terminal 20 in the beauty salon SL1. In addition, the processes of steps St1 to St3 do not have to be performed simultaneously. For example, the process of step St3 may be performed before the process of step St2, so that the viewing terminal 20 plays and displays the advertising video data, and the process of step St2 may be executed when the treatment of the user GST1 who has visited the store begins.

[0066] After starting the application in step St2, the photographing terminal 10 sends a connection start notification to the wireless router C1 to start a P2P (Peer to Peer) wireless connection (for example, a P2P connection for wireless LAN communication such as Wi-Fi (registered trademark)) with the viewing terminal 20 (St5), and performs wireless connection processing for the P2P connection with the viewing terminal 20 (St6). When the wireless router C1 receives the connection start notification from the photographing terminal 10, it transfers it to the viewing terminal 20. The viewing terminal 20 receives the connection start notification transferred by the wireless router C1 (St8). This completes the P2P connection so that the photographing terminal 10 and the viewing terminal 20 can communicate with each other via wireless LAN through P2P connection (St9). Note that, as an example of the wireless connection from step St5 to step St9, an example of P2P connection between the photographing terminal 10 and the viewing terminal 20 has been described, but the wireless communication between the photographing terminal 10 and the viewing terminal 20 may be performed via a server (not shown) or a repeater (not shown) other than the wireless router C1.

[0067] After the P2P connection between the photographing terminal 10 and the viewing terminal 20 is completed in step St9, the application of the corresponding terminal may be terminated by a manual operation by a staff member (e.g., hairdresser SYL1) of the photographing terminal 10 and the viewing terminal 20. In this case, if the application of the corresponding terminal is started again by a manual operation by the staff member (e.g., hairdresser SYL1), the P2P connection will be established again.

[0068] While the data of the advertisement video MV1 is being played and displayed in step St4, for example, assume that the user GST1 visits the beauty salon SL1, is called by the hairdresser SYL1 in charge, sits on the styling chair CHR1, and the hairdresser SYL1 starts a hair treatment for the user GST1. For example, if the applications of the photographing terminal 10 and the viewing terminal 20 are terminated before the user GST1 visits the salon by manual operation by the staff (e.g., the hairdresser SYL1), the photographing terminal 10 and the viewing terminal 20 may establish a P2P connection with each other by starting the corresponding application of their own terminal by manual operation by the staff (e.g., the hairdresser SYL1). The photographing terminal 10 generates data of a photographed video showing the back view (e.g., the back hair) of the user GST1 photographed by the imaging unit 101, and starts distribution (transmission) of the photographed video data to the viewing terminal 20 via the wireless router C1 in response to an operation (e.g., an operation of an application for the photographing terminal 10) by the hairdresser SYL1 on the display operation unit 104 (St10). The photographing terminal 10 distributes (transmits) data of the photographed videos MV2, MV3, ..., which show the back view (e.g., the back hair) of the user GST1 captured by the imaging unit 101 at different times during the treatment, to the viewing terminal 20 via the wireless router C1 (St11). Upon receiving the data of the photographed videos MV2, MV3, ..., distributed in step St11, the viewing terminal 20 displays each data on the display operation unit 204 (St12, see times t2 and t3 in FIG. 7).

[0069] Here, for example, assume that the hairdresser SYL1 who is in charge of the user GST1 leaves the user GST1 for some reason, such as to observe the status of another user (not shown) who he is in charge of, or to process the bill for yet another user who has already finished treatment, and so the hairdresser SYL1 manually stops the distribution of the captured video (St13). Note that the reason why the hairdresser SYL1 leaves the user GST1 for some reason is not limited to the above. Here, the distribution stop operation is an operation for switching the imaging terminal 10 to a sleep state (i.e., a temporary power saving mode state), and corresponds to, for example, the operation of pressing a power button (not shown) that constitutes a part of the display operation unit 104.

[0070] The photographing terminal 10 transitions to a sleep state by the distribution stop operation in step St13 (St14). Although the transition to the sleep state in step St14 has been described as being realized by an active manual operation by the hairdresser SYL1 in step St13, the photographing terminal 10 may be automatically transitioned to the sleep state by detecting that the hairdresser SYL1 has not operated the photographing terminal 10 for a certain period of time (for example, 5 minutes). In response to the transition to the sleep state in step St14, the photographing terminal 10 generates and acquires a request to stop distribution of the photographed video data (St15), and sends the request to the viewing terminal 20 via the wireless router C1 (St16). When the viewing terminal 20 receives the distribution stop request sent in step St16, it interrupts the display of the photographed video data, reads out the data of the advertisement video MV4 or the advertisement video MV1 from the memory 202, and plays and displays the data on the display operation unit 204 (St17, see time t4 or time t5 in FIG. 7).

[0071] In step St17, when the viewing terminal 20 switches from displaying the shot video data to playing and displaying the advertising video data, the viewing terminal 20 may determine the playback location of the advertising video data as follows. Specifically, the viewing terminal 20 basically determines it as a location midway through the advertising video data, but if the in-camera (i.e., the imaging unit 201) does not detect a person (e.g., user GST1) for a certain period of time and then determines that a person has been detected, it determines that the user has been replaced by a different person and determines that the beginning (head) location of the advertising video data is the playback location.

[0072] In other words, the advertising video data may be played back from the beginning (top) of the advertising video data (see advertising video MV1), or from a continuation of the point that was played back until the filmed video data was displayed at step St12 (see advertising video MV4). If the data is played back from the former point (i.e., the beginning), the store (e.g., beauty salon SL1) can allow a newly visiting user to watch an advertising video with content that the store (e.g., beauty salon SL1) wants them to watch first. On the other hand, if the data is played back from the latter point (i.e., an intermediate point), the store (e.g., beauty salon SL1) can allow the same user GST1 who has already visited the store to enjoy watching an advertising video with new content that is different from the content that he or she has already viewed.

[0073] Here, suppose that the hairdresser SYL who takes care of the user GST1 manually starts the distribution of the captured video (in other words, resumes the distribution) for a reason such as the hairdresser SYL returning to the user GST1 (St18). Note that, in order to release the sleep state of the photographing terminal 10 constituted by, for example, a smartphone, manual operation by an operator (e.g., the hairdresser SYL1) is required, and therefore the above-mentioned distribution start operation requires manual operation by the hairdresser SYL1.

[0074] The photographing terminal 10 releases the sleep mode by the distribution start operation in step St18. In response to the release of the sleep mode, the photographing terminal 10 generates and acquires a distribution start request for the photographed video data (St19) and sends it to the viewing terminal 20 via the wireless router C1 (St20). When the viewing terminal 20 receives the distribution start request sent in step St20 and the photographed video data showing the back view (e.g., back hair) of the user GST1 captured by the imaging unit 101, it interrupts the playback display of the advertisement video MV4 or the advertisement video MV1 and displays the photographed video data sent from the photographing terminal 10 on the display operation unit 204 (St21).

[0075] In addition, in the explanation of Figure 6 above, in preparation for opening a store (e.g., a beauty salon SL1), the processes from step St1 to step St17 (in other words, P2P connection between the shooting terminal 10 and the viewing terminal 20, confirmation of viewing of the video shot by the shooting terminal 10 on the viewing terminal 20, and playback and display of the advertising video data on the viewing terminal 20 by a staff member (e.g., a hairdresser SYL1) manually stopping the distribution) may be performed in advance, and this may also be applied to an operation of waiting for user GST1 to arrive at the store.

[0076] As described above, the video viewing system 100 according to the first embodiment includes a photographing terminal 10 located behind the user GST1 in a store (e.g., a beauty salon SL1) and equipped with an imaging unit 101 that captures a picture of the user's back, and a viewing terminal 20 located in front of the user GST1 in the store (e.g., a beauty salon SL1), connected to the photographing terminal 10 so as to be communicable with the photographing terminal 10, and equipped with a display unit (e.g., a display operation unit 204) that displays a photographed video of the back of the user GST1 captured by the photographing terminal 10. The viewing terminal 20 includes a memory 202 that stores a video related to the store, and when a photographed video is transmitted from the photographing terminal 10, the transmitted photographed video is displayed on the display operation unit 204. When a photographed video is not transmitted from the photographing terminal 10, the viewing terminal 20 plays and displays a video related to the store stored in the memory 202 on the display operation unit 204.

[0077] As a result, the video viewing system 100 or the video switching method can adaptively switch the video displayed on the viewing terminal 20 in accordance with the situation of a customer (e.g., user GST1) who visits a store (e.g., beauty salon SL1). Therefore, the video viewing system 100 or the video switching method can effectively support improvement of the customer's (i.e., user GST1) satisfaction with the store (e.g., beauty salon SL1).

[0078] The photographing terminal 10 also includes an operation unit (e.g., a display operation unit 104) that accepts a store clerk operation (e.g., a distribution stop operation) that switches on and off the transmission of the photographed video (e.g., the sleep state of the photographing terminal 10). In response to a transition to a state in which the photographed video is not being transmitted (e.g., the sleep state of the photographing terminal 10) based on the store clerk operation, the viewing terminal 20 plays and displays the video related to the store stored in the memory 202 on the display operation unit 204. For example, when the viewing terminal 20 receives a pause notification (see above) or an end notification (see above) from the photographing terminal 10, the viewing terminal 20 may determine that the photographed video is not being transmitted and play and display the video related to the store on the display operation unit 204. This allows the viewing terminal 20 to accurately detect that the photographing terminal 10 is going into a sleep state, and therefore allows the viewing terminal 20 to quickly play and display the data of the advertisement video prepared in advance for the user GST1, and allows efficient introduction of the store (e.g., a beauty salon SL1) to the user GST1.

[0079] Furthermore, the viewing terminal 20 displays the captured video transmitted from the photographing terminal 10 on the display operation unit 204 in response to a transition to a state in which a captured video is transmitted based on a store clerk's operation (for example, the release of the sleep state of the photographing terminal 10). For example, when the viewing terminal 20 receives a start notification (see above) or a return notification (see above) from the photographing terminal 10, the viewing terminal 20 may display the captured video data from the photographing terminal 10 on the display operation unit 204. This allows the viewing terminal 20 to switch from the content of the advertising video to the content of the captured video instructing the appearance of the back of the user GST1 (for example, the back of the hair) during treatment when the store clerk (for example, the hairdresser SYL1) returns to the user GST1, etc., and to quickly inform the user GST1 of the appearance of the back.

[0080] In addition, in response to the automatic transition to the sleep state based on the absence of any operation of the photographing terminal 10 for a predetermined period of time, the viewing terminal 20 plays and displays the video about the store stored in the memory 202 on the display operation unit 204. In this way, the viewing terminal 20 can quickly detect that the photographing terminal 10 is going to the sleep state by simply determining that it has stopped receiving photographed video data or has not received it for a certain period of time, even without receiving an active notification from the photographing terminal 10 that the terminal is going to the sleep state.

[0081] In addition, the video about the store shows the advertisement or promotion of the store. This allows the store (e.g., beauty salon SL1) to advertise the store's business campaign or introduce the products it handles (e.g., hair dye products) to the user GST1, and also gives the user GST1 an opportunity to get to know the store better, so that a win-win relationship can be built.

[0082] Furthermore, when the video related to the store is composed of multiple video files, the viewing terminal 20 repeatedly plays and displays the multiple video files on the display operation unit 204. This allows the viewing terminal 20 to repeatedly play and display the video related to the store, making it possible to widely advertise the store to customers such as user GST1.

[0083] Furthermore, the viewing terminal 20 is communicatively connected to a management server S1 that manages videos showing different content for each store, and downloads videos corresponding to the store from the management server S1 and stores them in the memory 202. This allows the viewing terminal 20 to easily prepare advertising video data by downloading it whenever necessary from the management server S1 that manages and stores the advertising video data for each store, even if the advertising video data is not stored in advance in the memory 202.

[0084] Furthermore, when the viewing terminal 20 determines that no captured video has been transmitted from the photographing terminal 10 during the period in which the video related to the store has been switched to the video captured by the photographing terminal 10 and displayed on the display operation unit 204, the viewing terminal 20 plays and displays the content from the point in time when the video related to the store was switched on the display operation unit 204. This allows the store (e.g., beauty salon SL1) to allow the same user GST1 who has already visited the store to enjoy viewing an advertising video with new content different from the content that has already been viewed.

[0085] Furthermore, when the viewing terminal 20 determines that no captured video is transmitted from the photographing terminal 10 during the period in which the video related to the store is switched to the video captured by the photographing terminal 10 and displayed on the display operation unit 204, the viewing terminal 20 plays back and displays the beginning of the video related to the store on the display operation unit 204. This allows a store (e.g., beauty salon SL1) to have a newly visited user view an advertising video with content that the store (e.g., beauty salon SL1) wants them to view first.

[0086] Although various embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications, corrections, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also belong to the technical scope of the present disclosure. In addition, the components in the various embodiments described above may be arbitrarily combined within the scope of the invention. [Industrial Applicability]

[0087] The present disclosure is useful for a video viewing system and video switching method that adaptively switches the video displayed on a viewing terminal according to the situation of a customer visiting a store, helping to improve the customer's satisfaction with the store. [Explanation of symbols]

[0088] 10. Shooting device 20 Viewing Devices 100 Video Viewing System 101, 201 Imaging unit 102, 202 Memory 103, 203 processors 103A OS processing unit 103B Application Processing Unit 104, 204 Display operation section 105, 205 Audio input / output controller 106, 206 Bus 107, 207 Public Line Controller 108, 208 Public Line Communication Interface 109, 209 Wireless LAN Controller 110, 210 Wireless LAN communication interface 111, 211 Rechargeable battery MK1, MK2 Microphone NW Network S1 Management Server SP1, SP2 speakers

Claims

1. an image capturing terminal that is located behind the user in the store and has an image capturing unit that captures an image of the user from behind; a viewing terminal that is located in front of the user in the store, is communicably connected to the photographing terminal, and has a display unit that displays a photographed image of the rear view of the user photographed by the photographing terminal; The viewing terminal includes: A memory for storing video relating to the store is provided, When the photographed image is transmitted from the photographing terminal, the transmitted photographed image is displayed on the display unit; When the photographed video is not transmitted from the photographing terminal, a video about the store stored in the memory is played and displayed on the display unit. Video viewing system.

2. The photographing terminal includes an operation unit that receives a store clerk operation to switch on or off the transmission of the photographed video, the viewing terminal, in response to a transition to a state in which the captured video is not transmitted based on the store clerk's operation, plays and displays on the display unit the video related to the store stored in the memory; The video viewing system according to claim 1 .

3. The viewing terminal displays the captured video transmitted from the imaging terminal on the display unit in response to a transition to a state in which the captured video is transmitted based on the store clerk's operation. The video viewing system according to claim 2 .

4. the viewing terminal, in response to the automatic transition to a sleep state based on the absence of any operation of the photographing terminal for a predetermined period of time, plays and displays on the display unit the video about the store stored in the memory; The video viewing system according to claim 1 .

5. The video relating to the store shows advertisements or promotions for the store. The video viewing system according to claim 1 .

6. When the video related to the store is composed of a plurality of video files, the viewing terminal repeatedly plays and displays the plurality of video files on the display unit. The video viewing system according to claim 1 .

7. the viewing terminal is communicably connected to a management server that manages videos showing different contents for each store, and downloads videos corresponding to each store from the management server and stores the videos in the memory; The video viewing system according to claim 1 .

8. When the viewing terminal determines that there is no transmission of the captured video from the imaging terminal during the period in which the video related to the store is switched to the captured video from the imaging terminal and displayed on the display unit, the viewing terminal reproduces and displays on the display unit the content of the video related to the store after the switching point. The video viewing system according to claim 1 .

9. When the viewing terminal determines that there is no transmission of the captured video from the imaging terminal during the period in which the video about the store is switched to the captured video from the imaging terminal and displayed on the display unit, the viewing terminal reproduces and displays on the display unit the contents of the video about the store from the beginning. The video viewing system according to claim 1 .

10. an image capturing device that is located behind the user in the store and captures an image of the user from behind; a viewing terminal that is located in front of the user in the store, that is communicatively connected to the photographing terminal, and that displays a photographed image of the rear view of the user captured by the photographing terminal, storing a video about the store in a memory; When the photographed image is transmitted from the photographing terminal, the transmitted photographed image is displayed; When the photographed video is not transmitted from the photographing terminal, a video about the store stored in the memory is played and displayed. How to switch videos.

Images