Questionnaire implementation method and questionnaire implementation apparatus

Abstract

To improve the accuracy of a questionnaire collected from a user who drove a test-drive vehicle.SOLUTION: A questionnaire implementation method which is executed by a computer includes: acquiring a video image in front of a user, the image being captured while the user drives a test-drive vehicle by a first camera disposed near a driver's seat; acquiring voice of the user recorded when the user gets in the test-drive vehicle; generating a processed video by adding text voice to the video image; and outputting the processed video and a questionnaire regarding test drive of the test-drive vehicle at a time and receiving an input of answers to the questionnaire.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a survey method and a survey device. [Background technology]

[0002] A system has been proposed in which a test drive vehicle is loaned to a user and a questionnaire is sent to the user's terminal after the test drive vehicle has been used (see, for example, Patent Document 1). Such a system aims to collect the questionnaire and effectively carry out development that meets market needs. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-277583 Summary of the Invention [Problem to be solved by the invention]

[0004] However, if time passes between the end of the test drive and the time the questionnaire is answered, the user may forget the impression they had during the test drive of the test vehicle, and therefore the questionnaire may not accurately capture the user's impression of the test drive vehicle.

[0005] The purpose of the present disclosure, made in consideration of such circumstances, is to improve the accuracy of questionnaires collected from users who test drive test vehicles. [Means for solving the problem]

[0006] A survey implementation method according to one embodiment of the present disclosure is a survey implementation method executed by a computer, and is characterized by including the steps of: acquiring an image of the area in front of a user captured when the user test drives a test drive vehicle using a first camera positioned near the driver's seat; acquiring audio of the user spoken that is recorded when the user gets into the test drive vehicle; converting the audio into text and adding it to the image to generate a processed image; simultaneously outputting the processed image and a questionnaire regarding the test drive of the test drive vehicle; and accepting input of responses to the questionnaire.

[0007] A survey device according to an embodiment of the present disclosure includes an acquisition unit, a control unit, an output unit, and an input unit. The acquisition unit acquires, using a first camera located near the driver's seat, an image of the area in front of a user captured when the user test drives a test vehicle, and audio of the user recorded when the user gets into the test vehicle. The control unit converts the audio into text and adds it to the image to generate a processed video. The output unit simultaneously outputs the processed video and a questionnaire regarding the test drive of the test vehicle. The input unit accepts input of responses to the questionnaire. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to improve the accuracy of questionnaires collected from users who test drive test vehicles. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram illustrating a schematic configuration of a survey system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram showing an example of the layout of components in the test vehicle of FIG. 1. [Figure 3] 2 is a flowchart of a test drive information collection process executed by a control unit of the in-vehicle device of FIG. [Figure 4] 2 is a flowchart of a survey execution process executed by a control unit of the survey execution device of FIG. 1. [Figure 5] FIG. 2 is a diagram showing an example of a display screen of the survey implementation device of FIG. 1. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Note that the drawings used in the following description are schematic. The dimensional ratios and the like in the drawings do not necessarily correspond to the actual ones.

[0011] (Survey implementation system) As shown in FIG. 1 , a survey system 1 according to an embodiment of the present disclosure includes a test drive vehicle 10 prepared for a user to test drive, and a survey device 20. In the survey system 1, video and audio are collected when a user test drives the test drive vehicle 10. When the user uses the survey device 20 to answer a survey after the test drive, the survey device 20 presents the user with video of the test drive and the user's speech during the test drive. This allows the user to recall their experience during the test drive, improving the accuracy of their survey responses.

[0012] (Test drive vehicle) In order to collect video and audio during the user's test drive, the test drive vehicle 10 is equipped with an in-vehicle device 11, a first camera 12, and a microphone 13. The test drive vehicle 10 may further be equipped with a second camera 14 and a third camera 15. The second camera 14 and the third camera 15 are not essential components.

[0013] The in-vehicle device 11 is a device that collects information indicating the situation during a test drive from various parts of the test drive vehicle 10 when a user test drives the vehicle 10. The in-vehicle device 11 can transfer the collected information to the survey implementation device 20 via a network 30. The network 30 may be any communication network including a mobile communication network and the Internet. The in-vehicle device 11 includes a communication unit 16, a memory unit 17, and a control unit 18.

[0014] The communication unit 16 may be configured to include at least one communication module connectable to the network 30. For example, the communication module is a module compatible with mobile communication standards such as LTE (Long Term Evolution), 4G (4th Generation), and / or 5G (5th Generation).

[0015] The memory unit 17 may be configured to include at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory may be, for example, a random access memory (RAM) or a read-only memory (ROM). The RAM may be, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The ROM may be, for example, an electrically erasable programmable read-only memory (EEPROM). The memory unit 17 may function as a main memory device, an auxiliary memory device, or a cache memory. The memory unit 17 stores information collected by the on-board device 11 while the user is test driving the test vehicle 10.

[0016] The control unit 18 may be configured to include at least one processor, at least one dedicated circuit, or a combination of these. The processor may be a general-purpose processor such as a central processing unit (CPU) or a graphics processing unit (GPU), or a dedicated processor specialized for a specific process. The dedicated circuit may be, for example, a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC).

[0017] While user U is test driving test vehicle 10, control unit 18 stores information acquired from first camera 12, microphone 13, second camera 14, and third camera 15 in memory unit 17 as test drive information. After user U has finished test driving test vehicle 10, control unit 18 causes communication unit 16 to transmit the test drive information stored in memory unit 17 to survey execution device 20. Note that, rather than transmitting test drive information directly to survey execution device 20, in-vehicle device 11 may transmit the test drive information via a server that accumulates test drive information. In this case, the test drive information may be stored on the server and read from the server to survey execution device 20 when user U answers the survey using survey execution device 20.

[0018] The first camera 12 is an imaging device equipped with an optical system including a lens and an imaging element. As shown in FIG. 2 , the first camera 12 is positioned near the driver's seat 19 with its optical axis O1 directed toward the front of the test drive vehicle 10 so as to capture an image of what is ahead of the user U when the user U test drives the test drive vehicle 10. The first camera 12 is positioned with the intention of recording video of a scene similar to what the user U sees during the test drive. Therefore, the first camera 12 may be positioned, for example, above the driver's seat 19 inside the vehicle cabin. The imaging range of the first camera 12 includes the exterior visible through the windshield of the test drive vehicle 10 and the interior of the test drive vehicle 10. The interior of the test drive vehicle 10 includes, for example, the steering wheel and the instrument panel.

[0019] The microphone 13 is a device that converts voices within the vehicle cabin into audio signals and outputs the audio signals. One or more microphones 13 can be provided. The microphone 13 is particularly provided so as to detect the voices emitted by the user U who is driving the test drive vehicle 10. The microphone 13 can be provided in various locations within the vehicle cabin. For example, the microphone 13 can be provided on the dashboard, the ceiling of the vehicle cabin, the steering column, the door, or other locations.

[0020] The second camera 14 is an imaging device similar to the first camera 13. The second camera 14 is disposed inside the test drive vehicle 10 at a position facing the face of the user U seated in the driver's seat 19, for example, near the steering column or steering wheel. The second camera 14 is disposed with its optical axis O2 directed toward the position of the face of the user U seated in the driver's seat 19 so that the line of sight direction can be detected from the movement of the user U's eyes during the test drive.

[0021] The third camera 15 is an imaging device similar to the first camera 13. The third camera 15 captures an image of the user U from the side of the driver's seat 19 of the test drive vehicle 10. The image captured by the third camera 15 is called a lateral image. The third camera 15 is disposed, for example, on the passenger side door with its optical axis facing the driver's seat 19.

[0022] (Survey implementation device) The survey execution device 20 is an information device installed in an automobile dealership or the like that provides test drive vehicles 10. Information devices include PCs (Personal Computers) and tablet terminals. The survey execution device 20 includes a communication unit 21, a memory unit 22, a control unit 23, an output unit 24, and an input unit 25. The functions of the survey execution device 20 may be distributed across multiple information devices.

[0023] The communication unit 21 may be configured to include at least one communication module connectable to the network 30. For example, the communication module is a module compatible with standards such as a wired LAN (Local Area Network) or a wireless LAN. The communication unit 21 may be connected to the network 30 via the communication module via the wired LAN or wireless LAN. The communication unit 21 may acquire test drive information from the in-vehicle device 11 via the network 30. The communication unit 21 functions as an acquisition unit.

[0024] Like the memory unit 17 of the in-vehicle device 11, the memory unit 22 may be configured to include at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The memory unit 22 stores data used in the operation of the survey execution device 20 and data obtained by the operation of the survey execution device 20. For example, the memory unit 22 stores a program for operating an information device as the survey execution device 20. The memory unit 22 also stores survey questions. The memory unit 22 also stores test drive information of the user U obtained from the in-vehicle device 11. The memory unit 22 may also store spatial position information of each device arranged in the test drive vehicle 10.

[0025] Like the control unit 18 of the in-vehicle device 11, the control unit 23 may be configured to include at least one processor, at least one dedicated circuit, or a combination of these. The control unit 23 may execute processes related to the operation of the survey implementation device 20 while controlling each component of the survey implementation device 20. The control unit 23 may generate processed video in which the voice of the user U during the test drive is converted into text and added to the video of the scene in front of the user U during the test drive, which is included in the test drive information acquired via the communication unit 21.

[0026] The output unit 24 is a display device capable of displaying any video. The display device includes various display devices such as a liquid crystal display (LCD), an organic electroluminescence (EL) display, and an inorganic EL display. The output unit 24 can simultaneously output the processed video and a questionnaire regarding the test drive of the test drive vehicle 10.

[0027] The input unit 26 has an input interface that can accept input to the survey implementation device 20. The input interface may be a physical key, a capacitance key, a pointing device, a touch screen that is integrated with the display device of the output unit 24, a microphone, or the like. The input unit 26 can accept responses to survey questions.

[0028] (Test drive information collection and processing) The test drive information collection process performed by the control unit 18 of the in-vehicle device 11 will be described below with reference to FIG.

[0029] When the user U gets into the test drive vehicle 10 and starts the test drive, the control unit 18 starts capturing images using the first camera 12, the second camera 14, and the third camera 15, and recording audio using the microphone 13 (S101). The in-vehicle device 11 may be provided with an operation switch for instructing the user U to start and end the test drive. When the operation switch is operated, the control unit 18 may start video and audio recording processing.

[0030] During the user U's test drive of the test drive vehicle 10, the control unit 18 sequentially stores in the storage unit 17 the images captured by the first camera 12, the second camera 14, and the third camera 15, and the audio captured by the microphone 13 (S102). When test driving the test drive vehicle 10, the user U may talk to a salesperson at a dealership who is also riding in the test drive vehicle 10 about their impressions and thoughts about the drive. The microphone 13 can capture the content of the user U's speech at this time. The in-vehicle device 11 may be provided with a display unit that displays to the user U that video and audio recording is being performed, and may display to the user U that video and audio recording is being performed.

[0031] When the test drive by the user U is finished, the control unit 18 stops recording the images captured by the first camera 12, the second camera 14, and the third camera 15, and stops recording the audio acquired by the microphone 13 (S103). The control unit 18 may stop the video and audio recording process upon detecting that the user U has turned off the operation switch of the in-vehicle device 11 or the ignition switch.

[0032] After the user U has completed the test drive, the control unit 18 causes the video and audio stored in the memory unit 17 to be transmitted as test drive information to the survey implementation device 20 via the communication unit 16 at an appropriate timing (S104). The control unit 18 may cause the test drive information to be transmitted immediately after the user U has completed the test drive of the test drive vehicle 10.

[0033] (Survey implementation process) Next, the survey execution process performed by the control unit 23 of the survey execution device 20 will be described with reference to Figure 4. The steps of the survey execution process shown in the flowchart of Figure 4 can be executed by the control unit 23 of the survey execution device 20 according to a program. Such a program can be stored in a non-transitory computer-readable medium. Examples of non-transitory computer-readable media include, but are not limited to, a hard disk, RAM, ROM, flash memory, CD-ROM, optical storage devices, magnetic storage devices, etc.

[0034] First, the control unit 23 acquires the images captured by the first camera 12, the second camera 14, and the third camera 15, and the audio acquired by the microphone 13 from the in-vehicle device 11 via the communication unit 21 (S201). S201 corresponds to the processing of S104 in Fig. 3. The control unit 23 stores the acquired information in the memory unit 22 as test drive information.

[0035] The control unit 23 sequentially executes the processes from S202 to S207 described below for the test drive information while chronologically reading the test drive information stored in the storage unit 22. The processes from S202 to S207 are presented to the user U as if replaying the experience during the test drive.

[0036] The control unit 23 performs speech recognition processing on the speech acquired from the in-vehicle device 11, and converts the speech uttered by the user U into text (S202). For the speech recognition processing, various known techniques can be adopted, such as a technique based on an acoustic model and an AI deep learning technique based on machine learning.

[0037] Control unit 23 generates a processed video by adding the text of the voice converted to text in S202 to the video information acquired from first camera 12 (S203). The text can be added to any position in the video acquired from first camera 12. For example, the text may be added to the bottom of the video.

[0038] Next, the control unit 23 detects the gaze direction of the user U from the image of the user U's eyes acquired by the second camera 13 (S204). Any known gaze detection technology can be used to detect the gaze direction of the user U. The control unit 23 can determine which device the user U's gaze is directed towards based on the eye position of the user U that can be identified from the image of the second camera 13, the gaze direction of the user U, and the spatial position information of the devices arranged in the test drive vehicle 10 stored in the memory unit 22.

[0039] In other embodiments, at least a part of the processing equivalent to S204 may be executed in the in-vehicle device 11 of the test drive vehicle 10. That is, the control unit 18 of the in-vehicle device 11 may execute all or a part of the processing up to determining the device at which the user U is looking. The control unit 18 may transmit the determination result to the survey implementation device 20.

[0040] The information indicating which device the user U is looking at is information indicating the user U's reaction to the devices provided in the test drive vehicle 10. Such information is called reaction information. The image captured by the second camera 13 is also included in the reaction information. The control unit 23 acquires the reaction information and identifies a device that the user U has looked at with his / her gaze a predetermined number of times or more as a device of interest (S205). The number of times the user U has looked at a device may be the total number of times for a predetermined period immediately prior to each point in time during the test drive. A device of interest is a device that the user U is looking at with interest at a specific point in time.

[0041] The control unit 23 adds a mark 49 indicating the device of interest to the information of the processed image (S206). The mark 49 may be an arrow pointing to the device of interest, a line highlighting the outline of the device of interest, and / or coloring the device of interest.

[0042] The control unit 23 outputs the processed video and the questionnaire to the output unit 24 (S207). FIG. 5 is a diagram showing an example of an image displayed on the display screen 40 of the output unit 24. The processed video and the questionnaire may be displayed in a first display area 41 and a second display area 42, which respectively represent different display areas. The display screen 40 may further include a third display area 43 that displays a horizontal image captured by the third camera 15. The first display area 41, the second display area 42, and the third display area 43 may be, for example, windows that can be rearranged on the display screen 40, or may be fixed areas on the display screen 40.

[0043] The processed video displayed in the first display area 41 includes the external view viewed by the user U while test driving the test vehicle 10, as well as the internal devices of the test vehicle 10. The internal devices of the test vehicle 10 include, for example, a monitor 44, a shift knob 45, a steering wheel 46, instruments 47 such as a speedometer, and a rearview mirror 48. Furthermore, when a device of interest is identified, a mark 49 indicating the device of interest is displayed on the processed video. In the example of FIG. 4, the user U frequently looks at the instrument 47, and the mark 49 indicates the instrument 47, which is the device of interest. Furthermore, a text area 50 is provided in a part of the first display area 41, and text information based on the user U's speech is displayed.

[0044] Some or all of the questionnaires may be displayed in the second display area 42. For example, as shown in FIG. 4, the second display area 42 may be a scrollable window. The user U who answers the questionnaires may recall the situation during the test drive of the test drive vehicle 10 while viewing the processed video displayed in the first display area 41, and may display and answer the questions as appropriate. As an example, answer options for the questionnaire questions are displayed as radio buttons on the GUI (Graphical User Interface) of the display screen 40. The user U can select an answer by operating the radio buttons with an input device such as a mouse.

[0045] In another embodiment, the control unit 23 may sequentially display, in the second display area 42, survey questions linked to the content of the text displayed in the text area 50. The control unit 23 may detect pre-registered keywords included in the text, and display questions associated with the keywords.

[0046] The third display area 43 displays the seating posture of the user U in the driver's seat 19 while riding in the test drive vehicle 10. The user U can check changes in their driving posture during the test drive by viewing the side view image in the third display area 43. When the user U's driving posture changes, the control unit 23 can make it easier for the user U to check by, for example, coloring the part of the user U that comes into contact with the driver's seat 19 in red. The user U can more accurately recall the situation while driving by viewing the side view image in the third display area 43 together with the processed image in the first display area 43. For example, the user U can recall the comfort of the driver's seat 19 during the test drive by viewing the side view image in the third display area 43 that shows changes in their posture while driving.

[0047] Through steps S202 to S207, the control unit 23 causes the output unit 24 to display the processed video for the user U during the test drive. The control unit 23 may shorten the processed video to a time shorter than the actual test drive time of the test drive vehicle 10. For example, the control unit 23 may display at double speed or omit a portion where there is no speech from the user U and where monotonous video continues. Furthermore, when the display of the processed video during the test drive has ended, the control unit 23 may display the processed video again from the start of the test drive.

[0048] Survey execution device 20 accepts input of survey responses while displaying the processed video and the survey on display screen 40 of output unit 24 (S208).

[0049] When the user U has answered all the questions in the questionnaire, or when the user U has performed an action indicating that the user U has finished answering the questionnaire, the answering of the questionnaire is completed (S209). When it is detected that the answering of the questionnaire has been completed, the control unit 23 ends the display of the processed image, the questionnaire, and the horizontal image on the display screen 40.

[0050] As described above, in this embodiment, the survey execution device 20 simultaneously displays processed video including text of the content of utterances made during the test drive to the user U who is answering the survey. This allows the user U to answer the survey while reconfirming the scene during the test drive and the content of their own utterances. This increases the likelihood that the user U will be able to recall their test drive experience of the test drive vehicle 10 and provide a more accurate impression.

[0051] Furthermore, the survey execution device 20 can add a mark 49 to the device of interest that the user U looked at during the test drive on the processed video. This allows the user U to remember that he or she was interested in the device of interest during the test drive. More specifically, the user U can remember how easy or difficult it was to operate the device of interest, or how easy or difficult it was to see the device of interest. This allows the user U to more accurately recall the situation during the test drive of the test drive vehicle 10, improving the likelihood that he or she will be able to answer the survey more accurately.

[0052] Furthermore, the survey execution device 20 displays the side image captured by the third camera 15 together with the processed image on the display screen 40. This allows the user U to recall the driving posture, seating comfort, and other conditions during the test drive. This allows the user U to recall in more detail the conditions, such as the ride comfort, during the test drive of the test drive vehicle 10, improving the likelihood that the user U will be able to provide a more accurate impression in response to the survey.

[0053] The present invention is not limited to the above-described embodiment, and many variations and modifications are possible. For example, the functions included in each means, step, etc. can be rearranged so as not to cause logical contradictions, and multiple means or steps can be combined into one or divided.

[0054] In the above embodiment, the test drive information of user U was transmitted from the in-vehicle device 11 to the survey execution device 20 by communication via the network 30. However, the method of transferring the test drive information of user U is not limited to communication. For example, the test drive information may be stored in a portable storage medium such as a USB (Universal Serial Bus) memory in the in-vehicle device 11 and transferred to the survey execution device 20. [Explanation of symbols]

[0055] 1. Survey implementation system 10 vehicles 11 Onboard equipment 12 Camera 1 13. Mike 14 Second Camera 15 Third Camera 16 Communications Department 17 Memory section 18 Control Unit 19 Driver's seat 20 Survey implementation device 21 Communication Department (Acquisition Department) 22 Memory section 23 Control Unit 24 Output section 25 Input section 30 Network 40 display screen 41 1st display area 42 Second display area 43 Third display area 44 monitors 45 Shift knob 46 Steering Wheel 47 Instruments 48 Rearview mirror 49 marks 50 text areas U User O1, O2 optical axis

Claims

1. A computer-implemented survey implementation method, comprising: acquiring an image of a front view of a user captured by a first camera disposed near a driver's seat when the user test drives the test vehicle; Acquiring a voice uttered by the user recorded when the user got into the test vehicle; generating a processed video by converting the audio into text and adding the text to the video; outputting the processed image and a questionnaire regarding the test drive of the test drive vehicle at the same time, and receiving input of responses to the questionnaire; Survey implementation methods, including:

2. 2. The survey method of claim 1, further comprising: acquiring reaction information indicating the user's reaction to a device equipped in the test drive vehicle; identifying the device to which the user responded as a device of interest based on the reaction information; and further adding a mark indicating the device of interest to the video to generate the processed video.

3. The survey method described in claim 2, wherein the response information includes footage captured by a second camera installed inside the test vehicle and capable of detecting the user's gaze direction, and the device to which the user directs their gaze a predetermined number of times or more is identified as the device of interest.

4. The survey implementation method according to claim 1, further comprising acquiring a side image taken from the side of the driver's seat of the test drive vehicle, and outputting the side image together with the processed image.

5. an acquisition unit that acquires an image of a scene in front of the user captured by a first camera disposed near the driver's seat when the user test drives the test vehicle, and an audio recording of the user's speech when the user gets into the test vehicle; a control unit that converts the audio into text and adds the text to the video to generate a processed video; an output unit that simultaneously outputs the processed video and a questionnaire regarding the test drive of the test drive vehicle; an input unit that accepts input of responses to the questionnaire; A survey implementation device comprising:

Images