Control device

Abstract

To make it easy to identify an ordered vehicle ordered by a user from among captured images of vehicles under production.SOLUTION: A control device 10 includes a communication unit that communicates with a terminal device 20 of a user 21, and a control unit that acquires captured images obtained by imaging a process in which a plurality of vehicles, including an ordered vehicle ordered by the user 21, are produced, generates, from the acquired captured images, presentation images in which the ordered vehicle and vehicles other than the ordered vehicle have a different appearance, and transmits the generated presentation images to the terminal device 20 via the communication unit.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a control device.

Background Art

[0002] Patent Document 1 discloses a vehicle information providing device that provides a user terminal with in-production captured images of a vehicle contracted by a user in real time.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a conventional device, when a plurality of vehicles that look the same flow through a production line, even if a captured image of the vehicle in production is provided, it is impossible to identify the ordered vehicle ordered by the user.

[0005] An object of the present disclosure is to make it easier to identify an ordered vehicle ordered by a user from captured images of vehicles in production.

Means for Solving the Problems

[0006] The control device according to the present disclosure includes a communication unit that communicates with a user's terminal device, and a control unit that acquires a captured image obtained by imaging a process in which a plurality of vehicles including the ordered vehicle ordered by the user are being produced, generates a presentation image in which the ordered vehicle and vehicles other than the ordered vehicle look different from the acquired captured image, and transmits the generated presentation image to the terminal device via the communication unit. and is provided with.

Effects of the Invention

[0007] According to the present disclosure, it becomes easier to identify an ordered vehicle ordered by a user from among photographed images of vehicles in production.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Modes for Carrying Out the Invention

[0009] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings.

[0010] In each figure, the same or corresponding parts are denoted by the same reference numerals. In the description of this embodiment, the description of the same or corresponding parts will be omitted or simplified as appropriate.

[0011] Referring to FIG. 1, the configuration of the system 1 according to this embodiment will be described.

[0012] The system 1 according to this embodiment includes a control device 10 and a terminal device 20. The control device 10 can communicate with the terminal device 20 via a network 30.

[0013] In this embodiment, the control device 10 is a server computer such as a cloud server, but may also be a general-purpose computer such as a PC, a microcomputer installed in a mobile device such as a smartphone or a tablet, or a dedicated computer. "PC" is an abbreviation for personal computer. In this embodiment, the control device 10 is operated by a vehicle manufacturer. The control device 10 may be integrated with the terminal device 20, for example, it may be a microcomputer installed in the terminal device 20.

[0014] The terminal device 20 is a computer capable of installing and executing application programs, such as a PC, a mobile phone, a smartphone, or a tablet. The terminal device 20 is used by the user 21.

[0015] The network 30 includes the Internet, at least one WAN, at least one MAN, or any combination thereof. "WAN" is an abbreviation for wide area network. "MAN" is an abbreviation for metropolitan area network. The network 30 may include at least one wireless network, at least one optical network, or any combination thereof. The wireless network is, for example, an ad hoc network, a cellular network, a wireless LAN, a satellite communication network, or a terrestrial microwave network. "LAN" is an abbreviation for local area network.

[0016] Referring to FIG. 1, the outline of this embodiment will be described.

[0017] In this embodiment, the control device 10 communicates with the terminal device 20 of the user 21. The control device 0 acquires a captured image obtained by imaging a process in which a plurality of vehicles including the ordered vehicle F ordered by the user 21 are being produced. The control device 10 generates a presentation image that looks different between the ordered vehicle F and vehicles other than the ordered vehicle F from the acquired captured image. The control device 10 transmits the generated presentation image to the terminal device 20. The terminal device 20 displays the received presentation image.

[0018] According to this embodiment, it becomes easier to identify the ordered vehicle F ordered by the user 21 from among the captured images of the vehicles being produced.

[0019] In this embodiment, the user 21 is a purchaser who has ordered the ordered vehicle F and is waiting for delivery. When the user 21 orders the ordered vehicle F, a user ID for identifying the purchaser is assigned to the user 21. In addition, a VIN for identifying the ordered vehicle F is assigned to the ordered vehicle F. "ID" is an abbreviation for identifier. "VIN" is an abbreviation for Vehicle Identification Number. In this embodiment, the user ID and the VIN are associated with each other and stored in the control device 10. The user ID and the VIN may be stored in an external storage device.

[0020] In this embodiment, the vehicle manufacturer centrally manages the production progress of the ordered vehicle F using the server SV. The server SV is a cloud server or an on-premises server installed in a facility such as a factory of the vehicle manufacturer. The control device 10 communicates with the server SV. The data indicating the progress status is stored in the server SV as progress status data DA. The progress status data DA is data that indicates the process to which the ordered vehicle F currently belongs among a plurality of processes included in the production of the ordered vehicle F, and also indicates the date and time when that process was started, as the production progress status of the ordered vehicle F. At the timing when a certain process is started, for example, when a tag reader installed on the line corresponding to that process in the factory reads the tag with the VIN written on the ordered vehicle F, the server SV records, as the progress status data DA, data indicating that process and the date and time when the ordered vehicle F belonged to that process. The progress status data DA is transmitted from the server SV to the control device 10.

[0021] In this embodiment, the "processes in which the production of a plurality of vehicles is being carried out" include five processes: a press process, a welding process, a painting process, an assembly process, and an inspection process. The press process is a process of making parts such as the vehicle body and doors of the ordered vehicle F. The welding process is a process of making a vehicle body from the parts made in the press process. The painting process is a process of painting the vehicle body made in the welding process. The assembly process is a process of attaching parts to the vehicle body painted in the painting process. The inspection process is a process of inspecting the vehicle body with parts attached in the assembly process. The ordered vehicle F proceeds through these processes in order. In each process, a plurality of vehicles including the ordered vehicle F flow through the line in order. In this embodiment, the "plurality of vehicles" are vehicles of the same vehicle type, the same color, and the same grade as each other.

[0022] In this embodiment, a camera that captures a captured image is installed near a line corresponding to each process. The "captured image" is an image obtained by capturing a process in which a plurality of vehicles including the ordered vehicle F are being produced. The captured image is a still image or a moving image. There may be a plurality of captured images. The captured images are stored in the server SV. The captured images include the ordered vehicle F and vehicles other than the ordered vehicle F. When the camera captures a captured image, each vehicle included in the captured image is associated with the VIN of each vehicle. The vehicle included in the captured image may be identified from the elapsed time since the above tag reader reads the VIN of the vehicle. For example, for each process, the range in which the vehicle is included in the captured image on the line and the range of the elapsed time from when the tag of the vehicle is read by the tag reader until the vehicle passes through that range may be known in advance. Thereby, a vehicle whose elapsed time since the tag reader reads the VIN of the vehicle is within a certain range may be determined to be shown in the captured image. Also, for example, when it is determined that a captured image captured in the press process includes the ordered vehicle F and a vehicle G which is a vehicle other than the ordered vehicle F, this captured image is stored in the server SV together with the shooting date and time, the process in which the image was captured, the VIN of the ordered vehicle F, and the VIN of the vehicle G.

[0023] As an example, the captured image may be an image in which parts of a plurality of vehicles including the ordered vehicle F are being made in the press process. Also, the captured image may be an image in which the vehicle bodies of a plurality of vehicles including the ordered vehicle F are being made in the welding process. Also, the captured image may be an image in which the vehicle bodies of a plurality of vehicles including the ordered vehicle F are being painted in the painting process. Also, the captured image may be an image in which parts are being attached to the vehicle bodies of a plurality of vehicles including the ordered vehicle F in the assembly process. Also, the captured image may be an image in which the vehicle bodies of a plurality of vehicles including the ordered vehicle F are being inspected in the inspection process.

[0024] Referring to FIG. 2, the configuration of the control device 10 according to this embodiment will be described.

[0025] The control device 10 includes a control unit 11, a storage unit 12, and a communication unit 13.

[0026] The control unit 11 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for specific processing. "CPU" is an abbreviation for central processing unit. "GPU" is an abbreviation for graphics processing unit. The programmable circuit is, for example, an FPGA. "FPGA" is an abbreviation for field-programmable gate array. The dedicated circuit is, for example, an ASIC. "ASIC" is an abbreviation for application specific integrated circuit. While controlling each part of the control device 10, the control unit 11 executes processing related to the operation of the control device 10.

[0027] The storage unit 12 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, RAM, ROM, or flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. RAM is, for example, SRAM or DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. ROM is, for example, EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read only memory. The flash memory is, for example, SSD. "SSD" is an abbreviation for solid-state drive. The magnetic memory is, for example, HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 12 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 stores data used for the operation of the control device 10 and data obtained by the operation of the control device 10.

[0028] The communication unit 13 includes at least one communication module. The communication module is a module compatible with, for example, a wired LAN communication standard such as Ethernet (registered trademark), a wireless LAN communication standard such as IEEE802.11, or a mobile communication standard such as LTE, 4G standard, or 5G standard. "IEEE" is an abbreviation for Institute of Electrical and Electronics Engineers. "LTE" is an abbreviation for Long Term Evolution. "4G" is an abbreviation for 4th generation. "5G" is an abbreviation for 5th generation. The communication unit 13 communicates with the terminal device 20 via the network 30. The communication unit 13 receives data used for the operation of the control device 10 and transmits data obtained by the operation of the control device 10.

[0029] The functions of the control device 10 are realized by executing the program according to this embodiment on a processor as the control unit 11. That is, the functions of the control device 10 are realized by software. The program causes a computer to execute the operations of the control device 10, thereby making the computer function as the control device 10. That is, the computer functions as the control device 10 by executing the operations of the control device 10 according to the program.

[0030] The program can be stored in a non-transitory computer-readable medium. The non-transitory computer-readable medium is, for example, a flash memory, a magnetic recording device, an optical disk, a magneto-optical recording medium, or a ROM. The distribution of the program is performed, for example, by selling, transferring, or lending a portable medium such as an SD card, a DVD, or a CD-ROM storing the program. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program may be stored in the storage of a server and transferred from the server to other computers to distribute the program. The program may be provided as a program product.

[0031] A computer stores, for example, a program stored in a portable medium or a program transferred from a server in a main memory device once. Then, the computer reads the program stored in the main memory device with a processor and executes processing according to the read program with the processor. The computer may directly read a program from a portable medium and execute processing according to the program. The computer may sequentially execute processing according to the received program each time a program is transferred from the server to the computer. Processing may be executed by a so-called ASP type service that realizes functions only by execution instructions and result acquisition without transferring a program from the server to the computer. "ASP" is an abbreviation for application service provider. A program includes information for use in processing by an electronic computer that conforms to the program. For example, data that is not a direct instruction to a computer but has a property that defines the processing of the computer corresponds to "something that conforms to the program".

[0032] Some or all of the functions of the control device 10 may be realized by a programmable circuit or a dedicated circuit as the control unit 11. That is, some or all of the functions of the control device 10 may be realized by hardware.

[0033] Referring to FIG. 3, the operation of the control device 10 according to the present embodiment will be described. The operations described below correspond to the control method according to the present embodiment. That is, the control method according to the present embodiment includes steps S101 to S103 shown in FIG. 3.

[0034] In S101, the control unit 11 acquires a captured image. The captured image is an image obtained by imaging a process in which a plurality of vehicles including the ordered vehicle F are being produced. In the present embodiment, the captured image is an image in which the ordered vehicle F and the vehicles other than the ordered vehicle F look the same. Specifically, the control unit 11 receives the captured image from the server SV via the communication unit 13.

[0035] In S102, the control unit 11 generates a presentation image from the captured image acquired in S101. The presentation image is an image that looks different between the ordered vehicle F and vehicles other than the ordered vehicle F. Specifically, the control unit 11 processes the captured image acquired in S101 to generate a presentation image. As an example, when the captured image is a still image or a moving image captured in the press process, the control unit 11 may generate, as the presentation image, a still image or a moving image in which only the parts of the ordered vehicle F are framed. When the captured image is a still image or a moving image captured in the press process, the control unit 11 may generate, as the presentation image, a still image or a moving image in which identification information such as an icon is electronically added to the parts of the ordered vehicle F. When the captured image is a moving image captured in the press process, the control unit 11 may emphasize the presentation image with music only while the parts of the ordered vehicle F are being made.

[0036] The frame, identification information, or music applied when the captured image is processed may be selected by the user 21 as a processing option. In this case, the control unit 11 may receive, from the terminal device 20 via the communication unit 13, processing option data indicating the processing option input by the user 21 to the terminal device 20. The control unit 11 may store the received processing option data in the storage unit 12. The control unit 11 may apply the processing option indicated by the stored processing option data. By looking at the ordered vehicle F in the presentation image to which the processing option is applied, the user 21 can identify the ordered vehicle F.

[0037] In S103, the control unit 11 transmits the presentation image generated in S102 to the terminal device 20 via the communication unit 13. The terminal device 20 receives the presentation image. The terminal device 20 displays the received presentation image on the screen.

[0038] After S103, the flow shown in FIG. 3 ends.

[0039] According to this embodiment, it becomes easier for the user 21 to identify the ordered vehicle F from among the captured images of the vehicles during production.

[0040] In this embodiment, the above operations are performed for each of the five processes, but the above operations may be performed only in any one or some of the processes. For example, the control unit 11 may perform the steps of S101 to S103 only in one of the five processes. Alternatively, the control unit 11 may not perform the steps of S101 to S103 in the pressing process and the inspection process, and may perform the steps of S101 to S103 only in the welding process, the painting process, and the assembly process.

[0041] As a first modification example of this embodiment, the photographed image may be an image in which the appearance of the ordered vehicle F is different from that of vehicles other than the ordered vehicle F, instead of an image in which the appearance of the ordered vehicle F is the same as that of vehicles other than the ordered vehicle F. Referring to FIG. 4, the operation of the control device 10 according to the first modification example will be described. The operations described below correspond to the control method according to the first modification example. That is, the control method according to the first modification example includes the steps of S201 to S205 shown in FIG. 4.

[0042] In S201, the control unit 11 acquires additional option data. The additional option data is data indicating an additional option. The additional option is an option for adding a physical change for making the appearance of the ordered vehicle F different from that of vehicles other than the ordered vehicle F. The additional option is selected by the user 21 via the terminal device 20 before the production of the ordered vehicle F starts. The additional option data may include data indicating a process for adding the additional option. Specifically, the control unit 11 receives the additional option data from the terminal device 20 via the communication unit 13. As an example, the additional option may be an option for physically adding identification information such as an icon to the vehicle body. The additional option may be an option for causing the ordered vehicle F to perform an operation accompanied by a change in appearance, such as turning on the headlights of the ordered vehicle F.

[0043] In S202, the control unit 11 transmits an addition instruction corresponding to the additional option data acquired in S201 to the server SV via the communication unit 13. The addition instruction is an instruction to add a physical change indicated by the additional option data as an additional option. When data indicating the process of adding the additional option is included in the additional option data, that process is specified by the addition instruction.

[0044] In the first modification example, the server SV manages the production of the ordered vehicle F. When the server SV receives the addition instruction, it causes the addition instruction received to be displayed on a screen that an operator in the process where the production of the ordered vehicle F is being carried out can view during work. When the process of adding the additional option is specified by the addition instruction, the server SV causes the addition instruction to be displayed on a screen that an operator in that process can view during work. The operator installs the additional option on the ordered vehicle F according to the addition instruction displayed on the screen. As an example, the operator may perform an operation of physically adding identification information such as an icon to the vehicle body. The operator may also perform an operation of causing the ordered vehicle F to perform an operation accompanied by a visual change, such as turning on the headlights of the ordered vehicle F. Instead of causing the addition instruction to be displayed on the screen, the server SV may automatically install the additional option on the ordered vehicle F by controlling the construction machine or the ordered vehicle F according to the addition instruction. As an example, the server SV may control the construction machine to physically add identification information such as an icon to the vehicle body. The server SV may also control the ordered vehicle F to perform an operation accompanied by a visual change, such as turning on the headlights of the ordered vehicle F.

[0045] In S203, the control unit 11 acquires a photographed image. The photographed image in the first modification example is an image obtained by imaging the process in which the production of a plurality of vehicles including the ordered vehicle F is being carried out, similar to the photographed image acquired in S101. However, since the additional option is installed on the ordered vehicle F before S203, the photographed image in the first modification example is an image in which the appearance of the ordered vehicle F is different from that of the vehicles other than the ordered vehicle F, unlike the photographed image acquired in S101. Specifically, the control unit 11 receives the photographed image from the server SV via the communication unit 13.

[0046] In S204, the control unit 11 generates a presentation image from the captured image acquired in S203. The presentation image in the first modification example is an image in which the appearance of the ordered vehicle F is different from that of vehicles other than the ordered vehicle F, similar to the presentation image generated in S102. Specifically, the control unit 11 generates a presentation image by only formally processing the captured image acquired in S203 without substantially processing it. As an example, when the captured image is a still image or a moving image captured in the press process, the control unit 11 may generate a still image or a moving image that has only been formally processed, such as resizing or changing the data format, as the presentation image.

[0047] The process of S205 is the same as that of S103 described above, so the description thereof is omitted.

[0048] After S205, the flow shown in FIG. 4 ends.

[0049] According to the first modification example, by viewing the additional options installed on the ordered vehicle F, the user 21 can identify the ordered vehicle F.

[0050] As a second modification example of the present embodiment, the captured image may be a moving image distributed as a live video. The VINs of a plurality of vehicles including the ordered vehicle F in the live video have been identified in advance. With reference to FIG. 3, the differences in the operations of the control device 10 according to the second modification example from the operations of the control device 10 according to the present embodiment will be described.

[0051] In S101, the control unit 11 acquires a captured image. When there is no user watching, the control unit 11 distributes the acquired captured image as a live video. When there is a user watching, the control unit 11 acquires user identification information for identifying one or more users 21a who are watching the live video. When the control unit 11 acquires the user identification information, it identifies one or more ordered vehicles Fa ordered by one or more users 21a among the plurality of vehicles. In S102, the control unit 11 generates a video with a different appearance between the identified one or more ordered vehicles Fa and the vehicles other than the one or more ordered vehicles Fa as a presentation image. Then, in S103, the control unit 11 distributes the presentation image generated in S102 as a live video instead of the captured image acquired in S101. Specifically, in S101, the control unit 11 receives a moving image, which is a captured image, from the server SV via the communication unit 13. When there is no user watching, the control unit 11 streams and distributes the received moving image as a live video. When there is a user watching, the control unit 11 receives, from the terminal device 20a of one or more users 21a, user identification information for identifying one or more users 21a who are watching the live video via the communication unit 13. The control unit 11 identifies, from the received user identification information, one or more ordered vehicles Fa ordered by one or more users 21a among the plurality of vehicles included in the received moving image as the objects to be processed. In S102, the control unit 11 generates a moving image obtained by processing the identified one or more ordered vehicles Fa as a presentation image. Then, in S103, the control unit 11 distributes the presentation image generated in S102 as a live video instead of the moving image received in S101. As an example, when the user 21 accesses the control device 10 from the terminal device 20 to watch a live video, the control unit 11 acquires the ID of the user 21 as user identification information for identifying the user 21. The control unit 11 identifies the ordered vehicle F included in the moving image received in S101 as the object to be processed from the acquired user ID. In S102, the control unit 11 generates a moving image obtained by processing such as emphasizing the identified ordered vehicle F as a presentation image. Then, in S103, the control unit 11 distributes the presentation image generated in S103 as a live video instead of the moving image received in S101.The terminal device 20 displays the distributed live video on the screen. As a result, the user 21 can identify the ordered vehicle F in the live video.

[0052] Referring to FIG. 5, an additional operation of the control device 10 according to the present embodiment will be described. The additional operation includes steps S301 to S303 shown in FIG. 5.

[0053] When a user ID is assigned to the user 21 who ordered the vehicle F and a VIN is assigned to the vehicle F, the step of S301 is started. After the flow shown in FIG. 5 ends, the step of S301 is also started when a predetermined period such as one day has elapsed, or at other predetermined timings.

[0054] In S301, the control unit 11 acquires the progress status data DA. Specifically, the control unit 11 acquires the progress status data DA from the server SV via the communication unit 13.

[0055] In S302, the control unit 11 refers to the progress status indicated by the progress status data DA acquired in S301 and predicts the time when the production of the ordered vehicle F will be performed. Specifically, the control unit 11 predicts the time when the production of the ordered vehicle F will be performed in that process from the date and time when the process to which the ordered vehicle F currently belongs started, which is included in the progress status indicated by the progress status data DA acquired in S301. As an example, the control unit 11 predicts the time when the production of the ordered vehicle F will be performed in the press process from the date and time when the press process started, which is included in the progress status data DA acquired in S301. Similarly, the control unit 11 predicts the time when the production of the ordered vehicle F will be performed in that process from the date and time when the painting process, the assembly process, or the inspection process started, which is included in the progress status data DA acquired in S301.

[0056] In S303, the control unit 11 transmits time data indicating the time predicted in S302 to the terminal device 20 via the communication unit 13. The terminal device 20 receives the time data. Then, the terminal device 20 displays on the screen the time indicated by the received time data. For example, the terminal device 20 displays, in a pop-up format, the time predicted in S302 and a message indicating that the production of the ordered vehicle F is to be performed on the lock screen or the home screen. The lock screen is the screen displayed when the power key is pressed when the screen of the terminal device 20 turns off. The home screen is the screen displayed when the lock is released from the lock screen.

[0057] After S303, the flow shown in FIG. 5 ends.

[0058] The present disclosure is not limited to the above-described embodiments. For example, two or more blocks described in the block diagram may be integrated, or one block may be divided. Instead of executing two or more steps described in the flowchart in time series according to the description, each step may be executed in parallel or in a different order according to the processing ability of the device that executes the steps, or as necessary. Other changes are possible without departing from the spirit of the present disclosure.

Description of Reference Numerals

[0059] 1 System 10 Control Device 11 Control Unit 12 Storage Unit 13 Communication Unit 20 Terminal Device 21 User 30 Network

Claims

1. A communication unit that communicates with the user's terminal device, An imaging unit that acquires a captured image obtained by imaging a process in which a plurality of vehicles including an ordered vehicle ordered by the user are being produced, generates a presentation image in which the appearance of the ordered vehicle is different from that of vehicles other than the ordered vehicle from the acquired captured image, and transmits the generated presentation image to the terminal device via the communication unit, and A control device comprising:

2. The captured image is an image in which the appearance of the ordered vehicle is the same as that of vehicles other than the ordered vehicle, The control device according to claim 1, wherein the control unit processes the captured image to generate the presentation image.

3. The captured image is an image in which the appearance of the ordered vehicle is different from that of vehicles other than the ordered vehicle, The communication unit communicates with a server that manages the production of the ordered vehicle, The control device according to claim 1, wherein the control unit transmits an instruction to add a physical change for making the appearance of the ordered vehicle different from that of vehicles other than the ordered vehicle to the server via the communication unit.

4. When the control unit distributes the captured image as a live video and acquires user identification information for identifying one or more users who view the live video, the control unit identifies one or more ordered vehicles ordered by the one or more users among the plurality of vehicles, generates a video in which the appearance of the identified one or more ordered vehicles is different from that of vehicles other than the one or more ordered vehicles as the presentation image, and distributes the presentation image as the live video instead of the captured image. The control device according to claim 1.

5. The control device according to claim 1, wherein the control unit acquires progress status data indicating the progress status of the production of the ordered vehicle, predicts the time when the production of the ordered vehicle is performed with reference to the progress status indicated by the acquired progress status data, and transmits time data indicating the predicted time to the terminal device via the communication unit.

Images