Sound field control method and sound field control device

By displaying the sound field status on the vehicle display and accepting passenger operations, the problem of passengers having difficulty identifying the location of sound sources in the car is solved, and accurate sound field control is achieved.

CN120752934APending Publication Date: 2025-10-03NISSAN MOTOR CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202380094830.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-02-27
Publication Date
2025-10-03

AI Technical Summary

Technical Problem

It is difficult for vehicle occupants to visually grasp which audio source is being played at which listening position in the vehicle cabin.

Method used

By displaying the sound field status information on the vehicle's display and accepting the occupants' operations, the sound field is controlled to achieve accurate sound field operation.

Benefits of technology

Passengers can visually and accurately grasp the sound field status in the car and perform operations, which improves the efficiency and accuracy of sound field control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120752934A_ABST
    Figure CN120752934A_ABST
Patent Text Reader

Abstract

In a sound field control method, information (210, 220, 240) indicating the current state of a sound field is displayed on a display (400) disposed in a vehicle interior, an operation of a vehicle occupant on the sound field is received, the sound field is controlled in accordance with the operation, and information (210, 220, 240) indicating the state of the controlled sound field is displayed on the display (400).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a sound field control method and a sound field control device. Background Art

[0002] Conventionally, there is known an in-vehicle sound processing device that performs sound processing for simultaneously playing different sound sources in a vehicle interior space having a plurality of listening positions (see Patent Document 1).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2018-170563 Summary of the Invention

[0006] Problems to be solved by the invention

[0007] However, it is difficult for a vehicle occupant to visually grasp which audio source is being played at which listening position in the vehicle cabin.

[0008] An object of the present disclosure is to provide a sound field control method and a sound field control device that can visually grasp the sound field in a vehicle cabin and perform accurate sound field manipulation.

[0009] Solutions for solving problems

[0010] In a sound field control method according to one embodiment of the present disclosure, information indicating the current state of the sound field is displayed on a display arranged in a vehicle cabin, operations on the sound field by a vehicle occupant are accepted, the sound field is controlled according to the operations, and information indicating the state of the sound field after the control is displayed on the display.

[0011] Effects of the Invention

[0012] According to one aspect of the present disclosure, it is possible to visually grasp the sound field in the vehicle cabin and perform accurate sound field manipulation. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1A 1 is a block diagram showing the configuration of a sound field control system 1000 including a sound field control device 100 and an acoustic system 300 according to the embodiment.

[0014] Figure 1B This is a flowchart showing an example of a sound field control method using the sound field control device 100 .

[0015] Figure 2 A display layout (part 1) of the touch panel 400 according to the first embodiment is shown.

[0016] Figure 3Show Figure 2 Another display example of the floor plan 220 showing the arrangement of seats.

[0017] Figure 4 The display layout (part 2) of the touch panel 400 according to the first embodiment is shown.

[0018] Figure 5 The display layout (part 3) of the touch panel 400 according to the first embodiment is shown.

[0019] Figure 6 The display layout (Part 4) of the touch panel 400 according to the first embodiment is shown.

[0020] Figure 7 A display layout (part 1) of the touch panel 400 according to the second embodiment is shown.

[0021] Figure 8 A display layout (part 2) of the touch panel 400 according to the second embodiment is shown.

[0022] Figure 9 The display layout (Part 3) of the touch panel 400 according to the second embodiment is shown.

[0023] Figure 10 The display layout (Part 4) of the touch panel 400 according to the second embodiment is shown.

[0024] Figure 11 The display layout (Part 5) of the touch panel 400 according to the second embodiment is shown.

[0025] Figure 12 This is a block diagram showing the configuration of an acoustic system 300 according to the third embodiment.

[0026] Figure 13A This is a schematic diagram (part 1) schematically showing the image of the sound field formed in the vehicle cabin by audio system 300 for each sound field setting.

[0027] Figure 13B This is a schematic diagram (part 2) schematically showing the sound field formed in the vehicle cabin by audio system 300 for each sound field setting.

[0028] Figure 14 It shows Figure 12 Schematic diagram of a specific example of multiple sound sources (Sound Source) 330, the groups (Stream) 331, 332, 333 to which each sound source 330 belongs, and the category (Category) to which each sound source 330 belongs.

[0029] Figure 15AThe identification numbers (1) to (45) are used to identify Figure 14 A part (one) of the table obtained by classifying the combinations of the categories of the sound sources of the three groups (Main, Mix1, Mix2).

[0030] Figure 15B The identification numbers (1) to (45) are used to identify Figure 14 Part (part 2) of the table obtained by classifying the combinations of the categories of the sound sources of the three groups (Main, Mix1, Mix2).

[0031] Figure 15C The identification numbers (1) to (45) are used to identify Figure 14 Part of the table (part 3) obtained by classifying the combinations of the categories of the sound sources of the three groups (Main, Mix1, Mix2).

[0032] Figure 15D The identification numbers (1) to (45) are used to identify Figure 14 Part (fourth) of the table obtained by classifying the combinations of the categories of the sound sources of the three groups (Main, Mix1, Mix2).

[0033] Figure 16 It shows Figure 15A to Figure 15D A portion (one) of a correspondence table showing the correspondence between combinations of sound source categories classified by identification numbers (1) to (45) and groups of speakers to be driven and sound sources driving each speaker.

[0034] Figure 17 It shows Figure 15A to Figure 15D A part (part 2) of a correspondence table showing the correspondence between combinations of sound source categories classified by identification numbers (1) to (45) and groups of speakers to be driven and sound sources driving each speaker.

[0035] Figure 18 It shows Figure 15A to Figure 15D Part (part 3) of the correspondence table showing the correspondence between the combinations of the categories of sound sources classified by identification numbers (1) to (45) and the groups of speakers to be driven and the sound sources driving each speaker.

[0036] Figure 19 It shows Figure 15A to Figure 15D Part (fourth) of the correspondence table showing the correspondence between the combinations of the categories of sound sources classified by identification numbers (1) to (45) and the groups of speakers to be driven and the sound sources driving each speaker. DETAILED DESCRIPTION

[0037] (First embodiment)

[0038] The sound field control system 1000 involved in the embodiment is a system that forms one or more sound fields in the interior space of a vehicle and controls the sound fields. The sound field (sound bubble) represents the area in the interior of the vehicle where sound can be heard. Sound includes sounds played from multiple sound sources. Figure 1A As shown, sound field control system 1000 includes an audio system 300 that generates a sound field by playing sound using multiple speakers, and a sound field control device 100 that controls the sound field of multiple sound sources in response to vehicle occupant operations. Sound field control system 1000 generates various sound fields within the vehicle interior space, depending on the type of sound source and the sound field settings.

[0039] The sound field control device 100 includes a touch panel 400 and a control unit 200. The touch panel 400 is arranged in the vehicle interior and is an example of a display that displays information indicating the state of the sound field. The touch panel 400 has a function as a display and a function as an input device that receives touch operations performed by the vehicle occupants. The control unit 200 can be implemented using a microcomputer including a CPU (central processing unit), a memory, and an input / output unit. A computer program (sound field control program) for causing the microcomputer to function as the control unit 200 is installed in the microcomputer for execution. Thus, the microcomputer functions as a plurality of information processing units included in the control unit 200. In addition, an example of implementing the control unit 200 by software is shown here, but of course dedicated hardware for performing each information processing can also be prepared to constitute the control unit 200. In addition, the plurality of information processing units included in the control unit 200 can also be constituted by independent hardware. Furthermore, the sound source control device 340 (see Figure 12 ) The control unit 200 is configured with the same hardware. The control unit 200 may also serve as an electronic control unit (ECU) used in other vehicle-related controls.

[0040] Reference Figure 1BAn example of a sound field control method using the sound field control device 100 will be described. The sound field control method is a process in which the control unit 200 operates according to a sound field control program. In step S01, the control unit 200 displays information indicating the current state of the sound field on the touch panel 400. Proceeding to step S02, the control unit 200 accepts an operation of the sound field by a vehicle occupant. Specifically, it accepts a touch operation on the sound field setting screen displayed on the touch panel 400. After accepting the operation, the control unit 200 proceeds to step S03, where the control unit 200 controls the sound field according to the accepted operation. Specifically, the control unit 200 sends a signal indicating the sound field settings after the operation to the audio system 300. Upon receiving this signal, the audio system 300 determines the speakers to be driven and the sound source to drive each speaker based on the sound field settings after the operation, and then drives the speakers. Thereafter, the control unit 200 proceeds to step S04, where the control unit 200 displays information indicating the state of the sound field after the control on the touch panel 400. The sound field control system 1000 forms various sound fields in the vehicle interior space according to the settings of the sound field after operation. By displaying information indicating the current state of the sound field on the touch panel 400, it is possible to visually grasp which sound source is being played at which listening position in the vehicle interior. Therefore, the occupants can operate the sound field accurately (step S02). In addition, in step S04, information indicating the state of the sound field after control is displayed on the touch panel 400. Thus, the occupants can also confirm the accurate operation of the sound field (step S02). In this way, according to the sound field control device 100 and the audio control method, the occupants can operate the sound field accurately and efficiently by visually grasping the state of the sound field.

[0041] The third embodiment will describe a specific example of the detailed structure and operation of audio system 300. In the first embodiment, the detailed structure and operation of audio system 300 are not particularly limited, and an existing audio system 300 that can realize an operated sound field in the vehicle interior can be used.

[0042] Reference Figures 2 to 6 The display layout of the touch panel 400 and a specific method of operating the sound field according to the first embodiment will be described. Figures 2 to 6 is Figure 1BA specific example of "information indicating the state of the sound field" displayed on the screen of the touch panel 400 arranged in the vehicle cabin in each of steps S01 and S04. The information indicating the state of the sound field includes information indicating the correspondence between the seats in the vehicle cabin and the groups to which the sound sources that can be heard at the seats belong. A plurality of sound sources are classified into a number smaller than the number of sound sources. By displaying the information indicating the correspondence between the seats in the vehicle cabin and the groups of sound sources that can be heard at the seats on the touch panel 400, the passenger viewing the touch panel 400 can visually grasp which listening position in the vehicle cabin or which seat is playing which group of sound sources.

[0043] For example, Figure 2 As shown, the information representing the sound field includes a floor plan 220 showing the arrangement of seats within the vehicle interior, and sound source icons 231, 232, and 233 superimposed on floor plan 220 for seats 221, 222, and 223. Sound source icons 231, 232, and 233 represent the groups of sound sources that can be heard at seats 221, 222, and 223. Floor plan 220 is presented from a perspective looking down at the entire vehicle interior from above. Based on floor plan 220 and sound source icons 231, 232, and 233, passengers can intuitively understand the groups of sound sources that can be heard at each seat 221, 222, and 223. In other words, they can intuitively grasp the groups of sound fields formed for each seat 221, 222, and 223.

[0044] In the first embodiment, an example of operating and controlling the sound field by dividing the seats in the vehicle into front seats 221 and 222 and rear seats 223 is shown. In addition, the front seats include a driver's seat 221 (left seat) and a passenger seat (right seat). Figure 2 As shown, a music icon 231 representing "Music" as one of the sound source groups, a phone icon 233 representing "Phone" as one of the sound source groups, and a navigation icon 232 representing "Navigation (Japanese: ナビゲーション)" (hereinafter sometimes referred to as "Navigation (Japanese: ナビ)") as one of the sound source groups are superimposed and displayed in front seats 221 and 222. By viewing this display, passengers can understand that they can hear the sound played from the sound sources belonging to the music, phone, and navigation groups in front seats 221 and 222. In other words, they can understand that the sound field of the sound sources belonging to the music, phone, and navigation groups is formed in front seats 221 and 222.

[0045] Meanwhile, a music icon 231 is superimposed and displayed in the rear seat 223. By viewing this display, the passenger can understand that the sound played from the sound source belonging to the music group is being heard in the rear seat 223. In other words, the passenger can understand that a sound field belonging to the music sound source is being formed in the rear seat 223.

[0046] The screen of the touch panel 400 may also display an input receiving unit 210 for receiving touch operations of the touch panel 400 by the passenger. The input receiving unit 210 is also "information indicating the state of the sound field". The input receiving unit 210 includes, for example, a start switch 211, a sound field selection switch 212, and a telephone selection switch 213. The passenger can operate the sound field by touching the switches 211, 212, and 213. In addition, the passenger can grasp the state of the sound field before and after the operation through the state of the switches 211, 212, and 213. Therefore, the passenger can visually grasp the state of the sound field through the input receiving unit 210 and perform accurate operations on the sound field.

[0047] The start switch 211 corresponds to Figure 2 、 Figures 4 to 6 The switch for controlling the start or stop of the sound field control device 100 in the "Audio Zone Control" of the audio field control device 100 is used. Whenever the passenger performs a touch operation, the start and stop of the sound field control device 100 are switched. Figure 2 As shown, the state where the start switch 211 is located on the right side of the prescribed frame corresponds to the start state, as shown in FIG. Figure 4 As shown, the state where the start switch 211 is located to the left of the specified frame corresponds to the stopped state. The sound field control device 100 and the sound field control method display information indicating whether the sound field control device 100 is started or stopped (the start switch 211) on the touch panel 400, accept an operation to switch between starting and stopping the sound field control device 100, switch between starting and stopping the sound field control device 100 in accordance with the operation, and display information indicating whether the sound field control device 100 is started or stopped (the start switch 211) after the switch is made on the touch panel 400. This allows the passenger to visually grasp the activation state of the sound field control device 100 and accurately operate the sound field control device 100.

[0048] The sound field control device 100 accepts the passenger's operation on the sound field only when the sound field control device 100 is in the activated state, and controls the sound field according to the operation. Figure 2 In the activated state, information indicating the state of the sound field can also be displayed in color. Specifically, switches 211, 212, 213 and sound source icons 231, 232, 233 can also be displayed in color. This allows the occupants to intuitively understand the situation in which the sound field can be operated. On the other hand, in Figure 4In the stopped state, information indicating the status of the sound field can also be displayed in gray. Specifically, switches 211, 212, 213 and sound source icons 231, 232, 233 can be grayed out. This allows passengers to intuitively understand that the sound field cannot be operated. In addition, it is possible to switch the color of only one of switches 211, 212, 213 and sound source icons 231, 232, 233, or only a portion of switches 211, 212, 213 and a portion of sound source icons 231, 232, 233.

[0049] The sound field selection switch 212 corresponds to Figure 2 、 Figures 4 to 6 An example of displaying the first sound field and the second sound field in a switchable manner in the "Audio Zone Selection" of the audio field selection switch 212, wherein the first sound field is a sound field in which sound can be heard at all seats 221, 222, and 223 in the vehicle interior, and the second sound field is a sound field in which sound can be heard at the driver's seat 221 and the front passenger seat 222 in the vehicle interior and sound cannot be heard at the rear seat 223 in the vehicle interior. Whenever the passenger touches the sound field selection switch 212, the first sound field and the second sound field are switched. Figure 2 and Figure 5 As shown, in the state of the first sound field, the sound field selection switch 212 is displayed as "ALL", as shown in FIG. Figure 6 As shown, in the state of the second sound field, the sound field selection switch 212 is displayed as "FRONT". Figure 2 、 Figure 5 as well as Figure 6 As shown, the sound field selection switch 212 shows the state of the sound field (all / front row). As a result, the passenger can visually grasp the current or after-operation state of the sound field according to the state of the sound field selection switch 212 and accurately operate the sound field. In addition, the display of the sound source icons 231, 232, and 233 in the layout diagram 220 can also be changed in conjunction with the state of the sound field selection switch 212. Specifically, as shown in FIG. Figure 2 and Figure 5 As shown, in the state of the first sound field (all), the sound source icons 231 and 233 may be superimposed and displayed in the rear seat 223 .

[0050] On the other hand, Figure 6As shown, in the second sound field state (front row), a mute icon 235 indicating that no sound is being heard, i.e., a mute state where no sound field is formed, can be displayed in the rear seat 223. This allows passengers to intuitively understand the situation where no sound field is formed and the mute state is formed. Alternatively, mute icon 235 may not be displayed, and instead no sound source icon may be displayed in the rear seat 223. Furthermore, the sound field selection switch 212 can switch between the first sound field and the second sound field for all groups of sound sources, regardless of the sound source group.

[0051] On the other hand, the telephone selection switch 213 corresponds to Figure 2 、 Figures 4 to 6 The "Phone Zone Selection" of the device is a switch for switching the sound field of the sound source belonging to the phone between the first sound field and the second sound field, wherein the first sound field is a sound field in which the sound can be heard at all seats 221, 222, and 223, and the second sound field is a sound field in which the sound can be heard at the driver's seat 221 and the front passenger seat 222 in the vehicle and the sound cannot be heard at the rear seat 223 in the vehicle. Figure 2 As shown, in the case where the sound field of the sound source belonging to the telephone is the second sound field, the telephone selection switch 213 is displayed as "front row", as shown in FIG. Figure 5 As shown, when the sound field of the sound source belonging to the phone is the first sound field, the phone selection switch 213 is displayed as "all". The phone selection switch 213 shows the state of the sound field (all / front row), so the passenger can visually confirm the state of the sound field belonging to the sound source of the phone based on the phone selection switch 213. In addition, the display of the sound source icons 231, 232, and 233 in the layout diagram 220 can also be changed in conjunction with the state of the phone selection switch 213. Specifically, as shown in FIG. Figure 5 As shown, when the first sound field (all) is selected by the phone selection switch 213, the phone icon 233 may be superimposed and displayed on both the front seat and the rear seat 223. Figure 2 As shown, when the second sound field (front row) is selected using the phone selection switch 213, the phone icon 233 is superimposed and displayed at the front seats 221 and 222, but the phone icon 233 is not displayed at the rear seat 223. Figure 2 In the example, the first sound field (all) is selected by the sound field selection switch 212, so a music icon 231 is superimposed and displayed at the rear seat 223. Figure 6 In the example, the second sound field (front row) is selected by the sound field selection switch 212, so only the second sound field (front row) can be selected in the phone selection switch 213. Figure 6As shown, when the second sound field (front row) is selected by the sound field selection switch 212, the telephone selection switch 213 may be displayed in gray. This allows the passenger to intuitively understand that the sound field of the sound source of the telephone is inoperable.

[0052] like Figure 2 、 Figures 4 to 6 As shown, the information indicating the state of the sound field may also include a sentence 240 for explaining the correspondence between the seats 221, 222, 223 in the vehicle interior and the groups to which the sound sources that can be heard at the seats 221, 222, 223 belong. Figure 2 、 Figures 4 to 6 As shown, the content of statement 240 changes according to the state of the sound field. Figure 2 In the state of the sound field shown, a sentence 240 such as "In the front seats, you can listen to the sounds of music, navigation, and telephone. In the rear seats, only music is available." can be displayed on the screen of the touch panel 400. Figure 4 In the example, a sentence 240 such as "The sound field control device is in a stopped state. To control the sound field, please use the sound control menu or start the sound field control device." may be displayed. Figure 5 In the example, a sentence 240 such as "In the front seat, you can listen to the sounds of the sound sources of music, navigation, and phone calls. In the back seat, you can listen to music and phone calls." can also be displayed. Figure 6 In the vehicle, a sentence 240 such as "In the front seats, you can listen to music, navigation, and phone sounds. In the rear seats, you cannot listen to any sound sources." can also be displayed. Based on the content of sentence 240, the passenger can visually understand the current or post-operation state of the sound field and accurately operate the sound field.

[0053] like Figure 3 As shown, an animation 234 of ripple expansion may be displayed around the sound source icon that is currently playing sound. Specifically, an animation 234 indicating the outer edge of the space where the sound is expanding may be displayed around the sound source icons 231, 232, and 233 that are actually playing sound from the speakers. The passenger can intuitively recognize the group of sound sources that are currently playing. Figure 2 Animation 234 is displayed for each of the three icons 231, 232, and 333 displayed on the front seats 221 and 222. Alternatively, the three icons 231, 232, and 333 may be treated as a single icon and animation 234 may be displayed around it. Furthermore, animation 234 may be controlled to play while the vehicle is stopped and not displayed while the vehicle is moving. This helps maintain the driver's attention while the vehicle is moving.

[0054] In the first embodiment, the sound field of the navigation sound source is not the target of operation and control. However, it can be the target of operation and control in the same way as the sound field of the sound source of other groups such as music and telephone.

[0055] (Second embodiment)

[0056] In the second embodiment, the following example is described: the sound field in the vehicle cabin is switched between a first sound field and a third sound field, wherein the first sound field is a sound field in which sound can be heard at all seats in the vehicle cabin, and the third sound field is a sound field in which sound can be heard at the driver's seat and no sound can be heard at seats other than the driver's seat, that is, the front passenger seat and the rear seats. Figure 1A and Figure 1B The structure of the sound field control device 100 and the process of the sound field control method are the same as those of the first embodiment, and therefore repeated descriptions are omitted.

[0057] Reference Figures 7 to 11 The display layout of the touch panel 400 and the specific method of operating the sound field according to the second embodiment will be described. Figure 7 As shown, information indicating the state of the sound field is displayed on the screen of touch panel 400. As examples of information indicating the state of the sound field, a layout diagram 220 with a sound source icon superimposed thereon, an input receiving unit 210, and a sentence 240 are displayed on the screen of touch panel 400. Input receiving unit 210 includes a start switch 211, a sound field selection switch 212, and a phone selection switch 213. The operation of start switch 211 and sound field selection switch 212, as well as sentence 240, is the same as in the first embodiment, and therefore repeated descriptions will be omitted.

[0058] In the second embodiment, an example of operating and controlling the sound field by dividing the seats in the vehicle into three zones: the driver's seat 221 (left seat), the front passenger seat 222 (right seat), and the rear seat 223 is shown. Various sound source icons are superimposed and displayed on the driver's seat 221, the front passenger seat 222, and the rear seat 223 in the layout diagram 220. Furthermore, the driver's seat 221, the front passenger seat 222, and the rear seat 223 are each colored in a different color, and the sound source icons are also colored in a color similar to the color of the seats. This allows for intuitive understanding of the different sound fields formed for the three seats.

[0059] The telephone selection switch 213 corresponds to Figures 7 to 11The phone selection switch 213 is used to switch between the first and third sound fields for the sound source of the phone call. In the first sound field, the sound of the phone call can be heard in all seats 221, 222, and 223. In the third sound field, the sound of the phone call can be heard in the driver's seat 221 in the vehicle, but cannot be heard in the passenger seat 222 or the rear seat 223.

[0060] like Figure 7 and Figure 11 As shown in FIG. 1 , when the sound field of the sound source belonging to the telephone is the third sound field, the telephone selection switch 213 is displayed as “DRIVER”. Figure 9 and Figure 10 As shown, when the sound field of the sound source associated with a phone call is the first sound field, phone selector switch 213 displays "ALL." Each time the passenger touches sound field selector switch 212, the first sound field and the third sound field are switched. Phone selector switch 213 displays the sound field status (All / Driver's Seat), allowing the passenger to visually grasp the state of the sound field associated with the phone call and accurately control the sound field associated with the phone call.

[0061] In addition, the display of the telephone icon 233 in the layout diagram 220 may also be changed in conjunction with the state of the telephone selection switch 213. Specifically, Figure 9 As shown, when the first sound field (all) is selected using the phone selection switch 213, a phone icon 233 may be superimposed and displayed on each of the driver's seat 221, the passenger seat 222, and the rear seat 223. Figure 7 As shown, when the third sound field (driver's seat) is selected using the phone selection switch 213, a phone icon 233 may be superimposed and displayed on the driver's seat 221, and a phone mute icon 33N indicating that the sound of the phone's source cannot be heard, that is, that a sound field of the phone's source is not formed, may be displayed on the passenger seat 222 and the rear seat 223. Alternatively, instead of displaying the phone mute icon 33N, no phone-related icons 233 and 33N may be displayed on the passenger seat 222 and the rear seat 223.

[0062] In addition, Figure 7 and Figure 9 The sound field selection switch 212 shown in the figure shows "all", so the sound field is formed at all seats in the vehicle. Therefore, music icons 231 are superimposed and displayed at each seat of the driver's seat 221, the passenger seat 222 and the rear seat 223. Figure 10 and Figure 11 The sound field selection switch 212 shown in the figure shows "front row", so the sound field is formed at the front seats in the vehicle, that is, the driver's seat 221 and the passenger seat 222, but no sound field is formed at the rear seat 223. Figure 6 As shown, the telephone selection switch 213 is a switch for switching between the front seat and all seats. Therefore, when the second sound field (front row) is selected by the sound field selection switch 212, the telephone selection switch 213 is inoperable. However, in the second embodiment, the telephone selection switch 213 is a switch for switching between the driver's seat and all seats. Therefore, as Figure 10 and Figure 11 As shown, even if the second sound field (front row) is selected by the sound field selection switch 212, the telephone selection switch 213 can be operated. However, the sound field selection switch 212 has a higher priority than the telephone selection switch 213, so as shown in FIG. Figure 10 As shown, even if the second sound field (front row) is selected using the sound field selection switch 212 and the first sound field (all) is selected using the telephone selection switch 213, the sound field of the sound source belonging to the telephone is formed at the driver's seat 221 and the front passenger seat 222, but not at the rear seat 223.

[0063] like Figure 8 As shown, when the start switch 211 is in the stop position, and the sound field control device 100 is in a stopped state, information indicating the state of the sound field can also be displayed in gray. Specifically, the switches 211, 212, 213 and the sound source icons 231, 232, 233 can be grayed out. This allows the occupant to intuitively understand that the sound field is inoperable. Furthermore, it is also possible to switch the color of only one of the switches 211, 212, 213 and the sound source icons 231, 232, 233, or only a portion of the switches 211, 212, 213 and the sound source icons 231, 232, 233.

[0064] In addition, in the second embodiment, the sound field of the sound source belonging to the navigation is not the object of operation. The sound of the sound source belonging to the navigation is output to the driver, such as the guidance sound related to the route guidance. Figures 7 to 11 As shown, a navigation icon 232 is superimposed and displayed on the driver's seat 221, but not on the passenger seat 222 or the rear seat 223. However, the sound field of the sound source belonging to the navigation can also be operated and controlled in the same manner as the sound fields of the sound sources belonging to other groups such as music and telephone calls.

[0065] Although the first and second embodiments are described above, it should not be understood that the description and drawings, which are part of this disclosure, limit the invention. Various alternative embodiments, examples, and application techniques will become apparent to those skilled in the art based on this disclosure.

[0066] While the example illustrates sound sources belonging to groups including music, navigation, and phone, other groups are possible. Furthermore, an example of displaying sound source icons representing the groups of sound sources that form the sound field for each seat is shown in layout diagram 220. This is not limiting, and instead of displaying sound source icons, an animation such as a color, pattern, or ripple identifying the sound source group may be added to the seat. Alternatively, characters identifying the sound source group, such as "MUSIC," "NAV," "NAVI," "PHONE," or "PHONE," may be superimposed on the seat.

[0067] A switch for selecting a fourth sound field mode in which sounds played from all sound sources are heard by the driver's seat 221 in the vehicle cabin and are not heard by seats 222 and 223 in the vehicle cabin other than the driver's seat 221 may be displayed on the touch panel 200. This switch can be received by the passenger's operation to select the fourth sound field. Thus, the passenger can control the sound field in the vehicle cabin to the fourth sound field.

[0068] The sound field control device 100 may also collect the speech of a passenger seated in a seat that cannot hear the sound from the phone's audio source and, based on the results of voice recognition of the speech, switch the sound field so that the voice can be heard in the seat that cannot hear the speech. Furthermore, the sound field control device 100 may display information indicating the status of the switched sound field on the touch panel 200. For example, a microphone is installed in the vehicle interior to collect the speech of a passenger seated in the front passenger seat 222 or the rear seat 223. The control unit 200 uses existing voice recognition technology to identify the passenger's speech picked up by the microphone. For example, if a predetermined keyword such as "phone," "call," "want to join," or "want to talk together" is detected in the recognized speech, it is determined that the passenger intends to join the call. In this case, the control unit 200 switches the sound field so that the voice can be heard in the seat that cannot hear the speech without waiting for the passenger's touch operation. The sound field control device 100 can control the sound field according to the passenger's intention to participate in the phone call. In addition, the passenger can visually grasp the state of the controlled sound field.

[0069] In the first and second embodiments described above, touch panel 400 is used as an example of a display, and touch operation on touch panel 400 is used as an example of a vehicle occupant's operation of the sound field. However, the display that displays information indicating the state of the sound field may also be a display that does not function as a position input device like a touchpad. In this case, the occupant can operate the sound field using their own voice using existing voice recognition technology, or other input devices installed in the vehicle, such as switches on the steering wheel or instrument panel, rather than using touch operation on touch panel 400. In other words, the sound field control device 100 can also accept sound field operations performed by the occupant's voice or other input devices.

[0070] (Third embodiment)

[0071] In the third embodiment, the Figure 1A The illustrated configuration and operation examples of the audio system 300 included in the sound field control system 1000. The audio system 300 generates a sound field in the vehicle interior by using a plurality of speakers to reproduce sound based on the sound field settings determined by the sound field control device 100 in response to an operation received by an occupant.

[0072] Reference Figure 12 The structure of an audio system 300 according to a third embodiment will be described. Audio system 300 includes a sound source control device 340 and an amplifier 350. Sound source control device 340 outputs multiple sound source group signals. Amplifier 350 has at least the same number of sound inputs 351 as the number of sound source group signals, and uses the sound source group signals input to each sound input 351 to drive multiple speakers 360 mounted in the vehicle. Sound source control device 340 classifies a greater number of sound sources 330 than the number of sound source group signals into a plurality of groups 331 to 333, the same number as the number of sound source group signals. For each group 331 to 333, the sound source signals output by the multiple sound sources 330 belonging to each group 331 to 333 are output as sound source group signals. Amplifier 350 determines which speaker 360 to drive and the sound source group signal to drive each speaker 360 based on the type of each sound source group signal and the sound field settings within the vehicle cabin. Each of the multiple speakers 360 converts the sound source group signals received from the amplifier 350 into sound for output. In the third embodiment, a "sound field" refers to the area within the vehicle interior where the sound broadcast from the multiple speakers 360 can be heard. The sound field is formed over the entire vehicle interior or a portion thereof. Furthermore, two or more sound fields with different sound sources can be simultaneously formed.

[0073] A smaller number of sound source group signals than sound sources 330 are input to sound input 351 of loudspeaker 350. Loudspeaker 350 determines which speakers 36-1 to 36-N to drive and which sound source group signals to use to drive each speaker 36-1 to 36-N based on the type of each sound source group signal and the sound field settings. Therefore, the number of sound inputs to loudspeaker 350 is smaller than the number of sound sources 330, simplifying control of multiple speakers 360 by loudspeaker 350. N represents the number of speakers and is a natural number greater than 2.

[0074] In the third embodiment, the number of components is exemplified as follows. The number of sound source group signals output by the sound source control device 340 is set to three. The sound source control device 340 classifies the sound source 330 into three groups 331 to 333, the same number as the sound source group signals. The loudspeaker 350 has three sound inputs 351, the same number as the sound source group signals.

[0075] <Count of signal and sound input>

[0076] The counting of the number of sound source group signals and sound inputs 351 will be described. When the sound source 330 is a monaural sound source, the sound it plays is monaural, and the waveform of the signal generated from one sound source 330 is one type. On the other hand, when a stereo sound source (including 2-channel stereo, binaural, surround sound, 4-channel stereo, 5.1-channel stereo, etc.) is played in stereo, the waveform of the signal generated from one sound source 330 is two or more types. However, in the present disclosure, the number of sound source group signals is counted based on the difference in the sound source that generates the sound source group signals, without considering the difference in their waveforms. That is, even if the waveforms of the signals are different, if the sound source that generates the signals is the same, these signals are counted as one sound source group signal. Accordingly, the number of sound inputs 351 to which the sound source group signals are input is also counted based on the difference in the sound source that generates the input signals, without considering the difference in the waveforms of the input signals. For example, when signals having different waveforms but generated by the same sound source are input to two or more independent terminals included in the microphone 350 , the two or more sound input terminals are counted as one sound input 351 .

[0077] <Hardware Structure of Loudspeaker and Sound Source Control Device>

[0078] The loudspeaker 350 may also include a control unit 352. The control unit 352 may also constitute an information processing unit that determines the speaker 360 to be driven and the sound source group signal that drives each speaker 36-1 to 36-N based on the category of each sound source group signal and the setting of the sound field. Specifically, the control unit 352 can be implemented using a microcomputer having a CPU (central processing unit), a memory, and an input and output unit. A computer program (speaker control program) for enabling the microcomputer to function as the control unit 352 is installed in the microcomputer and executed. As a result, the microcomputer functions as the control unit 352. In addition, an example of implementing the control unit 352 by software is shown here, but of course, dedicated hardware for performing information processing can also be prepared to constitute the control unit 352. In addition, the control unit 200 can also be used as an electronic control unit (ECU) used in other vehicle-related controls.

[0079] In addition to transmitting the sound source group signal, the sound source control device 340 also transmits a signal indicating the category of each sound source group signal and a signal indicating the sound field setting to the loudspeaker 350. The loudspeaker 350, for example, the control unit 352 of the loudspeaker 350, determines the loudspeaker to be driven and the sound source group signal to drive each loudspeaker based on the signal indicating the category of each sound source group signal and the signal indicating the sound field setting received from the sound source control device 340. The loudspeaker 350 can determine the loudspeaker 360 to be driven and the sound source group signal to drive each loudspeaker 36-1 to 36-N based on the signal received from the sound source control device, thereby simplifying the control of the loudspeaker 360 by the loudspeaker 350. In addition, the sound source control device 340 can also transmit the signal received from the sound source control device to the loudspeaker 350. Figure 1A The control unit 200 of the sound field control device 100 receives a signal indicating the setting of the sound field. Figure 1B In step S03 , the sound source control device 340 may receive a signal indicating the sound field setting after the operation from the control unit 200 and transmit the signal to the speaker 350 .

[0080] Sound source control device 340, like control unit 352, can be implemented using a microcomputer equipped with a CPU (central processing unit), memory, and input / output units, or dedicated hardware for performing various information processing functions. Sound source control device 340 can also serve as an electronic control unit (ECU) used for other vehicle-related control functions.

[0081] (Specific example of sound source)

[0082] A specific example of multiple sound sources 330 and an in-vehicle infotainment system (IVI) are described. Multiple sound sources 330 are classified into three groups 331 to 333. Group 331 is a music group. The sound sources belonging to group 331 of music include a first tuner, a second tuner, ..., a first external input, a second external input, .... As the first tuner, the second tuner, ..., various radio tuners and TV tuners including an AM tuner, an FM tuner, and an XM tuner are exemplified. In addition, as the first external input, the second external input, ..., music playback from a portable music player (Mobile Music Player), music streaming (Wireless Audio Streaming), and music playback from an application installed on a smartphone or a mobile phone (mobile phone) are exemplified. Portable music players, smartphones, and mobile phones are connected to the vehicle-mounted sound source control device 340 via a wired connection cable or wirelessly via short-range wireless communication or a wireless LAN (local area network).

[0083] Group 332 is the navigation group. The audio sources belonging to group 332 include a first navigation system, a second navigation system, and so on. Examples of the first navigation system, the second navigation system, and so on include audio guidance from a navigation device installed in the vehicle and audio guidance from a navigation application installed in a passenger's portable communication terminal, such as a smartphone. The passenger's portable communication terminal is connected to the vehicle-mounted sound source control device 340 via a wired connection cable or wirelessly via short-range wireless communication or a wireless LAN (local area network).

[0084] Group 333 is a telephone group. Sound sources belonging to group 333 include a first call, a first call, a second call, a second call, etc. Examples of the first call, the first call, the second call, the second call, etc. include a call using a vehicle-mounted telephone system, a call tone in the telephone system, a call using a call application installed on a passenger's portable communication terminal, and a call tone in the call application.

[0085] Sound source signals can be output from each of the above-mentioned sound sources 330. The sound source control device 340 receives these sound source signals and outputs the sound source signals output from the multiple sound sources 330 belonging to the group as sound source group signals for each group 331 to 333. In the case where sound source signals are output simultaneously from multiple sound sources in the same group, the sound source control device 340 can also respond as follows. The sound source control device 340 can also output a representative sound source signal output from the sound source 330 with the highest priority among the sound source signals simultaneously output from the multiple sound sources 330 belonging to the same group 331 to 333 as a sound group signal. In this way, the number of sound inputs to the loudspeaker 350 can be reduced. The mixing of sounds played simultaneously from multiple sound sources is suppressed. Alternatively, the priority relationship between the multiple sound sources 330 belonging to the same group 331 to 333 can be predefined, and the sound source control device 340 can store data representing the priority relationship for each group 331 to 333.

[0086] In addition, multiple sound sources 330 and sound source control devices 340 are sometimes collectively referred to as an in-vehicle infotainment system 310. The in-vehicle infotainment system 310 is an information and communication system that provides both information and entertainment. For example, in addition to external input from a smartphone, the in-vehicle sound sources 330 and sound source control devices 340, which also include tuners and telephone systems, can be housed in a single housing.

[0087] <Sound field formed in the vehicle interior>

[0088] Reference Figure 13A and Figure 13B , the sound field formed in the vehicle cabin by the audio system 300 will be described for each sound field setting. Arrow FD indicates the direction in which the vehicle travels. Figure 13A and Figure 13B The upper portion of shows a case where the sound field selection is for all seats, that is, the sound field selection switch 212 is set to “all”. Figure 13A and Figure 13B The lower part of shows a case where the sound field selection is the front seat, that is, the sound field selection switch 212 is set to “front row”.

[0089] First, the sound field setting is Figure 7 The following describes the case where the settings are shown: the sound field selection switch 212 is set to "ALL" and the telephone selection switch 213 is set to "DRIVER". Figure 7 The "all" setting of the sound field selection switch 212 corresponds to Figure 13A and Figure 13BFor example, when the sound field selection is set to All Seats, for example, when the sound source belonging to group 331 of music is played, a music sound field 110 is formed in an area encompassing all seats in the vehicle cabin, namely, the driver's seat, the front passenger seat, and the rear seats. In sound field 110, the sound of the sound source belonging to group 331 of music can be heard.

[0090] While music sound field 110 is formed, if the sound source belonging to group 333 of the phone, for example, plays a call tone, a new phone sound field 130 is formed in the area of ​​the vehicle interior encompassing the driver's seat (left seat). Meanwhile, the sound source belonging to group 331 of the music continues to play, so music sound fields 112 and 113 are simultaneously formed in areas other than the driver's seat, encompassing the passenger seat and rear seats. Thus, when phone select switch 213 is in the "driver's seat" position, i.e., when the "Call Path Select: On" setting is enabled, audio system 300 forms sound field 130 of the phone sound source in a limited area of ​​the vehicle interior, in this case, the area encompassing the driver's seat. Simultaneously, music sound fields 112 and 113 are formed in other areas of the vehicle interior. In each sound field 130, 112, and 113, the sounds of the music and phone sound sources are not mixed, and both can be heard.

[0091] Next, the sound field is set as Figure 9 The sound field selection switch 212 is set to "all", and the telephone selection switch 213 is set to "all". The "all" setting of the telephone selection switch 213 corresponds to Figure 13A "Call path selection: None" is selected. In this case, the sound source of the phone is prioritized over the sound source of the music. Specifically, a sound field 131 for the sound source of the phone is formed in an area that includes all seats in the vehicle, while a sound field for the sound source of the music is not formed. In this way, when the playback of the sound source belonging to the phone group 333 starts while the sound field 110 for music is formed, the entire vehicle interior switches from the sound field 110 for music to the sound field 131 for the phone.

[0092] Next, the sound field of the navigation sound source will be described. In the state where the music sound field 110 is formed, when the sound source belonging to the navigation group 332 is, for example, a sound guide, Figure 13BAs shown, a new navigation sound field 120 is formed in the area including the driver's seat (left seat) in the vehicle cabin. At this time, the playback of the sound source belonging to group 331 of music continues, so that the sound fields 112 and 113 of music are formed simultaneously in the area including the front passenger seat and the rear seats in addition to the driver's seat. In this way, the sound field 120 of the sound source belonging to group 332 of navigation is formed in the area including the driver's seat, but not in the area including the front passenger seat and the rear seats in addition to the driver's seat. The audio system 300 simultaneously forms the sound fields 120, 112, and 113 of the sound sources of music and navigation in different groups. In each sound field 120, 112, and 113, the sounds of the music and navigation sound sources are not mixed with each other and can be heard.

[0093] In the above description, the navigation sound field 120 and the telephone sound field 130 are formed in the same area including the driver's seat. In the case where the sound source belonging to the navigation group 332 competes with the sound source belonging to the telephone group 333, that is, when the navigation and telephone sound fields are to be formed simultaneously, either one may be given priority over the other. For example, Figure 13B The upper right side of the figure shows a schematic representation of the navigation and phone sound fields 120 and 133 formed when the phone is prioritized over the navigation. Alternatively, the phone sound field 133 can be formed near the occupant's ear, while the navigation sound field 120 is formed in an area surrounding the sound field 133. This allows the navigation and phone sound fields to be formed without intermixing, allowing the occupant to hear the sounds of the phone and navigation sound sources independently in each sound field 133 and 120.

[0094] Figure 13A and Figure 13B The sound field selection for the front seats corresponds to Figure 10 and Figure 11 The sound field selection switch 212 shown is for the "front row" case. Therefore, when the sound source belonging to the music group 331 is played, a music sound field 111 is formed in the area including the front seats in the vehicle cabin, that is, the driver's seat and the front passenger seat, but no sound field is formed in the area including the rear seats. In the sound field 111, the sound of the sound source belonging to the music group 331 can be heard. In addition, regarding the above-mentioned "Call path selection: yes", "Call path selection: no", the sound field 120 of the navigation sound source, and the competition between the navigation sound field 120 and the telephone sound field 130, the difference compared to the case where the sound field selection is for all seats is that no sound field is formed in the rear seats, but other aspects are common and are omitted from further explanation.

[0095] <Sound Source Group (Stream) and Sound Source Category (Category)>

[0096] Reference Figure 14, a specific example of the groups (Stream) 331, 332, and 333 to which each sound source 330 belongs and the categories (Category) to which each sound source 330 belongs is described. All sound sources 330 are classified into one of group (Main) 331, group (Mix1) 332, and group (Mix2) 333. Group (Main) 331 is a music group, group (Mix1) 332 is a navigation group, and group (Mix2) 333 is a phone group.

[0097] All sound sources are categorized into multiple categories. A sound source category is set for each group 331, 332, and 333. For example, sound source 330 belonging to group 331 (music) is categorized into any of the following categories: Entertainment, TA (traffic announcement), Auto DJ, e-Call (emergency call), or Other. Sound source 330 belonging to group 332 (navigation) is categorized into any of the following categories: Normal-NAVI, Special-NAVI, or SPI-NAVI. The sound source 330 belonging to the telephone group 333 is classified into any one of Wireless-TEL (wireless call), Wireless-TEL RING (wireless phone call), SPI-TEL (special call), SPI-TEL RING (special phone call), APP-TEL (smartphone call), APP-TEL RING (smartphone phone call), Normal-VR (Voice recognition), SPI-VR, Enhanced-VR (enhanced VR), and other (OTHER). Figure 14 The illustrated sound sources 330 , groups of the sound sources 330 , and their types are merely examples and do not limit the present invention.

[0098] <Correspondence between category combinations and identification numbers>

[0099] Figure 15A to Figure 15D The identification numbers (1) to (45) are used to identify Figure 14 A table obtained by classifying the combinations of the categories of the three groups (Main, Mix1, Mix2). Figure 15A to Figure 15D The combinations of the categories of the music group (Main) 331 and the categories of the phone group (Mix2) 333 are shown. Figure 15A to Figure 15D The categories (None, Normal-NAVI, Special-NAVI, SPI-NAVI) of the navigation group (Main) 332 are shown respectively. Figure 15A to Figure 15DA three-dimensional table is formed showing all combinations of categories belonging to the three groups (Main, Mix1, Mix2). For example, Figure 15B The identification number (28) shown shows a combination of any of the categories of Entertainment, TA (Traffic announcement), and Auto DJ of the group (Main), the category (Normal-NAVI) of the group (Mix1), and any of the categories of Normal-VR and SPI-VR of the group (Mix2).

[0100] Furthermore, "None" or "NONE" of the category indicates that no sound source group signal is output from this group. For example, Figure 15A The overall figure shows that none of the sound sources belonging to the group (Mix1) outputs a sound source signal (None). Figure 15A The combination of the category (NONE) of the group (Mix2) and the category (NONE) of the group (Main) indicates that no sound source group signal is output from any of the groups (Main, Mix1, Mix2), and there is no speaker to be driven, so no identification number is assigned.

[0101] The control unit 352 of the loudspeaker 350 can refer to Figure 15A to Figure 15D The combination table shown is used to determine the identification number corresponding to the combination of the types of the sound source group signals of each group 331, 332, and 333 received from the sound source control device 340. Figure 12 As shown, Figure 15A to Figure 15D The combination table shown can be stored in the storage unit 353 included in the microphone 350 .

[0102]

[0103] Figures 16 to 19 They are shown respectively Figure 15A to Figure 15D Part of a correspondence table showing the correspondence between combinations of sound source categories classified by identification numbers (1) to (45) and groups of speakers to be driven and sound sources driving each speaker. Figures 16 to 19 The correspondence table shown can be stored in the storage unit 353 included in the microphone 350. Figures 16 to 19 In , the sound field settings are different. Figure 16 , the start switch 211 is turned on (Sound Bubble = ON), the sound field selection switch 212 is "ALL" (Sound Bubble Mode = ALL), and the phone selection switch 213 is "ALL" (CallRouting = OFF). Figure 17 and Figure 16The difference is that the telephone selection switch 213 is "DRIVER" (CallRouting = ON). Figure 18 and Figure 16 The difference is that the sound field selection switch 212 is "FRONT (front row)" (SoundBubble Mode = Front). Figure 19 and Figure 16 The difference is that the sound field selection switch 212 is "FRONT" (SoundBubble Mode = Front), and the telephone selection switch 213 is "DRIVER" (Call Routing = ON).

[0104] Figures 16 to 19 From identification numbers (1) to (45), we have selected Figure 13A and Figure 13B The ten sound field states shown are displayed with the corresponding identification numbers (1), (8), (16), and (35). Figures 16 to 19 Identifier (1), (8), (16), (35) and Figure 13A 、 Figure 13B as well as Figure 15A to Figure 15D The identification numbers (1), (8), (16), and (35) shown correspond respectively.

[0105] Figures 16 to 19 The figures illustrate 20 speakers 36-1 to 36-20 installed in the vehicle. The left side of the front seat (FL) is the driver's side, and the right side of the front seat (FR) is the passenger side. Three speakers 36-1 to 36-3 are installed at any location on the driver's side door, the driver's side of the dashboard, or the driver's side pillar on the left side of the front seat (FL). In addition, a headrest speaker 36-4 is installed on the driver's headrest. In this way, four speakers 36-1 to 36-4 are installed on the left side of the front seat (FL) facing the driver sitting in the driver's seat. Similarly, a total of four speakers 36-6 to 36-9 are installed on the right side of the rear seat (FR) facing the passenger sitting in the passenger seat, just like the left side of the front seat (FL). A speaker 36-5 is also installed in the center of the dashboard.

[0106] Meanwhile, three speakers 36-10 to 36-12 are installed on the left side of the rear seat (RL) for the rear-seat occupants. Three speakers 36-13 to 36-15 are installed on the right side of the rear seat (RR) for the rear-seat occupants. A subwoofer 36-16 is installed under the seat or in the trunk. Four surround speakers 36-17 to 36-20 are installed on the left side of the front seat (FL), right side of the front seat (FR), left side of the rear seat (FL), and right side of the rear seat (FR).

[0107] For each of the identification numbers (1), (8), (16), and (35), the speaker 360 to be driven and the groups 331 to 333 to which the sound source group signals driving the speakers 36-1 to 36-20 belong are described.

[0108] Figure 16 The identification number (1) indicates the following situation: any sound source of the Entertainment, TA (Traffic announcement), and Auto DJ categories belonging to the music group 331 (Main) outputs a sound source group signal, and any sound source belonging to the navigation group 332 (Mix1) and the telephone group 333 (Mix2) does not output a sound source group signal. Figure 16 The identification number (1) corresponds to Figure 15A Identification number (1). Figure 16 As shown, at this time, the amplifier 350 drives all the speakers 36-1 to 36-20 according to the sound source group signal from the music group 331 (Main). Figure 13A The upper left side shows the sound field 110 of the music.

[0109] Figure 16 The identification number (8) indicates the following situations: any sound source of the Entertainment, TA (Traffic announcement), and Auto DJ categories belonging to the music group 331 (Main) outputs a sound source group signal; any sound source of the Normal-NAVI, Special-NAVI, and SPI-NAVI categories belonging to the navigation group 332 (Mix1) outputs a sound source group signal; and no sound source of the telephone group 333 (Mix2) outputs a sound source group signal. Figure 16 The identification number (8) corresponds to Figure 15B to Figure 15D Identification number (8). Figure 16As shown, at this time, the loudspeaker 350 drives all the speakers 36-1 to 36-3, 36-5 to 36-20 except the headrest speaker 36-4 embedded in the driver's seat headrest according to the sound source group signal of the group 331 (Main) belonging to music, and drives the headrest speaker 36-4 according to the sound source group signal of the group 332 (Mix1) belonging to navigation. Figure 13B The upper left side of the figure shows the sound fields 112, 113 of music and the sound field 120 of navigation.

[0110] Figure 16 The identification number (16) indicates the following situations: any sound source of the Entertainment, TA (Traffic announcement), and Auto DJ categories belonging to the music group 331 (Main) outputs a sound source group signal; any sound source of the WL-TEL, WL-TEL RING, SPI-TEL, SPI-TEL RING, APP-TEL, and APP-TEL RING categories belonging to the telephone group 333 (Mix2) outputs a sound source group signal; and no sound source belonging to the navigation group 332 (Mix1) outputs a sound source group signal. Figure 16 The identification number (16) corresponds to Figure 15A At this time, the loudspeaker 350 drives all the speakers 36-1 to 36-4, 36-6 to 36-20 except the speaker 36-5 arranged in the center of the instrument panel according to the sound source group signal of the group 333 (Mix2) belonging to the telephone, and does not drive the speaker 36-5. Therefore, a Figure 13A The upper right side of the phone shows the sound field 131.

[0111] Figure 17 The identification number (16) indicates that Figure 16 The same combination of identification number (16). However, Figure 16 The difference is that the telephone selection switch 213 is "DRIVER" (Call Routing = ON). Figure 17 The identification number (16) corresponds to Figure 15A Identification number (16). At this time, the loudspeaker 350 drives all the loudspeakers 36-1 to 36-4, 36-6 to 36-20 except the loudspeaker 36-5 arranged in the center of the instrument panel, and does not drive the loudspeaker 36-5. The loudspeaker 350 drives the headrest loudspeaker 36-4 according to the sound source group signal of the group 333 (Mix2) belonging to the telephone, and drives the loudspeakers 36-1 to 36-3, 36-6 to 36-20 according to the sound source group signal of the group 331 (Main) belonging to the music. Therefore, a sound source is generated simultaneously in the vehicle interior. Figure 13AThe sound field 130 of the telephone and the sound fields 112, 113 of the music are shown in the upper center.

[0112] Figure 17 Identification number (35) indicates that a sound source group signal is output from any of the following sound sources: Entertainment, TA (Traffic announcement), and Auto DJ, belonging to group 331 (Main) of music; a sound source group signal is output from any of the following sound sources: Normal-NAVI, Special-NAVI, and SPI-NAVI, belonging to group 332 (Mix1) of navigation; and a sound source group signal is output from any of the following sound sources: WL-TEL, WL-TEL RING, SPI-TEL, SPI-TELRING, APP-TEL, and APP-TEL RING, belonging to group 333 (Mix2) of telephone. At this time, loudspeaker 350 drives all of speakers 36-1 to 36-4, 36-6 to 36-20, except speaker 36-5 located in the center of the instrument panel, and does not drive speaker 36-5. The loudspeaker 350 drives the headrest speaker 36-4 according to the sound source group signal of the group 333 (Mix2) belonging to the telephone, drives the speakers 36-1 to 36-3 according to the sound source group signal of the group 332 (Mix1) belonging to the navigation, and drives the speakers 36-6 to 36-20 according to the sound source group signal of the group 331 (Main) belonging to the music. Figure 13B Shown in the upper right portion are the sound field 133 of the telephone, the sound field 120 of the navigation surrounding the sound field 133, and the sound fields 112, 113 of the music.

[0113] on the other hand, Figure 18 and Figure 19 The identification numbers (1), (8), (16) and (35) are respectively Figure 16 and Figure 17 The combination of the categories of the sound sources with the same identification numbers (1), (8), (16) and (35). However, Figure 18 and Figure 19 The sound field setting and Figure 16 and Figure 17 (Sound Bubble Mode = ALL) is that the sound field selection switch 212 is set to "FRONT" (Sound Bubble Mode = Front). Therefore, the other speakers 36-9 to 36-20 except for the speakers facing the front seats (FL, FR) among the multiple speakers 36-1 to 36-20 are not driven (Mute) regardless of the combination of categories. Figure 13A and Figure 13BAs shown in the lower part of FIG, sound fields 111, 112, 120, 130, 132, and 133 are formed in the vehicle interior when the sound field is selected for the front seat.

[0114] like Figures 16 to 19 As shown, loudspeaker 350 may also include a correspondence table that lists combinations of sound source group signal types, loudspeakers 360 to be driven, and the sound source group signals that drive each loudspeaker 36-1 through 36-20. Loudspeaker 350 can refer to the correspondence table to determine which loudspeakers 36-1 through 36-20 to drive and the sound source group signals that drive each loudspeaker 36-1 through 36-20. This simplifies control of loudspeakers 360 by loudspeaker 350.

[0115] As described above, according to the third embodiment, the following effects can be obtained. For example, Figure 13A The sound field 130 of the sound source of the group 333 (Mix2) belonging to the telephone when "Call path selection: Yes" is shown. Figure 13B The sound field 120 of the sound source of the group 332 (Mix1) belonging to the navigation is limited to the driver's seat, which is a part of the seats in the vehicle. In this way, when the sound field of the sound played from the sound source belonging to the first group is limited to a part of the seats in the vehicle (driver's seat), the loudspeaker 350 allocates the first sound source group signal output from the sound source belonging to the first group to the speaker facing the passenger in the driver's seat, and allocates the second sound source group signal output from the sound source belonging to the second group (for example, music) to the second speaker facing the passenger in other seats (front passenger seat and rear seats). Figures 16 to 19 As shown in the identification numbers (8), (16), and (35), the loudspeaker 350 uses the first sound source group signal and the second sound source group signal to simultaneously drive the first speaker and the second speaker. Figure 13A and Figure 13B As shown, the sound field for the sound played by the sound sources belonging to the first group and the sound field for the sound played by the sound sources belonging to the second group can be simultaneously formed, separated from each other. In other words, a sound field in which two different sounds can be heard can be formed simultaneously. The two sounds are not mixed, and each sound can be heard clearly in each sound field.

[0116] In such Figure 13B When the sound field 133 of the first sound source group signal and the sound field 120 of the second sound source group signal are each formed in an area including a passenger sitting in a specific seat (here, the driver's seat) in the vehicle interior as shown, Figure 17As shown in the identification number (35), the loudspeaker 350 assigns a high-priority first sound source group signal to the headrest speaker 36-4 close to the passenger's ear, and assigns a low-priority first sound source group signal to the speakers 36-1 to 36-3 away from the passenger's ear. In this way, when the sound fields of two sound sources of different groups facing a specific passenger compete with each other, the speakers to be assigned are assigned according to the distance from the passenger's ear. Speakers with different distances from the passenger's ear are assigned according to the priority order of the first sound source group signal and the second sound source group signal. Thus, as Figure 13B As shown, the sound fields 133 and 120 of the first and second sound source group signals can be formed in the area including the driver's seat, respectively. The passenger can listen to the sounds of the first and second sound source group signals according to the priority order.

[0117] When multiple sound source group signals (e.g., navigation and phone signals) are used to simultaneously drive multiple speakers 36-1 to 36-4 for a passenger seated in a specific seat in the vehicle (e.g., the driver), loudspeaker 350 assigns a high-priority sound source group signal (phone signal) to speaker 36-4, which is closer to the passenger's ear, and assigns a low-priority sound source group signal to speakers 36-1 to 36-3, which are farther from the passenger's ear. By assigning speakers at different distances from the passenger's ears based on the priority of the sound source group signals, the passenger can hear multiple sounds according to the priority of the sound source group signals.

[0118] The multiple speakers for passengers seated in specific seats within the vehicle interior include headrest speakers 36-4 and 36-9 attached to the headrest of the specific seat, and seat-specific speakers 36-1 through 36-3, 36-6 through 36-8 attached to the door closest to the specific seat, the dashboard on the specific seat's side, or the pillar on the specific seat's side. The loudspeaker assigns the sound source group signals output from the sound sources in group 331 (Mix2) for telephone calls to headrest speakers 36-4 and 36-9, while the loudspeaker assigns the sound source group signals output from the sound sources in group 332 (Mix1) for navigation calls to the seat-specific speakers. Because the sound from the telephone, which has a higher priority than the navigation call, can be played from headrest speaker 36-4, which is closer to the passenger's ear, loudspeaker 350 can appropriately drive speaker 360.

[0119] Although the third embodiment has been described above, it should not be understood that the description and drawings, which are part of this disclosure, limit the invention. Various alternative embodiments, examples, and application techniques will become apparent to those skilled in the art based on this disclosure.

[0120] For example, the sound source control device 340 may send a signal for identifying the sound source 330 that outputs each sound source group signal to the loudspeaker 350 instead of a signal for identifying the type of each sound source group signal. Figure 14 The table showing the correspondence between sound source 330 and its category determines the category of sound source 330 based on the signal identifying sound source 330. Therefore, loudspeaker 350 can determine which speakers to drive and the sound source group signal to drive each speaker based on the signal identifying the sound source and the signal indicating the sound field settings received from sound source control device 340. This simplifies control of loudspeaker 360 by loudspeaker 350.

[0121] like Figure 14 In the figure, the case where the sound source 330 is classified into any one of the group 331 (Main) for music, the group 332 (Mix1) for navigation, and the group 331 (Main) for phone calls is described. However, the sound source 330 may be classified into two groups or four or more groups.

[0122] In the third embodiment, loudspeaker 350 does not drive the speakers facing the areas within the vehicle interior where no sound field is formed. However, loudspeaker 350 may also drive the speakers facing the areas within the vehicle interior where no sound field is formed using an active noise cancellation signal with a phase opposite to that of the sound source group signal driving the other speakers. This allows the active noise cancellation signal to cancel out sound leakage from areas where a sound field is formed into areas where no sound field is formed, thereby enabling highly precise control of the outer edge of the sound field.

[0123] Description of Reference Numerals

[0124] 100: Sound field control device; 110~113, 120, 130~133: Sound field; 220: Layout diagram; 211: Start switch (information indicating the start or stop of the sound field control device); 221, 222, 223: Seats; 221: Driver's seat; 231~233: Sound source icon; 234: Ripple expansion animation; 235, 33N: Mute icon; 240: Sentence; 330: Sound source; 331: Music group; 332: Navigation group; 333: Phone group; 350: Loudspeaker; 351: Voice input; 360: Speaker; 36-1~36-3, 36-6~36-8: Speakers for specific seats; 36-4, 36-9: Headrest speakers; 400: Touch panel (display).

Claims

1. A sound field control method for a sound field control device that controls a sound field in an area where sound can be heard in a vehicle interior, wherein: displaying information indicating the current state of the sound field on a display disposed in the vehicle interior; accepting an operation of the sound field by an occupant of the vehicle, According to the operation to control the sound field, Information indicating the state of the sound field after the control is displayed on the display.

2. The sound field control method according to claim 1, wherein: The sound includes sounds played from multiple sound sources, The information indicating the state of the sound field includes information indicating a correspondence relationship between seats in the vehicle cabin and the group to which the sound source audible at the seats belongs.

3. The sound field control method according to claim 1 or 2, wherein: The information indicating the state of the sound field includes a floor plan indicating the arrangement of seats in the vehicle cabin, and sound source icons at the seats superimposed on the floor plan, the sound source icons indicating the group to which the sound source audible at the seat belongs.

4. The sound field control method according to claim 3, wherein: An animation of ripple expansion is displayed around the sound source icon of the group representing the sound currently playing.

5. The sound field control method according to any one of claims 1 to 4, wherein: The display is a touch panel that accepts touch operations on its screen by the occupant. In the sound field control method, a touch operation on the touch panel by an occupant of the vehicle is accepted.

6. The sound field control method according to any one of claims 1 to 5, wherein: Displaying information indicating whether the sound field control device is started or stopped on the display, accepting an operation for switching the start and stop of the sound field control device, According to the operation, the start and stop of the sound field control device are switched. Information indicating whether the sound field control device is activated or deactivated after the switching is displayed on the display.

7. The sound field control method according to any one of claims 1 to 6, wherein: A first sound field in which the sound can be heard at all seats in the vehicle interior and a second sound field in which the sound can be heard at the driver's seat and the front passenger seat in the vehicle interior but cannot be heard at the rear seats in the vehicle interior are displayed on the display in a switchable manner. receiving an operation performed by an occupant of the vehicle for switching between the first sound field and the second sound field, According to the operation, the first sound field and the second sound field are switched. Information indicating a state of the first sound field or the second sound field after switching is displayed on the display.

8. The sound field control method according to any one of claims 1 to 6, wherein: The first sound field in which the sound can be heard at all seats in the vehicle interior and the third sound field in which the sound can be heard at the driver's seat in the vehicle interior and cannot be heard at the passenger seat and rear seats in the vehicle interior are displayed on the display in a switchable manner. receiving an operation performed by an occupant of the vehicle for switching between the first sound field and the third sound field, According to the operation, the first sound field and the third sound field are switched. Information indicating a state of the first sound field or the third sound field after switching is displayed on the display.

9. The sound field control method according to any one of claims 1 to 8, wherein: Only when the sound field control device is in the activated state, an operation on the sound field by an occupant of the vehicle is accepted, and the sound field is controlled according to the operation.

10. The sound field control method according to claim 9, wherein: When the sound field control device is in an activated state, information indicating the state of the sound field is displayed in color, and when the sound field control device is in an inactivated state, information indicating the state of the sound field is displayed in gray.

11. The sound field control method according to claim 3, wherein: The information indicating the state of the sound field includes a mute icon superimposed on the seat in the floor plan, indicating that the sound field is not being formed.

12. The sound field control method according to any one of claims 1 to 11, wherein: The information indicating the state of the sound field includes a sentence describing a correspondence between seats in the vehicle cabin and groups to which sound sources audible at the seats belong.

13. The sound field control method according to claim 2, wherein: The groups include a group for music, a group for navigation, and a group for phone calls.

14. The sound field control method according to any one of claims 1 to 6, wherein: The sound includes sounds played from multiple sound sources, In the sound field control method, a fourth sound field that enables the sounds played from all sound sources to be heard at the driver's seat in the vehicle cabin and not to be heard at seats other than the driver's seat in the vehicle cabin, and is selectably displayed on the display; An operation for selecting the fourth sound field is received by the occupant.

15. The sound field control method according to any one of claims 1 to 14, wherein: The speech of the passenger sitting in the seat who cannot hear the sound broadcasted from the sound source of the telephone is collected. Based on the result of voice recognition of the content of the speech, the sound field is switched so that the voice can be heard at the seat that cannot hear the voice. Information indicating the state of the sound field after the switch is displayed on the display.

16. A sound field control device for controlling a sound field in an area where sound can be heard in a vehicle cabin, the sound field control device comprising: a display disposed in the vehicle interior and configured to display information indicating a state of the sound field; an input device for accepting an operation of the sound field by an occupant of the vehicle; and a control unit that controls the sound field according to an operation received by the input device, in, The display displays information indicating a state of the sound field controlled by the control unit.

Citation Information

Patent Citations

  • Acoustic processing device, acoustic processing method, and program

    JP2018170563A