Program, information processing system, and information processing method

Abstract

To provide a program and the like allowing intuitive implementation of a signal processing system.SOLUTION: According to an aspect of the present invention, a program for implementing a signal processing system is provided. The program causes a computer to execute the following steps. A receiving step of receiving a plurality of input signals different from each other. A display control step of displaying a predetermined screen. The predetermined screen includes a list of pieces of visual information that can be viewed by a user. The visual information indicates a predetermined operation to be performed for the input signals, and the predetermined operation is selected as at least one of a plurality of candidates managed in advance or is set by being implemented through the program. The arrangement configuration of the visual information determines a signal processing system that outputs at least one output signal after the predetermined operation is executed.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a program, an information processing system, and an information processing method.

Background Art

[0002] As an example of signal processing, there is audio signal processing that handles signals including audio information. Patent Document 1 discloses an audio signal processing device and the like.

[0003] This audio signal processing device is an audio signal processing device that upmixes a stereo sound source to a surround sound source, and includes a separation unit that separates a stereo sound source into a direct sound and an indirect sound, a setting unit that generates a parameter for adjusting at least one of the direct sound or the indirect sound, a coefficient generation unit that generates a coefficient for multiplying the direct sound and the indirect sound for each channel in the surround sound source based on the parameter, and an arithmetic unit that upmixes the stereo sound source to the surround sound source by multiplying the direct sound and the indirect sound by the coefficient.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, the technology disclosed in Patent Document 1 is for engineers, and for example, researchers in the field of audio signal processing are not suitable for freely implementing a signal processing system. Not limited to audio signal processing, there is a need for a technology that allows researchers in the field of signal processing to more intuitively implement a signal processing system.

[0006] In view of the above circumstances, the present invention aims to provide a program or the like that can intuitively implement a signal processing system.

Means for Solving the Problems

[0007] According to one aspect of the present invention, a program for implementing a signal processing system is provided. This program causes a computer to execute the following steps. In the reception step, a plurality of different input signals are received. In the display control step, a predetermined screen is displayed. The predetermined screen includes a list of visual information that can be visually recognized by the user. The visual information indicates a predetermined operation performed on the input signal, and the predetermined operation is selected as at least one of a plurality of candidates managed in advance or set by being implemented via the program. Based on the arrangement configuration of the visual information, a signal processing system that outputs at least one output signal after the predetermined operation is performed is determined.

[0008] According to such an aspect, a signal processing system can be implemented intuitively.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Various characteristic matters shown in the following embodiments can be combined with each other.

[0011] Incidentally, the program for realizing the software appearing in this embodiment may be provided as a non-transitory computer-readable medium that can be read by a computer, may be provided so as to be downloadable from an external server, or may be provided so that the program is started on an external computer and its function is realized on a client terminal (so-called cloud computing).

[0012] Also, in this embodiment, the “section” may include, for example, a combination of hardware resources implemented by a circuit in a broad sense and information processing of software that can be specifically realized by these hardware resources. Also, in this embodiment, various types of information are handled, and these information are represented, for example, by physical values of signal values representing voltage and current, the high and low of signal values as a set of binary bits composed of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculation can be executed on a circuit in a broad sense.

[0013] In addition, a circuit in a broad sense is a circuit realized by appropriately combining at least a circuit, circuitry, a processor, a memory, etc. That is, it includes an application specific integrated circuit (ASIC), programmable logic devices (for example, a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0014] [Embodiment] 1. Hardware Configuration In this section, the hardware configuration of this embodiment will be described.

[0015] 1.1 Information Processing System 1 FIG. 1 is a configuration diagram showing an information processing system 1 according to this embodiment. In one example, the information processing system 1 includes an information processing apparatus 2, a plurality of sound sources 3, and a voice output device 4. The plurality of sound sources 3 are connected to the information processing apparatus 2 via a general-purpose or dedicated communication standard (which may be analog or digital). The voice output device 4 is connected to the information processing apparatus 2 via a general-purpose or dedicated communication standard (which may be analog or digital). Here, the system exemplified in the information processing system 1 is composed of one or more devices or components. Therefore, even the information processing apparatus 2 alone is included in the system exemplified in the information processing system 1. Hereinafter, each component included in the information processing system 1 will be further described.

[0016] 1.2 Information Processing Apparatus 2 FIG. 2 is a block diagram showing the hardware configuration of the information processing apparatus 2. The information processing apparatus 2 includes a communication unit 21, a storage unit 22, a control unit 23, a display unit 24, and an input unit 25, and these components are electrically connected via a communication bus 20 inside the information processing apparatus 2. Each component will be further described.

[0017] The communication unit 21 preferably uses wired communication means such as USB, IEEE1394, Thunderbolt (registered trademark), and wired LAN network communication. However, wireless LAN network communication, mobile communication such as 3G / LTE / 5G, and Bluetooth (registered trademark) communication may be included as needed. That is, it is more preferably implemented as a set of these multiple communication means. That is, the information processing apparatus 2 may communicate various information from the outside via the communication unit 21 and the communication network. Particularly preferably, the communication unit 21 is connected to a plurality of sound sources 3 and audio output devices 4 via a general-purpose or dedicated communication standard, respectively.

[0018] The storage unit 22 stores various information defined by the foregoing description. This can be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs related to the information processing apparatus 2 executed by the control unit 23, or as a memory such as a random access memory (RAM) that stores temporarily necessary information (arguments, arrays, etc.) related to program operations. The storage unit 22 stores various programs, variables, etc. related to the information processing apparatus 2 executed by the control unit 23.

[0019] The control unit 23 performs processing and control of the overall operation related to the information processing apparatus 2. The control unit 23 is, for example, a Central Processing Unit (CPU) not shown in the figure. By reading a predetermined program stored in the storage unit 22, the control unit 23 realizes various functions related to the information processing apparatus 2. That is, the information processing by software stored in the storage unit 22 is specifically realized by the control unit 23, which is an example of hardware, and can be executed as each functional unit included in the control unit 23. These will be described in more detail in the next section. Note that the control unit 23 is not limited to being single, and may be implemented to have a plurality of control units 23 for each function, or a combination thereof. That is, the control unit 23 is an example of a processor capable of executing a program for executing each step described later.

[0020] The display unit 24 may be included in the housing of the information processing apparatus 2, or may be externally attached. The display unit 24 displays a screen of a Graphical User Interface (GUI) operable by the user. This is preferably implemented by appropriately using display devices such as a CRT display, a liquid crystal display, an organic EL display, and a plasma display. In the case of an external attachment, the display unit 24 and the information processing apparatus 2 may be connected by a wired connection, or may be connected directly without wiring via wireless communication or satellite communication.

[0021] The input unit 25 may be included in the housing of the information processing apparatus 2, or may be externally attached. For example, the input unit 25 may be integrated with the display unit 24 and implemented as a touch panel. In the case of a touch panel, the user can input a tap operation, a swipe operation, etc. Of course, instead of the touch panel, a switch button, a mouse, a QWERTY keyboard, etc. may be adopted. That is, the input unit 25 receives an operation input made by the user. The input is transferred as a command signal to the control unit 23 via the communication bus 20, and the control unit 23 can execute predetermined control and calculation as necessary.

[0022] 1.3 Sound source 3 The sound source 3 is an example of a signal processing source. The sound source 3 is not particularly limited, and any device or configuration may be used as long as it can output a signal including voice information. In the embodiment shown in FIG. 1, as n sound sources 3, sound sources 3-1, 3-2, 3-3 ··· 3-n are connected to the information processing device 2. Preferably, these n sound sources 3 are configured to output signals including different voice information. These signals are respectively input to the information processing device 2 as input signals SGi.

[0023] 1.4 Voice output device 4 The voice output device 4 is configured to output an output signal SGo output via the signal processing system SS defined by the information processing device 2. The output method is not particularly limited, and physical voice may be output, or voice information may be sent to the outside by IP transmission. Thereby, the user can listen to the voice related to the output signal SGo. The voice output device 4 may be, for example, a speaker or headphones with a built-in amplifier. In FIG. 1, one voice output device 4 is included in the information processing system 1, but a plurality of voice output devices 4 may be included.

[0024] 2. Functional configuration Next, referring to FIG. 3, each functional configuration of the information processing apparatus 2 in the information processing system 1 will be described. FIG. 3 is a block diagram showing the functional configuration of the information processing apparatus 2 according to an embodiment. As shown in FIG. 3, the control unit 23 functions as a reception unit 231, an allocation unit 232, an arithmetic unit 233, a display control unit 234, and an output unit 235 by executing various programs stored in the storage unit 22. That is, information processing by software stored in the storage unit 22 is specifically realized by the control unit 23, which is an example of hardware, and can be executed as each functional unit included in the control unit 23. In other words, the information processing system 1 includes at least one processor (for example, the control unit 23), and the processor executes a program so as to function as the following respective units. From another perspective, the program causes the computer to execute each step executed by the information processing system 1. Each step corresponds to, for example, a reception step, an allocation step, an arithmetic step, a display control step, an output step, and the like.

[0025] The reception unit 231 is configured to receive various information as a reception step. Specifically, the reception unit 231 receives information via the communication unit 21 or the storage unit 22 and is configured to be able to read this into the work memory. Preferably, the reception unit 231 receives an input signal SGi, which is a signal output from the sound source 3.

[0026] In realizing the signal processing system SS defined by the program, the allocation unit 232 is configured to allocate the core of the processor as an allocation step.

[0027] The arithmetic unit 233 is configured to execute various arithmetic operations as an arithmetic step.

[0028] The display control unit 234 causes various information stored in the storage unit 22 to be displayed in a visually recognizable manner as a display control step. For example, the display control unit 234 may cause a screen or the like including various information to be displayed in a visually recognizable manner on the display unit 24. Thereby, various information is presented to various users who operate the information processing apparatus 2. Further, the display control unit 234 controls to cause visual information such as a screen, an image, an icon, and a message to be displayed on the display unit 24. The display control unit 234 may generate only rendering information for causing the visual information to be displayed on the display unit 24.

[0029] The output unit 235 is configured to output various information as an output step. Specifically, the output unit 235 outputs the output signal SGo to the audio output device 4.

[0030] 3. Flow of Processing In this section, with reference to the drawings, the flow of processing executed by the information processing system 1 will be described. Note that the order of processing can be changed as appropriate, a plurality of processes may be executed simultaneously, or some processes may be omitted.

[0031] 3.1 Overview FIG. 4 is a flowchart showing an overview of the processing executed by the information processing system 1. In such processing, first, the reception unit 231 receives a plurality of input signals SGi (step S001). Subsequently, the display control unit 234 causes a predetermined screen (for example, the screen 5 shown in FIG. 6) including visual information (for example, the second visual information IF2) to be displayed (step S002). Subsequently, the user freely implements the signal processing system SS by performing an operation on the predetermined screen being displayed (step S003), and the signal processing system SS is determined by the arrangement configuration of the visual information (step S004).

[0032] Summarizing the above, the program according to one embodiment is a program for implementing the signal processing system SS. This program causes a computer (for example, the information processing apparatus 2) to execute the following respective steps. In the reception step, a plurality of different input signals SGi are received. In the display control step, a predetermined screen (for example, the screen 5 shown in FIG. 6) is displayed. The predetermined screen includes a listable visual information (for example, the second visual information IF2) that can be visually recognized by the user. The visual information indicates a predetermined operation performed on the input signal SGi, and the predetermined operation is selected as at least one of a plurality of candidates managed in advance or set by being implemented via the program. The signal processing system SS that outputs at least one output signal after the predetermined operation is performed is determined by the arrangement configuration of the visual information. According to such an aspect, a program that can implement the signal processing system SS intuitively is provided.

[0033] 3.2 Specific Example FIG. 5 is an activity diagram showing a specific example of the processing executed by the information processing system 1. The specific example may be included within the scope defined in the above-mentioned outline. In the specific example, it is assumed that the signal processing system is a signal processing system for a signal including audio information, and a dedicated program for implementing the signal processing system SS for a signal including audio information is installed in the information processing apparatus 2. Also, it is assumed that the user is a researcher who wants to implement the signal processing system SS while trial-and-error for research purposes using the information processing apparatus 2. Hereinafter, a specific example of the processing will be described along each activity in FIG. 5.

[0034] First, a plurality of sound sources 3 are prepared by the user (activity A101). Specifically, a plurality of different sound sources 3 are connected to the communication unit 21 of the information processing apparatus 2. Subsequently, the program installed in the information processing apparatus 2 is activated by the user (activity A102). Subsequently, the display control unit 234 causes the display unit 24 to display a predetermined screen (here, the screen 5 shown in FIG. 6. The description of FIG. 6 will be given later.) as the display control step.

[0035] From here, the user implements the signal processing system SS using the UI of the program displayed as Screen 5. Specifically, the reception unit 231 receives, from the user, an input specifying one of the arithmetic blocks which is an example of the second visual information IF2. An arithmetic operation desired by the user will be associated with the specified arithmetic block. It is preferable that an example of the arithmetic operation is preset in the program in advance. The preset arithmetic operation may be, for example, a known filter such as a high-pass filter, a low-pass filter, a band-pass filter, a Butterworth filter, etc., which are frequently used by those skilled in the art. Therefore, by selecting one of the multiple arithmetic operation candidates from the preset list, an arithmetic operation is associated with the specified arithmetic block (Activity A104a).

[0036] On the other hand, when the desired arithmetic operation is not in the preset arithmetic operation list, the user can also implement a new arithmetic operation via the UI of the program by themselves. In such a case, the reception unit 231 receives, from the user, the description of the code for realizing the arithmetic operation as an input (Activity A104b).

[0037] In this way, the process in which the user specifies an arithmetic block and associates the desired arithmetic operation is repeated by the user.

[0038] Also, if necessary, the reception unit 231 may receive, from the user, operations such as moving, swapping, or duplicating of the arithmetic block (Activity A105).

[0039] In this way, through the program screen 5 and the user operations thereon, a signal processing system SS is determined to output some output signal SGo using the signal emitted from the sound source 3 as the input signal SGi. At this time, preferably, one core of a processor for performing operations in each arithmetic block may be assigned to each arithmetic block (activity A106). In other words, when operating the implemented signal processing system SS, as an assignment step, the assignment unit 232 assigns one core to each predetermined operation corresponding to the second visual information IF2. According to such an aspect, the real-time property essential for signal processing (preferably, audio signal processing) can be enhanced, and the processing performance according to the number of cores can be scalable extended. Of course, it is not limited to this, and appropriate core assignment may be performed on the program side so that preferable parallel processing is performed.

[0040] Specifically, based on the content of the algorithm of the signal processing system SS, the type of signal, and the number of channels, parallel processing for executing the algorithm may be optimally constructed. The algorithm does not include instructions regarding the data flow of the input from the outside of the target data itself and the output to the outside. Even in such a case, the arithmetic unit 233 sets up parallel threads corresponding to the number of channels of the signal and dedicated threads independent of the algorithm, and executes signal processing. More preferably, the data flow of each signal may be optimized. According to such an aspect, it is possible to handle a data flow in which signals of a plurality of channels are appropriately segmented, and realize signal processing with high real-time performance.

[0041] Thereafter, a test operation of the implemented signal processing system SS is performed via the screen 5 (activity A107). That is, the arithmetic unit 233 executes the algorithm of the signal processing system SS. This may be immediately performed, for example, by a debug button (not shown), or may be implemented to operate after compilation. That is, the output unit 235 outputs the result related to the signal processing system SS to the audio output device 4 as the output signal SGo.

[0042] Preferably, the arithmetic unit 233 may execute the algorithm without compilation based on at least one of the algorithm and the signal and preset reference information. The reference information is information regarding various input signals and the content of signal processing thereof, and preferable parallel processing, and may be rule-based information or a learned model in which the relationship between the two has been learned in advance. More preferably, the reference information may include a predetermined file including at least the number of signal channels. In such a case, preferably, the arithmetic unit 233 further reads out a predetermined file including the number of signal channels, creates parallel threads based on the predetermined file, and executes the algorithm. According to such an aspect, signal processing of one or more channels can be realized without recompiling the algorithm. More specifically, by preparing reference information corresponding to various algorithms and input signals, the algorithm and the signal can be imparted with functions to the information processing system 1 in the form of a plug-in, and can be realized without recompiling the algorithm itself.

[0043] Finally, due to the characteristic that the user performs trial and error for the purpose of experimental research, the operations after the activity A103 will be repeated. The above is the processing according to the specific example.

[0044] 4. Screen Example Subsequently, with reference to FIGS. 6 to 9, a screen example of the program according to one embodiment will be described. FIG. 6 shows a screen 5 of the program displayed on the display unit 24. As shown in FIG. 6, the screen 5 includes a region 51 and a region 52. The region 51 is a region where the first visual information IF1, the second visual information IF2, the third visual information IF3, and the fourth visual information IF4 are drawn. Preferably, as shown in the drawing, the first to third visual information IF1 to IF3 (an example of visual information) are drawn as block-type objects on a predetermined screen 5.

[0045] Specifically, the first visual information IF1 is an input block indicating the input signal SGi, the second visual information IF2 is an operation block indicating a predetermined operation performed on the input signal SGi as described above, and the third visual information IF3 is an output block indicating at least one output signal SGo after the predetermined operation is performed. By adopting such a simple UI, various signal processing systems SS can be implemented via the program. That is, a program is provided that can implement the signal processing system more intuitively.

[0046] On the other hand, the fourth visual information IF4 shows the waveform of the output signal SGo. In particular, when the user is a researcher, an environment where the waveform information is visible is important for trial and error in determining the signal processing system SS. Note that it is not limited to the output signal SGo, and the waveform of the input signal SGi may be shown, or the waveform of the result of the operation related to some operation blocks may be shown. In other words, the predetermined screen 5 further includes the fourth visual information IF4 indicating the waveform of the input signal SGi, the output signal SGo, or the signal related to the middle of the signal processing. According to such an aspect, since the user can confirm the waveform within the same screen, the signal processing system SS related to multi-audio (a plurality of input signals SGi) can be implemented more intuitively.

[0047] In addition, each of the first visual information IF1, the second visual information IF2, and the third visual information IF3 is drawn so that the corresponding relationship can be grasped with each other. For example, in FIG. 6, from the vertical positional relationship in the figure, the input block described as "i1" and the input block described as "i2" correspond to the output block described as "o1". Similarly, the input block described as "i3" and the input block described as "i4" correspond to the output block described as "o2". Regarding the operation blocks drawn therebetween, it is also clear from the positional relationship which input signal SGi related to which input block the operation is performed on. As shown in the figure, the blocks may be connected by line segments to enhance intuitiveness.

[0048] In other words, the second visual information IF2 is drawn in such a way that it is possible to grasp which first visual information IF1 it corresponds to. The third visual information IF3 is drawn in such a way that it is possible to grasp which first visual information IF1 and which second visual information IF2 it corresponds to. According to such an aspect, the relationship between each visual information can be easily grasped, and a signal processing system SS related to multi-audio (a plurality of input signals SGi) can be implemented more intuitively. Also, as shown in the figure, the correspondence relationships of the first to third visual information IF1 to IF3 are not limited to one-to-one, and may be one-to-many, many-to-one, or many-to-many. According to such an aspect, various signal processing systems SS can be implemented via the program.

[0049] Region 52 is a region for generating code that allows the user to implement the operations associated with the arithmetic blocks by themselves. That is, code CD related to the operation is drawn in region 52, and the user can implement a new operation that has not been preset while visually recognizing region 52. For example, the operation of the arithmetic block 53 included in region 51 may be realized by code CD. The computer language of code CD is not particularly limited, and preferably may be a language for signal processing such as Python, C / C++, R, Julia, etc., and among these, C / C++ is particularly preferred.

[0050] Subsequently, with reference to FIGS. 7 to 9, examples of operations that can be performed by the user will be described. FIGS. 7 to 9 show examples of operations of arithmetic blocks (an example of the second visual information IF2) on the screen 5.

[0051] (Association of operations) As shown in FIG. 7A, in the initial state, only the input block and the output block corresponding thereto are drawn. Here, the input blocks 61, 62 and the output blocks 81, 82 are drawn. Also, by placing the cursor CS of the computer (here, the information processing apparatus 2) on the blocks 63, 71, 72 indicated by the dotted line, new blocks can be created. For example, although not shown, when block 63 is specified, a new input block 63 may be generated.

[0052] Furthermore, for example, when the user places the cursor CS on the block 72 and the reception unit 231 receives a designation operation such as a click, a pop-up PU may be displayed as shown in FIG. 7B. The pop-up PU includes a list containing options such as "high-pass filter", "low-pass filter", "band-pass filter", "custom 1", and "custom 2", and an individual option of "compose code". By selecting a preset operation in the list, the user can set the block 72 as an operation block 72 associated with a predetermined operation.

[0053] On the other hand, by selecting the option of "compose code", an area 52 for implementing the code CD as shown in FIG. 6 may be displayed. "Custom 1" and "custom 2" in the list are those in which the operations by the code CD implemented by the user are stored in the storage unit 22. When the operation block 72 is determined, a dotted block 72a (an object for creating the operation block 72a) may be further drawn.

[0054] (Movement and Copy of Operation Block) The operation block may be configured to be movable by an operation by the user, for example, a drag-and-drop operation. For example, as shown in FIG. 8A, when the user places the cursor CS on the operation block 72 and drags and drops it as shown in FIG. 8B, the operation block can be changed to the operation block 71. That is, the operation block 72 applied to the input signal SGi input from the input block 62 can be changed to the operation block 71 applied to the input signal SGi input from the input block 61 by a simple operation. Although not shown, the positions of both may be easily interchanged by overlapping not the block shown by a dotted line but an already determined operation block.

[0055] Furthermore, the arithmetic block may be configured to be replicable by an operation by the user, such as a copy-and-paste operation. For example, as shown in FIG. 9A, when the user places the cursor CS on the arithmetic block 72 and copy-and-pastes it as shown in FIG. 9B, the arithmetic block 71 can be additionally generated. That is, while maintaining the arithmetic block 72 applied to the input signal SGi input from the input block 62, the arithmetic block 71 applied to the input signal SGi input from the input block 61 can be newly generated with a simple operation.

[0056] In other words, the second visual information IF2 is configured to be movable, replaceable, or replicable by an operation of the user. That is, by moving, replacing, or replicating, the signal processing system SS can be variably implemented. According to such an aspect, it is easy for the user to perform addition, modification, etc., and the signal processing system SS related to multi-audio (a plurality of input signals SGi) can be implemented more intuitively.

[0057] [Others] The above-described embodiments may be further devised as follows.

[0058] The information processing apparatus 2 may be configured to be connectable to other external devices through a network line. In such a case, without the user devising a special algorithm, signal processing with an optimized data flow regardless of the number of channels can be realized as a SaaS-type service.

[0059] The information processing apparatus 2 may be realized as a sound card specialized for audio processing or a dedicated computer including the same.

[0060] The foregoing signal processing is not limited to the audio signal processing as described in the specific examples, and may be any signal processing such as video signal processing, wireless communication, base station communication of mobile phones, signals including various meta-information, etc. That is, the outline according to one embodiment shows an aspect that can correspond to any signal processing. In such a case, it is preferable that the preset operations are adapted to various signal processes. For example, in the case of an operation block that handles both audio information and video information, it is preferable that the input signal SGi related to the audio information and the input signal SGi related to the video information are respectively input.

[0061] In one embodiment, the input signal SGi is acquired from the external sound source 3, but audio data or the like stored in advance in the storage unit 22 of the information processing apparatus 2 may be used as the input signal SGi. Of course, as described above, the audio signal processing is merely an example, and various data may be stored in the storage unit 22 as the input signal SGi. In such a case, the reception unit 231 receives the input signal SGi by reading the data stored in the storage unit 22.

[0062] The adoption of the block-type objects as the first visual information IF1, the second visual information IF2, and the third visual information IF3 is merely an example, and they may have any form. Each of the first visual information IF1, the second visual information IF2, and the third visual information IF3 may have a different form. They may be circular, elliptical, character icons, etc. In particular, the second visual information IF2 may have a different aspect for each associated operation. Also, the fourth visual information IF4 indicating a waveform may be omitted in some cases.

[0063] In one embodiment, the blocks corresponding to each other (such as the first to third visual information IF1 to IF3) are shown in a vertically arranged manner. However, a user interface may be adopted in which the blocks can be arranged at any position in the area 51, and the corresponding relationship is shown by connecting the arranged blocks with lines, arrows, etc.

[0064] In one embodiment, when the user wants to generate an operation by themselves, it was explained that the user can implement some operation via region 52. Instead of such an individual code generation screen, a code CD representing the entire signal processing system SS being implemented may be displayed. That is, various blocks (such as the first to third visual information IF1 to IF3, etc.) may be displayed in region 51 as the GUI mode, and the code CD of the signal processing system SS may also be configured to be visible together with or on a different screen. The user may generate or update various blocks displayed as the GUI mode by directly modifying the code representing the entire signal processing system SS. Also, when compilation of the code CD is necessary, it may be performed from the display screen of the code CD of the signal processing system SS.

[0065] Although the language for implementation is not particularly limited, for the core allocation, implementation using C / C++ is preferred. Further, in the implementation, a two-stage or three-stage configuration of a Python wrapper or a GUI wrapper may be used to balance both performance and usability well.

[0066] Furthermore, it may be provided in each of the aspects described below.

[0067] (1) A program for implementing a signal processing system, which causes a computer to execute the following steps: In the reception step, a plurality of different input signals are received respectively. In the display control step, a predetermined screen is displayed. Here, the predetermined screen includes a list of visual information visible to the user. The visual information indicates a predetermined operation performed on the input signal. The predetermined operation is selected as at least one of a plurality of pre-managed candidates or is set by being implemented via the program. The signal processing system that outputs at least one output signal after the predetermined operation is performed is determined by the arrangement configuration of the visual information.

[0068] According to such an aspect, a program is provided that can intuitively implement a signal processing system for a plurality of input signals.

[0069] (2) In the program according to (1) above, the visual information includes first to third visual information, the visual information indicating the predetermined operation is the second visual information, the first visual information indicates the input signal, and the third visual information indicates the output signal. Program.

[0070] According to such an aspect, the signal processing system can be implemented more intuitively.

[0071] (3) In the program according to (2) above, the second visual information is drawn so as to be able to grasp which of the first visual information it corresponds to, and the third visual information is drawn so as to be able to grasp which of the first visual information and which of the second visual information it corresponds to. Program.

[0072] According to such an aspect, the relationship between the visual information can be easily grasped, and the signal processing system can be implemented more intuitively.

[0073] (4) In the program according to (3) above, the correspondence relationship between the first to third visual information is one-to-many, many-to-one, or many-to-many. Program.

[0074] According to such an aspect, various signal processing systems can be implemented via the program.

[0075] (5) In the program according to any one of (2) to (4) above, the predetermined screen further includes fourth visual information indicating the waveform of the input signal, the output signal, or a signal related to the middle of signal processing. Program.

[0076] According to such an aspect, since the user can view the waveform within the same screen, the signal processing system can be implemented more intuitively.

[0077] (6) In the program according to any one of (1) to (5) above, the visual information is configured to be movable, replaceable, or duplicable by a user operation, and by performing the movement, replacement, or duplication, the signal processing system can be variably implemented.

[0078] According to such an aspect, it is easy for the user to perform addition, modification, etc., and the signal processing system can be implemented more intuitively.

[0079] (7) In the program according to any one of (1) to (6) above, the visual information is drawn as a block-type object on the predetermined screen.

[0080] According to such an aspect, various signal processing systems can be implemented via the program.

[0081] (8) In the program according to any one of (1) to (7) above, in the further allocation step, when operating the implemented signal processing system, for each of the predetermined operations corresponding to the visual information, one core is allocated one by one.

[0082] According to such an aspect, the real-time nature essential for signal processing can be enhanced, and the processing performance according to the number of cores can be scaled and extended.

[0083] (9) In the program according to any one of (1) to (8) above, the signal processing system is a signal processing system for a signal including audio information.

[0084] According to such an aspect, the signal processing system related to audio signal processing can be implemented more intuitively.

[0085] (10) An information processing system including at least one processor, wherein the processor is configured to execute the program such that each step of the program according to any one of (1) to (9) above is performed.

[0086] According to such an aspect, an information processing system is provided that can intuitively implement a signal processing system for a plurality of input signals.

[0087] (11) An information processing method comprising each step of the program according to any one of (1) to (9) above.

[0088] According to such an aspect, an information processing method is provided that can intuitively implement a signal processing system for a plurality of input signals. Of course, this is not the limit.

[0089] Finally, although various embodiments according to the present invention have been described, these are presented as examples and are not intended to limit the scope of the invention. The novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. Such embodiments and their modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and its equivalent scope.

Explanation of Reference Numerals

[0090] 1: Information processing system 2: Information processing device 20: Communication bus 21: Communication unit 22: Storage unit 23: Control unit 231: Reception unit 232: Allocation unit 233: Arithmetic unit 234: Display control unit 235: Output unit 24: Display unit 25: Input unit 3: Sound source 4: Voice output device 5: Screen 51: Area 52: Area 53: Calculation Block 61: Input Block 62: Input Block 63: Block (Input Block) 71: Block (Calculation Block) 72: Block (Calculation Block) 72a: Block (Calculation Block) 81: Output Block 82: Output Block CD: Code CS: Cursor IF1: First Visual Information IF2: Second Visual Information IF3: Third Visual Information IF4: Fourth Visual Information PU: Pop-up SGi: Input Signal SGo: Output Signal SS: Signal Processing System

Claims

1. A program for implementing a signal processing system, causing a computer to execute the following steps: In a reception step, a plurality of different input signals are received respectively, In a display control step, a predetermined screen is displayed, where the predetermined screen includes a list of visual information visible to the user, the visual information indicates a predetermined operation performed on the input signal, and the predetermined operation is selected as at least one of a plurality of pre-managed candidates or set by being implemented via the program, a program in which a signal processing system that outputs at least one output signal after the predetermined operation is performed is determined by the arrangement configuration of the visual information.

2. In the program according to Claim 1, the visual information includes first to third visual information, the visual information indicating the predetermined operation is the second visual information, the first visual information indicates the input signal, the third visual information indicates the output signal.

3. In the program according to Claim 2, the second visual information is drawn so as to be able to grasp which of the first visual information it corresponds to, the third visual information is drawn so as to be able to grasp which of the first visual information and which of the second visual information it corresponds to.

4. In the program according to Claim 3, the correspondence relationship among the first to third visual information is one-to-many, many-to-one, or many-to-many.

5. In the program according to Claim 2, the predetermined screen further includes fourth visual information indicating a waveform of the input signal, the output signal, or a signal related to the middle of signal processing.

6. In the program according to Claim 1, the visual information is configured to be movable, replaceable, or duplicable by a user's operation, a program in which the signal processing system can be variably implemented by performing the movement, replacement, or duplication.

7. In the program according to Claim 1, the visual information is drawn as a block-type object on the predetermined screen.

8. In the program according to Claim 1, further in an assignment step, when operating the implemented signal processing system, one core is assigned to each of the predetermined operations corresponding to the visual information.

9. In the program according to claim 1, The signal processing system is a program that is a signal processing system for a signal including audio information.

10. An information processing system comprising: At least one processor, wherein the processor is configured to execute the program such that each step of the program according to any one of claims 1 to 9 is performed.

11. An information processing method comprising: Each step of the program according to any one of claims 1 to 9.

Images