Organized Pipeline Scripting
in Major Pipelines of Multiple Pipelines
in Major Pipelines of Multiple Pipelines
Here, you read the rules how you have to be build a major pipeline in a multiple pipeline very organized according to Majops.
Bash is the highway of a major pipeline:
First of all, what is very important, is that scripts, including the jobscipt maker, and programs of your major pipeline always have to be called from the programming language Bash. All programs and scripts are called from the Linux environment. The programming language for Linux is Bash. If you would call from a different environment, that would be insufficient. For example, If you would call your scripts and programs from Python, what actually happens, is that the Python environment is left and the environment changes to Bash. After that, the script or program is called and the environment changes back to the original environment of Python. This happens each time with every call. Because this is carried out many times, this slows down your single pipeline as you can imagine.
To prevent these problems, you always have to use a major highway bash script as starting point. This major highway bash script can be downloaded on the page of ...
Below in figure ..., you can see how this highway bash script actually works schematically.
HERE COMES A NEW PICTURE!!!
Figure ...: Overview of how a major pipeline in a multiple pipeline works according to Majops.
The highway of a major pipeline in a multiple pipeline according to Majops is always in the programming language Bash. From Bash, other scripts, including the jobscript maker, or programs are called.
Figure ...: Overview of how a major pipeline in a multiple pipeline works according to Majops.
The highway of a major pipeline in a multiple pipeline according to Majops is always in the programming language Bash. From Bash, other scripts, including the jobscript maker, or programs are called.
The overview in figure ... shows the highway of the major pipeline in the middle in the programming language Bash. On the left and on the right next to that highway, you see other processes that can be called from the highway. Each process is in a different programming language. There are many programming languages, but the most well known are put in this figure. You also see in the left down corner that other programs can be used as well instead of programming a new script of your own. N.B.: Always use an existing program, if a specific process in your major pipeline already exists in that program!