Majops Skeleton Scripts
for Minor Pipelines in Multiple Pipelines
for Minor Pipelines in Multiple Pipelines
If you would like to build a script for the minor pipelines of your multiple pipeline according to Majops, you always have to make use of one of Majops Skeleton Scripts. But it is not possible to use these directly now. They can only be used to see how their structures are. It is supposed that the scripts of the minor pipelines are created by the jobscript maker scripts of the major pipeline in your multiple pipeline.
There are 3 types of Majops Skeleton Scripts for the minor pipelines:
- Jobscript maker scripts
- Process scripts
- Highway bash script
Each type of Majops Skeleton Script will be explained below.
Jobscript maker scripts:
The jobscript maker scripts are the most important scripts and are used for creating the scripts for the minor pipelines that the major pipeline generates. The jobscript maker scripts are called from a highway bash script in the major pipeline and NOT in a minor pipeline. The jobscript maker scripts are in the programming languages Python2 and Python3. These are not in Bash or another language, because Python2 and Python3 are very fast in generating those scripts for the minor pipelines. In Python2 and Python3, it is possible to save a whole script at once, which increases the speed very much. Saving whole scripts at once are not possible in Bash.
Structure of a Majops Skeleton Jobscript Maker Script:
Each Majops Skeleton Jobscript Maker Script has the same structure for each programming language. Its structure could be divided in 8 parts:
- Imports of libraries
- Declarations of global variables
- The function/method showUsageInformation()
- The function getHeadersJobscript()
This function is only necessary for building the highway bash script of a minor pipeline. - The function makeNewJobscript()
- All the other functions/methods for the script itself
- The function main()
- Additional information of the script itself for:
- Remarks
- Descriptions how the script works
- Possible future improvements
The Majops Skeleton Jobscript Maker Scripts can be downloaded in the programming languages Python2 and Python3.
Click here to go to the download page for the Majops Skeleton Scripts for the minor pipelines.
Click here to go to the download page for the Majops Skeleton Scripts for the minor pipelines.
Process scripts:
Process scripts are used for processing the data in a minor pipeline. These process scripts will be called from the highway bash script. The process scripts are in several programming languages. The choice of which programming language is chosen depends on the task to be carried out in that process.
It is supposed that these process scripts can only be used indirectly. These should be created by 1 or more jobscript maker scripts.
It is supposed that these process scripts can only be used indirectly. These should be created by 1 or more jobscript maker scripts.
Structure of a Majops Skeleton Process Script:
Each Majops Skeleton Process Script has the same structure for each programming language. Its structure could be divided in 6 parts:
- Imports of libraries
- Declarations of global variables
- The function/method showUsageInformation()
- All the other functions/methods for the script itself
- The function main()
- Additional information of the script itself for:
- Remarks
- Descriptions how the script works
- Possible future improvements
The Majops Skeleton Process Scripts can be downloaded for several programming languages.
Click here to go to the download page for the Majops Skeleton Scripts for the minor pipelines.
Click here to go to the download page for the Majops Skeleton Scripts for the minor pipelines.
Highway bash script:
In the highway bash script, jobscript maker scripts, process scripts and/or normal programs are called after one another. The highway bash script can be called by a start bash script.
It is also possible that in a highway bash script another pipeline(s) is/are called.
It is supposed that the highway bash script can only be used indirectly. These should be created by 1 or more jobscript maker scripts.
Click here to go to the download page for the Majops Skeleton Scripts for the minor pipelines.
It is also possible that in a highway bash script another pipeline(s) is/are called.
It is supposed that the highway bash script can only be used indirectly. These should be created by 1 or more jobscript maker scripts.
Click here to go to the download page for the Majops Skeleton Scripts for the minor pipelines.