merge

python merge -h


usage: merge [-h] [-c CFG] [-t TAG] [-r] [--comment COMMENT] [-v] [--log LOG] [-f FILE] [-d DIR] [--skip SKIP]
                        [--limit LIMIT] [--validate] [--list OPT] [-n NAME] [-m MTD] [-l]
                        [MODE] [inputs ...]

Command line interface for merge_utils

options:
-h, --help         show this help message and exit
-c, --config CFG   a configuration file
-t, --tag TAG      tag to help identify this run
-r, --retry        retry a failed workflow requires tag
--comment COMMENT  a comment describing the workflow
-v, --verbose      print more verbose output (e.g. -vvv for debug output)
--log LOG          specify a custom log file path

input arguments:
MODE               input mode (query, dids, files, dir)
-f, --file FILE    a text file with a list of input files
-d, --dir DIR      a directory to add to search locations
--skip SKIP        skip a number of files before processing the remainder
--limit LIMIT      maximum number of files to process (after skip)
inputs             remaining command line inputs

output arguments:
--validate         only validate metadata instead of merging
--list OPT         list (dids, replicas, pfns) instead of merging
-n, --name NAME    specify a name for the output files
-m, --method MTD   explicitly specify the merge method to use
-l, --local        run merge locally instead of submitting to JustIN

Command line interface for merge_utils.

merge_utils.__main__.get_inputs(args: dict) None[source]

Collect the list of inputs from the command line, from standard input, or from files. If multiple sources are provided, this will give an error since it’s likely a mistake. If a single source is provided, it will override the config. Inputs from the config file(s) will be used if no other sources are provided.

Parameters:

args – command line arguments

Returns:

None (updates config.input.inputs in place)

merge_utils.__main__.get_parser() ArgumentParser[source]

Set up the command line argument parser.

merge_utils.__main__.main()[source]

Run a merge job

merge_utils.__main__.print_metadata(metadata, mode)[source]

Print info about the metadata for a list of files.

merge_utils.__main__.print_replicas(paths, mode)[source]

Print info about the replicas for a list of files.

merge_utils.__main__.resume_job(args: dict)[source]

Resume a previously started merge job with the given command line arguments.

merge_utils.__main__.start_job(args: dict)[source]

Start a new merge job with the given command line arguments.