| 123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449 |
- WARNING: While bind mounting '/mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15:/mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15': destination is already in the mount point list
- [COMMAND] /opt/bin/run_clairs --tumor_bam_fn /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/CHAHA_diag_hs1.bam --normal_bam_fn /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/norm/CHAHA_norm_hs1.bam --ref_fn /home/t_steimle/ref/hs1/chm13v2.0.fa --threads 40 --platform ont_r10_dorado_sup_5khz_ssrs --output_dir /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15 --region chr17:1-28642702 --sample_name CHAHA_diag --include_all_ctgs --print_germline_calls --enable_indel_calling --enable_clair3_germline_output --use_longphase_for_intermediate_haplotagging True
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/logs
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/split_beds
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/candidates
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/pileup_tensor_can
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/fa_tensor_can
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/vcf_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/tmp_vcf_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/logs/clair3_log
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/phased_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/vcf
- [INFO] --include_all_ctgs enabled
- [INFO] Call variants in contigs: chr17
- [INFO] Number of chunks for each contig: 17
- [INFO] CALLER VERSION: 0.4.4
- [INFO] NORMAL BAM FILE PATH: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/norm/CHAHA_norm_hs1.bam
- [INFO] TUMOR BAM FILE PATH: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/CHAHA_diag_hs1.bam
- [INFO] REFERENCE FILE PATH: /home/t_steimle/ref/hs1/chm13v2.0.fa
- [INFO] PLATFORM: ont_r10_dorado_sup_5khz_ssrs
- [INFO] THREADS: 40
- [INFO] OUTPUT FOLDER: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15
- [INFO] OUTPUT VCF PATH: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/output.vcf.gz
- [INFO] PILEUP MODEL PATH: /opt/conda/envs/clairs/bin/clairs_models/ont_r10_dorado_sup_5khz_ssrs/pileup.pkl
- [INFO] FULL-ALIGNMENT MODEL PATH: /opt/conda/envs/clairs/bin/clairs_models/ont_r10_dorado_sup_5khz_ssrs/full_alignment.pkl
- [INFO] BED FILE PATH: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/region.bed
- [INFO] GENOTYPING MODE VCF FILE PATH: None
- [INFO] HYBRID MODE VCF FILE PATH: None
- [INFO] REGION FOR CALLING: chr17:1-28642702
- [INFO] CONTIGS FOR CALLING: None
- [INFO] CONDA BINARY PREFIX: /opt/conda/envs/clairs
- [INFO] SAMTOOLS BINARY PATH: samtools
- [INFO] PYTHON BINARY PATH: python3
- [INFO] PYPY BINARY PATH: pypy3
- [INFO] PARALLEL BINARY PATH: parallel
- [INFO] LONGPHASE BINARY PATH: /opt/conda/envs/clairs/bin/longphase
- [INFO] CHUNK SIZE: 5000000
- [INFO] SNV MINIMUM AF: 0.05
- [INFO] SNV MINIMUM QUAL: 8
- [INFO] INDEL MINIMUM AF: 0.1
- [INFO] INDEL PILEUP MODEL PATH: /opt/conda/envs/clairs/bin/clairs_models/ont_r10_dorado_sup_5khz_ssrs/indel/pileup.pkl
- [INFO] INDEL FULL-ALIGNMENT MODEL PATH: /opt/conda/envs/clairs/bin/clairs_models/ont_r10_dorado_sup_5khz_ssrs/indel/full_alignment.pkl
- [INFO] INDEL MINIMUM QUAL: 8
- [INFO] NORMAL VCF FILE PATH: None
- [INFO] DISABLE PHASING: False
- [INFO] ENABLE DRY RUN: False
- [INFO] ENABLE INDEL CALLING: True
- [INFO] ENABLE PRINTING REFERENCE CALLS: False
- [INFO] ENABLE PRINTING GERMLINE CALLS: True
- [INFO] ENABLE INCLUDING ALL CTGS FOR CALLING: True
- [INFO] ENABLE REMOVING INTERMEDIATE FILES: False
- [INFO] Call Germline Variants in Normal BAM using Clair3
- [INFO] RUN THE FOLLOWING COMMAND:
- ( /opt/conda/envs/clairs/bin/run_clair3.sh --bam_fn /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/norm/CHAHA_norm_hs1.bam --ref_fn /home/t_steimle/ref/hs1/chm13v2.0.fa --model_path /opt/conda/envs/clairs/bin/clairs_models/clair3_models/r1041_e82_400bps_sup_v420 --platform ont --threads 40 --output /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output --ctg_name=chr17 --samtools=samtools --pypy=pypy3 --python=python3 --min_coverage=4 --snp_min_af=0.08 --indel_min_af=0.15 --longphase_for_phasing ) 2>&1 | tee /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/logs/clair3_log/1_CLAIR3_NORMAL.log
- [INFO] CLAIR3 VERSION: v1.0.8
- [INFO] BAM FILE PATH: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/norm/CHAHA_norm_hs1.bam
- [INFO] REFERENCE FILE PATH: /home/t_steimle/ref/hs1/chm13v2.0.fa
- [INFO] MODEL PATH: /opt/conda/envs/clairs/bin/clairs_models/clair3_models/r1041_e82_400bps_sup_v420
- [INFO] OUTPUT FOLDER: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output
- [INFO] PLATFORM: ont
- [INFO] THREADS: 40
- [INFO] BED FILE PATH: EMPTY
- [INFO] VCF FILE PATH: EMPTY
- [INFO] CONTIGS: chr17
- [INFO] CONDA PREFIX:
- [INFO] SAMTOOLS PATH: samtools
- [INFO] PYTHON PATH: python3
- [INFO] PYPY PATH: pypy3
- [INFO] PARALLEL PATH: parallel
- [INFO] WHATSHAP PATH: whatshap
- [INFO] LONGPHASE PATH: /opt/conda/envs/clairs/bin/longphase
- [INFO] CHUNK SIZE: 5000000
- [INFO] FULL ALIGN PROPORTION: 0.7
- [INFO] FULL ALIGN REFERENCE PROPORTION: 0.1
- [INFO] PHASING PROPORTION: 0.7
- [INFO] MINIMUM MQ: 5
- [INFO] MINIMUM COVERAGE: 4
- [INFO] SNP AF THRESHOLD: 0.08
- [INFO] INDEL AF THRESHOLD: 0.15
- [INFO] BASE ERROR IN GVCF: 0.001
- [INFO] GQ BIN SIZE IN GVCF: 5
- [INFO] ENABLE FILEUP ONLY CALLING: False
- [INFO] ENABLE FAST MODE CALLING: False
- [INFO] ENABLE CALLING SNP CANDIDATES ONLY: False
- [INFO] ENABLE PRINTING REFERENCE CALLS: False
- [INFO] ENABLE OUTPUT GVCF: False
- [INFO] ENABLE HAPLOID PRECISE MODE: False
- [INFO] ENABLE HAPLOID SENSITIVE MODE: False
- [INFO] ENABLE INCLUDE ALL CTGS CALLING: False
- [INFO] ENABLE NO PHASING FOR FULL ALIGNMENT: False
- [INFO] ENABLE REMOVING INTERMEDIATE FILES: False
- [INFO] ENABLE LONGPHASE FOR INTERMEDIATE VCF PHASING: True
- [INFO] ENABLE PHASING FINAL VCF OUTPUT USING WHATSHAP: False
- [INFO] ENABLE PHASING FINAL VCF OUTPUT USING LONGPHASE: False
- [INFO] ENABLE HAPLOTAGGING FINAL BAM: False
- [INFO] ENABLE LONG INDEL CALLING: False
- [INFO] ENABLE C_IMPLEMENT: True
- + /opt/conda/envs/clairs/bin/scripts/clair3_c_impl.sh --bam_fn /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/norm/CHAHA_norm_hs1.bam --ref_fn /home/t_steimle/ref/hs1/chm13v2.0.fa --threads 40 --model_path /opt/conda/envs/clairs/bin/clairs_models/clair3_models/r1041_e82_400bps_sup_v420 --platform ont --output /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output --bed_fn=EMPTY --vcf_fn=EMPTY --ctg_name=chr17 --sample_name=SAMPLE --chunk_num=0 --chunk_size=5000000 --samtools=samtools --python=python3 --pypy=pypy3 --parallel=parallel --whatshap=whatshap --qual=2 --var_pct_full=0.7 --ref_pct_full=0.1 --var_pct_phasing=0.7 --snp_min_af=0.08 --indel_min_af=0.15 --min_mq=5 --min_coverage=4 --min_contig_size=0 --pileup_only=False --gvcf=False --base_err=0.001 --gq_bin_size=5 --fast_mode=False --call_snp_only=False --print_ref_calls=False --haploid_precise=False --haploid_sensitive=False --include_all_ctgs=False --no_phasing_for_fa=False --pileup_model_prefix=pileup --fa_model_prefix=full_alignment --remove_intermediate_dir=False --enable_phasing=False --enable_long_indel=False --keep_iupac_bases=False --use_gpu=False --longphase_for_phasing=True --longphase=/opt/conda/envs/clairs/bin/longphase --use_whatshap_for_intermediate_phasing=True --use_longphase_for_intermediate_phasing=True --use_whatshap_for_final_output_phasing=False --use_longphase_for_final_output_phasing=False --use_whatshap_for_final_output_haplotagging=False
- [INFO] Check environment variables
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/log
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/pileup_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/merge_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/phase_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/gvcf_tmp_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/full_alignment_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/phase_output/phase_vcf
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/phase_output/phase_bam
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/full_alignment_output/candidate_bed
- [INFO] Call variant in contigs: chr17
- [INFO] Chunk number for each contig: 17
- [INFO] 1/7 Call variants using pileup model
- Calling variants ...
- Total processed positions in chr17 (chunk 6/17) : 38596
- Total time elapsed: 95.29 s
- Calling variants ...
- Total processed positions in chr17 (chunk 5/17) : 61627
- Total time elapsed: 143.16 s
- Calling variants ...
- Total processed positions in chr17 (chunk 13/17) : 78825
- Total time elapsed: 173.07 s
- Calling variants ...
- Total processed positions in chr17 (chunk 3/17) : 85876
- Total time elapsed: 181.43 s
- Calling variants ...
- Total processed positions in chr17 (chunk 4/17) : 84539
- Total time elapsed: 181.84 s
- Calling variants ...
- Total processed positions in chr17 (chunk 14/17) : 81181
- Total time elapsed: 181.83 s
- Calling variants ...
- Total processed positions in chr17 (chunk 15/17) : 81543
- Total time elapsed: 182.32 s
- Calling variants ...
- Total processed positions in chr17 (chunk 10/17) : 83514
- Total time elapsed: 183.69 s
- Calling variants ...
- Total processed positions in chr17 (chunk 12/17) : 83512
- Total time elapsed: 187.00 s
- Calling variants ...
- Total processed positions in chr17 (chunk 8/17) : 83634
- Total time elapsed: 188.40 s
- Calling variants ...
- Total processed positions in chr17 (chunk 11/17) : 83228
- Total time elapsed: 188.88 s
- Calling variants ...
- Total processed positions in chr17 (chunk 16/17) : 93033
- Total time elapsed: 191.89 s
- Calling variants ...
- Total processed positions in chr17 (chunk 7/17) : 82191
- Total time elapsed: 194.59 s
- Calling variants ...
- Total processed positions in chr17 (chunk 9/17) : 92357
- Total time elapsed: 198.54 s
- Calling variants ...
- Total processed positions in chr17 (chunk 1/17) : 90481
- Total time elapsed: 201.20 s
- Calling variants ...
- Total processed positions in chr17 (chunk 2/17) : 89155
- Total time elapsed: 202.31 s
- Calling variants ...
- Total processed positions in chr17 (chunk 17/17) : 98267
- Total time elapsed: 214.09 s
- real 3m44.304s
- user 50m1.430s
- sys 2m26.943s
- [INFO] 2/7 Select heterozygous SNP variants for Whatshap phasing and haplotagging
- [INFO] Select heterozygous pileup variants exceeding phasing quality cutoff 15
- [INFO] Total heterozygous SNP positions selected: chr17: 53664
- real 0m2.855s
- user 0m2.653s
- sys 0m0.172s
- [INFO] 3/7 Phase VCF file using LongPhase
- LongPhase Ver 1.7
- --- File Parameter ---
- SNP File : /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/phase_output/phase_vcf/chr17.vcf
- SV File :
- MOD File :
- REF File : /home/t_steimle/ref/hs1/chm13v2.0.fa
- Output Prefix : /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/tmp/phase_output/phase_vcf/phased_chr17
- Generate Dot : False
- BAM File : /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/norm/CHAHA_norm_hs1.bam
- --- Phasing Parameter ---
- Seq Platform : ONT
- Phase Indel : False
- Distance Threshold : 300000
- Connect Adjacent : 20
- Edge Threshold : 0.7
- Mapping Quality : 1
- Variant Confidence : 0.75
- ReadTag Confidence : 0.65
- parsing VCF ... 0s
- parsing SV VCF ... 0s
- parsing Meth VCF ... 0s
- reading reference ... 1s
- (chr17,6s)
- parsing total: 6s
- merge results ... 0s
- writeResult SNP ... 1s
- total process: 8s
- real 0m8.006s
- user 0m26.299s
- sys 0m1.603s
- [INFO] 5/7 Select candidates for full-alignment calling
- [INFO] Set variants quality cutoff 19.0
- [INFO] Set reference calls quality cutoff 13.0
- [INFO] Low quality reference calls to be processed in chr17: 123647
- [INFO] Low quality variants to be processed in chr17: 107365
- real 0m3.208s
- user 0m2.830s
- sys 0m0.319s
- [INFO] 6/7 Call low-quality variants using full-alignment model
- Calling variants ...
- Total processed positions in chr17 (chunk 24/24) : 1012
- Total time elapsed: 15.71 s
- Calling variants ...
- Total processed positions in chr17 (chunk 16/24) : 10000
- Total time elapsed: 119.10 s
- Calling variants ...
- Total processed positions in chr17 (chunk 14/24) : 10000
- Total time elapsed: 121.61 s
- Calling variants ...
- Total processed positions in chr17 (chunk 19/24) : 10000
- Total time elapsed: 121.63 s
- Calling variants ...
- Total processed positions in chr17 (chunk 18/24) : 10000
- Total time elapsed: 121.65 s
- Calling variants ...
- Total processed positions in chr17 (chunk 6/24) : 10000
- Total time elapsed: 122.69 s
- Calling variants ...
- Total processed positions in chr17 (chunk 22/24) : 10000
- Total time elapsed: 123.51 s
- Calling variants ...
- Total processed positions in chr17 (chunk 21/24) : 10000
- Total time elapsed: 124.82 s
- Calling variants ...
- Total processed positions in chr17 (chunk 9/24) : 10000
- Total time elapsed: 125.01 s
- Calling variants ...
- Total processed positions in chr17 (chunk 4/24) : 10000
- Total time elapsed: 125.55 s
- Calling variants ...
- Total processed positions in chr17 (chunk 3/24) : 10000
- Total time elapsed: 126.30 s
- Calling variants ...
- Total processed positions in chr17 (chunk 12/24) : 10000
- Total time elapsed: 127.36 s
- Calling variants ...
- Total processed positions in chr17 (chunk 5/24) : 10000
- Total time elapsed: 127.54 s
- Calling variants ...
- Total processed positions in chr17 (chunk 10/24) : 10000
- Total time elapsed: 127.68 s
- Calling variants ...
- Total processed positions in chr17 (chunk 15/24) : 10000
- Total time elapsed: 128.53 s
- Calling variants ...
- Total processed positions in chr17 (chunk 20/24) : 10000
- Total time elapsed: 128.48 s
- Calling variants ...
- Total processed positions in chr17 (chunk 13/24) : 10000
- Total time elapsed: 130.01 s
- Calling variants ...
- Total processed positions in chr17 (chunk 11/24) : 10000
- Total time elapsed: 130.35 s
- Calling variants ...
- Total processed positions in chr17 (chunk 17/24) : 10000
- Total time elapsed: 129.08 s
- Calling variants ...
- Total processed positions in chr17 (chunk 2/24) : 10000
- Total time elapsed: 130.48 s
- Calling variants ...
- Total processed positions in chr17 (chunk 23/24) : 10000
- Total time elapsed: 131.76 s
- Calling variants ...
- Total processed positions in chr17 (chunk 7/24) : 10000
- Total time elapsed: 132.22 s
- Calling variants ...
- Total processed positions in chr17 (chunk 1/24) : 10000
- Total time elapsed: 133.61 s
- Calling variants ...
- Total processed positions in chr17 (chunk 8/24) : 10000
- Total time elapsed: 135.06 s
- real 2m19.593s
- user 47m42.523s
- sys 2m20.775s
- [INFO] 7/7 Merge pileup VCF and full-alignment VCF
- [INFO] Pileup variants processed in chr17: 46074
- [INFO] Full-alignment variants processed in chr17: 113883
- real 0m3.762s
- user 0m4.756s
- sys 0m0.345s
- [INFO] Finish calling, output file: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_normal_output/merge_output.vcf.gz
- real 6m41.397s
- user 98m39.308s
- sys 4m52.491s
- [INFO] Call Germline Variant in Tumor BAM using Clair3
- [INFO] RUN THE FOLLOWING COMMAND:
- ( /opt/conda/envs/clairs/bin/run_clair3.sh --bam_fn /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/CHAHA_diag_hs1.bam --ref_fn /home/t_steimle/ref/hs1/chm13v2.0.fa --model_path /opt/conda/envs/clairs/bin/clairs_models/clair3_models/r1041_e82_400bps_sup_v420 --platform ont --threads 40 --output /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output --ctg_name=chr17 --samtools=samtools --pypy=pypy3 --python=python3 --min_coverage=4 --snp_min_af=0.08 --indel_min_af=0.15 --longphase_for_phasing ) 2>&1 | tee /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/logs/clair3_log/2_CLAIR3_TUMOR.log
- [INFO] CLAIR3 VERSION: v1.0.8
- [INFO] BAM FILE PATH: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/CHAHA_diag_hs1.bam
- [INFO] REFERENCE FILE PATH: /home/t_steimle/ref/hs1/chm13v2.0.fa
- [INFO] MODEL PATH: /opt/conda/envs/clairs/bin/clairs_models/clair3_models/r1041_e82_400bps_sup_v420
- [INFO] OUTPUT FOLDER: /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output
- [INFO] PLATFORM: ont
- [INFO] THREADS: 40
- [INFO] BED FILE PATH: EMPTY
- [INFO] VCF FILE PATH: EMPTY
- [INFO] CONTIGS: chr17
- [INFO] CONDA PREFIX:
- [INFO] SAMTOOLS PATH: samtools
- [INFO] PYTHON PATH: python3
- [INFO] PYPY PATH: pypy3
- [INFO] PARALLEL PATH: parallel
- [INFO] WHATSHAP PATH: whatshap
- [INFO] LONGPHASE PATH: /opt/conda/envs/clairs/bin/longphase
- [INFO] CHUNK SIZE: 5000000
- [INFO] FULL ALIGN PROPORTION: 0.7
- [INFO] FULL ALIGN REFERENCE PROPORTION: 0.1
- [INFO] PHASING PROPORTION: 0.7
- [INFO] MINIMUM MQ: 5
- [INFO] MINIMUM COVERAGE: 4
- [INFO] SNP AF THRESHOLD: 0.08
- [INFO] INDEL AF THRESHOLD: 0.15
- [INFO] BASE ERROR IN GVCF: 0.001
- [INFO] GQ BIN SIZE IN GVCF: 5
- [INFO] ENABLE FILEUP ONLY CALLING: False
- [INFO] ENABLE FAST MODE CALLING: False
- [INFO] ENABLE CALLING SNP CANDIDATES ONLY: False
- [INFO] ENABLE PRINTING REFERENCE CALLS: False
- [INFO] ENABLE OUTPUT GVCF: False
- [INFO] ENABLE HAPLOID PRECISE MODE: False
- [INFO] ENABLE HAPLOID SENSITIVE MODE: False
- [INFO] ENABLE INCLUDE ALL CTGS CALLING: False
- [INFO] ENABLE NO PHASING FOR FULL ALIGNMENT: False
- [INFO] ENABLE REMOVING INTERMEDIATE FILES: False
- [INFO] ENABLE LONGPHASE FOR INTERMEDIATE VCF PHASING: True
- [INFO] ENABLE PHASING FINAL VCF OUTPUT USING WHATSHAP: False
- [INFO] ENABLE PHASING FINAL VCF OUTPUT USING LONGPHASE: False
- [INFO] ENABLE HAPLOTAGGING FINAL BAM: False
- [INFO] ENABLE LONG INDEL CALLING: False
- [INFO] ENABLE C_IMPLEMENT: True
- + /opt/conda/envs/clairs/bin/scripts/clair3_c_impl.sh --bam_fn /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/CHAHA_diag_hs1.bam --ref_fn /home/t_steimle/ref/hs1/chm13v2.0.fa --threads 40 --model_path /opt/conda/envs/clairs/bin/clairs_models/clair3_models/r1041_e82_400bps_sup_v420 --platform ont --output /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output --bed_fn=EMPTY --vcf_fn=EMPTY --ctg_name=chr17 --sample_name=SAMPLE --chunk_num=0 --chunk_size=5000000 --samtools=samtools --python=python3 --pypy=pypy3 --parallel=parallel --whatshap=whatshap --qual=2 --var_pct_full=0.7 --ref_pct_full=0.1 --var_pct_phasing=0.7 --snp_min_af=0.08 --indel_min_af=0.15 --min_mq=5 --min_coverage=4 --min_contig_size=0 --pileup_only=False --gvcf=False --base_err=0.001 --gq_bin_size=5 --fast_mode=False --call_snp_only=False --print_ref_calls=False --haploid_precise=False --haploid_sensitive=False --include_all_ctgs=False --no_phasing_for_fa=False --pileup_model_prefix=pileup --fa_model_prefix=full_alignment --remove_intermediate_dir=False --enable_phasing=False --enable_long_indel=False --keep_iupac_bases=False --use_gpu=False --longphase_for_phasing=True --longphase=/opt/conda/envs/clairs/bin/longphase --use_whatshap_for_intermediate_phasing=True --use_longphase_for_intermediate_phasing=True --use_whatshap_for_final_output_phasing=False --use_longphase_for_final_output_phasing=False --use_whatshap_for_final_output_haplotagging=False
- [INFO] Check environment variables
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output/log
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output/tmp/pileup_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output/tmp/merge_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output/tmp/phase_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output/tmp/gvcf_tmp_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output/tmp/full_alignment_output
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output/tmp/phase_output/phase_vcf
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output/tmp/phase_output/phase_bam
- [INFO] Create folder /mnt/beegfs02/scratch/t_steimle/data/wgs/CHAHA/diag/ClairS/part15/tmp/clair3_output/clair3_tumor_output/tmp/full_alignment_output/candidate_bed
- [INFO] Call variant in contigs: chr17
- [INFO] Chunk number for each contig: 17
- [INFO] 1/7 Call variants using pileup model
- Calling variants ...
- Total processed positions in chr17 (chunk 15/17) : 11069
- Total time elapsed: 73.46 s
- Calling variants ...
- Total processed positions in chr17 (chunk 11/17) : 10550
- Total time elapsed: 73.77 s
- Calling variants ...
- Total processed positions in chr17 (chunk 12/17) : 10782
- Total time elapsed: 74.56 s
- Calling variants ...
- Total processed positions in chr17 (chunk 10/17) : 11845
- Total time elapsed: 75.71 s
- Calling variants ...
- Total processed positions in chr17 (chunk 14/17) : 11398
- Total time elapsed: 75.65 s
- Calling variants ...
- Total processed positions in chr17 (chunk 7/17) : 12155
- Total time elapsed: 78.00 s
- Calling variants ...
- Total processed positions in chr17 (chunk 3/17) : 12437
- Total time elapsed: 78.22 s
- Calling variants ...
- Total processed positions in chr17 (chunk 2/17) : 13822
- Total time elapsed: 78.40 s
- Calling variants ...
- Total processed positions in chr17 (chunk 6/17) : 13099
- Total time elapsed: 78.92 s
- Calling variants ...
- Total processed positions in chr17 (chunk 8/17) : 13984
- Total time elapsed: 79.86 s
- Calling variants ...
- Total processed positions in chr17 (chunk 16/17) : 15105
- Total time elapsed: 81.61 s
- Calling variants ...
- Total processed positions in chr17 (chunk 4/17) : 13833
- Total time elapsed: 82.04 s
- Calling variants ...
- Total processed positions in chr17 (chunk 17/17) : 16957
- Total time elapsed: 82.85 s
- Calling variants ...
- Total processed positions in chr17 (chunk 1/17) : 18647
- Total time elapsed: 90.68 s
- Calling variants ...
- Total processed positions in chr17 (chunk 5/17) : 23171
- Total time elapsed: 93.07 s
- slurmstepd: error: *** JOB 2556293 ON n12 CANCELLED AT 2025-12-08T16:49:54 ***
- slurmstepd: error: Detected 2 oom_kill events in StepId=2556293.batch. Some of the step tasks have been OOM Killed.
- ----------------------------------------------
- | SLURM EPILOG |
- ----------------------------------------------
- Job ID: 2556293
- Cluster: flamingo
- User/Group: t_steimle/gs_hpc_biopath
- Nodelist: n12
- Nodes: 1
- Cores per node: 40
- Job started at: 2025-12-08 16:41:15
- Job ended at: 2025-12-08 16:49:54
- Job Wall-clock time: 00:08:39
- CPU Utilized: 02:04:09
- CPU Efficiency: 35.88% of 05:46:00 core-walltime
- Memory Utilized: 34.06 GB
- Memory Efficiency: 85.15% of 40.00 GB
|