[RESOLVED] Python error in version 0.100.0 - KeyboardInterrupt

Hi there,
I just upgraded to qunex container version 0.100.0, and whenever I run the container I get a python error of KeyboardInterrupt.
I use run_turnkey, after map_raw_data was done so steps start with import_dicom.

Call:

qunex_container run_turnkey    
 --rawdatainput="${RAW_DATA}"    
 --paramfile="${INPUT_BATCH_FILE}"   
 --mappingfile="${INPUT_MAPPING_FILE}"     
 --workingdir="${WORK_DIR}"   
 --projectname="${STUDY_NAME}"   
 --path="${WORK_DIR}/${STUDY_NAME}"   
 --sessions="${SESSIONS}"    
 --sessionsfolder="${STUDY_FOLDER}/sessions"    
 --turnkeytype="${RUNTURNKEY_TYPE}"    
 --container="${QUNEX_CONTAINER}"    
 --turnkeysteps="${RUNTURNKEY_STEPS}"    
 --parelements=3   
 --dockeropt="-v ${BIND_FOLDER}:${BIND_FOLDER}"

where

export QUNEX_CONTAINER="gitlab.qunex.yale.edu:5002/qunex/qunexcontainer:0.100.0"
export RUNTURNKEY_STEPS="import_dicom,create_session_info,setup_hcp,create_batch,hcp_pre_freesurfer,hcp_freesurfer,hcp_post_freesurfer,hcp_fmri_volume,hcp_fmri_surface"

Logs:

   Binary / Executable Locations and Versions
----------------------------------------------

    HCPpipelines TAG : v4.8.0-rc
 HCPpipelines commit : 62c6fff3f1e258746c5cc18890eef81a5cbb8696
      HCP ASL commit : 9e8b06c56b685c9a07cc91a839161704aede1d0d

         FSL Binary  :
         FSL Version : Binary not found!

  FreeSurfer Binary  :
  FreeSurfer Version : Binary not found!

        AFNI Binary  :
        AFNI Version : Binary not found!

        ANTs Binary  :
        ANTs Version : Binary not found!

    dcm2niix Binary  :
    dcm2niix Version : Binary not found!

         FIX Binary  :
         FIX Version : Binary not found!

      Octave Binary  :
      Octave Version : Binary not found!

           R Binary  :
  R Version : Binary not found!

      python binary  :
     python : Binary not found!

        PALM Binary  : /opt/palm/palm-o/palm.m
        PALM Version : Mar/2024 (github)

  wb_command Binary  :
  wb_command Version : Binary not found!

  Full Environment Paths
----------------------------------------------

  PATH : /opt/env/qunex/bin:/opt/miniconda/bin:/opt/fsl/fsl-6.0.7.11/condabin:/usr/local/cuda/bin:/opt/HCP/HCPpipelines/global/matlab:/opt/fsl/fix:/opt/qunex/bash/qx_utilities/diffusion_tractography_dense/autoptx_hcp_extended:/opt/qunex/bash/qx_utilities:/opt/qunex/bash/qx_utilities/diffusion_tractography_dense:/opt/qunex/bash/qx_utilities/diffusion_tractography/scripts:/opt/HCP/HCPpipelines/TaskfMRIAnalysis/scripts:/opt/HCP/HCPpipelines/global/scripts:/opt/HCP/HCPpipelines/DiffusionPreprocessing/scripts:/opt/HCP/HCPpipelines/tfMRI/scripts:/opt/HCP/HCPpipelines/fMRIVolume/scripts:/opt/HCP/HCPpipelines/fMRISurface/scripts:/opt/HCP/HCPpipelines/PostFreeSurfer/scripts:/opt/HCP/HCPpipelines/FreeSurfer/scripts:/opt/HCP/HCPpipelines/PreFreeSurfer/scripts:/opt/HCP/HCPpipelines/global/config:/opt/HCP/HCPpipelines/global/binaries:/opt/HCP/HCPpipelines/global/templates:/opt/gradunwarp/gradunwarp/gradunwarp/core:/opt/workbench/workbench/bin_linux64:/opt/HCP/HCPpipelines:/opt/HCP/HCPpipelines/MSMConfig:/opt/qunex/python/qx_utilities/templates:/opt/qunex/qx_library/data:/opt/qunex/qx_library/data/atlases/hcp:/opt/R/R:/opt/matlab/bin:/opt/octave/octave/bin:/opt/dcm2niix/dcm2niix:/opt/dcm2niix/dcm2niix/bin:/opt/ANTs/ANTs/bin:/opt/AFNI/AFNI:/opt/palm/palm-o:/opt/workbench/workbench/bin_linux64:/opt/freesurfer/FreeSurferScheduler:/opt/fsl/fsl/share/fsl/bin:/opt/freesurfer/freesurfer/bin:/opt/freesurfer/freesurfer/fsfast/bin:/opt/freesurfer/freesurfer/tktools:/opt/fsl/fsl/bin:/opt/fsl/fsl/share/fsl/bin:/opt/freesurfer/freesurfer/mni/bin:/opt/freesurfer/freesurfer:/opt/freesurfer/freesurfer/bin:/opt/freesurfer/freesurfer/mni/bin:/opt/qunex/lib:/opt/qunex/bin:/opt/bin:/opt/lib/bin:/opt/lib/lib:/opt/olib:/opt/qunex/python/qx_utilities:/opt:/usr/local/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/bin:/opt/fsl/fsl/bin:/opt/fsl/fsl/etc/matlab:/opt/fsl/fsl/lib

  MATLABPATH : /opt/qunex/matlab/qx_mice:/opt/qunex/matlab/qx_utilities/general:/opt/qunex/matlab/qx_mri/stats:/opt/qunex/matlab/qx_mri/img:/opt/qunex/matlab/qx_mri/general:/opt/qunex/matlab/qx_mri/fc:/opt/HCP/HCPpipelines/global/matlab:/opt/HCP/HCPpipelines/global/matlab/cifti-matlab:/opt/HCP/HCPpipelines/global/matlab/icaDim:/opt/HCP/HCPpipelines/global/matlab/nets_spectra:/opt/HCP/HCPpipelines/global/matlab:/opt/fsl/fix:/opt/qunex/qx_library/data/:/opt/qunex/qx_library/data/atlases/hcp:/opt/matlablib/cifti-matlab.qx:/opt/palm/palm-o:/opt/workbench/workbench/bin_linux64:/opt/fsl/fsl:/opt/fsl/fsl/bin:/opt/fsl/fsl/etc/matlab:


  ERROR: The following binaries / executables are not found: fsl freesurfer afni ants dcm2niix fix octave R python wb_command



  ---------------------------------------------------------------------

   ---> Executing specific QuNex turkey workflow steps:  import_dicom create_session_info setup_hcp create_batch hcp_pre_freesurfer hcp_freesurfer hcp_post_freesurfer hcp_fmri_volume hcp_fmri_surface

  ---------------------------------------------------------------------


 ---> RUNNING run_turnkey step ~~~ import_dicom


 -- Executed call:
    /opt/qunex/bin/qunex.sh import_dicom --sessionsfolder='/home/docker/volumes/hcppipelines/asaf_decoy_mouse/decoy/sessions' --sessions='035' --masterinbox='none' --archive='delete' --check='any' --unzip='yes' --add_image_type='' --add_json_info='' --gzip='folder' --overwrite='no'


 ........................ Running QuNex v0.100.0 [QX IO] ........................

OpenBLAS blas_thread_init: pthread_create failed for thread 1 of 40: Operation not permitted
OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
...
OpenBLAS blas_thread_init: pthread_create failed for thread 39 of 40: Operation not permitted
OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
Traceback (most recent call last):
  File "/opt/qunex/python/qx_utilities/gmri", line 20, in <module>
    from general import commands as gcom
  File "/opt/qunex/python/qx_utilities/general/commands.py", line 15, in <module>
    from general import dicom, bids, fourdfp, dicomdeid, fidl, qximg, img, nifti, palm, scheduler, utilities, meltmovfidl, commands_support, bruker, extensions
  File "/opt/qunex/python/qx_utilities/general/dicom.py", line 47, in <module>
    import general.nifti as gn
  File "/opt/qunex/python/qx_utilities/general/nifti.py", line 26, in <module>
    import numpy as np
  File "/opt/env/qunex/lib/python3.12/site-packages/numpy/__init__.py", line 130, in <module>
    from numpy.__config__ import show as show_config
  File "/opt/env/qunex/lib/python3.12/site-packages/numpy/__config__.py", line 4, in <module>
    from numpy.core._multiarray_umath import (
  File "/opt/env/qunex/lib/python3.12/site-packages/numpy/core/__init__.py", line 24, in <module>
    from . import multiarray
  File "/opt/env/qunex/lib/python3.12/site-packages/numpy/core/multiarray.py", line 10, in <module>
    from . import overrides
  File "/opt/env/qunex/lib/python3.12/site-packages/numpy/core/overrides.py", line 8, in <module>
    from numpy.core._multiarray_umath import (
  File "<frozen importlib._bootstrap>", line 463, in _lock_unlock_module
KeyboardInterrupt

Thank you in advance for your help,
Asaf

Hi Asaf,

There is something seriously wrong as QuNex is unable to find any of the tools it needs, see the many Binary not found! errors at the top of your log. To get to the bottom of this, let us try this:

# change this if needed
QUNEX_CONTAINER="gitlab.qunex.yale.edu:5002/qunex/qunexcontainer:0.100.0"

# enter the container interactively
docker run -it ${QUNEX_CONTAINER} bash

After running this, you should get a printout of the QuNex splash screen. We are now inside the container, we can check its status by running:

qunex_env_status

The printout should look something like this:

--------------------------------------------------------------
 QuNex Environment Status Report
--------------------------------------------------------------



   OS Version
----------------------------------------------

               PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
               NAME="Debian GNU/Linux"
               VERSION_ID="12"
               VERSION="12 (bookworm)"
               VERSION_CODENAME=bookworm
               ID=debian
               HOME_URL="https://www.debian.org/"
               SUPPORT_URL="https://www.debian.org/support"
               BUG_REPORT_URL="https://bugs.debian.org/"

   QuNex General Environment Variables
----------------------------------------------

                 QuNexVer : 0.100.0 [QX IO]
                    TOOLS : /opt
                QUNEXREPO : qunex
                QUNEXPATH : /opt/qunex
                 QUNEXENV : /opt/env/qunex
           TemplateFolder : /opt/qunex/qx_library/data/
            QUNEXMCOMMAND : octave -q --eval

   Core Dependencies Environment Variables
----------------------------------------------

                 CONDADIR : /opt/miniconda
                   FSLDIR : /opt/fsl/fsl
               FSLCONFDIR : /opt/fsl/fsl/config
                FSLBINDIR : /opt/fsl/fsl/bin
               FSL_FIXDIR : /opt/fsl/fix
          FREESURFER_HOME : /opt/freesurfer/freesurfer
     FREESURFER_SCHEDULER : /opt/freesurfer/FreeSurferScheduler
             WORKBENCHDIR : /opt/workbench/workbench/bin_linux64
                CARET7DIR : /opt/workbench/workbench/bin_linux64
                  AFNIDIR : /opt/AFNI/AFNI
                  ANTSDIR : /opt/ANTs/ANTs/bin
                DCMNIIDIR : /opt/dcm2niix/dcm2niix
                OCTAVEDIR : /opt/octave/octave
                MATLABDIR : /opt/matlab
             MATLABBINDIR : /opt/matlab/bin
                     RDIR : /opt/R/R
                  PALMDIR : /opt/palm/palm-o

   HCP Pipelines
----------------------------------------------

               HCPPIPEDIR : /opt/HCP/HCPpipelines
            GRADUNWARPDIR : /opt/gradunwarp/gradunwarp
     HCPPIPEDIR_Templates : /opt/HCP/HCPpipelines/global/templates
           HCPPIPEDIR_Bin : /opt/HCP/HCPpipelines/global/binaries
        HCPPIPEDIR_Config : /opt/HCP/HCPpipelines/global/config
         HCPPIPEDIR_PreFS : /opt/HCP/HCPpipelines/PreFreeSurfer/scripts
            HCPPIPEDIR_FS : /opt/HCP/HCPpipelines/FreeSurfer/scripts
        HCPPIPEDIR_PostFS : /opt/HCP/HCPpipelines/PostFreeSurfer/scripts
      HCPPIPEDIR_fMRISurf : /opt/HCP/HCPpipelines/fMRISurface/scripts
       HCPPIPEDIR_fMRIVol : /opt/HCP/HCPpipelines/fMRIVolume/scripts
         HCPPIPEDIR_tfMRI : /opt/HCP/HCPpipelines/tfMRI/scripts
          HCPPIPEDIR_dMRI : /opt/HCP/HCPpipelines/DiffusionPreprocessing/scripts
     HCPPIPEDIR_dMRITract : /opt/qunex/bash/qx_utilities/diffusion_tractography/scripts
        HCPPIPEDIR_Global : /opt/HCP/HCPpipelines/global/scripts
 HCPPIPEDIR_tfMRIAnalysis : /opt/HCP/HCPpipelines/TaskfMRIAnalysis/scripts
                MSMBINDIR : /opt/MSM_HOCR_v3
 HCPPIPEDIR_dMRITractFull : /opt/qunex/bash/qx_utilities/diffusion_tractography_dense
    HCPPIPEDIR_dMRILegacy : /opt/qunex/bash/qx_utilities
            AutoPtxFolder : /opt/qunex/bash/qx_utilities/diffusion_tractography_dense/autoptx_hcp_extended
                 EDDYCUDA : /opt/fsl/fsl/bin/eddy_cuda10.2
                   ASLDIR : /opt/HCP/hcp-asl


   Binary / Executable Locations and Versions
----------------------------------------------

    HCPpipelines TAG : v4.8.0-rc-62c6fff
 HCPpipelines commit : 62c6fff3f1e258746c5cc18890eef81a5cbb8696
      HCP ASL commit : 9e8b06c56b685c9a07cc91a839161704aede1d0d

         FSL Binary  : /opt/fsl/fsl/share/fsl/bin/fsl
         FSL Version : 6.0.7.11

  FreeSurfer Binary  : /opt/freesurfer/freesurfer/bin/freesurfer
  FreeSurfer Version :   freesurfer-Linux-centos6_x86_64-stable-pub-v6.0.0-2beb96c

        AFNI Binary  : /opt/AFNI/AFNI/afni
        AFNI Version : Precompiled binary linux_openmp_64: May 26 2024 (Version AFNI_24.1.14 'Publius Septimius Geta')

        ANTs Binary  : /opt/ANTs/ANTs/bin/antsRegistration
        ANTs Version : ANTs Version: 2.5.2-gf9a7b51

    dcm2niix Binary  : /opt/dcm2niix/dcm2niix/bin/dcm2niix
    dcm2niix Version : Chris Rorden's dcm2niiX version v1.0.20240202  (JP2:OpenJPEG) (JP-LS:CharLS) GCC12.2.0 x86-64 (64-bit Linux)

         FIX Binary  : /opt/fsl/fix/fix
         FIX Version : FIX (FMRIB's ICA-based Xnoiseifier) v1.06.15

      Octave Binary  : /usr/bin/octave
      Octave Version : 7.3.0

           R Binary  : /usr/bin/R
           R Version : R version 4.2.2 Patched (2022-11-10 r83330) -- "Innocent and Trusting"

      python binary  : /opt/env/qunex/bin/python
     python Version : Python 3.12.3

        PALM Binary  : /opt/palm/palm-o/palm.m
        PALM Version : Mar/2024 (github)

  wb_command Binary  : /opt/workbench/workbench/bin_linux64/wb_command
  wb_command Version : Version: 1.5.0

  Full Environment Paths
----------------------------------------------

  PATH : /opt/env/qunex/bin:/opt/miniconda/bin:/usr/local/cuda/bin:/opt/HCP/HCPpipelines/global/matlab:/opt/fsl/fix:/opt/qunex/bash/qx_utilities/diffusion_tractography_dense/autoptx_hcp_extended:/opt/qunex/bash/qx_utilities:/opt/qunex/bash/qx_utilities/diffusion_tractography_dense:/opt/qunex/bash/qx_utilities/diffusion_tractography/scripts:/opt/HCP/HCPpipelines/TaskfMRIAnalysis/scripts:/opt/HCP/HCPpipelines/global/scripts:/opt/HCP/HCPpipelines/DiffusionPreprocessing/scripts:/opt/HCP/HCPpipelines/tfMRI/scripts:/opt/HCP/HCPpipelines/fMRIVolume/scripts:/opt/HCP/HCPpipelines/fMRISurface/scripts:/opt/HCP/HCPpipelines/PostFreeSurfer/scripts:/opt/HCP/HCPpipelines/FreeSurfer/scripts:/opt/HCP/HCPpipelines/PreFreeSurfer/scripts:/opt/HCP/HCPpipelines/global/config:/opt/HCP/HCPpipelines/global/binaries:/opt/HCP/HCPpipelines/global/templates:/opt/gradunwarp/gradunwarp/gradunwarp/core:/opt/workbench/workbench/bin_linux64:/opt/HCP/HCPpipelines:/opt/HCP/HCPpipelines/MSMConfig:/opt/qunex/python/qx_utilities/templates:/opt/qunex/qx_library/data:/opt/qunex/qx_library/data/atlases/hcp:/opt/R/R:/opt/matlab/bin:/opt/octave/octave/bin:/opt/dcm2niix/dcm2niix:/opt/dcm2niix/dcm2niix/bin:/opt/ANTs/ANTs/bin:/opt/AFNI/AFNI:/opt/palm/palm-o:/opt/workbench/workbench/bin_linux64:/opt/freesurfer/FreeSurferScheduler:/opt/fsl/fsl/share/fsl/bin:/opt/freesurfer/freesurfer/bin:/opt/freesurfer/freesurfer/fsfast/bin:/opt/freesurfer/freesurfer/tktools:/opt/fsl/fsl/bin:/opt/fsl/fsl/share/fsl/bin:/opt/freesurfer/freesurfer/mni/bin:/opt/freesurfer/freesurfer:/opt/freesurfer/freesurfer/bin:/opt/freesurfer/freesurfer/mni/bin:/opt/qunex/lib:/opt/qunex/bin:/opt/bin:/opt/lib/bin:/opt/lib/lib:/opt/olib:/opt/qunex/python/qx_utilities:/opt:/usr/local/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/bin:/opt/fsl/fsl/bin:/opt/fsl/fsl/etc/matlab:/opt/fsl/fsl/lib

  MATLABPATH : /opt/qunex/matlab/qx_mice:/opt/qunex/matlab/qx_utilities/general:/opt/qunex/matlab/qx_mri/stats:/opt/qunex/matlab/qx_mri/img:/opt/qunex/matlab/qx_mri/general:/opt/qunex/matlab/qx_mri/fc:/opt/HCP/HCPpipelines/global/matlab:/opt/HCP/HCPpipelines/global/matlab/cifti-matlab:/opt/HCP/HCPpipelines/global/matlab/icaDim:/opt/HCP/HCPpipelines/global/matlab/nets_spectra:/opt/HCP/HCPpipelines/global/matlab:/opt/fsl/fix:/opt/qunex/qx_library/data/:/opt/qunex/qx_library/data/atlases/hcp:/opt/matlablib/cifti-matlab.qx:/opt/palm/palm-o:/opt/workbench/workbench/bin_linux64:/opt/fsl/fsl:/opt/fsl/fsl/bin:/opt/fsl/fsl/etc/matlab:


=================== QuNex environment set successfully! ====================

Now let us try doing the same with the qunex_container script:

qunex_container \
    --env_status \
    --container="${QUNEX_CONTAINER}"

You should get a similar printout as above. Let me know what you get.

Best, Jure

Hi Jure,
Thanks for such a quick response.

Inside the container I get the same status:

(qunex) [7db73f303815 qunex]$ qunex_env_status

--------------------------------------------------------------
 QuNex Environment Status Report
--------------------------------------------------------------



   OS Version
----------------------------------------------

               PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
               NAME="Debian GNU/Linux"
               VERSION_ID="12"
               VERSION="12 (bookworm)"
               VERSION_CODENAME=bookworm
               ID=debian
               HOME_URL="https://www.debian.org/"
               SUPPORT_URL="https://www.debian.org/support"
               BUG_REPORT_URL="https://bugs.debian.org/"

   QuNex General Environment Variables
----------------------------------------------

                 QuNexVer : 0.100.0 [QX IO]
                    TOOLS : /opt
                QUNEXREPO : qunex
                QUNEXPATH : /opt/qunex
                 QUNEXENV : /opt/env/qunex
           TemplateFolder : /opt/qunex/qx_library/data/
            QUNEXMCOMMAND : octave -q --eval

   Core Dependencies Environment Variables
----------------------------------------------

                 CONDADIR : /opt/miniconda
                   FSLDIR : /opt/fsl/fsl
               FSLCONFDIR : /opt/fsl/fsl/config
                FSLBINDIR : /opt/fsl/fsl/bin
               FSL_FIXDIR : /opt/fsl/fix
          FREESURFER_HOME : /opt/freesurfer/freesurfer
     FREESURFER_SCHEDULER : /opt/freesurfer/FreeSurferScheduler
             WORKBENCHDIR : /opt/workbench/workbench/bin_linux64
                CARET7DIR : /opt/workbench/workbench/bin_linux64
                  AFNIDIR : /opt/AFNI/AFNI
                  ANTSDIR : /opt/ANTs/ANTs/bin
                DCMNIIDIR : /opt/dcm2niix/dcm2niix
                OCTAVEDIR : /opt/octave/octave
                MATLABDIR : /opt/matlab
             MATLABBINDIR : /opt/matlab/bin
                     RDIR : /opt/R/R
                  PALMDIR : /opt/palm/palm-o

   HCP Pipelines
----------------------------------------------

               HCPPIPEDIR : /opt/HCP/HCPpipelines
            GRADUNWARPDIR : /opt/gradunwarp/gradunwarp
     HCPPIPEDIR_Templates : /opt/HCP/HCPpipelines/global/templates
           HCPPIPEDIR_Bin : /opt/HCP/HCPpipelines/global/binaries
        HCPPIPEDIR_Config : /opt/HCP/HCPpipelines/global/config
         HCPPIPEDIR_PreFS : /opt/HCP/HCPpipelines/PreFreeSurfer/scripts
            HCPPIPEDIR_FS : /opt/HCP/HCPpipelines/FreeSurfer/scripts
        HCPPIPEDIR_PostFS : /opt/HCP/HCPpipelines/PostFreeSurfer/scripts
      HCPPIPEDIR_fMRISurf : /opt/HCP/HCPpipelines/fMRISurface/scripts
       HCPPIPEDIR_fMRIVol : /opt/HCP/HCPpipelines/fMRIVolume/scripts
         HCPPIPEDIR_tfMRI : /opt/HCP/HCPpipelines/tfMRI/scripts
          HCPPIPEDIR_dMRI : /opt/HCP/HCPpipelines/DiffusionPreprocessing/scripts
     HCPPIPEDIR_dMRITract : /opt/qunex/bash/qx_utilities/diffusion_tractography/scripts
        HCPPIPEDIR_Global : /opt/HCP/HCPpipelines/global/scripts
 HCPPIPEDIR_tfMRIAnalysis : /opt/HCP/HCPpipelines/TaskfMRIAnalysis/scripts
                MSMBINDIR : /opt/MSM_HOCR_v3
 HCPPIPEDIR_dMRITractFull : /opt/qunex/bash/qx_utilities/diffusion_tractography_dense
    HCPPIPEDIR_dMRILegacy : /opt/qunex/bash/qx_utilities
            AutoPtxFolder : /opt/qunex/bash/qx_utilities/diffusion_tractography_dense/autoptx_hcp_extended
                 EDDYCUDA : /opt/fsl/fsl/bin/eddy_cuda10.2
                   ASLDIR : /opt/HCP/hcp-asl


   Binary / Executable Locations and Versions
----------------------------------------------

    HCPpipelines TAG : v4.8.0-rc
 HCPpipelines commit : 62c6fff3f1e258746c5cc18890eef81a5cbb8696
      HCP ASL commit : 9e8b06c56b685c9a07cc91a839161704aede1d0d

         FSL Binary  : 
         FSL Version : Binary not found!

  FreeSurfer Binary  : 
  FreeSurfer Version : Binary not found!

        AFNI Binary  : 
        AFNI Version : Binary not found!

        ANTs Binary  : 
        ANTs Version : Binary not found!

    dcm2niix Binary  : 
    dcm2niix Version : Binary not found!

         FIX Binary  : 
         FIX Version : Binary not found!

      Octave Binary  : 
      Octave Version : Binary not found!

           R Binary  : 
  R Version : Binary not found!

      python binary  : 
     python : Binary not found!

        PALM Binary  : /opt/palm/palm-o/palm.m
        PALM Version : Mar/2024 (github) 

  wb_command Binary  : 
  wb_command Version : Binary not found!

  Full Environment Paths
----------------------------------------------

  PATH : /opt/env/qunex/bin:/opt/miniconda/bin:/usr/local/cuda/bin:/opt/HCP/HCPpipelines/global/matlab:/opt/fsl/fix:/opt/qunex/bash/qx_utilities/diffusion_tractography_dense/autoptx_hcp_extended:/opt/qunex/bash/qx_utilities:/opt/qunex/bash/qx_utilities/diffusion_tractography_dense:/opt/qunex/bash/qx_utilities/diffusion_tractography/scripts:/opt/HCP/HCPpipelines/TaskfMRIAnalysis/scripts:/opt/HCP/HCPpipelines/global/scripts:/opt/HCP/HCPpipelines/DiffusionPreprocessing/scripts:/opt/HCP/HCPpipelines/tfMRI/scripts:/opt/HCP/HCPpipelines/fMRIVolume/scripts:/opt/HCP/HCPpipelines/fMRISurface/scripts:/opt/HCP/HCPpipelines/PostFreeSurfer/scripts:/opt/HCP/HCPpipelines/FreeSurfer/scripts:/opt/HCP/HCPpipelines/PreFreeSurfer/scripts:/opt/HCP/HCPpipelines/global/config:/opt/HCP/HCPpipelines/global/binaries:/opt/HCP/HCPpipelines/global/templates:/opt/gradunwarp/gradunwarp/gradunwarp/core:/opt/workbench/workbench/bin_linux64:/opt/HCP/HCPpipelines:/opt/HCP/HCPpipelines/MSMConfig:/opt/qunex/python/qx_utilities/templates:/opt/qunex/qx_library/data:/opt/qunex/qx_library/data/atlases/hcp:/opt/R/R:/opt/matlab/bin:/opt/octave/octave/bin:/opt/dcm2niix/dcm2niix:/opt/dcm2niix/dcm2niix/bin:/opt/ANTs/ANTs/bin:/opt/AFNI/AFNI:/opt/palm/palm-o:/opt/workbench/workbench/bin_linux64:/opt/freesurfer/FreeSurferScheduler:/opt/fsl/fsl/share/fsl/bin:/opt/freesurfer/freesurfer/bin:/opt/freesurfer/freesurfer/fsfast/bin:/opt/freesurfer/freesurfer/tktools:/opt/fsl/fsl/bin:/opt/fsl/fsl/share/fsl/bin:/opt/freesurfer/freesurfer/mni/bin:/opt/freesurfer/freesurfer:/opt/freesurfer/freesurfer/bin:/opt/freesurfer/freesurfer/mni/bin:/opt/qunex/lib:/opt/qunex/bin:/opt/bin:/opt/lib/bin:/opt/lib/lib:/opt/olib:/opt/qunex/python/qx_utilities:/opt:/usr/local/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/bin:/opt/fsl/fsl/bin:/opt/fsl/fsl/etc/matlab:/opt/fsl/fsl/lib

  MATLABPATH : /opt/qunex/matlab/qx_mice:/opt/qunex/matlab/qx_utilities/general:/opt/qunex/matlab/qx_mri/stats:/opt/qunex/matlab/qx_mri/img:/opt/qunex/matlab/qx_mri/general:/opt/qunex/matlab/qx_mri/fc:/opt/HCP/HCPpipelines/global/matlab:/opt/HCP/HCPpipelines/global/matlab/cifti-matlab:/opt/HCP/HCPpipelines/global/matlab/icaDim:/opt/HCP/HCPpipelines/global/matlab/nets_spectra:/opt/HCP/HCPpipelines/global/matlab:/opt/fsl/fix:/opt/qunex/qx_library/data/:/opt/qunex/qx_library/data/atlases/hcp:/opt/matlablib/cifti-matlab.qx:/opt/palm/palm-o:/opt/workbench/workbench/bin_linux64:/opt/fsl/fsl:/opt/fsl/fsl/bin:/opt/fsl/fsl/etc/matlab:


  ERROR: The following binaries / executables are not found: fsl freesurfer afni ants dcm2niix fix octave R python wb_command

with qunex_container:

(base) asaf@_:~$ qunex_container \
>     --env_status \
>     --container="gitlab.qunex.yale.edu:5002/qunex/qunexcontainer:0.100.0"
(base) asaf@_:~$ ---> unsetting the following environment variables: PATH MATLABPATH PYTHONPATH QUNEXVer TOOLS QUNEXREPO QUNEXPATH QUNEXEXTENSIONS QUNEXLIBRARY QUNEXLIBRARYETC TemplateFolder FSL_FIXDIR FREESURFERDIR FREESURFER_HOME FREESURFER_SCHEDULER FreeSurferSchedulerDIR WORKBENCHDIR DCMNIIDIR DICMNIIDIR MATLABDIR MATLABBINDIR OCTAVEDIR OCTAVEPKGDIR OCTAVEBINDIR RDIR HCPWBDIR AFNIDIR PYLIBDIR FSLDIR FSLBINDIR PALMDIR QUNEXMCOMMAND HCPPIPEDIR CARET7DIR GRADUNWARPDIR HCPPIPEDIR_Templates HCPPIPEDIR_Bin HCPPIPEDIR_Config HCPPIPEDIR_PreFS HCPPIPEDIR_FS HCPPIPEDIR_PostFS HCPPIPEDIR_fMRISurf HCPPIPEDIR_fMRIVol HCPPIPEDIR_tfMRI HCPPIPEDIR_dMRI HCPPIPEDIR_dMRITract HCPPIPEDIR_Global HCPPIPEDIR_tfMRIAnalysis HCPCIFTIRWDIR MSMBin HCPPIPEDIR_dMRITractFull HCPPIPEDIR_dMRILegacy AutoPtxFolder EDDYCUDA USEOCTAVE QUNEXENV CONDADIR MSMBINDIR MSMCONFIGDIR R_LIBS FSL_FIX_CIFTIRW FSFAST_HOME SUBJECTS_DIR MINC_BIN_DIR MNI_DIR MINC_LIB_DIR MNI_DATAPATH FSF_OUTPUT_FORMAT ANTSDIR CUDIMOT

========================================================================
Generated by QuNex
------------------------------------------------------------------------
Version: 0.100.0 [QX IO]
User: root
System: f8989c34feef
OS: Debian Linux #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023
------------------------------------------------------------------------

        ██████\                  ║      ██\   ██\                       
       ██  __██\                 ║      ███\  ██ |                      
       ██ /  ██ |██\   ██\       ║      ████\ ██ | ██████\ ██\   ██\    
       ██ |  ██ |██ |  ██ |      ║      ██ ██\██ |██  __██\\██\ ██  |
       ██ |  ██ |██ |  ██ |      ║      ██ \████ |████████ |\████  /    
       ██ ██\██ |██ |  ██ |      ║      ██ |\███ |██   ____|██  ██\     
       \██████ / \██████  |      ║      ██ | \██ |\███████\██  /\██\    
        \___███\  \______/       ║      \__|  \__| \_______\__/  \__|   
            \___|                ║                                      


                       DEVELOPED & MAINTAINED BY:

                    Anticevic Lab, Yale University
               Mind & Brain Lab, University of Ljubljana
                     Murray Lab, Dartmouth College

                      COPYRIGHT & LICENSE NOTICE:

Use of this software is subject to the terms and conditions defined in
QuNex LICENSES which can be found in the LICENSES folder of the QuNex
repository or at https://qunex.yale.edu/qunex-registration
========================================================================

---> Setting up Octave 


--------------------------------------------------------------
 QuNex Environment Status Report
--------------------------------------------------------------



   OS Version
----------------------------------------------

               PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
               NAME="Debian GNU/Linux"
               VERSION_ID="12"
               VERSION="12 (bookworm)"
               VERSION_CODENAME=bookworm
               ID=debian
               HOME_URL="https://www.debian.org/"
               SUPPORT_URL="https://www.debian.org/support"
               BUG_REPORT_URL="https://bugs.debian.org/"

   QuNex General Environment Variables
----------------------------------------------

                 QuNexVer : 0.100.0 [QX IO]
                    TOOLS : /opt
                QUNEXREPO : qunex
                QUNEXPATH : /opt/qunex
                 QUNEXENV : /opt/env/qunex
           TemplateFolder : /opt/qunex/qx_library/data/
            QUNEXMCOMMAND : octave -q --eval

   Core Dependencies Environment Variables
----------------------------------------------

                 CONDADIR : /opt/miniconda
                   FSLDIR : /opt/fsl/fsl
               FSLCONFDIR : /opt/fsl/fsl/config
                FSLBINDIR : /opt/fsl/fsl/bin
               FSL_FIXDIR : /opt/fsl/fix
          FREESURFER_HOME : /opt/freesurfer/freesurfer
     FREESURFER_SCHEDULER : /opt/freesurfer/FreeSurferScheduler
             WORKBENCHDIR : /opt/workbench/workbench/bin_linux64
                CARET7DIR : /opt/workbench/workbench/bin_linux64
                  AFNIDIR : /opt/AFNI/AFNI
                  ANTSDIR : /opt/ANTs/ANTs/bin
                DCMNIIDIR : /opt/dcm2niix/dcm2niix
                OCTAVEDIR : /opt/octave/octave
                MATLABDIR : /opt/matlab
             MATLABBINDIR : /opt/matlab/bin
                     RDIR : /opt/R/R
                  PALMDIR : /opt/palm/palm-o

   HCP Pipelines
----------------------------------------------

               HCPPIPEDIR : /opt/HCP/HCPpipelines
            GRADUNWARPDIR : /opt/gradunwarp/gradunwarp
     HCPPIPEDIR_Templates : /opt/HCP/HCPpipelines/global/templates
           HCPPIPEDIR_Bin : /opt/HCP/HCPpipelines/global/binaries
        HCPPIPEDIR_Config : /opt/HCP/HCPpipelines/global/config
         HCPPIPEDIR_PreFS : /opt/HCP/HCPpipelines/PreFreeSurfer/scripts
            HCPPIPEDIR_FS : /opt/HCP/HCPpipelines/FreeSurfer/scripts
        HCPPIPEDIR_PostFS : /opt/HCP/HCPpipelines/PostFreeSurfer/scripts
      HCPPIPEDIR_fMRISurf : /opt/HCP/HCPpipelines/fMRISurface/scripts
       HCPPIPEDIR_fMRIVol : /opt/HCP/HCPpipelines/fMRIVolume/scripts
         HCPPIPEDIR_tfMRI : /opt/HCP/HCPpipelines/tfMRI/scripts
          HCPPIPEDIR_dMRI : /opt/HCP/HCPpipelines/DiffusionPreprocessing/scripts
     HCPPIPEDIR_dMRITract : /opt/qunex/bash/qx_utilities/diffusion_tractography/scripts
        HCPPIPEDIR_Global : /opt/HCP/HCPpipelines/global/scripts
 HCPPIPEDIR_tfMRIAnalysis : /opt/HCP/HCPpipelines/TaskfMRIAnalysis/scripts
                MSMBINDIR : /opt/MSM_HOCR_v3
 HCPPIPEDIR_dMRITractFull : /opt/qunex/bash/qx_utilities/diffusion_tractography_dense
    HCPPIPEDIR_dMRILegacy : /opt/qunex/bash/qx_utilities
            AutoPtxFolder : /opt/qunex/bash/qx_utilities/diffusion_tractography_dense/autoptx_hcp_extended
                 EDDYCUDA : /opt/fsl/fsl/bin/eddy_cuda10.2
                   ASLDIR : /opt/HCP/hcp-asl


   Binary / Executable Locations and Versions
----------------------------------------------

    HCPpipelines TAG : v4.8.0-rc
 HCPpipelines commit : 62c6fff3f1e258746c5cc18890eef81a5cbb8696
      HCP ASL commit : 9e8b06c56b685c9a07cc91a839161704aede1d0d

         FSL Binary  : 
         FSL Version : Binary not found!

  FreeSurfer Binary  : 
  FreeSurfer Version : Binary not found!

        AFNI Binary  : 
        AFNI Version : Binary not found!

        ANTs Binary  : 
        ANTs Version : Binary not found!

    dcm2niix Binary  : 
    dcm2niix Version : Binary not found!

         FIX Binary  : 
         FIX Version : Binary not found!

      Octave Binary  : 
      Octave Version : Binary not found!

           R Binary  : 
  R Version : Binary not found!

      python binary  : 
     python : Binary not found!

        PALM Binary  : /opt/palm/palm-o/palm.m
        PALM Version : Mar/2024 (github) 

  wb_command Binary  : 
  wb_command Version : Binary not found!

  Full Environment Paths
----------------------------------------------

  PATH : /opt/env/qunex/bin:/opt/miniconda/bin:/opt/fsl/fsl-6.0.7.11/condabin:/usr/local/cuda/bin:/opt/HCP/HCPpipelines/global/matlab:/opt/fsl/fix:/opt/qunex/bash/qx_utilities/diffusion_tractography_dense/autoptx_hcp_extended:/opt/qunex/bash/qx_utilities:/opt/qunex/bash/qx_utilities/diffusion_tractography_dense:/opt/qunex/bash/qx_utilities/diffusion_tractography/scripts:/opt/HCP/HCPpipelines/TaskfMRIAnalysis/scripts:/opt/HCP/HCPpipelines/global/scripts:/opt/HCP/HCPpipelines/DiffusionPreprocessing/scripts:/opt/HCP/HCPpipelines/tfMRI/scripts:/opt/HCP/HCPpipelines/fMRIVolume/scripts:/opt/HCP/HCPpipelines/fMRISurface/scripts:/opt/HCP/HCPpipelines/PostFreeSurfer/scripts:/opt/HCP/HCPpipelines/FreeSurfer/scripts:/opt/HCP/HCPpipelines/PreFreeSurfer/scripts:/opt/HCP/HCPpipelines/global/config:/opt/HCP/HCPpipelines/global/binaries:/opt/HCP/HCPpipelines/global/templates:/opt/gradunwarp/gradunwarp/gradunwarp/core:/opt/workbench/workbench/bin_linux64:/opt/HCP/HCPpipelines:/opt/HCP/HCPpipelines/MSMConfig:/opt/qunex/python/qx_utilities/templates:/opt/qunex/qx_library/data:/opt/qunex/qx_library/data/atlases/hcp:/opt/R/R:/opt/matlab/bin:/opt/octave/octave/bin:/opt/dcm2niix/dcm2niix:/opt/dcm2niix/dcm2niix/bin:/opt/ANTs/ANTs/bin:/opt/AFNI/AFNI:/opt/palm/palm-o:/opt/workbench/workbench/bin_linux64:/opt/freesurfer/FreeSurferScheduler:/opt/fsl/fsl/share/fsl/bin:/opt/freesurfer/freesurfer/bin:/opt/freesurfer/freesurfer/fsfast/bin:/opt/freesurfer/freesurfer/tktools:/opt/fsl/fsl/bin:/opt/fsl/fsl/share/fsl/bin:/opt/freesurfer/freesurfer/mni/bin:/opt/freesurfer/freesurfer:/opt/freesurfer/freesurfer/bin:/opt/freesurfer/freesurfer/mni/bin:/opt/qunex/lib:/opt/qunex/bin:/opt/bin:/opt/lib/bin:/opt/lib/lib:/opt/olib:/opt/qunex/python/qx_utilities:/opt:/usr/local/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/bin:/opt/fsl/fsl/bin:/opt/fsl/fsl/etc/matlab:/opt/fsl/fsl/lib

  MATLABPATH : /opt/qunex/matlab/qx_mice:/opt/qunex/matlab/qx_utilities/general:/opt/qunex/matlab/qx_mri/stats:/opt/qunex/matlab/qx_mri/img:/opt/qunex/matlab/qx_mri/general:/opt/qunex/matlab/qx_mri/fc:/opt/HCP/HCPpipelines/global/matlab:/opt/HCP/HCPpipelines/global/matlab/cifti-matlab:/opt/HCP/HCPpipelines/global/matlab/icaDim:/opt/HCP/HCPpipelines/global/matlab/nets_spectra:/opt/HCP/HCPpipelines/global/matlab:/opt/fsl/fix:/opt/qunex/qx_library/data/:/opt/qunex/qx_library/data/atlases/hcp:/opt/matlablib/cifti-matlab.qx:/opt/palm/palm-o:/opt/workbench/workbench/bin_linux64:/opt/fsl/fsl:/opt/fsl/fsl/bin:/opt/fsl/fsl/etc/matlab:


  ERROR: The following binaries / executables are not found: fsl freesurfer afni ants dcm2niix fix octave R python wb_command

The first thing I would try is, I would delete the container. Start with typing

docker images

This will give you something like:

REPOSITORY                                        TAG       IMAGE ID       CREATED        SIZE
gitlab.qunex.yale.edu:5002/qunex/qunexcontainer   0.100.0   b08462011006   8 weeks ago    54.4GB
gitlab.qunex.yale.edu:5002/qunex/qunexcontainer   0.99.2d   ba89bab3bfea   6 months ago   56GB
bash                                              latest    9eb4e69a801b   6 months ago   14MB

Now you can delete a container by running:

docker image rm -f b08462011006

Replace the image id b08462011006 with the one in your list of images. Next, redownload the container from QuNex repostitory:

docker pull gitlab.qunex.yale.edu:5002/qunex/qunexcontainer:0.100.0

You can also try pulling 0.99.2d and see if the issues are present in there as well.

Unfortunately, I am unable to reproduce this on my end and none of our other users is reporting this (we have a lot of users that use the Docker container). So helping you out is a bit tricky.

Best, Jure

Thanks Jure

I deleted the container with docker image rm -f b08462011006
And then I also had to delete several stopped containers with docker ps -a | grep b08462011006, and deleting those too.
Only then I could re-download the container, but still the problem persists (“Binary not found”, etc.) Very odd.
I pulled 0.99.2d a while ago and it works fine, but I wanted to upgrade to 0.100.0.

I will update here if I manage to solve this issue. Of course if you have any more suggestions I will be more than happy to hear :slight_smile:

Thanks,
Asaf

I have no idea, seems like something weird with the system you are on. Please keep me posted if you manage to figure something out.

Is the size of the Docker container 54.4GB as listed above?

Can you maybe try Singularity instead of Docker?

Best, Jure

Hi Asaf,

Any updates regarding the issue you were having?

Best, Jure

Hi Jure,
Sorry for the late response.
First of all, I managed to download it to another machine, and the error did not replicate.

In my original server I couldn’t fix it yet. The size of the Docker container is indeed 54.4GB. I suppose some major cleaning of unused docker images would solve it, but I currently cannot perform them.
I haven’t tried Singularity yet.

As this seems to be a very specific condition, I suppose you can close this thread.

Thanks for your help,
Asaf