[RESOLVED] HCP_msmall not finding rest BOLD runs

I’m trying the command “hcp_msmall” but I am having troubles in setting the parameter “–hcp_msmall_bolds”. I ran “hcp_icafix” at first using the multi-run HCP ICAFix that generated a concatenated file be named fMRI_CONCAT_ALL. When trying to run “hcp_msmall”, I used “–hcp_msmall_bolds=“rest”” but the dry run failed as it could not find the rest BOLD runs.

I then re-ran “hcp_icafix” using the parameter “–hcp_icafix_bolds=“CONCAT_REST:rest|CONCAT_STIM:auditory,intermingled,mechanical,simultaneous””, followed by “hcp_msmall” using “–hcp_msmall_bolds=“rest””, --hcp_msmall_bolds=“CONCAT_REST:rest” and --hcp_msmall_bolds=“CONCAT_REST” but they all failed the dry run.

I attached the batch file here that I am using. Any ideas on what is going wrong? Thank you.

batch_FM_gracely.txt (44.8 KB)

  1. Could you also attach the hcp_icafix and hcp_msmall runlogs and comlogs. Thanks!

  2. I assume that hcp_icafix finished successfully for both groups (CONCAT_REST and CONCAT_STIM)? If that is the case, can you try running:

qunex_container hcp_msmall \
...
  --hcp_icafix_bolds=CONCAT_STIM:bold3,bold1,bold2,bold4 \
  --hcp_msmall_bolds=bold5,bold6 \
...

Replace … with other required parameters (e.g. sessionsfolder, overwrite, container, etc.).

Here are the logs, sorry for the multiple files, I tried the commands in multiple ways.

I tried what you suggested, qunex still did not like it.

cn2107:~ moana004$ qunex_container hcp_msmall --batchfile="${study_sharedfolder}/processing/batch_FM_Gracely.txt" --sessionsfolder="${study_sharedfolder}/sessions" --parsessions="1" --hcp_icafix_bolds=CONCAT_STIM:bold3,bold1,bold2,bold4 --hcp_msmall_bolds="bold5,bold6" --test --bind="${study_sharedfolder}:/${study_sharedfolder}" --container="${HOME}/qunex/qunex_suite-0.94.7.sif"

--> QuNex will run the command over 1 sessions. It will utilize:

    Maximum sessions run in parallel for a job: 1.
    Maximum elements run in parallel for a session: 1.
    Up to 1 processes will be utilized for a job.

    Job #1 will run sessions: FM0007
cn2107:~ moana004$ --> unsetting the following environment variables: PATH MATLABPATH PYTHONPATH QUNEXVer TOOLS QUNEXREPO QUNEXPATH QUNEXLIBRARY QUNEXLIBRARYETC TemplateFolder FSL_FIXDIR FREESURFERDIR FREESURFER_HOME FREESURFER_SCHEDULER FreeSurferSchedulerDIR WORKBENCHDIR DCMNIIDIR DICMNIIDIR MATLABDIR MATLABBINDIR OCTAVEDIR OCTAVEPKGDIR OCTAVEBINDIR RDIR HCPWBDIR AFNIDIR ANTSDIR PYLIBDIR FSLDIR FSLGPUDIR PALMDIR QUNEXMCOMMAND HCPPIPEDIR CARET7DIR GRADUNWARPDIR HCPPIPEDIR_Templates HCPPIPEDIR_Bin HCPPIPEDIR_Config HCPPIPEDIR_PreFS HCPPIPEDIR_FS HCPPIPEDIR_PostFS HCPPIPEDIR_fMRISurf HCPPIPEDIR_fMRIVol HCPPIPEDIR_tfMRI HCPPIPEDIR_dMRI HCPPIPEDIR_dMRITract HCPPIPEDIR_Global HCPPIPEDIR_tfMRIAnalysis HCPCIFTIRWDIR MSMBin HCPPIPEDIR_dMRITractFull HCPPIPEDIR_dMRILegacy AutoPtxFolder FSL_GPU_SCRIPTS FSLGPUBinary EDDYCUDADIR USEOCTAVE QUNEXENV CONDADIR MSMBINDIR MSMCONFIGDIR R_LIBS FSL_FIX_CIFTIRW FSFAST_HOME SUBJECTS_DIR MINC_BIN_DIR MNI_DIR MINC_LIB_DIR MNI_DATAPATH FSF_OUTPUT_FORMAT
 
Generated by QuNex 
------------------------------------------------------------------------ 
Version: 0.94.7 
User: moana004 
System: cn2107 
OS: RedHat Linux #1 SMP Tue Jun 28 15:37:28 UTC 2022 
------------------------------------------------------------------------ 
 
        ██████\                  ║      ██\   ██\                        
       ██  __██\                 ║      ███\  ██ |                       
       ██ /  ██ |██\   ██\       ║      ████\ ██ | ██████\ ██\   ██\     
       ██ |  ██ |██ |  ██ |      ║      ██ ██\██ |██  __██\\██\ ██  | 
       ██ |  ██ |██ |  ██ |      ║      ██ \████ |████████ |\████  /     
       ██ ██\██ |██ |  ██ |      ║      ██ |\███ |██   ____|██  ██\      
       \██████ / \██████  |      ║      ██ | \██ |\███████\██  /\██\     
        \___███\  \______/       ║      \__|  \__| \_______\__/  \__|    
            \___|                ║                                       
 
 
                       DEVELOPED & MAINTAINED BY: 
 
                    Anticevic Lab, Yale University 
               Mind & Brain Lab, University of Ljubljana 
                     Murray Lab, Yale University 
 
                      COPYRIGHT & LICENSE NOTICE: 
 
Use of this software is subject to the terms and conditions defined in 
'LICENSES' which is a part of the QuNex Suite source code package: 
https://gitlab.qunex.yale.edu/qunex/qunex/-/tree/master/LICENSES 
 
 ---> Setting up Octave  


 ........................ Running QuNex v0.94.7 ........................ 


--- Full QuNex call for command: hcp_msmall 

gmri hcp_msmall --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" --parsessions="1" --hcp_icafix_bolds="CONCAT_STIM:bold3,bold1,bold2,bold4" --hcp_msmall_bolds="bold5,bold6" --test --batchfile="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" --sessions="FM0007" 

--------------------------------------------------------- 


WARNING: Parameter qx_cifti_tail was not specified. Its value was imputed from parameter hcp_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter qx_nifti_tail was not specified. Its value was imputed from parameter hcp_nifti_tail and set to ''!
WARNING: Parameter cifti_tail was not specified. Its value was imputed from parameter qx_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter nifti_tail was not specified. Its value was imputed from parameter qx_nifti_tail and set to ''!

# Generated by QuNex 0.94.7 on 2022-08-18_17.09.58.725798
#
=================================================================
gmri hcp_msmall \
  --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" \
  --parsessions="1" \
  --hcp_icafix_bolds="CONCAT_STIM:bold3,bold1,bold2,bold4" \
  --hcp_msmall_bolds="bold5,bold6" \
  --test="True" \
  --sessions="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" \
  --sessionids="FM0007" \
=================================================================

Running test on /home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt ...

---- Running local

Starting testing of sessions FM0007 at Thursday, 18. August 2022 17:09:58

------------------------------------------------------------
Session id: FM0007 
[started on Thursday, 18. August 2022 17:09:58]
Test running HCP MSMAll pipeline [LegacyStyleData] ...

Comparing bolds with those specifed via parameters
     ... skipping BOLD_1: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_2: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_3: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_4: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_5: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_6: it is not specified in hcp_icafix_bolds
     ... ERROR: bold3 specified in hcp_icafix_bolds but not found in bolds
     ... ERROR: bold1 specified in hcp_icafix_bolds but not found in bolds
     ... ERROR: bold2 specified in hcp_icafix_bolds but not found in bolds
     ... ERROR: bold4 specified in hcp_icafix_bolds but not found in bolds

Multi-run HCP ICAFix on 1 groups
---> ERROR: bold bold5 defined in hcp_msmall_bolds but not found in the used hcp_icafix_bolds!
---> ERROR: bold bold6 defined in hcp_msmall_bolds but not found in the used hcp_icafix_bolds!

ERROR in completing hcp_msmall:
     ... invalid input parameters!


HCP MSMAll test completed on Thursday, 18. August 2022 17:09:58
------------------------------------------------------------


===> Final report for command hcp_msmall
... FM0007 ---> HCP MSMAll failed
===> Success status not reported for some or all tasks

But this command seemed to get me a little closer but it spits out a python Traceback error. Please let me know your thoughts. Thanks.

cn2107:~ moana004$ qunex_container hcp_msmall --batchfile="${study_sharedfolder}/processing/batch_FM_Gracely.txt" --sessionsfolder="${study_sharedfolder}/sessions" --parsessions="1" --hcp_icafix_bolds="rest" --hcp_msmall_bolds="rest" --test --bind="${study_sharedfolder}:/${study_sharedfolder}" --container="${HOME}/qunex/qunex_suite-0.94.7.sif"

--> QuNex will run the command over 1 sessions. It will utilize:

    Maximum sessions run in parallel for a job: 1.
    Maximum elements run in parallel for a session: 1.
    Up to 1 processes will be utilized for a job.

    Job #1 will run sessions: FM0007
cn2107:~ moana004$ --> unsetting the following environment variables: PATH MATLABPATH PYTHONPATH QUNEXVer TOOLS QUNEXREPO QUNEXPATH QUNEXLIBRARY QUNEXLIBRARYETC TemplateFolder FSL_FIXDIR FREESURFERDIR FREESURFER_HOME FREESURFER_SCHEDULER FreeSurferSchedulerDIR WORKBENCHDIR DCMNIIDIR DICMNIIDIR MATLABDIR MATLABBINDIR OCTAVEDIR OCTAVEPKGDIR OCTAVEBINDIR RDIR HCPWBDIR AFNIDIR ANTSDIR PYLIBDIR FSLDIR FSLGPUDIR PALMDIR QUNEXMCOMMAND HCPPIPEDIR CARET7DIR GRADUNWARPDIR HCPPIPEDIR_Templates HCPPIPEDIR_Bin HCPPIPEDIR_Config HCPPIPEDIR_PreFS HCPPIPEDIR_FS HCPPIPEDIR_PostFS HCPPIPEDIR_fMRISurf HCPPIPEDIR_fMRIVol HCPPIPEDIR_tfMRI HCPPIPEDIR_dMRI HCPPIPEDIR_dMRITract HCPPIPEDIR_Global HCPPIPEDIR_tfMRIAnalysis HCPCIFTIRWDIR MSMBin HCPPIPEDIR_dMRITractFull HCPPIPEDIR_dMRILegacy AutoPtxFolder FSL_GPU_SCRIPTS FSLGPUBinary EDDYCUDADIR USEOCTAVE QUNEXENV CONDADIR MSMBINDIR MSMCONFIGDIR R_LIBS FSL_FIX_CIFTIRW FSFAST_HOME SUBJECTS_DIR MINC_BIN_DIR MNI_DIR MINC_LIB_DIR MNI_DATAPATH FSF_OUTPUT_FORMAT
 
Generated by QuNex 
------------------------------------------------------------------------ 
Version: 0.94.7 
User: moana004 
System: cn2107 
OS: RedHat Linux #1 SMP Tue Jun 28 15:37:28 UTC 2022 
------------------------------------------------------------------------ 
 
        ██████\                  ║      ██\   ██\                        
       ██  __██\                 ║      ███\  ██ |                       
       ██ /  ██ |██\   ██\       ║      ████\ ██ | ██████\ ██\   ██\     
       ██ |  ██ |██ |  ██ |      ║      ██ ██\██ |██  __██\\██\ ██  | 
       ██ |  ██ |██ |  ██ |      ║      ██ \████ |████████ |\████  /     
       ██ ██\██ |██ |  ██ |      ║      ██ |\███ |██   ____|██  ██\      
       \██████ / \██████  |      ║      ██ | \██ |\███████\██  /\██\     
        \___███\  \______/       ║      \__|  \__| \_______\__/  \__|    
            \___|                ║                                       
 
 
                       DEVELOPED & MAINTAINED BY: 
 
                    Anticevic Lab, Yale University 
               Mind & Brain Lab, University of Ljubljana 
                     Murray Lab, Yale University 
 
                      COPYRIGHT & LICENSE NOTICE: 
 
Use of this software is subject to the terms and conditions defined in 
'LICENSES' which is a part of the QuNex Suite source code package: 
https://gitlab.qunex.yale.edu/qunex/qunex/-/tree/master/LICENSES 
 
 ---> Setting up Octave  


 ........................ Running QuNex v0.94.7 ........................ 


--- Full QuNex call for command: hcp_msmall 

gmri hcp_msmall --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" --parsessions="1" --hcp_icafix_bolds="rest" --hcp_msmall_bolds="rest" --test --batchfile="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" --sessions="FM0007" 

--------------------------------------------------------- 


WARNING: Parameter qx_cifti_tail was not specified. Its value was imputed from parameter hcp_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter qx_nifti_tail was not specified. Its value was imputed from parameter hcp_nifti_tail and set to ''!
WARNING: Parameter cifti_tail was not specified. Its value was imputed from parameter qx_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter nifti_tail was not specified. Its value was imputed from parameter qx_nifti_tail and set to ''!

# Generated by QuNex 0.94.7 on 2022-08-18_17.11.21.443362
#
=================================================================
gmri hcp_msmall \
  --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" \
  --parsessions="1" \
  --hcp_icafix_bolds="rest" \
  --hcp_msmall_bolds="rest" \
  --test="True" \
  --sessions="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" \
  --sessionids="FM0007" \
=================================================================

Running test on /home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt ...

---- Running local

Starting testing of sessions FM0007 at Thursday, 18. August 2022 17:11:21

------------------------------------------------------------
Session id: FM0007 
[started on Thursday, 18. August 2022 17:11:21]
Test running HCP MSMAll pipeline [LegacyStyleData] ...

Comparing bolds with those specifed via parameters
     ... skipping BOLD_1: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_2: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_3: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_4: it is not specified in hcp_icafix_bolds

Single-run HCP ICAFix on 2 bolds

------------------------------------------------------------
---> Test processing MSMAll MSMAll_restBOLD-only
     ... bold image BOLD_5 present
     ... bold image BOLD_6 present

------------------------------------------------------------
Running HCP Pipelines command via QuNex:

/opt/HCP/HCPpipelines/MSMAll/MSMAllPipeline.sh
    --path="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp"
    --subject="FM0007"
    --fmri-names-list="rest"
    --multirun-fix-names=""
    --multirun-fix-concat-name=""
    --multirun-fix-names-to-use=""
    --output-fmri-name="MSMAll_restBOLD-only"
    --high-pass="0"
    --fmri-proc-string="_Atlas_hp0_clean"
    --msm-all-templates="/opt/HCP/HCPpipelines/global/templates/MSMAll"
    --output-registration-name="MSMAll_InitialReg"
    --high-res-mesh="164"
    --low-res-mesh="32"
    --input-registration-name="MSMSulc"
    --matlab-run-mode="0"
------------------------------------------------------------

 --- Failed during processing of bolds rest with error:
 Traceback (most recent call last):
  File "/opt/qunex/python/qx_utilities/hcp/process_hcp.py", line 5595, in executeHCPSingleMSMAll
    passed, _, r, failed = pc.checkRun(None, None, 'HCP MSMAll ' + outfmriname, r, overwrite=True)
  File "/opt/qunex/python/qx_utilities/processing/core.py", line 634, in checkRun
    log = open(logFile, 'r')
TypeError: expected str, bytes or os.PathLike object, not NoneType



HCP MSMAll test completed on Thursday, 18. August 2022 17:11:21
------------------------------------------------------------


===> Final report for command hcp_msmall
... FM0007 ---> HCP MSMAll: bolds rest failed
===> Not all tasks completed fully!

done_hcp_icafix_CONCAT_REST_FM0007_2022-08-17_15.09.35.684685.log (29.7 KB)
done_hcp_icafix_CONCAT_STIM_FM0007_2022-08-17_15.09.35.686729.log (46.9 KB)
done_hcp_icafix_fMRI_CONCAT_ALL_FM0007_2022-08-17_10.58.06.076675.log (67.6 KB)

done_hcp_post_fix_CONCAT_REST_FM0007_2022-08-17_15.34.30.633631.log (10.4 KB)
done_hcp_post_fix_CONCAT_STIM_FM0007_2022-08-17_15.51.40.093359.log (10.4 KB)
done_hcp_post_fix_fMRI_CONCAT_ALL_FM0007_2022-08-17_11.57.01.656013.log (10.7 KB)
Log-hcp_icafix-2022-08-17_10.57.29.856922.log (2.9 KB)
Log-hcp_icafix-2022-08-17_10.58.06.055518.log (4.0 KB)
Log-hcp_icafix-2022-08-17_15.08.56.047504.log (3.8 KB)
Log-hcp_icafix-2022-08-17_15.09.35.665844.log (5.9 KB)
Log-hcp_icafix-2022-08-18_12.26.35.907110.log (6.0 KB)
Log-hcp_msmall-2022-08-17_15.00.58.497053.log (1.4 KB)
Log-hcp_msmall-2022-08-17_17.25.09.420527.log (1.4 KB)
Log-hcp_msmall-2022-08-17_17.25.39.469377.log (1.4 KB)
Log-hcp_msmall-2022-08-17_17.26.37.924041.log (1.4 KB)
Log-hcp_msmall-2022-08-18_10.55.47.058801.log (1.4 KB)
Log-hcp_msmall-2022-08-18_10.56.01.315822.log (1.4 KB)
Log-hcp_msmall-2022-08-18_10.56.18.658258.log (1.4 KB)
Log-hcp_msmall-2022-08-18_13.35.49.933946.log (1.4 KB)
Log-hcp_msmall-2022-08-18_13.36.03.268417.log (1.4 KB)
Log-hcp_msmall-2022-08-18_13.36.16.753316.log (1.4 KB)
Log-hcp_msmall-2022-08-18_13.38.11.636257.log (1.6 KB)
Log-hcp_msmall-2022-08-18_13.41.33.610246.log (2.9 KB)
Log-hcp_msmall-2022-08-18_16.38.36.821337.log (2.2 KB)

Also, Matt Glasser suggested a while ago to use both rest and task runs for MSMAll: https://groups.google.com/a/humanconnectome.org/g/hcp-users/c/e3Eumbvy8hA/m/90fQHufWAwAJ

In the “hcp_msmall” command help, it is suggested to use only rest runs for its processing: hcp_msmall — QuNex documentation

  • –hcp_msmall_bolds (str, default detailed below) – A comma separated list that defines the bolds that will be used in the computation of the MSMAll registration. Typically, this should be limited to resting-state scans. Specified bolds have to be a subset of bolds used from the hcp_icafix_bolds parameter [if not specified all bolds specified in hcp_icafix_bolds will be used, which is probably NOT what you want to do if hcp_icafix_bolds includes non-resting-state scans].

Do you see any issues if I try to use the “fMRI_CONCAT_ALL” for both ica-fix and msmall commands?

HCP folks use QuNex for their ICAFix and MSMAll processing and the defaults were set based on their guidelines. I know that when we were testing and developing MSMAll we were usually specifying rest bolds as hcp_msmall_bolds. In the link you provided the user has only one rest bold, maybe this why Matt is suggesting to use non-rest bolds as well.

For the run, please try

qunex_container hcp_msmall \
...
  --hcp_icafix_bolds=CONCAT_STIM:BOLD_3,BOLD_1,BOLD_2,BOLD_4 \
  --hcp_msmall_bolds=BOLD_5,BOLD_6 \
...

It seems like this is the format that QuNex wants here (based on the skipping messages). I will investigate tomorrow why it wants bolds labeled like this. It should work with tags (rest, audio …) or with the names in the batch file, so something is off here. I will try to fix this and release a new version next week (together with bedpostx legacy support).

As for the group names (e.g., fMRI_CONCAT_ALL), the hcp_icafix_bolds parameter needs to match between the icafix and msmall calls, so that part is OK.

I tried the command you suggested, it still could not find BOLD_5 and BOLD_6.

cn2107:~ moana004$ qunex_container hcp_msmall --batchfile="${study_sharedfolder}/processing/batch_FM_Gracely.txt" --sessionsfolder="${study_sharedfolder}/sessions" --parsessions="1" --hcp_icafix_bolds=CONCAT_STIM:BOLD_3,BOLD_1,BOLD_2,BOLD_4 --hcp_msmall_bolds=BOLD_5,BOLD_6 --test --bind="${study_sharedfolder}:/${study_sharedfolder}" --container="${HOME}/qunex/qunex_suite-0.94.7.sif"

--> QuNex will run the command over 1 sessions. It will utilize:

    Maximum sessions run in parallel for a job: 1.
    Maximum elements run in parallel for a session: 1.
    Up to 1 processes will be utilized for a job.

    Job #1 will run sessions: FM0007
cn2107:~ moana004$ --> unsetting the following environment variables: PATH MATLABPATH PYTHONPATH QUNEXVer TOOLS QUNEXREPO QUNEXPATH QUNEXLIBRARY QUNEXLIBRARYETC TemplateFolder FSL_FIXDIR FREESURFERDIR FREESURFER_HOME FREESURFER_SCHEDULER FreeSurferSchedulerDIR WORKBENCHDIR DCMNIIDIR DICMNIIDIR MATLABDIR MATLABBINDIR OCTAVEDIR OCTAVEPKGDIR OCTAVEBINDIR RDIR HCPWBDIR AFNIDIR ANTSDIR PYLIBDIR FSLDIR FSLGPUDIR PALMDIR QUNEXMCOMMAND HCPPIPEDIR CARET7DIR GRADUNWARPDIR HCPPIPEDIR_Templates HCPPIPEDIR_Bin HCPPIPEDIR_Config HCPPIPEDIR_PreFS HCPPIPEDIR_FS HCPPIPEDIR_PostFS HCPPIPEDIR_fMRISurf HCPPIPEDIR_fMRIVol HCPPIPEDIR_tfMRI HCPPIPEDIR_dMRI HCPPIPEDIR_dMRITract HCPPIPEDIR_Global HCPPIPEDIR_tfMRIAnalysis HCPCIFTIRWDIR MSMBin HCPPIPEDIR_dMRITractFull HCPPIPEDIR_dMRILegacy AutoPtxFolder FSL_GPU_SCRIPTS FSLGPUBinary EDDYCUDADIR USEOCTAVE QUNEXENV CONDADIR MSMBINDIR MSMCONFIGDIR R_LIBS FSL_FIX_CIFTIRW FSFAST_HOME SUBJECTS_DIR MINC_BIN_DIR MNI_DIR MINC_LIB_DIR MNI_DATAPATH FSF_OUTPUT_FORMAT
 
Generated by QuNex 
------------------------------------------------------------------------ 
Version: 0.94.7 
User: moana004 
System: cn2107 
OS: RedHat Linux #1 SMP Tue Jun 28 15:37:28 UTC 2022 
------------------------------------------------------------------------ 
 
        ██████\                  ║      ██\   ██\                        
       ██  __██\                 ║      ███\  ██ |                       
       ██ /  ██ |██\   ██\       ║      ████\ ██ | ██████\ ██\   ██\     
       ██ |  ██ |██ |  ██ |      ║      ██ ██\██ |██  __██\\██\ ██  | 
       ██ |  ██ |██ |  ██ |      ║      ██ \████ |████████ |\████  /     
       ██ ██\██ |██ |  ██ |      ║      ██ |\███ |██   ____|██  ██\      
       \██████ / \██████  |      ║      ██ | \██ |\███████\██  /\██\     
        \___███\  \______/       ║      \__|  \__| \_______\__/  \__|    
            \___|                ║                                       
 
 
                       DEVELOPED & MAINTAINED BY: 
 
                    Anticevic Lab, Yale University 
               Mind & Brain Lab, University of Ljubljana 
                     Murray Lab, Yale University 
 
                      COPYRIGHT & LICENSE NOTICE: 
 
Use of this software is subject to the terms and conditions defined in 
'LICENSES' which is a part of the QuNex Suite source code package: 
https://gitlab.qunex.yale.edu/qunex/qunex/-/tree/master/LICENSES 
 
 ---> Setting up Octave  


 ........................ Running QuNex v0.94.7 ........................ 


--- Full QuNex call for command: hcp_msmall 

gmri hcp_msmall --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" --parsessions="1" --hcp_icafix_bolds="CONCAT_STIM:BOLD_3,BOLD_1,BOLD_2,BOLD_4" --hcp_msmall_bolds="BOLD_5,BOLD_6" --test --batchfile="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" --sessions="FM0007" 

--------------------------------------------------------- 


WARNING: Parameter qx_cifti_tail was not specified. Its value was imputed from parameter hcp_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter qx_nifti_tail was not specified. Its value was imputed from parameter hcp_nifti_tail and set to ''!
WARNING: Parameter cifti_tail was not specified. Its value was imputed from parameter qx_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter nifti_tail was not specified. Its value was imputed from parameter qx_nifti_tail and set to ''!

# Generated by QuNex 0.94.7 on 2022-08-19_10.17.02.650630
#
=================================================================
gmri hcp_msmall \
  --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" \
  --parsessions="1" \
  --hcp_icafix_bolds="CONCAT_STIM:BOLD_3,BOLD_1,BOLD_2,BOLD_4" \
  --hcp_msmall_bolds="BOLD_5,BOLD_6" \
  --test="True" \
  --sessions="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" \
  --sessionids="FM0007" \
=================================================================

Running test on /home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt ...

---- Running local

Starting testing of sessions FM0007 at Friday, 19. August 2022 10:17:02

------------------------------------------------------------
Session id: FM0007 
[started on Friday, 19. August 2022 10:17:02]
Test running HCP MSMAll pipeline [LegacyStyleData] ...

Comparing bolds with those specifed via parameters
     ... skipping BOLD_5: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_6: it is not specified in hcp_icafix_bolds

Multi-run HCP ICAFix on 1 groups
---> ERROR: bold BOLD_5 defined in hcp_msmall_bolds but not found in the used hcp_icafix_bolds!
---> ERROR: bold BOLD_6 defined in hcp_msmall_bolds but not found in the used hcp_icafix_bolds!

ERROR in completing hcp_msmall:
     ... invalid input parameters!


HCP MSMAll test completed on Friday, 19. August 2022 10:17:02
------------------------------------------------------------


===> Final report for command hcp_msmall
... FM0007 ---> HCP MSMAll failed
===> Success status not reported for some or all tasks

Then I tried specifying the rest runs in both parameters, than I got a Python error.

cn2107:~ moana004$ qunex_container hcp_msmall --batchfile="${study_sharedfolder}/processing/batch_FM_Gracely.txt" --sessionsfolder="${study_sharedfolder}/sessions" --parsessions="1" --hcp_icafix_bolds=CONCAT_REST:BOLD_5,BOLD_6 --hcp_msmall_bolds=BOLD_5,BOLD_6 --test --bind="${study_sharedfolder}:/${study_sharedfolder}" --container="${HOME}/qunex/qunex_suite-0.94.7.sif"

--> QuNex will run the command over 1 sessions. It will utilize:

    Maximum sessions run in parallel for a job: 1.
    Maximum elements run in parallel for a session: 1.
    Up to 1 processes will be utilized for a job.

    Job #1 will run sessions: FM0007
cn2107:~ moana004$ --> unsetting the following environment variables: PATH MATLABPATH PYTHONPATH QUNEXVer TOOLS QUNEXREPO QUNEXPATH QUNEXLIBRARY QUNEXLIBRARYETC TemplateFolder FSL_FIXDIR FREESURFERDIR FREESURFER_HOME FREESURFER_SCHEDULER FreeSurferSchedulerDIR WORKBENCHDIR DCMNIIDIR DICMNIIDIR MATLABDIR MATLABBINDIR OCTAVEDIR OCTAVEPKGDIR OCTAVEBINDIR RDIR HCPWBDIR AFNIDIR ANTSDIR PYLIBDIR FSLDIR FSLGPUDIR PALMDIR QUNEXMCOMMAND HCPPIPEDIR CARET7DIR GRADUNWARPDIR HCPPIPEDIR_Templates HCPPIPEDIR_Bin HCPPIPEDIR_Config HCPPIPEDIR_PreFS HCPPIPEDIR_FS HCPPIPEDIR_PostFS HCPPIPEDIR_fMRISurf HCPPIPEDIR_fMRIVol HCPPIPEDIR_tfMRI HCPPIPEDIR_dMRI HCPPIPEDIR_dMRITract HCPPIPEDIR_Global HCPPIPEDIR_tfMRIAnalysis HCPCIFTIRWDIR MSMBin HCPPIPEDIR_dMRITractFull HCPPIPEDIR_dMRILegacy AutoPtxFolder FSL_GPU_SCRIPTS FSLGPUBinary EDDYCUDADIR USEOCTAVE QUNEXENV CONDADIR MSMBINDIR MSMCONFIGDIR R_LIBS FSL_FIX_CIFTIRW FSFAST_HOME SUBJECTS_DIR MINC_BIN_DIR MNI_DIR MINC_LIB_DIR MNI_DATAPATH FSF_OUTPUT_FORMAT
 
Generated by QuNex 
------------------------------------------------------------------------ 
Version: 0.94.7 
User: moana004 
System: cn2107 
OS: RedHat Linux #1 SMP Tue Jun 28 15:37:28 UTC 2022 
------------------------------------------------------------------------ 
 
        ██████\                  ║      ██\   ██\                        
       ██  __██\                 ║      ███\  ██ |                       
       ██ /  ██ |██\   ██\       ║      ████\ ██ | ██████\ ██\   ██\     
       ██ |  ██ |██ |  ██ |      ║      ██ ██\██ |██  __██\\██\ ██  | 
       ██ |  ██ |██ |  ██ |      ║      ██ \████ |████████ |\████  /     
       ██ ██\██ |██ |  ██ |      ║      ██ |\███ |██   ____|██  ██\      
       \██████ / \██████  |      ║      ██ | \██ |\███████\██  /\██\     
        \___███\  \______/       ║      \__|  \__| \_______\__/  \__|    
            \___|                ║                                       
 
 
                       DEVELOPED & MAINTAINED BY: 
 
                    Anticevic Lab, Yale University 
               Mind & Brain Lab, University of Ljubljana 
                     Murray Lab, Yale University 
 
                      COPYRIGHT & LICENSE NOTICE: 
 
Use of this software is subject to the terms and conditions defined in 
'LICENSES' which is a part of the QuNex Suite source code package: 
https://gitlab.qunex.yale.edu/qunex/qunex/-/tree/master/LICENSES 
 
 ---> Setting up Octave  


 ........................ Running QuNex v0.94.7 ........................ 


--- Full QuNex call for command: hcp_msmall 

gmri hcp_msmall --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" --parsessions="1" --hcp_icafix_bolds="CONCAT_REST:BOLD_5,BOLD_6" --hcp_msmall_bolds="BOLD_5,BOLD_6" --test --batchfile="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" --sessions="FM0007" 

--------------------------------------------------------- 


WARNING: Parameter qx_cifti_tail was not specified. Its value was imputed from parameter hcp_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter qx_nifti_tail was not specified. Its value was imputed from parameter hcp_nifti_tail and set to ''!
WARNING: Parameter cifti_tail was not specified. Its value was imputed from parameter qx_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter nifti_tail was not specified. Its value was imputed from parameter qx_nifti_tail and set to ''!

# Generated by QuNex 0.94.7 on 2022-08-19_10.17.58.863302
#
=================================================================
gmri hcp_msmall \
  --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" \
  --parsessions="1" \
  --hcp_icafix_bolds="CONCAT_REST:BOLD_5,BOLD_6" \
  --hcp_msmall_bolds="BOLD_5,BOLD_6" \
  --test="True" \
  --sessions="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" \
  --sessionids="FM0007" \
=================================================================

Running test on /home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt ...

---- Running local

Starting testing of sessions FM0007 at Friday, 19. August 2022 10:17:58

------------------------------------------------------------
Session id: FM0007 
[started on Friday, 19. August 2022 10:17:58]
Test running HCP MSMAll pipeline [LegacyStyleData] ...

Comparing bolds with those specifed via parameters
     ... skipping BOLD_1: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_2: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_3: it is not specified in hcp_icafix_bolds
     ... skipping BOLD_4: it is not specified in hcp_icafix_bolds

Multi-run HCP ICAFix on 1 groups

------------------------------------------------------------
---> Test processing MSMAll MSMAll_restBOLD-only
     ... bold image BOLD_5 present
     ... bold image BOLD_6 present
     ... ICA CONCAT_REST present

------------------------------------------------------------
Running HCP Pipelines command via QuNex:

/opt/HCP/HCPpipelines/MSMAll/MSMAllPipeline.sh
    --path="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp"
    --subject="FM0007"
    --fmri-names-list=""
    --multirun-fix-names="BOLD_5@BOLD_6"
    --multirun-fix-concat-name="CONCAT_REST"
    --multirun-fix-names-to-use="BOLD_5@BOLD_6"
    --output-fmri-name="MSMAll_restBOLD-only"
    --high-pass="0"
    --fmri-proc-string="_Atlas_hp0_clean"
    --msm-all-templates="/opt/HCP/HCPpipelines/global/templates/MSMAll"
    --output-registration-name="MSMAll_InitialReg"
    --high-res-mesh="164"
    --low-res-mesh="32"
    --input-registration-name="MSMSulc"
    --matlab-run-mode="0"
------------------------------------------------------------

 --- Failed during processing of group CONCAT_REST with error:
 Traceback (most recent call last):
  File "/opt/qunex/python/qx_utilities/hcp/process_hcp.py", line 5760, in executeHCPMultiMSMAll
    passed, _, r, failed = pc.checkRun(None, None, 'HCP MSMAll ' + groupname, r, overwrite=True)
  File "/opt/qunex/python/qx_utilities/processing/core.py", line 634, in checkRun
    log = open(logFile, 'r')
TypeError: expected str, bytes or os.PathLike object, not NoneType



HCP MSMAll test completed on Friday, 19. August 2022 10:17:58
------------------------------------------------------------


===> Final report for command hcp_msmall
... FM0007 ---> HCP MSMAll: bolds CONCAT_REST failed
===> Not all tasks completed fully!

Oh, right. There needs to be an overlap between the two sets. So hcp_msmall_bolds needs to be a subset of hcp_icafix_bolds. Try:

qunex_container hcp_msmall \
...
  --hcp_icafix_bolds=fMRI_CONCAT_ALL:BOLD_1,BOLD_2,BOLD_3,BOLD_4,BOLD_5,BOLD_6 \
  --hcp_msmall_bolds=BOLD_5,BOLD_6 \
...

I tried it, then the Python error comes up similar to my previous attempt above.

cn2107:~ moana004$ qunex_container hcp_msmall --batchfile="${study_sharedfolder}/processing/batch_FM_Gracely.txt" --sessionsfolder="${study_sharedfolder}/sessions" --parsessions="1" --hcp_icafix_bolds=fMRI_CONCAT_ALL:BOLD_1,BOLD_2,BOLD_3,BOLD_4,BOLD_5,BOLD_6 --hcp_msmall_bolds=BOLD_5,BOLD_6 --test --bind="${study_sharedfolder}:/${study_sharedfolder}" --container="${HOME}/qunex/qunex_suite-0.94.7.sif"

--> QuNex will run the command over 1 sessions. It will utilize:

    Maximum sessions run in parallel for a job: 1.
    Maximum elements run in parallel for a session: 1.
    Up to 1 processes will be utilized for a job.

    Job #1 will run sessions: FM0007
cn2107:~ moana004$ --> unsetting the following environment variables: PATH MATLABPATH PYTHONPATH QUNEXVer TOOLS QUNEXREPO QUNEXPATH QUNEXLIBRARY QUNEXLIBRARYETC TemplateFolder FSL_FIXDIR FREESURFERDIR FREESURFER_HOME FREESURFER_SCHEDULER FreeSurferSchedulerDIR WORKBENCHDIR DCMNIIDIR DICMNIIDIR MATLABDIR MATLABBINDIR OCTAVEDIR OCTAVEPKGDIR OCTAVEBINDIR RDIR HCPWBDIR AFNIDIR ANTSDIR PYLIBDIR FSLDIR FSLGPUDIR PALMDIR QUNEXMCOMMAND HCPPIPEDIR CARET7DIR GRADUNWARPDIR HCPPIPEDIR_Templates HCPPIPEDIR_Bin HCPPIPEDIR_Config HCPPIPEDIR_PreFS HCPPIPEDIR_FS HCPPIPEDIR_PostFS HCPPIPEDIR_fMRISurf HCPPIPEDIR_fMRIVol HCPPIPEDIR_tfMRI HCPPIPEDIR_dMRI HCPPIPEDIR_dMRITract HCPPIPEDIR_Global HCPPIPEDIR_tfMRIAnalysis HCPCIFTIRWDIR MSMBin HCPPIPEDIR_dMRITractFull HCPPIPEDIR_dMRILegacy AutoPtxFolder FSL_GPU_SCRIPTS FSLGPUBinary EDDYCUDADIR USEOCTAVE QUNEXENV CONDADIR MSMBINDIR MSMCONFIGDIR R_LIBS FSL_FIX_CIFTIRW FSFAST_HOME SUBJECTS_DIR MINC_BIN_DIR MNI_DIR MINC_LIB_DIR MNI_DATAPATH FSF_OUTPUT_FORMAT
 
Generated by QuNex 
------------------------------------------------------------------------ 
Version: 0.94.7 
User: moana004 
System: cn2107 
OS: RedHat Linux #1 SMP Tue Jun 28 15:37:28 UTC 2022 
------------------------------------------------------------------------ 
 
        ██████\                  ║      ██\   ██\                        
       ██  __██\                 ║      ███\  ██ |                       
       ██ /  ██ |██\   ██\       ║      ████\ ██ | ██████\ ██\   ██\     
       ██ |  ██ |██ |  ██ |      ║      ██ ██\██ |██  __██\\██\ ██  | 
       ██ |  ██ |██ |  ██ |      ║      ██ \████ |████████ |\████  /     
       ██ ██\██ |██ |  ██ |      ║      ██ |\███ |██   ____|██  ██\      
       \██████ / \██████  |      ║      ██ | \██ |\███████\██  /\██\     
        \___███\  \______/       ║      \__|  \__| \_______\__/  \__|    
            \___|                ║                                       
 
 
                       DEVELOPED & MAINTAINED BY: 
 
                    Anticevic Lab, Yale University 
               Mind & Brain Lab, University of Ljubljana 
                     Murray Lab, Yale University 
 
                      COPYRIGHT & LICENSE NOTICE: 
 
Use of this software is subject to the terms and conditions defined in 
'LICENSES' which is a part of the QuNex Suite source code package: 
https://gitlab.qunex.yale.edu/qunex/qunex/-/tree/master/LICENSES 
 
 ---> Setting up Octave  


 ........................ Running QuNex v0.94.7 ........................ 


--- Full QuNex call for command: hcp_msmall 

gmri hcp_msmall --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" --parsessions="1" --hcp_icafix_bolds="fMRI_CONCAT_ALL:BOLD_1,BOLD_2,BOLD_3,BOLD_4,BOLD_5,BOLD_6" --hcp_msmall_bolds="BOLD_5,BOLD_6" --test --batchfile="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" --sessions="FM0007" 

--------------------------------------------------------- 


WARNING: Parameter qx_cifti_tail was not specified. Its value was imputed from parameter hcp_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter qx_nifti_tail was not specified. Its value was imputed from parameter hcp_nifti_tail and set to ''!
WARNING: Parameter cifti_tail was not specified. Its value was imputed from parameter qx_cifti_tail and set to '"_Atlas"'!
WARNING: Parameter nifti_tail was not specified. Its value was imputed from parameter qx_nifti_tail and set to ''!

# Generated by QuNex 0.94.7 on 2022-08-19_10.37.47.958722
#
=================================================================
gmri hcp_msmall \
  --sessionsfolder="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions" \
  --parsessions="1" \
  --hcp_icafix_bolds="fMRI_CONCAT_ALL:BOLD_1,BOLD_2,BOLD_3,BOLD_4,BOLD_5,BOLD_6" \
  --hcp_msmall_bolds="BOLD_5,BOLD_6" \
  --test="True" \
  --sessions="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt" \
  --sessionids="FM0007" \
=================================================================

Running test on /home/moanae/shared/project_FM_Gracely_TEST_FM0007/processing/batch_FM_Gracely.txt ...

---- Running local

Starting testing of sessions FM0007 at Friday, 19. August 2022 10:37:47

------------------------------------------------------------
Session id: FM0007 
[started on Friday, 19. August 2022 10:37:47]
Test running HCP MSMAll pipeline [LegacyStyleData] ...

Comparing bolds with those specifed via parameters
     ... all bolds specified via hcp_icafix_bolds are present

Multi-run HCP ICAFix on 1 groups

------------------------------------------------------------
---> Test processing MSMAll MSMAll_restBOLD-only
     ... bold image BOLD_1 present
     ... bold image BOLD_2 present
     ... bold image BOLD_3 present
     ... bold image BOLD_4 present
     ... bold image BOLD_5 present
     ... bold image BOLD_6 present
     ... ICA fMRI_CONCAT_ALL present

------------------------------------------------------------
Running HCP Pipelines command via QuNex:

/opt/HCP/HCPpipelines/MSMAll/MSMAllPipeline.sh
    --path="/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp"
    --subject="FM0007"
    --fmri-names-list=""
    --multirun-fix-names="BOLD_1@BOLD_2@BOLD_3@BOLD_4@BOLD_5@BOLD_6"
    --multirun-fix-concat-name="fMRI_CONCAT_ALL"
    --multirun-fix-names-to-use="BOLD_5@BOLD_6"
    --output-fmri-name="MSMAll_restBOLD-only"
    --high-pass="0"
    --fmri-proc-string="_Atlas_hp0_clean"
    --msm-all-templates="/opt/HCP/HCPpipelines/global/templates/MSMAll"
    --output-registration-name="MSMAll_InitialReg"
    --high-res-mesh="164"
    --low-res-mesh="32"
    --input-registration-name="MSMSulc"
    --matlab-run-mode="0"
------------------------------------------------------------

 --- Failed during processing of group fMRI_CONCAT_ALL with error:
 Traceback (most recent call last):
  File "/opt/qunex/python/qx_utilities/hcp/process_hcp.py", line 5760, in executeHCPMultiMSMAll
    passed, _, r, failed = pc.checkRun(None, None, 'HCP MSMAll ' + groupname, r, overwrite=True)
  File "/opt/qunex/python/qx_utilities/processing/core.py", line 634, in checkRun
    log = open(logFile, 'r')
TypeError: expected str, bytes or os.PathLike object, not NoneType



HCP MSMAll test completed on Friday, 19. August 2022 10:37:48
------------------------------------------------------------


===> Final report for command hcp_msmall
... FM0007 ---> HCP MSMAll: bolds fMRI_CONCAT_ALL failed
===> Not all tasks completed fully!

Can you try the real run, without the test flag?

Ok, without the --test flag the command started as expected. It did not complete successfully though, it had a “file not found” error, see the logs attached. Thank you.

Log-hcp_msmall-2022-08-19_10.48.31.626539.log (3.6 KB)
error_hcp_msmall_fMRI_CONCAT_ALL_FM0007_2022-08-19_10.48.31.636964.log (44.9 KB)

Never saw this before. Can you provide the contents of these folders:

/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp/FM0007/MNINonLinear/
/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp/FM0007/MNINonLinear/fsaverage_LR32k

It could be that you need to change some other parameters of MSMAll so it will look for the correct files here.

Just as a sanity check also check folder permissions, but there should be no issues there as these folders were created by HCP Pipelines.

Sure, see below are the output of the ls -l commands for the folders you suggested. Interestingly, I did a “chmod -R 750 ${study_sharedfolder}/sessions/inbox/BIDS” after I copied the BIDS mri data to ${study_sharedfolder}/sessions/inbox/BIDS folder and before the first qunex command, qunex_container import_bids.

cn2107:~ moana004$ ls -l /home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp/FM0007/MNINonLinear/
total 211264
-rw-rw-r--.  1 moana004 moanae   458853 Aug 16 08:27 aparc.a2009s+aseg.nii.gz
-rw-rw-r--.  1 moana004 moanae   425330 Aug 16 08:27 aparc+aseg.nii.gz
-rw-rw-r--.  1 moana004 moanae 23014918 Aug 16 09:58 BiasField.nii.gz
-rw-rw-r--.  1 moana004 moanae    29128 Aug 16 08:28 brainmask_fs.2.dil2x.nii.gz
-rw-rw-r--.  1 moana004 moanae    23715 Aug 16 08:28 brainmask_fs.2.nii.gz
-rw-rw-r--.  1 moana004 moanae   136256 Aug 16 08:28 brainmask_fs.nii.gz
-rw-rw-r--.  1 moana004 moanae     3568 Aug 16 09:58 FM0007.164k_fs_LR.wb.spec
-rw-rw-r--.  1 moana004 moanae  3099060 Aug 16 09:53 FM0007.aparc.164k_fs_LR.dlabel.nii
-rw-rw-r--.  1 moana004 moanae  3109268 Aug 16 09:53 FM0007.aparc.a2009s.164k_fs_LR.dlabel.nii
-rw-rw-r--.  1 moana004 moanae  3388528 Aug 16 09:53 FM0007.ArealDistortion_FS.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3388560 Aug 16 09:53 FM0007.ArealDistortion_MSMSulc.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3092436 Aug 16 09:58 FM0007.corrThickness.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3092388 Aug 16 09:53 FM0007.curvature.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3388512 Aug 16 09:53 FM0007.EdgeDistortion_FS.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3388560 Aug 16 09:53 FM0007.EdgeDistortion_MSMSulc.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae    18696 Aug 16 09:10 FM0007.L.aparc.164k_fs_LR.label.gii
-rw-rw-r--.  1 moana004 moanae    29959 Aug 16 09:10 FM0007.L.aparc.a2009s.164k_fs_LR.label.gii
-rw-rw-r--.  1 moana004 moanae   814750 Aug 16 09:10 FM0007.L.ArealDistortion_FS.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   800936 Aug 16 09:10 FM0007.L.ArealDistortion_MSMSulc.164k_fs_LR.shape.gii
-rw-r--r--.  1 moana004 moanae     4789 Aug 16 08:30 FM0007.L.atlasroi.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   693543 Aug 16 09:58 FM0007.L.corrThickness.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   743436 Aug 16 09:10 FM0007.L.curvature.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   773284 Aug 16 09:10 FM0007.L.EdgeDistortion_FS.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   771501 Aug 16 09:10 FM0007.L.EdgeDistortion_MSMSulc.164k_fs_LR.shape.gii
-rw-r--r--.  1 moana004 moanae  2651457 Aug 16 08:30 FM0007.L.flat.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae  3632865 Aug 16 09:10 FM0007.L.inflated.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae  3640114 Aug 16 09:09 FM0007.L.midthickness.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae  3642319 Aug 16 09:09 FM0007.L.pial.164k_fs_LR.surf.gii
-rw-r--r--.  1 moana004 moanae   846142 Aug 16 08:30 FM0007.L.refsulc.164k_fs_LR.shape.gii
-rw-r--r--.  1 moana004 moanae  3614784 Aug 16 08:30 FM0007.L.sphere.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae   814455 Aug 16 09:10 FM0007.L.StrainJ_FS.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   800936 Aug 16 09:10 FM0007.L.StrainJ_MSMSulc.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   781657 Aug 16 09:10 FM0007.L.StrainR_FS.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   767686 Aug 16 09:10 FM0007.L.StrainR_MSMSulc.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   813271 Aug 16 09:10 FM0007.L.sulc.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   695983 Aug 16 09:10 FM0007.L.thickness.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae  3629717 Aug 16 09:10 FM0007.L.very_inflated.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae  3638781 Aug 16 09:09 FM0007.L.white.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae    18781 Aug 16 09:52 FM0007.R.aparc.164k_fs_LR.label.gii
-rw-rw-r--.  1 moana004 moanae    29740 Aug 16 09:52 FM0007.R.aparc.a2009s.164k_fs_LR.label.gii
-rw-rw-r--.  1 moana004 moanae   813399 Aug 16 09:52 FM0007.R.ArealDistortion_FS.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   795029 Aug 16 09:52 FM0007.R.ArealDistortion_MSMSulc.164k_fs_LR.shape.gii
-rw-r--r--.  1 moana004 moanae     4850 Aug 16 09:11 FM0007.R.atlasroi.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   693916 Aug 16 09:58 FM0007.R.corrThickness.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   743385 Aug 16 09:52 FM0007.R.curvature.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   773205 Aug 16 09:52 FM0007.R.EdgeDistortion_FS.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   773090 Aug 16 09:52 FM0007.R.EdgeDistortion_MSMSulc.164k_fs_LR.shape.gii
-rw-r--r--.  1 moana004 moanae  2541434 Aug 16 09:11 FM0007.R.flat.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae  3506810 Aug 16 09:52 FM0007.R.inflated.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae  3515299 Aug 16 09:51 FM0007.R.midthickness.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae  3516924 Aug 16 09:51 FM0007.R.pial.164k_fs_LR.surf.gii
-rw-r--r--.  1 moana004 moanae   847311 Aug 16 09:11 FM0007.R.refsulc.164k_fs_LR.shape.gii
-rw-r--r--.  1 moana004 moanae  3492005 Aug 16 09:11 FM0007.R.sphere.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae   813060 Aug 16 09:52 FM0007.R.StrainJ_FS.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   794781 Aug 16 09:52 FM0007.R.StrainJ_MSMSulc.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   781270 Aug 16 09:52 FM0007.R.StrainR_FS.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   769263 Aug 16 09:52 FM0007.R.StrainR_MSMSulc.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   812752 Aug 16 09:52 FM0007.R.sulc.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae   696712 Aug 16 09:52 FM0007.R.thickness.164k_fs_LR.shape.gii
-rw-rw-r--.  1 moana004 moanae  3504010 Aug 16 09:52 FM0007.R.very_inflated.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae  3515050 Aug 16 09:51 FM0007.R.white.164k_fs_LR.surf.gii
-rw-rw-r--.  1 moana004 moanae  3388464 Aug 16 09:53 FM0007.StrainJ_FS.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3388512 Aug 16 09:53 FM0007.StrainJ_MSMSulc.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3388464 Aug 16 09:53 FM0007.StrainR_FS.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3388512 Aug 16 09:53 FM0007.StrainR_MSMSulc.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3388432 Aug 16 09:53 FM0007.sulc.164k_fs_LR.dscalar.nii
-rw-rw-r--.  1 moana004 moanae  3092404 Aug 16 09:53 FM0007.thickness.164k_fs_LR.dscalar.nii
drwxrwsr-x.  2 moana004 moanae     4096 Aug 16 09:11 fsaverage
drwxrwsr-x.  2 moana004 moanae    16384 Aug 19 10:52 fsaverage_LR32k
drwxrwsr-x.  4 moana004 moanae    12288 Aug 19 10:52 Native
drwxrwsr-x. 13 moana004 moanae     4096 Aug 19 10:48 Results
-rw-rw-r--.  1 moana004 moanae   299214 Aug 16 09:56 ribbon.nii.gz
drwxrwsr-x.  2 moana004 moanae     4096 Aug 16 08:28 ROIs
drwxrwsr-x.  3 moana004 moanae     4096 Aug 16 09:59 StructuralQC
-rw-rw-r--.  1 moana004 moanae  8346620 Aug 16 09:58 T1w.nii.gz
-rw-rw-r--.  1 moana004 moanae  3288505 Aug 16 08:28 T1w_restore.2.nii.gz
-rw-rw-r--.  1 moana004 moanae  6694876 Aug 16 09:58 T1w_restore_brain.nii.gz
-rw-rw-r--.  1 moana004 moanae 24205446 Aug 16 09:58 T1w_restore.nii.gz
-rw-rw-r--.  1 moana004 moanae   477455 Aug 16 08:26 wmparc.nii.gz
drwxrwsr-x.  2 moana004 moanae     4096 Aug 16 13:05 xfms

cn2107:~ moana004$ ls -l /home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp/FM0007/MNINonLinear/fsaverage_LR32k/
total 135440
-rw-rw-r--. 1 moana004 moanae     3551 Aug 16 09:58 FM0007.32k_fs_LR.wb.spec
-rw-rw-r--. 1 moana004 moanae   590288 Aug 16 09:54 FM0007.aparc.32k_fs_LR.dlabel.nii
-rw-rw-r--. 1 moana004 moanae   600496 Aug 16 09:54 FM0007.aparc.a2009s.32k_fs_LR.dlabel.nii
-rw-rw-r--. 1 moana004 moanae   633920 Aug 16 09:53 FM0007.ArealDistortion_FS.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   633968 Aug 16 09:54 FM0007.ArealDistortion_MSMSulc.32k_fs_LR.dscalar.nii
-rw-r--r--. 1 moana004 moanae   580288 Aug 19 10:48 FM0007.atlas_MyelinMap_BC.32k_fs_LR.dscalar.nii
-rw-r--r--. 1 moana004 moanae 15241104 Aug 19 10:48 FM0007.atlas_RSNs_d40.32k_fs_LR.dscalar.nii
-rw-r--r--. 1 moana004 moanae  3933000 Aug 19 10:48 FM0007.atlas_Topographic_ROIs.32k_fs_LR.dscalar.nii
-rw-r--r--. 1 moana004 moanae  3934488 Aug 19 10:48 FM0007.atlas_Topography.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   583616 Aug 16 09:58 FM0007.corrThickness.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   583568 Aug 16 09:53 FM0007.curvature.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   633920 Aug 16 09:53 FM0007.EdgeDistortion_FS.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   633952 Aug 16 09:54 FM0007.EdgeDistortion_MSMSulc.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae 15246704 Aug 19 10:51 FM0007.individual_RSNs_d40_MSMSulc.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae 15382968 Aug 19 10:51 FM0007.individual_RSNs_d40_weights.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae    11769 Aug 16 09:10 FM0007.L.aparc.32k_fs_LR.label.gii
-rw-rw-r--. 1 moana004 moanae    18996 Aug 16 09:10 FM0007.L.aparc.a2009s.32k_fs_LR.label.gii
-rw-rw-r--. 1 moana004 moanae   168023 Aug 16 09:10 FM0007.L.ArealDistortion_FS.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   166065 Aug 16 09:10 FM0007.L.ArealDistortion_MSMSulc.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   133951 Aug 19 10:52 FM0007.L.atlas_MyelinMap_BC.32k_fs_LR.func.gii
-rw-r--r--. 1 moana004 moanae     3510 Aug 16 09:10 FM0007.L.atlasroi.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae     2853 Aug 19 10:52 FM0007.L.atlasroi_inv.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae  5917112 Aug 19 10:52 FM0007.L.atlas_RSNs_d40.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae   143163 Aug 16 09:58 FM0007.L.corrThickness.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   153016 Aug 16 09:10 FM0007.L.curvature.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   159217 Aug 16 09:10 FM0007.L.EdgeDistortion_FS.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   159110 Aug 16 09:10 FM0007.L.EdgeDistortion_MSMSulc.32k_fs_LR.shape.gii
-rw-r--r--. 1 moana004 moanae   538686 Aug 16 09:10 FM0007.L.flat.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae  5928259 Aug 19 10:51 FM0007.L.individual_RSNs_d40_MSMSulc.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae    45756 Aug 19 10:52 FM0007.L.individual_RSNs_d40_weights.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae   724016 Aug 16 09:10 FM0007.L.inflated.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   725250 Aug 16 09:10 FM0007.L.midthickness.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae  4972887 Aug 19 10:52 FM0007.L.Modalities_1.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae   151622 Aug 19 10:52 FM0007.L.Modalities_1_weights.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae   135194 Aug 19 10:52 FM0007.L.norm_atlas_MyelinMap_BC.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae  5917699 Aug 19 10:52 FM0007.L.norm_atlas_RSNs_d40.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae   134780 Aug 19 10:52 FM0007.L.norm_MyelinMap_BC.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae   725819 Aug 16 09:10 FM0007.L.pial.32k_fs_LR.surf.gii
-rw-r--r--. 1 moana004 moanae   562891 Aug 16 09:10 FM0007.L.sphere.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   663001 Aug 19 10:48 FM0007.L.sphere.MSMSulc.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   167844 Aug 16 09:10 FM0007.L.StrainJ_FS.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   165821 Aug 16 09:10 FM0007.L.StrainJ_MSMSulc.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   160962 Aug 16 09:10 FM0007.L.StrainR_FS.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   158171 Aug 16 09:10 FM0007.L.StrainR_MSMSulc.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   167704 Aug 16 09:10 FM0007.L.sulc.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   143691 Aug 16 09:10 FM0007.L.thickness.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   723420 Aug 16 09:10 FM0007.L.very_inflated.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   725053 Aug 16 09:10 FM0007.L.white.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae    11774 Aug 16 09:53 FM0007.R.aparc.32k_fs_LR.label.gii
-rw-rw-r--. 1 moana004 moanae    19061 Aug 16 09:53 FM0007.R.aparc.a2009s.32k_fs_LR.label.gii
-rw-rw-r--. 1 moana004 moanae   168192 Aug 16 09:52 FM0007.R.ArealDistortion_FS.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   166058 Aug 16 09:52 FM0007.R.ArealDistortion_MSMSulc.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   134120 Aug 19 10:52 FM0007.R.atlas_MyelinMap_BC.32k_fs_LR.func.gii
-rw-r--r--. 1 moana004 moanae     3539 Aug 16 09:52 FM0007.R.atlasroi.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae  5927093 Aug 19 10:52 FM0007.R.atlas_RSNs_d40.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae   143352 Aug 16 09:58 FM0007.R.corrThickness.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   153121 Aug 16 09:52 FM0007.R.curvature.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   159154 Aug 16 09:52 FM0007.R.EdgeDistortion_FS.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   159811 Aug 16 09:52 FM0007.R.EdgeDistortion_MSMSulc.32k_fs_LR.shape.gii
-rw-r--r--. 1 moana004 moanae   527373 Aug 16 09:52 FM0007.R.flat.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae  5929292 Aug 19 10:51 FM0007.R.individual_RSNs_d40_MSMSulc.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae    46141 Aug 19 10:52 FM0007.R.individual_RSNs_d40_weights.32k_fs_LR.func.gii
-rw-rw-r--. 1 moana004 moanae   710913 Aug 16 09:52 FM0007.R.inflated.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   712479 Aug 16 09:52 FM0007.R.midthickness.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   712824 Aug 16 09:52 FM0007.R.pial.32k_fs_LR.surf.gii
-rw-r--r--. 1 moana004 moanae   553052 Aug 16 09:52 FM0007.R.sphere.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   650522 Aug 19 10:48 FM0007.R.sphere.MSMSulc.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   167981 Aug 16 09:52 FM0007.R.StrainJ_FS.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   165810 Aug 16 09:52 FM0007.R.StrainJ_MSMSulc.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   160839 Aug 16 09:52 FM0007.R.StrainR_FS.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   158544 Aug 16 09:53 FM0007.R.StrainR_MSMSulc.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   167793 Aug 16 09:53 FM0007.R.sulc.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   144000 Aug 16 09:52 FM0007.R.thickness.32k_fs_LR.shape.gii
-rw-rw-r--. 1 moana004 moanae   710577 Aug 16 09:52 FM0007.R.very_inflated.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   712670 Aug 16 09:52 FM0007.R.white.32k_fs_LR.surf.gii
-rw-rw-r--. 1 moana004 moanae   633872 Aug 16 09:54 FM0007.StrainJ_FS.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   633904 Aug 16 09:54 FM0007.StrainJ_MSMSulc.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   633872 Aug 16 09:54 FM0007.StrainR_FS.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   633904 Aug 16 09:54 FM0007.StrainR_MSMSulc.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   633824 Aug 16 09:53 FM0007.sulc.32k_fs_LR.dscalar.nii
-rw-rw-r--. 1 moana004 moanae   583584 Aug 16 09:53 FM0007.thickness.32k_fs_LR.dscalar.nii

For some reason your folders are missing the MyelinMaps that are created by the hcp_post_freesurfer step.

Other than that, the outgoing command now looks good. I would rerun post freesurfer and check if the file below exists:

/home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp/FM0007/MNINonLinear/Native/FM0007.MyelinMap.native.dscalar.nii

If it is not, then search your folder structure for the file:

cd /home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions
find . -name "FM0007.MyelinMap.native*"

Interesting, it looks like this file was not created as part of “hcp_post_freesurfer” - see below. Do you think this could be related to these being legacy MRI data without a high-resolution T2w image? I ran the HCP structural pipelines using only the T1w images. Looking at the logs for hcp_post_freesurfer, I can see that there were errors regarding the myelin maps - see attached.

I just finished running another participant’s T1w data for “hcp_post_freesurfer” and it also did not have the myelin map file.

cn2107:~ moana004$ ls /home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp/FM0007/MNINonLinear/Native/FM0007.MyelinMap.native.dscalar.nii
ls: cannot access /home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions/FM0007/hcp/FM0007/MNINonLinear/Native/FM0007.MyelinMap.native.dscalar.nii: No such file or directory
cn2107:~ moana004$ cd /home/moanae/shared/project_FM_Gracely_TEST_FM0007/sessions
cn2107:sessions moana004$ find . -name "FM0007.MyelinMap.native*"

done_hcp_post_freesurfer_FM0007_2022-08-16_08.25.39.769759.log (1.8 MB)

Yes, interestingly there are no errors in the CreateMyelinMaps.sh step, but there are errors in the QC that follows. Unfortunately I am not a big expert when it comes to HCP FreeSurfer details.

I will ask around our team if someone has more experience with the pipeline when there is no T2w. If not, then the HCP user group might be a better place for this question as we identified that the issues arise because of a hiccup with your data and HCP Pipelines.

Ok, thanks for the tip. I will ask at the HCP-Users list, and will update here once I get a response.

I got a potential solution to run hcp_msmall using legacy data from Matt Glasser: https://groups.google.com/a/humanconnectome.org/g/hcp-users/c/e1pIdThibBI/m/wFNDyqWbBAAJ

In a nutshell, the HCP pipelines do not create myelin maps for structural preprocessing using T1w data only (and it does so silently without throwing an error, apparently). Matt mentioned that MSMAll can be run without myelin maps, but the MSMAll script needs to be modified, as there are no parameters to adjust for this. Line 529 should be changed from:

MSMAllRegsOrig+=“@CA_CAT” # Iterations

to:

“MSMAllRegsOrig+=”@C_CT" # Iterations"

https://github.com/Washington-University/HCPpipelines/blob/master/MSMAll/MSMAllPipeline.sh

Any suggestions on how I can change this script within the qunex container? Thank you.

It is possible to rewire QuNex container so it uses tools that are sitting outside of container. In the example below, I will put a new version of HCPPipelines in /home/moanae/shared/.

# 1. Use Git to get the latest version of HCP Pipelines
cd /home/moanae/shared
git clone https://github.com/Washington-University/HCPpipelines.git

# 2. Edit the code in the relevant script of /home/moanae/shared/HCPpipelines

# 3. Launch qunex_container by adding the bash_post option
qunex_container hcp_msmall \
...
  --bash_post="export HCPPIPEDIR=/home/moanae/shared/HCPpipelines"
...

The code in the bash_post parameter will be executed after entering the container and before running the QuNex command. The code above will change the variable that sets the path to HCP pipelines directory to /home/moanae/shared/HCPpipelines.

Depending on the settings of your system, maybe you will have to bind the /home/moanae/shared/HCPpipelines in the qunex_container call, just like you are doing with the study path.

Great, I tried what you suggested and MSMAll seems to be going past the previous error. Thanks for the instructions.