[RESOLVED] Error using create_conc

Description:

Hi, I’m trying to create conc files using the create_conc command but got an error. Please see below. Thank you.

Estephan

Call:

subjID_list="10001,10002,10004,10005,10006,10007,10009,10011,10012,10013,10014,10015,10016,10018,10019,10021,10022,10023,10024,10030,10031,10033,10034,10035,10037,10038,10039,10041,10042,11004,11006,11009,11015,20001,20004,20005,20006,20008,20010,20011,20012,20013,20015,20016,20017,20018,20019,20021,20022"; \
study_sharedfolder=/home/moanae/shared/project_K99_ChrTMDHCP_qunex02; \
qunex_container create_conc \
--batchfile=${study_sharedfolder}/processing/batch_K99Aim2.txt --sessionsfolder=${study_sharedfolder}/sessions --sessions=${subjID_list} \
--concname="dentalvpress" --bolds="3,4" --boldname="BOLD" --bold_tail="_Atlas_MSMAll_hp0_clean.dtseries.nii" \
-bind=${study_sharedfolder}:${study_sharedfolder} --container=${HOME}/qunex/qunex_suite-0.97.3.sif

Logs:

cn2107:~ moana004$ subjID_list="10001,10002,10004,10005,10006,10007,10009,10011,10012,10013,10014,10015,10016,10018,10019,10021,10022,10023,10024,10030,10031,10033,10034,10035,10037,10038,10039,10041,10042,11004,11006,11009,11015,20001,20004,20005,20006,20008,20010,20011,20012,20013,20015,20016,20017,20018,20019,20021,20022"; \
> study_sharedfolder=/home/moanae/shared/project_K99_ChrTMDHCP_qunex02; \
> qunex_container create_conc \
> --batchfile=${study_sharedfolder}/processing/batch_K99Aim2.txt --sessionsfolder=${study_sharedfolder}/sessions --sessions=${subjID_list} \
> --concname="dentalvpress" --bolds="3,4" --boldname="BOLD" --bold_tail="_Atlas_MSMAll_hp0_clean.dtseries.nii" \
> -bind=${study_sharedfolder}:${study_sharedfolder} --container=${HOME}/qunex/qunex_suite-0.97.3.sif

--> QuNex will run the command over 49 sessions. It will utilize:

    Maximum sessions run in parallel for a job: 1.
    Maximum elements run in parallel for a session: 1.
    Up to 1 processes will be utilized for a job.

    Job #1 will run sessions: 10001,10002,10004,10005,10006,10007,10009,10011,10012,10013,10014,10015,10016,10018,10019,10021,10022,10023,10024,10030,10031,10033,10034,10035,10037,10038,10039,10041,10042,11004,11006,11009,11015,20001,20004,20005,20006,20008,20010,20011,20012,20013,20015,20016,20017,20018,20019,20021,20022
cn2107:~ moana004$ --> unsetting the following environment variables: PATH MATLABPATH PYTHONPATH QUNEXVer TOOLS QUNEXREPO QUNEXPATH QUNEXEXTENSIONS QUNEXLIBRARY QUNEXLIBRARYETC TemplateFolder FSL_FIXDIR FREESURFERDIR FREESURFER_HOME FREESURFER_SCHEDULER FreeSurferSchedulerDIR WORKBENCHDIR DCMNIIDIR DICMNIIDIR MATLABDIR MATLABBINDIR OCTAVEDIR OCTAVEPKGDIR OCTAVEBINDIR RDIR HCPWBDIR AFNIDIR PYLIBDIR FSLDIR FSLGPUDIR PALMDIR QUNEXMCOMMAND HCPPIPEDIR CARET7DIR GRADUNWARPDIR HCPPIPEDIR_Templates HCPPIPEDIR_Bin HCPPIPEDIR_Config HCPPIPEDIR_PreFS HCPPIPEDIR_FS HCPPIPEDIR_PostFS HCPPIPEDIR_fMRISurf HCPPIPEDIR_fMRIVol HCPPIPEDIR_tfMRI HCPPIPEDIR_dMRI HCPPIPEDIR_dMRITract HCPPIPEDIR_Global HCPPIPEDIR_tfMRIAnalysis HCPCIFTIRWDIR MSMBin HCPPIPEDIR_dMRITractFull HCPPIPEDIR_dMRILegacy AutoPtxFolder FSL_GPU_SCRIPTS FSLGPUBinary EDDYCUDADIR USEOCTAVE QUNEXENV CONDADIR MSMBINDIR MSMCONFIGDIR R_LIBS FSL_FIX_CIFTIRW FSFAST_HOME SUBJECTS_DIR MINC_BIN_DIR MNI_DIR MINC_LIB_DIR MNI_DATAPATH FSF_OUTPUT_FORMAT
 
Generated by QuNex 
------------------------------------------------------------------------ 
Version: 0.97.3 
User: moana004 
System: cn2107 
OS: RedHat Linux #1 SMP Tue Mar 7 15:41:52 UTC 2023 
------------------------------------------------------------------------ 
 
        ██████\                  ║      ██\   ██\                        
       ██  __██\                 ║      ███\  ██ |                       
       ██ /  ██ |██\   ██\       ║      ████\ ██ | ██████\ ██\   ██\     
       ██ |  ██ |██ |  ██ |      ║      ██ ██\██ |██  __██\\██\ ██  | 
       ██ |  ██ |██ |  ██ |      ║      ██ \████ |████████ |\████  /     
       ██ ██\██ |██ |  ██ |      ║      ██ |\███ |██   ____|██  ██\      
       \██████ / \██████  |      ║      ██ | \██ |\███████\██  /\██\     
        \___███\  \______/       ║      \__|  \__| \_______\__/  \__|    
            \___|                ║                                       
 
 
                       DEVELOPED & MAINTAINED BY: 
 
                    Anticevic Lab, Yale University 
               Mind & Brain Lab, University of Ljubljana 
                     Murray Lab, Yale University 
 
                      COPYRIGHT & LICENSE NOTICE: 
 
Use of this software is subject to the terms and conditions defined in 
'LICENSES' which is a part of the QuNex Suite source code package: 
https://gitlab.qunex.yale.edu/qunex/qunex/-/tree/master/LICENSES 
 
 ---> Setting up Octave  


 ........................ Running QuNex v0.97.3 ........................ 


--- Full QuNex call for command: create_conc 

gmri create_conc --sessionsfolder="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions" --concname="dentalvpress" --bolds="3,4" --boldname="BOLD" --bold_tail="_Atlas_MSMAll_hp0_clean.dtseries.nii" --batchfile="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/processing/batch_K99Aim2.txt" --sessions="10001,10002,10004,10005,10006,10007,10009,10011,10012,10013,10014,10015,10016,10018,10019,10021,10022,10023,10024,10030,10031,10033,10034,10035,10037,10038,10039,10041,10042,11004,11006,11009,11015,20001,20004,20005,20006,20008,20010,20011,20012,20013,20015,20016,20017,20018,20019,20021,20022" 

--------------------------------------------------------- 


started running create_conc at 2023-05-10 15:39:44, track progress in /home/moanae/shared/project_K99_ChrTMDHCP_qunex02/processing/logs/comlogs/create_conc_/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/processing/tmp_batch_K99Aim2.txt_2023-05-10_15.39.44.536926.log
call: gmri create_conc sessionsfolder="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions" concname="dentalvpress" bolds="3,4" boldname="BOLD" bold_tail="_Atlas_MSMAll_hp0_clean.dtseries.nii" sessions="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/processing/batch_K99Aim2.txt" sessionids="10001,10002,10004,10005,10006,10007,10009,10011,10012,10013,10014,10015,10016,10018,10019,10021,10022,10023,10024,10030,10031,10033,10034,10035,10037,10038,10039,10041,10042,11004,11006,11009,11015,20001,20004,20005,20006,20008,20010,20011,20012,20013,20015,20016,20017,20018,20019,20021,20022"
-----------------------------------------


ERROR
Traceback (most recent call last):
  File "/opt/qunex/python/qx_utilities/general/core.py", line 570, in runWithLog
    result = function(**args)
TypeError: create_conc() got an unexpected keyword argument 'sessionids'


-----------------------------------------
Finished at 2023-05-10 15:39:44


Hi Estephan,

Thanks for reporting this, I will fix it for the next version.

Right now, the easiest fix is to create a new batch file that includes only sessions that you want to run create_conc on and then skip the sessions parameter. So:

# variables
study_sharedfolder=/home/moanae/shared/project_K99_ChrTMDHCP_qunex02

# create a copy of the batch file with only a subset of sessions (the subjID_list)
cp ${study_sharedfolder}/processing/batch_K99Aim2.txt ${study_sharedfolder}/processing/batch_K99Aim2_subset.txt

# remove unused sessions from ${study_sharedfolder}/processing/batch_K99Aim2_subset.txt

# run the command by using the new batchfile and skipping the sessions parameter
qunex_container create_conc \
--batchfile=${study_sharedfolder}/processing/batch_K99Aim2_subset.txt --sessionsfolder=${study_sharedfolder}/sessions  \
--concname="dentalvpress" --bolds="3,4" --boldname="BOLD" --bold_tail="_Atlas_MSMAll_hp0_clean.dtseries.nii" \
-bind=${study_sharedfolder}:${study_sharedfolder} --container=${HOME}/qunex/qunex_suite-0.97.3.sif

Let me know if this worked.

Jure

It did not work. It seems that even when no “–sessions”" parameter is in the command, the error about “sessionsids” still comes out.

Are looking into days or weeks for the new version?

cn2107:~ moana004$ study_sharedfolder=/home/moanae/shared/project_K99_ChrTMDHCP_qunex02; \
> qunex_container create_conc \
> --batchfile=${study_sharedfolder}/processing/batch_K99Aim2.txt --sessionsfolder=${study_sharedfolder}/sessions \
> --concname="dentalvpress" --bolds="3,4" --boldname="BOLD" --bold_tail="_Atlas_MSMAll_hp0_clean.dtseries.nii" \
> -bind=${study_sharedfolder}:${study_sharedfolder} --container=${HOME}/qunex/qunex_suite-0.97.3.sif

--> QuNex will run the command over 52 sessions. It will utilize:

    Maximum sessions run in parallel for a job: 1.
    Maximum elements run in parallel for a session: 1.
    Up to 1 processes will be utilized for a job.

    Job #1 will run sessions: 10001,10002,10004,10005,10006,10007,10009,10011,10012,10013,10014,10015,10016,10018,10019,10021,10022,10023,10024,10030,10031,10033,10034,10035,10036,10037,10038,10039,10041,10042,11004,11006,11009,11012,11015,20001,20002,20004,20005,20006,20008,20010,20011,20012,20013,20015,20016,20017,20018,20019,20021,20022
cn2107:~ moana004$ --> unsetting the following environment variables: PATH MATLABPATH PYTHONPATH QUNEXVer TOOLS QUNEXREPO QUNEXPATH QUNEXEXTENSIONS QUNEXLIBRARY QUNEXLIBRARYETC TemplateFolder FSL_FIXDIR FREESURFERDIR FREESURFER_HOME FREESURFER_SCHEDULER FreeSurferSchedulerDIR WORKBENCHDIR DCMNIIDIR DICMNIIDIR MATLABDIR MATLABBINDIR OCTAVEDIR OCTAVEPKGDIR OCTAVEBINDIR RDIR HCPWBDIR AFNIDIR PYLIBDIR FSLDIR FSLGPUDIR PALMDIR QUNEXMCOMMAND HCPPIPEDIR CARET7DIR GRADUNWARPDIR HCPPIPEDIR_Templates HCPPIPEDIR_Bin HCPPIPEDIR_Config HCPPIPEDIR_PreFS HCPPIPEDIR_FS HCPPIPEDIR_PostFS HCPPIPEDIR_fMRISurf HCPPIPEDIR_fMRIVol HCPPIPEDIR_tfMRI HCPPIPEDIR_dMRI HCPPIPEDIR_dMRITract HCPPIPEDIR_Global HCPPIPEDIR_tfMRIAnalysis HCPCIFTIRWDIR MSMBin HCPPIPEDIR_dMRITractFull HCPPIPEDIR_dMRILegacy AutoPtxFolder FSL_GPU_SCRIPTS FSLGPUBinary EDDYCUDADIR USEOCTAVE QUNEXENV CONDADIR MSMBINDIR MSMCONFIGDIR R_LIBS FSL_FIX_CIFTIRW FSFAST_HOME SUBJECTS_DIR MINC_BIN_DIR MNI_DIR MINC_LIB_DIR MNI_DATAPATH FSF_OUTPUT_FORMAT
 
Generated by QuNex 
------------------------------------------------------------------------ 
Version: 0.97.3 
User: moana004 
System: cn2107 
OS: RedHat Linux #1 SMP Tue Mar 7 15:41:52 UTC 2023 
------------------------------------------------------------------------ 
 
        \u2588\u2588\u2588\u2588\u2588\u2588\                  \u2551      \u2588\u2588\   \u2588\u2588\                        
       \u2588\u2588  __\u2588\u2588\                 \u2551      \u2588\u2588\u2588\  \u2588\u2588 |                       
       \u2588\u2588 /  \u2588\u2588 |\u2588\u2588\   \u2588\u2588\       \u2551      \u2588\u2588\u2588\u2588\ \u2588\u2588 | \u2588\u2588\u2588\u2588\u2588\u2588\ \u2588\u2588\   \u2588\u2588\     
       \u2588\u2588 |  \u2588\u2588 |\u2588\u2588 |  \u2588\u2588 |      \u2551      \u2588\u2588 \u2588\u2588\\u2588\u2588 |\u2588\u2588  __\u2588\u2588\\\u2588\u2588\ \u2588\u2588  | 
       \u2588\u2588 |  \u2588\u2588 |\u2588\u2588 |  \u2588\u2588 |      \u2551      \u2588\u2588 \\u2588\u2588\u2588\u2588 |\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588 |\\u2588\u2588\u2588\u2588  /     
       \u2588\u2588 \u2588\u2588\\u2588\u2588 |\u2588\u2588 |  \u2588\u2588 |      \u2551      \u2588\u2588 |\\u2588\u2588\u2588 |\u2588\u2588   ____|\u2588\u2588  \u2588\u2588\      
       \\u2588\u2588\u2588\u2588\u2588\u2588 / \\u2588\u2588\u2588\u2588\u2588\u2588  |      \u2551      \u2588\u2588 | \\u2588\u2588 |\\u2588\u2588\u2588\u2588\u2588\u2588\u2588\\u2588\u2588  /\\u2588\u2588\     
        \___\u2588\u2588\u2588\  \______/       \u2551      \__|  \__| \_______\__/  \__|    
            \___|                \u2551                                       
 
 
                       DEVELOPED & MAINTAINED BY: 
 
                    Anticevic Lab, Yale University 
               Mind & Brain Lab, University of Ljubljana 
                     Murray Lab, Yale University 
 
                      COPYRIGHT & LICENSE NOTICE: 
 
Use of this software is subject to the terms and conditions defined in 
'LICENSES' which is a part of the QuNex Suite source code package: 
https://gitlab.qunex.yale.edu/qunex/qunex/-/tree/master/LICENSES 
 
 ---> Setting up Octave  


 ........................ Running QuNex v0.97.3 ........................ 


--- Full QuNex call for command: create_conc 

gmri create_conc --sessionsfolder="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions" --concname="dentalvpress" --bolds="3,4" --boldname="BOLD" --bold_tail="_Atlas_MSMAll_hp0_clean.dtseries.nii" --batchfile="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/processing/batch_K99Aim2.txt" --sessions="10001,10002,10004,10005,10006,10007,10009,10011,10012,10013,10014,10015,10016,10018,10019,10021,10022,10023,10024,10030,10031,10033,10034,10035,10036,10037,10038,10039,10041,10042,11004,11006,11009,11012,11015,20001,20002,20004,20005,20006,20008,20010,20011,20012,20013,20015,20016,20017,20018,20019,20021,20022" 

--------------------------------------------------------- 


started running create_conc at 2023-05-11 10:44:04, track progress in /home/moanae/shared/project_K99_ChrTMDHCP_qunex02/processing/logs/comlogs/create_conc_/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/processing/tmp_batch_K99Aim2.txt_2023-05-11_10.44.04.068942.log
call: gmri create_conc sessionsfolder="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions" concname="dentalvpress" bolds="3,4" boldname="BOLD" bold_tail="_Atlas_MSMAll_hp0_clean.dtseries.nii" sessions="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/processing/batch_K99Aim2.txt" sessionids="10001,10002,10004,10005,10006,10007,10009,10011,10012,10013,10014,10015,10016,10018,10019,10021,10022,10023,10024,10030,10031,10033,10034,10035,10036,10037,10038,10039,10041,10042,11004,11006,11009,11012,11015,20001,20002,20004,20005,20006,20008,20010,20011,20012,20013,20015,20016,20017,20018,20019,20021,20022"
-----------------------------------------


ERROR
Traceback (most recent call last):
  File "/opt/qunex/python/qx_utilities/general/core.py", line 570, in runWithLog
    result = function(**args)
TypeError: create_conc() got an unexpected keyword argument 'sessionids'


-----------------------------------------
Finished at 2023-05-11 10:44:04


Weeks unfortunately …

You can also try without the batchfile, the bug happens because of weird interaction between batchfile and sessions when both are provided. Do you have access to any older QuNex versions perhaps?

# variables
study_sharedfolder=/home/moanae/shared/project_K99_ChrTMDHCP_qunex02
subjID_list="10001,10002,10004,10005,10006,10007,10009,10011,10012,10013,10014,10015,10016,10018,10019,10021,10022,10023,10024,10030,10031,10033,10034,10035,10037,10038,10039,10041,10042,11004,11006,11009,11015,20001,20004,20005,20006,20008,20010,20011,20012,20013,20015,20016,20017,20018,20019,20021,20022"

# command
qunex_container create_conc \
--sessions=${subjID_list} --sessionsfolder=${study_sharedfolder}/sessions  \
--concname="dentalvpress" --bolds="3,4" --boldname="BOLD" --bold_tail="_Atlas_MSMAll_hp0_clean.dtseries.nii" \
-bind=${study_sharedfolder}:${study_sharedfolder} --container=${HOME}/qunex/qunex_suite-0.97.3.sif

Jure

I came up with a short bash code to generate the conc files:

study_sharedfolder=/home/moanae/shared/project_K99_ChrTMDHCP_qunex02; bold_run_list="BOLD_3 BOLD_4"; \
subjID_list="10001 10002 10004 10005 10006 10007 10009 10011 10012 10013 10014 10015 10016 10018 10019 10021 10022 10023 10024 10030 10031 10033 10034 10035 10037 10038 10039 10041 10042 11004 11006 11009 11015 20001 20004 20005 20006 20008 20010 20011 20012 20013 20015 20016 20017 20018 20019 20021 20022"; \
for subjID in ${subjID_list}; do \
> ${study_sharedfolder}/sessions/inbox/concs/${subjID}_dentalvpress.conc; count=0; bold_path_list=""; \
for bold_run in ${bold_run_list}; do \
bold_path_list="${bold_path_list} `ls ${study_sharedfolder}/sessions/${subjID}/hcp/${subjID}/MNINonLinear/Results/${bold_run}/${bold_run}_Atlas_hp0_clean.dtseries.nii`"; \
((count++)); \
done; \
echo "number_of_files: ${count}" >> ${study_sharedfolder}/sessions/inbox/concs/${subjID}_dentalvpress.conc; \
for bold_path in ${bold_path_list}; do \
echo -e "\tfile:${bold_path}" >> ${study_sharedfolder}/sessions/inbox/concs/${subjID}_dentalvpress.conc; \
done; \
done

Then I tried to run join_fidl_folder but it found an error:

study_sharedfolder=/home/moanae/shared/project_K99_ChrTMDHCP_qunex02; \
qunex_container join_fidl_folder \
--concfolder=${study_sharedfolder}/sessions/inbox/concs \
--fidlfolder=${study_sharedfolder}/sessions/inbox/events \
--bind=${study_sharedfolder}:${study_sharedfolder} --container=${HOME}/qunex/qunex_suite-0.97.3.sif
cn2107:~ moana004$ study_sharedfolder=/home/moanae/shared/project_K99_ChrTMDHCP_qunex02; \
> qunex_container join_fidl_folder \
> --concfolder=${study_sharedfolder}/sessions/inbox/concs \
> --fidlfolder=${study_sharedfolder}/sessions/inbox/events \
> --bind=${study_sharedfolder}:${study_sharedfolder} --container=${HOME}/qunex/qunex_suite-0.97.3.sif
cn2107:~ moana004$ --> unsetting the following environment variables: PATH MATLABPATH PYTHONPATH QUNEXVer TOOLS QUNEXREPO QUNEXPATH QUNEXEXTENSIONS QUNEXLIBRARY QUNEXLIBRARYETC TemplateFolder FSL_FIXDIR FREESURFERDIR FREESURFER_HOME FREESURFER_SCHEDULER FreeSurferSchedulerDIR WORKBENCHDIR DCMNIIDIR DICMNIIDIR MATLABDIR MATLABBINDIR OCTAVEDIR OCTAVEPKGDIR OCTAVEBINDIR RDIR HCPWBDIR AFNIDIR PYLIBDIR FSLDIR FSLGPUDIR PALMDIR QUNEXMCOMMAND HCPPIPEDIR CARET7DIR GRADUNWARPDIR HCPPIPEDIR_Templates HCPPIPEDIR_Bin HCPPIPEDIR_Config HCPPIPEDIR_PreFS HCPPIPEDIR_FS HCPPIPEDIR_PostFS HCPPIPEDIR_fMRISurf HCPPIPEDIR_fMRIVol HCPPIPEDIR_tfMRI HCPPIPEDIR_dMRI HCPPIPEDIR_dMRITract HCPPIPEDIR_Global HCPPIPEDIR_tfMRIAnalysis HCPCIFTIRWDIR MSMBin HCPPIPEDIR_dMRITractFull HCPPIPEDIR_dMRILegacy AutoPtxFolder FSL_GPU_SCRIPTS FSLGPUBinary EDDYCUDADIR USEOCTAVE QUNEXENV CONDADIR MSMBINDIR MSMCONFIGDIR R_LIBS FSL_FIX_CIFTIRW FSFAST_HOME SUBJECTS_DIR MINC_BIN_DIR MNI_DIR MINC_LIB_DIR MNI_DATAPATH FSF_OUTPUT_FORMAT
 
Generated by QuNex 
------------------------------------------------------------------------ 
Version: 0.97.3 
User: moana004 
System: cn2107 
OS: RedHat Linux #1 SMP Tue Mar 7 15:41:52 UTC 2023 
------------------------------------------------------------------------ 
 
        \u2588\u2588\u2588\u2588\u2588\u2588\                  \u2551      \u2588\u2588\   \u2588\u2588\                        
       \u2588\u2588  __\u2588\u2588\                 \u2551      \u2588\u2588\u2588\  \u2588\u2588 |                       
       \u2588\u2588 /  \u2588\u2588 |\u2588\u2588\   \u2588\u2588\       \u2551      \u2588\u2588\u2588\u2588\ \u2588\u2588 | \u2588\u2588\u2588\u2588\u2588\u2588\ \u2588\u2588\   \u2588\u2588\     
       \u2588\u2588 |  \u2588\u2588 |\u2588\u2588 |  \u2588\u2588 |      \u2551      \u2588\u2588 \u2588\u2588\\u2588\u2588 |\u2588\u2588  __\u2588\u2588\\\u2588\u2588\ \u2588\u2588  | 
       \u2588\u2588 |  \u2588\u2588 |\u2588\u2588 |  \u2588\u2588 |      \u2551      \u2588\u2588 \\u2588\u2588\u2588\u2588 |\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588 |\\u2588\u2588\u2588\u2588  /     
       \u2588\u2588 \u2588\u2588\\u2588\u2588 |\u2588\u2588 |  \u2588\u2588 |      \u2551      \u2588\u2588 |\\u2588\u2588\u2588 |\u2588\u2588   ____|\u2588\u2588  \u2588\u2588\      
       \\u2588\u2588\u2588\u2588\u2588\u2588 / \\u2588\u2588\u2588\u2588\u2588\u2588  |      \u2551      \u2588\u2588 | \\u2588\u2588 |\\u2588\u2588\u2588\u2588\u2588\u2588\u2588\\u2588\u2588  /\\u2588\u2588\     
        \___\u2588\u2588\u2588\  \______/       \u2551      \__|  \__| \_______\__/  \__|    
            \___|                \u2551                                       
 
 
                       DEVELOPED & MAINTAINED BY: 
 
                    Anticevic Lab, Yale University 
               Mind & Brain Lab, University of Ljubljana 
                     Murray Lab, Yale University 
 
                      COPYRIGHT & LICENSE NOTICE: 
 
Use of this software is subject to the terms and conditions defined in 
'LICENSES' which is a part of the QuNex Suite source code package: 
https://gitlab.qunex.yale.edu/qunex/qunex/-/tree/master/LICENSES 
 
 ---> Setting up Octave  


 ........................ Running QuNex v0.97.3 ........................ 


--- Full QuNex call for command: join_fidl_folder 

gmri join_fidl_folder --concfolder="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions/inbox/concs" --fidlfolder="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions/inbox/events" 

--------------------------------------------------------- 


started running join_fidl_folder at 2023-05-11 11:33:55, track progress in /home/moanae/moana004/comlogs/tmp_join_fidl_folder_2023-05-11_11.33.55.445152.log
call: gmri join_fidl_folder concfolder="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions/inbox/concs" fidlfolder="/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions/inbox/events"
-----------------------------------------

===> reading 10001_dentalvpress.conc
 ... 2 bolds: 3 

ERROR
Traceback (most recent call last):
  File "/opt/qunex/python/qx_utilities/general/core.py", line 570, in runWithLog
    result = function(**args)
  File "/opt/qunex/python/qx_utilities/general/fidl.py", line 249, in join_fidl_folder
    join_fidl(concfile, root, outfolder, fidlname)
  File "/opt/qunex/python/qx_utilities/general/fidl.py", line 149, in join_fidl
    bolddata = readConc(concfile, TR)
  File "/opt/qunex/python/qx_utilities/general/fidl.py", line 94, in readConc
    length = boldInfo(boldfile).frames * TR
  File "/opt/qunex/python/qx_utilities/general/fidl.py", line 50, in boldInfo
    hdr = gi.niftihdr(boldfile)
  File "/opt/qunex/python/qx_utilities/general/img.py", line 387, in __init__
    self.readHeader(filename)
  File "/opt/qunex/python/qx_utilities/general/img.py", line 571, in readHeader
    self.unpackHdr(h)
  File "/opt/qunex/python/qx_utilities/general/img.py", line 472, in unpackHdr
    e, = struct.unpack(">i", s.read(si))                        # int       - must be 348
  File "/opt/env/qunex/lib/python3.7/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xa4 in position 56: invalid start byte


-----------------------------------------
Finished at 2023-05-11 11:33:55

I pasted below the conc and fidl files for an example participant. What do you think could be causing this error?

conc file

number_of_files: 2
	file:/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions/10001/hcp/10001/MNINonLinear/Results/BOLD_3/BOLD_3_Atlas_hp0_clean.dtseries.nii
	file:/home/moanae/shared/project_K99_ChrTMDHCP_qunex02/sessions/10001/hcp/10001/MNINonLinear/Results/BOLD_4/BOLD_4_Atlas_hp0_clean.dtseries.nii

fidl file

0.937   dentalvpress_OFF    dentalvpress_ON
0   0   9
9   1   30
39  0   30
69  1   30
99  0   30
129 1   30
159 0   30
189 1   30
219 0   30
249 1   30
279 0   30
309 1   30
339 0   54

Hi, it seems like the file is not encoded with UTF-8 which is the encoding used for creating and reading files in QuNex.

In Linux, you can check the current encoding of the file with:

file -i filename.conc

Next, you can change the encoding to UTF-8 with:

iconv -f <old_encoding> -t utf-8 filename.conc > new_filename.conc

Hope it works!

Jure