Framework

• Investigated ONNX usage of memory allocation.
  • Onnx can make use of them in initialisation, but somehow not in layer-wise (temporary) allocations

• MIGraphX failure on build
  • Requires: migraphx-devel hipblaslt-devel

[533/1835] Scanning /scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_execution_provider_info.cc for CXX dependencies
FAILED: CMakeFiles/onnxruntime_providers_migraphx.dir/scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_execution_provider_info.cc.o.ddi 
/scratch/csonnabe/MyO2/sw/slc9_x86-64/GCC-Toolchain/v14.2.0-alice2-1/bin/c++ -DCPUINFO_SUPPORTED_PLATFORM=1 -DEIGEN_MPL2_ONLY -DEIGEN_USE_THREADS -DENABLE_CPU_FP16_TRAINING_OPS -DHAS_STRING_VIEW=1 -DMIOPEN_VERSION=30300 -DONLY_C_LOCALE=0 -DONNXIFI_BUILD_LIBRARY=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx -DORT_ENABLE_STREAM -DPLATFORM_POSIX -DROCM_VERSION=60302 -DUSE_MIGRAPHX=1 -DUSE_PROF_API=1 -DUSE_ROCM=1 -D_GNU_SOURCE -D__HIP_PLATFORM_AMD__=1 -D__ONNX_DISABLE_STATIC_REGISTRATION -Donnxruntime_providers_migraphx_EXPORTS -I/scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/include/onnxruntime -I/scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/include/onnxruntime/core/session -I/scratch/csonnabe/MyO2/sw/slc9_x86-64/pytorch_cpuinfo/alice1-3/include -I/scratch/csonnabe/MyO2/sw/BUILD/ff69defdb056aee197ee5b00d887c93e809528b3/ONNXRuntime -I/scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime -I/scratch/csonnabe/MyO2/sw/slc9_x86-64/safe_int/v3.0.28a-1/include -I/scratch/csonnabe/MyO2/sw/slc9_x86-64/ms_gsl/4.0.0-19/include -I/scratch/csonnabe/MyO2/sw/slc9_x86-64/date/v3.0.3-2/include -I/scratch/csonnabe/MyO2/sw/BUILD/ff69defdb056aee197ee5b00d887c93e809528b3/ONNXRuntime/amdgpu/onnxruntime -isystem /scratch/csonnabe/MyO2/sw/slc9_x86-64/abseil/20240722.0-2/include -isystem /scratch/csonnabe/MyO2/sw/slc9_x86-64/onnx/v1.17.0-alice2-6/include -isystem /scratch/csonnabe/MyO2/sw/slc9_x86-64/protobuf/v29.3-2/include -isystem /scratch/csonnabe/MyO2/sw/slc9_x86-64/flatbuffers/v24.3.25-10/include -isystem /scratch/csonnabe/MyO2/sw/slc9_x86-64/boost/v1.83.0-alice2-38/include -isystem /opt/rocm/include -isystem /opt/rocm-6.3.2/include -fPIC -O2 -std=c++20 -Wno-unknown-warning -Wno-unknown-warning-option -Wno-pass-failed -Wno-error=unused-but-set-variable -Wno-pass-failed=transform-warning -Wno-error=deprecated -Wno-error=maybe-uninitialized -Wno-error=deprecated-enum-enum-conversion -Wno-error -Wno-error=missing-requires -w -ffunction-sections -fdata-sections -DCPUINFO_SUPPORTED -Wno-unused-parameter -O3 -DNDEBUG -fPIC -Wno-deprecated-declarations -Wall -Wextra -Wno-deprecated-copy -Wno-nonnull-compare -w -Wno-error=sign-compare -Werror -E -x c++ /scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_execution_provider_info.cc -MT CMakeFiles/onnxruntime_providers_migraphx.dir/scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_execution_provider_info.cc.o.ddi -MD -MF CMakeFiles/onnxruntime_providers_migraphx.dir/scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_execution_provider_info.cc.o.ddi.d -fmodules-ts -fdeps-file=CMakeFiles/onnxruntime_providers_migraphx.dir/scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_execution_provider_info.cc.o.ddi -fdeps-target=CMakeFiles/onnxruntime_providers_migraphx.dir/scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_execution_provider_info.cc.o -fdeps-format=p1689r5 -o CMakeFiles/onnxruntime_providers_migraphx.dir/scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_execution_provider_info.cc.o.ddi.i
In file included from /scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_inc.h:8,
                 from /scratch/csonnabe/MyO2/sw/SOURCES/ONNXRuntime/ee70b3049a/0/onnxruntime/core/providers/migraphx/migraphx_execution_provider_info.cc:9:
/opt/rocm/include/migraphx/migraphx.hpp:1234:5: error: module control-line cannot be in included file
 1234 |     module get_main_module()
      |     ^~~~~~
/opt/rocm/include/migraphx/migraphx.hpp:1248:5: error: module control-line cannot be in included file
 1248 |     module create_module(const std::string& name)
      |     ^~~~~~
cc1plus: note: unrecognized command-line option '-Wno-pass-failed=transform-warning' may have been intended to silence earlier diagnostics
cc1plus: note: unrecognized command-line option '-Wno-pass-failed' may have been intended to silence earlier diagnostics
cc1plus: note: unrecognized command-line option '-Wno-unknown-warning-option' may have been intended to silence earlier diagnostics
cc1plus: note: unrecognized command-line option '-Wno-unknown-warning' may have been intended to silence earlier diagnostics

Physics

• Enlarging the data volume and rerunning QA: 5x50Ev 0-5% centrality
• Trying to combine digit files -> Would make QA a lot easier (wrote a task, but its quite memory heavy)
• Implementing full PID calibration chain -> As per Silvias request for the PhD thesis. Will do it on raw data of e.g. 24as
  
  

Other

• Potential bug in ppl-workflow.sh?
  

  export GPUTYPE=CPU
  export RAWINPUTDIR="/scratch/csonnabe/PhD/jobs/simulation/output/test_sim_2"
  export WORKFLOW_DETECTORS=ITS,TPC,TRD,TOF,FT0,CTP
  export TRD_SOURCES=ITS-TPC
  export TOF_SOURCES=ITS-TPC,ITS-TPC-TRD
  export HMP_SOURCES=
  export TRACK_SOURCES=ITS-TPC,ITS-TPC-TRD,ITS-TPC-TOF,ITS-TPC-TRD-TOF,ITS,TPC,TOF,FT0,TRD,CTP
  export VERTEXING_SOURCES=ITS-TPC,ITS-TPC-TRD,ITS-TPC-TOF,ITS-TPC-TRD-TOF,ITS,TPC,TOF,FT0,TRD,CTP
  export VERTEX_TRACK_MATCHING_SOURCES=ITS-TPC,ITS-TPC-TRD,ITS-TPC-TOF,ITS-TPC-TRD-TOF,ITS,TPC,TOF,FT0,TRD,CTP
  export SVERTEXING_SOURCES=ITS-TPC,ITS-TPC-TRD,ITS-TPC-TOF,ITS-TPC-TRD-TOF,ITS,TPC,TOF,FT0,TRD,CTP
  export AOD_SOURCES=ITS-TPC,ITS-TPC-TRD,ITS-TPC-TOF,ITS-TPC-TRD-TOF,ITS,TPC,TOF,FT0,TRD,CTP
  export WORKFLOW_PARAMETERS="AOD,CALIB,CTF,EVENT_DISPLAY"
  export WORKFLOW_EXTRA_PROCESSING_STEPS="MATCH_SECVTX,ZDC_RECO"
  export WORKFLOWMODE="print"
  
  $O2_ROOT/prodtests/full-system-test/dpl-workflow.sh

• Duplicate run-number option in aod-producer and raw file reader