[2021-07-07 11:53:21.054][I] [FMQ] ______ _ _______ _________ / ____/___ _(_)_______ |/ /_ __ \ version 1.4.38 / /_ / __ `/ / ___/__ /|_/ /_ / / / build RELWITHDEBINFO / __/ / /_/ / / / _ / / / / /_/ / https://github.com/FairRootGroup/FairMQ /_/ \__,_/_/_/ /_/ /_/ \___\_\ LGPL-3.0 © 2012-2021 GSI [2021-07-07 11:53:21.055][D] DataDistLogger: Checking O2_INFOLOGGER_MODE variable [2021-07-07 11:53:21.055][I] DataDistLogger: O2_INFOLOGGER_MODE backend is not set. [2021-07-07 11:53:21.055][W] DataDistLogger: Invalid O2_INFOLOGGER_MODE. Ignoring severity-infologger=warning [2021-07-07 11:53:21.055][I] NEW RUN NUMBER. run_number=0 [2021-07-07 11:53:21.055][I] [STATE][FMQ] Starting FairMQ state machine --> IDLE [2021-07-07 11:53:21.055][D] [FMQ] PID: 71752 [2021-07-07 11:53:21.055][D] [FMQ] Loaded plugin: 'config', version '1.4.38', maintainer 'FairRootGroup ', homepage 'https://github.com/FairRootGroup/FairRoot' [2021-07-07 11:53:21.055][D] [FMQ] Loaded plugin: 'control', version '1.4.38', maintainer 'FairRootGroup ', homepage 'https://github.com/FairRootGroup/FairMQ' [2021-07-07 11:53:21.055][D] [FMQ] Running builtin controller: static [2021-07-07 11:53:21.055][D] [FMQ] Plugin 'control' is setting up signal handling for SIGINT and SIGTERM [2021-07-07 11:53:21.056][D] [FMQ] Configuration: catch-signals = 1 [default] channel-config = name=dpl-chan,type=push,method=bind,address=ipc://@tf-builder-pipe-0,transport=shmem,rateLogging=1 > [provided] color = true [default] control = static [provided] data-sink-dir = [default] data-sink-enable = false [default] data-sink-file-name = run%r_tf%i.tf [default] data-sink-max-file-size = 4096 [default] data-sink-max-stfs-per-file = 1 [default] data-sink-sidecar = false [default] data-source-copy-cmd = [default] data-source-dir = /disk/O2/data/MW2/pedestal_test/2021-03-02T16_53_11Z/aFewSavedFiles [provided] data-source-enable = true [provided] data-source-file-list = [default] data-source-headersize = 256 [default] data-source-preread = 1 [default] data-source-rate = 100 [provided] data-source-regionsize = 4096 [provided] data-source-repeat = false [default] detector = [default] detector-rdh = [unidentified_type] <[unidentified_type]> [default] detector-subspec = [unidentified_type] <[unidentified_type]> [default] dpl-channel-name = dpl-chan [provided] file-severity = nolog [default] id = stfb [provided] init-timeout = 120 [default] input-channel-name = readout [default] io-threads = 4 [default] log-to-file = [default] max-buffered-stfs = -1 [default] max-built-stfs = 0 [default] max-run-time = 0 [default] monitoring-backend = [default] monitoring-interval = 2 [default] monitoring-log = false [default] network-interface = default [default] ofi-size-hint = 0 [default] output-channel-name = builder-stf-channel [default] rate = 0 [default] rdh-data-check = [unidentified_type] <[unidentified_type]> [default] rdh-filter-empty-trigger = false [default] run-type = [unidentified_type] <[unidentified_type]> [default] session = default [provided] severity = debug [provided] severity-infologger = warning [default] shm-allocation = rbtree_best_fit [default] shm-mlock-segment = false [default] shm-monitor = true [default] shm-no-cleanup = false [default] shm-segment-id = 0 [default] shm-segment-size = 8589934592 [provided] shm-throw-bad-alloc = false [default] shm-zero-segment = false [default] stand-alone = false [default] transport = shmem [provided] verbosity = medium [default] [2021-07-07 11:53:21.056][I] [STATE][FMQ] IDLE ---> INITIALIZING DEVICE [2021-07-07 11:53:21.056][D] [FMQ] channel-config: Parsing channel configuration [2021-07-07 11:53:21.057][D] StfBuilderDevice::Init() [2021-07-07 11:53:21.057][D] [FMQ] Adding 'shmem' transport [2021-07-07 11:53:21.057][D] [FMQ] Transport: Using ZeroMQ (4.3.3) & boost::interprocess (1.75.0) [2021-07-07 11:53:21.057][D] [FMQ] Generated shmid '55da1683' out of session id 'default'. [2021-07-07 11:53:21.058][D] [FMQ] no fairmq-shmmonitor found for shared memory id 55da1683, starting... [2021-07-07 11:53:21.071][D] [FMQ] Started fairmq-shmmonitor for shared memory id 55da1683 [2021-07-07 11:53:21.072][D] [FMQ] no session info found, creating and initializing [2021-07-07 11:53:21.072][D] [FMQ] initialized session info, name: default, creator id: 1006 [2021-07-07 11:53:21.072][D] [FMQ] no event counter found, creating one and initializing with 0 [2021-07-07 11:53:21.072][D] [FMQ] initialized event counter with: 0 [2021-07-07 11:53:21.072][D] [FMQ] Created shared memory segment 'fmq_55da1683_m_0'. Size: 8589934592 bytes. Available: 8589934432 bytes. Allocation algorithm: rbtree_best_fit [2021-07-07 11:53:21.072][D] [FMQ] no device counter found, creating one and initializing with 1 [2021-07-07 11:53:21.072][D] [FMQ] initialized device counter with: 1 [2021-07-07 11:53:21.072][D] (Sub)TimeFrame Source started... [2021-07-07 11:53:21.072][D] (Sub)TimeFrame Sink created. [2021-07-07 11:53:21.073][D] [FMQ] Setting 'shmem' as default transport for the device [2021-07-07 11:53:21.073][D] [FMQ] Reusing existing 'shmem' transport [2021-07-07 11:53:21.073][D] [FMQ] Initializing transport for channel dpl-chan[0]: shmem [2021-07-07 11:53:21.073][D] [FMQ] Reusing existing 'shmem' transport [2021-07-07 11:53:21.073][I] [STATE][FMQ] INITIALIZING DEVICE ---> INITIALIZED [2021-07-07 11:53:21.073][I] [STATE][FMQ] INITIALIZED ---> BINDING [2021-07-07 11:53:21.073][D] [FMQ] Validating channel 'dpl-chan[0]'... VALID [2021-07-07 11:53:21.074][D] [FMQ] Created socket stfb.dpl-chan[0].push [2021-07-07 11:53:21.074][D] [FMQ] Attached channel dpl-chan[0] to ipc://@tf-builder-pipe-0 (bind) (push) [2021-07-07 11:53:21.074][I] [STATE][FMQ] BINDING ---> BOUND [2021-07-07 11:53:21.074][I] [STATE][FMQ] BOUND ---> CONNECTING [2021-07-07 11:53:21.074][I] [STATE][FMQ] CONNECTING ---> DEVICE READY [2021-07-07 11:53:21.074][I] [STATE][FMQ] DEVICE READY ---> INITIALIZING TASK [2021-07-07 11:53:21.075][D] Starting monitoring collection thread for ... [2021-07-07 11:53:21.075][I] Configuration: Run type: 'physics' [2021-07-07 11:53:21.075][I] Not imposing limits on number of buffered SubTimeFrames. Possibility of creating back-pressure. [2021-07-07 11:53:21.075][I] Configuration: Number of built SubTimeFrames is not limited [2021-07-07 11:53:21.075][I] (Sub)TimeFrame file sink is disabled. [2021-07-07 11:53:21.075][I] (Sub)TimeFrame file source is enabled. [2021-07-07 11:53:21.075][D] Starting monitoring sender thread for ... [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010113.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010114.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010116.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010118.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010119.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010120.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010121.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010122.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010123.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010124.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010127.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010128.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010129.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010131.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010151.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010169.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010170.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010172.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010174.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010175.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010176.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010177.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010178.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010179.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010180.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010183.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010184.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010185.tf ? no [2021-07-07 11:53:21.075][D] Checking if should remove file: 2021-03-02_00010187.tf ? no [2021-07-07 11:53:21.075][I] (Sub)TimeFrame source :: enabled = yes [2021-07-07 11:53:21.075][I] (Sub)TimeFrame source :: file location = local [2021-07-07 11:53:21.075][I] (Sub)TimeFrame source :: directory = /disk/O2/data/MW2/pedestal_test/2021-03-02T16_53_11Z/aFewSavedFiles [2021-07-07 11:53:21.075][I] (Sub)TimeFrame source :: (s)tf load rate = 100 [2021-07-07 11:53:21.075][I] (Sub)TimeFrame source :: (s)tf pre reads = 1 [2021-07-07 11:53:21.075][I] (Sub)TimeFrame source :: repeat data = false [2021-07-07 11:53:21.075][I] (Sub)TimeFrame source :: num files in dataset = 29 [2021-07-07 11:53:21.075][I] (Sub)TimeFrame source :: data region size(MiB) = 4096 [2021-07-07 11:53:21.075][I] (Sub)TimeFrame source :: header region size(MiB) = 256 [2021-07-07 11:53:21.075][I] DPL Channel name: dpl-chan [2021-07-07 11:53:21.075][D] SubTimeFrameFileSink started [2021-07-07 11:53:21.075][W] MemoryResource: Memory locking disabled via DATADIST_NO_MLOCK env variable. Not suitable for production. [2021-07-07 11:53:21.075][I] Creating new UnmanagedRegion name=O2HeadersRegion_FileSource path= size=268435456 [2021-07-07 11:53:21.075][I] StfOutputThread: sending data to channel: dpl-chan[0] [2021-07-07 11:53:21.075][D] [FMQ] no region counter found, creating one and initializing with 1 [2021-07-07 11:53:21.075][D] [FMQ] initialized region counter with: 1 [2021-07-07 11:53:21.229][D] [FMQ] Zeroing free memory of region 1... [2021-07-07 11:53:21.279][D] [FMQ] Successfully zeroed free memory of region 1. [2021-07-07 11:53:21.279][W] MemoryResource: Memory locking disabled via DATADIST_NO_MLOCK env variable. Not suitable for production. [2021-07-07 11:53:21.279][I] Creating new UnmanagedRegion name=O2DataRegion_FileSource path= size=4294967296 [2021-07-07 11:53:21.279][D] [FMQ] region counter found, with value of 1. incrementing. [2021-07-07 11:53:21.279][D] [FMQ] incremented region counter, now: 2 [2021-07-07 11:53:23.912][D] [FMQ] Zeroing free memory of region 2... [2021-07-07 11:53:24.840][D] [FMQ] Successfully zeroed free memory of region 2. [2021-07-07 11:53:24.840][I] InitTask() done... [2021-07-07 11:53:24.841][I] [STATE][FMQ] INITIALIZING TASK ---> READY [2021-07-07 11:53:24.841][I] (Sub)TimeFrame Source: Injecting new STF every 10000 us [2021-07-07 11:53:24.841][I] [STATE][FMQ] READY ---> RUNNING [2021-07-07 11:53:24.841][I] [FMQ] DEVICE: Running... [2021-07-07 11:53:24.842][D] (Sub)TimeFrame Source: reading new file=/disk/O2/data/MW2/pedestal_test/2021-03-02T16_53_11Z/aFewSavedFiles/2021-03-02_00010113.tf [2021-07-07 11:53:24.842][I] Restarting file source. [2021-07-07 11:53:24.842][I] Entering running state. RunNumber: 0 terminate called after throwing an instance of 'boost::wrapexcept' what(): failed opening file: Permission denied: iostream error /home/dsilverm/runStfBuilder.sh: line 19: 71752 Aborted StfBuilder --id stfb --session default --transport shmem --shm-segment-size ${GLOBAL_SHMSIZE} --dpl-channel-name dpl-chan --channel-config "name=dpl-chan,type=push,method=bind,address=ipc://@tf-builder-pipe-0,transport=shmem,rateLogging=1" --data-source-dir ${TF_DIR} --data-source-rate=100 --data-source-regionsize=${DATA_SHMSIZE} --data-source-enable --severity debug --control=static