Effective Data Taking and Quality Monitoring in EEE Run Coordination Meeting

 
Introduzione al DQM
 
D. De Gruttola
Centro Fermi Roma
 
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
Summary
 
basis for a good 
data
 taking
EEE Data Quality Monitor (
DQM
)
main quantities to be monitored
data and tools to 
analyze 
them
 
2
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
3
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
24/10/2018
Data Taking and Data Quality Monitor (DQM)
effective data taking period (
duty
cycle
)
 
needs to be 
the highest
possible
costant acquisition to perform
several measurements (a few
examples here)
data taking 
and 
DQM 
are crucial
each school 
has the 
needed
 
tools
to:
access DQM
check the correct behavior of the
       telescope
perform 
data analysis 
to study performance
and physics phenomena
4
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
24/10/2018
-
24 copper 
strips 
to pick up the signal
-
trigger
: six-fold coincidence (two
chamber sides and three chambers)
x
y
- X coordinate determined by the fired strip
- Y coordinate obtained by measuring the time
difference between the signals on the two
sides of the chamber
x
y
15/04/2015
Position of the hits
 
DQM and quantities to be monitored
 
5
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
!!! each member of the Collaboration can monitor and analyze data from all the EEE telescopes !!!
 
Data Quality Monitor
 
 
https://iatw.cnaf.infn.it/eee/monitor/
 
6
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
information on the last run transferred to CNAF are given
per each school
the status of a school is 
GREEN
 if there is a transfer in the
last 3 hours, with reasonable paramaters of the run (rate,
fraction of reconstructed tracks, …)
links to check the data quality, by means of DQM plots, are
given per each telescope
DQM home page
https://iatw.cnaf.infn.it/eee/monitor/
online global monitor of all sites of the project
7
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
24/10/2018
 
8
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
link to transfer
history
 
list of daily reports from
DQM
 
link to
quantities
to be
monitored
 
trigger rate
 
reconstructed
tracks rate
 
 
https://iatw.cnaf.infn.it/eee/monitor/
 
DQM home page
 
9
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
Telescopes acceptance
 
a tracking algorithm reconstructs trakcs crossing the telescope, by using the hits on each
chamber
 
DQM is a basic tool to monitor the quality of the data taking
 
many quantities can be monitored online:
 
track lenght
Time of flight
angular distributiond
track quality (
2
)
multiplicity
trigger rate , rate of events with hits, rate of events with good tracks
DQM: rate, pressure and temperature
Daily
 report of rate, pressure and temperature
click
10
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
24/10/2018
11
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
24/10/2018
history
 rate, pressure and temperature monitor
click
DQM: rate, pressure and temperature
12
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
24/10/2018
DQM: histograms and alarms
histograms 
and 
alarms 
automatically produced by DQM
click
13
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
24/10/2018
DQM: 
multiplicity
single hit
cluster
hit multipliciity 
cluster multipliciity 
constant monitoring of event multiplicity
need of interventions on the telescope in case 
      the multiplicity is peaked at high values
 
2
 
t
r
a
c
k
s
 
d
i
s
t
r
i
b
u
t
i
o
n
2
 
m
e
a
s
u
r
e
s
 
t
h
e
 
s
h
i
f
t
 
o
f
 
t
h
e
 
t
r
a
c
k
 
w
r
t
 
h
i
t
s
 
r
a
n
d
o
m
l
y
 
a
l
i
g
n
e
d
h
i
t
s
a
n
d
 
t
r
a
c
k
s
 
o
f
s
c
a
t
t
e
r
e
d
 
p
a
r
t
i
c
l
e
s
:
tracks with high 
2
 
tracks with 1< 
2
 < 10:
particle candidates
 
DQM: tracks and 
2
 
global measurement
 
14
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
t
r
e
n
d
i
n
g
 
(
m
e
a
s
u
r
e
m
e
n
t
 
v
s
 
t
i
m
e
)
 
rate of good tracks,
i.e. with 
2
 
< 10
 
rate of events with at least one
good track
 
DQM: tracks and 
2
 
15
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
16
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
d
e
l
t
a
 
t
i
m
e
 
d
i
s
t
r
i
b
u
t
i
o
n
b
etween two consecutive trigger events
slope inversely proportional to trigger rate
 
DQM: 
time difference between two events
 
y = e
-R
T
 
R = rate 
 1/R = mean
 
a
n
g
u
l
a
r
 
d
i
s
t
r
i
b
u
t
i
o
n
s
:
 
a
z
i
m
u
t
h
a
l
 
a
n
d
 
p
o
l
a
r
 
a
n
g
l
e
 
DQM: 
angular distributions
 
Azimuthal distribution
 (bigger acceptance in the corners)
 
Polar distribution
(affected by telescope acceptance)
 
17
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
d
i
s
t
r
i
b
u
t
i
o
n
s
 
o
f
 
t
i
m
e
 
o
f
 
f
l
i
g
h
t
 
(
T
O
F
)
 
a
n
d
 
t
r
a
c
k
 
l
e
n
g
h
t
 
distance between
chambers 1 and 3
 
TOF ~ 3.3 ns 
 d= 1m
(d = distanza tra le camere)
 
DQM: 
time of flight and track lenght
 
tilted
tracks
 
18
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
19
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
24/10/2018
DQM: file csv per analisi dati
download
 dei file dati:
csv header 
 summary for one run
cdv trending 
 trending of measured quantities
csv weather 
 temperature and pressure
Data collected in csv (comma
separated values) files
They can be analised in Excel
 
20
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
DQM: file root per analisi dati
 
Data are also collected as root files
root is a framework written in c++
 
21
 
D. De Gruttola 
 EEE Run Coordination Meeting open to schools
 
24/10/2018
 
It is possible to retrieve some data from several runs by using the elog
Real data and MC data are available
This tool has been used for ICD 2017
 
Cut to have good tracks
 
Chose a telescope
 
Chose date
(no more than 2 or 3 days)
Please check output dimensions
before asking many days and have
too big files
 
Tip it if you want MC data
 
E-log: data query
 
Back up
 
Team Viewer and Data Taking
 
!!! remote control of all the telescopes is always possible!!!
 
multeplicity
 of 24
channels of a single FEA
possibility to check
     the correct behavior
     of each single channel
    and identify 
dead
 or
    
noisy 
channels
 
Strip multiplicity
 
molteplicity
 of triggered
      events
number of strips giving
      a signal in each event
the distribuzione has to
      be peaked at 1
 
Event multiplicity
 
Analysis example
 
dependence of rate from temperature and pressure(lecture from I. Gnesi, 16 April)
effect of solar flares on the cosmic ray flux (lecture from I. Gnesi, 16 April)
 
Barometric corrections
 
d
i
d
a
c
t
i
c
 
e
x
p
e
r
i
m
e
n
t
s
 
o
n
 
c
o
s
m
i
c
 
r
a
y
s
m
e
a
s
u
r
e
m
e
n
t
 
w
i
t
h
 
G
e
i
g
e
r
 
c
o
u
n
t
e
r
s
 
 
 
 
 
 
a
n
d
 
s
c
i
n
t
i
l
l
a
t
o
r
s
 
m
e
a
s
u
r
e
m
e
n
t
 
o
f
 
t
h
e
b
a
r
o
m
e
t
r
i
c
 
e
f
f
e
c
t
 
p
r
e
s
s
u
r
e
 
v
a
r
i
a
t
i
o
n
s
a
f
f
e
c
t
 
t
h
e
 
s
e
c
o
n
d
a
r
y
c
o
s
m
i
c
 
r
a
y
 
f
l
u
x
a
c
c
o
r
d
i
n
g
 
t
o
 
t
h
e
 
l
a
w
:
 
I
 
=
 
-
p
 
atmospheric pressure
 
yield corrected by pressure
 
muon yield
 
a
t
m
o
s
p
h
e
r
i
c
 
p
r
e
s
s
u
r
e
 
i
s
 
a
 
d
i
r
e
c
t
 
m
e
a
s
u
r
e
m
e
n
t
 
o
f
 
t
h
e
a
m
o
u
n
t
 
o
f
 
a
i
r
 
t
o
 
b
e
 
c
r
o
s
s
e
d
 
b
y
 
a
 
s
h
o
w
e
r
 
b
e
f
o
r
e
r
e
a
c
h
i
n
g
 
t
h
e
 
t
e
l
e
s
c
o
p
e
 
p
r
e
s
s
u
r
e
 
v
a
r
i
a
t
i
o
n
s
 
c
a
u
s
e
v
a
r
i
a
t
i
o
n
s
 
i
n
 
t
h
e
 
p
a
r
t
i
c
l
e
 
f
l
u
x
m
e
a
s
u
r
e
d
 
b
y
 
t
h
e
 
t
e
l
e
s
c
o
p
e
 
Barometric corrections
 
pressure can be read
b
y
 
w
e
a
t
h
e
r
 
s
t
a
t
i
o
n
 
(
i
f
 
p
o
s
s
i
b
l
e
)
b
y
 
s
i
t
i
 
d
i
 
r
i
l
e
v
a
m
e
n
t
o
 
n
e
l
l
e
 
v
i
c
i
n
a
n
z
e
 
Pressure monitoring
 
i
f
 
m
e
a
n
 
m
u
l
t
i
p
l
i
c
i
t
y
g
r
e
a
t
e
r
 
t
h
a
n
 
2
,
 
a
n
i
n
t
e
r
v
e
n
t
i
o
n
 
i
s
 
n
e
e
d
e
d
:
n
e
e
d
 
t
o
 
t
u
n
e
 
t
h
e
 
c
h
a
m
b
e
r
v
o
l
t
a
g
e
 
o
r
 
t
h
e
 
i
n
t
e
r
n
a
l
t
e
m
p
e
r
a
t
u
r
e
 
ottobre
 
luglio
 
Bad behavior
 
o
n
c
e
 
t
h
e
 
f
l
u
x
 
i
s
 
c
o
r
r
e
c
t
e
d
 
b
y
a
t
m
o
s
p
h
e
r
i
c
 
p
r
e
s
s
u
r
e
 
p
h
y
s
i
c
s
o
b
s
e
r
v
a
b
l
e
s
 
b
e
c
o
m
e
 
v
i
s
i
b
l
e
 
Cosmic Ray Flux
Decrease
 
d
a
y
/
n
i
g
h
t
m
o
d
u
l
a
t
i
o
n
 
+
 
t
h
e
r
m
a
l
 
d
r
i
f
t
 
Barometric corrections
 
DQM: csv files for data analysis
 
download
 of data files:
 
csv header 
 summary of run information
cdv trending 
 quantities vs time
csv weather 
 data of temperature and pressure
 
data are collected in csv files
(comma separated values)
and can be analyszed by Excel
 
data are collected also in root files
root is a framework written in c++
 
DQM: root files for data analysis
Slide Note
Embed
Share

The Data Quality Monitor (DQM) plays a crucial role in ensuring the effective data taking period in the EEE Run Coordination Meeting for schools. It involves monitoring key quantities using specific tools, analyzing data, and checking for correct behavior. The acquisition of data is essential for studying performance and physics phenomena, with each school having necessary tools to access and utilize DQM. The coordination meeting emphasizes the importance of continuous monitoring and analysis for optimal data quality.


Uploaded on Aug 17, 2024 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript


  1. Introduzione al DQM D. De Gruttola Centro Fermi Roma D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  2. Summary basis for a good data taking EEE Data Quality Monitor (DQM) main quantities to be monitored data and tools to analyze them 2 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  3. Data Taking and Data Quality Monitor (DQM) effective data taking period (duty cycle)needs to be the highest possible costant acquisition to perform several measurements (a few examples here) data taking and DQM are crucial each school has the neededtools to: telescope perform data analysis to study performance and physics phenomena access DQM check the correct behavior of the 3 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  4. Position of the hits x - - 24 copper strips to pick up the signal trigger: six-fold coincidence (two chamber sides and three chambers) x y - X coordinate determined by the fired strip - Y coordinate obtained by measuring the time difference between the signals on the two sides of the chamber y 4 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018 15/04/2015

  5. DQM and quantities to be monitored 5 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  6. Data Quality Monitor https://iatw.cnaf.infn.it/eee/monitor/ https://iatw.cnaf.infn.it/eee/monitor/ !!! each member of the Collaboration can monitor and analyze data from all the EEE telescopes !!! 6 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  7. DQM home page https://iatw.cnaf.infn.it/eee/monitor/ https://iatw.cnaf.infn.it/eee/monitor/ information on the last run transferred to CNAF are given per each school the status of a school is GREEN if there is a transfer in the last 3 hours, with reasonable paramaters of the run (rate, fraction of reconstructed tracks, ) number of collected tracks links to check the data quality, by means of DQM plots, are given per each telescope v v v online global monitor of all sites of the project 7 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  8. DQM home page https://iatw.cnaf.infn.it/eee/monitor/ https://iatw.cnaf.infn.it/eee/monitor/ list of daily reports from DQM trigger rate link to transfer history reconstructed tracks rate link to quantities to be monitored 8 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  9. Telescopes acceptance a tracking algorithm reconstructs trakcs crossing the telescope, by using the hits on each chamber DQM is a basic tool to monitor the quality of the data taking many quantities can be monitored online: track lenght Time of flight angular distributiond track quality ( 2) multiplicity trigger rate , rate of events with hits, rate of events with good tracks 9 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  10. DQM: rate, pressure and temperature Daily report of rate, pressure and temperature click immediate detecting: noisy periods high trigger rate low reconstruction efficiency immediate detecting: Important temperature fluctuations pressure fluttuations useful to find good periods to get barometric corrections telescope inactivity 10 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  11. DQM: rate, pressure and temperature history rate, pressure and temperature monitor click 11 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  12. DQM: histograms and alarms histograms and alarms automatically produced by DQM click 12 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  13. DQM: multiplicity expected multiplicity cluster hit multipliciity noisy events single hit cluster multipliciity constant monitoring of event multiplicity need of interventions on the telescope in case the multiplicity is peaked at high values 13 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  14. DQM: tracks and 2 global measurement 2 tracks distribution 2measures the shift of the track wrt hits tracks with 1< 2 < 10: particle candidates randomly aligned hits and tracks of scattered particles: tracks with high 2 14 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  15. DQM: tracks and 2 trending (measurement vs time) rate of events with at least one good track rate of good tracks, i.e. with 2< 10 15 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  16. DQM: time differencebetweentwoevents y = e-R T delta time distribution between two consecutive trigger events slope inversely proportional to trigger rate R = rate 1/R = mean 16 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  17. DQM: angulardistributions angular distributions: azimuthal and polar angle Polar distribution Azimuthal distribution (bigger acceptance in the corners) (affected by telescope acceptance) 17 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  18. DQM: time of flightand tracklenght distributions of time of flight(TOF) and track lenght tilted tracks distance between chambers 1 and 3 TOF ~ 3.3 ns d= 1m (d = distanza tra le camere) 18 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  19. DQM: file csv per analisi dati download dei file dati: csv header summary for one run cdv trending trending of measured quantities csv weather temperature and pressure Data collected in csv (comma separated values) files They can be analised in Excel 19 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  20. DQM: file root per analisi dati Data are also collected as root files root is a framework written in c++ 20 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  21. E-log: data query It is possible to retrieve some data from several runs by using the elog Real data and MC data are available This tool has been used for ICD 2017 Chose a telescope Chose date (no more than 2 or 3 days) Please check output dimensions before asking many days and have too big files Tip it if you want MC data Cut to have good tracks 21 D. De Gruttola EEE Run Coordination Meeting open to schools 24/10/2018

  22. Back up

  23. Team Viewer and Data Taking controllo tensioni acquisizione monitoraggio T e p !!! remote control of all the telescopes is always possible!!!

  24. Strip multiplicity multeplicity of 24 channels of a single FEA possibility to check the correct behavior of each single channel and identify dead or noisy channels

  25. Event multiplicity molteplicity of triggered events number of strips giving a signal in each event the distribuzione has to be peaked at 1

  26. Analysis example dependence of rate from temperature and pressure(lecture from I. Gnesi, 16 April) effect of solar flares on the cosmic ray flux (lecture from I. Gnesi, 16 April)

  27. Barometriccorrections didactic experiments on cosmic rays measurement with Geiger counters and scintillators muon yield measurement of the barometric effect atmospheric pressure pressure variations affect the secondary cosmic ray flux according to the law: yield corrected by pressure I = - p

  28. Barometriccorrections atmospheric pressure is a direct measurement of the amount of air to be crossed by a showerbefore reaching the telescope pressure variations cause variations in the particle flux measured by the telescope

  29. Pressure monitoring pressure can be read by weather station (if possible) by siti di rilevamento nelle vicinanze

  30. Badbehavior if mean multiplicity greater than 2, an intervention is needed: need to tune the chamber voltage or the internal temperature ottobre luglio

  31. Barometriccorrections once the flux is corrected by atmospheric pressure physics observables become visible Cosmic Ray Flux Decrease day/night modulation + thermal drift

  32. DQM: csv files for data analysis download of data files: csv header summary of run information cdv trending quantities vs time csv weather data of temperature and pressure data are collected in csv files (comma separated values) and can be analyszed by Excel

  33. DQM: root files for data analysis data are collected also in root files root is a framework written in c++

Related


More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#