LIU-SPS Coordination Meeting

→ Europe/Zurich
Zoom

Zoom

https://cern.zoom.us/j/92195944007?pwd=R0dxMHNOSlM1MnFCUVp0RFdTaTVrZz09

LIU-SPS Machine Coordination Meeting 07/10/2020

Invited: Alexander Huschauer, Andy Butterworth, Anne Funken, Anthony Rey ,Antonio Grande Mallavia, Arthur Spierer, Brennan Goddard,Chiara Pasquino, David Mcfarlane, David Nisbet, Elena Chapochnikova, Eric Montesinos, Eric Veyrunes, Etienne Carlier ,Fabio Follin ,Francesco Maria Velotti ,François-Xavier Nuiry, Frank Gerigk, Gerd Kotzian, Giovanni Rumolo, Giulia Papotti ,Gregoire Hagmann ,Grzegorz Kruk, Hannes Bartosik , Ivan Karpov, Ivan Romera Ramirez, James Ridewood ,Johan Dalla-Costa, Jonathan Meignan, Julie Coupard, Kevin Shing Bruce Li ,Lars Jensen, Loic De Oliveira, Louis Pereira, Luciana Kolbeck, Malika Meddahi, Marine Gourber-Pace, Mauro Taborelli, Paul Cruikshank, Philippe Baudrenghien, Reyes Alemany Fernandez, Sonia Bartolome Jimenez, Stephane Cettour Cave, Sylvie Prodon, Verena Kain, Wolfgang Hofle, Yannick Le Borgne. 

Present: see attachment

Matters arising and actions

  • Power interlocking; being followed up - now need to get together with OP to look at impacts
  • JMinuit still open
  • WS specs not yet released
  • 50 Hz correction longer term - can be looked at ni 2021; needs new electronics
  • Done: Coating 414 and 616 is added
  • VSC storage of samples not yet followed up; to be checked with team
  • High intensity scrubbing coating strategy for LS3; still open and needs to be folded into the schedule for 2023
  • Done: Ions and LHC commissioning not compatible; current baseline is the SPS ion commissioniong
  • TIDVG interlocking still being looked at - trying to reduce the 20 minutes waiting time;
  • Done: ALPS is scheduled, invitations sent around, SPS island is reserved
  • Done: ORA invitation list has been updated

Status of RF hardware installation and power commissioning (Eric)

  • Close coordination of the work, attendance and vacations, organising the teams
  • BAF3 basically finished
  • Amplifiers #1 and #2 done
  • Lines installed
  • 3/6 TWC cavities RF processed (proceeding normally)
  • 99% of project now completed
  • Remaining risks/concerns:
    • Stable operation - maintenance to complete with Siemens and Philips
    • Accumulate hours of operation with Thales
    • Complete overdrive and overpower protection
    • Matching step lines - somewhat late
    • Control of equipment from CCC
    • RF-BR measurements (because of the matching step line delays)
  • Slow to finalise as large RF power (1 MW) and need extreme care
  • Key interface milestones
    • First cavity to RF FB after RF processing beginning Nov.
    • Beginning Dec. everything else should be available.
    • All 8 systems will remain with cavity processing 0.5 day/week and standby situation over Christmas to reduce the power 

Status of RF LLRF hardware (Philippe)

  • Cavity controller, a few bits in production or test, but looks good overall. Will have 6 such systems - only some slight differences when deployed on a different cavity depending on the cavity length. Main debugging will be the first cavity which will start in November.
  • Beam control  - one problem with the AFCZ boards where the series are late, delivery now not until January 2021. One needed for the startup (ordered another 10 for spares).
  • Beam based measurement - Teledyne "all-in-one" solution abandoned, could not integrate into CERN controls system. Went for the option B with same AFCZ board with mezzanine card, and option C with higher performance ADC, again the issue of the AFCZ board, but only need two for Beam Measurement. Still need the firmware effort for the 6 GSps ADC integration.
  • Aim to start up with the 3 AFCZ boards, for sure with the 125 Msps acquisition. With remaining to do the 6 Gsps ADC algorithms and firmware for March 2021. Kevin makes the point that it would be useful for the scrubbing to have the bunch by bunch phases. Philipe says that this should be possible.
  • Commissioning before beam: 
    • Most advanced system is beam control and will start making tests this month with WR distribution
    • Then RF synchronisation and distribution, where few modules still in fabrication (RFPDU and NIM distribution).
    • FESA class to be re-compiled (when?)
    • Goal is to have RF signals available on Jan 4th. This is fine for ABT and for BI.
    • For B-train and reference magnet, need to power main dipoles and this has to be discussed with OP and MSC (Philipe, Arthur, Verena, Marco etc).
    • TWC200 cavity controller, much work remaining on firmware, tests with cavity beginning Nov., until end of 2020, then setup of the other 5 cavities Jan-March 2021.
    • Beam based measurements, realisation of PU FEs by Dec., complete firmware for 125 Msps by Feb 2021 and 6 Gsps for March 2021 - late but only acquisition for OP in this.
  • Commissioning with beam:
    • Some beam needed for setting up to commission during weeks 15-21 (cavity alignment and setting up for phase and radial loop
    • Beam needed for collective affects and intensity ramp-up. Will be interleaved - feedforward, long. damper, alignment of 800 MHz, long. blow-up.
    • Beam needed for RF gymnastics (transition crossing, slow extraction, AWAKE)
    • Beam needed for commissioning new algorithms and for optimisation of FFA and phase noise
    • Also will be needed for slip stacking
    • For FT beams, seem to only come very late for RF - but for OP have this in the first 6 weeks. OK for RF - plan is to make the FT beam setup including transition crossing but not yet the slow extraction in the initial weeks.
    • One turn-feedback will also be essential from the start. Elena makes the point that the 800 MHz is more critical than the feedforward - priorities to maybe revise internally in RF. 
    • Plans for first 7 weeks are clear, reasonable intensity pLHC batch by end May (numbers exist)
    • For weeks 22-29 pLHC intensity ramp-up, including w26-29 for pFT for NA
    • Mid-July to mid-August will need experts for piquet
  • Ions
    • Setting up will start w39, assuming no LHC run gets in the way. Otherwise if there is an LHC beam needed, there will be a resource problem which will mean 4 week delay, which would mean SPS FT ion physics not possible
  • Manpower problems with beam-based measurement - need to count on the FELL (presently LIU), Bren and Frank to check what has been requested here.
  • For acquisitions, how much is testable until the real HW is there with the FE underneath? How long for full vertical slice and when will this be planned? Not until February/March 2021. Tests will be several days, realistically. 
  • Ions, OP really would push for early look, how much effort would it take away from other activities to schedule this (things like toggling of FFA, even dry tests)?

Status of RF CS (Andy)

  • HLRF PLC controls
    • Thales tower PLCs all 32 PLCs installed, ready 100%, some small mods expected still
    • Cavity PLCs cavity 6 operational, SW mods still in progress, cavity 3 this week.
    • Philips and Siemens similar and also in hand
  • RF power interlocks
    • Internal protections limit max power to avoid HW damage
    • At different levels and different timescales
    • Also clamping by LLRF which is functional and not protection
    • Power observation and logging foreseen
    • Fast interlock system deployed in Thales, testing next week, modules also installed in Siemens and Philips
    • Signal acquisition in scopes, and slow interlocks in progress, FESA and alarms/warnings.
  • Beam interlocks
    • Beam interlocks needed to protect Thales amps, protect PUs, pre-empt beam-loss and inhibit injection.
    • Fibre available to connect to BIS.
    • Need new fast interlock crate (RF) to replace old beam dump interface crate.
    • More sophisticated logic in SIS.
    • Overall interlocking proposal exists, should be discussed with MPP and OP to make sure all OK (Andy with Kevin/Verena/MPP/RF-BR).
    • Masking might only be needed in some very specific cases - and depending on the beam.
    • Application SW needed for interlock management? Also needed for unlatching. Urgent to come back to this and look at the concept, implementation and integration.  
  • Front end SW
    • Generic FESA timings with OP for tests, FGs already with OP (Coast trims for end Oct), Acquisition with OP for demos, but full vertical slice to be sorted out (Andy/Kevin)
    • Cavity controller has FESA class, deployed in simulation but not yet tested, not yet handed to OP (next few weeks).
    • Beam control released in simulation mode to OP, will be tested with real HW and firmware in Oct/Nov, vertical slice with B-train end Oct.
    • Beam-based measurements is latest, internal RF control, only acquisition FESA devices for OP, as soon as possible.
    • Misc classes (HW platform control/surveillance, excitation core, eRTM, long blowup) still some dev to do
    • Embedded controllers still ongoing 
    • For existing systems no fundamental changes, updates and reorganisation, plus new clock selection to implement
  • Dashboard with progress shows most items well advanced or in progress
  • Milestones defined through October and November for synchro, cavity and beam control, with Jan-March for final FESA classes for beam-based measurements
  • Main open question is on the beam and SIS interlocks, where HW renovation is proposed. Beam-based measurement is late but no impact for OP.
  • Comment that 800MHz and damper power FESA classes are needed (Andy).
  • Need to make sure the interfaces for the beam-based measurement needs to be sorted for OP (in progress but should not be neglected).
  • Will there be interlocks for 800 MHz? No - not requested and not needed for the amplifiers.

RF System integration status (Kevin)

  • 5 stage integration plan,
    • Parameter model (done)
    • define FESA classes (mostly done)
    • Dry run LSA models and FESA (now started)
    • Full vertical slice tests
    • Run full operational cycles
  • 3 stage commissioning plan
    • HWC without beam
    • Beam Commissioning setting up
    • Operational Commissioning fine tuning
  • Detailed status
    • ATIMS missing cavity control but not expected to be too heavy
    • RFFG technicalities mostly sorted out
    • Core parameter models established and complete
    • Parameter import started - need to have all value generators and Makerules specified now (RF)
    • FESA interfaces are coming in. OP working on the applications
    • Dry runs, a lot of work ongoing and still to do. Some questions to sort out in settings
  • Overall status
    • Parameter models in good shape
    • FESA coming in, highly dynamic and iterative process
    • Dry runs and vertical slices need to be pushed more. List given of what is proposed, need to actively plan these with RF
    • Full tests of operational situations planned for cold-checkout
  • Timeline and milestones shown, very urgent and immediate now.
  • Dry-run scheduling to move to the SPS Monday meeting
  • Longitudinal blowup not yet defined in the new way at FESA level (old way is already included in terms of synchrotron frequency, but need settings and virtual parameters)

Overall RF commissioning milestones (Frank)

  • List of 15 commissioning milestones defined in 2020 and 2021 with dates, linking all the previously discussed aspects together
  • Proton commissioning with beam through 2021 from April - July. Reminded that unlikely to have any time for ion activities.
  • List of "cooldown compatible beam studies" defined which don't need much support from LLRF/CS/.
  • To be addressed:
    • Date of HW commissioning tests from CCC - being addressed 
    • Power interlocking to agree
    • Application needed for estimating RF power before cycle
    • List of things needed where OP input is needed
    • Ion cycle needed to setup iFFA - would need e.g. MD1 cycle, had to be approved (IPP?). Would clash with LHC LLRF setup if LHC injection test. OP agree with the idea but would put a dedicated cycle in, details to look at (Giulia, Verena)
  • Ion commissioning sequence is clear but fewer fixed dates and milestones, will obviously depend on whether there is an LHC injection test, and if there is SPS FT ion run. In case proton commissioning is faster than expected, could anticipate some items.
  • Where internally in RF is this planning being maintained? Will be done ~monthly by RF internally on the longer time scales, while the short-term planning over a few weeks will be looked after by OP in the weekly meetings
  • During the run, when physics is running, it is not optimal to be requesting time/cycles to keep on commissioning - need dedicated commissioning time without beam.
  • OP shifts start 7th December, will need to fold into this planning availability for SW dev.
  • Many items still to squeeze in for OP, tight on the schedule. Any derivation now will be a problem, which means that any issues need to be flagged immediately.

Next steps (all)

  • Monday coordination meetings (weekly). Verena to distribute mandate and proposed invitees asap.
  • RF internal technical coordination (monthly), Frank to continue to follow on basis of established milestones
  • Other topics can be in LIU-SPS MCM as appropriate (should be few/none!).

AOB

  • SPS-OP 8:30 meetings will start as of next Monday to follow up closely on integration, FESA readiness, Dry Runs etc. for all systems to prepare the HWC that is coming up soon

Agenda for next meeting (14/10/2020)

  • Impedance reduction outcome and lessons learned Jaime Espinos
  • UCAP server deployment and workflow: and SBDS example Francesco Velotti
There are minutes attached to this event. Show them.