Lockloss seemingly due to ground motion instability. In the last 6 hours, the microseism increased by an order of magnitude.
PRG and ASC signals have been oscillating every few minutes since I started shift (and seismic was in micreoseism).
TITLE: 10/17 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 152Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
SEI_ENV state: USEISM
Wind: 7mph Gusts, 4mph 3min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.50 μm/s
QUICK SUMMARY:
IFO is in NLN and OBSERVING as of 05:22 UTC
Range and wind are stable. Microseism is on the rise.
Plan is to stay OBSERVING
TITLE: 10/17 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Lock Acquisition
INCOMING OPERATOR: Tony
SHIFT SUMMARY: Relocking and at MOVE_SPOTS. We were having a bit of a rough start trying to relock after the lockloss - for the first few minutes ALSX was buzzing weirdly, but then it went away on its own. I briefly checked the quad movements, and it looks like it may have been caused by ETMX Y moving to adjust the alignment. We then were having trouble locking DRMI or PRMI, so eventually I started an initial alignment and that helped a lot.
LOG:
23:30UTC Observing and have been Locked for 1 hour
23:49 Earthquake mode activated
23:50 Out of Observing to run ASC Hi Gains
23:59 GRB-Short E610763 https://gracedb.ligo.org/events/E610763/view/
00:09 Back into Observing after going back to nominal gains
00:09 Back to CALM
03:06 Lockloss https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=87534
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 23:32 | Jennie | JOAT | n | Putting away wipes | 23:35 |
Lockloss at 2025-10-17 03:06 UTC after over 4.5 hours Locked. Unsure of cause.
TITLE: 10/16 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 151Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY: The DARM fom struggled this morning as it wasn't getting data from GDS and sometimes nds2, ETMY beam spot adjustment alog87508, and we had to swap the ITMY L2 sat amp box alog87515. A PRM filter was also turned off alog87523, and I accepted some CDS calibration report related SDFs. After we relocked post sat amp swap there was a 1Hz ringup seen in ASC, but it calmed down.
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 15:01 | FAC | Randy | Yarm beam tube | N | Beam tube inspection, mid to corner | 17:56 |
| 15:04 | FAC | Kim , Nellie | VAC prep lab | N | Tech clean | 15:31 |
| 18:19 | ISC | Jennie | Vac Prep lab | N | Looks for parts | 19:30 |
| 18:23 | FAC | Kim, Nellie | Receiving, then Mids | N | Tech clean and look for stuff | 18:49 |
| 18:25 | PSL | Keita | Optics lab | N | ISS array, Laser Safe | 19:43 |
| 18:32 | PSL | Rahul | Optics lab | N | Join Keita | 19:43 |
| 19:04 | FAC | Eric | Staging | N | Move boom lift to LeXi | 19:29 |
| 20:06 | EE | Fil | LVEA | N | ITMY L2 sat amp swap | 20:16 |
| 20:39 | FAC | Randy | Xarm | N | Beamtube calking | 22:10 |
| 21:06 | PSL | Jennie | Optics lab, Vac prep | N | Check for parts/tools/cleanliness, Laser Safe | 22:00 |
| 21:34 | SUS | Rahul | LVEA, near PSL | N | Grab parts | 21:47 |
| 21:45 | PSL | Keita | Optics lab | N | ISS array work | 23:09 |
TITLE: 10/16 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 152Mpc
OUTGOING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 13mph Gusts, 9mph 3min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.16 μm/s
QUICK SUMMARY:
Observing at 150 Mpc and have been Locked for 1 hour. Looks like everything is going well now.
J. Kissel
The ETMs have L2 to R0 "tracking" in longitudinal (in addition to pitch and roll "damping") L2 sensing to R0 actuation. It's referred to as "tracking" rather than "damping" because the open loop gain is greater than unity over a much broader frequency region, focusing around 0.1 Hz.
These, like the P and R damping, didn't change after the sat amp swaps.
The templates to take this data lives here:
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ETMY/SAGR0/Data
2025-10-14_1830UTC_H1SUSETMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_L.xml
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ETMX/SAGR0/Data
2025-10-14_1830UTC_H1SUSETMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_L.xml
J. Kissel, S. Dwyer, E. Capote We recently re-discovered that H1SUSPRM M3 DRIVEALIGN matrix has an L2P filter ON with gain of -1.36 that was designed in 2014 (see LHO:9589). Unsure of its function/performance with the modern IFO, we wanted to test turning it OFF. We turned it OFF (by ramping the gain in that bank to 0.0 with a 10 sec ramp time) at the end of the most recent lock stretch, with the IFO in nominal low noise (just after Elenna's calibration push; LHO:87520). Namely the IFO was suffering from a failed H1 SUS ITMY PUM sat amp, and we knew we needed to replace it, so we were looking for "useful" ways to break the lock. Turning off the H1 SUS PRM M3 DRIVEALIGN L2P filter, at first superficial glance, has no impact on the IFO excpet for reducing the M3 pitch drive from +/- 300 to +/- 2 (Euler Basis) DAC Counts. For more in-depth analysis, - 2025-10-16 18:45 UTC the problems with the ITMY satamp started - 2025-10-16 19:54 UTC we turned off the PRM M3 L2P filter, and - 2025-10-16 20:02 UTC I caused the IFO lock loss by inverting the polarity on IN2 of the IMC common mode board. So, we should have a good 5 minutes of time right before vs. right after to compare ISC ASDs. We also tried this next lock acquisition with the filter OFF, to see if it's still needed for lock acquisition. PRMI isn't locking after 10 minutes of trying (*after* going through MICH fringes), though we did NOT run an initial alignment prior to this lock attempt and the AS port does look a little splotchy. Turned it back on 2025-10-16 20:39:44 UTC, but pretty quickly decided to run initial alignment instead (by 2025-10-16 20:42:57 UTC). We'll leave it ON and test more / again some other day; we'd rather get back to observing.
Turned off again at 21:15:30 UTC. SDF.
I don't see any difference in ISC signals (PRC2, PRCL, MICH ASC, REFL SERVO) from this change.
We made it through our second attempt at DRMI locking with the usual amount of difficulty. It's not obvious to me how this filter could impact our DRMI locking, since it's a length-to-pitch decoupler and the impact to locking should be in length only. DRMI ASC engaged with no issues.
Observe
Today I pushed calibration report 20251016T180834Z which was just taken in alog 87512. My motivation was due to what appears to be an incorrect kappa c value that I reported here 87453. We have also moved the beam spot on ETMY due to a camera bump, reported here 87473 and here 87508.
Note, I did not update the L3 drivealign gain in the model. That number is still changed in the actual suspension gain, but not in CALCS or in the pydarm ini file.
I also noticed that, maybe due to the beamspot change, there is an antispring present in the sensing function that maybe we should correct.
I followed the usual steps to commit, upload and export. I loaded the calcs model and accepted the SDF diffs. I confirmed things look good by checking the broadband measurement. Calibration is within +-2%. Kappa C is back to 1-ish. This is not as good as the Aug 28 push, but it's still pretty good overall.
18:45 UTC While Jim was running a measurement on ISI HAM5, SUS ITMY started to flash its' red Rocker Switch Death on L2 and report that its' L2 OSEMs were in fault, we also noticed there's a big new line at ~92Hz. Jeff turned off feedback from L2. It looks like it could be a sat amp issue, the L2 sat amp was upgraded this past Tuesday alog87469. Jeff is starting to work on characterizing a sat amp box in the EE shop to swap in.
We would need a lockloss to swap this component.
We are going to try to go back into Observing for a bit until we can fix it or lose lock.
19:31 UTC Observing
FYI -- we went into observing with the ITMY PUM sat amp OSEM PD's still dead. We turned OFF the ITMY L2 (PUM) to R0 "damping" feedback loop, so the failed sensors *should* not have any impact on the IFO. However, an obvious, loud ~92-93 Hz feature remained new and glaringly obvious in the DARM sensitivity.
@DetChar / @CW Group Probably best to just veto this observation stretch, unless we -- in the future -- find some amazingly exceptional event.
2025-10-16 19:31 UTC to 19:54 UTC.
ITMY L2 (PUM) Sat Amp S1100148 installed on 10/14/2025. Replaced on 10/16/2024 with S1100080.
https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=87469
J. Kissel This past Tuesday (Oct 14 2025), we upgraded the L2 (PUM) OSEM PD Sat Amps to improve their whitening filter, per ECR E2400330; see LHO:87469. These QUAD L2 PUM OSEMs (in which the flags are on the QUADs main chain PUM, and the LED & PD are on the reaction chain PUM [aka the "PenRe"]) are used in feedback. This "damping" of a "3.3" Hz reaction chain resonance is different ITMs and ETMs (ITM Install = LHO:65728; ETMs Install = LHO:68012 --- commissioning of both = LHO:68200); the ITM has resonances at 3.28 / 3.31 Hz and the ETM has modes at 3.18 Hz / 3.42 Hz. Because the improved sat amps come with better compensation of the whitening filter frequency response, we know that the frequency dependent gain on each channel -- especially around 3.3 Hz may change by as much as ~10%. In the aLOG (and comments collection) I report (a) That we *did* see a change in the open loop gain TFs of these loops, but (after ~2 days of observing since the upgrade) the IFO doesn't seem to mind the changes. (b) We were able to get better coherence on the open loop gain TFs in the 0.1 to 10 Hz region because of the sat amp whitening improvement (c) A comparison between all four QUAD's PITCH and YAW damping, so that we might understand them better and potentially improve them. In this main aLOG I show the comparison between the PITCH and ROLL open loop gain TFs and loop suppression for all four QUADs. Rushed commentary: - The surprising thing to me is that we're getting gain peaking and/or some suppression of other modes below 1 Hz, which I'm confident was not the design intent. - Even though the filters and EPICs gains are the same for EX and EY, ETMX has a lot more open loop gain below 1 Hz. - Also though the ETM loop suppression is about the same on these 3.18 / 3.42 Hz, the ITM loops have pretty different amount of gain peaking. - I'm guessing we *don't* want this much sharp gain peaking just *off* the "3.3" Hz mode.
Here's the EPICs configurations, gains, and frequency response for L2DAMP filters. In foton, I added a temporary filter that multiplied in the EPICs gain in use (including the sign) for plotting/comparison purposes. As shown, the ITM filter and overall gain design is identical between ITMX and ITMY, and the ETM filter design and overall gain is identical between ETMX and ETMY.
ITMX Before vs. After Sat Amp Swap Open Loop Gain and Loop Suppression plots for PITCH and ROLL.
As advertised -- no substantial change. The overall magnitude of PITCH open loop gain dropped by 18% between 0.5 and 3 Hz, but I suspect this is actually a clean-up of the compensation or frequency dependent calibration rather than a "real" gain drop. Since this all happens below the intended functional frequency, there's little to no change in functional loop suppression, save a little bit *less* gain peaking at 3.3 Hz.
The templates for taking this this before vs. after data lives in
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ITMX/SAGR0/Data/
2025-10-14_1830UTC_H1SUSITMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P.xml
2025-10-14_1830UTC_H1SUSITMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R.xml
and to make the comparison in the main aLOG entry, I exported the results to
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ITMX/SAGR0/Data/
2025-10-14_1830UTC_H1SUSITMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P_LoopSuppression_tf.txt
2025-10-14_1830UTC_H1SUSITMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P_OpenLoopGain_tf.txt
2025-10-14_1830UTC_H1SUSITMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R_LoopSuppression_tf.txt
2025-10-14_1830UTC_H1SUSITMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R_OpenLoopGain_tf.txt
ITMY Before vs. After Sat Amp Swap Open Loop Gain and Loop Suppression plots for PITCH and ROLL.
Even less change than ITMX -- arguably none at all to within the precision [i.e. coherence] of the measurement.
The templates for taking this this before vs. after data lives in
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ITMY/SAGR0/Data/
2025-10-14_1830UTC_H1SUSITMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P.xml
2025-10-14_1830UTC_H1SUSITMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R.xml
and to make the comparison in the main aLOG entry, I exported the results to
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ITMY/SAGR0/Data/
2025-10-14_1830UTC_H1SUSITMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P_LoopSuppression_tf.txt
2025-10-14_1830UTC_H1SUSITMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P_OpenLoopGain_tf.txt
2025-10-14_1830UTC_H1SUSITMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R_LoopSuppression_tf.txt
2025-10-14_1830UTC_H1SUSITMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R_OpenLoopGain_tf.txt
ETMX Before vs. After Sat Amp Swap Open Loop Gain and Loop Suppression plots for PITCH and ROLL.
Arguably no change -- and the measurement coherence is better *after* in the 0.5 to 5 Hz band because of the improved whitening on the L2 OSEM PDs.
The templates for taking this this before vs. after data lives in
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ETMX/SAGR0/Data/
2025-10-14_1830UTC_H1SUSETMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P.xml
2025-10-14_1830UTC_H1SUSETMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R.xml
and to make the comparison in the main aLOG entry, I exported the results to
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ETMX/SAGR0/Data/
2025-10-14_1830UTC_H1SUSETMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P_LoopSuppression_tf.txt
2025-10-14_1830UTC_H1SUSETMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P_OpenLoopGain_tf.txt
2025-10-14_1830UTC_H1SUSETMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R_LoopSuppression_tf.txt
2025-10-14_1830UTC_H1SUSETMX_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R_OpenLoopGain_tf.txt
ETMY Before vs. After Sat Amp Swap Open Loop Gain and Loop Suppression plots for PITCH and ROLL.
Similar to ETMX -- arguably no change at all in open loop gain or loop suppression to within the measurement precision i.e. coherence.
The templates for taking this this before vs. after data lives in
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ETMY/SAGR0/Data/
2025-10-14_1830UTC_H1SUSETMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P.xml
2025-10-14_1830UTC_H1SUSETMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R.xml
and to make the comparison in the main aLOG entry, I exported the results to
/ligo/svncommon/SusSVN/sus/trunk/QUAD/H1/ETMY/SAGR0/Data/
2025-10-14_1830UTC_H1SUSETMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P_LoopSuppression_tf.txt
2025-10-14_1830UTC_H1SUSETMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_P_OpenLoopGain_tf.txt
2025-10-14_1830UTC_H1SUSETMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R_LoopSuppression_tf.txt
2025-10-14_1830UTC_H1SUSETMY_R0_WhiteNoise_0p02to50Hz_L2DAMP_OLGTF_R_OpenLoopGain_tf.txt
Broadband:
Start: 2025-10-16 18:01:42 UTC
Stop: 2025-10-16 18:06:53 UTC
Files: /ligo/groups/cal/H1/measurements/PCALY2DARM_BB/PCALY2DARM_BB_20251016T180142Z.xml
Simulines:
Start: 2025-10-16 18:08:33 UTC // 1444673331.797786 GPS
Stop: 2025-10-16 18:31:47 UTC // 1444674725.604456 GPS
Files:
2025-10-16 18:31:47,448 | INFO | File written out to: /ligo/groups/cal/H1/measurements/DARMOLG_SS/DARMOLG_SS_20251016T180834Z.hdf5
2025-10-16 18:31:47,456 | INFO | File written out to: /ligo/groups/cal/H1/measurements/PCALY2DARM_SS/PCALY2DARM_SS_20251016T180834Z.hdf5
2025-10-16 18:31:47,461 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L1_SS/SUSETMX_L1_SS_20251016T180834Z.hdf5
2025-10-16 18:31:47,466 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L2_SS/SUSETMX_L2_SS_20251016T180834Z.hdf5
2025-10-16 18:31:47,471 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L3_SS/SUSETMX_L3_SS_20251016T180834Z.hdf5
Once again, it pulled the wrong report, regenerated.
I regenerated again after changing "prospring" to FALSE. This report includes GDS filters because we are going to push.
I ran a second PCAL broadband.
Start: 2025-10-16 19:20:36 UTC
Stop: 2025-10-16 19:25:46 UTC
File: /ligo/groups/cal/H1/measurements/PCALY2DARM_BB/PCALY2DARM_BB_20251016T192036Z.xml