I've removed the Misaligned states and their associated edges for the IMs and MC1 nodes to avoid a similar mishap from last week (alog87793) of going up to 60W but misaliging optics that should not be moved at that power.
To do this I needed to make h1 versions of these nodes. Most other sus nodes are common, and these do use the common SUS.py file, but we redefine the edges and removed the misaligned and misaligning states.
Sheila, TJ
We also added the OMs, OPO, and OFI to the list. This brings the total list of sus nodes without misaligned states to:
The quarterly maintenance of Chiller 3 and pump at the Corner Station has been done. Additionally, all chillers site-wide have been rotated.
TITLE: 11/04 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 8mph Gusts, 5mph 3min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.29 μm/s
QUICK SUMMARY: Violin modes are very rung up, although our violin monitors dont agree with that. Our range has been very low for the past 2 hours, as if the squeezer isn't squeezing. While the magnetic injections are running right now, I don't think they are getting anything useful. Still trying to figure out what's going on.
Maintenance day today.
Looks like this happened to Ryan C last night as well - alog87930. I did just as he did and turned off the damping to violin ETMX modes 1&6, and the saturations went away and DARM looked better. The 500Hz line in DARM is still very elevated, but the harmonics are much lower and the DCPDs are no longer saturating.
Now that the gains are off, the monitors are making more sense for those modes. They immediately went up when the gain was turned off.
SUS in lock charge is running and should be good, at least for the latter half of the measurements.
I've set the gain of ETMX mode 1 to zero in lscparams for now.
Workstations were updated. This was an OS packages update. Conda packages were not updated.
TITLE: 11/04 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Aligning
INCOMING OPERATOR: Oli
SHIFT SUMMARY: One lockloss, we are relocking at MAX_POWER.
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 23:50 | CAL | Tony | PCAL lab | LOCAL | Prep for end station meas tomorrow | 00:35 |
| 00:49 | CAL | Rick | Receiving | N | Pick up PSL parts | 01:25 |
| 00:52 | OPS | Ryan | Optics lab | N | Check on dust monitor | 00:58 |
03:45 UTC Something started to ring up in the DCPDs and the 500Hz line looked large on DARM. None of the vioins were ringing up though, I eventually found that both ETMY and ETMX (mostly ETMX) mode1/6's drive was ringing up and once I turned off the damping the DCPDs came back down and so did the line on DARM. (tagging SUS). I then put the nominal gain back into ETMX mode6 and it started to damp back down.
04:03 UTC We dropped observing, I brought us to Hi gain ASC as a semi large earthquake from Eastern Russia was hitting us (6.0)
04:19 UTC lockloss from the Earthquake
04:55 UTC MC2 M3 tripped as the IMC was trying to relock after a lockloss from FIND_IR, a look at some of the OSEMs
04:56 UTC IA, after INPUT_ALIGN it took the IMC 6 minutes to relock itself
04:19 UTC lockloss from a 6.0 from Eastern Russia, we were in the Hi gain ASC state at the time trying to ride it out.
M. Todd
I ran ISS injections in several bands during commissioning today (1-20 Hz) until about 9:30 PT. I am still struggling to get coherence below about 4 Hz, but the measurements of the transfer functions match relatively well with models of the ISS couplings to different ports in the IFO, except for POP. This could be sideband dominated dynamics, but more thought is needed.
TITLE: 11/04 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 149Mpc
INCOMING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 6mph Gusts, 4mph 3min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.36 μm/s
SHIFT SUMMARY:
Lockloss from NLN , Lockloss tool failed again.
Thefirst channel that I was able to see deviate from its nominal operation was ETMX L3 channels.
screen shot attatched.
Relocking notes:
Relocked after another IA that unlocked and faulted the IMC after Saturating MC2. Doing a manual IA does not cause this issue.
Once passed DRMI, it locked without issue until NLN where the 1 hz ring up happened on the ASC-INP1-P. Elenna had me use the ASC high gain button for about a minute.
Once that had properly damped the oscillation and used the ASC Low gain button we were able to do some Observing.
Observing reached at 00:15:01 UTC
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 15:50 | FAC | Randy | Mid X | No | Sealing the Beam tube | 21:59 |
| 16:31 | PEM | Robert | LVEA | N | Setting up for Shaker injections, & now shutting down shakers | 19:16 |
| 16:32 | iss | Matt | Control Rm | N | ISS injections. | 17:16 |
| 16:33 | FAC | Nellie | Mid Y | N | Technical Cleaning | 17:33 |
| 16:33 | FAC | Kim | Mid Y | N | Technical cleaning | 17:25 |
| 18:29 | CDS | Erik | EY | N | swapping fibers at the racks. | 20:29 |
| 23:50 | CAL | Tony | PCAL lab | LOCAL | Prep for end station meas tomorrow | 00:35 |
| 00:49 | CAL | Rick | Receiving | N | Pick up PSL parts | 01:49 |
| 00:52 | OPS | Ryan | Optics lab | N | Check on dust monitor | 01:02 |
TITLE: 11/04 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 147Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 3mph Gusts, 1mph 3min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.44 μm/s
QUICK SUMMARY:
At about 1100 PST I swapped the fiber pair for Ethernet IPC testing from the MSR in the corner station to EY. The new 4k pair is connected via patch fiber 24 at EY, replacing patch fiber 33.
FAMIS 31110
The PSL was restarted on Thursday following an interlock trip and the PS3 pump current was increased (alog87866). Since then, AMP2 power has been very slightly lower, but so has PMC reflected power. ISS diffrected power has been low the past couple of days as well.
Lockloss at 18:37 UTC Lockloss tool seemed to failed.
There was an unknown lockloss during commissioning.
Related Lockloss scopes attached.
Relocking notes:
Initial_Alignment railed MC2 in PRC aligning again today, twice. This perhaps is the start of a trend?
I just ran a manual IA.
After that relocking was pretty fast.
I accecpted some SQZr SDF changes to get back into Observing. Tagging SQZ.
Got back to Observing at 20:39:50
Superevent candidate S251103f
Mon Nov 03 10:11:37 2025 INFO: Fill completed in 11min 33secs
Gerardo confirmed a good fill curbside.
TITLE: 11/03 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 149Mpc
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
SEI_ENV state: USEISM
Wind: 17mph Gusts, 12mph 3min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.47 μm/s
QUICK SUMMARY:
This morning the secondary u-seism has dropped enough to lock!
Oli was woken up and had suspected some Fast shutter errors, But was able to get H1 relocked!
When I walked in Oli had H1 in OMC_Whitening already!
H1 went back to Observing at 15:41 UTC.
The wind forecast to the next 24 hours looks fantastic for Observing.
The ETMX Hardware Watchdog started showing activity again around Wed 20oct2025. This does not appear to be related to any maintenance or Satellite Amp work. As the plot shows, its activity is very closely correlated to the IFO lock state, this was not the case earlier this year before it went quiet.
Got called by H1 Manager due to the fast shutter check during CHECK_AS_SHUTTERS failing. I've been looking at the trigger power and various SYS-PROTECTION channels (medm, ndscope), and it looks like to me that the fast shutter test failed only because we lost lock right as it was checking?? You can see the trigger power oscillating along with DRMI as DRMI is right about to fail. However, It does look like the fast shutter did not fire for this test.
So it looked like just a bad coincidence to me, BUT when I went to try opening the shutter manually via the shutter controller, it wouldn't open. I ended up using the FORCE OPEN button, which did work, and after that I was ableto open and close it fine normally.
Looking back further it looks like it doesn't close&open it every time?Looking back on ndscope, it looks like the few times we got up to CHECK_AS_SHUTTERS from the past day, during that state, the fast shutter did not close/open for the test(I thought it was supposed to get opened and closed every relock during CHECK_AS_SHUTTERS??). At 11/02 14:59 UTC it had functioned correctly, but then at the next CHECK_AS_SHUTTERS, it didn't.
I wanted to go just to CHECK_AS_SHUTTERS to see if I could confirm that maybe the failure was just coincidental and based on a lockloss during the test, so I got up to CHECK_AS_SHUTTERS, and it did run the test by itself, but as it closed, it caused a lockloss(ndscope). After this test though, all of the issues on the AS_PORT_PROTECTION screen had cleared, so I went up again. I did accidentally leave the FAST_SHUTTER guardian in SHUTTER_FAILURE though(last time it got reset by my INITing), so that probably affected the next test that I tried on the next CHECK_AS_SHUTTERS. When we got there, it didn't run the test. I realilzed the FAST_SHUTTER guardian was in the wrong state and corrected it, but the test still didn't run, but the ISC_LOCK state marked itself as finished. I manually ran the test from the AS PORT PROTECTION screen, and it caused a lockloss. The test failed and the AS PORT PROTECTION screen is back to having lots of red, with the fault this time saying 'NotReopening'.
Now that it's after 6am Pacific, I'll call Fil or Marc because it definitely seems like something is wrong with the fast shutter, but I'm still a bit confused as to what it is.
P.S. MC2 watchdog just tripped while trying to relock the IMC, but it's okay now
Jenne, Fil, Oli
I INITed ISC_LOCK and decided to try CHECK_AS_SHUTTERS a third time. This time, everything worked correctly (fast shutter closed&opened) and the test passed (ndscope). I checked with Fil, who said it might have just been a logic mix-up, and Jenne, who confirmed that we should be good to power up now that the test passed. We are heading up!
After remotely rebooting h1seiey and seeing that the 4th ADC is now completely absent from the PCI bus, the next test was a power cycle of the IO Chassis.
Procedure was:
Stop h1seiey models, fence from Dolphin and power down the computer.
Dave (@EY):
power down the IO Chassis (front switch, then rear switch)
Power down the 16bit-DAC AI Chassis (prevent overvoltage when IO Chassis is power up)
Power up the IO Chassis (rear switch, then front switch).
The chassis did not power up. Tracking it back, the +24V-DC power strip was unpowered, the laser interlock chassis which is also plugged into this was powered down. This tripped all the lasers.
Fil came out to EY with a spare ADC
Dave & Fil (@EY):
We opened the IO Chassis and removed the 4th ADC. With this slot empty Fil powered up the DC power supply with the IO Chassis on, it did not trip.
We powered down the IO Chassis to install a new ADC. We are skipping the slot the old ADC was in, because it could be a bad slot.
The second DAC was moved from A2-slot4 to A3-slot1, the new ADC was installed in A2-slot4, leaving the suspect A2-slot3 empty.
We powered the IO Chassis on with no problems, then we powered up the h1seiey computer. The models started with no issues, I was able to reset the SWWD.
The chassis was buttoned up, pushed into the rack, and the AI Chassis were powered back up.
Marc is fixing a cracked cap on the old ADC so we can test it offline.
ADCs:
| old ADC (Removed) | 110204-18 |
| new ADC (Installed) | 210128-28 |
Tripped power supply location:
Updated as-built drawing for h1seiey IO Chassis
Here is the +24VDC power supply after we got everything going again. It is drawing about 3.5A
Testing of ADC 110204-18
After Marc replaced the cracked capacitor he discovered, this ADC (pulled from h1seiey) was tested on the DTS Thursday 30oct2025.
x7eetest1 IO Chassis was used. The ADC was installed into A3 by itself, no interface card or ribbon was attached. The chassis powered up with no problems. The ADC was not visible on the PCI bus (lspci and showcards).
Looks like this card is broken and not usable.