Currently Observing at 156Mpc and have been Locked for over 3.5 hours. Quiet evening, nothing to report.

TITLE: 01/29 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 137Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:

Had 2-locklosses this shift which were not trivial.  First lockloss had issues with ALS & Finding IR, but this was eventually was addressed with an Initial Alignment, but it still took about 2.5hrs to lock.  After the 2nd lockloss, ALSx had issues with its WFS not engaging (this happened for locking and a Manual Alignment), but when an Initial Alignment was run the ALSx WFS were fine.

EX HVAC continues to run with limited heater coils, but temperatures are OK, but if there is an issue, we should contact Tyler (he's not heard back from the vendor for purchasing more heater coils).
LOG:

• 1539-1620 MX parts search (eric)
• 1625-1637 Optics lab cleaning (kim)
• 16:41:44 - 16:41:46 Drop from Observing
  • Looks like accidental LOAD button push (according to ISC_LOCK log:  2025-01-29_16:41:44.344503Z ISC_LOCK system archive: code changes detected and committed
• 1722 Lockloss
  • Had issues with ALSx with repeated locklosses at LOCKING ALS (would also get a PDH error for ALSx).  Paused at LOCKING ARMS GREEN and then LOCKING ALS, and finally able to get past this.
  • ISS Adjustment (alog 82530):  During the pauses above, Jason came in to address the ISS Diffracted Power by increasing it from -1.90 to -1.88 (Jason ACCEPTED this in SDF).  Result is the low diffracted power increased from 2.8 to 4.0.
  • Then had issues with Finding IR.  ALS COMM was stuck in Fine Tuning (with the TRX_NORM value only making it to 0.6 which is low.  Tried moving the COMM OFFSET to find a better spot, but could not get above 0.6....eventually we got an "IR NOT FOUND", so at this point went for a Manual Alignment (skipping Green Arms which were good).
  • 1825-1845 Manual Initial Alignment
    • Input Align and PRC Align worked fine, but MICH Bright had issue (so it was skipped), and SRC also had issues.  Decided to run a full alignment and keep track of each step.
  • 1845-1915 Initial Alignment
    • Although the green arms looked good earlier, ALSX took quite a bit of time to offload (maybe due to temperature issue at EX?)....took about 15min to get through ALSx offloading
    • Rest of the alignment was totally fine!  So, operator error (me) was definitely the issue with the Manual Alignment above!
  • Locking Notes
    • Made it all the way to DRMI (for a lockloss), but got through the pesky spots earlier with ALSx & FIND IR
    • Sooooo----should have just run a full Initial Alignment from the beginning
    • Locking was fine all the way until Squeezing:  FC Alignment Tuning Needed
      • SQZ_FC was having trouble locking GR & Finding IR, so it was stuck in a loop.  
      • Luckily, Camilla was here, so I asked for help.  She went to the Troubleshooting SQZ wiki's Issues with SQZ_FC Guardian section.  Basically we needed to take SQZ_FC to DOWN, Close Input1, and manually lock the FC on Green (Camilla had the FCGS trans camera up and we saw that it was on the wrong mode and misaligned in pitch; as we watched it, it relocked on a 00 mode.  Now that we were on the right mode, we touched up FC2 (mostly with pitch).  Then took SQZ_FC to GR_LOCKED, and once green was locked, SQZ_MANAGER was taken to FREQ_DEP_SQZ.  Then that was it.
• 2025 Back to Observing
• 2031-2036 Odd noise shelf on H1!  Noticed noise on H1's DARM between 20-50Hz (stayed in observing during this noisy time).
• 2102-2244 ISS Array work in Optics Lab (keita,jennie, siva.myank)
• 2247 Lockloss
  • Several LOCKING ALS locklosses (but in hindsight noticed that ALSx did NOT have WFS engaged---it's power was at 1.0 or less vs the usual 1.2)
  • 2314 Manual Alignment, but ALSx for some reason was not engaging WFS! Sooooo, started.....
  • 2326 Initial Alignment started, and this time ALSx WFS engaged!  Frustrating :(
• 0030 Back to Observing!

TITLE: 01/30 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Corey
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 2mph Gusts, 0mph 3min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.37 μm/s
QUICK SUMMARY:

Currently relocking and at MOVE_SPOTS. Relocking has been going okay this time besides a bit of waiting at the beginning for ALS to behave and having a time where ALSX WFS didn't turn on because of it locking at the wrong mode.

FAMIS27807

No water was added, both levels looked to be at the top of their reseviours. All filters looked clean, and there was no water in the Dixie leak detection device.

Interestingly, water hasn't been added since Jan 7 according to the T2200289 sheet, but levels have stayed the same.

Closes FAMIS#28390, last checked 82163

Measurements analyzed for the data taken January 28th. Nothing looking too wild.

ITMX  ITMY  ETMX  ETMY

FAMIS26028

As noted in the last few checks, ITMX ST1 V1 and ITMY ST1 V2 seem to be higher than other dofs, and this time they are slightly above last week's check as well (alog82366).

Lockloss (ETMx Glitch tag) at 1722utc.

Relocking was not trivial.  Had issues with consecutive LOCKING ALS locklosses (pauses appeared to help), but then had ALS COMM Fine Tuning issues where TRX could not get above 0.6 (which is too low).  Ultimately, a full Initial Alignment did the trick.  Now finally getting ready to power up H1.  It's been over 2hrs so far and hope to make it back up within 45min.

Saw Corey's note re: "ISS Diffracted Power Low," so I took the opportunity provided by the recent lockloss to adjust the ISS RefSignal.  The RefSignal changed from -1.90 V to -1.88 V, which brought the diffracted power % to ~4% from just below 3%.  The diffracted power % changed due to the enclosure slowly returning to thermal equlibrium after yesterday's FSS tune up, which changed the amount of power transmitted through the PMC.

Wed Jan 29 10:05:45 2025 INFO: Fill completed in 5min 42secs

TCmins[-66C, -65C] OAT (-3C, 27F) DetaTempTime 10:05:47. TC-B is nominal again.

If you are trending slow channels which are acquired by the EDC spanning the time of the EDC+DAQ restart yesterday (11:30 Tue 28 Jan 2025) and you are using the default NDS (h1daqnds1) you may see outlier data for a period of about 10 minutes. This is because we staggered the DAQ restart to preserve front-end data, starting with the 0-leg and EDC first, and then the 1-leg later after fw0 was back to writing frames. 

The EDC change yesterday was to add/remove mechanical room vacuum channels, and the vacuum systems are at the beginning of the EDC DAQ configuration file. The result of this is that after h1edc was restarted at 11:28, from h1daqfw1's perspective almost all the EDC channels moved relative to each other (channel hop), meaning that for each channel nearby channel data was being written instead for about 10 minutes.

h1daqfw0 does not have this issue because h1edc was restarted while it was down, such that when it started writing frames again it was running with the new h1edc configuration. Ditto for raw minute trends on h1daqtw0.

Switching your NDS from the default h1daqnds1 to h1daqnds0 removes this issue. The attached plots show a 24 hour trend of the outside temperature in degC obtained from nds1 and nds0. The nds1 command is:

ndscope --light -t "24 hours ago" -t now H1:PEM-CS_TEMP_ROOF_WEATHER_DEGC

and the nds0 command is

ndscope --nds h1daqnds0:8088 --light -t "24 hours ago" -t now H1:PEM-CS_TEMP_ROOF_WEATHER_DEGC

Ran the dust monitor check this morning and noticed LAB2 had this note:  Error: data set contains 'not-a-number' (NaN) entries

TITLE: 01/29 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 161Mpc
OUTGOING OPERATOR: TJ
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 4mph Gusts, 2mph 3min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.19 μm/s
QUICK SUMMARY:

H1's been locked 9.5hrs and even stayed locked through a local M4.2 eq off the WA/BC coast.  H1 was dropped out of Observing from 1053-1055 due to PI24.

Getting some ISS Diffracted Low Power messages ever few seconds and have some EX glitches from Verbal over the last 4hrs.

Looking like the EX temperature drop & recovery returned to normal at around 12hrs ago (300utc) and it's a balmy 17degF (-8degC) out!

TITLE: 01/29 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 156Mpc
INCOMING OPERATOR: TJ
SHIFT SUMMARY: Just started Observing a few minutes ago after relocking. Relocking went relatively well. Two locklosses during my shift and the only problem with relocking both times was waiting for ALSY and ALSX to calm down so we could lock them. ALSX has an excuse because of the temperature excursion at EX (which is now not too bad - the heating overshot a bit but is coming back down and the rate at which the temperature is changing isn't too bad anymore). However, ALSY doesn't have a good excuse and was also causing issues. We noticed this started happening around January 22nd or 23rd. Almost every lockloss, ALSY does this thing (ndscope) where it will be okay, then gets worse and unlocks, then goes back to being okay, and repeat. A few days ago we checked if it was being caused by the WFS, but the WFS seemed fine and turning them off doesn't stop ALSY from acting strange. Tagging ISC
LOG:

01:00 Lockloss
    - ALSX kept losing lock (probably due to temperature changes at EX)
    - Let ALS lock and WFS converge more before continuing
    - Stuck doing MICH so ran an initial alignment
02:59 NOMINAL_LOW_NOISE
03:02 Observing

04:45 Lockloss
    - ALSX and ALSY kept losing lock
    - Let ALS lock and WFS converge more before continuing
05:56 NOMINAL_LOW_NOISE
05:59 Observing

Lockloss @ 01/29 04:44 UTC after 1.75 hours locked

Lockloss tool tags anthropogenetic, there was a ground motion spike in the 0.3 - 1.0 band that matches up to the lockloss. We lose lock right around the CS_Z motions peak.

On Tuesday NOV 19th Eric started the replacement of the ceilign light fixtures in the PCAL Lab.
Francisco and I grabbed 3 HAM Door covers to stretch out over the PCAL table to minimize dust particles on the PCAL optical bench.
I also put all the Spheres away in the cabinet and made sure that they all had their apature covers on.
I went in to shutter the laser using the internal PCAL TX module shutter, and the shutter stopped working.
I then just powered off the laser, removed the shutter, and repaired the shutter in the EE lab.
Put in an FRS ticket: https://services1.ligo-la.caltech.edu/FRS/show_bug.cgi?id=31730
The Shutter is repaired and just waiting for the FAC team to finish the Light fixture replacement to reinstall.

Update: Friday NOV 22nd, there are 2 more light fixtures in the PCAL LAB that need to be replaced. One directly above the PCAL Optics table.
PCAL Laser Remains turned off with the key out.