Sheila, Ibrahim, Jenne, Vicky, Camilla
After Ibrahim told Sheila that DRMI has been struggling to lock, she checked the POP signals and found that somethings been drifting and POP now appears to be clipping, see POP_A_LF trending down. We use this PD in full lock so don''t want any clipping.
We has similar issues last year that gave us stability issues. These issues last year didn't have "IMC" lock-losses so we think this isn't the main issue we've having now but maybe effecting stability.
Trends showing the POP clipping last year, and now. Last year we moved PR3 to removing this slipping while looking at the coherence between ASC-POP_A_NSUM (one of the QPD on the sled in HAM3) and LSC-POP_A (LSC sensor in HAM1): 74578, 74580, 74581.
Similar coherence plots to 74580, for now are show the coherence is bad:
Sheila is moving the PRC cavity now which is improving POPAIR signals, plot attached is the ASC-POP_A_NSUM to LSC-POP_A coherence with DRMI only locked before and during the move. See improvements. Sheila is checking she's in the best position now.
We have been holding 2W with ASC on before powering up, and using the guardian state PR2_SPOT move, which lets us move the sliders on PR3 and moves PR2, IM4 and PRM sliders to follow PR3.
Moving PR3 by -1.7 urad (slider counts) increased the power on LSC POP, and POPAIR 18, but slightly misaligned the ALS comm beatnote. We continued moving PR3 to see how wide the plateau is on LSC POP, we moved it another -3urad without seeing power drop on LSC POP, but the ALS paths started to have trouble staying locked so we stopped there. (POP18 was still improving, but I went to ISCT1 after the OFI vent and adjusted alignment onto that diode 79883 so it isn't a nice reference). I moved PR3 yaw back to 96 urad on the yaw slider (we started at 100urad), a location where we were near the top for POP and POPAIR 18, so in total we started with PR3 yaw at 100 on the slider and ended with 96 on the slider.
Ibrahim, Camilla
Over the weekend we had a long ~13 hour lock and 2 days with minimal IMC issues, this was during a time when the microseism was low. Plot attached. We see similar long locks around Novmeber 6th/7th when the microseism was low, but we always have less issues locking when the micorsiem is low, plot attached.
We checked back to the quiet IMC time shown in 80951, between Oct 11th to 16th, but the microseism was actually relatively elevated during this time. Plot attached.
In both plots, between the t-cursors show quieter IMC glitch times.
FAMIS 31060
Enclosure incursion last Tuesday (alog81247); enclosure temps came back as expected, but power out of AMP2 has been lower by about 1W since then.
PSL Beckhoff was restarted last Thursday (alog81281), which apparently brought the chiller back with a slightly lower flow rate. At this time, there was also a slight jump up in temperature for AMP2, DB2, CB2, and the diode room (?).
PMC reflected power has also been on the rise again, but generally steady for the past ~4 days.
TITLE: 11/18 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: TJ
CURRENT ENVIRONMENT:
SEI_ENV state: USEISM
Wind: 15mph Gusts, 11mph 3min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.58 μm/s
QUICK SUMMARY:
IFO is LOCKING at ACQUIRE DRMI
When I arrived, IFO had just found PRMI. It seems this is the first lock acquisition since an auto-initial alignment following the last lockloss at 14:23 UTC. Microseism is high and increasing.
The IFO timed out after a long period of IMC locking struggles, then it got stuck trying to lock ALSY during initial alignment. I minor tweak to ETMY fixed the latter issue, but then SRM tripped during the SRC alignment step. I adjusted SRM to fix this. We then made it up to just after the power up before losing lock again (141596598, IMC tag).
I'll let it try a few more times by itself before stepping in again.
TITLE: 11/18 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Ibrahim
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 20mph Gusts, 13mph 3min avg
Primary useism: 0.05 μm/s
Secondary useism: 0.42 μm/s
QUICK SUMMARY:
I ran an Initial_Alignment early on and had the IMC unlock during the SRC_ ALIGN Section. The asc signals looked real strange, so I turned off the ISS and did a Manual_Initial_Alignment.
but....
Between the increasing Sencondary microSeism , the 30-40+ mph wind gusts, and the IMC issues have made locking for the past 2 shifts very diffucult.
I tried using the SEI_CONF MORE_WINDY early on to see if I could get locked. But as the rising micro seism made this increasingly less like to be successful.
I held in IDLE for an hour waiting for the wind to get below the 30 mph mark and tried to lock a number of times. Getting no Futher than LOWNOISE_ESD_ETMX
I took some time to do another Initial Alignment, and didn't get H1all the way locked.
So , Good luck to TJ and H1 Manni.
TITLE: 11/18 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Wind
OUTGOING OPERATOR: Ibrahim
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 29mph Gusts, 18mph 3min avg
Primary useism: 0.06 μm/s
Secondary useism: 0.44 μm/s
QUICK SUMMARY:
45 MPH wind gusts are present.
I'll be trying to lock it a few times just incase I get lucky with a break in the wind.
IMC Has been unlocking as well. I turned off the ISS again to get some more stability from the IMC. I'm not sure if this actually works or not.
I'm also taking the SEI_CONF to MORE_WINDY, to see if that also helps.
Wish me luck!
TITLE: 11/18 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Wind
INCOMING OPERATOR: Tony
SHIFT SUMMARY:
IFO is DOWN due to ENVIRONMENT
Very rough shift with 0 time spent locked. Today, this was mostly due to 3 reasons.
1. Environment:
2. IMC: The IMC glitch has dominated our locking attempts during lulls in the wind speed. It occured during initial alignment as well as during normal locking multiple times. This occured a few times after we had already locked DRMI under such windy conditions and so getting back to DRMI was either glitchy or windy and only happened twice today. The glitch has happened during all non-windy lock acquisitions.
3. Fast Shutter Error: At 20:01, we were at CHECK_AS_SHUTTERS during a lull in wind speed when we lost lock. After this locklossm the HAM6 SHUTTER status alert went red and guardian warned me not to power up. After calling a couple of people, Keita was able to diagnose the issue as a code threshold error. I went into the fast shutter guardian and changed the threshold of PdBDarkLo from -15 to -40 and PdBDarkHi from 15 to 40. More background and info is available in Keita's comment to my midshift alog 81320. This took 1hr 43 mins to diagnose and solve.
A calibration sweep has not been done yet (since Saturday). If at all we are able to get locked let alone thermalized that, Tony will do it.
LOG:
None
Closes FAMIS 26318, Last checked in alog 81105
Laser Status:
NPRO output power is 1.909W (nominal ~2W)
AMP1 output power is 68.55W (nominal ~70W)
AMP2 output power is 137.8W (nominal 135-140W)
NPRO watchdog is GREEN
AMP1 watchdog is GREEN
AMP2 watchdog is GREEN
PDWD watchdog is GREEN
PMC:
It has been locked 0 days, 21 hr 38 minutes
Reflected power = 18.21W
Transmitted power = 107.2W
PowerSum = 125.4W
FSS:
It has been locked for 0 days 0 hr and 18 min
TPD[V] = 0.8546V
ISS:
The diffracted power is around 4.0%
Last saturation event was 0 days 0 hours and 0 minutes ago
Possible Issues:
PMC reflected power is high - this is new from last week's report.
ISS diffracted power is high
We had a lull in the heavy winds during which I was able to get an initial alignment in and then up to DRMI locked.
The wind is now back up to the 30s mph and the IMC glitch is happening quite frequently (both on the rocky start-up to DRMI and thereafter).
Thus, I will be staying in DOWN until conditions improve.
Meanwhile, the HAM6 SHUTTER red alert came on with guardian telling me not to power up due to SHUTTER_FAILURE. I am investigating this.
Fast shutter worked and is working. (I was worried that the mirror was broken off but that's not the case, the shutter still opens and closes without an issue.)
From the guardian log (attached), it failed because AS_B_DC_NSUM was 20.3 when the shutter was closed and the threshold is 15. AS_B was 0.28. Fundamentally, this is because I reduced the gain of this DC path by 20dB and digitally compensated in search for an existing sensor that won't rail when lock is lost, and the same fast shutter test failure was observed (see alog 79104). Back then, I wrote "I adjusted the dark offset while IMC was unlocked but we can probably increase the threshold to 30 or so if it continues to bother us."
The dark offset has drifted enough to bother us at times (i.e. it is about 12 counts or so on average now), so I told Ibrahim to increase the thresholds only for AS_B, i.e.
PdBDarkLo=-40 # dark level low
PdBDarkHi= 40 # dark level high
in FAST_SHUTTER.py.
Since we now have a dedicated diode to look at lock loss power spikes, we can turn down the analog gain of AS_B_DC by 20dB and turn off +20dB filter in FM4 of H1:ASC-AS_B_DC_SEG[1234] filter, and adjust the dark offset again on Tuesday.
The mirror is still attached to the fast shutter and is moving. It actually closed using HV (see GS13 signal) when the test failed (2nd attachment), and later when I opened/closed it with low voltage drive it responded correctly (3rd attachment).
Sun Nov 17 10:10:23 2024 INFO: Fill completed in 10min 20secs
TITLE: 11/17 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Wind
OUTGOING OPERATOR: TJ
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 44mph Gusts, 33mph 3min avg
Primary useism: 0.12 μm/s
Secondary useism: 0.32 μm/s
QUICK SUMMARY:
IFO is IDLE due to ENVIRONMENT.
In the last hour since TJ's OWL alog, the wind has not died down, and the microseism has only gone up.
With 50mph gusts, we are unable to lock. Will stay in idle until we can re-attempt lock.
On the bright side, the IMC is locked.
The IMC has been struggling to stay locked for the last few hours, interrupting locking and restarting the process. Ground motion has also not been kind with a 6.1M earthquake from Japan a few hours ago, and useism and wind on the rise. Since the wind is getting over 40mph gusts, I'm switching the Observatory Mode to Environment - Windy.
TITLE: 11/17 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Lock Acquisition
INCOMING OPERATOR: TJ
SHIFT SUMMARY:
3:01 UTC GRB-Short E 525935 We were not locked for the begining of this stand down event.
2024-11-17 3:27:53 NOMINAL_LOW_NOISE reached
3:30:27 OBSERVING reached
Violin ITMY Mode 5 is still rising on this lock.
I changed the Gain to 0 and waited 15 minutes to see if it will stop going up or even turn around.
I then tried about 3 minutes with the gain at -0.02 ( Nominal gain just negative) but it was obvious that the no gain is better than opposite gain.
I ended up just turnin goff the gain.
05:11 UTC Lockloss https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1415855535
This was a very fast lockloss , it doesn't look like the same IMC /FSS locklosses we have been seening. But the PSL-FSS_FAST_MON_OUT_DQ was still the first signal to change behavior.
Relocking notes:
Relocking has been made very difficult with the IMC constantly unlocking. Most of the Locklosses are in locking Green arms, but everyfew attempts it gets a little further like DRMI, then the IMC stops working again.
I tried turning the ISS off again, but it hasn't stopped it from unlocking the IMC.
I turned back on the ISS so just in case H1 manager gets to about ISC_LOCK state 500 it will auto lock for him.
I couldn't get Past DRMI 1f, and ended up in a PRMI & Check Mich loop.
I tried to do an Intial_Alignment, But IMC would not stay locked for long enough.
I eventually waited for the IMC to lock then turned off the ISS Auto Locker for the duration of the Initial alignment.
Initial alignment went well with the ISS turnt off.
Trying to relock again.
TITLE: 11/17 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 159Mpc
OUTGOING OPERATOR: Ibrahim
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 15mph Gusts, 11mph 3min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.24 μm/s
QUICK SUMMARY:
H1 Has been locked for 1 Hour and 45 minutes.
DCPD's are diverging, Which I usually attribute to the Violins growing.
Turns out it's one of the usual suspects..... ITMY Mode 5 increasing.
I have turned the Gain off of ITMY m5 to see if it stays at that level or decreases.
The IFO stays locked until 1:25 UTC then I can do a Calibration sweep are the calibration time early today was missed by a lockloss.
Lockloss https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1415840300
This looks like there is some IMC issue that cause this Lockloss.
The Lockloss plots show that at -906ms there was blip on the PSL-FSS_FAST_MON _OUT_DQ channel.
Relocking the IMC was difficult as the IMC kept going into fault. I took ISC_LOCK to idel and took the IMC to idle for 10 minutes.
Relocking started fine, except I had to manual green arms.
TITLE: 11/16 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 157Mpc
INCOMING OPERATOR: Tony
SHIFT SUMMARY:
IFO is in NLN and OBSERVING as of 22:35 UTC
There was one IMC-caused Lockloss which ended our 13hr and 36 min lock acquisition. (alog 81310)
Stayed locked for the majority of this shift with one somewhat troublesome lock acquisiton for a number of reasons:
I was not able to take a calibration measurement due to the Lockloss, and we're not thermalized yet. I've informed Tony, the EVE operator, and he will take a calibration sweep once thermalized (01:24 UTC).
LOG:
None
Lockloss seemingly caused due to the IMC with MC2 losing lock within 1ms of ASC (attached).