Last reminder — we’ll be beginning to bring things down soon — see you all on the other side!





> On Sep 16, 2016, at 7:35 AM, David A Mason <[log in to unmask]> wrote:

> 

> 

> Reminder — things going down end of the day TODAY!!!  

> 

>> On Sep 15, 2016, at 10:17 AM, David A Mason <[log in to unmask]> wrote:

>> 

>> Reminder — we start bringing things down end of the day (5 pm FNAL time) tomorrow!  At which point things still running will not be.

>> 

>> Thanks,

>> 

>> —Dave

>> 

>>> On Sep 7, 2016, at 10:09 AM, David A Mason <[log in to unmask]> wrote:

>>> 

>>> 

>>> Good morning!

>>> 

>>> Two of the transformers feeding FCC, where all our servers, storage, and LPC interactive nodes are housed, have lost the ability to auto-failover to generator, and require repair.  This work has been scheduled to begin early in the morning on the September 17th, and we’ll need to shut down our computing infrastructure ahead of that.  We’ll begin doing this at the end of business on Friday the 16th (5 pm FNAL time).  We will begin bringing up infrastructure after the work is completed on the weekend, but users should not expect to be able to use the LPC resources until the following monday morning FNAL time.  The interactive cmslpc nodes will be unavailable, EOS data offline even remotely via xrootd, and any running jobs on the LPC farm will be terminated as we bring things down on the 16th.  The FNAL Tier 1 and data it houses will also be down during this work.  FCC being down also affects much of the lab computing infrastructure in general, kerberos will be down and so will web services.  Work is going on now however to ensure at least FNAL email services will be able to stay up during this outage.  The village should still have power and network connectivity to the outside that weekend, but Wilson Hall will be closed due to cooling work there.

>>> 

>>> Thanks for your patience, will update as we know more!

>>> 

>>> —Dave

>> 

>