Enron email

Algorithmic Indexing

3 Aug 2001, 21:55 UTC

Supplemental Weekend Outage Report for 8-03-01 through 8-06-01

From
Enron Change Management Announcement@ENRON no.address@enron.com
Date
Fri, 3 Aug 2001 14:55:38 -0700 (PDT)
------------------------------------------------------------------------------------------------------
W E E K E N D   S Y S T E M S   A V A I L A B I L I T Y

F O R

August 3, 2001 5:00pm through August 6, 2001 12:00am
------------------------------------------------------------------------------------------------------


SCHEDULED SYSTEM OUTAGES: 

ARDMORE DATA CENTER - FACILITY OPERATIONS: No Scheduled Outages.

AZURIX: No Scheduled Outages.

EB34 DATA CENTER - FACILITY OPERATIONS: No Scheduled Outages.

EDI SERVER: No Scheduled Outages.

ENRON CENTER SOUTH DATA CENTER - FACILITY OPERATIONS: No Scheduled Outages

ENRON NORTH AMERICAN LANS:    ALSO SEE ORIGINAL REPORT 
Impact:  NAHOU-LNARC01P
Time:  Fri 8/3/2001 at  7:00:00 PM CT thru Fri 8/3/2001 at  9:00:00 PM CT
	Fri 8/3/2001 at  5:00:00 PM PT thru Fri 8/3/2001 at  7:00:00 PM PT
	Sat 8/4/2001 at  1:00:00 AM London thru Sat 8/4/2001 at  3:00:00 AM London
Outage:  NAHOU-LNARC01P
Environments Impacted:  LN ARCHIVE DATA
Purpose: server is on a test dev segment
Backout: return to orig config
Contact(s): 	Todd Thelen    713-853-9320

Impact:  ECN 36
Time:  Sat 8/4/2001 at  8:00:00 AM CT thru Sat 8/4/2001 at  12:00:00 PM CT
	Sat 8/4/2001 at  6:00:00 AM PT thru Sat 8/4/2001 at  10:00:00 AM PT
	Sat 8/4/2001 at  2:00:00 PM London thru Sat 8/4/2001 at  6:00:00 PM London
Outage:  Fiber Additions to ECN 36
Environments Impacted:  Corp
Purpose: improve network connections
Backout: 
Contact(s): 	Mark Trevino    713-345-9954 
 
FIELD SERVICES:  No Scheduled Outages.

INTERNET: No Scheduled Outages.

MESSAGING:     ALSO SEE ORIGINAL REPORT
Impact:  All systems dependent on outbound internet mail for exchange
Time:  Sat 8/4/2001 at  10:00:00 PM CT thru Sat 8/4/2001 at  11:59:00 PM CT
	Sat 8/4/2001 at    8:00:00 PM PT thru Sat 8/4/2001 at  9:59:00 PM PT
	Sun 8/5/2001 at  4:00:00 AM London thru Sun 8/5/2001 at  5:59:00 AM London
Outage:  Upgrade NAHOU-MSCNX04P
Environments Impacted:  Exchange users sending mail outbound to the internet
Purpose: Exchange RTM code interaction with MAILsweeper causing outbound internet mail delay.
Backout: Restore system state.
Contact(s): 	Trey Rhodes    713-345-7792
  
MARKET DATA: No Scheduled Outages.

NT: No Scheduled Outages.

OS/2:  No Scheduled Outages.

OTHER SYSTEMS:      ALSO SEE ORIGINAL REPORT
Impact:  NAHOU-APTB03P
Time:  Fri 8/3/2001 at  5:30:00 PM CT thru Fri 8/3/2001 at  6:00:00 PM CT
	Fri 8/3/2001 at  3:30:00 PM PT thru Fri 8/3/2001 at  4:00:00 PM PT
	Fri 8/3/2001 at  11:30:00 PM London thru Sat 8/4/2001 at  12:00:00 AM
Outage:  ThunderBall / MoneyPenny Processor Removal
Environments Impacted:  Global Products Traders
Purpose: Deals are not being executed reliably because this particular application interfaces with Tagg.
Backout: Put the processor back in.
Contact(s): 	Christopher Spann    713-345-4986

Impact:  HR
Time:  Sat 8/4/2001 at  10:00:00 AM CT thru Sat 8/4/2001 at    2:00:00 PM CT
	Sat 8/4/2001 at    8:00:00 AM PT thru Sat 8/4/2001 at  12:00:00 PM PT
	Sat 8/4/2001 at  4:00:00 PM London thru Sat 8/4/2001 at  8:00:00 PM London
Outage:  HR SAN Hardware Replacement
Environments Impacted:  All HR Global Applications, eHRonline, Business Objects users, Expertfinder, HRGIS
Purpose: Hardware Replacement
Backout: None
Contact(s): 	Brandon Bangerter    713-345-4904
		Mark Calkin                713-345-7831  281-298-2787
		Raj Perubhatla          713-345-8016  281-788-9307
		Brian Ellis                  713-345-8017  713-446-6193
		
Impact:  CORP
Time:  Sat 8/4/2001 at  8:00:00 PM Calgary thru Sat 8/4/2001 at  9:00:00 PM Calgary
	Sat 8/4/2001 at  9:00:00 PM CT thru Sat 8/4/2001 at  10:00:00 PM CT
	Sat 8/4/2001 at  7:00:00 PM PT  thru Sat 8/4/2001 at  8:00:00 PM PT
	Sun 8/5/2001 at  3:00:00 AM London thru Sun 8/5/2001 at  4:00:00 AM London
Outage:  Calgary File Cluster
Environments Impacted:  Corp Calgary
Purpose: To try clear up performance issues.
Backout: NA
Contact(s): 	Clayton Rondeau    403-974-6904

Impact:  CORP
Time:  Sat 8/4/2001 at  12:00:00 PM CT thru Sat 8/4/2001 at   2:00:00 PM CT
	Sat 8/4/2001 at  10:00:00 AM PT thru Sat 8/4/2001 at 12:00:00 PM PT
	Sat 8/4/2001 at  6:00:00 PM London thru Sat 8/4/2001 at  8:00:00 PM London
Outage:  Maintenance and reboot of Clearcase server pluto.
Environments Impacted:  Clearcase users
Purpose: Update number of file descriptors to accommodate recently added users.  General maintenance.
Backout: Backout patches and reduce number of file descriptors.
Contact(s): 	Malcolm Wells    713-345-3716
		    		    		    		
SITARA:   ALSO SEE ORIGINAL REPORT
Impact:  CORP
Time:  Sat 8/4/2001 at  8:00:00 PM CT thru Sat 8/4/2001 at  10:00:00 PM CT
	Sat 8/4/2001 at  6:00:00 PM PT thru Sat 8/4/2001 at    8:00:00 PM PT
	Sun 8/5/2001 at  2:00:00 AM London thru Sun 8/5/2001 at  4:00:00 AM London
Outage:  Memory replacement and data migration for Sitara server madrid.
Environments Impacted:  Sitara
Purpose: Replace failed, offlined memory.  Move home directory to the NFS disk space on NetApp server.
Backout: Boot up with out memory.
Refer to old disks if there is a problem with the migrated data.
Contact(s): 	Malcolm Wells    713-345-3716   
 
Impact:  CORP
Time:  Fri 8/3/2001 at  6:00:00 PM  CT thru Fri 8/3/2001 at  8:00:00 PM CT
	Fri 8/3/2001 at  4:00:00 PM PT thru Fri 8/3/2001 at  6:00:00 PM PT
	Sat 8/4/2001 at  12:00:00 AM London thru Sat 8/4/2001 at  2:00:00 AM London
Outage:  CPU replacement for server midas. 
Environments Impacted:  Sitara parallel
Purpose: Repeat errors on cpu.  Needs replacement before it causes data corruption.
Backout: Reboot with cpu offline..
Contact(s): 	Malcolm Wells    713-345-3716

SUN/OSS SYSTEM: No Scheduled Outages.

TELEPHONY:     SEE ORIGINAL REPORT
 
TERMINAL SERVER:  No Scheduled Outages.

UNIFY:  No Scheduled Outages.

----------------------------------------------------------------------------------------------------------------------------
								FOR ASSISTANCE

(713) 853-1411   Enron Resolution Center


Specific Help:
Information Risk Management			(713) 853-5536
SAP/ISC                                                                               (713) 345-4727
Unify On-Call 					(713) 284-3757  [Pager]
Sitara On-Call					(713) 288-0101  [Pager]
RUS/GOPS/GeoTools/APRS			(713) 639-9726  [Pager]
OSS/UA4/TARP				(713) 285-3165  [Pager]
CPR						(713) 284-4175  [Pager]
EDI Support 					(713) 327-3893  [Pager]
EES Help Desk					(713)853-9797 OR (888)853-9797
TDS -Trader Decision Support On-Call                    (713) 327-6032 [Pager]