CDF Data Handling

	CDF Data Handling
	"Whatever it takes to get at data..."

The CDF Data Handling project aims to provide users straight-forward access to and bookkeeping of data. Remote sites are participating fully in the analysis of CDF data.

CDF SAM User Documentation is the basic document to read. It includes information on storing MC files.

Note: Links in red are only visible from inside the fnal.gov domain.

Main Links
...At A Glance	Data Handling At A Glance SAM At A Glance Weekly Status Report
Monitoring	ENSTORE : servers plots tape access rates DCACHE : data rates pool activity request queues pool queue history disk usage errors dCache reference book SAM : Sam Station Monitor (replaced SamTV) Database Monitoring Interactive Network Diagram
SAM	SAMGrid CDF Homepage Sam Station Monitor (replaced SamTV) Admin page Preliminary Metrics SAM DB Browser CDF SAM User Documentation CDF SAM Shifter E-log Ganglia Cluster Report for SAM Nodes SAM DBServer Documentation
Datasets	Dataset Registration Tool SAM Datasets Report Datasets available at remote sites
Documentation	Raw data taking and upload notes DH At A Glance notes Data Handling Expert HowTo - SAM Shifter's Guide
Other	a variety of reports Tape Recycling Log

External Links
CDF GRID	Accelerator Division Notification Page
Node Locator	FEF Faultlog for CDF

Announcements

Usage Guidelines

Specific Dataset Guidelines

June 2006: Recommendation: the '08' & '09' and earlier Generation 4 datasets were removed; please use any of the newer datasets

Golden Datasets Status

Golden Dataset concept was abandoned on 1 May 2006; total disk space in the dCache disk pools should be sufficient to minimize repetetive tape access.
Golden Datasets were preloaded into dCache and periodically checked for availability.

Other News and Information

Old diagnostics:

Predator

File servers status

Excel spreadsheet which includes age of server, capacity, usage:
17 May 2007
18 April 2007
15 October 2006
10 October 2006
18 September 2006
06 September 2006
24 July 2006
30 April 2006
14 April 2006
3 March 2006

31 July 2006: Datasets assigned to files but not registered in filecatalog.cdf2_dataset_registries orphaned datasets

11 July 2006: dCache Pool Groups capacity and Configuration are available at DH At a Glance and Pool Information

21 June 2006: bphysr missing file list from run 218713 is here

27 February 2004: CDF 5981: Introduction to dCache Use at CDF, v2.03 (html). Also: text abstract, postscript note, and PDF note.

cdf_dh_help June 2009