A5056657302- Advanced Data Storage Technologies
- Distributed and Parallel Computing Systems
- Scientific Computing and Data Management
- Particle physics theoretical and experimental studies
- High-Energy Particle Collisions Research
- Quantum Chromodynamics and Particle Interactions
- Caching and Content Delivery
- Parallel Computing and Optimization Techniques
- Distributed systems and fault tolerance
- Particle Detector Development and Performance
- Nuclear Physics and Applications
- Research Data Management Practices
- Cloud Computing and Resource Management
- Atmospheric and Environmental Gas Dynamics
- Migraine and Headache Studies
- Privacy-Preserving Technologies in Data
- Enzyme Structure and Function
- Data Quality and Management
- Access Control and Trust
- VLSI and Analog Circuit Testing
- Dark Matter and Cosmic Phenomena
- Radiation Detection and Scintillator Technologies
- Electromagnetic Compatibility and Noise Suppression
- Service-Oriented Architecture and Web Services
- Advanced Authentication Protocols Security
Deutsches Elektronen-Synchrotron DESY
2005-2023
Hitachi Global Storage Technologies (United States)
2016
RWTH Aachen University
1992-1997
The LCG collaboration is encompassed by a number of Tier 1 centers. Nordic 1, operated NDGF, in contrast to many other centers distributed over the countries. A setup was chosen for both political and technical reasons, but also provides unique challenges. dCache well known respected as powerful storage resource manager, implementing aspects 1. In classic deployments, we deploy WAN with limited bandwidth, high latency, frequent network failures, spanning administrative domains. These...
Storage Services are crucial components of the Worldwide LHC Computing Grid Infrastructure spanning more than 200 sites and serving computing storage resources to High Energy Physics communities. Up tens Petabytes data collected every year by four experiments at CERN. To process these large volumes it is important establish a protocol very efficient interface various solutions adopted WLCG sites. In this work we report on experience acquired during definition Resource Manager v2.2 protocol....
Storage management is one of the most important enabling technologies for large-scale scientific investigations. Having to deal with multiple heterogeneous storage and file systems major bottlenecks in managing, replicating, accessing files distributed environments. resource managers (SRMs), named after their Web services control protocol, provide technology needed manage rapidly growing data volumes, as a result faster larger computational facilities. SRMs are grid providing interfaces...
A numerical method is developed for computing relaxation-time spectra from time-domain measurements. The starts with an assumed spectrum. This spectrum altered and adjusted by comparing the data calculated measured data. approach essentially inverse Laplace transformation suitable broad as well narrow spectra. Measurements performed on polyimide aluminium oxide illustrate capabilities of method. stability against noise in investigated, a smoothing procedure described.< <ETX...
The European-funded ESCAPE project will prototype a shared solution to computing challenges in the context of European Open Science Cloud. It targets Astronomy and Particle Physics facilities research infrastructures focuses on developing solutions for handling Exabyte scale datasets. DIOS work package aims at delivering Data Infrastructure Science. Such an infrastructure would be non HEP specific implementation data lake concept elaborated HSF Community White Paper endorsed WLCG Strategy...
For over a decade, dCache has been synonymous with large-capacity, fault-tolerant storage using commodity hardware that supports seamless data migration to and from tape.
A number of storage elements now offer standard protocol interfaces like NFS 4.1/pNFS and WebDAV, for access to their data repositories, in line with the standardization effort European Middleware Initiative (EMI). Also LCG FileCatalogue (LFC) can such features. Here we report on work that seeks exploit federation potential these protocols build a system offers unique view metadata ensemble possibility integration other compatible resources as those from cloud providers. The challenge, here...
The LHC needs to achieve reliable high performance access vastly distributed storage resources across the network. USCMS has worked with Fermilab-CD and DESY-IT on a service that was deployed at several sites. It provides Grid heterogeneous mass systems synchronization between them. increases resiliency by insulating clients from network failures, facilitates file sharing traffic shaping. This new is implemented as Storage Element (SE). consists of dCache, jointly developed DESY Fermilab,...
Storage management is one of the most important enabling technologies for large-scale scientific investigations. Having to deal with multiple heterogeneous storage and file systems major bottlenecks in managing, replicating, accessing files distributed environments. resource managers (SRMs), named after their Web services control protocol, provide technology needed manage rapidly growing data volumes, as a result faster larger computational facilities. SRMs are grid providing interfaces...
The dCache project provides open source storage software deployed internationally to satisfy ever more demanding scientific requirements. Its multifaceted approach an integrated way of supporting different use cases with the same storage, from high throughput data ingest, through wide access and easy integration existing systems. In new communities, such as photon science microbiology, is evolving provide features technologies. this paper, we describe some these recent that facilitate...
NFSv4.1 (pnfs) is a new industry standard which allows for access to data distributed on different file servers. The dCache storage system has implemented this protocol. aim of paper evaluate implementation and compare it traditional HEP protocols like dCap. We perform synthetic simple ROOT tests as well real analysis using the ATLAS HammerCloud framework an use case from CMS. are done cluster comparable small cluster. Our have shown that very stable speed at least if not superior dCap in...
The eXtreme-DataCloud (XDC) is an EU H2020 funded project aimed at developing scalable technologies for federating storage resources and managing data in highly distributed computing environments. XDC software stack based on existing tools, whose technical maturity proved, that the enriches with new functionalities plugins to address real life requirements from user communities belonging a variety of scientific domains: Life Science, Astrophysics, High Energy Physics, Photon Science Clinical...
With over ten years in production use dCache data storage system has evolved to match ever changing lansdcape of continually evolving technologies with new solutions both existing problems and challenges. In this paper, we present three areas innovation dCache: providing efficient access NFS v4.1 pNFS, adoption CDMI WebDAV as an alternative SRM for managing data, integration authentication mechanisms.
Scientific research communities have benefited recently from the increasing availability of computing and data infrastructures with unprecedented capabilities for large scale distributed initiatives. These are largely defined enabled by middleware they deploy. One major issues in current usage is need to use similar but often incompatible solutions. The European Middleware Initiative (EMI) a collaboration providers ARC, dCache, gLite UNICORE. EMI aims to: deliver consolidated set components...
We report on the status of data preservation project at DESY for HERA experiments and present latest design storage which is a central element bit- preservation. The HEP based accelerator collected large unique datasets during period from 1992 to 2007. As part ongoing DPHEP efforts DESY, these must be transferred into systems that keep available studies guarantee safe long term access. To achieve high level reliability, we use dCache distributed solution make its replication capabilities...
Serial (femtosecond) X-ray-Crystallography (SFX) is a special variant of macromolecular X-ray crystallography aiming at rapid structural studies room temperature. This highly innovative technology permits investigation bio-structures not tractable with conventional crystallography, and capable studying fast in-situ biochemical processes. The method still relatively new, but it already one the most prominent applications free-electron lasers (FELs), increasingly also very brilliant...
When preparing the Data Management Plan for larger scientific endeavors, PIs have to balance between most appropriate qualities of storage space along line planned data life-cycle, its price and available funding. Storage properties can be media type, implicitly determining access latency durability stored data, number locality replicas, as well protocols or authentication mechanisms. Negotiations community responsible infrastructures generally happen upfront, where amount space, types,...
For over a decade, dCache has relied on the authentication and authorization infrastructure (AAI) offered by VOMS, Kerberos, Xrootd etc. Although established worked well provided sufficient security, implementation of procedures underlying software is often seen as burden, especially smaller communities trying to adopt existing HEP stacks [1]. Moreover, scientists are increasingly dependent service portals for data access [2]. In this paper, we describe how federated identity management...
In this paper we discuss design, implementation considerations, and performance of a new Resilience Service in the dCache storage system responsible for file availability durability functionality.
The dCache project provides open-source storage software deployed internationally to satisfy ever more demanding scientific requirements. Its multifaceted approach an integrated way of supporting different use-cases with the same storage, from high throughput data ingest, through wide access and easy integration existing systems. In this paper, we describe some recent features that facilitate use maximise gain stored data, including quality-of-service management, heterogeneous systems - both...