We published an unclassified unlimited release (UUR) technical report.
We published an unclassified unlimited release (UUR) paper.
Composition of computational science applications, whether into ad hoc pipelines for analysis of simulation data or into well-defined and repeatable workflows, is becoming commonplace. In order to scale well as projected system and data sizes increase, developers will have to address a number of looming challenges. Increased contention for parallel filesystem bandwidth, accomodating in situ and ex situ processing, and the advent of decentralized programming models will all complicate application composition for next-generation systems. In this paper, we introduce a set of data services, Faodel, which provide scalable data management for workflows and composed applications. Faodel allows workflow components to directly and efficiently exchange data in semantically appropriate forms, rather than those dictated by the storage hierarchy or programming model in use. We describe the architecture of Faodel and present preliminary performance results demonstrating its potential for scalability in workflow scenarios.
we received DOE approval to relase version 1.1803.1 ("Cachet") of faodel on github.
The code is now hosted at github:
We presented an unclassified unlimited release (UUR) poster.
It's official: I'm renaming my main project at work to FAODEL: Flexible, asynchronous, data-object exchange libraries. FAODEL (pronounced fay-oh-dell) comes from a simplification of the Gaelic term faodhail, which is a land bridge used to cross between islands. Here are two examples between the Monach Islands in Scotland:
What's a faodhail? WikiSource says:
faodhail, ford, a narrow channel fordable at low water, a hollow in the sand
retaining tide water: from N. vaðill, a shallow, a place where
straits can be crossed, Shet vaadle, Eng. wade.