Title :
A scientific workflow solution to the archiving of digital media
Author :
Hou, Chien-Yi ; Altintas, Ilkay ; Jaeger-Frank, Efrat ; Gilbert, Lucas ; Moore, Reagan ; Rajasekar, Arcot ; Marciano, Richard
Author_Institution :
San Diego Supercomput. Center, UCSD, San Diego, CA, USA
Abstract :
This work explores the challenges of embedding long-term preservation processes into existing video production workflows. The challenges are many: size of video data, bulk and parallel transfer into the archive, automation of the processes, elimination of human steps, automatic triggering of the preservation workflows, replication of content, automatic extraction of metadata, and most important mechanisms to ldquohardenrdquo the automation by providing recovery mechanisms in case of errors and discrepancies. We present production-quality solutions that automate this process and make use of Kepler scientific workflows and Storage Resource Broker (SRB) data grid environments.
Keywords :
grid computing; information retrieval systems; multimedia computing; video databases; workflow management software; Kepler scientific workflows; SRB data grid environment; digital media archiving; long-term preservation process; production-quality solutions; scientific workflow solution; storage resource broker; video production workflows; Data mining; Environmental management; History; Humans; Material storage; Production; Project management; Resource management; Storage automation; Supercomputers;
Conference_Titel :
Workflows in Support of Large-Scale Science, 2006. WORKS '06. Workshop on
Conference_Location :
Paris
Print_ISBN :
978-1-4244-5215-6
DOI :
10.1109/WORKS.2006.5282348
