TY - CONF T1 - Automated Building of OAI Compliant Repository from Legacy Collection T2 - Digital Spectrum: Integrating Technology and Culture - Supplement to the Proceedings of the 10th International Conference on Electronic Publishing Y1 - 2006 A1 - Tang, Jianfeng A1 - Maly, Kurt A1 - Zeil, Steven A1 - Zubair, Mohammad KW - Digital Library KW - Metadata Extraction KW - OAI AB -

In this paper, we report on our experience with the creation of an automated, human-assisted process to extract metadata from documents in a large (>100,000), dynamically growing collection. Such a collection may be expected to be heterogeneous, both statically heterogeneous (containing documents in a variety of formats) and dynamically heterogeneous (likely to acquire new documents in formats unlike any prior acquisitions). Eventually, we hope to be able to totally automate metadata extraction for 80% of the documents and reduce the time needed to generate the metadata for the remaining documents also by 80%. In this paper, we describe our process of first classifying documents into equivalence classes for which we can then use a rule-based approach to extract metadata. Our rule-based approach differs from others in as far as it separates the rule-interpreting engine from a template of rules. The templates vary among classes but the engine is the same. We have evaluated our approach on a test bed of 7413 randomly selected documents from the DTIC (Defense Technical Information Center) collection with encouraging results. Finally, we describe how we can use this process to generate an OAI (Open Archive Initiatives) - compliant digital library from a stream of incoming documents.

JA - Digital Spectrum: Integrating Technology and Culture - Supplement to the Proceedings of the 10th International Conference on Electronic Publishing T3 - ELPUB CY - Bansko, Bulgaria SP - 101-112 J1 - ELPUB2006 ID - oai:elpub.id:107_elpub2006 ER -