Reformatting: Terminology, Intent and Practices

By Chris Lacinak

Director of Operations, Vidipax

Archiving, Preservation, Restoration, Conservation, Access, and Copy are words that are used very broadly and interchangeably throughout the audiovisual archiving and preservation field. These are words which historically have no defined practices that are tied to them. How does one know which they are performing and/or if they are performing to industry standard or specification? Without clear definition of the practical application of these words there is not much meaning to them. This is detrimental to the purpose and principle which they seek to define.

Even more important than defining the words is defining the purpose with which they are associated. The truth of the matter is that institutions charged with “preservation” often have varying and peripheral goals which may weave in and out of, and look like, various goals at different points in the process.

I conducted a small survey of professionals who archive, preserve and provide access to audiovisual materials. This group included experts in the reformatting process, administrators overseeing large collections and librarians who manage collections and outsource reformatting work. I asked two questions:

  1. Describe, in your own words, the difference between preservation and duplication.
  2. List 3 key aspects/factors/processes which identify the difference between preservation and duplication.

Responses to question number one included:

"Preservation is a process, strategy or approach taken to protect the original object, materials and content. Duplication is simply the act of creating a copy."

"For the purposes of preservation and professional usage, sound, (moving) images and associated metadata [content] should be transferred without loss or degradation."

“One can duplicate/copy media without concern for its long-term preservation. The copy may be of compromised quality (contain information/data loss) or be reproduced on a non-durable medium that deteriorates over time. Technological obsolescence may also render media unreadable over time if it cannot be properly migrated. Hence, preservation goes beyond duplication in its concern for the longevity of media, both in terms of its authenticity and readability over time.”

Responses to question number two included:

“concern about data loss/data authenticity; ability to migrate/read data over time; and durability of the physical stratum on which it's housed.”

“1) Knowledge 2) Resources 3) Ethical considerations.”

While the concepts of individuals regarding differences are closely aligned, the associated practices and materialization of the concepts are harder to define. Progressive awareness, over the past 20 years, regarding the need for reformatting audiovisual materials has directed rapid proliferation of reformatting projects. The rapid rate of reformatting increases the burden on the solidity and quality of the practices utilized to represent the goals for which they are intended. The consequences of ignoring this task are too great and damaging to our collective historical and artistic content. As a community, we must seek a common understanding to ensure that our reformatting actions are truly representative of our intended objectives, and that our actions are guided by clarity, not by ignorance. As part of this process, it is necessary to articulate the spectrum of preservation reformatting services and practices using a common terminology.

This document begins the conversation by presenting a “straw man” proposal consisting of a list of differences. The list includes both practical and philosophical contrasts in an effort to draw closer to a definable and material set of dissimilarities between concepts represented in the terms “Archiving”, “Preservation”, “Restoration”, “Conservation”, “Access” and “Copy”. At the very least, it is intended to serve as a common reference for the broad and diverse community charged with carrying forth various aligned causes, as we move forward in our efforts.

Rather than to try to define these words or argue semantics, this document seeks to define the practical application of the purpose behind the vocabulary in reference to the reformatting process.

The three purposes outlined are as follows:

  1. Faithful reproduction, intended to serve as an exact representation of the original, worthy of replacement with regard to the content. Supported by a structure/strategy which seeks to prolong the carrier/media and content perpetually.
  2. Sufficient reproduction, intended to serve as an adequate representation to convey the intention of the original, for the foreseeable future. Supported by a structure/strategy which seeks to prolong the carrier/media and content perpetually.
  3. Informational reproduction, with the primary intention of serving as an informational reference, for a limited time span.

Experience has shown that all three of these may be utilized throughout the duration of a reformatting project, sometimes in parallel and sometimes singularly.

When using words instead of purposes, you see that in the case of an informational reproduction, in retrospect, isn’t the institution that loses the original and is left with only this reproduction happy that they are left with a reproduction of the original? Even a low-level reproduction may serve as a form of preservation, in the case where an original is subsequently lost.

This is an argument that is carefully made from a vantage point of hindsight and is not intended to be utilized in project planning, but proves the point that even a project not intended for preservation can serve the purpose of preservation in the absence of anything greater. And the point is made only to propose that a further evaluation and clarification of terminology, concepts, intent and practices are needed to ensure that moving forward as a community is tied to progress. Forward movement without progress may very well be more harmful than no movement at all.

Also, the processes described below are meant to encompass the reformatting process specifically, and do not speak to the ongoing management, long term storage and maintenance of collections.

Click on the terms in the “Parameter” column for a more detailed breakdown of its meaning with respect to the type of reproduction – faithful, sufficient, or informational – to be created. Within each detail page there is a link back to this page.

Parameter Faithful Sufficient Informational
Diagnostic
Each tape received is closely visually examined by a technician to determine the proper method of treatment and/or reproduction.
Each tape received is given an initial visual examination.
Non-existent as a pre-production activity. If performed, it is performed as a reaction to diagnosing only a few through failed reproductions.
Preparation
Each tape is thoroughly physically examined and prepared for treatment and/or transfer.
Each tape is prepared for treatment and/or transfer.
Non-existent or Batch is treated on basis of diagnosing only a few through failed reproductions.
Treatment
Performed under the principle of obtaining a faithful reproduction of the original recording. Stabilizing the physical medium as close to its original state as possible and countering degradation mechanisms in an aim to achieve a faithful reproduction.
Only performed under a pass/fail criteria. Pass criteria is “transports without failure”, but may have unnecessary artifacts of varying extremes.
None performed
Transfer
Primary focus is ensuring absolute preservation quality. All aspects are aimed at a faithful reproduction of the original.
Other factors driving primary focus away from ensuring absolute preservation quality
Unmonitored multiple simultaneous transfers. Playback potentially performed faster than real-time. Potentially lesser quality equipment. Greater interval of time between cleanings of transport. No level setting.
Transfer Documentation
An attempt to capture the reformatting process, source and destination media and content characteristics.
Meeting the metadata requirements.
Documenting Pass or Fail status of reproduction.
Environment
Meet multi-media long term storage environment specifications. Secure.
Temperature and Humidity control. Secure.
No monitored temperature or humidity control. Basic security.
Equipment
Meets, or wherever possible, exceeds the technical parameters and technical limitations of the original recording device. Meets professional industry standards.
Meets, or wherever possible, exceeds the bandwidth and technical limitations of the original recording device. Meets professional industry standards.
Reproduction ability may not meet technical specifications of original recording device. Signal path and transport may not be sound with regard to preservation.
Signal Path
Wiring is high quality. Devices in the chain are chosen carefully and routed with signal integrity and preservation in mind.
Wiring is high quality. Devices in the chain are chosen carefully and routed with signal integrity and preservation in mind.
Wiring and I/O may be of lesser quality. Devices in the signal path may be of lesser quality. Signal path is chosen to meet primary goal of expediency and convenience, and may result in unnecessary components or improper choice of components in the signal path.
Staff
Thorough working knowledge of obsolete and new technologies and Library Sciences. Embedded in the field. Have core preservation sensibilities which are represented in actions and choices made in reformatting. Can speak and write intelligently on the topic.
Strong technical knowledge and understanding of preservation values.
Basic technical knowledge.
Quality Assurance
Implemented throughout entire process to ensure the highest level of quality assurance in all aspects of source media, reformatting, destination media and fulfillment
Implemented as a process to avoid major quality issues.
Pass/Fail
Metadata
Source media description, Industry standards and references used, Reproduction information, Destination information, Media and Content Condition report, Unique Identifier, pointers to relative objects.
Title Unique identifier
Title

Back to the top

Diagnostic

Diagnostics provide the opportunity for information regarding

  • Media Production timeline
  • Potential environment used
  • Environment stored
  • Geographic location
  • Professional or amateur recording
  • Known and potential degradation mechanisms
  • Miscellaneous known and potential transfer issues
  • Preparation and treatment necessary prior to reproduction
  • Projected associated costs for reformatting
  • Reproduction technology necessary (Noise reduction decoding, Standard Equalization, etc.)

Faithful Diagnostic

  • Physical construction
  • Condition
    • Mold
    • Water damage
    • Deterioration
    • Residue existence and type
  • Odors
  • Container metadata
    • Original User
    • Writing instrument/labeling mechanism used and its condition
    • Dates
    • Content
    • Copy/Compilation tape
    • Performers
    • Geographic location
    • Original equipment used
  • Administrative
    • Writing instrument/labeling mechanism used
    • Correlation to Original user metadata
    • Catalog #
  • Marketing information printed on container
  • Correlation to media
    • Type
    • Logistics
    • Condition

Sufficient Diagnostic

Container

  • Condition

Media

  • Format
  • Type
  • Condition
  • Splices

Back to the top.

Informational Diagnostic

The media is looked at as it’s being pulled out to place in/on the transport for reproduction.

Back to the top

Faithful Preparation

This step involves confirming information gathered as part of the diagnostic process and expanding on this information.

  • Track Format
    • Media Length
    • Media Type
    • Process Encoding/Decoding
    • Playability
      • Unidentified degradation
      • Cassette/reel damaged
      • Tape Damage
    • Content type identification
    • Initial evaluation of visual/sonic characteristics
  • Pre-Transfer preparation
    • Fixing Splices
    • Adding/Replacing leader
    • Presence of alignment reference
    • Correct poor tape wrap
    • Playback speed(s)
    • Program Length

Informational Preparation

  • The media is looked at as it’s being pulled out to place in/on the transport for reproduction.

Back to the top

Faithful Treatment

Expert treatment minimizes artifacts while maximizing sonic quality. Any compromises made during the treatment phase can affect the integrity of the transferred content to the detriment of future preservation and the value of the asset.

Faithful reproduction is achieved by restoring the physical medium to its original condition as closely as possible. Although it may be expedient, shortcutting this labor-intensive phase results in the need for remedial post-production “clean up” that is detrimental to the content.

Treatment is a process which is post-diagnostic and pre-transfer. Expert diagnosis is critical in providing proper treatment. Media and data loss is the result of misdiagnosis and application of improper treatments.

Treatment activities may include cleaning, baking, lubrication, physical repair etc…

Sufficient Treatment

Treatment under this category is reactive, not proactive. It is a result of an initial failure in reproduction and/or transport. The potential gain is a gain in time and cost. The potential losses include added artifacts, media damage, content loss, added time, and playback machine damage.

Informational Treatment

No treatment. Insurance of quality image reproduction and transport success are sacrificed.

Back to the top

Faithful Transfer

  • Equipment
    • High Quality equipment
      • Monitoring
      • Playback
      • Record
      • Routing
      • Wiring
  • Setup
    • Playback device is setup and aligned to the source media and reference bars/tones and/or content, referenced to industry standards, with a focus on faithful reproduction. Optimal utilization of destination medium and addressing of preparatory and diagnostic notes which call for operator intervention during the transfer.
    • The heads and guides are cleaned after each playback or transfer to ensure that cross contamination of masters does not occur and transfer artifacts are not presented as a result of residue or particulate matter left on the transport.
    • Record device and media are setup and aligned to industry standards.
  • Transfer
    • Playback performed in real-time.
    • Fully monitored transfer.
    • One to one relationship between the program and the transfer engineer.
    • During playback the technician may need to adjust the playback deck.
    • Tape tension and tape-to-head/stylus-to-groove contact is always closely monitored for optimal playback.
  • Content/Reporting
    • Relevance of content to title and existing metadata is noted.
    • All visual artifacts and physical issues are noted and diagnosed as relating to degradation mechanisms, transport error or original recording errors.
  • Characteristics of Transfer Engineer
    Thorough working knowledge and understanding of
    • The media
    • Playback mechanism(s) and nuances of the transport
    • Technology
    • Expectations of audible/visual results
    • Expectations of the media based on the condition
    • Discerning and defining errors and their source.

Sufficient Transfer

  • Equipment
    • High Quality equipment
      • Monitoring
      • Playback
      • Record
      • Routing
      • Wiring
    • Frequently tested, maintained and calibrated
    • Professional I/O
    • Proper signal path
    • Capability of exceeding, when possible, but never less than meeting, the bandwidth and technical limitations of the original recording device and/or media.
  • Setup
    • Playback device is setup and aligned to the source media and reference bars/tones and/or content, referenced to industry standards, with a focus on faithful reproduction
    • The heads and guides are cleaned after each playback or transfer to ensure that cross contamination of masters does not occur and transfer artifacts are not presented as a result of residue or particulate matter left on the transport
    • Record device and media are setup and aligned to industry standards
  • Transfer
    • Playback performed in real-time
    • Monitored transport
  • Content/Reporting
    • Significant visual Artifacts and physical issues are noted
  • Characteristics of Transfer Engineer
    Thorough working knowledge and understanding of
    • Playback mechanism(s) and nuances of the transport
    • Discerning and defining errors and their source

Informational Transfer

  • Equipment
    • Moderate Quality equipment
      • Monitoring
      • Playback
      • Record
      • Routing
      • Wiring
  • Setup
    • Playback device is periodically setup and aligned to industry standards.
    • Record device and media are periodically setup and aligned to industry standards
  • Transfer
  • Content/Reporting
    • Pass/Fail reporting
  • Characteristics of Transfer Engineer
    • Basic knowledge of the playback mechanism(s) and transport.

Back to the top

Faithful Documentation

  • Source media identification
  • Collection and content information
  • Physical condition
  • Diagnostic results
  • Preparation process
  • Treatment and transfer processes
  • Operators and equipment
  • Content technical quality evaluation
  • Correlation between process and content documentation
  • Destination media/format identification
  • Provenance information and derivative copies produced

Sufficient Documentation

  • Meeting the metadata requirements

Informational Documentation

  • Documenting Pass or Fail status of reproduction

Back to the top

Faithful Environment

  • Temperature and humidity controlled appropriate to media and process
    • Storage
    • Production
  • Maintains good indoor air quality
  • Incorporates media tracking system
  • Secure
  • Disaster prevention and recovery implementation and plans

Sufficient Environment

  • Temperature and humidity control specific to media
  • No indoor air pollution
  • Incorporates media tracking system
  • Disaster prevention and recovery implementation and plans

Informational Environment

  • No monitored temperature or humidity control
  • Basic security

Back to the top

Faithful Equipment

It is imperative that quality equipment is maintained and utilized from varying eras and varying iterations of technologies to support the diversity represented in audiovisual collections. The ability to reproduce is not always an indicator of successful reproduction. Matching corresponding technologies, devices and signals appropriately is the difference between poor and proper reproduction. The significance of the ability and knowledge of the technician utilizing these tools cannot be emphasized enough.

Diagnosis

  • Tools which accommodate diagnosis of materials
    • Allow inspection of physical and magnetic/optical properties
    • Show evidence of degradation

Treatment

  • Tools and devices that remedy physical maladies which cause sonic/visual artifacts and incorporate
    • Safe transport if applicable
    • Safe and proper application of solutions if applicable
    • Narrow margin of variation of required treatment specifications

Features of reproduction and record devices

  • Stable and safe transport
  • Exceeds, when possible, but never less than meets, the technical parameters and technical limitations of the original recording device.
  • Routine testing and maintenance program to ensure integrity
  • Offers adjustment of key sonic/visual and transport aspects
  • Does not add artifacts to original
  • Interfaces properly with peripheral equipment in reproduction and capture system
  • Offers flexibility of reproduction methods appropriate for preparation and diagnosis.

Test devices – Facility has

  • Oscilloscope / Waveform monitor & Vectorscope
  • Alignment tapes for playback device
  • Reference tapes for system integrity analysis
  • Devices for testing and analysis of signals

Peripheral and integrated system components

  • Patchbays and/or Routers
    • Professional industry standard IO
    • Setup to accommodate multing of signals
    • Incorporates tones, bars, sync
  • Standards converters
  • Time base Correctors

Sufficient Equipment

Features of reproduction and record devices

  • Stable and safe transport
  • Routine testing and maintenance program to ensure integrity
  • Does not add artifacts to original
  • Interfaces properly with peripheral equipment in reproduction and capture system

Test devices – Facility has

  • Oscilloscope / Waveform monitor & Vectorscope
  • Alignment tapes for playback device

Peripheral and integrated system components

  • Patchbays and/or Routers
    • Setup to accommodate multing of signals
    • Incorporates tones, bars, sync
  • Standards converters
  • Time base Correctors

Informational Equipment

Features of reproduction and record devices

  • Stable and safe transport

Peripheral and integrated system components

Has ability to produce tones, bars and sync

  • Standards converter
  • Time base Corrector

Back to the top

Faithful signal path

  • No unnecessary equipment in the signal path
  • Multiple destinations have a direct 1:1 relationship with the source
  • If multiple destinations, source signal is split/multed with high-end method ensuring integrity
  • Signal path is checked on a regular basis for integrity
  • Optimum gain staging from source to destinations
  • Software utilized for uses quality algorithms and is bit transparent at unity.
  • Engineer knows how to properly utilize dither, quantizing, noise shaping, compression and has a knowledge and understanding of basic digital concepts and practices.

Sufficient signal path

  • No unnecessary equipment in the signal path
  • Multiple destinations have a direct 1:1 relationship with the source
  • Signal path is checked on a regular basis for integrity
  • If multiple destinations, source signal is split/multed with high-end method ensuring integrity

Informational signal path

  • Wiring and I/O may be of lesser quality
  • Devices in the signal path may be of lesser quality
  • Signal path is chosen to meet primary goal of expediency and convenience, and may result in unnecessary components or improper choice of components in the signal path

Back to the top

Faithful Staff

A staff comprised of individuals with expertise in a diverse set of disciplines is optimum. Naturally, this includes audiovisual reformatting and preservation. Overall criteria for a staff include experience, training and working knowledge of audio/video engineering (aka technician. Not an engineering degree), digital media/technology, electrical engineering, library sciences, material sciences and general arts and history.

  • The institution should support internal and external growth.
    • Internal cross-training, discussion and industry related research and writing on preservation concepts, practices and philosophy
    • External learning and participation in seminars, symposiums and conferences
  • The staff should possess overall qualities of critical thought, good troubleshooting skills and genuine interest in media/content preservation.
  • Ability to diagnose physical and audiovisual artifacts and create treatment plan
  • Ability to use industry tools for analysis
  • Knowledge of end use of content and associated metadata

Sufficient Staff

  • Ability to perform most basic tasks involved with performing and overseeing transport function.

Back to the top

Faithful Quality Assurance

  • Calibration of transport, playback and record devices
    • Experience
    • Supporting Documentation
      • Intranet Manual
  • Worksystem/Data flow
    • least amount of entry
    • maximum amount of automation
  • Metadata
    • Matches any relative existing data
    • Spelling
    • Dissemination
      • Labels
      • Reports
      • Embedding
  • Transfer transport and content documentation.
  • Destination Specification and Content
    • Consistency in quality to source and between destinations
    • Each
    • Dissemination
      • Resolution
      • File Type
      • Content matches the source
    • Overall
      • Destination content matches
      • Qualities match
      • Metadata is accurate and matches where applicable
    • Tones, Bars and Timecode specification is accurate and match (if applicable).

Sufficient Quality Assurance

  • Calibration of transport, playback and record devices
  • Metadata
    • Spot check accuracy
  • Destination Content
    • Content exists
  • Fullfillment
    • Deliverables match specification
      • Correct number of destinations
      • Correct formats
      • Labeling exists
      • Reports exists

Informational Quality Assurance

  • Pass/Fail of reproduction transport and content
  • Functionality of Destination media

Back to the top

Metadata

Metadata capture, as used here, must be confined by a couple of considerations for proper perspective on the noted parameters.

  • The metadata capture parameters defined are pertaining to the reformatting process only. While it is feasible that some of these parameters may be captured in pre or post reformatting processes, those which pertain to the reformatting process have been noted here.
  • The choices made have been guided by a perspective which considers the variable nature at which content enters and exits the reformatting process. A Unique Identifier for instance is meaningless on its own. However a unique identifier is imperative for an object to thrive within a repository. Therefore it is listed as a parameter for those who have the purpose of providing a structure/strategy which seeks to prolong the carrier/media perpetually.

Back to main navigation. | Back to side navigation.

Updated: February 28, 2005
Send comments/questions

Creative Commons License
This work is licensed under a Creative Commons License.