USA flag logo/image

An Official Website of the United States Government

Video Analysis for Nighttime Surveillance and Situational Awareness

Award Information

Agency:
Department of Defense
Branch:
Defense Advanced Research Projects Agency
Award ID:
63548
Program Year/Program:
2003 / STTR
Agency Tracking Number:
03ST1-003
Solicitation Year:
N/A
Solicitation Topic Code:
N/A
Solicitation Number:
N/A
Small Business Information
Charles River Analytics Inc.
625 Mount Auburn Street Cambridge, MA 02138
View profile »
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
 
Phase 1
Fiscal Year: 2003
Title: Video Analysis for Nighttime Surveillance and Situational Awareness
Agency / Branch: DOD / DARPA
Contract: DAAH0103CR279
Award Amount: $98,915.00
 

Abstract:

Interpretation of video imagery is the quintessential goal of computer vision. The ability to group moving pixels into regions and then associate semantic labels with those regions has long been studied by the vision community. Only recently have thecomponent technologies matured sufficiently to make this goal attainable for well-defined scenarios. We propose a system for semantic interpretation of certain human behaviors in a nighttime parking lot surveillance scenario. The video stream is firstsegmented into moving objects of interest (people, cars) vs. background (ground, sky, buildings, trees, moving foliage, shadows, etc.). Trajectory analysis is then performed on each object, using robust feature tracking and 3D reconstruction. In parallel,body pose analysis is performed by a probabilistic framework that learns mappings from body silhouettes to physical pose. Trajectory and pose information is combined by inferencing over an iconic action grammar. Our approach to specifying interestingactions via behavioral models is novel, as is the identification of unauthorized actions based on top-down inferencing from these models. We will demonstrate using nighttime parking lot imagery from commercial off-the-shelf low-light video equipment. Toincrease robustness of event detection, we will also explore audio information of events such as cars starting. The proposed system and developed techniques are applicable to a wide range of DoD mission and intelligence community areas, including targetrecognition, HumanID, and surveillance & tracking. The technologies developed here could be used to model the behavior of terrorists and identify individuals engaging in illegal acts given a video stream of their motion through the environment. Thistechnology is directly applicable to various current DARPA programs (including Combat Zones that See).

Principal Investigator:

Mark R. Stevens
Senior Scientist
6174913474
mstevens@cra.com

Business Contact:

Paul G. Gonsalves
Vice President
6174913474
pgonsalves@cra.com
Small Business Information at Submission:

Charles River Analytics, Inc.
625 Mount Auburn Street Cambridge, MA 02138

EIN/Tax ID: 800029702
DUNS: N/A
Number of Employees:
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
Research Institution Information:
BOSTON UNIV.
Office of Sponsored Programs, 25 Buick Street
Boston, MA 02215
Contact: Steven Singer
Contact Phone: (617) 353-4365
RI Type: Nonprofit college or university