[ibm] The IBM Smart Surveillance system (S3) is developed by the Exploratory
Computer Vision Group in IBM
Watson Research Center. The system is a middleware
offering for use in surveillance systems and provides video based
analysis capabilities. Release 1 of the Smart Surveillance System
- Smart Surveillance Engine (SSE) which provides the front
end video analysis capabilities.
- Middleware for Large Scale Surveillance (MILS) which
provides data management capabilities.
system draws on some of the Smart Surveillance technologies created by
IBM Research. S3-R1 provides the following functionality.
based Real Time Alerts including Motion Detection, Directional Motion,
Abandoned Object, Object Removal & Camera Move/Blind: User
Designed Alerts: Specified
using simple SQL like interface.
based Event Search using Object
Type, Object Size, Object Speed, Object Location, Object Color, Track
Duration & Compound Queries
based Event Statistics including
Distributions & Moments
system is currently available to end customers on a pilot basis.
Business partners can also license the
technology for product development.
Scenarios While being
able to provide real time alarms to “pre-programmed” events is useful,
the ability to search through event
data and understand patterns enables new “security strategies”.
Understanding long term patterns of
activity and the ability to search through events can help identify
real-time alarms are useful, reacting to a large number of real time
alarms is infeasible. Understanding patterns of
violations for effective deployment of patrols is critical.
Scale Investigations: In large
scale investigations like the Washington Sniper incident, the ability
to sift through large numbers of
surveillance video tapes to identify commonality is essential.
Smart Surveillance Technology Base:
Detection in the
presence of distraction motion
- 2D Object
tracking with occlusion resolution.
independent object classification.
- 3D Object
Tracking: Precise 3D
location using standard cameras.
Tracking: Automatic PTZ
Camera control to track objects.
Handoff: The ability
to track an object across cameras.
faces at large distances from the camera.
Metadata Representation for object
and its motion attributes.
Engine Architecture for plug and
play video analytics.
- Real Time
Event Indexing: Scene events
are instantaneously available for searching in a distributed database
service interfaces for Event Search & Retrieval
rapid application development of customer specific applications.
Backend System: COTS
database technology allows for both distributed surveillance and
- Robust Background Subtraction
- Salient Motion
- 2D Tracking
- 3D Multi-Person Tracking
- Articulated Human Body
- Active Head Tracking
- Coarse Head Pose
- Position Independent
- Face Cataloger
- Video Privacy
- Multi-scale Tracking &
- Real Time Alerts
- Middleware for Large Scale
- Performance Evaluation