Date: March 11, 2012

Length: 6 hours (Sunday morning)

Effect: Telco subscribers affected to different levels.

Cause: A commission summary database job was disrupted by the weekly backup and did not recover which locked some commission database tables. The backup completed fine.