Blackboard upgrades 8/18/2007 (OIT SysCore)

Blackboard upgrades 8/18/2007

Todays updates did not go well. I'm finishing the process of rolling back at this point.
Blackboard is up and running in the state it was before the upgrade.

There were a number of problems but the short version is that the upgrade was taking way too long and finally errored out. I started at about 6:30 and started the rollback at about 11:45.
I have a few ideas on how to make the update work that involve the
database. I'm also submitting some errors to blackboard in a few minutes.
If I can get the mirrors rebuild I can try the update again this Sunday night at
10PM. Otherwise I can try it some night this coming week

The first unexpected "got ya" that hit me was that upgrade was unable to modify the
database due to the replication subscriptions. We are replicating our blackboard databases to a special database for access by our umbc apps. I had to remove the replication subscriptions to remove the publications, to alow the updater to modify the database.

What this means is that I'll need to completely reconfigure the replication
setup next week. This should be a good thing. When I first set up the replication,
I felt like there was quite a bit of pressure to get it working very quickly. So, I never really had time to figure out what I was doing. Nor was I able to document "how to set up replication" for the blackboard database. Now hopefully I should be able to set this up better and document the procedure properly.

The second problem was that the updater had not finished the first server after 2 hours
and it normally takes 30 minutes. I've seen this before in test, and it didn't finish after a
full day. So I had to start over. The next try I let the updater run for 2.5 hours and it finished with a critical error. Hence the rollback.

Netsaint is broken. Going to netsaint.umbc.edu gives a PGP page.

Posted by David Freeman on August 18, 2007 12:37 PM | Permalink

OIT SysCore

Blackboard upgrades 8/18/2007

Comments (16)

Post a comment

Search

About