DPS System Problems: Thin Margin for Error Creates Snowball Effect
June 1, 2011 
4 Comments
Note: This is the third in a series of posts looking at the concern over the DPS system performance during peak season.
Even its most ardent supporters would probably agree that the DPS computer system doesn’t have much excess capacity. It appears that it is normally using most of its capability just to keep up with the demand placed on it by its users. During the peak season, when there are more transactions that need to be entered into the system, DPS will likely be using all of its capacity to keep up with the increased demand.
This lack of excess capacity creates a very thin margin for error for the DPS system. In the event of a problem which temporarily reduces the capability of the system, or takes it entirely offline, some or all of the data updates that need to be made in the system will be delayed until the system is at full strength. However, even when DPS returns to full strength, there is still a good chance the system will have problems.
This is due to the fact that now the amount of transactions that DPS has to process has increased. When DPS is down, and TSPs cannot enter pre-approvals, PPSOs cannot respond to SIT requests, and members cannot perform self-counseling, those tasks do not get eliminated. They are merely delayed until DPS is up and running again. Once it is up, everyone tries to get their delayed transactions done in DPS as soon as possible.
However there is still the normal workload that needs to be done, and the combination of the of the delayed transactions and the current transactions can sharply increase the strain on the system. If DPS does not have additional capacity available at the time, the increased stress on the system can cause another period of slowness or even downtime, which further exacerbates the problem. It can create a snowball effect of system performance issues.
We had a situation at Daycos about 5 years ago which may help demonstrate the problem. During some construction work near our office, our internet service provider cut our internet line, causing a complete internet outage for one workday during the middle of peak season. Our customers could not use our website to register their shipments for billing, or download the copies of the invoices created on their behalf.
The next day, our internet provider had fixed the internet outage, and our customers rushed back to to our website to register two days worth of billings and download two days worth of invoices. Our website promptly crashed under the increased strain. Our web programmer worked throughout the day trying to get the site back up, but it was well into the evening before it was running smoothly again. The following day, our customers tried once again to access the system, but this time to do 3 days worth of work, and again our website crashed. Thankfully we then hit a holiday weekend, and it gave our customers a chance to catch up gradually, without putting a strain on our system.
The lesson we learned is that our web based systems needed to always have extra capacity to deal with those unexpected situations where they will be under an increased load. Unfortunately, DPS does not have that luxury, and is not likely to have it for quite some time. Therefore, the only thing to do is hope that there is not some unexpected outage during the peak season that creates a snowball effect of problems.
Do you think that the DPS system will make it through the summer without any major outages? Please use the comments below to share your opinion.
Related Posts
- Daycos Creates Tracking System - March 23rd, 2007
- JPMO-HHGS Report Discusses DPS System Problems - April 14th, 2011
- DPS System Problems: Attack On the Web Bots - June 7th, 2011
I have read this post a few times over the last several days, this morning I glanced at the title once again, and instead of seeing “DPS System Problems: Thin Margin For Error Creates Snowball Effect”, I saw “DPS System Problems: Thin Margins Create Snowball Effect”.
Yea it was my mind playing tricks with me. Certainly my mind saw what it wanted to see, because this is what I have been thinking for several months. (Actually years now)
I can see SDDC eventually coming to terms with their computer system issues, what I don’t see much evidence of SDDC making much progress on the real systemic issues of the program at large.
Computer issues aside, from my point of view, most of the “capacity problems” we are seeing now are operational issues, or if you will driver, labor, and motivational issues, that have been created by and/or aggravated by the new structure imposed on the industry by DP3.
My greatest concern for the industry is that we will be forced to endure the coming fall and winter with no substantial or meaningful changes to the program, and that we will enter the NEXT summer in the same condition (but actually WORSE) as we entered this summer.
DP3 has made a business that I mostly enjoyed into an endeavor that I mostly do not enjoy. I don’t think I am alone in this regard.
I used to take pride in just how much I could see accomplished in the peak season, now it is all about selective moderation, and working with the resources that I still have left.
I say we leave the tsp high and dry on move day
Brad, I have to admit that sounds tempting at times, but I think the more prudent approach is to avoid work from the folks who have a history of putting it to your company.
There are a number of TSP’s out there that I wont do work for at any price or under any condition, not because of some perceived prejudice or irrelevant disdain, but because they have taken advantage of me in the past when I allowed them the opportunity to do so. Kind of like “fool me once….” (I have a VERY long memory in these cases)
I have a problem with giving someone my word that I will do something and then not giving them my “realistic best” to complete the process. Although, I will admit to regret at times when I have accepted work and certain particulars of the situation come to light. If these particulars involve deliberate deception, all bets are off, (with certain considerations given to a customer who might be stuck in the middle for no fault of his own).
James
You are right!
That is where we are standing now.
Unfortunately for my team – we have about reached the end of the line.
I never believed in the line
“All GOOD THINGS MUST COME TO AN END”
The unbelievable part to me is not the soon to be end of my time in this business but the realization that this chapter really ended months ago.