Mystery solved

opinion
May 26, 20202 mins

It’s all so deterministic.

Computerworld  |  Shark Tank
Credit: Computerworld / IDG

Company where this pilot fish works is having a bit of a problem with non-deterministic load times in the data warehouse. If the load runs normally, even with heavy volume, everything is done by about 9 a.m., which means management can see their reports just around the time they’re having their morning coffee.

But the load doesn’t always run normally. In fact, a system problem during the night can set things back by as much as six hours, which management finds unacceptable. So various measures are taken to get the load to run in less time: Users are kicked off the system, priorities are rejiggered and so on.

Nothing works. The load processes just don’t seem to take advantage of the resources made available to them.

Then, a chance discussion with a member of the storage team lifts the veil. Turns out that the backup, which runs directly on the network storage system, kicks off automatically when drives are available after 9 a.m. There’s no direct visibility into this with the flavor of Unix on the warehouse server.

Now the solution is simple: Disable the automatic backup within the storage system’s scheduler and trigger it with a job that’s added to the end of the production stream. Once the load completes — and only then — the backup is triggered.

Result: Production delays — likely caused by users being on the system — levy about a 10% penalty rather than the 100%-plus penalty that had been hitting the process before.

sharky

Questions that Sharky gets a lot

Q: What's a pilot fish?

A: There are two answers to that question. One is the Mother Nature version: Pilot fish are small fish that swim just ahead of sharks. When the shark changes direction, so do the pilot fish. When you watch underwater video of it, it looks like the idea to change direction occurred simultaneously to shark and pilot fish.

Thing is, sharks go pretty much anywhere they want, eating pretty much whatever they want. They lunge and tear and snatch, but in so doing, leave plenty of smorgasbord for the nimble pilot fish.

The IT version: A pilot fish is someone who swims with the sharks of enterprise IT -- and lives to tell the tale. Just like in nature, a moment's inattention could end the pilot fish's career. That's life at the reef.

Q: Are all the Sharky stories true?

A: Yes, as best we can determine.

Q: Where do the Sharky tales come from?

A: From readers. Sharky just reads and rewrites and basks in the reflected glory of you, our readers. It is as that famous fish-friendly philosopher Spinoza said, "He that can carp in the most eloquent or acute manner at the weakness of the human mind is held by his fellows as almost divine."

Q: Do I have to write my story in Sharky-ese?

A: No. Not at all. Just be sure to give us details. What happened, to whom, what he said, what she said, how it all worked out. If Sharky likes your tale of perfidy, heroism or just plain weirdness at your IT shop, he will supply his particular brand of Shark snark.

Q: I've got a really funny story, but I could get fired if my old trout of a boss found out I told you. How confidential is what I send to Sharky?

A: We don't publish names: yours, your boss's, your trout's, your company's. We try to file off the serial numbers, though there's no absolute guarantee that someone who lived through the incident won't recognize himself. Our aim is to share the outrageous, knee-slapping, milk-squirting-out-your-nose funny tales that abound in the IT world, not to get you fired. That would not be funny.

Q: How do I get each new Shark Tank tale emailed to me?

Easy. Subscribe to the newsletter.

Q: Where are the Sharkives?

Tales of old can be found in Sharky's archive.

More from this author