Data Cleaning

About a year ago, the other half had a computer that malfunctioned in a particularly nasty way.

All of the data from that computer was essentially wiped because the computer itself managed to rewrite data enough times on an SSD that it killed the drive. FYI. Solid State Drives have a finite lifespan that is dictated by the number of times data is written to them.

The other half’s computer managed to kill not one but two SSD drives in 6 months. Wow! that’s a whole lot of rewriting of data. 20 years worth in 3 months.

The upshot of all of this is that I ended up digging data up from backups, and places on the network where they’d stored data. This doesn’t sound like much of an issue until you realize that the other half stores data in a completely random way.

This is not surprising since hardcopy data is stored in exactly the same way in odd little places all around the house.

After I’d consolidated all the data I could recover into a single group of folders on the server, I said, “Okay that’s all I can do, you’re going to have to sort through and delete duplicates and what you don’t need.”

That was over a year ago. Guess what? Nothing has been touched since the important documents got transferred to the new computer.

Here’s a lovely chart showing how much data is needlessly occupying space on the server.

These numbers are astounding. Gigabytes of duplicate data? Really?

Well, since none of this has been touched in over a year. I’m going to clean house!

This is going to take a really long time. I’m not even going to bother to examine files, I’m going to use a utility to merge folders and delete duplications.

Whatever is lost will probably be of no consequence since it wasn’t important enough to look through in the first place.

The fact is, there’s no reason to have 5 folders of duplicate information indexed and stored on the server. It’s not that I’m all that worried about space I’ve got tons available. It’s about the possibility of a drive crash and all of this crap would make recovering from a one or two drive malfunction in the RAID array really tedious.

I’m sure that I’ll hear about something being lost, sometime in the future, but I’ll deal with that when/if the time comes.

At this point, I’m curious to see just how the deletion of all of this crap affects the performance of the server. I’m betting that the reduction in size of the index files alone will get me a speed boost.

I just hope the utility can swallow and digest a mountain of redundant data.

I should know in another 12 hours or so.

Now off to deal with some other poop. This time it’s legitimate poo, from the dog. Strangely I don’t mind cleaning the poop from the back yard nearly as much as I mind cleaning up the poop on the server.

Have a great weekend.


Update:

260GB deleted. Probably 100GB more to sort through.

The cleaning application, got lost in the mess. This happened several times.

I finally got annoyed with the utility. I was seriously considering asking for a refund. I went in manually to do the job. Initially I was thinking, “DAMN a human brain will still be needed to do the most basic things!”

Uh Huh…

I found that the application was having a problem with folders nested within folders that all had the same names.

It looked like the image to the right.

But in each one of the subfolders, there were files. Some of these files were originals and some of them were duplicates.

This diagram shows a recursion only 5 levels deep. Something like 63 directories and what I was looking at was in some cases 7 levels deep. It was not uncommon for there to be 1000’s of files in each directory.

As you can imagine, it got out of hand very quickly. Especially when you consider that many of the file names were duplications.

I’d been annoyed at the utility for not being able to keep it all straight. But I was far less annoyed when I realized that I, (The Human,) had gotten lost more than once in this digital house of mirrors.

As a interesting aside, It took me two different applications to create even this simple representation. One of the applications flat out refused to engage in the illogic and crashed.

The second application was somewhat uncooperative but eventually allowed me to create it, then save it as a PNG.

I’m no longer annoyed at the duplicate finding utility that threw up its hands. Even trying to create the representation was harder than I thought it would be. I could picture in my head what I wanted to show, but translating that kind of irrationality to something clear was… Odd.

In the case of the utility, I very much doubt that the programmer who created it even considered that someone would do something like this. So I still think the utility was worth what I paid for it.

Looking at the recycle bin, it looks as though the utility handled 4 levels of recursion without a complaint.

It’s because of this kind of thing that I personally am a bastard when it comes to training computer users on the importance of reasonable directory structures. I’ve always said that if you need nested directories more than five levels deep, you’re doing something wrong.

Obviously, there are exceptions to this rule. Computers can keep track of much deeper nesting, but non-technical average human beings??? More than five levels down, you’re asking for files to be “lost” and setting yourself up to chew hard disk space with duplicate files that will never be accessed again.

Yet again… There’s usually a good reason for me doing things the way I do.

So that was my Saturday… I hope yours was more fun and less, uhh… interesting.

I was looking for a new keyboard, but…

Maybe a month or two ago I ran across a nifty computer keyboard in some publication. At the time I thought, “It’s really nice, I like that it’s mechanical, It’s cool that you can order it with switches that are firm, medium, or light, which allow you to have a keyboard that is exactly what you want, but dang that’s really expensive,”

So I moved on to the next thing and forgot the manufacturers name. After all, the 8 year old keyboard I’ve got works just fine and I’m used to it.

Then yesterday, my reliable old keyboard started missing space bar presses and occasionally other keys as well. I considered the problem and admitted that it might be time for me to pony up the cash for a new one. I tried to go back and find the article in my Apple News History. I haven’t found the article I was looking for but did stumble across the Alec Baldwin, George Stephanopoulos interview where Baldwin tearfully claims he didn’t pull the trigger.

What a load of runny horse shit!

I was able to let the statement of the Armorer from the production “Someone must have put a live bullet in the gun,” go because that statement was so stupid it required no comment.

Had I commented at the time, I’d have said, “No Shit dumbass!

But Alec Baldwin crying and saying he didn’t pull the trigger?

Oh hell no, I can’t let that one go.

The gun reportedly used in the crime, (Yes, it was a crime!) was a period specific Colt revolver or a replica of the venerable Colt revolver. This gun, as are most guns, is a purely mechanical machine. There are no batteries, no electronics, no circuitry, and no software.

Guns in general are relatively simple machines that exist in the real physical world and require real physical actions to operate. They can’t be hacked.

The person holding the gun is the power source and the directing intelligence.

As you can see from the diagram, (Thank you Nichols Ranch), There are approximately 24 components in a revolver. (24 in the diagram, there could be fewer in other models) The last two components in the diagram above are the Bullet and its shell.

Functionally, you could loose the grips and the logos, possibly the ejector rod and spring, and the cylinder cover, and still have a functional weapon. It would probably bruise your hand if you fired it without the grips but the weapon would still work as designed.

There is no magic here. This is simply an elegant mechanical system.

To fire the assembled weapon requires the following steps.

Open the cylinder cover
Put rounds (a bullet and its shell) in at least some of the chambers of the cylinder. In this case a maximum of six chambers can have rounds inserted.
Close the cylinder cover
Cock the hammer.
Take aim
Pull the trigger

Repeat the last three steps as necessary five more times, then start at step one.

Note there are three inherent safety mechanisms present.

If rounds are not loaded, the gun is not ready to fire
If the hammer isn’t cocked, the gun is not ready to fire.
If the trigger is not pulled, the gun will not fire, even if rounds are present and the hammer is cocked.

I’m not a gunsmith, but if I’m looking at the diagram correctly, it appears that the action of cocking the hammer is what causes the cylinder to rotate, moving the next round to firing position.

This mechanical simplicity is why the revolver and integrated shells & bullets revolutionized guns.

Prior to the revolver, the choice was a cap and ball pistol, which basically gave you one shot, then you had to spend a minute reloading before you could take a second shot (think about a cannon). That’s probably why everyone carried a sword with their pistol.

For close to 200 years, the revolver has been around, it’s well understood, reliable, and has undergone some evolution but not a whole lot.

There is a variation of the revolver where pulling the trigger also cocks the hammer.

This is why when handling a weapon you never put your finger on the trigger, and you never take anyone’s word for it, that the weapon is not loaded. You always check!

Even then if you need to pull the trigger (as in you’re checking proper function,) you always aim in a safe direction. You do not pull the trigger unless you are sure that no-one is downrange.

Given the simplicity of the revolver that Baldwin was probably using, for him to claim he didn’t pull the trigger is a bald faced lie. He may not remember pulling the trigger, but he sure as hell did.

The only other scenario that has a remote possibility is that he partially cocked the revolver when he pulled it from the holster. In that scenario though, it’s far more likely that he would have had the weapon fire the moment it cleared the holster.

I rather suspect that in that scenario Baldwin would have shot himself. I also suspect that the mechanism that rotates the cylinder would not have brought a round into correct firing position since the hammer wouldn’t have completed its travel.

That being said, if the weapon was worn or had been abused it’s a remote possibility.

However there wouldn’t have been enough of a delay for Baldwin to have brought the weapon to a firing position for the view of the camera. (They were rehearsing, the assumption is they were trying to frame a shot.)

No matter what. In this situation Alec Baldwin was the person holding the weapon. Baldwin was the person who violated gun safety protocols. Baldwin is the person who clearly still has no idea how guns work.

Ultimately, Alec Baldwin is the person who shot two people, one fatally. Alec Baldwin is therefore the responsible party and must answer for his negligence.


Update: I was just reading another article on Baldwin’s interview.

Baldwin said, “So, I take the gun and I start to cock the gun. I’m not going to pull the trigger,” he continued. “And I cock the gun, I go, ‘Can you see that? Can you see that? Can you see that?’ And then I let go of the hammer of the gun, and the gun goes off. I let go of the hammer of the gun – the gun goes off.

Was the gun cocked Alec or was it not? In this type of gun if you’re holding the trigger down and you pull the hammer back then release it the gun will fire. You’d know that if you’d paid attention in any of the on-site gun training you’ve no doubt received during your many years of movie making where you were handling guns. You’re essentially describing that you “fanned” the hammer.

Stephanopoulos stated, “There are some who say you’re never supposed to point a gun on anyone on a set no matter what.

Baldwin replied, “Unless the person is the cinematographer, who’s directing me at where to point the gun for her camera angle,” Baldwin replied. “I didn’t point the gun at her, and she said, ‘Hey, man, don’t point the gun at me.’ I pointed the gun in a direction she wanted.”

Is it me or does Baldwin’s reply sound like he was trying to blame the victim?

Do you feel guilt?,” Stephanopoulos asked.

No. No,” Baldwin said. “I feel that someone is responsible for what happened, and I can’t say who that is, but I know it’s not me.

What a piece of Shit Alec Baldwin is!

He goes on to describe how he has dreams and emotional distress. Trying to paint himself as the victim.

Really? Alec Baldwin, you are filth! I cannot even describe how reading your responses has sickened me.

I hope the family, the members on set, and everyone in the production sues you into poverty. I hope the police, the district attorney, the judge, and a jury throw the book at you. I hope you end up doing hard labor in a prison in New Mexico for the rest of your miserable life.

It’s one thing to have this be an accident. It’s quite another for you to try to slime your way out of responsibility and essentially say, she was asking for it.


BTW… I still haven’t found that keyboard site!

Tis the Season…

Here we are in December.

Decorations are starting to go up around the neighborhood.

One neighbor’s decoration is a for sale sign. I’m not surprised about that, it’s gotta be tough for a single guy living up here. The local dating pool is really thin and most of the people he’s likely to date aren’t willing to to make the trek up here with any regularity. It can be lonely.

Given what he paid for the house, and the current market, he’s likely to make a profit on the sale. I’ll be sorry to see him go because he’s a decent guy. On the other hand he’ll drive the value up on all the houses on the street, so that’s welcome.

I’ve been trying not to look at the news with any regularity. At this point even the “normal” news is like doom scrolling. I thought I’d gotten away from that when I stopped using social media. Alas, I was wrong.

I’m just not very Christmasy. I haven’t been for several years. It’s just not the same kind of fun it used to be.

Some might say it’s the commercialism, others might say it’s the fact that some shopping areas put their Christmas displays up along with their Halloween displays. So that by the time you get around to Christmas, there’s nothing special about it anymore.

When I was a kid, there were three distinct holidays and the shops changed their displays each month. My first job at Toys R Us we changed the store during those three months. We worked overtime November 1, and November 20th to make the transition. November was a good paycheck month! It was a lot of work, and we were just transitioning from Halloween to Christmas.

The change was still magical. We knew that the kids coming into the store would light up seeing Christmas trees decorated in the aisles and empty boxes in bright wrapping paper stuffed under the fake tree branches.

These days, it’s like all the magic has gone. Sure, there’s holiday music blaring in all the shopping centers. The decorations are still out, although the last time I was in a shopping center at Christmas, a lot of the decorations looked shop worn. Oddly, decorations in the several shopping centers I visited, looked alike.

I remember years ago, part of the season’s fun was going from shopping center to shopping center because each one was unique in their decorating style.

If you stopped for a moment in a mall you’d see “character” and know that someone had put real effort into creating Christmas displays that were a delight to the eye. The yearly displays also changed making each Christmas special.

I suppose all that changed when people started dwelling on being offended by the season (or for that matter anything else). It really started changing when those people began winning court cases.

Of course all of this is California specific. It’s been very rare for me to be in other states during the holidays over the past 30 years or so.

These days, the majority of the holiday shopping experience is homogeneous. One mall or shopping center is very like another.

This may be due to a several factors. One is that the malls don’t want to offend anyone. The second factor is that so many of the malls are owned by the same conglomerate so they’re buying all their decorations in bulk. Lastly, the conglomerates may think that a consistent shopping experience across their properties is better for business.

I suppose you could argue all of these factors are beneficial. But I would argue that the “sameness” diminishes the joy of the season.

There was a time when we’d say, “Lets go to XYZ mall today,” now it’s, “let go to the mall.”

I’m trying to get in the mood. I really am. I’m looking forward to the annual shopping trip with one of my best friends. It’s not so much about the shopping as it is about the comradery. I think to some extent it hearkens back to our shared heritage of ancient hunting parties.

Only this annual trip has lots of eating and drinking as part of it unlike those hunting parties where cold and wet were often the norm. Halfway through the day we’re both fairly full of good cheer! That good cheer, might offset any shortages of goods due to the supply problems this year.

A couple of friends and I would laugh ourselves stupid if we came around the corner into this shopping area.

I hope the place had a PG rating.

Hmm. Maybe I’ve found a reason to be Christmasy, I can wander the local malls for examples of holiday decorations that tried really hard, but didn’t quite work out as planned.

Have a wonderful holiday season.

That’s it! I want to get the HELL out of California!

In addition to all of the absolute bullshit that is California…

Traffic, Lockdowns, Abridgment of rights, Water shortages, Electricity Shortages, $500 Auto Registration Fees, Incompetence of the State Government and all the state’s government offices, State waste of tax dollars. Complete lack of planning, Crime, Outrageous Property Taxes, Outrageous Gas prices .55 on every gallon of gas really? Shitty roads, Outrageous State Income Taxes, and on and on and on…

I mean, pick literally any subject and then look to California to see how to do it exactly wrong.

I hate this place and everything about it.

There was a time when the benefits outweighed the hassle. That time is long gone.

This is a losing proposition any way you cut it.

That’s not to say that there aren’t some good people here and even some good Representatives in the Legislature. The problem is there are too few people with any common sense and those numbers apparently are dwindling.

The straw that has broken this camels back is EDD.

I don’t think there’s ever been a more incompetent government entity short of perhaps the last of the Roman Empire, maybe King George III’s tax collectors or court.


First EDD screwed up their modernization of their computer systems. They contracted with, and hired a bunch more people to actually do the work. Apparently the work not only didn’t get done, but they bought a shit ton of equipment that sat in its boxes until the warranties expired. Then the equipment sat for another few years until it was literally obsolete and had to be scrapped.

They were completely unprepared for the number of unemployment claims that were being filed when the pandemic hit. How did they address this? By putting more people on the phones supposedly to answer phone calls, which of course still didn’t get answered.

Oh yeah, there were hearings and excuses and in the end, after the uproar died down nothing was done. No heads rolled, and EDD went right back to its usual incompetent self.

They screwed up who was being paid during the pandemic. Turns out they paid a lot of people that perhaps weren’t eligible for benefits.

What? You mean they threw taxpayers dollars at people that shouldn’t have received benefits??? Yep… in at least the hundreds of millions of dollars range if not billions.


Now, EDD is sending out stupid emails that demand the people who received benefits prove they were eligible to receive those benefits and they’re threatening to charge 30% penalties on those benefits.

But of course the email they send you provides links to the EDD website that frankly is a hot steaming pile of shit. So even if you want to comply with their demand the odds are you can’t since the site sucks so bad.

Just connecting to their web site makes me and my computer morons. The intellect draining capacity of California’s EDD site should be harnessed and used to combat hackers and cyberterrorists the world over.

Come to think of it, the EDD site could be used as a firewall. It’s amazing at creating endless loops of login after login.

The funny parts of EDD’s demands are that they seem to think; A) The criminals who gamed the system are going to send documentation. B) That they’re going to get the money they threw away back from criminals who gamed the system.

Hey California EDD, NEWSFLASH Those people are in the wind and you’re not going to find them!

D’Oh!

But for people who had legitimate claims. We’re having to jump through hoops to clean up EDD’s fuckup.

When you talk to EDD they predictably absolve themselves of responsibility by saying the Federal Government is who is requesting this information.

That is probably true, however EDD should have all the data. They should not be asking for tax returns. After all if EDD approved a person for unemployment benefits that presumes that EDD knows who your previous employer was and verified that you were eligible for benefits in the first place. RIGHT?

It gets better, the EDD representatives are apparently unsure what exact documents you need to provide. Do you need to provide the entirety of your tax returns or just a copy of the W2 or will pages from your California Tax return suffice? They’re not sure.

It’s the Federal Government that’s asking, it goes into a computer to determine if the document is right…

Uh huh.

Having spent some time working for a Federal contractor, I can tell you that the Feds are pretty damn specific about what they want to see.

But wait, there’s more! EDD told a representative from a legislator’s office yesterday that they’d called me, (they did). I wasn’t available to take their call so they went to voice mail. This same person told the same legislative representative that they’d left a voice mail, (they did not). I sent screen shots proving the point to the legislators representative. So I have a little bit of a trust issue with EDD.

I have a real problem with providing EDD documents of this sensitive nature.

They’re incompetent, they’ve reported at least one data breach if I recall correctly. I’ve caught them literally lying to a California Legislator’s office.

Given their incompetence and Laissez-faire attitude about what they seem to need I’m concerned that by providing these documents in an electronic format I’m just setting myself up for identity theft.

After all what better hacking target than an organization with a proven track record of stupidity? Just imagine all the wonderful identities that will suddenly be available for the picking.

EDD appears to be auditing the citizens. EDD needs to be audited by a totally independent source. Maybe a group of accountants from Texas or Florida? Someone who’s not likely to sweep things under the carpet in the interest of not embarrassing California.

They made this mess. Why should the citizens be hassled, threatened, or further annoyed to help them clean it up?

I believe, California’s corruption and incompetence goes from the top all the way down to the local level.

I’m sick of it.

Voting is pointless because the people who’ve created this fucked up system greatly outnumber the people in this state who demand fiscal responsibility.

With that realization, I choose to work to get my ass out of here.

Even if that means divorce after 33 years and leaving the house and everything else behind. Honestly at this point I’m thinking about cutting my losses and doing anything to be free of this third world shit hole.

At least in another state I might have a shot at a job where I don’t have to worry about skin color quotas and layer upon layer of politically correct bullshit!

Fuck California!

p.s. In case you had any doubt… I’m not in a very good mood today.