Corruption of Time Machine files can cause recurrent kernel panics

Modern computers have too many emergent properties.

Corruption of the the Time Capsule sparse image file Time Machine writes to can cause recurrent Kernel panics.

Gruber ran into the same problem.

The source of the bug has been located in Darwin code, the fix for now is to run Disk Utility to fix the Time Capsule store.

Of course not only should Time Machine not crash under these conditions, but it’s also really wrong for a TM crash to bring down the OS. Of course it may be that the flaw is in the OS and TM is only an innocent bystander.

Bad bug, no doubt.

The good news is that it’s well understood by Gruber-class geeks, so the fix might make it to Apple.

This is where the GBs go

The stinkin' printer driver is 1/4 GB?!

MacInTouch: timely news and tips about the Apple Macintosh:

... Apple's Canon Print Driver Update 1.1, a 267MB download for Mac OS X 10.5.3 or later, brings updated drivers for the Canon Pixma Pro9500 and Pro9000....

This is the digital equivalent of a single person commuting in a monster SUV. It's obscene.

How to use Google Calendar's Quick Add pseudo-natural language interface

Quick Add: the faster way to create events is a guide to entering strings so Google Calendar can parse them. It's a faster way to enter calendar items than using the GUI, and it can represent more recurrence patterns than the GUI (ex. Every 2nd and 4th Friday of each month, thanks DLW.)

Quick Add is a kind of mid-point between Natural Language Processing (NLP) and a programming language. Perhaps for performance reasons, the gCal text entry interface is not as flexible as a typical NLP interface. It's much less capable of parsing and "understanding" a phrase than a human reader.

On the other hand, it's more accepting than a compiler or interpreter. It will ignore things it doesn't "understand" and make some inferences. The inferencing is often incorrect, so I haven't used Quick Add very much.

If you know what Quick Add expects, however, you can dramatically improve its interpretations. The key pattern is (sorry, you have to memorize this pattern -- it's in english alpha sort order until "Where"):

What(title)-When-Who(invitee list)-Where

What and When are required ...

• What: This can be any text; the event title is created from this.
• When: This can be nearly any date and/or time expression. Using “at” and/or “on” can help the recognition.
• Who: This should begin with “with” followed by a list of email addresses; these are added to the guest list.
• Where: This can be any text following “at” or “in.”

In other words (the real strings don't have the [] brackets), something like (bold is required):

[Meet Emily] on [7/12/2008] with [emily@somewhere.111, fred@somewhere.111] at [Minneapolis metrodome].

The logic for recurring events extends the "when clause":

When creating recurring events, the time expression has three parts: the start, the repetition, and the end.

So:

[Meet Emily] on [7/12/2008 every month for five months] with [emily@somewhere.111, fred@somewhere.111] at [Minneapolis metrodome]

I think you can see why this interface is nowhere near "natural", but with practice it looks powerful and it's likely to improve.

Call it pseudo-natural.

QuickTime 7.4.5 for 10.4.11 disabled audio on FLIP Video (3ivx codec) - get Perian

It was broken in April 5th! How time flies. I only noticed today. It's a known problem with QT 7.4.5 and 10.4.11, but there hasn't been much noise. Neither Apple nor FLIP has been particularly helpful ...

Apple - Support - Discussions - When will Apple fix QT 7.4.5: no sound ...

...FLIP uses the 3ivx codec. I recall that the version they were distributing last I checked was described by 3ivx as having severe security issues. 3ivx distributed a newer version but FLIP doesn't distribute it.

It may be that Apple's 7.4.5 Quicktime update fix took care of the security problem -- by deliberately or unavoidably disabling the 3ivx codec. If so, that would be, shall we say, not very nice of them.

Under the circumstances it would have been nice of Apple to have also created a kb article about the problem.

Of course FLIP should also have created a kb article, and by now they should have had a fix.

It's noteworthy though, how few complaints there are in this forum. Evidently the group of people who are using FLIP video with 10.4.11 and applying security fixes and who know about discussion forums is really, really, tiny...

So if my FLIP camcorder stops working because the software is broken, can I make a warranty claim?

No, I didn't think so.

Update 6/5/08: If you try exporting from QT Pro, you'll see no options to export the audio stream. QT Pro is not "aware" of an audio component.

Update 6/5/08b: I installed the 3ivx.com 5.0.2 codec (trial version). It doesn't work either. Happily, we're seeing more complaints on the 3ivx forum. Frustrated users may wish to install the 3ivx s/w, then register for the forum and complain it doesn't work.

Update 6/5/08c: I uninstalled 3ivx.com 5.0.2 and installed the Perian preference pane codec collection. It works. I'm able to export to Apple Intermediate Codec. Uninstalling the 3ivx.com codec will disable the Flip import utility, you will need to drag files over by hand. The import utility reads Flip metadata and puts the image acquisition date in the file name, I'm sorry to lose that.

A pox on Apple, PureDigital and 3ivx.com alike. Blessings to the Perian LGPL development team. (Now if only they'd use something other than PayPal for donations ...)

Leopard (10.5) Sparse Bundle .IMG files are packages, not files

This is surprising. I will have to test with Retrospect and see how it treats these things. I assume Retrospect will see these IMG objects as Packages, and thus back up only the changed "band".

mac.column.ted: Leopard still holds some small surprises - MacFixIt

...So why was the bundle image format added in Leopard? Because there was a significant problem with plain sparse images. A sparse image is essentially a single file. When backing up your drive, a backup utility thus sees the image as a single file, regardless of how many files are stored within the image. Further, any addition or subtraction you make to the image (such as adding even a measly 5K text document) registers the image as a modified file. This means that, if an image file were 1GB in size, the entire 1GB would need to be recopied to a backup each time the image was modified, even if the only change to the image was a 5K file addition. Not very efficient. And unnecessarily time consuming.

The sparse bundle format avoids this dilemma. Essentially, the bundle format divides the content of the image file into smaller separable bands. The image still appears as a single file in the Finder. However, it is actually a package. If you select Show Package Contents from the image's contextual menu in the Finder, you will find a bands folder containing the individual band segments (as shown in the figure below). Each band, at least in my testing, was 8MB or less. Assuming your backup software recognizes and works correctly with the bundle format, only the modified bands are copied over when backing up the image. This means that backing up the aforementioned 1GB image, with a 5K file addition, would require copying only 8MB or less!...

...Apple, in Disk Utility's Help pages, recommends using the sparse bundle format whenever you want to create "a blank disk image for storage." Indeed, Apple takes its own advice and uses the new format for FileVault (rather than the sparse image format used by FileVault in Tiger)...

The division of a .IMG file into arbitrary packaged Bands is a clever mitigation of a problem that's had many variations over the years.

Update 3/9/09: I looked into these as a way to share an iPhoto Library between multiple users. It looks like Retrospect Pro does NOT backup .sparsebundle images correctly. Yech.

Update 5/6/09: Hoisted from comments (DocIceT):

Re your attempt to make sparsebundles work with Retrospect, I had some partial success.

Firstly the backup needs to include what Retrospect sees as top level directory of the bundle. Finder shows this as the name of the package file.

More interestingly, the restore works if it is done to the original drive. If the bundle gets restored to a different drive then the bundle is not seen as a mountable file system any more.

With that said, there is some kind of permissions change going on when restoring to a different drive and I had to tweak that manually. This could break some part of the OS X structure for making those bundles work.

What is a task and a note - OS X iCal/Mail/Gmail vs. Outlook vs. Claris Organizer

In another universe I'm using Ecto Professional for task and project management, but in this world I'm an Outlook uber-geek. I know every weird kink in that twisted software, from the brilliant drag-and-drop item transformations to the fantastically clumsy object ID scheme.

In Outlook Notes are obscure colored rectangles with fancy fonts. (Bear with me, this is going somewhere.) Full text search (Windows Desktop Search in my case) makes them surprisingly useful, but most people (foolishly) ignore them. They have Categories (tags: many-to-many relationship) and data attributes that support some useful queries.

Outlook Tasks, on the other hand, are fancy with RTF bodies that can act as containers for all kinds of things.

Notes and Tasks in OS X are very different. They're especially different in 10.5, where they reflect from Mail.app into Gmail to they live as email messages!

Web 2.0: Howto : use google's imap and mail application as GTD tool

Apple's mail.app features it in the latest version that is shipped with Leopard (OSX 10.5). If you set it up to talk to gmail using imap, notes and todo's are created on the imapserver....

...A todo created here shows up...

... if you go to gmail, you'll see a label (as google calls it) with the name Apple Mail To Do, and if you click on it your todo is sitting right there for you to be handled. As it is all in iCal format, easy calendar integration is there, but most important is the fact that you have access to your todo list from anywhere....

Notes show up too, as strange emails with an invalid mail header and a "tag" of "Notes".

The Gmail integration is completely unexpected and thus far seems pretty pointless (maybe that will change June 9th?).

More to the point, OS X Notes/Tasks are almost the mirror image of Outlook Notes/Tasks. In OS X 10.5 tasks are very simple things -- a single line, a priority and due date, and a status field. Notes, on the other hand, can have many associated tasks and support attachments and (clumsy) RTF editing.

 

So where did the OS X Notes/Tasks design meme come from? Perhaps from Claris Organizer, an Apple Mac Classic app from the late early 90s that was later sold to Palm and rewritten to run as a Carbon app in OS X 10.1 and 10.2.

In Claris Organizer (later Palm Desktop for OS X), Notes were distinct entities that could be related to other items.

So you might think you were attaching a comment to an Address Book entry, but in reality you were creating a "note" item and a link from the Address book entry to the note item:

TidBITS  Moving Back to the (Palm) Desktop (1999)

Attached to Attachments -- If you've synchronized your Palm device's data and played with Palm Desktop a bit, you've no doubt run into one of the bigger brain-twisting elements of the new Palm Desktop. What happened to attached notes? Under the Palm OS, you can create a note ... that includes miscellaneous information... Looking at the Note List for the first time can produce a moment of organizational panic: in addition to the records you entered in the Palm's Memo Pad, you'll find dozens of records marked "HandHeld Note:" then the name of one of the Palm's built-in applications...

OS X 10.5 Tasks and Notes have something in common with this, though the user interface is pretty different (much simpler basically). If you start out creating an OS X Task I don't think you can create a Note related to it, but if you instead create a Note, then transform a row (line item) into a Task, you're creating a (hidden) link to a new Task item.

The awkward Palm PDA/Claris Organizer PIM integration resembles Apple's peculiar Gmail "integration", and foreshadows how hard it will be for the iPhone to sync with both Outlook and iCal. (Maybe that has something to do with why Apple hasn't put tasks on the iPhone!). I presume one would have to sync an Outlook Task with an OS X Note that happened to contain a single task!

Software dies, but software memes (and synchronization problems!) live a lot longer.

So it seems OS X 10.5 Mail.app is slowly turning into a simpler version of Outlook -- now with email, tasks, calendaring (ok, via iCal) and notes.
Meanwhile Google Apps is turning into a Sharepoint clone.

It's sure going be interesting to see how this all plays out with the iPhone.

OS X really does need an uninstaller

Found in \Library\Application Support: iWork '06 "iWork Tour" - 256MB.

iWork was pre-installed on my MacBook (demo-ware). I dragged it to the trash and deleted it.

This is how the GBs go. I'm sure I'll find more of these as I browse through the root Library. It doesn't take all that long, but we shouldn't need to do this kind of cleanup of Apple's own trash.

OS X really does need a proper uninstaller.

Parallels to VMware - my experience

As part of my move from 10.4.11 to 10.5.3 I switched from Parallels (Windows 2000 VM running Office 2003 and MindManager to VMWare Fusion (updated 5/30 for 10.5.3). Here's how it went.

1. Uninstall Parallels prior to the OS update. Don't delete the VM files (Win2K.pvs and W2k.hdd on my disk).
2. Update OS.
3. Download latest version of VMWare Fusion (not the beta though). You need to be a registered user to do this.
4. Install VMWare Fusion.
   
5. Download beta version of VMware Importer tool and install (requires Fusion be installed).
6. Find the Parallels files - Win2K.pvs and W2k.hdd. Drop the PVS file on the importer. The importer then converts the 3.1 GB Parallels file to a 3.4 GB (10% larger) single file stored in a Virtual Machine folder in current_user/Documents. (After I'd finished the entire install, however, the VM file was 4.4 GB, a 33% increase.)
   
7. I double clicked on Win2K (my VM name) and Windows 2000 SP4 launched. Fusion shows an inline reminder to install the VM tools, but after a LONG startup and restart (for Win2K this is a new machine) Fusion installed them automatically. I saw a Windows dialog requesting help with an unrecognized device -- ignore those and let the Fusion tools install and Win2K restart.
8. Shutdown Win2K after this initial install (good practice after initial config), in future just suspend it.
   

After the conversion and setup Win2K SP4 goes from shutdown to running in 30 seconds on my MacBook. Much faster than XP, much less Vista! Of course one would usually suspend the OS when done, not do a shutdown.

Uninstall Palm Desktop for OS X - Of course Palm's directions are wrong.

I'm continuing my post 10.5.3 house cleaning. This evening I noticed my login items list still included 'transport manager', which is part of the Palm HotSync framework for OS X.

I've probably bought at least a dozen PalmOS devices for Emily and I, but the platform died years ago. I've been keeping my personal Palm environment on life support pending iPhone 2.0, but there's no need for any remnants outside of my XP box.

Time for the rebranded version of Claris Organizer, better known as Palm Desktop for OS X to go.

My search for information on uninstalling Palm Desktop for OS X immediately turned up this Palm kb article.

...In the top left corner of the window, click on the dropdown menu and select UNINSTALL. Directly beneath this menu, place a check to select Palm Desktop software...

I went through that procedure, and, surprise, there's no uninstaller.

So I went back and looked for the 2nd result in the search:

Palm Desktop 4.2.1 Rev D for Mac - Download

...Uninstalling Palm Desktop

The installer for Palm Desktop 4.2.1 Rev D does not include an uninstall function. To uninstall Palm Desktop, open your Mac's Applications folder, and drag and drop the Palm folder to the trash. If Palm Desktop is in the Dock, drag its icon off the Dock...

Of course they couldn't have updated their support article -- there's probably nobody left with the password to their kb server.

I deleted the folder. Transport Manager remained as a 'ghost' in one user's login, but there was no file; it was a dangling reference. I removed it. Aside from the Hot Sync conduits, perhaps left deliberately, there wasn't a lot to clean up.

One more step towards extubation ...

OS X 10.5: Apple engineers need more children

I needed to upgrade to 10.5.3 sooner or later (I suspect the iPhone may need 10.5.3 - at least at launch time), but I'd intended to wait until it was absolutely necessary*.

I installed last night because I was enthused about one feature that promised to be of immediate value to us -- time limited child use.

Naturally, it doesn't work quite as well as I'd hoped ...

Be the best you can be: Time limited computer access

.. Since my original post I installed 10.5.1 and upgraded to 10.5.3. I discovered the shortest possible setting for time limited computer access is 30 minutes (per day).

I need a range where the low end is 10 minutes.

Sigh. Apple engineers need more children.

I also don't recommend regular people install an OS X update to an existing system until the DVDs actually ship with 10.5.3 or later. My install experience was unsettling...

Sigh. No Apple engineer should be allowed to work on parental controls unless they at least one child between the ages of 3 and 13.

I wonder if anyone has a hack to change the low end setting.

--

* Even 10.5.3, the 1/2 GB patch, has significant video issues on some relatively recent machines. Apple OS updates are also very expensive, since they may require replacing a range of software and peripherals. I'm still testing which of my things work with 10.5.3, I know that some apps that broke with 10.5.0 will more or less work with 10.5.3. One nice thing about 10.5.3 is it feels "smoother" on my Intel MacBook than 10.4.11. So it's not all bad.

Upgrading to OS X 10.5.1: LaunchDaemons

I try. Really, I try.

I knew 10.5.0 had severe quality problems. I waited until 10.5.3 was out, though the install DVD was still 10.5.1. I even cleaned up prior to installation [1].

Then I did an 'archive and install' ... Oops. I thought the installer would ask me what type of install I was doing. It didn't. Guess I should have read the manual. I ended up unwittingly doing a regular update install. (Yech.)

The install sucked down another 5GB by the way.

So I had an ominous premonition when I was done. Justified.

After installation I tried to log in to my Administrator account, with user name 'Admin'.

My password didn't work.

An empty password didn't work.

I was locked out! My other accounts worked, just not the admin account.

Google sent me directly to the fix ...

Mac OS X 10.5: Unable to log in after an upgrade install

... You may not be able to log in with a user account that has a password of 8 or more characters and was originally created in Mac OS X 10.2.8 or earlier, after performing an upgrade installation of Mac OS X 10.5 Leopard (the default installation type)...

... launchctl load /System/Library/LaunchDaemons/com.apple.DirectoryServices.plist...

So at least this was a well known bug.

I caught it because when I bought my MacBook, I used the firewire migration service to migrate the settings from my iBook to the MacBook. I never had 10.2.8 on the MacBook (it wouldn't have installed anyway), but the iBook started with 10.1. So the glitch was transferred to the MacBook.

A little booby trap, just waiting to detonate when I installed 10.5.1.

Fixing the bug required entering some reasonably convoluted unix commands. The last step in the series resets the admin password. [2]

Yes, as has been known for some time, anyone with access to your machine can reset your admin password, though they won't have access to the admin keychain. (Since I reset the password to the old password, I still have access to the admin keychain).

Now I've installed 10.5.3.

More on that later.

If you haven't updated to 10.5, I'd suggest waiting until Apple starts shipping DVDs with 10.5.3. "Leopard" was a really buggy OS update, a kind of mini-Vista.

[1] Cleanup

1. Uninstall Parallels 2.5.
2. Check for Input Managers and remove them (l found smart crash reporter.)
3. Remove contextual menu items
4. Remove Preference Panes
5. Repeat for both admin and my primary account.
6. Do a safe boot (hold shift on start) to run maintenance checks.
7. Delete all apps I suspect won't work with 10.5.1 or that I don't often use.
   
8. Reboot into admin

[2] I suspect that if one has encrypted one's home directory, then one would be, technically speaking, screwed.

Update 6/17/11: Years later my iMac started handing at startup. It passed hardware tests, I couldn't find an easy fix, so I archived and installed. Right. That's why I'm back.

The horrid Apple fix worked again. This time though I created a fresh administrator account before I upgraded to 10.5.8. I'll delete the old, contaminated account. Should have done that years ago.

How to uninstall Parallels Desktop for OS X

Uninstall is not an OS X strength.

It's not quite as bad as OS/2, where nothing could be uninstalled, but it's not good. (Note to self: this was a bad sign about how finished OS/2 was. Don't forget this.) Perfectly behaved apps can be simply deleted, but those are less common that one would imagine. Even Apple apps aren't all that well behaved.

Applications like Parallels Desktop and VMWare Fusion are particularly worrisome. You know these things are messing with the deep OS.

The good news is that there is an uninstaller -- it's in the DMG file. The bad news is that it's surprisingly hard to find out about this. Google failed completely, and it took several searches through the Parallels kb to find this article (VMWare Fusion was marginally better at providing the same info):

KB #5027 - What is the recommended policy of updating to Mac OS X Leopard with Parallels Desktop installed?

... Please uninstall Parallels Desktop from Mac OS Tiger using the program's Uninstaller script located in the distribution package (.dmg or CD) before running Leopard update. Keep in mind that you should use Uninstaller of the same program version you have installed or newer, using Uninstaller from the outdated package may cause unexpected issues with removing the program. The uninstall procedure doesn't affect your existing Virtual Machines.

BTW, this is the first place I read that you should uninstall Parallels before upgrading to 10.5. I'm battered enough to routinely clean out complex things before an OS update, but I suspect that most Parallels users, geeky as they are, missed this.

Yes, I am now moving to 10.5. It's not just that 10.5.3 finally came out, it's also that I really want the parental time-limited access controls.

With 10.5.3 I'm switching to VMWare Fusion -- mostly because the people I read like it better. I've already noticed, however, that Fusion is much pickier about Windows OSs than Parallels. It won't work with older versions of Windows 2000, for example. A point for Parallels I've not seen mentioned elsewhere, but since I've already bought Fusion I'm going to give it a try.

Gmail search operators: OR, in:anywhere and others

Gmail's search operators are resemble those of Windows Desktop Search. I suppose we're heading towards some kind of convergence.

The interesting ones are:

• to: (obvious)
• has:attachment (more useful than one might think)
• in:anywhere (when it might be in spam filter or trash)
• after: and before: (dates are yyyy/mm/dd - my favorite date format!)
• OR: yes, Google has introduced the Boolean OR. At long last ...

Why you really do have to apply those patches immediately ...

Or abandon #$!$%%$ Flash and XP ...

Slashdot | Adobe Flash Zero-Day Attack Underway

...Security researchers have found evidence of a previously unknown Adobe Flash vulnerability being exploited in the wild. The zero-day flaw has been added to the Chinese version of the MPack exploit kit and there are signs that the exploits are being injected into third-party sites to redirect targets to malware-laden servers. From the article: 'Continued investigation reveals this issue is fairly widespread. Malicious code is being injected into other third-party domains (approximately 20,000 web pages) most likely through SQL-injection attacks. The code then redirects users to sites hosting malicious Flash files exploiting this issue..

It doesn't suffice to restrict browsing to "quality" sites. If those sites are hacked, then traffic can be redirected to a site where the a specially crafted .SWF file launches the exploit and attacks your machine. Antiviral software won't help either -- at least until it's patched and updated (too late).

Keeping up with these patches is a slow, onerous task -- particularly on a slow booting XP machine (forget Vista!).

The easiest defense is to use a Mac. Even though Flash on OS X is vulnerable, it's doubtful that the injected malware will work, particularly if you run in standard user mode (nobody who reads this blog would be foolish enough to run OS X as an admin).

Eliminating Flash, a notorious source of vulnerabilities, is the next option to consider. I'd really like to see Apple do their own Flash interpreter. (QuickTime is about as bad, but at least that gets patched through Apple's updater.)

Unsharp mask: how to use it

I've never seen this explained -- despite years of my sharpening images! These directions are for a generic unsharp mask too, Aperture has additional options.

Photojojo » Unsharp Mask: How Do You Actually Use That Thing?

... Step 1: View the image at 100%. Set the radius between 1 and 3. Set the amount between 300 and 500. Set the threshold at 0.

This will look like crap. But you’re going to fix it in a minute, so don’t worry.

Slide the radius level up until you start to see nasty halos forming, then back it off a bit. It’s OK if it looks a little bit harsh at this point.

Step 2: Change the image view to 50%. Adjust the amount until it looks grainy and oversharpened, than back it down a little.

Since web images need a fairly high amount of sharpening (in the 300 to 500 range), our example here isn’t quite as dramatic as we’d like. We made the “after” image a little soft so you can see what’s going on at this stage.

Step 3: Move the threshold slider up until the low-contrast areas look smooth, but you can still see fine details...

... Photography Jam has a good set of starting points for different kinds of pictures. We liked their all-purpose and web settings, but there are lots more on their site.

All-purpose sharpening: amount=85, radius=1, threshold=4
Sharpening for the web: amount=400, radius=0.3, threshold=0...

I'm going to add this site to my feed list.