Costco: where Apple's discontinued iPods go

TUAW also reports they have pretty good warranty service:

5 reasons to love Costco during the gift-giving season - The Unofficial Apple Weblog (TUAW):

...Their slightly out-of-date iPods. Costco provides a reliable resource for anyone looking to buy older-generation iPods. They clearance them out with excellent prices and good availability. Costco currently carries iPod Nanos and Videos (which still work with free video out!), as well as the newer Classics, and Touches...

Microsoft's free memory test utility

I had no idea Microsoft provided this free memory test utility. I guess I'm too much in the OS X world these days. Many thanks to "enthusiast" for the pointer to this a set of similar test utilities.

Microsoft Online Crash Analysis - windiag

The Windows Memory Diagnostic tests the Random Access Memory (RAM) on your computer for errors. The diagnostic includes a comprehensive set of memory tests. If you are experiencing problems while running Windows, you can use the diagnostic to determine whether the problems are caused by failing hardware, such as RAM or the memory system of your motherboard. Windows Memory Diagnostic is designed to be easy and fast. On most configurations, you can download the diagnostic, read the documentation, run the test and complete the first test pass in less than 30 minutes.

To run Windows Memory Diagnostic, you must reboot your computer with the disk or CD-ROM on which you installed Windows Memory Diagnostic in the drive. After the reboot, Windows Memory Diagnostic will load and its interface will appear. After loading, the first test pass will begin, using the default standard test suite, and continue until complete, unless Windows Memory Diagnostic is either paused or exited. Once the first test pass is complete, Windows Memory Diagnostic will begin a second test pass using the same settings as before. Windows Memory Diagnostic will continue to run test passes until you exit...

I'm looking at this because my "possessed" (really, it is) corporate Dell Latitude (XP SP2 +) just gave me an error message on a huge file copy that was supposed have been fixed in Windows 2000:

You May Not Be Able to Copy Large Files on Computers That Are Running Windows NT 4.0 or Windows 2000

...Cannot copy [filename]: Insufficient system resources exist to complete the requested service...

Yes, this could be due some mysterious corporate monitoring software; many corporations are layering loads of cr*p atop an already unstable XP/antivirus environment, thereby taking XP into new realms of emergent behavior.

My money though is on flaky hardware. I'll try that Windiag and the Dell test suite that comes with their restore DVD.

Converting OS X Mail.app from ISP IMAP to Google Apps IMAP

A few weeks ago I wrote about Google Gmail gets IMAP services. I'd already been using Gmail POP services on my accounts, but IMAP was a better choice for my wife. [1] I figured I'd migrate her from our no longer competent local ISP email service once things settled down a bit.

Today I migrated my wife's email from our newly annoying local ISP (visi.com) to our family private domain Google App domain.

It worked, but it's a bit tricky. I'll outline the process and some key things I learned, but I won't replicate the directions available elsewhere.

But first ...

A cautionary tale about IMAP hell - IMAP and local spam filters

Emily has been using IMAP on 3 OS X machines at our home for years. This seemed to work, but in retrospect there were severe problems I didn't recognize.

1. Each client was doing spam filtering. She never tuned the local spam filters and was used to checking her ISP's spam filter, not the OS X Mail.app spam filter. The result was a lot of email was being captured in the local junk folder of each machine -- then being deleted after 30 days. She never knew about these. She lost quite a few messages this way, including some from family and business.
   
   
2. It gets worse. She could easily have 2 Mail.app clients running simultaneously. Each polled the server every few minutes. Depending on which one got there first, email that was flagged by Mail.app as spam would get pulled off the IMAP server and saved in one or the other of the local Junk folders. This hit me when I was testing her new email. A message I expected to appear never showed up -- because the downstairs machine had pulled it from the IMAP server and stored it in the local Junk folder!
   
   
3. Sent mail, of course, piled up locally. (She cc'd herself on key sent messages, so this was more annoying that anything else)

Now on to the conversion ...

Converting Mail.app from VISI IMAP to our family domain Google IMAP.

1. Print out Google's Mail.app directions and their recommended client settings [1, see below!]
2. Scan the Google Gmail IMAP Access document. Especially read known issues.
3. Read the ThirtyOne discussion for the key advice on "Properly sort Drafts, Deleted, and Sent mail in Apple Mail"
   

I did the conversion on 10.3.9 and 10.4.11 Mail.app. It worked similarly on both versions. A few tips from the experience:

1. If you have a huge number of emails on an IMAP server this may take a very long time or your client may crash. This wasn't an issue for us as we'd been archiving emails locally (limited capacity on the old service).
2. If you're changing from a previous IMAP service, just edit your old IMAP entry. Don't create a new one. You need to edit to the new settings. Then exit. Then start again. I had to do that on 10.4 and 10.3 on 3 different machines. It only worked when I would exit and restart. Actually, most IMAP configuration changes required a Mail.app restart to complete properly.
   
3. Turn off spam filtering in Mail.app. Remember our email Hell? Don't let that happen to you. Let Google do the spam filtering.
4. The process created some empty local machine folders with names like "Junk" and "Draft". This was in addition to the IMAP folders. I confirmed they were empty and deleted them. They did not reappear on restart or with IMAP sync, they really were accidental junk.
5. Follow the "ThirtyOne" directions about "Use This Mailbox For" so the Google Apps Sent folder vanishes and you see only the one "Sent" folder. Much nicer.

There's still one more thing. Google says Mail.app "Move deleted messages to the Trash mailbox" should be unchecked. This is fine when you're strictly doing IMAP. There's one Trash that appears and that's Google's. But, what if you're using storing email locally in an archival store? If you delete from that store, you may want a Trash.

On the family iMac, which is backed up, Emily does have archival email stores (see image above). On that machine only, I did check Mail.app "Move deleted messages to the Trash mailbox" and I set "use this mailbox for" so that Gmail Trash and Local Trash appear as "children" of the Mail.app iconic Trash mailbox. (See ThirtyOne folder link, above.)

The screenshot to the top left of this post shows you the 10.4 Mail.app view with both a set of local folders (we archive locally, drag and drop from the server to the local folders such as Save and "flylady") and the IMAP folders. [Gmail]/Sent has been mapped to the standard Mail.app Sent folder, but "Starred" and "In" remain as folders under [Gmail].

It seems to be working very well. The process is strictly for geeks however.

PS. When Blogger says they only accept JPEG and GIF uploads, they lie. They accept PNG too.

[1] Google maps tags to IMAP folders. Since I've used tags with my email this is a bit annoying, so I'm staying with POP for now. My wife has never used Gmail or Google Apps Mail, so this isn't an issue for her.

[2] Google is not joking about the best way to set up Mail.app. Follow this advice:

Drafts:
Store draft messages on the server > checked

Sent:
Store sent messages on the server > do NOT check

Junk:
Store junk messages on the server > checked
Delete junk messages when > Never

Trash:
Move deleted messages to the Trash mailbox > do NOT check [jf: see "one more thing, above"]
Store deleted messages on the server > do NOT check

Update 11/19/07: I've posted on Gmail Groups: we're seeing multiple versions of messages saved to the Trash.

Update 12/21/07: Either Google changed something or a new router might have broken connectivity from one of my IMAP OS X Mail.app clients. I tried following Google's OS X Mail.app configuration settings and got nowhere. The fix is to disregard all their lovely client-specific instructions and use the bare bones geek-friendly directions provided for "other clients". The settings there differ from the OS X Mail settings.

Needless to say, Google is in its usual confused state.

Google's link search behavior and a Firefox request

It's annoying to have so many text entry fields at the top of a browser. There's one for a URL (which may act as a search field), one for search (which may allow specification of the search engine) and one embedded in the Google or WL toolbar (the latter can be set to search Google.

It's no wonder users get confused:

Google Tries to Fix Broken Links

....So people type URLs in the search box. Google changed the way it treats those queries last year: instead of showing information about a URL, it returns standard search results and the top result should be the page that corresponds to your query. This is a great way to avoid typosquatting sites, like flicker.com or twiter.com.

But what happens when Google doesn't find a page from a site included in the index? Until recently, it returned the standard 'Your search did not match any documents.' Now it returns more helpful information: results from websites with similar addresses, suggestions for queries and a way to identify the page by restricting the search to the domain/subdomain from my initial query.

This is a great improvement that should be emulated. It's one more step in the "brute force" approach to broken links. We're stuck with "brute force" because the web never evolved a true directory service.

Now I'd like Google (or Firefox) to add an option such that when the URL matches a well ranked site then we just go to the site. We'd only see search results when the URL was off, that would be the current behavior.

This might have to be an advanced option since the variant behavior would be confusing, but it would let me live with a single top text field. One that also needs to mapped to command-L (OS X) or Ctrl-L (Win).

iPhone UI unsuited to podcast navigation

My SONY car radio is pretty good with AAC and MP3 tunes, but it fails miserably with podcasts. The controls are designed for navigating a 3 minute tune, not a 60 minute podcast. At the very least they needed to have the fast forward accelerate over time.

I was sure Apple wouldn't mess up like that.

Wrong.

graphpaper.com - Scrubbing the iPhone Scrubber

.... the new scrubber bar is almost useless, especially for long tracks like podcasts where it’s impossible to move the playhead any less than a few minutes per hop...

At least there's a chance Apple will fix their dumb mistake in a future update.

Fixing Leopard stacks (via Japan)

I won't be walking the Leopard until 10.5.3, by which time Stacks might actually work out of the box, but I'm still going to make note of this hack:

TidBITS Problem Solving: A Simple Hack To Fix Leopard's Stacks:

...Zen balance is now restored to my Desktop and Dock, and I find myself once again using Stacks to organize my current projects. For smaller folders the single-click access to the stack is surprisingly more convenient than right-clicking was under Tiger. And sorting by date modified makes even large directories useful as stacks, since I usually want to access the most recent files anyway.

It's a really beautiful hack, and to me one of the neatest aspects is that it comes to us from a Japanese Mac fan.

Rumor has it that the Mac is starting to get a following in Japan. If true this will bring a new rush of invention and creativity to the platform.

Google Desktop Search bites the dust

I've posted frequently since January 2005 about various approaches to full text search in Windows XP in general and Outlook 2003 in particular.

My test environment is harsh. GBs of Outlook PST files. GBs of documents. Machine never rests. Hard drive always on the edge of meltdown.

The best solution, by an order of magnitude, was Lookout for Outlook. Fast, stable, and the bugs are manageable. Alas, it conflicted with some other Outlook Add-Ins (that environment reminds me of DOS TSR hell). Lookout also doesn't work in Outlook 2007 and it's definitely not supported anywhere, so I thought I needed to change. That was probably a mistake.

I used Yahoo Desktop Search for a while, but it was increasingly buggy and Yahoo finally abandoned it. It reverted back to X1 but it was even buggier when I tried their version.

Recently I decided Windows Desktop Search was my only option. It was slow and sucked performance, but it did all I needed and it incorporated Lookout's search syntax (see the help file). Unfortunately, my work machine has been possessed lately.

I'd removed about everything I could think of to try to stabilize my system, so it was time to remove WDS and try the only remaining contender Google Desktop Search.

Yech. This is what I wrote when I uninstalled it:

... I don't have enough control over indexing behavior. I don't have enough search syntax control - esp. for outlook tasks vs. email search. It was WAY slow to do a search against my multi-GB Outlook archives. It doesn't treat folders as first class search objects...

So now what do I do? I could buy a MacBook Pro and run XP in a VM, but Spotlight won't search PST files.

I need full text search - esp. of PST files.

I'm going to try Lookout again; I've gotten rid of most of my Outlook plug-ins / add-ins anyway.

Gee whiz, I miss my home OS X machines. I know people complain about Vista, but I'm not a great fan of any Microsoft products at the moment (though my problems, to be fair, may be hardware related). Even my beloved Windows Live Writer is buggier at the 1.0 release than it was in the last two beta versions!

Update 11/16/07: Joe Cheng (see comment) noted I hadn't submitted my WLW bug reports. They're really not awful, but they stood out relative to the perfection of the last beta. One is certainly a bug -- the category/tag names can be truncated randomly (last few characters are missing). The other two I need to prove are really bugs, which is a bit tough since my Dell laptop is definitely flaky.

I'm going to be more careful going forward about what I call a bug ...

Update 11/16/07b: The regressions (bugs) will soon be history. In the meantime don't use the Post to Weblog as Draft feature with Blogger.

The real iMovie '08 is Final Cut Express 4

iMove '08 should have been called iClip 1.0. It clearly wasn't an upgrade from iMovie HD, it was a new product.

At the time I wrote:

Gordon's Tech: Apple's iClip 1.0 (iMovie '08) shaft: what they should have done

...The honorable thing for Apple to have done would have been to provide iMovie HD users with an upgrade path to Final Cut Express (which might also require some updates to FCE, I'm not sure how serious Apple is about that product)...

Well, Apple didn't do the honorable thing for iMovie HD users, but the new Final Cut Express is out. Users of iMovie HD should probably forego the iLife 2008 update and buy FCE 4 instead.

I'd give them points if they were to provide a $100 upgrade path for users of iMovie HD, but I admit that would pretty hard to police. The new product is $200, so heavy users of iMovie HD will probably pay up.

Safari 3: very cool tech

Safari 3 is even more impressive than I'd realized: Surfin’ Safari: Ten New Things in WebKit 3.

Faster - esp. JavaScript. Less memory. More capabilities. Fewer bugs. SVG support (not fully optimized).

I'm going to test it with Blogger and Google Docs, Safari 3 beta didn't work too well there.

OS X 10.4.11: Macintouch reports and an update procedure

My policy on these bug fix updates is to wait a few days and check both the Macintouch Reader Reports: OS X 10.4.11 and the Apple Discussion List.

I follow a simple subset of Gruber's update procedure:

1. Download the full cumulative update from Apple's site.
2. Shut down and disconnect all external drives.
3. Restart into my admin account (very plain account).
4. Install update, don't run anything until it's done.
5. Restart into my regular account.

I don't do an extra backup but I do check that my nightly backup completed correctly. If I'm feeling paranoid I do a test restore of a single randomly selected file.

There has been a longstanding bug with Apple's Updater (note, however, I have removed unsanity's application program enhancer from all my machines). There's a low but non-zero probability that it will botch an update; the probability rises sharply if you're doing anything during the update process or if another users is logged on at the same time. The restart reduces that risk substantially, as does the plain admin account.

I don't repair privileges. Everyone I read feels that's pointless.

Since I have no recognized problems with OS X 10.4.10 I'm in no great hurry to update*.

*iPhoto 7.1 is crashy. I hope the combination of 10.4.11 and iPhoto 7.11 will help.

Update 11/15/07: Some hints in Apple's release notes and user experiences suggest 10.4.11 may have the same trouble with input manager hacks (application program enhancer mostly) as 10.5 has. I recommend checking for APE as described in the APE uninstall guidelines. Then uninstall it.

After the update, if you absolutely can't live without APE, do your research prior to reinstalling the very latest version.

Bento and the iPhone

FileMaker has discontinued FileMaker Mobile

As of the end of the business day, December 19, 2007, FileMaker, Inc. will no longer sell FileMaker Mobile.

That's a serious drag, because a database client for the iPhone is one of my high priority requirements.

On the other hand, FM has introduced the mysterious 10.5 only Bento "personal database" app:

Meet Bento — Learn More

... Bento is designed exclusively for Mac OS X 10.5 Leopard. It takes advantage of many of the new features of Leopard, including live linking to iCal data, core animation, advanced find, Time Machine backups, and multimedia features...

So will there by a companion iPhone application for Bento?

In the meantime, I'll be holding off on FileMaker updates. In fact, I'll be holding off on all Apple purchases until I see the iPhone SDK and the rumored major iPhone update in Feb 2008. Apple's strategy is simply murky ...

Safari: Ok, you win

I really thought Safari's web rendering engine was doomed, though I noted some caveats.

Ok, so even I can be wrong. Yes, I still use Firefox (kind of got away from Camino, though I use it on slower machines), but clearly WebKit is a winner.

The iPhone has established WebKit compatibility as a must-have for most web sites, but the use of WebKit in the Android platform has finished the deal.

This is from the Safari WebKit blog:

...Many of you have seen the announcement of the Android Mobile Platform (www.openhandsetalliance.com) followed by today’s release of the SDK (code.google.com/android). We (Android) were happy to highlight the use of the WebKit engine as the rendering core for Android’s browser. We have been working on our mobile implementation of WebKit for quite some time. A few changes that we made to WebKit, which make it more suitable for mobile devices, have been submitted to the Tip Of Tree prior to the release of the SDK...

Another interesting change we made, which is not mobile specific, was to make the canvas tag platform independent. Again we are working on migrating this to SVN.
Most changes made to WebKit are clearly identified with a #ifdef ANDROID_[feature name]...

Canvas is the drawing environment for applications in WebKit. Knowing little, I think of it as "QuickDraw for the web".

Making Canvas "platform independent" sounds interesting.

Anyway, sorry WebKit. I was wrong, you were right.

If Google changes their Docs and Blogger sites to work better with Safari, I might even switch back. (Safari editing in Blogger causes a tag mess in the output.)

Update: See the comments for a persuasive explanation of what Canvas does and it's relation to Quartz. I'd been using "QuickDraw" as a metaphor rather than a technology, but it's very nice to get more background.

Incidentally, I write this blog primarily as a way to create notes for my own learning and reference, and secondarily as a way to "give back" to the net. I get enormous help from people who share knowledge freely, this blog is a small way to share what I know, and sometimes what I think (I mostly put opinion elsewhere).

I assumed readership would only come incidentally, as the result of a Google Search to solve a specific problem I'd written about.

Somehow, for reasons that are unclear to me, I seem to have acquired some rather knowledgeable readers. It's an unexpected pleasure.

Lunarpages: a sign of the end-times for low end hosting solutions?

My blogs are posted through Google's Blogger, and they've been very reliable for months.

My older web pages however, and several domains, are hosted by Lunarpages. Lunarpages is a low-end to mid-range hosting provider with an above average reputation. I've used them for years and I've been reasonably satisfied.

They're not doing so well lately. They've been down 3 times in the past 10 days, and they've been offline all day today. Only their forums are working. Even several Google Apps domains, where Lunarpages only does redirects, are unavailable because the redirects have failed.

My guess is it's some kind of denial-of-service attack on their DNS servers. The worst part of it is they're maintaining complete radio silence -- no postings at all on their network status. Since their entire domain is unreachable I think that merits a comment or two.

Google has the technical team and infrastructure to handle a pretty massive BOT attack. Lunarpages clearly doesn't. I wonder if that vulnerability is going to wipe out the low end internet services market -- leaving only the big players.

I'll have to start moving off of Lunarpages. It'll take quite a while, but I'll start by moving my domains to the service Google uses for the Google Apps domains I have. The last step will be finding a new home for my legacy web pages.

Update 11/14/07: It looks like this was two problems. Lunarpages had been failing due to DNS attacks, but the failure of the past week was a routing problem with the service my Hotel was using. I didn't have time to debug the routing problem, so I can't say who was ultimately responsible.

Terrific review of Google Search 2007 - power user techniques

I hadn't realized how much personalization of search results Google does now. No wonder I can find my own blog material so easily!

Biases and Restrictions in Google Search:

...5. If you don't like Google's personalized results you can log out from your Google account, disable the Web History service or turn off the personalization bias by adding &pws=0 to Google's URL. Note that the parameter is not persistent and it only works for the current search.

6. To restrict your search to the high-quality (?) web sites included in the Open Directory Project, you can append &cat=gwd/Top to Google's URL or perform your search at Google Directory...

There's lots more. It's definitely worth studying this and keeping a link to the reference.

I tried the &pws=0 parameter when searching for my own stuff, and it was neat to see the search results change. It wasn't a large change, but in general my stuff moved down the main page one step.

XP Demotion: from Administrator to Debugger User

My corporate Dell laptop has been behaving badly. As far as I can tell, it's possessed.

Today our noble and long suffering sysadmin took a look at my privilege settings.

The one local and two network admin accounts on the Dell had been switched to Debugger User. Apparently, it's going around the office.

As of 11/09/07 a search on Microsoft's site doesn't turn up any useful explanation. The current theory is that it's a .NET bug.

The way the security privileges had been reconfigured should, in theory, work. It's not, however, standard.

Anything that's not standard in XP is in the danger zone - and it's getting worse. My best guess is that Microsoft has stopped seriously debugging XP, and every security update and/or installation of new Microsoft software drives XP closer to entropic collapse.

Vista SP 1, not coincidentally, is starting to look better.

I am tempted to buy a MacBook Pro for the office and run Outlook and Access in an XP VM. I could use OS X for all my other tools, and if the system started misbehaving I'd delete the VM and restore from backup...