Thursday, August 07, 2008

Laptop short of space? Remember NTFS compression.

I’d forgotten about NTFS compression. This thorough review, Thrilling tales of NTFS compression, reminded me that it’s a reliable tool for a few circumstances: (Quotes are from the Dans Data link):

  • Laptop short of space: “Program Files contains a lot of stuff that's read moderately often but not written to very much, which is a good access profile for compression to have no perceptible speed impact at all, after the half-hour or whatever you'll be waiting for everything in a typical large-ish Program Files, on a laptop with a slow-ish CPU, to be compressed…

    … You can't expect a terribly large amount of compression from this, but when I tried it, I turned a 35.4Gb Program Files into a 27.6Gb one - 78% of its previous size, and a perfectly worthwhile 7.8Gb saved…”
  • Microsoft Access databases (however this may impact I/O slightly). These compress extremely well.
  • Windows BMPs – though almost no-one would keep these around outside of (gasp) screen shots pasted into PowerPoint.

Practically speaking, I think NTFS compression is most useful if you have to carry around a lot of large Microsoft Access databases on a laptop (consider using NTFS on a directory) or if you need to free up a few GBs on any laptop.

NTFS compression is not compatible with NTFS encryption (which most people will want to avoid, see the linked DD article). I don’t know if it’s compatible with other encryption schemes corporations apply to hard drives these days.

I think the closest OS X equivalent would be the 10.5 expandable sparse images.

Dan's Data recommends a USB enclosure

Allegedly, it spins down: Cheap USB box du jour :: August :: 2008. Only available in Australia, but he gives advice on the chipset.

Good links to other DD notes on enclosures.

It's very hard to find good recommendations on these things.

Tuesday, August 05, 2008

iPhone synchronization is a flaming mess

1Password has yet another approach to iPhone synchronization. Problem is, it didn't work for me:
Gordon's Tech: Palm to iPhone: JFile to 1Password

.... After all of the following, I'm unable to get the sync to desktop working under 10.4.11..
1Password tries to sync with the desktop app. OmniFocus tries to work through an absurd WebDav service. Missing Sync for iPhone is the only product I've seen to date that syncs anything through the cable.

This is *%$& ridiculous. All of these kludgy synchronization methods are only creating security holes and stability issues. Not to mention screwing up my evenings!

Apple needs to give developers a standard, reliable, synchronization framework. I've worried about the apparent absence of API synchronization support for desktop apps for months; I'm not happy to discover I was right to worry.

Palm to iPhone: JFile to 1Password

For at least 14 years I've kept my URL base and password data in FileMaker Pro for PC and Mac. I periodically exported the data to my Palm, using an old database app with support for encryption (JFile).

It worked, so I haven't touched it for years. Now it's one more thing I have to transition from my Palm to the iPhone.

I was hoping that FileMaker would resurrect FileMaker Mobile for the iPhone, and add encryption. That would be perfect. Alas, I don't see it.

So I'm looking at dedicated password storage apps like the list on the left, including 1Password, eWallet, SplashID, etc.

There are three criteria other than an established user base and a good reputation:
  1. It has to work on the iPhone (native app).
  2. It has to sync with my iMac
  3. It has to be able to import tab delimited data exported from my FileMaker database
  4. It has to have good export options.
  5. There has to be a good demo app I can test.
1Password seems to meet the criteria, and it has plug-ins for Firefox and Safari. I write "seems" because the web site says nothing about the limitations of the downloaded version. If I run into limitations that make it hard to test then I'll put 1Password down at the bottom of my list.

The above screenshot shows it can import in many formats. More importantly, it can also export as tab delimited and as 1Password Interchange File.

So how do I import data from my FMPro database? The 1Password documentation is pretty terse:
1Password User Guide

... In addition to the above formats, 1Password has a Generic Importer that can import any Comma or Tab Separated Values. To use this, specify Generic Text as the Import Format.

The Generic Text importer will allow you to specify which columns in your CSV file should be used for each 1Password field...

Problem is, I need to know what all the possible import choices are, so I can create an export from FileMaker Pro for further testing.

I created an entry in 1Password then exported it as tab delimited. I found the following list, I've bolded those I can provide from my database:

  • title
  • notes
  • htmlName
  • htmlID
  • htmlAction
  • htmlMethod
  • passwordHistory
  • username
  • password
  • URL/Location
My FM database has a much richer organizational scheme than 1Password can support, including two types of classification, tags/keywords, extensive notes, those insane "secret questions", search across all fields, and more. It's also shareable with Emily in a way that 1Password is not.

So I'm not sure I'll give up on the FM database, but it looks like I can, for the moment, export it to 1Password so it's available on my iPhone.

At $35 1Password isn't cheap, but if it passes my import test I may go for it.

Update: It took over an hour to import 1400 rows, so it's pretty darned slow. That's not a big deal though, it's quite fast to search them. Turns out these are the available columns on import:
  1. Title
  2. Username
  3. Password
  4. URL
  5. Folder
  6. Notes 1, Notes 2, Notes 3, Notes 4, Notes 5
As best I can tell Columns titled "Notes" 1-5 are concatenated into the 1Password Note field. I used Notes 1 for my description field and Notes 2 for a calculation field that concatenated several FM fields.

Search runs against Title and Notes, so this concatenation works for my purposes.

One major limitation is that you can import into Web Form and Secure Note, but you cannot import "Wallet items". You can export Wallet items however. The inability to import a wallet item is very annoying, though I can see why that is a harder task for the developer. Wallet items use a different data model for each type of item, so a tab import is less likely to work. I will probably use "Secure Note" for another JFile database that holds that type of information.

Update 8/7/08: After the above things got messy. I couldn't get the sync to work at all. 1Password technical support pointed me to firewall instructions, and explained something that really should be documented on the web site:
... 1Password is fully functional for 30 days, with no limitations. After this time, should you wish to continue using it for free, you will need to store fewer than 20 items...
This is a great demo policy, it just needs to be documented. There are other things that could use some documentation. It turns out there are firewall changes to make, but that's only documented in a support forum thread:
Firewalls can prevent the iPhone/iPod touch and Mac applications from connecting to one another. Please check if you have firewall turned on (System Preferences > Security on Leopard). Details for Leopard. Tiger is quite a bit different: Details for Tiger
I turned off my 10.4 firewall and was able to sync. I'll try it later with the firewall enabled and the port they recommend set up.

Update 8/14/08: I think 1Password uses the OS X Keychain. That has some nice features, but it is unbelievably slow to delete large numbers of items or add large numbers from an import. Slow, as in seconds per transaction! It feels like AppleScript speed.

Update 9/2/08: Unbelievable. I went to buy 1Password, and I learned it uses a "license token". I hate those, because they're a pain to backup and manage. I want a registration code. I'm going to contact support, but this is a real stinker of a deal killer.

Update 9/4/08: About the same time as I wrote my 9/2 post, 1Password relented. The current version supports entering a text un/registration number that they provide via email. I found out because I let them know why I wasn't going to buy 1Password, and they quickly responded that I wasn't the only person who was unhappy with the encrypted token approach -- and they were now providing both options. So I bought it.

Update 7/15/09: I use 1Password still. It's been through several updates, sometimes with new bugs. I've also discovered it uses an Input Manager -- something I really try to avoid because of all the associated bugs and complications. I'd recommend an application that didn't use an Input Manager, though I'll stick with 1 Password for now.

Palm to iPhone migration: import into iCal

If I decide to migrate my legacy Palm/Outlook calendar data to iCal, this is a handy reference: macosxhints.com - Import .csv and other text files to iCal. The comments suggest other options.

For now I simply ended my Outlook calendar and started using the iPhone calendar. That was the least trouble for the moment.

[Update 8/16/08: Much later I realized I could have used Missing Sync for Palm OS to sync my Palm to iCal. I have a license from eons ago, when we used to sync my wife's SONY PalmOS device to the iMac. I may still do that to get legacy data into the calendar, but really I'm better off archiving that data.

Update 10/2/2009: Another method.

iPhone's forgotten web apps

It's a bit weird, to put it mildly, that Apple's iPhone Web apps site doesn't have an iPhone friendly version.

Makes you wonder how seriously they really ever were about the once celebrated Web apps.

The list is actually pretty interesting. For example: Apple - Web apps - Productivity, including 43 Actions,

I think the best way to install these is to browse the list from Safari/Desktop (on your iPhone sync machine), bookmark those you want to try, then sync to iPhone Safari.

From iPhone Safari you can turn these into standalone icons as desired.

Saving grace of the iPhone – Apple updates it

I’ve bitched a fair bit about my iPhone.

I may not have recently mentioned that it’s actually working pretty well for me. I haven’t seen the crashes and instability many users experience. Contacts is slow, but not unbearably slow. The battery lasts about as long as my prior non-smartphone 3G Nokia; I just charge nightly or at the office via USB. I don’t miss voice dial – it’s never worked for me.

I have expected problems with things I knew were missing when I bought the phone: tasks, notes, editing, search. The biggest nasty surprises have been iTunes Outlook synchronization (unsafe at any speed), Apple’s MobileMe calendar limitations (missing subscription features, missing feed and CalDAV support), the loss of Firewire charging, and the usual anxiety about how much power Apple will give developers to work around Apple’s lowest-common-denominator approach.

Still, it’s not like the alternatives are very good. This AppleInsider post reminds us how very bad the US smartphone marketplace has been …

AppleInsider | Inside iPhone 2.0: iPhone OS vs. other mobile platforms

… This rapid pacing of Apple's free updates is unheard of on competing smartphone platforms. The Palm OS seemingly hasn't been updated since dinosaurs roamed the earth…

The Symbian partnership has delivered four incremental updates to Symbian 9.0 since 2004, roughly one per year. These updates are often related to new hardware, and in many cases owners of Symbian phones simply can't upgrade to whatever the latest official version is.

RIM's BlackBerry OS update page similarly warns, "If you did not purchase BlackBerry software or smartphones directly from Research In Motion (RIM), please contact your service provider to determine if the software distributed by RIM is authorized for use with your smartphone." That highlights why Apple chose to only market the iPhone through mobile partners that would agree to allow Apple itself to deliver updates and support for all of its phones worldwide. …

When Microsoft shipped Windows Mobile 5.0 in 2005, the update wouldn't even run on most existing WinCE phones because it required new hardware support for its persistent RAM architecture change. The following release of Windows Mobile 6.0 didn't ship until two years later in 2007, and Windows Mobile 6.1, a relatively minor update, took more than another year to shake loose from the bowels of Microsoft. Even after a Windows Mobile release "ships," owners of specific models might have to wait for many months before their mobile provider or software vendor allows them to install it, if they ever choose to do so.

Despite now being a decade old, the WinCE foundation of Windows Mobile is also still regarded as unstable, riddled with bugs, and poorly architected, with a horrific user interface, clumsy process management, and development tools that are a simple regurgitation of the archaic Win32 desktop API, lacking much optimization for mobile development…

Apple, at least, releases updates for all phones from one central service. That’s a saving grace.