Showing posts with label Palm. Show all posts
Showing posts with label Palm. Show all posts

Saturday, September 19, 2020

ToDo apps: Microsoft's solution

I've used Appigo's ToDo app for about 12 years (with Toodledo at first). It's had problems over the years, but in general it's been a good subscription choice. There's a fairly hard data lock (maybe SQLite?) but manual reentry is feasible albeit annoying.

Lately, however, ToDo has been more ragged. A recent server side change induced a date bug (time zone?) that in turn showed me I was using a macOS app last updated in 2016. It appears to have been abandoned on the Mac App Store. When I went to Twitter I found Appigo's account was closed years ago for violating TOS. Eventually I found I could download a current version of their other App Store app from their web site.

At the moment the app is more or less working again, though parts of the macOS app UI are kind of weird. I figure there was some violent ownership transition with lost dev passwords in Appigo's history (maybe they got ransomwared?).

I decided to go shopping again. I'm looking at:

  • Apple Reminders: hard data lock and I have to upgrade from Mojave to get to latest version (not happening).
  • Google Todo: this is one hell of a weird product. WTF is their web strategy? Tied to Gmail? Tied to Calendar? At least there's data export.
  • Things
  • OmniFocus: poor Omni is in some disarray ...
  • Microsoft To Do
Today I dug into Microsoft To Do. Of course it's a mess, but this is 2020 so we expect that. The mess starts with Microsoft reusing product names. To simplify a bit:
  • There are classic Outlook Tasks. I'll call these TasksClassic. TasksClassic was excellent in many ways, including, once upon a time, great import/export options and lots of view flexibility (I like to sort by last modified!). Unfortunately it's dead, just barely hanging on in the current desktop app with some degree of synchronization with the new product.
  • There's the new Wanderlist-based product variable called Microsoft To Do and ... Outlook Tasks (name reuse!). I'll call these TasksW for Wanderlist.
If you open the Help screen page for macOS TasksW (To Do) it takes one to a page on Outlook synchronization that's obsolete -- because the Outlook.com version of Tasks has switched from TasksClassic to TasksW. On the other hand the version of Office 365 on my Mac still has TasksClassic, and it does synchronize with TasksW as displayed on macOS and iOS Microsoft To Do.app.

Are you still with me?

This gave me a brief moment of hope that there was some data freedom here. I remember the import/export options of old Windows Outlook. Alas, the only import/export from macOS Outlook is Microsoft's PST format. There might be some way to do things with Outlook Windows or with 3rd party tools but I don't have the energy for that.

At this time I think TasksW is probably a decent enough product, but this has reminded me how screwed up Microsoft is. So I'm setting this one aside for the moment.

See also:

Saturday, February 16, 2013

Google Contact Sync on Mountain Lion and iOS - CardDAV (Project Contacts 2013)

I'm rather late to this party [6], but around the time Google ended ActiveSync support for unpaid accounts [1] they added vCard 3 (1998) based CardDAV support [3]. Up until then one could sync iOS and OS X mail and Calendars via IMAP and CalDAV, but Contact sync was only via Active Sync. [2]

TUAW has some details and Google's iOS CardDAV instructions are here.

As we all know, synchronization is hell. Even if Apple and Google actually used the same vCard spec (probably vCard 3, 1998), and even if they agreed on newline characters, they still have to deal with distinctions between their internal data models and vCard. Some of those data model gaps are non-computable. [5]. Even thought Google and Apple have similar 'Group' models that relationship metadata is ignored [8].

That said, at least CardDAV is relatively Apple friendly. Most importantly, this standard means, for the very first time I know of [7], there's a somewhat supported way to synchronize Contacts between Google and OS X Contacts and iOS contacts.

I've begun using it on Mountain Lion. Since I use Google two factor authentication I had to use one of their totally-defeats-the-purpose-giant-security-hole-not-single-use-god-i-hate-passwords-humans-are-losing-the-battle alternative passwords. There was some kind of transient authentication glitch but on a second try it worked. After a few minutes I had all 634 of my Google "My Contacts" on my Mac. Because of the long history of my Google/Apple Contact sync efforts (See Also, below) these largely duplicate my Address Book/iCloud contacts -- but Mountain Lion Contacts.app seems to merge the duplicates when I search [9].

This looks promising in a terrifying sort of way. You can drag and drop contacts between the iCloud and Google Contact lists; they'll be copied.

So what about Snow Leopard? Many fine machines run Snowie (and should not upgrade to Lion even if they theoretically can). They're (more or less) cut off from iCloud. Does CardDAV sync work with Google now? I wonder about adopting Hsiaio's technique, but so far the answer is no (same with Yahoo CardDAV). I didn't find much research on this question, but I suspect it's a combination of 10.6 bugs and SSL requirements. [9]. There is some limited Google Contacts sync on Snow Leopard that some still use.

- fn - lots

[1] Google grandfathered my half-dozen Google Apps accounts and recently extended the termination date for non-Apps users.

[2] Google says Google Apps accounts should use "Google Sync", which is their implementation of Microsoft's Exchange Server derived ActiveSync (with different bugs one assumes).

[3] vCard over HTTP/WebDAV. vCard has been Apple's Contact/Address Book export option for as long as I can recall, so it may be a good match to their Contact data model. CardDAV is also used by Apple's ancient Address Book Server. vCard 4 2011 has old-style and XML representations, but I suspect Apple, like Google, is more or less on 1998's vCard 3.

Google's vCard implementation has limits; worse the only partly implement the 1998 vCard 3 spec: "why did Google move the ADR extended address "Oak and Pine" into the street address component? And worse still, why did it separate the two using an '\r\n' (CRLF) sequence? The VCard 3.0 specification clearly states that CRLF must be escaped by the single escape sequence '\n', not by '\r\n'".[4]

[4] Reading the last line of [3], by the way, a penny dropped. Apple changed the way they handled CRLF and vCard between MobileMe and iCloud, with near-disastrous consequences for my OS X Contacts. By Darwin, I hate the ancient DOS/unix/mac line newline debacle.

[5] Meaning data loss is inevitable, transferring a Contact between systems won't return the original. Incidentally, under my TrueName, I've spent 15 years dealing with interoperability issues in healthcare - from HL7 to TermInfo to SNOMED/RxNORM and back again via cCCD and the like. If you understand why CardDAV is hard, then you have a glimmer of a smidgen of a hint of an idea why we don't have true interoperability between EpicCare and Cerner -- and why we won't for decades.

I think the people who trudge away on vCardX are heroic figures who should be carried upon our shoulders. Forget Ive, these people do the work I rely on.

[6] The marketing/interest problem is unsolved -- largely because of the spam/advertising counter-current. I'm very interested in productivity software and I follow a number of related feeds; but I still miss news like this.

[7] Check out "See also" - lots of history here.

[8] Looking at Apple's braindead implementation of iOS Contacts and Groups I'd pin this failure on Cupertino and Apple's corporate silos.

[9] A friend of mine has a 10.6 MacBook and needs to use Google's world (as do we all). I think the easiest way to manager her Contract migration will be to get them to iOS/Google and then use Gmail web on Mac. I may put them on an account on my ML machine to help with cleanup.

[9] So which gets edited when one clicks "Edit" in Mac Contacts.app? Don't ask those questions. OS X doesn't say.

See also - via Gordon's Tech

Yeah, I've been fighting this war a long time. February 2009, almost exactly 4 years ago, was a big series of battles, but the 2008 PalmOS to iOS migration was probably the worst (later there were tools). I've read recently that Apple is an intensely siloed company -- that explains why iOS and OS X contract integration is so very bad.

Saturday, February 02, 2013

Sharing a credential store for a family (or small business) - and the end of the personal database

I have managed family credentials and web site data in a FileMaker database since 1996 [1]. That database now holds over 1600 records, of which at least 1200 are historical (dead accounts, obsolete urls). The historical items don't get in the way as much as one might think, and I kind of like this mini-history of the net.

This repository has survived many technology transitions. Over the past 10 years it has more-or-less synchronized with credential stores running on PalmOS and iOS. At some times I've used FileMaker sharing (web publishing and the IP based fmnet: protocol) to allow my wife to access and edit both of our credentials too. (I am too boring to have any secrets, and it's critically important that she have credential access if I'm unavailable -- as in dead.)

Alas, all things must come to an end. FileMaker and its half-baked replacement "Bento" are both dying. Filemaker Go, which I'd like to use on my iPhone, doesn't support true synchronization. Bento is supposed to have some synchronization capabilities with iOS clients, and there's some form of encryption on the desktop version, but I don't know of anyone using this product. Bento feels stillborn.

So while I could probably cobble together a solution using some combination of FileMaker licenses ($180+ each) and or FM 12 web sharing (Mountain Lion broke FM 11 web sharing [2]) -- but then I'm investing in a dead technology niche.

There are other issues with the way I use this credential store. I've been maintaining it in FileMaker and exporting to 1Password for iPhone access, but that means my iPhone repository is read-only. The update loop is slow; sometimes I don't have credentials on hand.

It's time to move.

After consultation with appnetizens there appear to be 3 solutions:

  1. Use 1Password with Dropbox. (I'm still on iPassword 2, but it works similarly. I don't mind upgrading anyway.)
  2. Use some other Cloud solution, such as shared Google Doc or Spreadsheet, Simplenote, etc.
  3. Use 1Password on her iPhone only (see below). [1Password 2 only - see update.]

The first two require the Cloud. I don't like that - for several reasons [3].

That leaves option 3, and that only works because 1Password runs constantly on my always-active account and 1Password on the desktop can support multiple iOS clients. It's not perfect as it gives her credential access only via her iPhone; but since we do use Google Sync that's less of a problem than it might be [4].

I think we'll try option 3, which implies I'm going to treat 1Passwords as the "source of truth" and slowly archive my last FileMaker database -- and then FileMaker itself.

RIP old friend.

Update:

Well, that's interesting. Technology transitions are rarely smooth. It's not clear that there is a non-Dropbox solution any more. I think I'll keep Filemaker on life-support a bit longer.
 
Incidentally, There's something disturbing about how 1Password syncs. Watching the behavior it's almost as though it replays every transaction that's every occurred on 1Password desktop; implying it still keeps fully deleted credentials. When I updated the cache 10,000 records were processed for 1,500 credentials. Looking at my backup history the agilebits keychain file is growing at a rate consistent with retention of deleted credentials. I think the only way really clean it out is to delete the keychain and start anew.

--

[1] FileMaker is a survivor from the pre-net era of software, when geeks used personal databases for address books, recipes, PDF based document management, record and CD collections,  archives of thousands of stapled paper medical journal article archive indexing with pre-web "Grateful Med" MEDLINE metadata (Grateful Med), club memberships, and much more. With a relatively large user base FileMaker was then quite affordable.

I will now interrupt this post to admit that review of those web 1.0 pages, and particularly the data store transformations of the past 8 years, has given me a dose of old-guy future shock. When I started researching this topic I didn't realize I was also writing an obituary for the personal database!

It has been one hell of a ride from my 1990s FileMaker article file to Google and the Strata conference I'll be attending in Santa Clara this month.

[2] I tried reenabling Apache on ML using a freeware pref pane. Apache ran, but FM web sharing still didn't work. Looking at the FM 12 writeup I think it barely works even there.

[3] Example: An encrypted database store is forgotten in the cloud. Six years from now, when Dropbox's assets have been acquired by the Russian mafia, 2012 encryption is trivially broken. I don't want this store public even in 2019. Not to mention the LastPass breach.

[4] So why do I allow that form of Cloud use? Good question.

Tuesday, December 28, 2010

There are no great task managers for the iPhone - but there's hope for 2011

I'm surprised by the conclusion of my recent survey [3] of iPhone/OS X/Web task management solutions. There are still no great task managers for the iPhone.

Neither Things, nor Appigo's ToDo.app (which I have used incessantly since 2008), nor OmniFocus, nor Remember the Milk.app nor Toodledo.app are a great solution. They all fall short. None of them are the equal of the venerable, simple minded, task manager that came with the PalmOS in 1994 and was improved with integration into DateBk in the late 1990s.

You may wonder why I condemn all of our current options. I'll start by listing the base requirements.

  1. Simple enough for a non-geek to use with at least basic task attributes (due date, priority, task name, description, category [1]) and views (filters, sorts).
  2. Data freedom: import/export capabilities for all tasks.
  3. Synchronization to a desktop or web version that matches the "data model" of the iPhone version and has the same usability standards. [2]
  4. Affordable (total solution costs < $50)
  5. Calendar integration, even if that's only an "agenda" type view of tasks and dates.
  6. Search across all "fields" (attributes).
  7. Utter, absolute reliability.
  8. Instant on, no delays in task entry.
  9. Archiving of completed tasks.
  10. Local iPhone app with synchronizatio -- not dependent on a data connection to work.

Sounds easy, doesn't it?  Palm did most of this fifteen years ago, and Pimlico's DateBk delivered the complete package (and more) over ten years ago. Must be easy [4]...

Evidently not. Nobody does it for the iPhone today. Let me name the failures ...

  1. OmniFocus is too expensive ($100 for iPhone/desktop pair) and is too complex. At a lower price point though I'd seriously consider them despite the complex. I'm an Omni Group fan.
  2. Things has reliability issues, is too expensive and doesn't support data freedom. Their iTunes ratings continue to decline.
  3. Appigo's ToDo.app doesn't have a robust and reliable web or desktop solution and lacks data freedom. The best option is to sync with Toodledo's web app, but that app has a different data model than ToDo.app. This is what I use every day however.
  4. Toodledo's own iPhone/web solution is limited by their complex (and, sadly, ugly) web app. The web app search is field specific and so almost useless.
  5. Remember the Milk has a bad reputation as a business partner, their iTunes ratings are poor (?reliability), they are relatively costly at $25/year, and there's no data freedom. (Corrected from original - see comments.)

It's a sad situation. The best option is still the combination of Appigo's ToDo.app and Toodledo's web service; I pay for both. I do, however, grit my teeth every time I use Toodledo's web client, especially if I need to search for something.

I'm hopeful we'll see a fix in 2011. There are at least three ways the logjam could break.

Apple's OS X app store could reenergize the flagging OS X desktop, and new desktop products might appear at better price points. If Apple were to provide OS X App Store developers with a standard way to synchronize to iOS devices I'd expect a great solution. Alternatively,  Apple could forget it hates its customers, and finally put a bullet through iCal (sadly, will require 10.7). Lastly, and least likely, Jobs might decide he doesn't totally hate task managers after all.

Google might finally provide an API for Google Tasks, allowing iOS client development. Or they might provide HTML 5 (Gears-like) offline Google Tasks web app with synchronization support for Safari. [6]

Lastly, the Omni Group could create a "lite" version of OmniFocus for the App Store and sell both an iPhone and desktop OmniFocus Lite for under $50.  Or some other current vendor will fill out an existing solution.

If we assume an average probability of each of these outcomes of 50%, there's an almost 90% probability [5] we'll get finally get a great iPhone task management solution next year.

I'll raise a beer when it happens.

See also (mostly not about tasks, but all about PIM functions and the amazingly hard Palm to iPhone migration)

- fn -

[1] The big "breakthrough" change to the Palm ToDo (task) list was the radical addition of up to 16 categories. For quite some time Palm tasks lacked "categories" (single tag). The original Palm design team were even more radical minimalists than Apple's modern iPhone OS team.
[2] This is huge. If data models don't match perfectly non-geeks, and even geeks, will eventually be frustrated -- even if they don't understand why they are frustrated.
[3] Looking for a good solution for Emily, and deciding none existed.
[4] I'm being sarcastic of course. One of the hardest things in software development is deciding what to omit. It's the old line about sculpture - great art consists of removing the inessential.
[5] 1 - (1/2*1/2*/2) = 7/8
[6] More likely now that the Google/Apple war is over.

Saturday, July 31, 2010

Migrating Notes from ToodleDo to ResophNotes and the Simplenote ecosystem

[Shortly after I first wrote this, C.Y. released ResophNotes 1.0.5. Among other things, such as the ability to store notes as indexable .txt files, it has direct support for importing ToodleDo’s CSV file. He’d told me the release was coming soon, I did it my way just for geek fun. I’ve therefore moved the details of what I did to a footnote. BTW, turns out C.Y., like me, migrated to Simplenote from Toodledo/Appigo!]

Once I'd rescued my memory fragments from Outlook 2007 my next goal was to unify them from the former Palm Memos I'd (painfully) migrated to ToodleDo and thus Appigo's Notebook.app.

I've been reasonably happy with the combination of ToodleDo and Appigo, but notes are very much a 2nd class citizen on ToodleDo (they're all about tasks) and their search tools are pretty weak. I also wanted to be able to access and work with my notes from my desktop on Windows and the Mac, to be able to back them up, to have them be exposed to Spotlight search on OS X, to integrate my old corporate Outlook Notes with my old personal former Palm Memos and to have at least one open source repository in the mix. I needed the notes to live in a standard file format (UTF-8 text or RTF) free of all data lock.

Sounds like a lot, but the combination of ResophNotes (XP and higher - free but do donate), Simplenote (Cloud, ad-supported or $9/year - I paid - see documentation), Simplenote.app (iPhone and iPad app, free) and Notational Velocity (open source, OS X - documentation) gave me everything I wanted -- plus Chrome extensions for editing.

There was only one thing standing in my way. How could I get my ToodleDo notes into Simplenote?

I knew that ResophNotes (Win) would import Outlook's peculiar CSV files (embedded paragraphs!), but the developer, C.Y. I still days away from releasing a more general CSV import feature. I was impatient, so this is what I did. (see footnote [1])

During my early import experiments, because I used a Mac for part of the process, I ran into character encoding problems. Since ResophNotes doesn't yet have note multiselect and delete [2] I had to find its database and delete it.

ResophNotes exports and imports .RSN files (yay! backup!), but that's not how it works with notes. I found them in "C:\Documents and Settings\jfaughnan" in a .ResophNotes folder (hidden). To delete them and start over you have to quit ResophNotes, then find the instance in Task Manager Processes and kill it, then you can delete the files.

That let me start over again.

BTW, here's how the notes look in Notational Velocity's "Notational Notes" store:


Yes, each note a separate Rich Text file (I may convert to safer plain text) -- all Spotlight indexed.

Just in time for my birthday.

Nerdvana.

[1] Now that ResophNotes has direct ToodleDo import, I’ll include this as a reference for how one might support CSV variants other than ToodleDo or Outlook. My procedure was especially weird because I happened to have a Mac at hand…

  1. Use ToodleDo's Notes CSV export to my Mac.
  2. Import into FileMaker and use Calculation field to merge the ToodleDo Title and Notes into an Outlook style "Note Body". I next renamed the ToodleDo "Folder" column to Category.
  3. Created FileMaker columns to match Outlook's names, and exported as CSV. I had to paste this string in as the first row: "Note Body","Categories","Note Color","Priority","Sensitivity". I left all values except Note Body and Category null. In retrospect I should have appended "Categories" as a string to the end of "Note Body" to facilitate search.
  4. I used TextWrangler to clean up some character encoding CR/LF issues. This was only necessary because I got a Mac in the mix. Curse that ancient CR/LF screwup. It seems to have survived into the world of UTF-8 encoding.
  5. I fired up my Fusion VM (way better than it first was on 10.6) and my old XP image and moved the file over. I opened it in Word and saved as UTF-8 to remove any residual character encoding issues.
  6. I imported into ResophNotes. When I was sure all was well, I synchronized ResophNotes with Simplenotes and all my notes merged into one lovely repository. I fired up Notational Velocity in another window and confirmed all was fine there as well.

[2] Since the latest version can store as .txt files, I assume one could just delete all the .txt files! I haven’t tried this tough.

Tuesday, July 27, 2010

Escape from Outlook Notes - ResophNotes, SimpleNote for iPhone and Notational Velocity

I had despaired of rescuing my notes from Outlook 2007.

I'd written hundreds over time. In the old days I used Palm products that would sync with Outlook, so I could carry them with me. Now my iPhone, after years of struggle, gives me good Outlook sync with Contacts and Calendars. Notes and Tasks, however, have been orphaned. There's no real hope of an Outlook Notes to iPhone sync solution; although a few people use Outlook Tasks almost nobody uses Outlook Notes.

I've learned to live without corporate Outlook Tasks (I schedule my time on a 3 week plan basis), but I wanted those notes. I decided they needed to live within either ToodleDo Notes/Appigo Notebook, iPhone Notes (unlikely), or the Simplenote / NotationalVelocity universe (for various reasons I've given up on Evernote).

Today I discovered ResophNotes, a Windows app that syncs with the Simplenote cloud data store. The Simplenote cloud data store, of course, also syncs with Notational velocity (open source, OS X Spotlight indexed), OS X Tinderbox, OS X Yojimbe (3rd party sync), and there's a Chrome extension for editing notes.

I exported my Outlook 2007 notes to Outlook's odd CSV format (includes line feeds!), then I imported into ResophNotes and synchronized with Simplenote's cloud store. Then on my iPhone I viewed them in the Simplenote iPhone client.

It worked better than I'd expected.

Now I can move my old (originally Palm III Notes, now ToodleDo/Appigo Notebook) personal notes to the same cloud store. I'll sign up for the $10/year premium Simplenote service. (Currently I have free version.) If Simplenote belly up the rich ecosystem and open source Notational Velocity desktop solution provides the insurance I need.

A good day.

See also:
Update 7/31/10: The author of ResophNotes tells me he's preparing a new version that will import CSV files -- like the ones ToodleDo Notes export creates. Incidentally, I discovered that FileMaker Pro 8 does a great job opening Outlook's CSV files with embedded line feeds. I never imagined ...

Friday, October 02, 2009

Palm to Google calendar migration: Dba2CSV

I received a comment on on of my many Palm to iPhone migration posts plugging a calendar migration tool:
... To move from Palm Desktop to gCal/iPhone etc you can also try Dba2Csv or Palm2Google to move your calendars. No sync here - this is just accurate conversion from .dba to .csv (for Palm Desktop 4 files) or direct export from Palm to Google Calendars (for Palm Desktop 6 files) ... Unlike some other solutions to this problem, I am an independent freelance developer, and I provide unlimited online help (chat/email) AND a 100% quibble-free money-back guarantee :-)
The author's web site advises ...
... The best method for Palm Desktop 4 users is usually to upgrade to Palm Desktop 6 & use the Palm2Google tool within Dba2Csv. This process should only take 5-10 minutes, if you read the instructions under "Palm2Google" in the main menu on the left first. Once Palm2Google has moved your data to Google you can easily sync Google Calendars with nearly any software or mobile device, or export as an iCal file to import to most calendar software ; once your data is where you need it, you can stop using Google Calendars altogether if you wish, use Google Calendars to keep syncing with your new device, or just keep the data there as an online backup...
With Emily and I sync our iPhone Calendar.apps with Google's Calendar using Google's Exchange server ActiveSync (Google Sync). It's worked very well for us and I'd vouch for it, though the semi-secret UI for multi-calendar support on the iPhone is obviously not for general consumption.

So how did we get to Google Calendar?

Emily had given up on Palm many years ago, but in my case I just gave up on my Palm calendar and started a new one. See a prior post with several options for Palm calendar migration.Now that Google has an Outlook Sync product that's an easy option for any Palm user with Outlook available.

If you're on Palm Desktop though, there may not be a lot of options. So this might be worth looking at.

Incidentally, this post inspired me to update my old Palm to iPhone migration table.

Friday, September 25, 2009

Tasks from Palm to iPhone via Toodledo

I don't think this was available when I moved my PalmOS tasks to my iPhone.

Toodledo will import PalmOS Task archives: Toodledo : Palm PDA Import/Export.

So you can import your tasks to Toodledo, then sync them to your iPhone using either the Toodledo iPhone app or Appigo's Todo.app.

I've used Toodledo and Appigo Todo.app for over a year. Neither is perfect, but they're both a solid B+. I really don't know a better solution.

PS. How could they be better? Well, if Appigo doesn't make any more bone-headed changes to the Todo.app (they've mercifully reversed some past mistakes), and if Toodledo stopped deleting tasks > 1 yo and changed quick search to scan all task fields, then they'd be a solid A.

Update: Incidentally, I'm experimenting with the RSS feed view of my tasks in Google Reader. I think I'll figure out a good use for this feature.

Sunday, June 14, 2009

Deep dive into the Palm Pre

An escaped image is giving techies a deep look into the innards of the Pre. Turns out the PalmOS is based on OpenEmbeddded Linux which in turn incorporates OpenZaurus which is descended from the 1990s Sharp Zaurus PDA.

And you thought the PalmOS was built new in 2 years. Not so. The genius of the thing is how much GPL software it contains.

The Pre continues to please, with positive reviews from Mac folk like Scott Gruby. Maybe I'm not the only one who needs a phone that excels at basic PIM functions (see Andy, I'm not always a market of one). I think Apple made a mistake blowing off the entire personal productivity domain.

One big caveat however. I fear the cloud. The Pre is a cloud phone -- it syncs with Google, Facebook and other Cloud properties. That's a problem for me.

Monday, June 08, 2009

A sislaw’s Pre review

Sislaw Nettie (sister to sislaw Martha and to Emily) has a Pre.

I trust her reviews far more than the pro reviews – am I the only one to notice that Amazon’s product reviews are much better than those printed in magazines?

Like me Nettie misses Graffiti One. She likes her Pre a lot, but unsurprisingly the battery is troublesome. iPhone users can feel smug about the Sprint crapware infesting the Pre. NASCAR … brrrrrrr

My Little Pre « Nettie’s World

…I can’t delete the Sprint NASCAR app – other posters on the Pre forums yesterday confirmed this. RI-DI-CU-LOUS. So now I need to see if there’s any possibility of hiding it, although the thing I object to most strenuously is the fact that it’s taking up my 8GB space in the first place, of course.

6. Battery life. It wasn’t a very promising feeling when I woke up on Sunday morning. The battery had been at nearly 100% when I turned out the light (I had spent 10-15 minutes cleaning up contacts -more about that later) and all apps were closed. When I picked it up to say “Good morning dear Pre” the battery was at 65%! For 7 hours of (nothing?) — all I could think was that the WiFi connection was what was dragging it. The Pre forums also complained about poor battery life – and some constructive posters also provided tips, a few of which I’ve put into practice like dimming the screen a bit, syncing email a bit less frequently, turning off IM and WiFi when not needed. I think I also have to do more reading on better management of lithium ion batteries in general – a few posters said things like, “It typically takes a new battery a week of so to condition itself for maximum results” — is that really true…

No, I don’t think the “week or so” story is true – more like wishful thinking. Maybe Jobs was right about the battery cost of multitasking, though I could believe the Pre OS might be more energy efficient than OS X.

Nettie, if it makes you feel better my iPhone battery will run out by day’s end if I talk more than about two hours during the day (it’s almost a year old now). In airport mode it will last a few days even if I use WiFi occasionally.

Condolences on the Sprint crapware Nettie. Apple was in a stronger bargaining position with AT&T, though I’ve hear rumors AT&T has been fighting mightily to put their garbage on the iPhone. Rumor has it Jobs arose from his sick bed to smite them (ok, I made that up).

Thursday, June 04, 2009

You can't run an iPhone on USB power

Yes, of course you can charge an iPhone with a USB power source, but you can't run an iPhone on USB power. If you use your iPhone the battery level will fall even if it's charging. I haven't tried this yet, but maybe you could just squeak by used if you turned off 3G and WiFi.

This isn't just a curiosity; it means that if your iPhone is in the "dead zone" of low battery level, you can't use it again until it charges out of the critical low level.

Presumably the iPhone needs more power to operate than USB 2 can provide. Alas, if it could still work with firewire that would be enough, and I suppose USB 3 could work.

I wonder if the Pre, which is said to be more efficient, can both charge and operate off of USB power.

Update 6/24/09: I read recently (Dan's Data) that newer laptops can provide significantly greater current and voltage than the standard USB spec. They do that to support power hungry devices. I think my iPhone charges more quickly from my new corporate Dell laptop than it does from my (non-Apple) USB charger. The next time I'm running low, I'm going to try charging it from the Dell laptop during use, and see I can stay out of the dead zone.

Saturday, February 14, 2009

Project Contacts: Integration across iPhone, Google and whatever

I was just about ready to turn my iPhone into cyber-mulch when, unexpectedly, Google saved it. Calendar nerdvana has come to my iPhone, albeit at some cost to my iPhone battery. Again, I have hope. (Yes, Andrew, I am obsessed.)

I need hope. My PIM/PDA world is still a post-Palm mess. At the moment Google is my source of Calendar Truth, my iPhone is a sync client, and iCal is not involved. I’d like to have a copy of Calendar data that I “own”, so I’ll eventually re-integrate iCal. I’m no fan of Apple’s calendaring monstrosity, so there’s not a great rush. Sometime this year though.

In any event, it’s time for a refresh of my Palm Migration Status page:

image

Things have changed quite a bit over the past few months. It’s been a lot harder than I ever expected, and there’s still a way to go. (I hope the Palm Pre is a smash success, if only for vicarious revenge upon Apple for MobileMess.)

Today my old Palm Classic PIM data is scattered across my iPhone, Google, OS X desktop, ToodleDo, Evernote and Jott. That has to get simpler! I’ve made a “strategic” family and personal commitment to Google, so if/when they integrate their inadequate Tasks with Google Calendar (here’s how to do it) I’ll drop ToodleDo from the mix.

I could drop Jott fairly easily as well, and Evernote is improving nicely, so for now my focus is Contacts. This isn’t as critical as Calendar integration, but I’d sure like to get all my work and home Contacts on my phone.

Unfortunately, Contacts are hard, much harder than Appointments, Notes, Tasks, etc. (Ok, so Appointments have their own special non-technical problems too.)

There are a lot of variables in the mix, from endpoints to transition tools. Gmail Contacts, Google Apps domain shared contacts, Google Contacts API and extended Contact Kind, OS X Address Book [1] OS X Address Book Google Sync [2], OS X Address Book Exchange Sync [3], iPhone Contacts.app, Microsoft Exchange Server, ActiveSync, SpanningSync, FileMaker Pro, Bento, MobileMe, gSyncIt, iTunes Google sync, iTunes Address Book Sync, Google iPhone Sync, vCal, hCard, GData, OpenSocial, Windows Live, Facebook and Outlook among others. (Yes, several others.)

Bad enough, but “Contact” information is a big part of vendor lock-in strategy. Yes, Data Lock, big time. We’re talking Google, Microsoft and FaceBook fighting over ownership of contact relationship networks, and everyone fighting with banks, Amazon and the phone companies for identity ownership.

Complexity, corporate combat, rapidly shifting implementations, vendors focused until recently on Calendaring …

Yes, this one is the big Kahuna. Big enough that, for this project, I’ve created a new Gordon’s Tech Label of “Contacts” to help me as I work through all the options.

In the meantime, there’s one big bit of good news. Contacts don’t change as much as Calendaring events. I can get by with manual export/import for quite some time.

In the meanwhile, I’ll be experimenting carefully. Follow the Contacts thread forward to learn what I learn …

[1] OS X iCal is miserable, but OS X "Address Book" isn't all bad. If Bento weren't so crummy I'd put the OS X "Address Book" plus Bento at the core of my strategy.

[2] Update: Since my original posting, I discovered through this thread that OS X 10.5 Address Book has its own options to synchronize with Exchange, Google, and Yahoo -- in addition to the Phone to Google synchronization built into iTunes/OS X (available for 10.4 and 10.5). The mind boggles. So one could synchronize the OS X Address Book with Google Contacts directly, or through Google's Active Sync service ...

Update 5/19/09: Major progress - I have work and home integrated and options for Google too. The cost is I may have to subscribe to MobileMe.

Saturday, January 31, 2009

Prediction: We won’t see a fixed MobileMe until 10.6 is out

I usually keep my editorial opinions off my tech blog, and post them in Gordon’s Notes (tech) instead. This one’s a bit of an exception.

I’ve been spinning cycles thinking about why Apple’s MobileMe and synchronization solutions are so miserable – and why they’re not improving.

Incompetence alone is not an explanation. Yes, Apple uses early adopters as beta testers, and yes, the MobileMe launch demonstrated Apple has serious internal issues, but they’ve still got good people.

Marketing is not an explanation. I can’t imagine any reason why Apple would not want MobileMe calendaring and synchronization to be a wonderful experience that would tie their desktop and phone customers ever more closely to Apple.

That leaves one explanation. Synchronization Hell.

The fundamental problem with “synchronization”* is that computers are not yet super-sentient. If a transaction hub had full knowledge of the world, and an IQ of 150, and lots of time to think things over, it could figure out how to translate an “all day event” represented as an attribute on a day to one represented as a “24 hour event” with a buggy representation of time zones and daylight savings time.

We’re not there yet.

It’s impossible, in the sense of mathematically not possible, to perfectly migrate data between systems that represent the semantics (meanings) of the data differently. Small discrepancies are amplified with each synchronization. Things get left out. Not only are the results inexplicable to users, they’re inexplicable to engineers.

In Apple’s case they’re deeply stuck. They have desktop systems running 10.4 and 10.5 that they’re trying to support, each with somewhat different models for calendar items, contacts, and tasks. (Let’s not even mention the horrors of the Mail.app vs. iCal.app task fiasco). The iPhone has yet another data model for Calendar and Contacts, not to mention Notes (but no Tasks). The iPhone has to “sync” with Outlook (when Exchange is not present) and iCal/Address Book (OS X) and MobileMe and Exchange Server.

The solution is to surrender to Microsoft and accept the Exchange Server model of the world. Yes, Microsoft’s monopoly is not dead.

So in OS X 10.6 everything adopts the Microsoft Exchange Server data and semantic model of Contacts, Tasks, Notes, Calendar events, etc. At that point MobileMe, the iPhone, and the OS X desktop will align. That’s probably good news, though users of PPC machines may be out of luck**.

“Snow Leopard” is probably coming out later this year. I don’t think MobileMe and the iPhone will give us the basic PDA functions we need until after 10.6 is widely available.

--

* In the world of HealthCare IT, where I live during daylight hours, the equivalent words are “mapping”, “messaging” and “interoperability”.

** It’s generally assumed that 10.6 will be Intel only. I would not be surprised if Apple has not yet made a final decision.

Saturday, January 10, 2009

Palm Pre is Exchange sync based

Microsoft now has monopoly control over the standard for corporate data synchronization:
Ars talks to Palm at CES, gets under the hood with the pre

... The device supports over-the-air Exchange ActiveSync for contacts, email, calendar, and tasks. 'We use EAS at Palm, so we live and breath and eat it.'...
This has more than a few implications. See my Gordon's Notes rant on the big problem.

It means, among other things, that a huge amount of the value of a smartphone is whether or not it will be granted access to the corporate Exchange server. It also means that it's rather hard to image anything but Exchange server at the heart of any modern corporation ...

But now I digress into Gordon's Notes opinion territory.

Incidentally, does anyone know of a vendor preparing a utility that would be installed on a PC and would
  1. Read/write Outlook data.
    Publish Post
  2. Provide a local Exchange ActiveSync service so one could connect to the machine via TCP/IP and sync that way?
Update 6/10/09: See comments for some useful definitions. For example, old ActiveSync is now called "Outlook Anywhere" and it's implemented as Outlook-style RPC over HTTPS. This page provides Outlook-centric implementation details and links to Microsoft references.

Sunday, December 28, 2008

iPhone: status update and my apps

Gear Diary made a list of the types of iPhone apps professional geek bloggers use. I have many of them, with the exception that Twitter isn't useful for me and I've only now trying to see if there's something useful about Facebook...
Gear Diary's Favorite iPhone/iPod Touch Apps | whatsoniphone.com

On four different lists were:

Evernote
ToDo [jf: Appigo]

On three of the lists are:
Facebook
Twittelator Pro [jf: still trying to figure out a Twitter use case]
eWallet [jf I use 1Password]
Safari

And on two of the lists are:
eReader
Jott
Byline [jf: I use Google Reader]
Around Me [jf: I have Where To?]
My Apps are above, click to make 'em readable. This list, taken from iTunes, doesn't show my heavily used web apps (eg. Google Reader) and it includes a couple I no longer sync to the phone.

Google Reader is my favorite iPhone app - it's amazing. The Google Calendar app for our family calendar is another superb Google web app, then there's Google iPhone search, etc.

The games are for the kids (really) -- and they're invaluable in tight spots (my 9yo played one game during his flu immunization -- worked great).

So lots of good stuff there, but the bad news is that the iPhone sucks as a business tool.

I really thought it would be better than it is, but Apple has dropped the ball. No Calendar API to support over-the-air sync to Google Calendar, a complete lock-out on the cable which means corporate outlook calendars are a no-go [1], and, of course, no cut/copy/paste and truncation of longish notes/memos associated with contacts and calendars. (Oh, and I wish the phone had GPS compass capabilities, but that's a nice-to-have.)

I'm back to carrying around a very aged Palm PDA so I can get access to my corporate contacts and calendar. The only thing that saves Apple for me is that the alternatives are equally lousy.

[1] The only way to get a half-decent business access is to simultaneously use MobileMe for personal data (pathetic) and Exchange Server for corporate data (requires corporate IT approval -- fugget-about-it).

Update 1/5/09: A friend asked for some recommendations, so I've provided some more detail. Some of this duplicates my original post ...
1. Air Sharing: turns phone into webdav server -- store documents there.
2. Remote: control air tunes library
3. Google Mobile: many different web apps, Google Reader is essential
4. Google Earth
5. i41CX: HP 41 emulator - amazing
6. Evernote: take picture, it uploads, does OCR, indexes, store other data in cloud. Now acceptable since they've delivered a way to move data out.
7. AirMe: take picture, send Picasa web album
8. Notebook and Todo: Appigo "notes" and "tasks" management (these have a treacherous design flaw when used together however)
9. NYTimes reader: could be better, but still good
10. Pandora radio: explore music. Terrific.
11. Shazam: recognize music (best for pop though, fails with Jazz, classical.)
12 Wikipanion: great! Optimized Wikipedia client.
I don't have Byline but since it integrates with Google Reader I'm considering it.

Then there are the built-in apps. The huge issue with the iPhone now is the inability to sync directly, or even efficiently, with Google Calendar and the lack of a Calendar API. That's bad enough, but Apple's MobileMe alternative is awful. (Corporate sync is a MUCH harder problem). Eventually people are going to figure out how big a problem this is. (Vendors are starting to deliver entire calendaring/task solutions that completely ignore Apple's built-in solutions and that sync with Google -- but these will only be coming out in the next few months.)

The other big missing app, which I suspect is due to a nasty conflict of interests, is that Apple won't enable any effective instant messaging client -- in fact they have failed to deliver a promised 'push/notification' API so they're foreclosing that entire domain of apps. They want, of course, to keep the huge SMS revenue they share with AT&T.
Update 1/1/10: Jott is now trying to do automated transcription instead of human transcription - obviously to save money. It doesn't work at all for my voice. So Jott is really just a voice snippet recorder now.

Friday, November 28, 2008

Chapura KeyTasks for the iPhone

Chapura is offering an iPhone Task management application tied to an online "cloud" service.

If you're an Outlook user you can sync your tasks from Outlook to the "MyChapura" cloud service, and from the cloud service to your iPhone/iTouch -- even if you sync Outlook with Exchange Server. (Unlike MobileMe, which has been changed to no longer sync with Outlook when exchange server is involved.)

As far as I can tell the MyChapura cloud doesn't include any user interface for manipulating the Task data, it's strictly a store that gets around all the issues with syncing an iPhone to multiple machines and the inability to sync over the Apple calbe.

Grrr. Maybe I should have left all my PIM data in Outlook -- rather than moving it to the pathetically inferior OS X environment. (Only Address Book is in any way competitive to the Outlook PIM equivalent.)

So is Chapura going to go all the way, and add Calender, Contact and Memo/Notes support to MyChapura, with complementary apps on the iPhone? That would be a large project, but it's very much like their Palm KeySuite application.

I'm definitely interested; it's a shame Chapura doesn't have a blog I could track. Tasks synchronization alone isn't worth the risk of installing software into Outlook/XP (very unstable environments these days), but if Chapura goes further ...

Sunday, November 09, 2008

Is it too late to go back to Palm 1994?

After my latest iPhone Toodledo / Appigo disaster I've been reconsidering my approach.

Maybe I need to go give up on the Cloud for a while, and let things bake a bit.

Or maybe I'm being premature. Evernote's no longer guilty of data lock, maybe I should try them again.

I mozy over to my Evernote account. There I'm greeted with my first note ...
Evernote Web: Note Search

...Unknown exception (com.google.gwt.core.client.JavaScriptException: (TypeError): c is null fileName: http://www.evernote.com/enweb/ENWeb/26883679FEFF138CBBFB08EA679E2AA0.cache.html lineNumber: 2534 stack: vdd(null,229501)@http://www.evernote.com/enweb/ENWeb/26883679FEFF1 ....bject Object]) ..../enweb/ENWeb/26883679FEFF138CBBFB08EA679E2AA0.cache.html:800 ) during operation (Unknown)...
Pick up towel. Throw. In.

I'm toast.

Time to rethink my approach to Task and Notes.

Frankly, if I'd know it was going to be this bad I'd have stuck with my old Palm handheld for another year!

Appigo and Toodledo – nasty emergent design flaw makes a mess of my iPhone Notes and Tasks

This is about the worst design flaw / bug /emergent interaction I’ve encountered in the past few years.

Here's the story from my rejected post to the Appigo Todo Google Group [1]

When I added Notebook to Todo, and after I'd imported hundreds of notes Toodledo, I ended up with a set of categories (aka folders) for my iPhone Appigo Notes and Tasks that were the sum of the Palm categories I had used for Notes and the Palm categories I had used for Tasks.

Since my Palm Notes and Tasks had different categories, there were empty folders that showed in Notes (but not empty in Tasks) and vice-versa. They cluttered up my folder list.

So I deleted the empty folders on both sides.

Can you guess what happens next?

It took a surprisingly long time after the deletion, perhaps due to Toodledo synchronization issues, but I now have hundreds of Tasks and Notes that no longer belong to any category…

… At least when synchronizing with Toodledo, Tasks and Notes share a common set of categories/folders. If you remove a folder from Notes that is empty, you remove the matching folder from Tasks. All contained Tasks go into the inbox (at least they aren't deleted).

This is the single worst bug or design flaw or bizarre emergent synchronization behavior I've run into in several years. I don't know how I'll sort this out.There’s no way to undo this behavior, and there’s no good UI on either the iPhone or Toodledo for manipulating sets of Tasks or Notes.

Man, do I hate synchronization.

What a bloody mess.

Update 11/9/08: To clarify why the problem is so bad. If the data lived in Outlook, this would be a nuisance problem. It would take some time, but I could select swathes of items and assign them to new categories. Neither Appigo nor Toodledo support multi-select operations.

I did some further testing. I created a folder in Toodledo tasks, and verified it did not, at first, appear in Toodledo Notes. I did the same with Toodledo notes. However after Appigo Notes synchronization, the Toodledo TASKS folder appeared in Appigo Notes. After a cycle of Appigo Tasks and Notes synchronization the new Toodledo Notes and Tasks folders appeared in both Appigo Tasks and Notes and then synchronized back to Toodledo Notes and Tasks.

Which brings me back to two critical points I keep relearning:

  1. Synchronization is Hell.
  2. Reliable service requires a single vendor to control the client and the server. Differences in folder models between Toodledo and Appigo are at the root of this exquisitely nasty bug.
  3. There is a vast and perhaps unbridgeable gap between the capabilities of a robust desktop client like Outlook and what the Cloud can offer.

Update 11/12/08: Although Appigo did not publish my email they did respond to another complaint. They say it's not their design, it's a result of how Toodledo manages categories.

I suspect Toodledo stores notes in the same tables they use for tasks, hence the shared categories.

So this is an example of an emergent bug arising from synchronization between different application models.

Everything I need to know about Health Care messaging and synchronization I learned from my PDAs.

Update 11/13/2008: I looked into alternatives to Appigo such as Things.app and OmniFocus. The first is pre-release and has no import/export capabilities and the second, though released, has no useful import/export capabilities.

Neither meets my minimal data freedom requirements.

Since the category-loss bug arises from the combined use of Appigo's Todo.app and Notebook.app synchronizing against Toodledo's single Task/Note store, one workaround is to keep Todo.app and Toodledo Tasks but look for another solution for Notes, such as Evernote.

Alternatively, since Evernote now has a published API, Appigo could use Evernote as their note store instead of Toodledo. Their Notebook app is far more stable and useful than the Evernote iPhone client.

I'd suggest this to Appigo, but the last post I submitted to the Appigo support Group was not published. [1]

I don't have better options for the moment, so I'll stick with Appigo iPhone Todo.app and Notebook.app for the next few months. Things.app may be ready for my use by February 2009, assuming they have a robust set of import/export capabilities on the client.

Of course Google could create a Task companion for Google Calendar at any time. If they do that then the deck will be reshuffled and we'll have more options. I don't expect any solutions from Apple; I think they're in much worse organizational shape than we realize.

[1] Appigo declined to publish my post to their Google Group based support forum. If my most recent note on this thread doesn't appear, I'll have to conclude that Appigo is aggressively censoring their customer posts -- at least on this very sensitive topic.

Update 11/13/08: My posts are not appearing in Appigo's Google Group.

Update 2/24/2010: Appigo did eventually introduce warnings into their apps, so that you're less likely to fall into this trap.

Wednesday, October 08, 2008

Synchronization is Hell.

In the past few days I've run into cryptic synchronization errors from Sharepoint, Outlook, Exchange server, and Spanning Sync. Messages like
Task 'SharePoint' reported error (0x80004005) : '"****- PTO" starting on Monday, November 24, 2008, at 12:00 AM (server time) was not copied because Outlook does not support skipping over a later occurrence of the same recurring appointment...
Funny, I saw a similar Spanning Sync warning about deleting the first instance of a recurring appointment in gCal.

Synchronization between apps with identical data models is Heck. That's what Palm Desktop and Palm OS did in the good old days, and what Toodledo iPhone does with ToodleDo web today.

Synchronization between different data models, such as iCal with gCal, or Todo.app with ToodleDo web service, is HELL.

Really. Try hard to avoid jobs that involve message passing between different data models, or take 'em but ask for a lot of money.

Update 10/21/08: Exhibit #43145515 from Outlook 2007 subscription to a gCal ICS feed:
Task 'Internet Calendar Subscriptions' reported error (0x000710D2) : 'The VEVENT, "Baseball ", defined near line 2061, contains a recurrence pattern that has no instances.'
Update 11/9/08: Synchronization Hell destroys the folder/category relations of hundreds of my iPhone Notes and Tasks. Also, time zone problems between Outlook 2007, gSyncIt and Google Calendar when one views a gCal from a time zone different than the time zone for which the sync occurred, or when the Outlook even has a time zone other than default. Since time zones are Hell, and Synchronization is Hell, what do we call synchronization involving time zones?

Update 1/22/09: Many months after the multiple sync hells associate with migrating my Outlook/Palm Calendar to my iPhone I find out many birthday events were duplicated or prematurely terminated -- so I'm late with my father's card.

Update 2/7/09: Two more examples -- OS X vs. Gmail Contact data models and NuevaSync and "bad" Google Contacts.

Update 2/14/09: An oldie but goodie.

Update 3/18/09: Both Google Outlook Sync to Calendar (gCal) and Google's iPhone Exchange Sync service get messed up, leading to a massive debugging exercise.

Update 4/27/09: Google Calendar Sync disaster returns. This time, the monster is even stronger.

Update 5/15/09: I beat back the Google Calendar Sync monster, then take a huge, complex, but maybe successful run at the horrors of Project Contact.