Deleting Google: Is Latitude broken?

I'm late to the great Google divorce party -- tomorrow Google promises to exploit and sell everything that they've got on us. (Not sure if that includes Docs and Email -- soon if not now.)

It was easy to delete my extensive search history, but the Google Latitude management page is missing its delete history button. Looks like they forgot that one.

It's sad how fast and far Google's reputation has fallen. I'm at a Silicon Valley (think LA without the beaches or the glamour) tech conference today, and Google gets the disdain Microsoft once owned. I wonder if they've noticed, or if they've figured out that Larry Page is not Steve Jobs.

A fix for OS X lousy print sharing - the AirPort Express

I've been struggling with my OS X 10.6 shared Brother HL-2140 ever since I bought it. Whatever I tried, at least once a week I'd get an error message that was supposedly fixed with 10.5.5:

Mac OS X 10.5.5: USB connected printers do not print; printer queue displays "Printer is currently off-line" ... 

... After updating to Mac OS X 10.5.5, you may not be able to print to some USB-based printers. This message may appear in the printer queue: "Printer is currently off-line." 

... Open this link in a web browser:  (http://localhost:631/printers/) Click the "Modify Printer" button for your affected USB printer queue. Click Continue.  You may need to wait a few seconds. From the "Device:" pop-up menu, select "Unknown USB". Click Continue. The "Make:" list should highlight the manufacturer of your printer. Click Continue. Select the printer model that is attached. Click "Modify Printer". Enter an administrator account name and password....

Alas, that 10.5.5 measure didn't work, though it's nice to know that localhost:631 interface to the CUPS printing service. Maybe 10.7 is better, but I'm trying to avoid that mangy beast.

I had past success with the networked Brother MFC-7820N - I only gave up on it when the print mechanism started jamming (old). I figured when my next printer cartridge was due I'd look for something better. Alas, we're WLAN these days, and the reviews for Brother's wireless printers are not good. In fact, there don't seem to be any good reviews for anything. Printing is fading away.

So instead I disconnected the printer from our 10.6 iMac and connected it to an old and underused 802.11G Airport Express. That did the trick. It's been two weeks and the 2140 has been working for all of us. Cheaper (free in our case) and more reliable than a printer WiFi client.

iMovie '11: deleting rejected clips reduces video quality

The great thing about my home video archive project [1] is that there are always more pitfalls. I suppose it's a bit like golf that way.

In the last few days, for example, I discovered that the 10 or so hours of analog video I'd painfully captured had only one audio channel [2]. Prior to that I figured out that the existence of an Event repository on an external firewire drive was preventing thumbnail generation with new event capture.

Yes, it reminds me of the joys DesqView/QEMM DOS memory management. Be glad you don't know what I mean.

Even better, last night I discovered that iMovie '11s "Move Rejected Clips to Trash" feature destructively degrades archival video quality. Without, I might add, any warning.

Like all video pitfalls, this surprised me. I remember QuickTime Pro was very good at excising bits of DV files [3]; select the region, delete, quickly get a smaller file. Alas, iMovie doesn't work this way.

Instead iMovie decompresses (decodes to lossless) the clip, which in the case of my Analog to Digital capture is the entire file. [4] Then it excises the unwanted segments and it re-compresses to back to DV-25, changing the packaging as well (from .DV to .MOV). Since DV-25 is a lossy form of compression [5] there's a significant quality degradation from removing unwanted clips, such as the trailing frames iMovie creates after my camera's DV stream ends.

Oh joy. Now I get to redo that tape [6].

So why does Apple do this [7]? Probably because nobody seems to have noticed. Even when I knew what to search on Google found only one reference from 2007 [8]...

harder & harder to remove unwanted...: Apple Support Communities

... I can still crop bits from my events and send those bits to the trash BUT doing so converts the underlying DV movies into .MOV files and DOES modify the quality of the video. I'm not sure if it's significantly worse quality, but I can do a side by side comparison of the original DV and the MOV file that iMovie 08 insists on making if I delete bits permanently from my events and there IS a difference...

... However, they get "squeezed" for some reason, as you pointed out, so that when played directly (i.e. from Finder in QuickTime) they get reduced from their real/original 853x480 to a smaller, squished 720x480...

Even in that thread the participants missed that DV (MPEG-2) is lossy compression; the reassurances were misplaced.

Someday I'll have to see what Final Cut Pro X does. iMovie's callous recompression doesn't give me warm and fuzzy feelings. (Admittedly, nothing about Apple gives me warm and fuzzy feelings any more.)

[1] For the rest of the current series over the past week or two, see:

• How should I transcode my home analog video? 2/13/2012
• iMovie 11 and analog to digital videotape conversion by passthrough
• MPEG Streamclip video converter as Compressor alternative
• Mac mass storage for video archiving - options
• Video: The state of compression is not good. Blame it on Congress. 2/18/2012 (and, perhaps, soon we can blame Google)
• iMovie 11 does not completely import iMovie HD projects

[2] I'd swear one of the capture UIs I used appeared to show stereo. I think the problem was that the Canon STV-250N video cable only looks standard; I think it flips an audio and video input. So one audio was going to the video channel, but since I was using an S-video cable I didn't see this. I'd long ago mixed that cable with others, and it took some detective work and web image study to identify it.
[3] DV-25 technically, though I believe that label conceals a wide variety of messiness including variations in codec version, variations in metadata, variations in sound encoding, differences in 'pixel aspects', interlacing variations and so on. 
[4] Maybe it always does all clips in an Event. I don't know. In this case the Event was a single 10GB clip and it was entirely re-encoded. I also don't know if this continues to happen after the initial DV/MOV reencoding, perhaps iMovie can work with some forms of DV more directly.
[5] Quite lossy by still image standards. It feels comparable to 60% compressed JPEG, so a single re-encoding cycle causes noticeable damage. I have a theory that low compression MPEG-4 (30 Mbps+ data rates) is less lossy than DV, but saying this tends to enrage video "experts" in Apple's Discussion groups.
[6] It looks like I'm going to be running through each A to D conversion an average of 2.5 times. If I could travel back in time two weeks I'd send me to a commercial A to D conversion service.
[7] Aperture does something similar, albeit less obnoxious. Even if you don't edit a JPEG image, if you export it as JPEG Aperture always decompresses and recompresses. There's no intelligent export of the original.
[8] Not the point of this post, but this bit of the thread helps explain why video work is so nasty (more on formats some other day) ...

... QuickTime always reports two dimensions, the native format size — 720x480 — and the playback display size, shown in parenthesis, e.g. "(853x480)". The native size is measured in non-square pixels and the display size in square pixels. (Or is it the other way around?)

.. Throughout the history of QuickTime the playback of DV video has evolved from always displaying it as 720x480 — which confused viewers because the pixel shape of DV caused the video to appeared "stretched" — to adjusting the playback display to 640x480 for 4:3 video and 853x480 for 16:9 video. Sometimes QT doesn't choose the display size we expect, but that shouldn't affect the size or quality of the underlying video. (To force the video to use the aspect ratio we want so it looks right, QuickTime Pro lets us adjust the display size, just like we used to adjust all 720x480 DV to play as 640x480.) ..

Pinboard and IFTTT to Twitter

A few weeks after Google 2.0 killed Google Reader Social, I decided I'd take the Twitter route.

My Twitter feed was active for about two months, but in time I gave up on Twitter (again). It didn't work as a memory management solution, I don't like the length limit and the lack of structure, and I don't expect Twitter to take better care of my data than Google. Worst of all, like Google, Twitter is free. I can't afford free.

Next I ran through PosterousandTumblr. They both failed, for different reasons. Worst of all, both are too expensive.

Lastly, I turned to Pinboard. I thought I'd use it restore access to my Google Reader JSON exports -- but that didn't work. I could have gotten my $10 back, but I like Pinboard's style, microblog post formats, export formats, import options, ownership, feed-focus, and bookmarklet -- and I really like the Reeder (and, via SendTo, Reader) integration. Most of all, I like paying for it. Oh, and it's Google-Free too [2].

So I've stayed with Pinboard. I tag my (all public) posts with 1 tap codes that are meaningful only to me - s for share, b for blogworthy, y for yammworthy. Each tag has its own stream. The 's' stream is really aimed at Emily, but anyone can consume it. It shows up in her copy of Reeder.app and on her iGoogle page.

No, it's not Google Reader Social. Then again, nothing is. I've come to think of GR Social as a future-fluke, a transient window into a future that might never be. Pinboard isn't GRS, but it's the best microblog/share platform in the mundane world. It beats the heck out of Twitter and (shudder) G+.

Except Twitter, despite my neglect, refuses to die. So I decided to try injecting my Pinboard shares into the Twitter stream. Pinboard doesn't support this, and they don't intend to. However IFTT supports both Pinboard and Twitter, so I now tweet from Pinboard via IFTTT (recipe) [1]

For example:

• Original in Pinboard: Pinboard: Bookmark Detail
• Format in Twitter: Twitter / @jgordonshare: Information Technology Cog ...: ""

It mostly seems to work, though I don't know what happens if my Descriptions are too long.

For the moment then, I share the same items in two places:

• Pinboard 's' with feed.
• Twitter - jgordonshare

[1] In my own task I have a colon between Title and Description, otherwise they run together in Twitter.
[2] Is it Google's ambition to be more disliked than AT&T?

iTunes Playlist havoc - where did they go?

(The moral of this story - be very careful about following old web recipes for iTunes hackery. The app has changed a great deal in recent releases.)

The original:

It's been a long time since iTunes caused me much trouble, but something's gone wrong recently. Several playlists were missing. I followed the standard procedure for playlist recreation (reference deleted, see [1]). I didn't recover anything, but now most of my many, many Smart Albums are broken.

Be interesting to find out if this is simply my bad luck or something went bad in a recent iTunes update.

Nothing for it but to slowly clean up, wistfully parting with more more hours feeding the beast. I'll try restoring from an a month old playlist XML file via Time Machine and see if I get better results.

I suspect they're not long for the world anyway. Apple is overdue to gut iTunes, and replace it with some simple app that will omit most of what I use.

Update: Oh, great. TIme Machine does not backup iTunes Library.xml. Good thing I have offsite backups using Carbon Copy Cloner. Did I mention Apple gives me hives? In theory we're not supposed to need it, but in this case without that file I have no Playlists at all. Certainly feels like something is broken....

[1] Updateb: It got worse. All my apps were missing too, and all my purchases. At that point I bailed. I pulled my CCC backup to protect it, then told Time Machine to restore iTunes Library, iTunes Library Extras.itdb and iTunes Library Genius.itdb from 1 hour before I started messing around. Things returned to normal; iTunes Library.xml was recreated as it should be. I'm still missing a couple of Playlists, but at least I haven't lost everything.

So I can't say what happened to a few of my ITunes Playlists, but I can say one should be very cautious about trying to recreate a playlist using the method of removing iTunes Library and importing from iTunes Library.xml.

Updatec: Looks like there's more material missing - including several audiobooks! .... Time Machine shows everything was there an hour ago. It's almost as though, when I was trying to restore my playlists, iTunes actually went and removed ... content. I've never seen anything quite like this. I am going to run some disk check software then try restoring my entire iTunes Library from last night's disk clone.

Updated: I think I figured out what happened to the Audiobooks -- and probably other content. It went something like this:

1. During my ill-fated attempts to restore the wee missing Playlists, I caused iTunes to review all content without any genre settings I'd made.
2. During the review iTunes decided that some old Audiobooks taken from CD and specified as audiobook, were in fact music. iTunes reorganized them into music (I found them there using Spotlight.)
3. When I restored the iTunes database it didn't know about the new location, so the content went missing.

I finally restored from a backup of the previous night and brought everything back. I recreated the mysteriously lost playlists. The loss was never explained.

iMovie 11 does not completely import iMovie HD projects

I was infuriated by the data loss during iPhoto to Aperture migration, but that's nothing compared to iMovie HD to iMovie 11 migration [1]. All titles and effects are lost.

This happened years before the better known debacle; Final Cut Pro X does not import Final Cut Pro 7 projects.

How does Apple get away with this?

It's not just a rhetorical question.

[1] Prior versions don't import at all, though you can dig the .DV files out of the Packages and import them by hand. Or open prior projects in iMovie HD, then save them then import.

MPEG Streamclip video converter as Compressor alternative

I came across this reading a well written response on the FCP discussion group:

Squared 5 - MPEG Streamclip video converter for Mac and Windows

... MPEG Streamclip is a powerful free video converter, player, editor for Mac and Windows. It can play many movie files, not only MPEGs; it can convert MPEG files between muxed/demuxed formats for authoring; it can encode movies to many formats, including iPod; it can cut, trim and join movies. MPEG Streamclip can also download videos from YouTube and Google by entering the page URL....

Those are impressive features. The post claimed conversion quality equalled that of Apple's Compressor app.

Reading the release notes it's typical video software - somewhat flaky and tricky to use. Some functionality requires companion apps. It's not fully Lion compatible and OS updates may require app reinstallation. Some details on functionality (emphases mine)...

MPEG Streamclip lets you play and edit QuickTime, DV, AVI, MPEG-4, MPEG-1; MPEG-2 or VOB files or transport streams with MPEG, PCM, or AC3 audio (MPEG-2 playback component required); DivX (with DivX 6) and WMV (with Flip4Mac WMV Player). MPEG Streamclip can export all these formats to QuickTime, DV/DV50, AVI/DivX and MPEG-4 with high quality encoding and even uncompressed or HD video.

Video conversion is performed in the YUV color space; you can choose to scale video to any frame size using a professional 2D-FIR scaler (better than bicubic) but you can also leave it unscaled. Other optional video processing features include a powerful motion-adaptive deinterlacer, a field dominance converter, a chroma reinterlacer and an option to perform interlaced scaling instead of progressive scaling. Audio can be converted to uncompressed or to IMA, AAC, MP2 or AMR using the high-quality MP1/MP2/AC3/PCM built-in decoders of MPEG Streamclip; it is also kept in perfect sync with video using a timekeeping system.

MPEG Streamclip can save edited movies as MOV files, and (when possible) as AVI or MP4 files. Edited MPEG-1 or MPEG-2 files are saved as MPEG or TS files.

MPEG Streamclip (with or without the MPEG-2 Playback Component) can also convert MPEG-2 transport streams into muxed MPEG-2 files, for immediate burning at full quality with Toast 6 or 7 and Sizzle; it can also demux MPEG-1 and MPEG-2 files and transport streams with MPEG, AC3, PCM audio to M2V and AIFF (or M1A or AC3) files, for immediate burning at full quality with DVD Studio Pro or Toast 6 and 7. A special demuxing option is available for Final Cut Pro 4/5: this application does not work well with M2V files, but MPEG Streamclip can write a special "unscaled" M2V file that preserves full video quality when imported into Final Cut Pro.

MPEG Streamclip can handle files and streams larger than 4 GB, split in any number of segments, or with multiple audio tracks, and can also optionally handle timecode breaks. It is compatible with MPEG-1 and MPEG-2 video, MPEG layer 1/2 (MP1/MP2) audio, AC3/A52 audio, and PCM audio.

The player included in MPEG Streamclip lets you preview the files and transport streams before doing the conversion; it also lets you visually set the In and Out points for the conversion so you can convert just the part of the file you are interested in, and also cut commercials and other unwanted parts, or edit the stream and join two streams with Cut/Copy/Paste.

MPEG Streamclip supports batch processing: just drag some files in the batch list, choose a conversion and a folder, click the Go button and MPEG Streamclip will automatically convert all your files.

Reading between the lines I suspect it's sometimes used for non-approved editing of commercial products.