Saturday, November 17, 2007

Google's link search behavior and a Firefox request

It's annoying to have so many text entry fields at the top of a browser. There's one for a URL (which may act as a search field), one for search (which may allow specification of the search engine) and one embedded in the Google or WL toolbar (the latter can be set to search Google.

It's no wonder users get confused:
Google Tries to Fix Broken Links

....So people type URLs in the search box. Google changed the way it treats those queries last year: instead of showing information about a URL, it returns standard search results and the top result should be the page that corresponds to your query. This is a great way to avoid typosquatting sites, like flicker.com or twiter.com.

But what happens when Google doesn't find a page from a site included in the index? Until recently, it returned the standard 'Your search did not match any documents.' Now it returns more helpful information: results from websites with similar addresses, suggestions for queries and a way to identify the page by restricting the search to the domain/subdomain from my initial query.
This is a great improvement that should be emulated. It's one more step in the "brute force" approach to broken links. We're stuck with "brute force" because the web never evolved a true directory service.

Now I'd like Google (or Firefox) to add an option such that when the URL matches a well ranked site then we just go to the site. We'd only see search results when the URL was off, that would be the current behavior.

This might have to be an advanced option since the variant behavior would be confusing, but it would let me live with a single top text field. One that also needs to mapped to command-L (OS X) or Ctrl-L (Win).

Thursday, November 15, 2007

iPhone UI unsuited to podcast navigation

My SONY car radio is pretty good with AAC and MP3 tunes, but it fails miserably with podcasts. The controls are designed for navigating a 3 minute tune, not a 60 minute podcast. At the very least they needed to have the fast forward accelerate over time.

I was sure Apple wouldn't mess up like that.

Wrong.
graphpaper.com - Scrubbing the iPhone Scrubber

.... the new scrubber bar is almost useless, especially for long tracks like podcasts where it’s impossible to move the playhead any less than a few minutes per hop...
At least there's a chance Apple will fix their dumb mistake in a future update.

Fixing Leopard stacks (via Japan)

I won't be walking the Leopard until 10.5.3, by which time Stacks might actually work out of the box, but I'm still going to make note of this hack:
TidBITS Problem Solving: A Simple Hack To Fix Leopard's Stacks:

...Zen balance is now restored to my Desktop and Dock, and I find myself once again using Stacks to organize my current projects. For smaller folders the single-click access to the stack is surprisingly more convenient than right-clicking was under Tiger. And sorting by date modified makes even large directories useful as stacks, since I usually want to access the most recent files anyway.
It's a really beautiful hack, and to me one of the neatest aspects is that it comes to us from a Japanese Mac fan.

Rumor has it that the Mac is starting to get a following in Japan. If true this will bring a new rush of invention and creativity to the platform.

Google Desktop Search bites the dust

I've posted frequently since January 2005 about various approaches to full text search in Windows XP in general and Outlook 2003 in particular.

My test environment is harsh. GBs of Outlook PST files. GBs of documents. Machine never rests. Hard drive always on the edge of meltdown.

The best solution, by an order of magnitude, was Lookout for Outlook. Fast, stable, and the bugs are manageable. Alas, it conflicted with some other Outlook Add-Ins (that environment reminds me of DOS TSR hell). Lookout also doesn't work in Outlook 2007 and it's definitely not supported anywhere, so I thought I needed to change. That was probably a mistake.

I used Yahoo Desktop Search for a while, but it was increasingly buggy and Yahoo finally abandoned it. It reverted back to X1 but it was even buggier when I tried their version.

Recently I decided Windows Desktop Search was my only option. It was slow and sucked performance, but it did all I needed and it incorporated Lookout's search syntax (see the help file). Unfortunately, my work machine has been possessed lately.

I'd removed about everything I could think of to try to stabilize my system, so it was time to remove WDS and try the only remaining contender Google Desktop Search.

Yech. This is what I wrote when I uninstalled it:
... I don't have enough control over indexing behavior. I don't have enough search syntax control - esp. for outlook tasks vs. email search. It was WAY slow to do a search against my multi-GB Outlook archives. It doesn't treat folders as first class search objects...
So now what do I do? I could buy a MacBook Pro and run XP in a VM, but Spotlight won't search PST files.

I need full text search - esp. of PST files.

I'm going to try Lookout again; I've gotten rid of most of my Outlook plug-ins / add-ins anyway.

Gee whiz, I miss my home OS X machines. I know people complain about Vista, but I'm not a great fan of any Microsoft products at the moment (though my problems, to be fair, may be hardware related). Even my beloved Windows Live Writer is buggier at the 1.0 release than it was in the last two beta versions!

Update 11/16/07: Joe Cheng (see comment) noted I hadn't submitted my WLW bug reports. They're really not awful, but they stood out relative to the perfection of the last beta. One is certainly a bug -- the category/tag names can be truncated randomly (last few characters are missing). The other two I need to prove are really bugs, which is a bit tough since my Dell laptop is definitely flaky.

I'm going to be more careful going forward about what I call a bug ...

Update 11/16/07b: The regressions (bugs) will soon be history. In the meantime don't use the Post to Weblog as Draft feature with Blogger.

The real iMovie '08 is Final Cut Express 4

iMove '08 should have been called iClip 1.0. It clearly wasn't an upgrade from iMovie HD, it was a new product.

At the time I wrote:

Gordon's Tech: Apple's iClip 1.0 (iMovie '08) shaft: what they should have done

...The honorable thing for Apple to have done would have been to provide iMovie HD users with an upgrade path to Final Cut Express (which might also require some updates to FCE, I'm not sure how serious Apple is about that product)...

Well, Apple didn't do the honorable thing for iMovie HD users, but the new Final Cut Express is out. Users of iMovie HD should probably forego the iLife 2008 update and buy FCE 4 instead.

I'd give them points if they were to provide a $100 upgrade path for users of iMovie HD, but I admit that would pretty hard to police. The new product is $200, so heavy users of iMovie HD will probably pay up.

Safari 3: very cool tech

Safari 3 is even more impressive than I'd realized: Surfin’ Safari: Ten New Things in WebKit 3.

Faster - esp. JavaScript. Less memory. More capabilities. Fewer bugs. SVG support (not fully optimized).

I'm going to test it with Blogger and Google Docs, Safari 3 beta didn't work too well there.

OS X 10.4.11: Macintouch reports and an update procedure

My policy on these bug fix updates is to wait a few days and check both the Macintouch Reader Reports: OS X 10.4.11 and the Apple Discussion List.

I follow a simple subset of Gruber's update procedure:

  1. Download the full cumulative update from Apple's site.
  2. Shut down and disconnect all external drives.
  3. Restart into my admin account (very plain account).
  4. Install update, don't run anything until it's done.
  5. Restart into my regular account.

I don't do an extra backup but I do check that my nightly backup completed correctly. If I'm feeling paranoid I do a test restore of a single randomly selected file.

There has been a longstanding bug with Apple's Updater (note, however, I have removed unsanity's application program enhancer from all my machines). There's a low but non-zero probability that it will botch an update; the probability rises sharply if you're doing anything during the update process or if another users is logged on at the same time. The restart reduces that risk substantially, as does the plain admin account.

I don't repair privileges. Everyone I read feels that's pointless.

Since I have no recognized problems with OS X 10.4.10 I'm in no great hurry to update*.

*iPhoto 7.1 is crashy. I hope the combination of 10.4.11 and iPhoto 7.11 will help.

Update 11/15/07: Some hints in Apple's release notes and user experiences suggest 10.4.11 may have the same trouble with input manager hacks (application program enhancer mostly) as 10.5 has. I recommend checking for APE as described in the APE uninstall guidelines. Then uninstall it.

After the update, if you absolutely can't live without APE, do your research prior to reinstalling the very latest version.

Tuesday, November 13, 2007

Bento and the iPhone

FileMaker has discontinued FileMaker Mobile
As of the end of the business day, December 19, 2007, FileMaker, Inc. will no longer sell FileMaker Mobile.
That's a serious drag, because a database client for the iPhone is one of my high priority requirements.

On the other hand, FM has introduced the mysterious 10.5 only Bento "personal database" app:
Meet Bento — Learn More

... Bento is designed exclusively for Mac OS X 10.5 Leopard. It takes advantage of many of the new features of Leopard, including live linking to iCal data, core animation, advanced find, Time Machine backups, and multimedia features...
So will there by a companion iPhone application for Bento?

In the meantime, I'll be holding off on FileMaker updates. In fact, I'll be holding off on all Apple purchases until I see the iPhone SDK and the rumored major iPhone update in Feb 2008. Apple's strategy is simply murky ...

Safari: Ok, you win

I really thought Safari's web rendering engine was doomed, though I noted some caveats.

Ok, so even I can be wrong. Yes, I still use Firefox (kind of got away from Camino, though I use it on slower machines), but clearly WebKit is a winner.

The iPhone has established WebKit compatibility as a must-have for most web sites, but the use of WebKit in the Android platform has finished the deal.

This is from the Safari WebKit blog:

...Many of you have seen the announcement of the Android Mobile Platform (www.openhandsetalliance.com) followed by today’s release of the SDK (code.google.com/android). We (Android) were happy to highlight the use of the WebKit engine as the rendering core for Android’s browser. We have been working on our mobile implementation of WebKit for quite some time. A few changes that we made to WebKit, which make it more suitable for mobile devices, have been submitted to the Tip Of Tree prior to the release of the SDK...

Another interesting change we made, which is not mobile specific, was to make the canvas tag platform independent. Again we are working on migrating this to SVN.
Most changes made to WebKit are clearly identified with a #ifdef ANDROID_[feature name]...

Canvas is the drawing environment for applications in WebKit. Knowing little, I think of it as "QuickDraw for the web".

Making Canvas "platform independent" sounds interesting.

Anyway, sorry WebKit. I was wrong, you were right.

If Google changes their Docs and Blogger sites to work better with Safari, I might even switch back. (Safari editing in Blogger causes a tag mess in the output.)

Update: See the comments for a persuasive explanation of what Canvas does and it's relation to Quartz. I'd been using "QuickDraw" as a metaphor rather than a technology, but it's very nice to get more background.

Incidentally, I write this blog primarily as a way to create notes for my own learning and reference, and secondarily as a way to "give back" to the net. I get enormous help from people who share knowledge freely, this blog is a small way to share what I know, and sometimes what I think (I mostly put opinion elsewhere).

I assumed readership would only come incidentally, as the result of a Google Search to solve a specific problem I'd written about.

Somehow, for reasons that are unclear to me, I seem to have acquired some rather knowledgeable readers. It's an unexpected pleasure.

Sunday, November 11, 2007

Lunarpages: a sign of the end-times for low end hosting solutions?

My blogs are posted through Google's Blogger, and they've been very reliable for months.

My older web pages however, and several domains, are hosted by Lunarpages. Lunarpages is a low-end to mid-range hosting provider with an above average reputation. I've used them for years and I've been reasonably satisfied.

They're not doing so well lately. They've been down 3 times in the past 10 days, and they've been offline all day today. Only their forums are working. Even several Google Apps domains, where Lunarpages only does redirects, are unavailable because the redirects have failed.

My guess is it's some kind of denial-of-service attack on their DNS servers. The worst part of it is they're maintaining complete radio silence -- no postings at all on their network status. Since their entire domain is unreachable I think that merits a comment or two.

Google has the technical team and infrastructure to handle a pretty massive BOT attack. Lunarpages clearly doesn't. I wonder if that vulnerability is going to wipe out the low end internet services market -- leaving only the big players.

I'll have to start moving off of Lunarpages. It'll take quite a while, but I'll start by moving my domains to the service Google uses for the Google Apps domains I have. The last step will be finding a new home for my legacy web pages.

Update 11/14/07: It looks like this was two problems. Lunarpages had been failing due to DNS attacks, but the failure of the past week was a routing problem with the service my Hotel was using. I didn't have time to debug the routing problem, so I can't say who was ultimately responsible.

Friday, November 09, 2007

Terrific review of Google Search 2007 - power user techniques

I hadn't realized how much personalization of search results Google does now. No wonder I can find my own blog material so easily!
Biases and Restrictions in Google Search:

...5. If you don't like Google's personalized results you can log out from your Google account, disable the Web History service or turn off the personalization bias by adding &pws=0 to Google's URL. Note that the parameter is not persistent and it only works for the current search.

6. To restrict your search to the high-quality (?) web sites included in the Open Directory Project, you can append &cat=gwd/Top to Google's URL or perform your search at Google Directory...
There's lots more. It's definitely worth studying this and keeping a link to the reference.

I tried the &pws=0 parameter when searching for my own stuff, and it was neat to see the search results change. It wasn't a large change, but in general my stuff moved down the main page one step.

XP Demotion: from Administrator to Debugger User

My corporate Dell laptop has been behaving badly. As far as I can tell, it's possessed.

Today our noble and long suffering sysadmin took a look at my privilege settings.

The one local and two network admin accounts on the Dell had been switched to Debugger User. Apparently, it's going around the office.

As of 11/09/07 a search on Microsoft's site doesn't turn up any useful explanation. The current theory is that it's a .NET bug.

The way the security privileges had been reconfigured should, in theory, work. It's not, however, standard.

Anything that's not standard in XP is in the danger zone - and it's getting worse. My best guess is that Microsoft has stopped seriously debugging XP, and every security update and/or installation of new Microsoft software drives XP closer to entropic collapse.

Vista SP 1, not coincidentally, is starting to look better.

I am tempted to buy a MacBook Pro for the office and run Outlook and Access in an XP VM. I could use OS X for all my other tools, and if the system started misbehaving I'd delete the VM and restore from backup...

Thursday, November 08, 2007

Phil Bradley's Top 10 Useful Web Tools

A terrific list. I use many of Phil's choices, but Netvibes and PageFlakes are new to me:
Phil Bradley's weblog: Top 10 Useful Web Tools from Pandia:

...Netvibes is their preference for a start page. I use Netvibes as my backup system on Internet Explorer, but I'm very firmly in the PageFlakes camp here. More flexible, better options, easier to use, larger user base ...
I use Picasa Web Albums instead of Flickr -- though lately Picasa WA has really been annoying me. Otherwise I'm aligned with Phil in all tool choices.

Fixing a broken Windows XP Remote Desktop Connection install

This was so much harder than it should have been.

My home copy of XP Pro no longer had a Program shortcut to Remote Desktop Connection. It wasn't in Programs\Accessories\Communications or anywhere else I could find.

On the other hand RDC was installed. I tried reinstalling from the XP CD (see help for XP) but it said a newer version was already in place.

I tried looking for a way to uninstall RDC thinking I could then reinstall and retrieve my shortcut - I couldn't find any way to do that.

I tried searching my hard drive for the file and navigating windows folders, but I couldn't find it.

Eventually I found Remote Desktop Connection (Terminal Services Client 6.0) for Windows XP (KB925876) and installed that. It went well, but it didn't create a favorite/shorcut!

Well, it turns out that c:\windows\system32\mstsc.exe is the remote desktop client (tsc probably stands for terminal server client).

Isn't that pretty bloody obscure.

So I created a shortcut to that and now everything is fine. Presumably I accidentally deleted the original when cleaning up my start folders (specifically, I moved a lot of stuff out of the "all users" folder to protect it from the children).

How did I figure this one out? I had to find another XP machine and identify where the shortcut went on that machine. There was no other way.

Incidentally, mstc.exe has some very obscure command line options:
Parameters

ConnectionFile : Specifies the name of an .rdp file for the connection.

/v:server : Specifies the remote computer to which you want to connect.

/console : Connects to the console session of the specified Windows 2000 Server.

/f : Starts Remote Desktop connection in full-screen mode.

/w:width /h:height : Specifies the dimensions of the Remote Desktop screen.

/edit : Opens the specified .rdp file for editing.

Remarks ...

.rdp files are stored for each user as hidden files in My Documents.
When I use RDC on a dual monitor setup, full screen mode is limited to the size of my primary monitor. I wonder if I could use the /w and /h options to set it to the size of my larger secondary monitor ...

Searching: Google and Yahoo are very different from Microsoft

Today a quite heavily used and very senior Mac site noticed that almost all their search referrals come via Google:
TidBITS Inside TidBITS: Google Used 70 Times More than Yahoo:

... What could possibly account for Google's utter dominance in our statistics? I know the crawlers come through all the time, and indeed, searching Yahoo and the others for the same keywords used in the popular Google searches brings up our articles. Do users of Yahoo and the others just not like us?
Very strange. My first guess is that Google Analytics has a bug in it, but that would be one heck of a bug.

In any case I'm posting on this because I noticed something curious the other day that could be related.

I used the search string "Gordon's Tech" on Microsoft Live Web search. My blog didn't appear anywhere in the first few pages. Oh well, I thought, I can just type the URL. I have no delusions of fame after all.

On impulse though, I tried "Gordon's Tech" (phrase search, so with the quotes) on Google. The blog is the number one result. It's also, for that matter, the number one result on Yahoo (albeit with an older URL that still works).

I don't think this accounts for the TidBITS oddity, but it is a worthwhile reminder that Microsoft's search results can be very different from those of Google or Yahoo. So if you don't find what you expect on Google, try Microsoft.

Of course you can guess which search engines I approve of.