Showing posts with label W7. Show all posts
Showing posts with label W7. Show all posts

Sunday, March 12, 2017

Escape from Outlook Notes - export as text files, import into NvAlt or other

Back in 2010 I wrote Gordon’s Tech: Escape from Outlook Notes - ResophNotes, Simplenote for iPhone and Notational Velocity.

Seven years later ResophNotes, Notation Velocity (I now use nvAlt), and Simplenote are still around — despite lack of a revenue stream for any of ‘em. Not only are they still around, but it’s still possible to keep notes in plain text or RTF — which is as future proof as computing gets.

They are still around — but not in great health. ResophNotes was last updated in 2012 or so and it is donation ware (always was). Simplenote was purchased by Automattic (WordPress) and is now open source and apparently run as some kind of charity operation [1]. nvAlt is ancient but Brett Terpstra recently updated it to run on Sierra (a notoriously buggy version of macOS).

These apps are old and kind of worn — but so am I. So we’re a good fit. 

Recently I had another set of Microsoft Outlook Notes files to move to Simplenote. Talk about old and kind of worn! Outlook Notes is old, odd, and useful. It’s a winner in a category of one. Functionally it’s a lot like Simplenote — though you can’t print from Outlook [2].

The problem with Notes isn’t that it’s old and odd, it’s that everyone has given up on it. Microsoft tries to make it invisible. Apple dropped support for Notes sync via iTunes/iCloud — though I think Exchange sync may still work. Google ignores them too.

Which is why I needed to again move a data set of out Outlook Notes. I think export to Outlook CSV them import to ResophNotes is still the best bet. From there to Simplenote and from Simplenote to nvAlt, etc.

There’s another way to go though. You can use VB to script export from Outlook to c:\notes:

Sub NotesToText()
    
Set myNote = Application.GetNamespace("MAPI").PickFolder
  
For cnt = 1 To myNote.Items.Count
        
noteName = Replace(Replace(Replace(myNote.Items(cnt).Subject, "/", "-"), "\", "-"), ":", "-")
        
myNote.Items(cnt).SaveAs "c:\notes\" & noteName & ".txt", OlSaveAsType.olTXT
   Next
End Sub

The key thing is this script creates file names with the note title. It’s not a perfect result because the top of each file looks like this:

Modified: Thu 1/12/2017 2:36 PM

accidents and injuries

In this case ‘accidents and injuries’ becomes both the file name and the third line of the note. The “Modified: …” bit is just annoying. I suppose it could be removed using regex and a text editor that can iterate over a set of files … or script the removal.

I imported the plain text notes into nvAlt where they got the title from the file name so it looks something like this:

accidents and injuries

Modified: Thu 1/12/2017 2:36 PM

accidents and injuries

A bit of redundancy in there, and, of course, the Modified string is still around.

Overall this doesn’t work quite as well as the ResophNotes method, but it’s helpful to have options.

- fn -

[1] Automattic recently released a redo of the macOS Simplenote client. I haven’t tried it, but I hope it fixes the perennially broken search of the current client. In any case, Simplenote is not dead yet.

[2] Outlook 2013 broke Notes by essentially removing the list view — I think this might have been fixed in Office 365.

Update 3/13/2017

Speaking of ResophNotes, the current version has an impressive set of import options. Outlook CSV, Toodledo Notes CSV, text files, single file with note separator …

ResophNotesImport

I donated years ago, time to send another donation.

Thursday, November 13, 2014

Force Chrome to remember iCloud password - how I ended up with LastPass

I don’t use iCloud for much - Apple’s cloud functionality is almost as lacking as its reliability. Our family has used Google Calendar for 7 years [1], I use Simplenote and nvAlt [3] as an information store, Gmail for email [4] and Toodledo/Todo.app for tasks. [5]

That leaves Contacts in Apple’s badlands — they’re too tightly coupled to iOS and OS X to readily migrate. So Contacts are the only bit of iCloud I use; I have to admit that they have been relatively reliable.

Hang on — this does get to the part about forcing Chrome to remember an iCloud password. But first I need a bit of setup. I have to explain something about corporate life and personal data.

Fifteen years ago many employees mixed their personal and corporate data on business laptops and workstations. It wasn’t unusual to use a single email for both work and personal use. Ever since then the two worlds have been dividing - driven by legal and security concerns. Even thumb drives are encrypted on insertion now; data on the increasingly locked down corporate laptop belongs to the corporation.

Which is fine for email and work documents - they should belong to my employer. Contacts though — they’re a problem. They don’t divide neatly between work and personal — and my work Contacts are pretty important for my future employment and family food. So, when it came time to decide where my Contacts should live, I moved them entirely into the personal sphere.

Which is why I need to use a corporate browser (Chrome [6]) to access iCloud — that’s where all of my Contacts live. I need ‘em when I work. 

Ok, so we’ve established I need to use Chrome to access iCloud. Now the problem — it makes me enter my password way too often. And my passwords aren’t easy to type or remember. There are extensions that once forced Chrome to store this password, but they don’t work any more.

So today I broke down. LastPass has a freemium model for online credential storage; the web app and Chrome extension are free. (LastPass charges for mobile services.) Unlike 1Password, which I use on iOS and OS X, there’s no need to buy a Windows client — and I don’t want to put all my credentials in the Cloud anyway. So I signed up for free LastPass, and created an account with a single stored credential - my iCloud ID and password.

It works fine. So one of my longstanding annoyances has been fixed — I can quickly bring up iCloud Contacts.

- fn - 

[1] Calendars 5.app is essential for the Google Calendar power user — we have it on every phone [2]. My native iOS Calendar syncs to my corporate calendar, Calendars 5 reads the iOS calendar database so it appears inline with my other 17 calendars, including 1 for each family member and one ‘all family’ calendar. Our family grandfathered into free Google Apps accounts, but if we didn’t I’d probably pay for the business service. Free has been nice though.

[2] It’s $7 a user. Since it’s not funded by in app purchases I believe iOS family sharing would allow one purchase to support five users. If it did use in app purchases that wouldn’t work. FWIW we still share a single Apple Store only AppleID, I use a different AppleID with iCloud.

[3] nvAlt is in maintenance mode for now — but so is Notational Velocity. Brett has a commercial replacement in the queue, as of today “it’s amazing and will probably be released”.

[4] Google’s broke Gmail usability with their last UI redo. I use Mail.app on iOS and sometimes Airmail on Mac, but mostly I gnash my teeth and weep and use Gmail.

[5] Nobody would do this by choice. Is a legacy choice.  Works and I hate to change things that work.

[6] The corporate standard is IE 9 — thanks to legacy apps. So IE for corporate apps, Chrome elsewhere.

Thursday, June 27, 2013

Indexing Freemind documents for Windows Search: just add extension as free text

There are a lot of software domains that disappoint me. It's a 'get off my lawn' kind of thing. Enormous excitement about cosmetic changes to iOS 7, but nobody cares about applications for knowledge visualization. Sob.

Sure, there are some good apps for OS X [1] (though even they lack innovation [2]), but my work day is spent in the software desert of Windows 7, a forgotten platform served only by minor vendors slowly degrading once half-decent products.

On the Windows 'mind mapping' front MindManager is expensive, increasingly slow and burdened by feature cruft, and locks data up in a proprietary format. I liked XMIND for a while, but then a software update slowed it to a crawl. It also seems to have been abandoned.

So, lately, I've turned to FreeMind. Not because it's open source and free, not because there's ongoing development, and definitely not because it's a Java app or "cross-platform". I've turned to Freemind because, despite being homely [3], slow to launch, and having an eclectic UI, it has users, performs quickly when it's running, and, above all, it has the closest thing to a standard file format in the industry. A file format that's plaintext.

More and more, I love plain text.

I think I can live with FreeMind -- but only if I can retrieve documents using Windows Search. I live and die by free text search. I took a look at the FreeMind IFilter ($20) for Windows Search, but I was unimpressed with the klunky install and configuration requirements. It had a bad smell.

Fortunately, there's a simple workaround. FreeMind .mm files are plain text (did I mention I love that?). All I had to do was tell Windows Search to index .mm files as free text:

That worked.

[1] I'd love to see OMNI Group enter this market, possibly building on OmniOutliner. I use MindNode on OS X.
[2] Rereading my 10/2011 idea for implementing a graph app atop simplenote nodes I'm sad nobody has done this. If I lose my job maybe I will.
[3] Worse than homely, FreeMind currently has a major usability problem. There's nothing in the UI to tell you that a node has collapsed children. It's quite weird.

Tuesday, March 12, 2013

Tools for diagramming and sketching on Windows


Windows is a broken and barren desert of malware and spyware, but I still need to work in it. Alas, I can't switch at work (yet).

So, when I'm looking for better ways to diagram and sketch, I can't choose from the rich world of Mac alternatives, much less from iOS tools. I need something that will work on Windows -- or on a web platform our corporate software doesn't block (alas, Evernote).

I'm working on my options, but fwiw here's a list I'm assembling. I'll update it with whatever I like, while striking out those I've considered and eliminated.

Windows 
  • OneNote 2010: popular, but tied to Office
  • SnagIt Editor
  • PowerPoint: Too awkward to just use for diagrams.
  • Visio: Expensive, clumsy, overpowered, relearning curve with infrequent use.
Web
Mac/Win

Apple's iCloud control panel enables iCloud Contacts within corporate Outlook

iCloud support is limited to relatively new Macs able to at least run Lion. Practically speaking, Mountain Lion.

Apple is kinder to the Windows world. The iCloud Control Panel will run on Outlook 2007 or later on any old OS.

I suppose they don't have the same sales incentives on the Windows platform. In any event, it seems to work very much like the old MobileMe Control Panel, at least when it comes to Contacts. I installed it on a Win 7 laptop running Outlook 2007 that syncs to Exchange Server and I now have full access to my iPhone/Mac Contacts.

It works by creating a new account, separate from the Exchange account. There are few install options -- you have to sync Calendar, Contacts and Reminders (but not Notes). Just like MobileMe [2] (I suspect some shared code). It also creates an IMAP account.

I had some glitches on installation and had to fiddle with restarting both the Control Panel and Outlook 2007, but now it seems stable. I didn't want the IMAP service so I canceled out of the credentials prompt and deleted the IMAP account.

There's no way to turn off Reminders, so I now sync my iPhone reminders in some puzzling ways -- basically via ActiveSync/Exchange for one set of reminders, via this method for the iCloud set. Weird.

Contacts is what I was interested in and it seems to work. Since Outlook allows only one Group per Contact, and iCloud allows many [1] there are potential problems related to Group assignment. In the case of MobileMe this didn't seem to break anything.

It's great to have all my Contacts at hand, and to able to quickly add to them. As an extra bennie, I get to use Outlook's Contact views. They are old and complex, but they are far more powerful than anything Apple gives me.

[1] Group relationships are kind of messed up between iOS and OS X, but Apple has bigger problems.
[2] At one time MobileMe Control Panel could work with Outlook/Exchange, but then it coulnd't -- which made things hard. This version can, perhaps because it creates a new local account.

Tuesday, November 27, 2012

Windows 7 Search: how to display appointment start date in results

Windows XP full-text search was a back-ported version of Windows 7 search. It was a regression from Lookout (Microsoft Acquired) but an improvement on Windows Live Search. The UI adapted to the result type, so Appointments showed different attributes than Contacts or Files.

Windows 7 Search is another regression, and a big one. When I hit Windows-F for example (only way to really use it), and use Details view (best view), my Outlook Appointments (meetings, etc) show with 'modified date'. That is not particularly useful.

Fortunately there are workarounds. I don't think they are well known, even after I figured this out I couldn't find any posts on this.

One work around is to switch from Details View of search results to Content View (control is a drop down in the explorer bar - right side). Content View shows attributes appropriate for the data type. Enabling the preview bar and you get something like the XP search interface - albeit without column sort or sub-search and, inexplicably, some standard objects can't be previewed on my machine (tasks?).

Alternatively stay in Details View, but right click on the columns (Name, Date Modified, etc). This will produce a very long list of attributes/columns that can be added. For appointments you want "Start date" and "End date" (if you don't know the name, good luck finding them). You can change sort order. You can add selected attributes for other items of interest. The result for many searches will be a sparse matrix, but you can sort by the columns of interest.

See also

Saturday, September 29, 2012

Missing Windows 7 User Folders after restore from backup (Retrospect Professional and ?)

I don't think this is a common problem, but unanswered questions found in my failed Windows 7 searches suggest it's not rare.

I ran into the problem after my corporate laptop died. This happens fairly frequently, I suspect the encryption software we use great increases the risk of unrecoverable errors resulting in effective drive failure.

Since I was traveling I knew I'd lost a bit of work, but fortunately my notes were still on paper and I run my own automated office backups [1] using Retrospect Professional (Retrospect Windows now). I was a bit nervous though, because I consider backup to be an unsolved problem. Even though I do a test restore to my system every few weeks I still don't trust my backups.

Despite my worries the restore went well. In an hour or two I had 30 GB of Windows 7 data I could access from a workstation while I waited for my laptop repair.

Except ... I couldn't see my User Folder (ex: User/jgordon). I could see other folders, but not my User Folder (where most of my data was).

I knew my files were there, something was taking up 30GB of storage. Retrospect could see the files, Windows 7 couldn't. (Later I showed that XP could see them too.)

Hilarity ensued. I'll spare you the details of the fixes we tried including icalcs resets, updating access privileges for all children of the visible container folder, escalated privilege command.com and so on.

The trick was a setting in "Folder Options" that's been around for over a decade, but whose meaning changed @ Windows 7 (Vista). In Folder Options find and and uncheck the "hide protected operating system files" option. Suddenly everything appeared.

Why was this so hard for us to figure out? There were several contributing factors:

  • Google was no help. Even after I knew the the cause of our problem I couldn't find an answer on the net (now there is one).
  • This didn't come up in my test restores because I was restoring to the same User Account I backed up from.
  • This is an old setting whose meaning had changed. In XP, even with this checked, I could see all User Folders.
  • The setting impacts all access, not just Folder Access. So it's in the wrong UI location. The folder was invisible to the command line utilities too.
  • This setting is orthogonal and independent of all user and permission settings.
  • On my own systems I routinely make everything visible, so I'd forgotten that wasn't the default on the workstation I was temporarily using.

Like I said, backup is an unsolved problem. [2]

See also

[1] There's no officially supported way to backup a large personal drive where I work. This is more common in large corporations than civilians could imagine; I have far more robust backup at home than at work.
[2] To solve it vendors would need to design the OS to facilitate backup and restores. Apple did this to some extent with iOS. 

Monday, July 16, 2012

Fixing Outlook's Ctrl-D usability bug - with AutoHotkey

The letter S is next to the letter D - on my keyboard anyway.

That means when my lifelong q10sec Ctrl-S twitch hits, there's a 1/200 chance I hit Ctrl-D instead.

In Outlook Ctrl-S saves an email, but Ctrl-D deletes it - without warning. In the midst of my work my email vanishes.

This is annoying, but I usually catch it. I make a trip to the Deleted Items folder and drag the email back to Drafts. The other day, however, I was multitasking and didn't notice I'd deleted my email. It wasn't in the UI, it wasn't in Drafts, I probably assumed I'd sent it. Later I emptied my Deleted Items folder (because, by default, Microsoft's slightly daft Search tool includes Outlook Deleted Items, I keep that folder empty).

The email was gone. Minor panic ensued the next day. Fortunately I realized the email was lost, so I responded with an apology rather than being obnoxious.

I resolved to fix the bug. I found very little on the web, really just this one unanswered question: Ctrl-D del adjacent to Ctrl-S save. Either this afflicts very few people, or most don't realize what's happening.

So I asked on our corporate social network (Yammer) and a colleague gave me the answer. He wrote me an AutoHotkey macro that swallows the Ctrl-D key when Outlook is running.
;-------------------------------------------------------------------------------------
#ifwinactive ahk_class rctrl_renwnd32
^d::
return
It works!

Since I grew up on TSRs (if you don't know what that means then you are blessed in more ways than one) so I try to avoid system hacks like this, but Outlook's Ctrl-D bug has broken me. Since I've signed up, I now need to find other ways to use this utility...

Friday, September 30, 2011

Consolidating Contacts: From Outlook to Address Book via MobileMe and the 5th Circle

This option is, for now, only open to the few people who have MobileMe accounts. Maybe iCloud will add something like this. I'll pass it on for the record.

The time had come to consolidate my work and personal contacts. No, I'm not changing jobs. A change in work policy meant I could no longer sync my iPhone to Exchange. I need my work contacts on my iPhone to do my job, so I needed to consolidate.

This is what I did. I bit imperfect perhaps, but it was reasonably fast.

  1. Using Outlook 2007 at work I copied all my Contacts to a PST file. That copy action makes Outlook resolve Exchange format email into standard email format. Took the PST home.
  2. Use Address Book export to save an archive. Turned off MobileMe sync on all machines. Put iPhone into Airport mode.
  3. Started up my VMWare Fusion XP with Outlook 2007 standalone. Using MobileMe on XP I did a sync to MobileMe.
  4. In Outlook 2007 standalone I imported the PST file Contacts (1012 items) from the external PST file into a new subfolder of Contacts. I then did another sync to MobileMe.
  5. Switched to OS X then turned MobileMe sync back on. It said there were 1007 (not 1012) items to install. When it was done, there 1002 "cards" in a new "Group"

Note that, at face value, I lost 10 contacts during the import process. However, Outlook still showed 1012 even after I repeated a sync there. It's mostly likely 10 contacts won't sync, but it's also possible Address Book does some kind of duplicate merging on import -- but doesn't add the correct recreate Group-Name relationship.

I then ran Contacts Cleaner from Spanning Tools (App Store, cheap). It found 635 "conflicts" (issues, really), of which a surprisingly small number were duplicates. I set to work cleaning that up (Contacts Cleaner has an annoying habit of flagging academic suffixes as "bad".

After an initial cleanup I went back and forth between OS X and XP/VM, each time repeating a sync then running Contacts Cleaner. It only took a few minutes to find problems and settle things down.

Some data is lost of course. Sync must have its price. I made liberal use of 'Categories' (now we'd call these 'tags') to slice and dice my Outlook Contacts. They are all gone now. That is sad.

On the other hand, OS X allows a Contact to be associated with more than one Group. I can make use of that. It's too bad MobileMe Sync didn't try to turn Categories/tags into Groups. (And too bad you can't edit group assignments on an iOS device!)

There was only one funny thing. I've seen this once before. I created a Smart Group for all Cards that had no Group assignment. Over 1,000 showed up unexpectedly. I quit and restarted and all was well. It's a good idea to quit and restart Address Book after a large update.

Once I had things sorted out between my XP and OS X sources I turned on my iPhone and let it reconcile to the new addresses. I found some oddities on searching while Spotlight sorted out the additions.

The iPhone sync added more duplicates! Yes, Synchronization is Hell. I'd almost be disappointed if it weren't.

Back to Contact Cleaner again and I returned to 1805 total contacts. Even so, I readily found a contact that wouldn't sync to my iPhone. I made another backup of my Address Book.

So I turned off MobileMe Contacts sync. That should have removed all Contacts from my phone, but quite a few remained. I had to remove my MobileMe accounts and add it back. Yes, even though we've yet to develop artificial sentience, we have developed artificial dementia.

All were back on my iphone, but we were back to 1043. Clearly, we had a problem. I removed more duplicates but ended up with only 1804. So I restored from backup.

I was in the 5th circle of sync hell, but I've been here before. Call me Dante. I used advanced MobileMe sync to forcibly replace everything on MobileMe with what I had on my home server. I confirmed MobileMe had 1805 contacts, then reenabled Contact sync on my iPhone. Then I forced sync from MobileMe to my other two Macs. At last all showed 1805 contacts [1].

For now. Synchronization is Hell. I don't think iCloud will be any better. In fact, I expect it to be worse.

[1] I'd written previously that Address Book for Lion didn't show a count of cards. It does; you have to scroll to the very bottom of the address (card) list to see it.

Monday, September 19, 2011

Resolving ghost printers in Win7 - delete redundant print queue

My corporate Win 7.64 box had a printing problem. Everything looked fine, but jobs sent to some printers didn't appear.

I was also seeing "ghost" printers -- they displayed in Windows print dialogs, but they didn't show in Control Panel "Devices and Printers".

For example, from the print dialog I saw "biz-c1" and "biz-c1 (copy 1)", but from the control panel I saw only "biz-c1 (copy 1)".

I think this glitch came from running an XP or 32 bit Win 7 printer installer on a 64 bit machine.

The printers that had this problem had an extra context menu entry "delete print queue". After a I deleted the "older" (non-copy 1) queues this context menu item disappeared! (Google was no help, this was my closest hit.).

The transient "delete print queue" menu item worked to fix the print dialogs. They again show a single queue. Even better, my printing was restored.

I assume this is a bug in Windows 7 that Microsoft knows about. There has to be a reason that the "delete print queue" option appeared on printers that had a redundant print queue. It's odd that it's not better documented however.

Thursday, July 28, 2011

Restoring an XP backup (.bkf) file in Windows 7

Based on a long history of problems with copying GBs of data over the LAN, I decided to move my data from a corporate XP box to a Win 7 box using XP Backup. That old utility is stone simple, but for me it's been fast and reliable.

I mounted a share on the W7 machine then ran backup to put every bit of my old machine into a .bkf file on the new machine. From there I'd unpack at leisure. In a month or so, once I'm satisfied I've not lost key data in a crevice of XP, I planned to delete the .bkf file.

Naturally, I did a small test first.

Obviously, or I wouldn't be writing this, the test failed. Windows-7 no longer supports restores from XP backup files.

I was open mouthed. This is the sort of middle-finger gesture I'm used to getting from Apple. Whatever their many, many faults, Microsoft has always been kinder to data. The formats are usually proprietary, but at least they're supported.

I couldn't believe it, so I looked further.

Happily, my faith was justified. You can now download a Microsoft Win 7 utility that will restore from a .bkf file. Description of the Windows NT Backup Restore Utility for Windows 7 and for Windows Server 2008 R2. It worked for me.

Tuesday, September 07, 2010

Operators in Windows Search and Spotlight - Common and Similar

This is a narrowcast post. It's of interest to someone who ...
  1. Is a serious geek.
  2. Has to routinely find things in very large document and email collections.
  3. Uses both Windows Search (built into Vista/7, add-on for XP) and Spotlight for OS X.
If you're still reading we need to go out for a beer the next time you're in MSP. There are only 2-3 like us on earth.

In an earlier post I discussed operators in Spotlight. When I first posted I complained about the difficulty of reconciling Windows Search operators and Spotlight operators. It's tough enough to learn one set, but learning two is kinda painful.

My first impression was wrong though. It turns out that several operators work in both Spotlight and Windows Search. Below is a list of common operators, followed by a list of differing operators and conventions. I'll update both lists over time. I'm only including the ones I use, there are many more.

Common operators (work in both Windows Search and Spotlight)
  • author:
  • kind:folder
  • kind:contacts
  • kind:email
  • kind:music
  • date:>7/4/1776
  • Boolean rules with parens (AND, OR, NOT)
Differing operators (W|S)
  • Windows uses () to contain phrases, Spotlight uses quotes
  • kind:docs | kind:document
  • not available | kind:application
  • modified:3/7/08..3/10/08 | modified:3/7/08-3/10/08 (hyphen might work in Win)
I think Windows Search accepts a number of variations, so I'm going to try more OS X Spotlight operators and syntax with Windows Search and document what works. Even now, however, it's impressive how much commonality there is.
--
My Google Reader Shared items (feed)

Saturday, September 04, 2010

VMware Virtual Machines - the backup problem

It's times like this that I really miss Byte (or BYTE?) magazine. They would have had great coverage of VMWare VMs - how they work, and what the risks are. Now that's specialist knowledge. Knowledge that, when I use Google, is obscured by a haze of marketing material.

The best we non-specialists can do is share our limited experience in blog posts, like this one sharing my experience with VM backup. That's been a problem for me.

First - my experience. I've used VMWare Fusion on my Macs for a few years. I need it less than once a month, typically to launch XPSP4 and run Access or (yech) Quicken. On the other hand, I configured and use a VMWare Workstation on a 64bit Win7 machine at work. That VM is running a Windows 2003 Server environment with terminal server and I use it very frequently.

Both my Fusion and Workstation VMs are configured to store the VM data as many files rather than a single monolithic file. Both are about 80-100 GB in size and store as little of my data as possible; on the Mac the individual .vmdk files vary in size from about 200 to 500 MB. I don't have the Workstation VM at hand but I think its files are all a fixed size.

The host OS X machine is backed up using Time Capsule (sigh) and SuperDuper! (sigh). Neither give me the warm fuzzies of Retrospect at its best. The Windows 7 machine is backed up using (Dantz -> EMC -> Roxio) Retrospect Professional.

I configured both VMs to use multiple files because of the VM backup problem I knew about.

The obvious backup problem for these machines is that if you configure a VM as one monolithic file, then every time you touch it the host system backup software has to backup a 100GB backup event. That will overload Time Machine (Capsule) or Retrospect pretty quickly. (More sophisticated backup software can manage this differently, but I don't think TM or Retrospect can.)

That's why I went with separate files. Backups would only have to manage the files that changed. (Ahh, but how does the backup software know what's changed - esp. if the files are a fixed size?)

I think that approach does work when the VM is shut down. I think it works on my Mac. It doesn't work with Retrospect Professional on the Windows 7 machine where our VM is always running.

I learned that the hard way when we tried to do a restore. The restored VM seemed good at first, but it was soon clear that we'd somehow ended up with different time slices. We had to kill the VM. Fortunately, because I'm justifiably paranoid about backup, we also had a file system backup that was only a few weeks old. Since we don't keep data on the VM we lost very little.

This is a nasty problem. As best I can tell, at least on Windows, Retrospect Professional can't do a reliable backup of a running multi-file VMWare VM. The limited VMWare marketing material I could find suggests this isn't just a Retrospect problem. The solution is, of course, to buy their costly backup software. You can also do backup from within the client OS, but that adds a new level of cost and complexity to overall backup. Retrospect Professional, for example, won't install on Windows 2003 server. For that you need their much more costly server backup.

Now you know what I know. If you know any more, or can point me to anything that's not marketing material, I'd be grateful.

I do miss Byte.

--My Google Reader Shared items (feed)

Saturday, July 10, 2010

Retrospect Professional 8 backup of VMware VM corrupt on restore

I've been using Retrospect Professional 8 to backup a Windows 7 machine. That machine has VMware VM running.

There have been no backup errors.

Recently I had to do a restore of the VM. All seemed fine. The size was right. When I ran it, however, the VM was corrupt.

The VM is made up of many large files. I think Retrospect backed some up at different times, depending on metadata changes, file locked, etc. Normally that would be fine, but they all had to be the same version for the VM to work.

Fortunately I had a completely separate manual all-at-once backup done when VMWare was turned off. It was a few days old, but we didn't lose anything significant. Sometimes paranoia is a good strategy.

A cautionary tale! Virtual machine backup is tricky.

Friday, February 05, 2010

Access denied: VMWare Shared Folders on Windows 7

Between Dell machines shipping with motherboard disconnected SATA cables, a Clampi Trojan on my Windows 2003 server, a mysteriously vanished backup [1], Windows 2003 blue screening on a new Dell workstation, a failed Acronis disk image and the horror of 64 bit Windows 7 it's been another fun week in tech.

Today was a bit better. I installed VMWare Player on a 64bit Windows machine and created a 32 bit Windows 2003 VM - giving it all four cores and 3GB of memory. After VMWare tools installed and I enabled hardware graphics acceleration it felt faster than on the prior 3 yo workstation lost to the wretched corporate refresh cycle.

Mostly easy, until I dealt with the second drive in the box. Even after I used shared folders to map to drive E:, and the ancient DOS subst command to assign a drive letter to the shared folder, I still couldn't write to the new shared folder. I could read, but I couldn't delete anything. If I tried, I got an "access denied" message.

Worse, it seemed I could write to the drive, but the data wasn't there. VMWare showed files as having been copied, but in Win 7 they weren't there. On restart the VM didn't see them either.

The fix was to right click the drive letter in Windows 7, choose properties then security, and allow "EVERYONE" full control of the E: Drive. Then Windows 2003 in the VM could read and write.

I suspect there's a less severe fix. After I left work it occurred to me that I should study the read/write permissions on the C: drive. I suspect the vmware_user (__vmware_user__) group has special privileges on that drive, I just need to study them and replicate them for the E: and F: drives.

I'll update this post with what I find.

PS. It's unnerving that my Google searches really didn't turn up anything useful on this topic!

[1] Retrospect Pro backup on external drive. It vanished! Dir *.* and Attrib *.* showed nothing with 325 GB used. Retrospect could find the files though -- it restored from the backup drive.
--
My Google Reader Shared items (feed)

Wednesday, February 03, 2010

Windows 7 is OS X Warp(ed)

One of my work machines now runs Win 7. It’s the first time I’ve had to do more than play with it.

It helps to know OS X, but it also hurts. There’s a lot of stuff in Win 7 that’s a tasteless and ugly version of OS X. Take the desktop themes (please).

Hard to say if it’s really an aesthetic improvement even over XP. The XP interface feels light, sharp and clear by comparison.

Update: For example - "Program Files (x86)". Thousands of Google hits puzzling over that one. WTF were they thinking?

Update 2/4/10: OS X managed a smooth migration to 64 bit. I've had a few days of experience with the Win 7 mix of 32 and 64 bit ODBC, Oracle, Java, Microsoft Office, SQL Developer, etc. It's a train wreck. It brings back memories of early DOS experiences. This 2007 tech doc tells one part of the dreadful story.

Wednesday, July 15, 2009

Stack Overflow now has global computer question site (beta)

First Stack Overflow came for the coders. Then they came for the Sysops. Now the dynamic duo of “Joel on Software” Spolsky and “Coding Horror” Atwood are going for all the rest of the geeks. I’ve joined the Super User beta (how did they get that url?!)…

… Super User is a collaboratively edited question and answer site for computer enthusiasts – on any platform. It's 100% free, no registration required….

Stack Overflow’s children are the heirs to the pre-spam usenet. Experts-exchange is finished.

Fantastic work, and very much appreciated. I very much hope there’s a fortune in it for them somewhere – I suspect there is.

I love these guys.

Tuesday, June 09, 2009

Experiment with VMWare -- for free

I have sinned, but I have seen the light.

Now that I've joined the Church of the disposable image, I need to catch up on some basics. I've been using Fusion and Parallels w/ Windows 2000 on OS X, but the Windows VM world is new to me. So I'll have a few posts on that topic.

Since I've committed to Fusion on the Mac I'm experimenting with VMWare. Their primary end user product is VMWare Workstation, which is inexpensive for academics. This appears to be similar to Fusion on OS X. There's a generous 1 month free trial.

The surprise, however, is that you don't actually need to pay any money at all to do quite a bit with VMs. Both VMWare Converter and VMWare Player are free. VMWare Converter (Windows) will convert an existing machine, such as an XP machine, to the VM format and VMWare Player will execute these images. [Update: OK, not quite! See below.]

This isn't something VMWare markets. VMWare's web site doesn't list VMWare Converter as a possible source for VMWare Player images and even the VMWare Player wikipedia article doesn't mention this.

VMPlayer (Windows) will run their "appliances". -- and more besides ...
... Open Microsoft virtual machines, Symantec Backup Exec System Recovery (formerly called Live State Recovery) images, Norton Ghost 10 images, Norton Save & Restore images, StorageCraft ShadowProtect images, and Acronis True Image images. In this process, the initial virtual machine or image is left untouched in its native format and any modifications are saved in a much smaller VMware-formatted file that is linked to the initial image...
So you can turn your existing Windows environment into a VM and play with it - for free. I think you can also run a VMWare 6.5.2 VM on Fusion but I'm not sure of that.

There are a few VMWare Player limitations, it doesn't enter full screen on startup unless you tweak a setting and it's essentially undocumented. I've also run into device driver issues, I can't see how to install the VMWare tools for example. It's really a bit of a toy but it's free. There's an upgrade mechanism to VMWare Workstation

If you want to download the Win 7 RC .iso file and turn it into a VM without installing it I think you'll need VMWare Workstation -- though if you have VMWare Fusion maybe you could prep it on the Mac then move it to VMWare Player.

VMware Converter comes with lots of documentation. Cough. Actually, it appears to be about as undocumented as VMWare Player. Must be a corporate policy.

I think there are two ways to run Converter - standalone and client server. I did the standalone conversion. I installed it on a machine and directed it to send the resulting image to a network share.

I clicked "convert machine" and followed the defaults. The one place to pay attention is where you're asked to select the target VMWare product. The default is some corporate product, you need to change to "VMWare Workstation 6.5.x".

A reasonably big VM takes rather a while to convert - overnight is typical.

More later...

Update: Ok, now I see the catch. Unless you install VMWare Tools you can sort of use the VMWare Convert image, but you can't go full screen, toggle out of it, some drivers don't work, etc. You can get VMWare Tools from VMWare Workstation, but there's probably a reason VMWare doesn't bundle them with Player. I say "probably" because I think VMWare is rather vague about the whole think. In any case I'll be using Workstation for my further experiments. (You might be able to install VMWare tools via Fusion. I think this is actually legal, since the point of VMWare Player is that it lets you use completed images and if you have a license to Fusion you can can complete them there.)

Update 1/21/2010: I experimented for a while, but I found VMWare on XP much less consumer-friendly than VMWare on OS X. In retrospect that's not too surprising. VMWare/Win is a corporate product, VMWare Fusion (OS X) is a consumer/geek product.