Saturday, October 31, 2015

Time Capsule & Time Machine: "Browse Other Backup Disks" doesn't let you access backups from a different device

One day your iMac dies. It’s old, but not old-old. Sucks. Good thing you are paranoid about backups. You have onsite backups. You have offsite backups. You have Time Capsule backups. You have Synology NAS backups. You have Carbon Copy Cloner “Backups” (clones). You have …

Ok. I’ve made my point. Anyone this paranoid ought to feel good. Problem is, they’re paranoid for a reason. Data just wants to die.

The “you” is “me” and I’m here to tell you that one small bit of my data almost didn’t make it. One folder full of almost-deleted images got lost, I had to pick it up from a last minute copy of the iMac’s user folder. 

I had to do that because when I tried Time Machine’s “Browse Other Backup Disks…” feature (option key)  …

Screen Shot 2015 10 31 at 11 50 45 AM

… it didn’t actually work. That is, I got the right list of disks ...

Screen Shot 2015 10 31 at 11 36 11 AM

but when I selected one of them Time Machine showed me only data from my current Device’s current state — and no past data.

I did this first using a Synology NAS backup replacement for my died-young Time Capsule. I thought I’d run into a Synology limit, but I got the same results from older Time Capsule backups. It turns out that “Browse Other Backup Disks” really means “Browse Other Backup Disks … for the current device”…

 Yeah, I hate Time Machine too. OS X Help has some entries on Time Machine, but there’s no real documentation. There’s nothing on “browse other backup disks”.

So, if you don’t have access to your original mac, you are sort of doomed. That’s what happened to me.

I say “sort of” because there are weak options. You can open the disk image and navigate Time Machine’s base storage. You don’t have access to the File System Event Store or hard links though, so things are hard to locate. EasyFind.app might help. Or you can use Migration Assistant, the official solution, and move large pieces of the backup to a local store (only most current versions of course). Maybe OS X Server has some special options …

You can also try Backup Loupe ($10). It doesn’t replace Time Machine’s time-slice views of data, but it does let you browse snapshots and search for file instances. I’m not sure it’s a big improvement on EasyFind, but I bought a copy for emergency use.

The bottom line? Time Machine is a sucky backup solution — just good enough to eliminate strong alternatives. But you knew that. If you don’t have a machine (Device) that “owns” a backup you can use Migration Assistant to copy the latest state of a large amount of data, or if you know a file name you can use EasyFind or Backup Loupe to browse.

Sure, Apple should fix this. They should fix a lot of things.

"Unable to contact iMessage server": try restoring from iCloud instead of iTunes

I picked up Emily’s SIM-Free [1] 64GB silver 6s from the Mall of America Apple store Friday night. I’d used Apple’s reservation system so that, in theory, I’d be in and out. Alas, Friday night at the Apple Store is a zoo — it still took 30 minutes. The staff were so stressed they didn’t try to up-sell AppleCare or setup a contract — just dropped the box in my hand and ran.

There’s an AT&T store in the MOA and it’s not incredibly busy, so we did our SIM swaps there [2]. My son was going from a 4s to Emily’s 5s, so he needed a new SIM.

I restored both phones from iTunes backups. Emily’s worked, though it was a bit choppy. I had to unlock the phone 1-2 times as it went from 9.0.x to 9.1. 

My son’s restore didn’t work. I completely erased the 5s before starting, but there was still an odd feeling about the way the restore proceeded, perhaps because the 5s was still on 8.x (I didn’t realize it had never been updated).  Yes “odd feeling” isn’t very helpful, but I wasn’t paying that much attention. I’ve been down this road a few times.

Prior to the backup I’d removed iCloud, iMessage and FaceTime from his account, planning to put them on post-restore. I had some trouble restoring iCloud — the phone hung on credential entry. I restarted and it seemed to work — but then iMessage and FaceTime weren’t activated. When I enabled them I got a very cramped non-iOS 9 dialog for entering username and password.

I’ve seen that dialog before. It’s something very old — I suspect it’s hard coded for non-retina screens and dates back to the dawn of the iPhone, pre-iCloud. It’s a bad sign, it exposes Apple’s still broken iOS credential management problems [3]. When I did enter my son’s credentials the dialog hung, waiting for a response. I could kill settings; iOS wasn’t frozen. I let it sit for 15 minutes and it eventually responded with something like “Unable to contact iMessage server”. I don’t think there’s a problem with the iMessage server, I think that’s a misleading error message meaning “something went wrong”.

I called AT&T phone support to confirm the IMEI/ICCID relationship was correct at their end. I’ve had my issues with AT&T, but they must give their support staff very good coffee. They are remarkably pleasant and helpful. AT&T’s configuration looked good.

So either the phone was having hardware issues or something had gone wrong with updating one or more of Apple’s configuration systems. There’s lots of evidence that Apple wants iTunes to “die in a hole”, so I decided to try it Apple’s way. I did an iCloud backup, wiped the phone, and restarted with an iCloud restore.

That went smoothly. During the restore I had my son’s Mac account open for Keychain share confirmation, and I got the usual “FaceTime is using..” dialogs. I didn’t have to enter any extra credentials. iMessage and FaceTime activated immediately.

I suspect the combination of iTunes and iOS 8 to 9 and my removing FaceTime/iMessage/iCloud prior to backup exposed a nasty bug in Apple’s frail authentication systems. The real lesson though is that iTunes backup is seriously deprecated. I’d been moving to all iCloud backup and just doing a manual backup to iTunes every few weeks; that’s obviously the way to go.

- fn -

[1] We are currently AT&T customers, and there’s a case to be made that an unlocked AT&T 6s has the best set of antennae and band coverage for AT&T and even international use. You can’t, however, buy an unlocked AT&T iPhone directly, you have to buy it on plan then pay the plan cost to unlock it. Our AMEX purchase protection and extended warranty only work when the full purchase price is on the card. Hence SIM-Free.

[2] In theory you can move a compatible AT&T SIM from phone to phone yourself, but in practice I’ve seen some odd things. AT&T reps tell me their systems don’t update the ICCID (SIM)/IMEI relationships automatically, or at least not immediately. I think this causes some iMessage/Facetime activation delays.

[3] There are separate credential stores for iMessage, FaceTime, iCloud and the App Store — and perhaps for 1-2 other items. If you migrated from me.com to iCloud.com some of these systems require two sets of credentials. Apple tries to hide this from users, but any number of bugs will expose it.

[4] To fit into the iCloud 5GB limit I routinely delete obsolete backups of old phones and I move Photos.app data to our local machines. I see that with 9.1 there are now more controls on what’s part of an iCloud backup, though they are a bit hard to find.

Thursday, October 29, 2015

File sharing for the all-MacBook home

Lifehacker’s guide to home file sharing was written in 2010 for Windows users. Excluding a traditional server/file share the options back then were Dropbox, a NAS, and, peer-to-peer sync solutions. Things haven’t changed much since then.

Now that I’ve retired our iMac and gone all-MacBook, I need one of those solutions for a small number of files (MBs, not even 1 GB). Our home’s options are Dropbox, Google Drive, Microsoft’s OneDrive, a Synology NAS with or without Synology Cloud Station, Mac LAN based sync solutions (ex: ChronoSync, note MSFT bundles this with Windows), and an Airport Extreme external flash drive.

There are lots of options, but nothing is quite perfect. Dropbox, Google Drive and OneDrive all move our family data into the Cloud — and I’d like to not worry about that. Sync solutions mean new software, but perhaps only on one machine.

I’m going to stick our unused $20 SanDisk Ultra Fit 64GB flash drive in back of the Airport Extreme. I already use Carbon Copy Cloner as part of our nightly backup, I’ll just back the AE Flash Drive up to disk image on one of the my OWC Thunderbolt 2 dock drives. They in turn are backed up by both CCC (to removable drives) and Time Machine (to the Synology NAS).

That should be good enough. Keep it as simple as possible…

Update: oops. "When you use Airport Utility to change AirPort Extreme Shared Disk(s) security it *seems* to wipe out everything on the disk. Except free space shows data is still there.”  The AE has an operating system with some kind of file system support and access controls, but we have very limited access to it.

This Apple article partly explains what is supposed to happen. From Airport Utility we can create username/password “accounts”. Say “Parent” and “Kids”. When a client connects you are asked username/password, that gives access to the Folder of the same name as well as a “Shared” folder. So Emily and I connect as “Parents” and see the “Parents”  and “Shared” folder, but we don’t see a “Kids” folder unless we connect with that username password.

There’s no way for me to connect with to the AE shared disk (partitions?) and see everything.

When I insert the flash drive into my MacBook I can see how it’s organized, including the folders that were on the flash drive when it was “password” access rather than “account” access.

Screen Shot 2015 10 29 at 1 16 43 PM

When I switched “Secure Shared Disks” from “With a disk password” to “With accounts” it didn’t wipe my data, it created a Users folder containing the “Parents” folder and hid the existing folders. I thought I also created a Kids user, but I don’t see that Folder. Bug?

Hmm. This is a bit weird. I could experiment with partitioning the thumb drive on my Mac, but I think I need to look more at the Synology.  The AE’s file sharing security model seems to make backup impossible.

Update 2: I’ll rewrite this when I finalize things, but it looks like the Synology NAS gives me the permission controls I need. I’ll put the shared files there, then use CCC to put them back on an image on my laptop. That image will in turn go back to the Synology NAS Time Machine backup as well as to my local CCC backups.

Update 11/21/2015: I ended up enabling Synology Cloud Station, including installing the Mac client for both Emily and I. So our relatively small (1.5GB) of shared data exists on the Synology NAS (not baked up) and on both of our machines (so multiple backups). It is a strange outcome for the old file sharing/NFS/WebDav model and it doesn’t seem the most elegant solution, but sync seems to be the current technology direction. (Dropbox would be simpler, but we wanted to keep the data local and, of course, Dropbox costs money. The Synology NAS also supports a BitTorrent sync package but the Cloud Station seemed to have more users.

Configuration was a bit odd — you do need to read the documentation. The default setup is within one’s “Homes” folder, so if you want to share with two users (workgroup) you need to create a folder outside that NAS hierarchy and choose to that for sync.

Update 8/23/2016: Synology Cloud Station / Cloud Drive (it has many names) has stopped working reliably with El Capitan. I’ve given up on it. Emily’s MacBook is largely home so I’m moving these files to her machine and making them a file share. Sometimes I won’t have access, but I’ll move some things to a Google Drive we share.

Tuesday, October 27, 2015

iCloud Settings: remove devices, restore some iCloud content (but not Notes)

An Apple World post on El Capitan’s iCloud device management tools led me to check out what iCloud Web Settings supports. It has similar functionality

Screen Shot 2015 10 27 at 8 30 09 AM

From this web UI, as in El Capitan, you can remove devices from your iCloud account — including a machine that’s died or been sold.

There’s also a “restore files” option — the beginning of a backup solution for Apple’s iCloud services. It’s limited to iCloud files, Contacts and Calendars — there’s currently no support for restoring Notes.app files (sadly). I didn’t see any way to accelerate deletion of files — once data goes to the Cloud it is beyond our control.

Restores are all or none — you can’t restore only some Contacts.

Friday, October 23, 2015

Group text on iOS: native functionality and the Contaqs.app alternative (and GroupMe)

Our school mountain biking team has been doing group texting for coaches. Works well on rides — especially when coordinating riders of different skills. 

Yeah, I know the larvae do this. They use dedicated chat apps though, like WhatsApp Group Chat or Facebook Messenger or, much less often, named iMessage groups. We are old and set in our ways, so we need something that works with SMS. (Google Hangouts is said to support Group SMS, with Hangout 4.0, but I couldn’t verify this. Too complex anyway.)

The simplest approach to to send one message to a group, then dig up the thread when desired. You can even name the thread — but only if everybody is using iMessage (never happens). In practice many of us lose the thread.

There’s another approach sort of built into iOS. In OS X or iCloud you can define “Groups” of your Contacts. Bizarrely, you can see Groups using iOS Contacts.app, but you can’t edit Group membership in the standard iOS Contacts.app [1]. You can buy Contaqs.app for $2 and it will do lots of things that Contacts.app should do including editing Groups — and it works with the Contacts database. Or you can use iCloud or OS X to edit Groups and sync.

However you do it, once you define a group you can use it in iMessage as though it were someone’s name. There’s a limit of 10 SMS members however. Worse, a single person can have multiple phone numbers — and every number is used.So this looks appealing but it doesn’t actually work very well. What might work natively, at least for 10 or less SMS names, would be to create a Group composed of 1-n people each with 6-7 numbers each. Say the group is BIKE, and there are five people in it - Mike, John, Bob, Alice, Jim. Define the group BIKE, then create a contact MIkeJohnBob and a contact AliceJim with appropriate numbers. You’ll probably still hit the limit of 10 SMS numbers though.

But it’s not hopeless. It turns out Contaqs.app is pretty smart about this. When I chose my group in Contaqs.app, and select all the members (one tap) then tap SMS, it asks me to adjust the phone numbers for each recipient — and it does intelligent number selection. I was able to create a message for the BIKE group with 11 members, presumably because several used iMessage instead of plain old SMS.

i was able to create it … but not to send it. The message failed; I assume Contaqs.app can’t get around the 10 SMS limit (maybe is US specific?).

We should really use a group chat app that works on Android and iOS, like WhatsApp...

[1] A function we’ve been asking for since iOS 2. I don’t think we’ll every see it.

Update: Richard (in comments) suggested I look at GroupMe, a product launched in 2010 and acquired by Microsoft’s Skype in 2011. He says GroupMe will incorporate SMS users into a group, no app required. That wasn’t obvious from the main page, but in the About page … "Best of all, it works on nearly every phone, via push or SMS” and in support: "You don't need to have our app to use GroupMe. Add anyone from your phone book and they will immediately be able to chat with the group. You can chat with your groups directly over SMS.” SMS costs money, so I wonder if the web site has been revised to downplay the SMS integration. No business model needed since this is Microsoft.

It feels like the echo of another era, back when some phones walked on 2 legs and others slithered. You can do most things just with SMS (I have vague memories of Twitter and perhaps Facebook doing SMS things), and your correspondents don’t have to register or sign up for the app (yeah, you can spam anyone). A 2011 Business Insider article mentioned it alongside Kik; apparently GroupMe was hot once.

Every member of a GroupMe Group sees messages coming from a unique phone number. Which is a clever workaround for the limitations of SMS chat — the phone number you see is a unique identifier (key) for a combination of a Group ID and a member’s cellphone number. When you send a message to that number GroupMe confirms the sending phone (callerid) matches the database record, then GroupMe sends it out to all the other cell number that are a part of the group.

It’s clever, albeit a bit obsolete now, but it’s also quite an expensive approach. GroupMe must have ways to reclaim numbers for reuse ...

Wednesday, October 21, 2015

Macs and external SSD storage - thunderbolt hubs and USB 3 UASP

My 2009 iMac is finally dying. It was my second iMac and my second iLemon. My 2005 iMac had early screen discoloration, overheating, and drive failure — but it survived the capacitor failures that killed many of its generation and it was the almost last Mac designed for user servicing. My 2009 iMac had early screen discoloration, overheating, screen flickering, two drive failures (one under recall) and, now, GPU failure. It’s not user serviceable. Lemon.

So I’m not a fan of Apple’s iMac lineup; I don’t want to buy another one. The Mac Mini is interesting, but the SSD pricing is irritating. The obscure but still sold non-retina 2012 MacBook Pro is an attractive iMac alternative when paired with an external monitor — and I actually prefer two 21" displays to a single 27” display. A refurb costs $829 and it’s easy to add memory to the 8GB max. It even has a Firewire 800 port. Still … 2012. That’s pretty old tech. I could buy another 13” Air ...

Or, I realized, I could not buy a Mac. I could save money and, more importantly, reduce my maintenance hassles. When my Time Capsule died young I bought a Synology NAS [1], I can use that as a file server for the family files. My Aperture photo Library is too large for my MacBook Air SSD, but I can pull my 1TB Samsung EVO SSD from the dying iMac and put it in an (very) inexpensive UASP+ external SSD enclosure (or this one) [5]. Based on past experience Aperture ran pretty well even over Firewire 800 and an external SSD. Emily has her 11” Air, I have my 13” Air, #3 uses her school iPad, and #2 only uses a computer for his school work. He can use one of the Airs — or maybe I’ll buy a disposable $150 Chromebook. [2]

Ahhh. One less computer to update, debug, drag to the Apple store, configure … I feel the warm breeze of a southern sea … [2].

My Air has two USB 3 ports and one Thunderbolt 2, currently occupied by a mini-display port. If it’s replacing my iMac it needs to work with 1-2 external displays, the iMac’s 1TB SSD in a USB 3 enclosure, several USB devices (scanner, DVD), an ethernet cable connection to the NAS and, ideally, my old Firewire 800 external 4TB drive, backup drive cradle, and flatbed scanner. Apple’s $1000 answer is the aging USB-free Apple Thunderbolt display.

Disregarding the obsolete Apple solution, I could go with a USB 3 hub or a Thunderbolt hub. With either one I’d like UASP Support [3]. The Vantek UGT-AH700U3-2C USB 3 hub is said to support UASP on a Mac; Wirecutter’s favored Anker hub didn’t in 2013 (though it might with newer chipset, wire cutter missed this important criteria in their review).

Really, even though the USB 3 hubs are ultra-cheap, I’d prefer something that would give me a single plug. Which means Thunderbolt-2 docking stations. I reviewed the options...

  • The original Caldigit ThunderboltStation claimed UASP support but the new one doesn’t mention UASP — and it has a limited number of ports.
  • Elgato thunderbolt 2 dock is sold by Apple Store [4], it has Thunderbolt_2 (2), USB 3 UASP compliant (3), HDMI, GB ethernet (no firewire, but Apple sells a firewire/thunderbolt adapter for $30)
  • Belkin thunderbold 2 express HD is also sold by Apple, but there’s no mention of UASP and it has only two USB connectors.
  • The OWC Thunderbolt 2 dock has the best connector options: Firewire 800 (!), 5 USB 3, Ultra-HD HDMI, Gb ethernet — BUT there’s no mention of UASP support anywhere. You have to buy a thunderbolt cable.
  • The Akitio has only two USB 3 ports, but they do support UASP [5] - but no ethernet ports.

Overall I like the OWC Thunderbolt 2 ($228 + $30 thunderbolt cable), but it’s missing the UASP support (but [5]). Otherwise the Elgato ($208, need to buy $30 Firewire/Thunderbolt adapter) would be my choice.

I’ve got a response from OWC pending on UASP support, but I’m also wondering if it makes a real world difference. Update pending.

- fn -

[1] Apple quality? Only by comparison to the alternatives, and perhaps not even then.

[2] Apple, you really shouldn’t be making non-purchase so appealing. Maybe invest more in software quality and hardware reliability and value and less in marketing gimmicks?

[3] USB Attached SCSI. Really?!  I still have nightmares from my SCSI days, termination voodoo. Yeah, not the same thing, but tell that to the dreams. From the wikipedia article: "Apple added native support for UAS to OS X 10.8 Mountain Lion; drives using UAS show up as using IOUSBAttachedSCSI instead of the older IOUSBMassStorageClass kext”. I wonder how much USB Attached SCSI/UASP resembles Firewire protocols; I couldn’t find any Google references. This is the kind of thing BYTE magazine used to do so well...

[4] Navigating the online Apple store really can’t get any more painful… can it?

[5] It sounds like, practically speaking, the best one ever does is about 370MB/sec whether by USB, thunderbolt or eSATA. Makes me wonder whether UASP support actually makes a real difference in today’s products.

Update [5]: The Amazon listing for the Intateck is a bit mind boggling. This screenshot shows the multiple options shown for a single listing:

Screen Shot 2015 10 21 at 1 54 12 PM

Depending on where the mouse lands you can get a model FE2003, FE2002, or FE2001 with varying case designs, some plastic, some aluminum, some with side vents, some not. I chose Aluminum, Optimized For SSD] Inateck 2.5 Inch USB 3.0 Hard Drive Disk HDD Aluminum External Enclosure Case with usb 3.0 Cable for 9.5mm 7mm 2.5" SATA HDD and SSD, Support UASP - the FE2003 version. The reviews for these different units are all merged. I suspect both Inteck and Amazon are guilty here.

Update: I ordered both the Elgata AND the OWC Thunderbolt docks from Amazon. I’ll run my own tests on both of them against the Inateck F2003 containing my 1TB Samsung and I’ll return the loser. If the OWC is good enough I’ll keep that one.

Update 12/12/2015: Results of my testing.

Sunday, October 18, 2015

Replacing a Time Capsule with a Synology NAS - Time Machine for multiple machines

When my first Time Capsule died young I grumbled and bought another. When the second Time Capsule died even younger I decided to try a Synology NAS. If nothing else, maybe restores would, maybe, actually work.

Yes, Apple’s Time Capsule sucks. So does Apple to be honest. But you go to war with the army you have ...

Synology has a technical article on configuring Time Machine, but it assumes you have only one Mac.That’s dumb. If I had only one Mac I’d use an external drive cradle.

Two web sites were particularly helpful

To begin with I purchased a consumer grade Synology DS215j for $200 . This device is widely used and has a good reputation, but I suspect it’s due for replacement soon. I like using old stable stuff so this was fine with me. I bought it through Amazon where it was clear most users buy a pair of WD Red 4TB NAS drive to go with it. Installation was simple — but I still got confused! Synology provides two sets of screws, one for the drive mount and the other for case closure. They also provide extra screws for each! So, of course, I ended up thinking the packet of 10 screws was 8 mounts and 2 case. Except they don’t fit the case… Ok. Look for the other wee packet.
 
So far my Synology setup seems fairly quiet. If you hear a loud fan noise you probably got a bum unit (OTOH I expect the fan will get loud in a year or two.)
 
The initial setup defaults to Synology’s version of RAID 1 Synology Hybrid Raid (SHR). Use the Storage Manager tool to run a SMART Quick Test or a full Extended Test. The Health Info will show SMART status and useful disk information including Temperature (90F on mine). I configured Notifications to send me a monthly report; I didn’t want to give it access to my primary Google account so I used a non-critical secondary account for email services.
 
Synology tells me I have 3.6TB of storage to play with. That’s enough for my backups, but it doesn’t leave much for other uses. I considered using a Disk Group to create a 7.2 TB “drive” and divide that into two volumes, but then I did the arithmetic on failure assuming a 1/10 chance of drive death in the first year of use (which, for me, would be typical):
  • Use one drive for backup without drive group: 1/10 chance of data loss.
  • SHR data loss probability: 1/100 (both drives must fail, really it’s much less than that because they have to both fail before I can replace one)
  • Single Drive Group data loss probability: 1/5 (1 - 0.9*0.9) — Assuming data is striped so that if either drive dies the entire data group is lost.

I decided I like having a much more reliable backup — at least for now. I don’t like the risks of creating a Single Drive Group, but I could see one day using one drive for backup and another for other work.

First in Control Panel:File Services enable AFP service. Even in 2020 I have not enabled SMB service. (At least through High Sierra Time Machine needs AFP and that works for Mojave too.) In the Advanced tab I enabled Bonjour and SSDP.

Within the Control Panel:Shared Folder you create one Time Machine folder on the Synology NAS that will hold one or more Time Machine disk images (one disk image per Time Machine). I named mine Time_Machine_FLNAS (no spaces).

In Control Panel:User create one user for each Mac so each machine can have its own quota and the logs are machine specific. I created one user per machine named after each Mac’s network name (they all share the same password). Each of these users has its own disk quota. I gave each user “Network Backup Destination (later rsync)” and “File Station” application permissions, I’m not sure both are needed.

Synology supports AES encryption of the backup disk, but a 2012 article claims a major performance impact. Time Machine also supports encrypted backups (new since 2012) but for initial setup I’ve left that off. Since my primary server is also unencrypted this isn’t worse than my current practice. I use encrypted images for sensitive data and we do encrypt our laptops and our rotating offsite server backups. The primary risk of an unencrypted onsite drive is, of course, theft.

From the client Macs Time Machine should show the Drive name you created on Synology. Choose that and wait. As of 8/2020 I alternate TM backup for one of my machines between my Synology TM and a tiny local USB drive. I've been using the same Synology box and drive for five years.

PS If you have to delete a large sparseimage then do it from the Synology NAS using File Station (NOT from MacOS!). It takes about an hour to delete a multi-TB sparseimage.