iOS App Update hangs without an error message in infinite download: a general approach

Apple's FairPlay DRM management is notoriously fragile. It can be confused by family sharing, Screen Time controls, payment method changes, and, heaven forfend, mixed Apple IDs on a device.

Once Apple's DRM gets confused there's often no user accessible error message (PS. This is a bug [1]). The app just hangs. So when I realized my (manual) App Store updates were not completing I was not completely surprised. Recently I had:

1. Changed payment methods. I made my Apple Card's award balance (1-2% transaction) the default payment method (so it always gets emptied)
2. Enabled Screen Time account change restrictions to mitigate the harm of Apple's biggest current security issue.

I fixed the problem in the usual way (see Apple's article on this as well):

1. [Switch to manual update if you've been using automatic]
2. Verify Apple ID payment methods look correct
3. Turn off Screen Time [Apple doesn't mention this.]
4. Restart phone (power off/on)
5. Download a new free app from App Store [An old method, still useful]
6. Verify I can now update one of the pending apps.
7. Update All
8. Turn Screen Time back on.
9. [Turn auto update back on if you like that.]

-- 

[1] Failure to generate a user notification of a failed interaction is, of course, a bug. Regardless of whether there's a bug in the interaction processing (which there is, so that's another one).

Apple's App Store Apple Account balance: updated due to transition to Apple Cash

Update 5/1/2023 - a few months after writing this I realized Apple is in the midst of a very poorly documented multi-year transition.

There are currently two "gift cards" - Apple Gift Card (AGC) and App Store & iTunes (ASIGC) gift card.  The AGC used to be only useful for buying things at Apple Stores (or online equivalent) but sometime in the past few years the AGC could be used to to buy apps and media. 

The ASIGC works as below. Apple's check balance advice remains incorrect; the balance displayed in the App Store UI is not updated reliably. However, I don't think the ASIGC is long for this world. Which probably explains why Apple hasn't fixed the balance display or the use of the old term "iTunes".

The AGC can be purchased through a web interface - https://www.apple.com/shop/buy-giftcard/giftcard. When I bought it for my son using his iCloud email the balance showed on his phone wallet as Apple Cash. The Apple Cash balance also shows under his Account as did the prior ASIGC balance, but in a different location inserted at the top of the screen (it doesn't show there on my iPhone!).

The Apple Cash account is also used to hold purchase rebates (1-2%) from an Apple Card. I see my Apple Card balance there. I use the payment method selection control; my first payment method is Apple Cash, the second is Apple Card. When I view my son's payment methods at appleid.apple.com I see Apple ID (that is in fact holding his Apple Cash balance) and the fallback payment is "Apple Cash", but it's MY Apple Cash not his. (In fact there's a 3rd payment method --after these two charges roll over to me via my Apple Card, but the current UI can only show two.)

Note the weirdness here. In the case of a non-organizer family member the Apple Cash balance shows up here labeled Apple ID rather than Apple Cash!

I have found charges do go first against this "Apple ID" (his Apple Cash) then against my Apple Cash (currently $41.71). Incidentally, note if you can connect to a non-child family member's appleid you can see their balance and they can see the family organizer's cash balance.

If my son were a minor I'd have more options to manage Apple Cash. As it is this is a big improvement on a few months ago (below). It's obvious that in the US at least the ASIGC is obsolete and Apple will transition to the AGC. They still have a ways to go; they have added a savings account feature to Apple Card; I wonder if they'll add one to Apple Cash.

--------- original post

Apple's "Apple Account" holds cash that can be used to purchase apps, media and subscriptions. Money is most often added to an Apple Account through App Store and  Gift Cards iTunes gift cards. Users can also directly add money to their personal Apple Account from a payment method, but there are few times that makes sense. If a user is a member of a "Family" then the money comes from the Family Organizer's payment method (usually this is a bad thing). If a Family Member purchases something it will come out of their Apple Account balance first then any residual charge will come out of the Family Organizer's payment method (not the Family Member's payment method).

Apple Accounts are poorly documented, especially when they intersect with Family Sharing. Sometimes the support documents are incorrect or incomplete. For example, the check balance article for Mac tells users to look below their name in the App Store app:

That doesn't work very well though. You can see the problem in this screenshot taken from my son's account

His account shows $150 as a balance, but that's wrong. If you click on Profile and drill down to this Accounts page (requires authentication) you will see the correct amount of $135.37. Evidently the amount displayed on the App Store screen is copied there from another system and there's a time lag. In my testing I've found that the lag is at least a day and I suspect it only updates when one checks the Apple Account (requires authentication). So, in reality, the Apple Account is the only way to know this number.

Apple doesn't mention this, but you can also get to this Accounts page (which has the accurate numbers) from iTunes/Music. You can't get to it from the web however; appleid.apple.com doesn't have this data. My guess is that Apple is still using their 20yo iTunes infrastructure for the "Apple Account" (authentication doesn't support Apple Passwords OR biometrics) and that the display in the App Store is a bit of a hack. 

The Apple Account is a legacy system that is much older than Family Sharing and doesn't support it very well. I'm guessing Apple has been trying to replace the iTunes backend for a years and that the version we see is in maintenance mode. Perhaps they will transition to the emerging Apple Pay infrastructure. For now we have to workaround the issues.

Apple Family Sharing and reviewing family member charges

Apple's family sharing is complex and problematic. Family member charges are paid first from the Apple Account balance then secondarily to the Family Organizer account. Charges for members under 18 can require pre-authorization, but this cannot be done for over 18. The user interface for viewing Apple Account balances is obviously an old hack that would never pass any true review.

The Family Organizer receives emails with family member transactions on them. There's no comprehensive historic view of all family transactions however. A support article recommends using https://reportaproblem.apple.com, but that has only a 90 day history. Each family member can see their own transaction history on their Apple device, there is no web interface I know of for this comprehensive history. Recurring subscriptions are billed to the organizer but may be viewable only from the member account.

Essentially if a Family Organizer wishes to review family charges they need to do so within 90 days and they need to use reportaproblem.apple.com. Tracking emails is a less effective approach. To review older purchases the Organizer will need to use a family member's device or macOS account.

PS. Apple managed Subscriptions appear in the iOS/macOS subscription list, but 3rd party (ex. YouTube channel) subscriptions only. show up in the User's account view. You will see the recurring charge (monthly, etc) in reportaproblem.apple.com. Subscriptions must be managed in the host app, Apple only handles the billing.

Family Sharing: all charges go to Family Organizer - UNLESS there's an Apple Account balance

One of the drawbacks of Family Sharing is all charges go to the Family Organizer. Even if a family member has a payment method stored in their Apple Account it won't be used. When I look at my son's purchase history in iTunes I see that his recent music purchases have been billed to me. Apple's Support article is clear about this:

Which payment method is charged for purchases that family members make?

When Purchase Sharing is turned on, everyone's purchases bill to the family organizer's payment method.* If there's an issue with the payment method, the family organizer can update their payment method or add a new one.

If you're the family organizer and you don't want to share a payment method with your family, turn off purchase sharing. When purchase sharing is turned off, you can continue to share subscriptions like Apple TV+ and Apple Arcade. When Purchase Sharing is turned off, everyone must use their own payment method.

But this isn't true. My son's recent charges didn't appear on my credit card even though, as noted above, his purchase history says I paid for them.

It turns out there's an asterisk in the above paragraph. I think that was added recently. The asterisk points to a different support article:

Some purchases aren’t charged to your Apple Account balance

If you're in a Family Sharing group, purchases that you make are charged to your personal Apple Account balance. If you don't have enough Apple Account balance to pay for the purchase, the remainder is charged to the family organizer if purchase sharing is turned on.

Yes, that excerpt is internally contradictory! Ignore the heading, the key information is sort-of here: "If you're in a Family Sharing group, purchases that you make are charged to your personal Apple Account balance."

Basically the Apple Account balance is always used first regardless of Family Sharing status. Whatever exceeds that balance is charged to the primary payment method; for a family the primary payment method is always the credit card of the Family Organizer.

So this suggests that if you want charges to go to a family member rather than a family member, you use their primary payment method to create an Apple Account balance and then enable auto-reload.

Even when the payment is through the personal Apple Account balance the Purchase history will show that the purchase was by the Family Organizer. That is a bug. (Apple's purchase history records are a dumpster fire.)

An Apple Account balance can be created through a gift card. But what about using a family member's debit card to add money to their Apple Account? What about using Apple's Auto-reload feature?

Great questions! There's not any good documentation. I don't yet know the answer to the first question, but I did discover what happens with Auto-reload. Even if the family member's debit card is associated with their account the auto-reload will use the Family Organizer's payment method. (In my testing it took over 2 weeks for the first auto-reload charge to actually show on a credit card statement.)

So, what does this mean for those of us who would really like to have family members pay directly for their purchases? So far, not much. If you use auto-reload it may be easier to track the auto-reload payments and not worry about the per-item charges, but that's a small benefit.

That's all I know so far!

Migrating from an Apple Store/iTunes shared media Apple ID to a standard Apple ID configuration

I'm putting this up as a peacekeeper. I hope one day I'll fill it in better, but if you are trying to migrate from a shared Apple ID to each family member having only one Apple ID for both iCloud services and media then you will welcome any information.

First, see my prior post. I'll continue with this convention:

Let's say my iCloud Apple ID was "Sam" and my Media Apple ID was "Linda". So my device Apple ID configuration was Sam/Linda.  After the change it was Sam/Sam. 

I think the migration will more or less work. This is what I did so far, omitting errors and redirections:

1. Let my Apple Music subscription lapse and cleaned up other subscriptions. These were owned by "Linda".
2. Subscribed to Apple Music one day after the lapse using Sam. I'd seen hints Apple keeps iCloud media data (playlists) around for at least 1 month post lapse of subscriptions. I can confirm they last at least 1 day.
3. Changed my devices to be Sam/Sam (maybe this would best be done later)
4. In iCloud Family Sharing settings opened settings for Sam.  Even though my device might be Sam/Sam when I inspected details on my Family Organizer Apple ID I could see shared access was mediated by Linda. I changed that to Sam in Family Sharing.

I ran into too many issues to enumerate. A few tips:

1. Changes to media rights seem to take time to be effective. After starting a subscription give it at least 30-60 minutes.
2. iTunes classic allowed import/export of XML playlist files. These are useless. The key identifier is the track ID so they only have meaning for the Library they came from.
3. Sharing a playlist by URL from Monterey worked -- but not at first. It got hung up in the subscription translation.
4. Even after family members had renewed subscription access they needed to do something to get Apple Music.app to synchronize. Sometimes this was clicking on the sign-up add for Apple Music then choosing the subtle link for "already have a subscription". Sometimes shutting down and restarting. Sometimes looking at Music.app preferences and turning on iCloud library synch. (Sorry, there were so many issues!)

Extra comments

1. There are two kinds of Playlists - "Apple Music Playlists" and traditional iTunes/Music playlists. I think when you migrate an old iTunes library to Monterey the app turns legacy playlists into Apple Music Playlists. Not 100% sure about this.
2. I'm not gonna talk about this more, but I'm still running iTunes on Mojave and I'm amazed it works at all. It more or less survived the process. I have future work to do around migrating things out of iTunes on Mojave. (That machine will be an Aperture machine until I migrate that -- an even greater challenge. Then it will likely be replaced.
3. Post migration it's not clear how to identify what a Family Member purchased from the days of the shared Apple ID. Apple suggests going to reportaproblem.apple.com; it only goes back 90 days though. Before doing the Apple ID migration the Family Organizer view had data broken down by family member, but after the migration that was very limited.

Update 11/15/2022 - the dreaded Apple ID for purchases". 

Only my #1 son still had the "Linda" Apple ID for purchases (Store, Media). He's on iOS 16.1.1. Even after switching his Media Apple ID to be his iCloud Apple ID, and despite his Settings Family Sharing saying he had access to the Apple Music subscription, both iTunes.app and Music.app said he didn't have family sharing access.

I found https://support.apple.com/en-us/HT201454. There are 3 Apple ID settings in iOS, not 2. There's iCloud Apple ID, Media and App Purchase Apple ID, and for the Family Organizer there's also Apple ID:Family Sharing:Purchase Sharing:Purchases:Apple ID for Purchases! The last is not updated when a user changes Media Apple ID. It's a "secondary Apple ID".

I don't think the Apple ID for purchases always exists. On my son's phone it can be changed. On my personal family organizer phone it appears it cannot be changed and it's incorrect. There can be significant timing delays when it's changed, the Done button may appear not to work but on screen refresh it may work.

After I removed the secondary Apple ID for purchases from his phone he was able to access Apple Music. Then I could enable "Sync Library" in Music Settings.

Related: A post on App Update hanging in infinite download.

Update 11/18/2022: Article on the secondary Apple ID and purchase sharing. This article changed 9/2022. It feels like Apple's attempt to mitigate the multiple Apple ID curse. You can only change this every 90 days. I changed it from "Linda" to "Sam" but in 3m I might change it back again -- after some research.

Update 11/19/2022

After doing the Apple ID separation I needed to recreate a Library for my son that identified what he'd actually purchased over the years that his purchase were on the family shared Media Apple ID. The Media Apple ID had its own account on one of our Macs, so I could create a Playlist from that to share, then open that shared url in his current Library. That worked pretty well in the end, but there were many issues and steps. I used many macOS Music app queries and sorts to reconstruct which things were his (He still purchases Music from Apple. That's a longer story.)

Once he had the Playlist I created open in his macOS Music app I had to select all songs and use "Add to Library" to actually make them part of his Library. Note you can download songs for a Playlist but that doesn't make them part of the Library. I needed his Library to reflect his purchases and preferences.

As a part of this process I found the best way to view purchase history was to enable iTunes in Apple Music, then in iTunes click the Purchases link.

Incidentally I ran into many UI bugs and issues with Apple Music. The worst is the insane and inexplicably persistent Apple Music product manager decision to use an enormous Playlist header section that makes the essential column browser very inefficient. There were problems with Authorizations, with downloads, with list row selection and more. It's just a buggy and flaky app. At one point I was trying to download locally and nothing happened. Only by showing the Activity window could I see that my device authorization wasn't working. I had to use my son's Apple ID to authorize Music / iTunes in his user account -- perhaps the Apple ID I first used had too many authorizations on it. There was no error message.

Apple Music subscriptions stop working when I changed my Media & Purchases Apple ID

Apple digital rights management (DRM, FairPlay in this case) is very complex, particularly when one adds Family Sharing or has an atypical Apple ID setup.

In our case, for reasons that made sense 10-15y ago, my iCloud Apple ID is different from my Media & Purchases Apple ID. My iCloud Apple ID is the family organizer and my Media Apple ID is a family member.

Over the past few years I've been trying to migrate to using a single Apple ID on my phone. I have migrated all but one family member.

Migration has been difficult. I don't think Apple has published a transition guide. You can't, of course, transfer purchases or media or subscriptions. There's a risk of losing a lot purchases and Apple is unlikely to help.

I looked at doing a test migration on a macOS Monterey account of mine but it seemed Monterey did not a user to change only their Media Apple ID. [Later I found you can. In Monterey, unlike iOS, it's obscure how you do this; it doesn't show up in an Apple ID. You change the Media Apple ID through the App Store (Sign Out, Sign In).]

Since it seemed couldn't test on Monterey without trying a full Apple ID transition I made the changes on my iPhone.  Let's say my iCloud Apple ID was "Sam" and my Media Apple ID was "Linda". So my device Apple ID configuration was Sam/Linda.  After the change it was Sam/Sam. Sam is the Family Organizer, Linda is a family member. Linda owns our app and media purchases -- at least that's where they show up when I look.

I was particularly curious how Apple Music would work including test playlist sharing. Unfortunately I couldn't test the playlist sharing because Apple Music didn't work at all! As far as iOS was concerned I didn't have an Apple Music subscription. It offered to give me 6 months free. I also didn't have any Playlists or other configuration. Music (iTunes) configuration is tied to the Media Apple ID, not the iCloud Apple ID.

To recap, Sam is family organizer and Sam/Linda purchased the family plan Apple Music subscription. Linda shows up in Family Sharing as a family member. Once I became Sam/Sam I had no access to Apple Music. Reviewing Family Sharing it appeared that Sam should have access to Linda's Apple Music subscription. That doesn't work.

Apple's Family Sharing problem support page says:

... Make sure that you're using the same Apple ID for Family Sharing and Media & Purchases... 

They don't say how to migrate to that idea of course! Obviously it was possible to use a different Apple ID for Family Sharing and Media (Apple Music worked before). I don't know if the changes made to my device impacted any other family members (wish I'd checked!), but it appears for a Family Organizer device to see Apple Music they have to use the same Apple ID used at time of purchase.

Somewhat surprisingly Apple let me revert back to Sam/Linda on my iPhone. (I think there was some time limit/change limit on Apple ID media changes.) After a period of sync I had my old playlist and Apple Music access.

My guess is that to make the change to Sam/Sam and keep Apple Music I'll have to end my current subscription (tied to Linda) then change the Media Apple ID then resubscribe for the family. (In practice I'll end all subscriptions for Linda before the change.)

Monterey orphaned our physical podcast files. What can we do with them?

Podcasts started out as distributing MP3 files; back then iTunes was a great podcast app (and music and audiobooks, and voice memos and more -- it was a glorious app before the fall.)

Over the years Podcasts really shifted to streaming, listen once, don't keep. Then, somewhere post Mojave (Monterey) Apple orphaned the physical podcast files stored in iTunes. The Finder shows physical files in your media library but neither Music.app or Podcast.app can browse them. Music. app's browser Get Info still shows the media type dropdown, but there's only one type! (Music)

If you click on a podcast file iTunes will play it and import the file into the media library where it has media type Music but genre podcast.

So the fix is:

1. Move Podcast folder out of media library

2. Reimport all podcast as music.

3. For genre podcast multi-edit to make more like podcasts. You use macOS Music.app column browse to see all with genre "podcast", select all then hit cmd-I. You'll see a prompt asking if you wish to multi-edit (yes). Then in Options select: 'remember playback position' 'skip when shuffling'. I think this operation may fail if a file is being uploaded to Apple Music (at least I get to burn GB of Apple Storage!) so let uploads complete if it doesn't work.

Reference Stack Exchange.

PS. Voice Memos are supposed to have a migrate path, but that didn't show for me.

What happens when you have an Apple ID without an email address and you change it? (And much more about Apple ID hell.)

I'll provide some back story below, but it's tedious and a bit ranty so I'll put the most useful stuff up front.

For *reasons* (see below) I have had an Apple ID associated with iTunes, App Store, physical Apple Store, hardware and other purchases for about 20 years. For other *reasons* almost lost to memory the username has not been a valid email address for most of those years. Until recently it had an associated email address it would forward to but Apple changed things sometime in the past two years and that stopped working.

I'm simplifying.

We will call this Apple ID username "bob@mac.com". I will use alice@icloud.com and dan@me.com for my new Store Apple ID ("Media & Purchases") and my longstanding iCloud Apple ID respectively.

Once bob@mac.com stopped forwarding I no longer received notifications related to Apple Discussions or emails related to charges. Since bob@mac.com was the store Apple ID for my family (this was the practice in early iTunes days) our children (now adult) used it for purchases. Simplifying a lot and omitting family details the lack of email meant no monthly statements -- so I didn't spot a scam subscription - among other things.

I knew I had to fix this but I dreaded the side-effects. I'd already tried undoing the shared store Apple ID and ran into disaster; I had to reverse that attempt. I had to fix the Apple ID invalid email problem first.

Before Apple broke forwarding for the Apple ID "bob@mac.com" I had used "alice@icloud.com" as a forwarding address. Although there was no clue in the Apple ID online configuration tool, I knew alice@icloud.com was still entangled with bob@mac.com (see below, this post goes on for a long time but still omits much).

Ok, so far? I gets a bit simpler then you can skip the back story.

Anyhow ... when Apple broke forwarding they seem to have introduced the ability to change an Apple ID userid - such as bob@mac.com. I believe, though I can't find any documentation, that the visible username with the form of an email address (ex: bob@mac.com) is an alias for an unchanging hidden identifier (maybe a GUID). 

After some thought I decided the cleanest approach would be to change my Store Apple ID visible username from bob@mac.com to alice@icloud.com (I knew the two were entangled, see below). It's easy to make this change from appleid.apple.com. When I did this I was not asked to confirm that alice@icloud.com was a valid email address I owned. All I got was an email sent to to alice@icloud.com saying the change had been made.

After I made the change I found the following. I expect other changes as Apple's different systems synchronize and update (I will update this as I learn more, I expect to learn of problems from family members later today):

1. I cannot login to the Apple ID or anywhere using bob@mac.com but the two factor notification dialog still says bob@mac.com (this may change).
2. I think I may have more control over Apple ID two-factor, I can add/remove trusted devices, remove from account, and I can add a second trusted phone number. I still can't add a backup email address; that is available on some other Apple IDs I have
3. Apple Discussions is intact. When I login with alice@icloud.com I show as "member since June 23, 2003".
4. Mail sent to bob@mac.com still fails, there's no redirect.
5.  iTunes on Mojave: asks me to sign in and displays new alice@icloud.com. Says session expired, asks again. Purchase history intact.
6. Media & Purchases on iPhone showed new iCloud address and I had no trouble with updating apps.

In addition, Messages in my personal dan@me.com iCloud stopped working! It turns out "Messages" has legacy associations with the old Apple Store ID used with iMessage before Apple implemented iCloud. I got this error message

Messages in iCloud not available as iCloud and iMessage accounts do not match. (Messages in iCloud is not available because iCloud and iMessage accounts are different.)

There's a fix here but it's not the one I needed. When I looked at Messages on my iPhone it showed only my Phone number, the Apple IDs were all absent. When I tried to enter an Apple ID it showed my store Apple ID; I chose "use other Apple ID" and entered my personal iCloud Apple ID. That worked and it immediately restored all my send/receive message list. I could then reenable messages in iCloud.

It didn't fully work on Mojave iMessages though. I reenabled using iCloud Messages in preferences there and about an hour or two later it seemed to start working (though uploading messages to iCloud is still ongoing.)

That concludes the current record of changes to date. So far it has been less of a problem than anticipated, but it's early days. I will add other issues as they emerge. Then I can return to the herculean tasks of moving family members off of a shared Media & Purchases account.

Below are details for the benefit of someone searching who finds this post. They are related older items that I will summarize in outline.

----------- additional details ---------------

As noted above years ago I had alice@icloud.com as forwarding email for the Apple ID bob@mac.com. The address bob@mac.com had no associated email because of complex changes Apple made in migrating from free iTools to not-free .Mac to MobileMe. [1][2]

When I finally realized I wasn't getting Apple media purchase statements for bob@mac.com I began investigating what had happened to the old alice@icloud.com iCloud account. I found it was deactivated. I was able to reenable it. That's when things got weird. Remember (if you read above) that there was no longer anything I the Apple ID settings for bob@mac.com that showed alice@icloud.com.

Once I reenabled alice@icloud.com with a new password I found that:

• Both alice@icloud.com and bob@mac.com worked as usernames for the same bob@mac.com Apple ID.
• The password for the bob@mac.com Apple ID had changed to match the alice@icloud.com password. [This actually took a day to propagate to iTunes purchases]
• Both alice@icloud.com and bob@mac.com showed the same iCloud services (mail, etc).
• bob@mac.com was still not a valid email address. 

fn -

[1] https://en.wikipedia.org/wiki/MobileMe#.Mac

Originally launched on January 5, 2000, as iTools, a free collection of Internet-based services for Mac OS 9 users, Apple relaunched it as .Mac on July 17, 2002, when it became a paid subscription service primarily designed for Mac OS X users. Apple relaunched the service again as MobileMe on July 9, 2008, now targeting Mac OS X, Microsoft Windows, iPhone, and iPod Touch users.

On February 24, 2011, Apple discontinued offering MobileMe at its retail stores, and later from resellers.[2] New subscriptions were also stopped. On October 12, 2011, Apple launched iCloud to replace MobileMe for new users, with current users having access until June 30, 2012, when the service was to cease.

... The original collection of Internet software and services now known as iCloud was first called iTools, released on January 5, 2000, and made available free of charge for Mac users.

Services offered by iTools included the first availability of @mac.com email addresses, which could only be accessed through an email client (e.g. the Mail app); iCards, a free greeting card service; iReview, a collection of reviews of popular web sites; HomePage, a free web page publishing service; the first version of iDisk, an online data storage system; and KidSafe, a directory of family-friendly web sites.

.Mac[edit]
As costs rose, most particularly due to iDisk storage space, the wide demand for @mac.com email accounts, and increasing support needs, iTools was renamed .Mac on July 17, 2002, as a subscription-based suite of services with a dedicated technical support team.[25]

... Existing iTools accounts were transitioned to .Mac accounts during a free trial period that ended on September 30, 2002. This move generated a mixed reaction among Mac users, some believing .Mac was overpriced...

[2] eWorld https://en.wikipedia.org/wiki/EWorld

. Yesterday the password for App Store was different from password for Apple ID but today they seem to be same. I think they are two different systems that update every few hours...

 · Feb 19

Today it appears there is a single Apple ID with two usernames and one password. One username has iCloud services but is nowhere displayed in Apple ID information. twitter.com/jgordonshare/s…

... If you change a phone's Store ID to match the phone's iCloud ID  you cannot update all their apps with their iCloud ID password. You need to use the old Store ID password. Even when family sharing is in play...

... I have a hunch that Apple has an internal ID for users separate from the username (email form) displayed with their Apple IDs and Store IDs and iCloud IDs and that is what they use in FairPlay. 

Things I learned switching from Spotify to Apple Music

I'll keep adding to this list. For historic reasons going back over 10 years all my owned music is under one Apple ID and my iCloud services are under another. 3/5 family members use the same Store Apple ID. Because of the way family sharing works that legacy Apple ID is a six family member.

• On the individual plan you can stream to one device at a time. On the family plan you can stream to up to 6 devices at one time. On the individual plan if two devices share the same Store Apple ID only one can stream at a time. (I think you can play Music you own on more than one device.)
• If you are on a free plan and upgrade to family plan you don't get any special credit, just go to full price.
• When you do upgrade from the Music app (good luck figuring this out) you get the monthly $15 renewal. There's no yearly discount.
• I think music that you have in legacy iTunes that is not part of Apple's library is uploaded and available. For example (from 2003!). I don't know if I play from streaming if I get this one or a newer version.

• In addition to iTunes you can use music.apple.com to access your library on a Mac.
• FreeYourMusic.app on iOS $10 works pretty well to transfer Spotify playlists to Apple Music. The $10 is a lifelong subscription but it is not family shared.
• When you cancel Spotify you revert to ad-supported Spotify, your playlists don't go away.
• To Share Playlists you need to create a Profile.
• Apple Music includes iTunes Match

Additional notes on results of moving Emily from using a shared Store Apple ID to her iCloud Apple ID for media and purchases given family sharing:

• Playlists that were on her phone seemed to stay on her phone
• Downloads on her phone are still there and they synced to the Cloud
• Still TBD how this will impact movies, apps, etc given family sharing (our legacy shared Store Apple ID is a 'family member').

Apple Manage Devices / Associated Devices is still kind of broken

If multiple devices share a Store Apple ID they will show up in Apple ID Devices. They will also show in iTunes (for that Store Apple ID), Apple’s current documentation states iTunes is the only way to see and manage this list. “You can have ten devices (no more than five of them computers) associated with your Apple ID and iTunes at one time."

And you thought iTunes was dead!

You have to remove devices manually from this list after you stop using them. If, like me, you use the same Store Apple ID on family devices it’s easy to hit the limit.

The interesting bit is these two lists are different and they don’t synchronize. They are presumably on two different databases.

The applied.apple.com list is current and shows 8 devices. I think if you sign out of a device you’re not using this list will be updated.

The iTunes managed list is not updated when you sign out of a device. You have to update it manually. I think it still supports iPods. It had one of our devices that was no longer active on it, but it also had an old iPhone 4 we use for music only that runs iOS7 [1]

iPod support explains why the iTunes managed list can’t be automatically updated. I don’t know what happens if you exceed the limit on one list but not the other.

- fn -

[1] The iCloud My Devices display supports “iOS 8, macOS Yosemite … or later …”

Converting from shared store ID to Family Sharing - and what didn't work

Maybe this worked. Or not. See update.

Our five family members have long shared one store Apple ID. We’ve done this before there was Family Sharing. I put off switching to Family Sharing as I figured it would take Apple 3-4 years to get it working.

With iOS 11.3 Apple broke a longstanding purchase behavior. My son’s iPhone no longer required a password for purchases, only his fingerprint. There might be a fix, but I decided instead to move him to Family Sharing. (There is a fix, see below.)

The story went something like this [1]:

• I have an iCloud Apple ID (john.___@icloud.com) and a different Store Apple ID (j____@mac.com) — because I’m old. He has an iCloud Apple ID (sam.___@icloud.com) and my store Apple ID.
• In my iCloud Apple ID he is a family member. 
• I removed my Store Apple ID from his phone and added his iCloud Apple ID.
• I sent $15 to his iCloud Apple ID from my App Store account.

So far he still can access our movies and apps. Now he will make his own purchases that will be associated with his Apple ID. When he runs through his $15 he’ll give me cash and I’ll send more money. Eventually I do need to get a debit or managed credit card on his phone but we’ll start with cash. Alas, it doesn’t work that way. See update.

After the change I checked the (this is broken) two places Apple currently tracks devices associated with an Apple ID

• appleid.apple.com/account/manage: showed 7 devices including an old iPhone my son used to have that I’d previously removed. This also showed on his iPhone Apple ID view. I removed it from both places and it has not returned.
• iTunes Manage Devices showed 8 devices, but not my son’s current iPhone. This, in contrast to past testing, is correct while the appleid.apple.com list is incomplete. It’s interesting that moving my son’s phone to Family Sharing means I’m no longer at my 10 item device limit (if that rule still applies!)

- fn -

[1] He is, incidentally, a special needs adult. I’d have liked to be able to use Apple Ask to Buy for him but that’s not available for an adult. (I wish Apple considered special needs as a disability — they have great support for visual and auditory needs, but not for cognitive.)

Update 4/19/2018

• Seeing purchase histories is really clunky. You can see what apps a family member has purchased by launching App Store.app, logging out and then logging in as the family member. To see both tunes and apps you go to Apps & iTunes in Settings (yeah, this is crazy). You have to log in as the family member — I got the ancient iOS 1.0 un/pw dialog that shows up when you get to a part of iOS that desperately needs a replacement. It did work, but seriously ugly.

Update 4/20/2018

• Subscriptions aren’t Family shareable. So that’s a significant bummer; several of his apps are subscription based. All is not lost though, At Bat.app presented my Store Apple ID username and accepted the password. In-App purchases aren’t Family shareable either — which is bad news for Omni Group. Apple has a list of what’s not shared.

Update 4/28/2018 - what I wish I’d known

My son ran up a $70 bill on a $15 credit — all on my account — because “Any time a family member makes a new purchase, it’s billed directly to the family organizer’s account”. It doesn’t work the way I thought it did. If a family member is under 18 you can activate Ask to Buy, but not for someone over 18.

Family sharing is clearly designed to only work for children. It’s a poor match for a couple that wants to keep separate finances and it’s unsuited to adult children.

I found that the 11.3 update bug didn’t truly break the ability to require an iCloud password for purchases. It only bypassed the requirement to enter the iCloud password to enable Touch ID. I went into Touch ID & Passcode and turned off “USE TOUCH ID FOR … iTunes & App Store”. 

He doesn’t know his iCloud password (so he can’t lose it in a phishing attack!), so this meant he again needed us to enter a password into his iPhone to make purchases. Obviously, Ask to Buy would be far better. If Apple wanted to support users with cognitive disabilities …well, this blog accepts comments. I’d be glad to advise.

We didn’t want to have to memorize another password, so I changed his iCloud password to match my App Store & iTunes password.

"This item was not added to your iCloud Music Library because an error occurred"

This is why Apple Stores are overloaded. I have 254 items like this. No explanation, no hints on fixing it.

Low quality is expensive.

PS. In this particular case it looks like iTunes and iPhone supported .mp4 audio, but iCloud does not. Long ago I ripped these and the software did .mp4.

I found the on drive files and used quicktime player to export as .m4a — a lossless transform that strips out the some of the .mp4 wrapper. Then I deleted originals in iTunes and added these back in.

Salvaging the wreck of iOS Podcasts.app

iOS 11 Podcasts.app isn’t as broken as iTunes mediated iPad photo transfer or the US government, but it’s not far behind. The current version is not intended to be used with iTunes. It is designed for people who listen to Podcasts they way we used to listen to radio. Pick a podcast or collection of podcasts (a “station”) and stream it over always-on cellular.

That’s not how I listen to Podcasts. I select a topic of interest and learn from it. I used to use iTunes to organize my subscriptions and local stores; smart and manual playlists queued up my programs. In iOS 11 Apple broke all that.

Here’s what I do now. 

I disabled iCloud sync in both iTunes and iOS.

In iTunes I select about 10-20 episodes from my queue. I push them to my iPhone from iTunes. In Podcasts.app I enable the ‘Downloaded’ episodes menu. That’s all I use now. I pick episodes off that queue. One at a time, because play-next doesn’t work any more. iOS Podcasts.app deletes an episode after I listen. Every week or so I add another 10-20.

It’s very simple, it’s very stupid, it’s Apple 2017.

iTunes Mac to iPad photo sync is broken

I had a longish holiday break this year, so naturally I spent part of it fighting with another technology regression. 

This regression was about getting photos from my Mac to my iPad; I use the iPad as a digital photo frame randomly displaying my Aperture (running on Sierra) images tagged as “slideshow” (this drains the battery fairly quickly, so I usually have the iPad charging). Years ago this was painless, but over the last few months I’ve found that only a fraction of my tagged photos make it over to the iPad. Often the process seems to die.

This go round I tried an old Aperture tip to delete the iPod Photo Cache (Apple approved) [1]. That had one effect — image transfer died completely! Instead of telling iTunes to transfer all my Slideshow tagged images (9,019) I had to select year-specific smart album slideshows one at a time (incremental add):

That generally worked, though the ghostly counts shown above in the iTunes 12.7 UI came and went inexplicably. Sometimes a mouseover seemed to trigger an appearance. If they didn’t show up that was a clue that something had gone wrong with the sync. (Infamously iTunes does not log errors to Console. Perhaps because they’d overwhelm console?)

Some part of the OS (or Aperture?) has to regenerate the .ithmb files [2] that are shared, that seems to be a slow process. I think the build process might make use of some data Aperture saves on exiting; that data is also used by the old OS X media browser (itself related to Apple’s old iLife code) [3]. I’m pretty sure some of the .ithmb creation is by an OS thread thought, and that seems to have a low priority. Maybe part of what causes a complete failure with large numbers of files is that iTunes has an arbitrary timeout placed to work around some other iTunes bug [4].

Once I broke down my slideshow into smaller bits and added them incrementally I seemed to have some success. The count (erratically) displayed in iTunes matched what showed on the iPad album counts and the Aperture smart album counts. Then things went south. The numbers transferred started to be a fraction of the Aperture counts. When things settled out I seemed to be stuck at 7,811 on the iPad (same count in iTunes if I mouseover the iTunes content type distribution bar) out of 9,109 in Aperture [5].

I did some half-hearted testing to try to figure out if this was related to filename characters or the like, but I haven’t gotten very far. I did confirm that RAW files don’t have an obvious problem.

The great news is that I learned today that I’m not alone and it’s not an Aperture specific problem! There’s a Macintouch thread on this by riley (quotes others, emphases mine):

So here's an update on the issue with syncing large Photos databases between iOS devices and iTunes.

After posting a number of followups to my Apple bug report, the response I got back from Engineering was that this is a known limitation in iOS, and "we are working to improve this in a future iOS release."

Their suggestion was to sync by starting with just a few albums, and then repeatedly re-sync, adding a few more albums each time. "On subsequent syncs, iOS will not add additional photos unless the sync preferences in iTunes are different from the previous sync, which is why it is necessary to keep adding selected albums each sync, instead of all at once."

… There is a huge discussion of this over on the Apple forums (see “Photos app on iPhone not syncing in iOS 11 ").

Various people have been told various things. Some have been told it is an iOS issue, some an iTunes issue. Personally, I think there are issues in both that are interacting, which are preventing reliable syncs with large photo albums over USB between iTunes and iOS devices.

Two years ago, our then ~40k photo library in Photos would sync the selected items (maybe around 30k photos in various albums) without problem. Perhaps around the time of iOS 10, the syncs needed to be restarted to complete, but eventually it would work. Since iOS 11, some sync, but many do not, and the sync just cancels with a variety of error messages at various points. Sometimes it is a device error, sometimes nothing. Sometimes many of the photos will be on there, but the albums they should be associated with are empty…

… The last update I heard from the person who was helping me was that it was an iTunes issue (at minimum, perhaps iOS too). She said that the Apple engineering team is aware of the issue and working on finding the problem so it can be fixed.

… I also see that since the latest tvOS update and the latest iOS 11 update, many albums are no longer being shared with the Apple TVs.

Hmm. This suggests to force updates one should add or remove some album with every sync. That did not work quite as expected. After I tried using the Media Finder code [3] and the ‘add new album’ trick iTunes said it was synchronizing another 1000+ files (that’s good!) but then the counts in iTunes and iPad dropped from 7,811 to 7303. So that’s just great.[6]

Since I now know this is not just an (abandoned) Aperture problem I added an iTunes feedback comment about the problem. Rumor is Apple processes these, presumably doing some algorithmic text extraction based on volume. So add your voice if you’re interested.

- fn -

[1] It took hours to empty the trash after deleting iPod Photo Cache — despite files being on an SSD. As of 7/2020 the links are all broken, but this is what you do: "find your Aperture or iPhoto library in the Finder. Right-click and select “Show Package Contents” then find “iPod Photo Cache” and delete it."
[2] I changed extension of a copy to .jpg and it rendered as expected. They are fairly high res images, in a small sample I examined one was a 3MB jpg. 
[3] In Sierra’s Open dialog the Media Finder still shows in the left nav pane! Maybe invoking it might trigger some updates? Worth a try to open it and let it run for a while.
[4] It’s widely assumed that iTunes source code is an impenetrable mess with bits left over from pre-Apple days. 
[5] Incidentally “Stacks” are a problem. One of the many bad things Apple did in bridging iPhoto and Aperture was to treat an old iPhoto Edit as an Aperture Stack. This threw away key information — that one image was the new version of another. There are lots of downstream implications. Years later I’m recreating thousands of iPhoto edits in Aperture. One of the problem is that when you tag an image as “slideshow” then transfer to iPad both versions go. I think this can cause the iPad count to be higher than the Aperture count, but of course the problem I haves is in the other direction.
[6] I removed the extra album and then the count went UP to 7,811 again! That album did reference photos that were in other albums, so maybe part of the bug has to do with photos that are in more than one album. I do think there are multiple bugs here though.

Update 12/31/2017 I

There are some JPEG images in my older files that do not show up in either OS X Media Browser (old iLife code) or Sierra’s Screen Saver Library browser and do not transfer to the iPad via iTunes. However, if I export the original and drop it back in again then the image appears normally — this doesn’t appear to be problem with the JPEG. They also render normally in several different apps and EXIF viewers.

Rebuilding the Aperture database does not make a difference.

So this is curious, and potentially an important clue, but to go further I need to understand how Media Browser works.  In my case the bug doesn’t only impact image transfer to my iPhone; it impacts Media Browser as well. I’m now poking around at ~/Library/Application Support/iLifeAssetManagement and ~/Library/Application Support/iLifeMediaBrowser, especially ~/Library/Application Support/iLifeAssetManagement/state/albumshare/Daemon.sqlite.

Update 12/31/2017 II

Finding more “invisibles” but no clear pattern to what’s omitted. Some are quite small - from the days when 100K was a good image size. It’s not size alone though; of a pair of similar old images a 64kb one made it across and a 70k one didn’t.

Update 1/1/2018

Same sync, same everything — but now iPad acts as though it’s been syncing to a different computer. All images removed! It took several tries to get one album to sync, but after it started working I could do about  @1,200 at a time. Now have about 7,700 on iPad out of 9,100 on Mac. I won’t sync iPad to iTunes again until there’s word of a bug fix. Just stick with what’s on there now.

Update 6/9/2018

I thought this was fixed — but it’s broken again. On latest versions of iTunes and iOS 11.3.1, macOS Sierra.

Update 6/9/2018b

I was able to sync 7777 of 7771 (different apps count photos differently, not least due to Aperture’s brain-dead “Stacks” handling of iPhoto imports) photos after installing iOS 4. I don’t know if the bug is fixed or if it’s just that process of installing an iOS update cleared something out. In the latter case it might return.

Update 7/4/2020

It's been a year or two since I last tried syncing. At this time I'm still on Aperture and Mojave. The sync was worse than ever. I wiped my old iPad and restored from iCloud backup and sync actually seemed to work! It saw only 7992 of the 9413 images in my Aperture slide show, but it did import those.

I tried the trick of deleting the iPad Cache in Aperture [1] but on resync it was still 7992/9413. Consistent at least. 

I think there's a bug in Aperture with Sierra and later with generating the images in the iPod Cache. Maybe something iTunes or OS X was supposed to do.

 I suspect the iPad flash memory is also in bad shape. 

The lack of logging or error handling is appalling.

Can't remove last "App" from the App Bar in iOS 11.2.1 iMessage.app? Turn screen to landscape mode.

On my iPhone 8 with iOS 11.2.1 I was unable to toggle off the last App (YouTube by alpha sort) in my plug-in list (what I mean). I turned phone to landscape mode and my touch was recognized. It’s not a screen touch bug because after doing this I could turn back to portrait mode and toggle it on/off at will. I suspect an array count or layout bug.

Apple's Apple ID fiasco is getting worse -- declining support for Apple Store ID that is not iCloud ID

Like many veteran geeks I have a different iCloud ID and Apple store ID. This used to be a supported configuration. In my case it was essential because of some complicated history with Apple’s .mac precursor to MobileMe and iCloud. (In an unrelated matter I have another 3-4 Apple IDs that aren’t connected to anything but, depending on the vagaries of Apple’s hacked together legacy databases, sometimes pickup Apple Store hardware purchases.)

This is what Apple’s support document says now (emphases mine) …

Sign in with your Apple ID - Apple Support

… We recommend that you use the same Apple ID for all Apple services on your device—including the iTunes & App Stores and iCloud …

… If you have multiple Apple IDs, you can’t merge them …

I went looking for this document because I think iBooks.app doesn’t work properly with an iCloud ID that’s different from the Apple Store ID that can be used to purchase iBooks. It looks like this will be a trend.

Note what Apple says here. Your Apple Store ID and iCloud ID should be the same. You also can’t merge them [1]. So you either need to abandon all your Apple Store purchases or your iCloud storage purchase.

Anyone remember when Cook promised to fix Apple’s original sin of  botched identity management system? Apparently the problem is harder than building spaceship headquarters.

Apple should bite the bullet and come up with a process to merge Apple IDs. I fear they aren’t going to bother though. I really miss class action lawsuits.

- fn -

[1] There is a possible workaround. You may be able to use your iCloud ID as an Apple Store ID and then make it a family member of the original Apple Store ID. This will run into rules about changing device Store IDs and constraints on family member size as well as issues with the total number of devices that are part of a family (10). It isn’t an official workaround and I suspect it has irreversible problems of its own.

Podcasts.app - sync Stations between iTunes and iPhone via iCloud, not via iTunes sync

Apple removed playlists from iOS 11 podcasts.app. I loved playlists. They were a beautiful user friendly query building tool.

Instead we have Stations, which are more limited. I created some in iTunes and some on my iPhone. They didn’t sync even though I transfer podcasts from iTunes to iPhone via WiFi/Lightning cable.

It turns out Stations do sync — but only via iCloud even though files may travel via local sync.

Once I enabled podcast sync in both iTunes and iOS my stations appeared in both. 

This is good, because one advantage of stations is that podcasts play consecutively. At least I think that’s why mine started playing consecutively instead of stopping after each podcast as they did earlier in iOS 11.

There are lots of weirdnesses in iTunes when it tries to combine sync via iCloud/Store with local file based sync from iTunes. It will be interesting to see if Podcasts does better at this than Movies does.

Apple is clearly heading towards the world where we have all have 2TB iCloud Drives, a 256GB local machine store for frequently used data, and special folders in iCloud for personally owned files that sync separately from Store files (ex: personal images, ringtones, podcasts, PDF, etc). There’s no resisting this one.

Update: It is a mess. Of course. Stations need a setting to only show downloaded episodes. One problem with Stations is that while they can filter out Played stations, they only know a station is Played as long as the file is around. If the file is removed and the show is in the Cloud then it is treated as unPlayed.

Did iOS 11.1 (partly) fix iTunes photo sync?

I’m back to wired sync for photo transfer after giving up on iCloud Shared Albums. The simplicity is a relief — except with 11.0 it wasn’t working well. Out of 8300 images in Aperture I was lucky to get 6200 to sync. Sometimes repeated sync brought over a few more, other times I was stuck.
With 11.1 I got them all.

I still can’t get iTunes WiFi sync working though.

PS. I finally found some use for my iPad Air 2. I set it up at work without a network connection and play on device music and randomly display family album images using LiveFrame.app. I use MindNode.app to organize projects. It’s still marginally useful but that’s progress.

Update 11/3/2017: I think WiFi sync is working now.

Update 6/9/2018: I had to do a restore to my iPad and the bug is back again. I might try iOS 4.

Life with Apple: Podcasts move to streaming only

In a move that feels as inevitable as death and taxes, Apple has made podcasts effectively streaming only. The same thing is likely to happen to all media, Podcasts just went first.

Until recently macOS iTunes and iOS Podcasts.app supported both file based sync, including Playlists, and streaming based distribution with an unreliable sync of podcast metadata.

With iOS 11 iTunes playlists are no longer represented in Podcasts.app. You can still create Playlists in iTunes made up of local files and/or cloud references, but they stay in iTunes. The Playlists were the main way I organized listening to my large collection of file-based In Our Time podcasts and my medical education podcasts. No more. I’m now dependent on the very limited (ok, crap) organization abilities of Podcasts.app.

Apple has long had problems with video that moved to an iPhone from both iCloud and iTunes. iBooks synchronization is a mess too if you mix non-Apple store ePub with streamed iBook.

This is ugly and going to get worse. We’re moving fast into the DRMd hard data-lock rental-only future.

Update: Many good threads on this in Apple Communities. They reminded me to leave feedback. Stations are not a substitute for playlist sync, but even on their own they are missing a key filter — limit to on-device items.

iTunes purchased movies showing only a handful of my purchased movies

iTunes on my Mac shows 138 movies of which 135 have purchase dates. Those 135 were purchases from Apple starting in March 2009.

If I visit those 135 in iTunes some allow me to download, some invite me to purchase again. One old SD movie allowed me to download and that worked on my iPad and showed in the Purchased list after download.

My iPhone seems to show about the same number (though it doesn’t count for me).

My new iPad shows only 24 movies as purchased. Both devices have the same iTunes account. When I view my devices in iTunes (we’re at the 10 device limit) both my iPad and iPhone show up under the same Apple Store Apple ID.

One possibility is that the purchased list on my iPad is only showing HD movies. I can’t tell from iTunes which are HD and which are SD; we almost always buy SD when it is available. Some 3+ GB files are probably HD and they don’t show up.

Something is broken in Apple DRM land. I have a private message into Apple Twitter support and an Apple Discussion post …

Update: The “something that is broken” thing is the user interface. Apple Twitter support pointed me in the right direction.

When I view Movies in TV.app on my iPad there’s a subtle top left drop down called “Library” that on tap shows a hidden filter that defaults to Recently Added.

When I change that to Movies I see them all.

I was fooled by the "See All" link to the right of "Purchased Movies" that displays when the hidden Recently Added filter is active. The “Purchased Movies” heading should really be “Recently Purchased Movies” when viewed in this mode. It shows 4 recently purchased movies, and “See All” shows all recently purchased movies.