Can I install Xcode on an external hard drive along with the iPhone Simulator.app?

Omar Emam picture Omar Emam · Dec 3, 2019 · Viewed 27.6k times · Source

I want to install xcode to deploy a cross platform flutter application but I cant find enough space for Xcode is there any alternative solutions to just installing it on the internal storage

Answer

cseder picture cseder · Dec 27, 2019

PLEASE READ THIS FIRST!

Currently, this answer is only valid for systems that runs:

XCode <= v.11.3 running macOS <= v.10.15.2

Why? (Short Version):

With XCode 11.3.x, Apple activated a few (until now) dormant checks in /usr/lib/libxcselect.dylib that enabled checking if the developer tools is located on a read-only / immutable system partition guarded by SIP and gets triggered when you do a xcode-select -s directory switch attempt.

The 11.x "Big Sur" macOS versions, locked it down much harder still, because of things like this. Moving system related files, or even booting from external drives won't work, because the new "encryption seal", part of the new SSV (Signed System Volume) refuses to boot or run select programs if the hash is altered (files in / out etc).

I have not yet found a way to work around these checks. I take no responsibility for broken systems after using this method, and if you choose to tinker with a newer version of XCode / macOS, please take a full backup first! Good Luck!


Installing Xcode, Simulators and Other Tools to External Storage

As mentioned in the comments, if you already have Xcode installed the process is quite simple. Start by copying Xcode from the Internal HD to an External drive, rename the original and run the commands from step 4 & 5, and this should do the trick. If so, delete the original (now renamed) directory / app bundle.

My experience is that if you don't have Xcode already, the process is a bit more involved.

There may be simpler ways to do this, but after getting different errors for every thing I've tried, I've done it this way on a MacBook Pro 16" running macOS Catalina (10.15.2) and Xcode 11.3:

I have my external drive attached to the MacBook at all times, using a bit of Velcro as the Samsung T5 drive I use is so small and light. It's mounted at:
/Volumes/SSD

On the external drive I've copied Xcode into:
/Volumes/SSD/Applications

Follow this procedure for installing Xcode:

  1. Download the latest 11.3 Xcode release (not the Beta) from Apple's Developer Site (This is a 7.3GB Download and you need to register for a free developer account by the way)

  2. Install the Xcode command-line tools (to the internal drive), which can be triggered by running the following command in a terminal: sudo xcode-select --install
    This will trigger the installation of the command-line tools and establish the /Library/Developer/CommandLineTools path and set this as the default developer tools path after installation.

  3. Now, the Xcode download comes as a .xip file that needs to be expanded / unpacked using the Archive Utility included with macOS.
    I've already created a directory on the SSD:
    /Volumes/SSD/Applications
    and moved the Xcode_11_3.xip file here before extracting it by double- clicking it in the Finder.
    NOTE: It will unpack to the same folder as the .xip file, into Xcode.app but leaves the 7.3GB .xip file there as well. After unpacking, you may move the .xip file somewhere for backup or just delete it.

  4. Now change the default developer tools directory with command:
    sudo xcode-select -s /Volumes/SSD/Applications/Xcode.app/Contents/Developer
    then do another zsh -lor restart the Terminal.app.

  5. After setting the Xcode.app as the default developer tools directory, run this command, to have Xcode figure itself out:
    /usr/bin/xcrun --find xcodebuild

    This took a little while, then I got back:
    /Volumes/SSD/Applications/Xcode.app/Contents/Developer/usr/bin/xcodebuild

Moving The Simulators / Emulators

The simulators, caches and all that also takes up a considerable amount of space but lives elsewhere.
For Xcode, the simulators are normally located within:
~/Library/Developer/CoreSimulator

You'll want to move this whole directory structure to your external drive if you're looking to maximize the available space on the local drive. You can use a regular move operation via Finder.app by first doing a regular ⌘ + C (cmd+c) to copy ~/Library/Developer/CoreSimulator then in the target location, You can use ⌥ + ⌘ + V (opt+cmd+v) to move the copied contents directly (might require admin password).

I use /Volumes/SSD/Library/Developer/

Just had to mention this as many don't know how to properly "cut and paste" files in the Finder, ending up copying first then going back to delete... :)

Now make a symlink using:

ln -s /Volumes/SSD/Library/Developer/CoreSimulator /Users/<your_user>/Library/Developer

You should now be able to use and update the simulators as usual. First time run may throw an error, but subsequent runs should be fine. Sometimes a reboot might be a good thing as well...

The Android emulators are by default located somewhere beneath ~/.android/
Use the same procedure as for the Xcode simulators to move the whole ~/.android directory to a place on your external drive and symlink as described, so you end up with something like:

.android -> /Volumes/SSD/Library/android

when you do a $ ls -la ~ in your Terminal.

Note For Homebrew Users

If you're using Homebrew for installing packages (like many does), it seems as if Homebrew won't register that you have the CommandLineTools installed if you move the /Library/Developer/CommandLineTools directory, and will try to compile some bottles from source.
Homebrew apparently needs some tools found in the separate Command Line Tools package installed with sudo xcode-select --install that's missing from the regular Xcode install (I noticed this when upgrading to a new version of Python, it was still being compiled from source no matter what I tried.)
So, if you use Homebrew, you're probably better off keeping the Command Line Tools installed at the default location. Just install as described with the sudo xcode-select --install command and leave it there, it's not taking up much space anyway.

IMPORTANT, remember to accept the xcodebuild licenses before using a tool that depends on it, using a command like this (with your own path):

sudo /Volumes/SSD/Applications/Xcode.app/Contents/Developer/usr/bin/xcodebuild -license accept

or in cases where the developer tools are already detected and found on an external drive, and the path has been set by XCode:

sudo xcodebuild -license accept should do the trick.

As I said, there might be simpler solutions out there, but after doing it this way I've been able to use Homebrew without errors and Xcode + tools with MacOS, iOS and Flutter frameworks.

Also, I've created an alias to the Xcode.app in /Applications to have it conveniently placed together with the other apps. (Cmd + Opt drag the Xcode.app to /Applications in Finder). Saved myself a ton of space on the internal drive this way.


In response to questions in the comments:

Can I upgrade Xcode / Simulators after using this method?

As long as you create a good old "alias" from the external drive's Xcode.app to /Applications/Xcode.app by dragging the app while holding ⌥ + ⌘, I've not had any problems updating, BUT I upgrade by downloading from the Apple Developer Site, not through macOS AppStore, as I've noticed that the AppStore doesn't accept the alias and thinks that Xcode isn't installed.


Updates regarding Xcode Versions > 11.3

As I mentioned in the top of the answer, I can't vouch for this answer if you're using an Xcode version higher than 11.3.

I've gone through all the steps using a fresh install on a new machine.

I experienced a couple of showstoppers while trying to figure this one out, and I only had limited time to spare for doing this. The problems were a bit more involved than expected.

TODO:
✅ Disk arrived today (Tue, Sep 8)
✅ Install macOS, Xcode, Android SDK and Flutter SDK dev files
✅ Move Flutter SDK, Android SDK and Android emulator to external SSD
✅ Move iOS Simulator files to external SSD
[🛑] FAILED: Move Xcode and Platform files to external SSD
✅ Adapt Zsh environment variables / scripts to reflect the changes


It appears that those who have SIP enabled (probably most users) will get in trouble when accessing tools from within the Xcode app bundle if it's moved outside the internal drive.

You may think that, "hey, I have my tools in /usr/bin or somewhere else, but the problem is that these files are merely shim binaries, which use a system library to resolve a path to a Developer directory, where all the actual executable files, libraries and support files are installed.

This complicates matters further as you now no longer even know which of these files are in actual use. Just try doing:

$ otool -L /usr/bin/xcrun
# or
$ otool -L /usr/bin/xcode-select

And see what pours out... Same goes for most of the tools.

If you disassemble /usr/lib/libxcselect.dylib (is that allowed? 👀) there's apparently some additional checks being performed when running Xcode after version 11.3.

I went back and checked and the configuration have had these tests available for a few versions, but they haven't been activated in previous consumer builds.

So when a directory switch is attempted as described in my original answer, the libxcselect tool will now perform at least one (in)sanity check to ensure that Xcode and its tools are run from internal (safe) storage, which has an immutable system configuration guarded by SIP. System Integrity Protection, so, you can't just move or delete it.

My guess is that you'll have to disable SIP to be able to make this work, and that is not an acceptable solution, as it opens up for lots of security and stability issues (even worse performance).

Finding a Middle Ground

Problem: How to free up space on an internal drive, by moving developer files to an external drive.
I've tried pretty much everything I can think of regarding the moving Xcode part, but I've met new roadblocks and showstoppers no matter what.

SO. I had to throw in the towel on this one, finding a compromise. I can live with having saved approximately 50GB of space on my MacBook Pro's internal 256GB NVMe drive.

I had no trouble moving: ~/Library/Android/* (The whole Android SDK directory) ~/.android/* (Caches and .avd emulator image files)

Using nothing but symbolic links, after copying the contents and deleting the originals. This is only interesting for those who develop using the Android SDK and tools, so sadly I wasn't able to solve this madness caused by Apple's restrictive new policy regarding executable files in "foreign, hostile" locations.
These two directories alone saved me a fair share of space, so I guess for the time being that's about it.

I've tried moving some parts of the Xcode bundle out of the app bundle with varying degree of success, but as you can see in this screenshot:

Xcode Space Usage

The bulk of the Xcode.app is within the "Platforms" directory, and when I start messing with those files, the build tools blows up on me, but sometimes not, so I really don't know.

The Simulator files themselves are possible to move, and this will save you anything between a few gigabytes to plenty of GBs depending on how many platforms (iOS / iPadOS etc.) versions you use.

These are located inside: ~/Library/Developer/CoreSimulator I've been able to move this whole CoreSimulator directory without too much trouble using symlinks as explained in the original answer.

I will continue trying to figure this one out, but right now, this is where it's at.