How to only build one directory in a Jenkins multi-branch pipeline job?

Mark Allison picture Mark Allison · Jul 4, 2017 · Viewed 6.9k times · Source

I have a github repo called multibranch-test with two sub-directories Project1, Project2.

PS C:\Repos\multibranch-test> tree . Folder PATH listing for volume Windows Volume serial number is 2085-6D3D C:\REPOS\MULTIBRANCH-TEST ├───Project1 └───Project2

Each sub-directory has a Jenkinsfile and the code for that project.

In Jenkins I have two multibranch pipeline jobs - one for Project1 and one for Project2. In the configuration for Project1 I don't want a push notification or polling to build Project1 if a commit was pushed in sub-directory for Project2.

So in Project1 I have configured Additional Behaviours:

  • Advanced clone behaviours: Shallow clone is checked
  • Sparse checkout path is set to Project1#
  • Polling ignores commits in certain paths
    • Included Regions: Project1/*
    • Excluded Regions: *
  • Build Configuration: Script Path: Project1/Jenkinsfile

What is happening is if I push a commit to master in sub-directory Project2, both Project1 and Project2 jobs get built. I only want Project2 to build. Can someone point out what I'm doing wrong?

Jenkinsfiles for both Projects are similar and look like:

#!groovy
node  {
    stage ('checkout') {
        checkout scm
    }

    stage ('build') {
        dir ('Project1') {
            bat 'powershell -Command gci'
            bat 'powershell -Command gci env:'
            bat 'powershell -File .\\Project1.ps1'
        }
    }

Answer

Garrett Clyde picture Garrett Clyde · Oct 12, 2017

This has been a big hassle for us, but we were able to solve it with some workarounds.

We have a master Jenkins job that's triggered by a GitHub commit hook. It figures out what changed since the last commit, and then triggers other service-specific Jenkins jobs.

We have some other conventions we're using (like naming conventions for services, directories, and Jenkins jobs) that aren't specified here, but hopefully this will help someone out.

Here's a breakdown of each component in the solution:

  1. Jenkins jobs and corresponding Jenkinsfiles for each service in the monorepo.

C:\REPOS\MULTIBRANCH-TEST\Project1\Jenkinsfile (your build logic here) C:\REPOS\MULTIBRANCH-TEST\Project2\Jenkinsfile (your build logic here)

  1. A shell script, that gets a list of what changed since the last commit (adapted from this blog post).

C:\REPOS\MULTIBRANCH-TEST\change-sets.sh

    #!/usr/bin/env bash

    changeSets=(`git diff-tree --name-status HEAD`)
    for(( i=0; i<${#changeSets[@]}; i++))
    do
      if [ ${changeSets[$i]} == "M" ]
      then
        echo ${changeSets[$i+1]}
      fi
    done
  1. A Jenkins job that builds on GitHub commit hook

C:\REPOS\MULTIBRANCH-TEST\Jenkinsfile

    #!/usr/bin/env groovy

    pipeline {
        agent any

        stages {

            stage('Define Services to Build') {
                steps {
                    script {

                        def SERVICES_TO_BUILD = sh script:"./change-sets.sh", returnStdout: true
                        SERVICES_TO_BUILD.split("\n").each {
                            echo "Triggering build for ${it}"
                            try {
                                build job: "${it}", propagate: false, wait: false
                            } catch (ex) {
                                echo "Failed to trigger build for ${it}: ${ex.message}"
                            }

                        }
                    }
                }
            }
        }
    }