Git and GitHub Task

The Git plugin supports direct operations on git repositories with the git task and interactions with git repositories hosted on GitHub with the github task.

• Usage
• Git Task
  • Basic Authentication
  • Git Task Response
  • Clone a Repository
  • Pull
  • Commit and Push Changes
  • Create and Push a New Branch
  • Merge Branches
• GitHub Task
  • Common Task Parameters
  • GitHub Task Response
  • Create and Delete a Repository
  • Create and Merge a Pull Request
  • Comment on a Pull Request
  • Close a Pull Request
  • Create a Tag
  • Delete a Tag
  • Delete a Branch
  • Merge Branches
  • Fork a Repo
  • Get Branch List
  • Get Tag List
  • Get Pull Request
  • Get Pull Request List
  • Get Latest Commit SHA
  • Add a Status
  • Get PR files

Usage

To be able to use the plugin in a Concord flow, it must be added as a dependency:

configuration:
  dependencies:
  - mvn://com.walmartlabs.concord.plugins:git:2.5.0

This adds the Git plugin to the classpath and allows you to invoke the Git task or the GitHub task.

Git Task

The git task allows users to trigger git operations as a step of a flow. The operations are run via git command usage in the process working directory on the Concord server.

The git task uses a number of input parameters that are common for all operations:

• url: required, the SSH or HTTPS URL of git repository
  • auth: Required for HTTPS url values, details in Basic authentication
  • privateKey: Required for SSH url values.
• workingDir: required, the name of the directory inside the process space on the Concord server into which the git repository is cloned before any operation is performed.
• action: required, the name of the operation to perform.
• org of the privateKey parameter: Optional - the name of the organization in Concord org where the secret can be located, if not specified defaults to Default.
• secretName of the privateKey parameter: required, the name of the Concord secret used for the SSH connection to the git repository on the remote server.
• password of the privateKey parameter: Optional, the password to decrypt the Concord secret, if the secret is password protected. Otherwise not required.
• ignoreErrors: instead of throwing exceptions on operation failure, returns the result object with the error, if set to true.

The git task is called with standard runtime-v2 task call syntax. Below is an example showing the common parameters with private key based authentication:

flows:
  default:
  - task: git
    in:
      action: "actionName"
      url: "[email protected]:example-org/git-project.git"
      workingDir: "git-project"
      privateKey:
        org: "myGitHubOrg"
        secretName: "mySecret"
        password: "mySecretPassword" # optional
    out: gitResult

Basic Authentication

The auth parameter is required when a private git repository is accessed with HTTPS url. It must contain a basic nested element which contains either the token element or the username and password elements.

Following example shows the common parameters with basic authentication using username & password:

flows:
  default:
  - task: git
    in:
      action: "actionName"
      url: "https://git.example.com/example-org/git-project.git"
      workingDir: "git-project"
      auth:
        basic:
          username: "any_username"
          password: "any_password"
    out: gitResult

Here is an example of using basic authentication with token:

auth:
  basic:
    token: base64_encoded_auth_token

Git Task Response

In addition to common task result fields, the git task returns a result object with following fields:

• status: NO_CHANGES if repository is clean, otherwise returns SUCCESS or FAILURE if operation successful or failed respectively.
• headSHA: HEAD commit ID for the specified branch after performing the action.
• changeList: saves the list of uncommitted changes.

Clone a Repository

The clone action of the git task can be used to clone a git repository into the Concord server process space.

It simply uses the minimal common parameters with the addition of the baseBranch parameter:

flows:
  default:
  - task: git
    in:
      action: "clone"
      url: "[email protected]:example-org/git-project.git"
      workingDir: "git-project"
      privateKey:
        org: "myGitHubOrg"
        secretName: "mySecret"
        password: "mySecretPassword" # optional
      baseBranch: "feature-a"
      ignoreErrors: true
    out: response

  - if: ${!response.ok}
    then:
    - log: "Clone action failed: ${response.error}"

The baseBranch parameter is optional and specifies the name of the branch, the commit SHA identifier or the name of a tag, used to check out after the clone operation. If not provided, the default branch of the repository is used - typically called master.

To perform a shallow clone (truncate commit history to 1) specify shallow: true and useJGit: false input parameters.

Pull

The pull action of the git task can be used to pull changes from another branch from the remote origin into the current checked out branch.

It simply uses the minimal common parameters with the addition of the remoteBranch parameter:

• remoteBranch: required, name of remote origin/branch from where the changes are pulled.

Below example is equivalent to git pull origin myRemoteBranch. In order to use a pull action in your concord flow, you have to run a clone action first so that a repository clone is available in the workingDir. The value for the workingDir parameter should be same as what was used in clone action, otherwise you end up with an repository not found exception.

flows:
  default:
  - task: git
    in:
      action: "pull"
      workingDir: "git-project"
      remoteBranch: "myRemoteBranch"
      privateKey:
        org: "myGitHubOrg"
        secretName: "mySecret"
        password: "mySecretPassword" # optional

Commit and Push Changes

The commit action of the git task can be used to commit your changes made on the cloned repository. You can push the changes to origin by setting pushChanges to true. The commit action is dependent on a prior clone action, so make sure clone action is performed first.

- task: git
  in:
    action: "commit"
    workingDir: "git-project"
    privateKey:
       org: "myGitHubOrg"
       secretName: "mySecret"
       password: "mySecretPassword" # optional
    baseBranch: "feature-a"
    commitMessage: "my commit message"
    commitUsername: "myUserId"
    commitEmail: "myEmail"
    pushChanges: true
  out: response

- if: ${response.ok}
  then:
  - log: "Commit action completed successfully."
  - log: "New HEAD commit ID: ${response.headSHA}."
  - log: "My changeList: ${response.changeList}."

The baseBranch parameter is mandatory and specifies the name of the branch to use to commit the changes. The commitMessage is a message to add to your commit operation. The pushChanges parameter is optional and defaults to false, when omitted. The commitUsername and commitEmail are mandatory parameters to capture committer details.

The new commit ID is available in ${response.headSHA}. A list of uncommitted changes is available in ${response.changeList}.

Create and Push a New Branch

The createBranch action of the git task allows the creation of a new branch in the process space. The new branch can be pushed back to the remote origin. The following parameters are needed in addition to the general parameters:

• baseBranch: Optional - the name of the branch to use as starting point for the new branch. If not provided, the default branch of the repository is used - typically called master.
• newBranch: required, the name of new branch.
• pushBranch: Required configuration to determine if the new branch is pushed to the origin repository - true or false.

The following example creates a new feature branch called feature-b off the master branch and pushes the new branch back to the remote origin.

flows:
  default:
  - task: git
    in:
      action: "createBranch"
      url: "[email protected]:example-org/git-project.git"
      workingDir: "git-project"
      privateKey:
        org: "myGitHubOrg"
        secretName: "mySecret"
        password: "mySecretPassword" # optional
      baseBranch: "master"
      newBranch: "feature-b"
      pushBranch: true
    out: response

  - if: ${response.ok}
    then:
    - log: "Create-branch action completed successfully."

Merge Local Branches

The merge action of the git task can be used to merge branches using the following parameters:

• sourceBranch: required, the name of the branch where your changes are implemented.
• destinationBranch: required, the name of the branch into which the branches have to be merged.

The following example merges the changes in the branch feature-a into the master branch.

flows:
  default:
  - task: git
    in:
      action: "merge"
      url: "[email protected]:example-org/git-project.git"
      workingDir: "git-project"
      privateKey:
        org: "myGitHubOrg"
        secretName: "mySecret"
        password: "mySecretPassword" # optional
      sourceBranch: "feature-a"
      destinationBranch: "master"
    out: response

  - if: ${response.ok}
    then:
    - log: "Merge action completed successfully."

We recommend using the merge action of the GitHub task to merge branches in large repositories, since no local cloning is required and the action is therefore completed faster.

GitHub Task

The github task of the git plugin allows you to trigger git operations on a git repository hosted on GitHub.com or a GitHub Enterprise server as a step of a flow.

While the git mentioned above works on a repository by cloning it to the Concord server and performing operations locally, the github task uses the REST API of GitHub to perform the operations. This avoids the network overhead of the cloning and other operations and is therefore advantageous for large repositories.

The apiUrl configures the GitHub API endpoint. It is best configured globally by a default process configuration policy:

{
  "defaultProcessCfg": {
    "defaultTaskVariables": {
      "github": {
        "apiUrl": "https://github.example.com/api/v3"
      }
    }
  }
}

The authors of specific projects on the Concord server can then specify the remaining parameters:

• accessToken: required, the GitHub access token.
• org: required, the name of the GitHub organization or user in which the git repository is located.
• repo: required, the name of the git repository.

The github task is called with standard runtime-v2 task call syntax. The example below includes a locally defined apiUrl:

flows:
  default:
  - task: github
    in:
      action: "createPr"
      apiUrl: "https://github.example.com/api/v3"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
    out: response

Subsequent examples take advantage of a globally configured apiUrl.

Common Task Parameters

The following input parameters are required for all github task calls. action-specific parameters are details in the action’s docs.

• action: Task action to perform
• apiUrl: GitHub API URL (e.g. https://github.example.com/api/v3)
• accessToken: Access token for GitHub API. Must have appropriate scope

GitHub Task Response

In addition to common task result fields, the github task returns a result object with one or more fields of result data depending on the action called. The field names are noted in the documentation for each action.

Create and Delete a Repository

The createRepo and deleteRepo actions of the github task allow the creation and deletion of GitHub repositories.

createRepo action creates an empty repository with the name provided by repo parameter in the GitHub organization specified by org parameter.

createRepo and deleteRepo Parameters:

• org - GitHub organization in which to create or delete the repository
• repo - Repository name to create or delete

createRepo Returned Fields:

• cloneUrl - URL from which the repository can be cloned

The example below creates a repository myRepository in the GitHub organization myOrg.

flows:
  default:
  - task: github
    in:
      action: "createRepo"
      apiUrl: "https://github.example.com/api/v3"
      accessToken: "myGitHubToken"
      org: "myRepository"
      repo: "myOrg"
    out: response

  - if: ${response.ok}
    then:
    - log: "New repository: ${response.cloneUrl}"

deleteRepo action deletes the repository with the name provided by repo parameter in the GitHub organization specified by org parameter.

GitHub access token specified should have delete_repo scope enabled to delete a repository on GitHub. This can be done in Personal Access Token under Developer Settings for the intended user on GitHub.

The example below deletes the repository myRepository from the GitHub organization myOrg.

flows:
  default:
  - task: github
    in:
      action: "deleteRepo"
      apiUrl: "https://github.example.com/api/v3"
      accessToken: "myGitHubToken"
      org: "myRepository"
      repo: "myOrg"
    out: response

A few points to consider:

• both createRepo and deleteRepo actions are idempotent.
  • createRepo action does not fail if the repository already exists in an organization, but returns the clone URL of the repository.
  • similarly, deleteRepo action does not fail if the repository does not exist in the organization.
• createRepo action can be supplemented by other git and github task actions to commit code/documentation, and configure the repository.
• deleteRepo action is irreversible. The repository, its contents and the commit history will be deleted, and cannot be recovered.

Create and Merge a Pull Request

The createPr and mergePr actions of the github task allow the creation and merging a pull request in GitHub. Executed one after another, the tasks can be used to create and merge a pull request within one Concord process.

createPr Parameters:

• org: name of GitHub organization where your repository is located.
• repo: repository in which to create the pull request.
• prTitle: the title used for the pull request.
• prBody: the description body for the pull request.
• prSourceBranch: the name of the branch from where changes are implemented.
• prDestinationBranch: the name of the branch into which the changes are merged.

createRepo Returned Fields:

• prId - int, pull request number.

The example below creates a pull request to merge the changes from branch feature-a into the master branch:

flows:
  default:
  - task: github
    in:
      action: "createPr"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      prTitle: "Feature A"
      prBody: "Feature A implements the requirements from request 12."
      prSourceBranch: "feature-a"
      prDestinationBranch: "master"
    out: createResponse

  - log: "Got PR ID: ${createResponse.prId}"

The mergePr action can be used to merge a pull request. The pull request identifier has to be known to perform the action. It can be available from a form value, an external invocation of the process or as output parameter from the createPr action. The example below uses the pull request identifier createResponse.prId, that was returned from the createPr action above. commitMessage is a string that can be used to post custom merge commit messages. If omitted, a default message is used. mergeMethod is optional string that can be used to specify merge method to use (possible values are merge, squash or rebase).

mergePr Parameters:

• org: name of GitHub organization where your repository is located.
• repo: repository in which the pull request is located.
• prId: pull request number.
• commitMessage: optional, Custom merge commit message.
• mergeMethod: optional, one of are merge, squash or rebase

flows:
  default:
  - task: github
    in:
      action: "mergePr"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      prId: "${createResponse.prId}"
      commitMessage: "my custom merge commit message"
      mergeMethod: "squash"
    out: mergeReponse

Comment on a Pull Request

The commentPR action can be used to add a comment to a pull request.

The pull request identifier has to be known to perform the action. It can be available from a form value, an external invocation of the process or as output parameter from the createPr action.

The example below uses the pull request identifier createResponse.prId, that was return from the createPr action above. prComment is the string that is posted to the pull request as a comment. The accessToken used determines the user adding the comment.

commentPR Parameters:

• org: GitHub organization in which to create the repository.
• repo: repository in which the pull request is located.
• prId: pull request number.
• prComment: comment text.

flows:
  default:
  - task: github
    in:
      action: "commentPR"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      prId: "${createResponse.prId}"
      prComment: "Some pr comment"

Close a Pull Request

The closePR action can be used to close a pull request. The pull request identifier has to be known to perform the action. It can be available from a form value, an external invocation of the process or as output parameter from the createPr action. The example below uses the pull request identifier myPrId, that was populated with a value in the createPr action above.

closePR Parameters:

• org: name of GitHub organization where your repository is located.
• repo: repository in which the pull request is created.
• prId: pull request number.

flows:
  default:
  - task: github
    in:
      action: "closePR"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      prId: "${myPrId}"

Create a Tag

The createTag action of the github task can create a tag based on a specific commit SHA. This commit identifier has to be supplied to the Concord flow - typically via a parameter from a form or an invocation of the flow from another application. One example is the usage of the Concord task in the Looper continuous integration server.

createTag Parameters:

• org: name of GitHub organization where your repository is located.
• repo: repository in which to create the tag.
• commitSHA: the SHA of the git commit to use for the tag creation.
• tagVersion: the name of the tag e.g. a version string 1.0.1.
• tagMessage: the name of the author of the tag.
• tagAuthorName: the email of the author of the tag.

flows:
  default:
  - task: github
    in:
      action: "createTag"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      tagVersion: "1.0.0"
      tagMessage: "Release 1.0.0"
      tagAuthorName: "Jane Doe"
      tagAuthorEmail: "[email protected]"
      commitSHA: "${gitHubBranchSHA}"

Delete a Tag

The deleteTag action of the github task can be used to delete an existing tag from GitHub repository

deleteTag Parameters:

• org: name of GitHub organization where your repository is located.
• repo: name of GitHub repository where your tag is located.
• tagName: name of tag that you want to delete from your org/repo.

flows:
  default:
  - task: github
     in:
       action: "deleteTag"
       accessToken: "myGitHubToken"
       org: "myGitHubOrg"
       repo: "myGitHubRepo"
       tagName: "myTagName"

Delete a Branch

The deleteBranch action of the github task can be used to delete an existing branch from GitHub repository

deleteBranch Parameters:

• org: name of GitHub organization where your repository is located.
• repo: name of GitHub repository where your tag is located.
• branch: name of the branch that you want to delete.

flows:
  default:
  - task: github
     in:
       action: "deleteBranch"
       accessToken: "myGitHubToken"
       org: "myGitHubOrg"
       repo: "myGitHubRepo"
       branch: myBranchName

Merge Branches

The merge action of the github task can merge two branches of a repository on GitHub. Compared to merging branches with the git task, it does not require a local clone of the repository and is therefore faster in the execution and requires no local storage on the Concord server.

The parameters identifying the branches to merge have to be supplied to the Concord flow - typically by a parameter from a form or an invocation of the flow from another application.

merge Parameters:

• org: name of GitHub organization where your repository is located
• repo: repository in which the pull request is located.
• base: the name of the base branch into which the head is merged.
• head: the identifier for the head to merge. Head can be specified by using a branch name or a commit SHA1.
• commitMessage: the message to use for the merge commit. If omitted, a default message is used. Expressions can be used to add process information.

flows:
  default:
  - task: github
    in:
      action: "merge"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      base: "master"
      head: "${gitHubBranchName}"
      commitMessage: "Automated merge performed by Concord flow."

Fork a Repo

The forkRepo action can be used to fork a git repository on GitHub. By default, the repo is forked into your personal account associated with the accessToken.

forkRepo Parameters:

• org: name of GitHub organization where your repository is located.
• repo: name of GitHub repository that you want to fork.
• targetOrg: optional, if a value is specified the repository is forked into specified organization, otherwise the target is the personal space of the user specified with the accessToken.

flows:
  default:
  - task: github
    in:
      action: "forkRepo"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      targetOrg: "myForkToOrg"

GetBranchList

The getBranchList action can be used to get the list of branches of a GitHub repository. The output of the action is stored in a variable branchList. It can be used at a later point in the flow

getBranchList Parameters:

• org: name of GitHub organization where your repository is located.
• repo: name of GitHub repository for which you want to get the branch list.

getBranchList Returned Fields:

• branchList - list, branches from the specified repository

flows:
  default:
  - task: github
    in:
      action: getBranchList
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
    out: response

  - if: ${response.ok}
    then:
      - log: "Got ${response.branchList.size()} branches: ${response.branchList}"

GetTagList

The getTagList action can be used to get the list of tags of a GitHub repository. The output of the action is stored in a variable tagList. It can be used at a later point in the flow.

getTagList Parameters:

• org: name of GitHub organization where your repository is located.
• repo: name of GitHub repository for which you want to get the tag list.

getTagList Returned Fields:

• tagList - list, tagList from the specified repository

flows:
  default:
  - task: github
    in:
      action: "getTagList"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
    out: response

  - if: ${response.ok}
    then:
      - log: "Got ${response.tagList.size()} tags: ${response.tagList}"

Get Pull Request

The getPR action can be used to get a specific PR from a GitHub repository. The output of the action is stored in a variable pr, containing the PullRequest details. It can be used at a later point in the flow.

getPR Parameters:

• org: name of GitHub organization.
• repo: name of GitHub repository.
• prNumber: pull request number to get.

getPR Returned Fields:

• pr - object, pull request details. See Pulls docs for more details.

flows:
  default:
  - task: github
    in:
      action: "getPR"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      prNumber: 123
    out: response

  - log: "PR HEAD SHA: ${response.pr.head.sha}"

Get Pull Request List

The getPRList action can be used to get the list of PRs from a GitHub repository. The output of the action is stored in a variable prList, which is a list of PullRequest values. It can be used at a later point in the flow.

getPRList Parameters:

• org: name of GitHub organization.
• repo: name of GitHub repository.
• state: optional, state of a PR. Defaults to open. Allowed values are all, open, closed.

getPRList Returned Fields:

• prList: list of pull request objects. See Pulls docs for more details.

flows:
  default:
  - task: github
    in:
      action: getPRList
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      state: "closed"
    out: response
  - if: ${response.prList.isEmpty()}
    then:
    - log: "Got zero PRs"
    else:
    - log: "PR Numbers : ${response.prList.stream().map(c -> c.get('number')).toList()}"
    - log: "PR Titles: ${response.prList.stream().map(c -> c.get('title')).toList()}"

GetLatestSHA

The getLatestSHA action can be used to get the SHA identifier of the latest commit for a given branch. By default, it gets the SHA from the master branch. The output of the action is stored in the variable latestCommitSHA. It can be used at a later point in the flow.

getLatestSHA Parameters:

• org: name of GitHub organization.
• repo: name of GitHub repository.
• branch: name of GitHub branch from which you want to get the latest commit SHA. Defaults to master.

getLatestSHA Returned Fields:

• latestCommitSHA: SHA of the latest commit in the specified branch

flows:
  default:
  - task: github
    in:
      action: "getLatestSHA"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      branch: "myBranch"
    out: resp
  - if: ${resp.ok}
    then:
      - log: "Latest commit SHA: ${resp.latestCommitSHA}"

Add a Status

The addStatus action can be used to add status messages to a commit.

addStatus Parameters:

• org: name of GitHub organization where your repository is located.
• repo: name of GitHub repository.
• commitSHA: ID of the commit which should receive the status update.
• context, state, targetUrl and description: attributes of the status update. See the GitHub API documentation for details.

flows:
  default:
  - task: github
    in:
      action: "addStatus"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      commitSHA: "dfd5...0262"
      context: "myContext"
      state: "pending"
      targetUrl: "https://concord.example.com/#/process/${txId}"
      description: "my status description"

Get Pull Request Files

The getPRfiles action can be used to get a list of files that were modified, added, or deleted in a specific pull request.

getPRfiles Parameters:

• org: name of GitHub organization.
• repo: name of GitHub repository.
• prNumber: pull request number to get.

getPRfiles Returned Fields:

• prFiles - list of changes in PR. See [https://docs.github.com/en/free-pro-team@latest/rest/pulls/pulls?apiVersion=2022-11-28#list-pull-requests-files) for more details;
• prFilesModified - list of modified files;
• prFilesAdded - list of added files;
• prFilesRemoved - list of removed files;
• prFilesAny - list of modified, added and removed files;

flows:
  default:
  - task: github
    in:
      action: "getPRfiles"
      accessToken: "myGitHubToken"
      org: "myGitHubOrg"
      repo: "myGitHubRepo"
      prNumber: 123
    out: result

  - log: "All files: ${result.prFiles}"
  - log: "Modified file names: ${result.prFilesModified}"
  - log: "Added file names: ${result.prFilesAdded}"
  - log: "Removed file names: ${result.prFilesRemoved}"
  - log: "Any file names: ${result.prFilesAny}"