Petrel Data Service Pilot

The Petrel Data Service pilot provides a mechanism for Argonne researchers and ALCF users to store their data and trivially share with collaborators, without the burden of local account management. This system has been developed and is being operated via collaboration between Argonne Leadership Computing Facility and Globus team. Petrel leverages storage and infrastructure provided by the ALCF, and Globus Transfer and Sharing services for researchers to store large research data, move data in and out of the system, and to make (subsets) of the data available to their collaborators.Note that there is no compute associated with this – the data will need to be staged to a compute machine for further analysis.This document outlines the steps to create and manage an allocation on the Petrel Data Service.

Setting up a new project

Allocation Process and Model

Any Argonne PI can apply for a allocation on the Petrel project by providing some basic information on the project. Once approved, a project space will be created for the PI and they will be invited to join a project group to manage the allocation. The project group can be used by the PI to assign project manager roles to other users. A project manager has access to the project space and can allow other users read or read/write access to the project space.
In addition to the above, the PI and project managers can choose subsets of the project space and give access to other users on the subset.

New Allocation Request

To request a new project, a PI needs to apply for it using the following steps:

  1. Click here to request a allocation. If you don’t have a Globus account, you will need to Sign Up for a Globus account.


  1. Choose the option to “Join the Group” and complete the form.
    • The “Current Project Name” you provide will be used as names for the various project allocation.
  1. Once you submit your request, you will receive a confirmation email that your request has been received.
  2. Your request will be evaluated and you will be notified whether your application has been accepted or rejected. If accepted, you will added to a group and can proceed with next steps.

New Project Setup

Once your allocation has been approved, you will receive an invite to another group that you will have rights to manage, and will need to complete the following steps to setup your project

  1. You will receive a project group invitation and will need to accept it.
  2. You will then be able to login to Globus to check your project endpoint. A name of the endpoint will be petrel#<projectname>. E.g., for the ‘speedpage’ user who named his project, ‘testbed’, a name of a default project shared endpoint is petrel#testbed.
    • Note: if your project name had whitespaces, they will be removed, and the string will be converted to lower case.

You will also be made a manager of a group created for your project, called <projectname>. You will see this listed on this, under the “Manager Of” on the left hand side tab.

Adding new Managers

To add new managers, invite user to the <projectname> group via email address. You can do that using the “Members” tab on your group’s page. Once the user accepts the invite and is added to the group, you can grant the “Manager” role by clicking the pen icon on the right side of the user row and selecting the “Manager” radio button. A user with the “Manager” role can invite other users to the project group, accept membership requests, and share data from the project space with other users and groups.

Sharing data from Petrel

Sharing all of your project space other users

To share all of your project space with other users, use the following steps:

  • Open in your browser and find your project group.
  • In the “Members” tab click “Invite people to this group” and invite Globus users you would like to share your entire project space.

Sharing some subset of your project space with other users or groups

To share selected folders with other users, use the following steps:

  • Enter or browse a path and a user/group you want to share the path with.

Transferring Data to and from your project space

Using the Globus website:

To transfer data from/to the project space, go to, select the petrel#<projectname> endpoint from the drop down menu on one side of the window, choose another endpoint from the other drop down, you would like to transfer data to/from, and submit the transfer by pressing one of the two large arrow buttons in the center of the screen.

Using a command line script


Script let’s the user transfer or synchronize between two endpoints. It can be used in two modes:

  • batch mode: runs in the background. can be used to setup a cron job to keep two directories in sync.
  • interactive mode: user can submit transfers.


  1. Download the mirror script tarball from here:
    curl -Ov
  2. After downloading the mirror script tarball, you will need to unpack it:
    tar xf mirror.tgz
  3. After that, change directory into the mirror script package directory:
    cd mirror
  4. Change permission on script:
    chmod +x

Sync directories

This section discusses using the script to keep two directories in sync across two endpoints. Specific use case maybe data collected at one endpoint needs to be transferred to another. The script can be setup as a cron job, at desired frequency depending on delay that can be tolerated and the directories will be kept in sync.

  • Prepare

    To prepare the script to be run as a cron/batch job, you’ll first need to run it in batch_setup mode. This will prompt you for the details needed to run the transfer job(s) you wish to submit and will save the config information so it can be used by the script when it is run in batch_start mode:

    ./ –batch_setup

    Follow the instructions and your config will be created for your transfer job(s).

    [ranantha@rachanalaptop:~/MyFolders/work/petrel/mirror] ./ –batch_setup
    Enter Globus Credentials:
    Enter Username: ranantha
    Enter Password:
    Enter source endpoint name: go#ep1
    Enter source endpoint path: foo
    Enter destination endpoint name: go#ep2
    Enter destination endpoint path:
    Enter transfer deadline in hours (enter ‘0’ for none): 0
    Add another transfer (y/n): n
    Token saved to: /Users/ranantha/.globusonline/mirror/mirror_token_file
    Config saved to: /Users/ranantha/.globusonline/mirror/mirror.cfg
  • Setup task

    You can then submit the transfer job(s) you’ve configured by running the script in batch_start mode:

    ./ –batch_start

    This can be setup as a cron task or a windows ?? at interval of choice to keep in sync.

  • Monitor

    You can monitor the progress of your job by logging into the Globus website and going to this URL:

Interactive Mode

The script also has an interactive mode that you can use for testing your job configuration. Interactive mode will prompt you for all the same values that config mode does but, unlike batch_setup mode, will actually submit the job and will *not* save any of the config data you’ve entered into the config files.

./ –interactive

Transfers, transfer errors, and other data are logged to the ~/.globusonline/mirror/mirror.log file.

Leave a Reply

Your email address will not be published. Required fields are marked *