Skip to content

Commit 956cf34

Browse files
authored
Replace /dune/app with /exp/dune/app
1 parent 704ce3c commit 956cf34

File tree

1 file changed

+11
-11
lines changed

1 file changed

+11
-11
lines changed

_episodes/07-grid-job-submission.md

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -72,7 +72,7 @@ mkdir -p /pnfs/dune/scratch/users/${USER}/may2023tutorial
7272
Having done that, let us submit a prepared script:
7373

7474
~~~
75-
jobsub_submit -G dune --mail_always -N 1 --memory=1000MB --disk=1GB --cpu=1 --expected-lifetime=1h --singularity-image /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest --append_condor_requirements='(TARGET.HAS_Singularity==true&&TARGET.HAS_CVMFS_dune_opensciencegrid_org==true&&TARGET.HAS_CVMFS_larsoft_opensciencegrid_org==true&&TARGET.CVMFS_dune_opensciencegrid_org_REVISION>=1105)' -e GFAL_PLUGIN_DIR=/usr/lib64/gfal2-plugins -e GFAL_CONFIG_DIR=/etc/gfal2.d file:///dune/app/users/kherner/submission_test_singularity.sh
75+
jobsub_submit -G dune --mail_always -N 1 --memory=1000MB --disk=1GB --cpu=1 --expected-lifetime=1h --singularity-image /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest --append_condor_requirements='(TARGET.HAS_Singularity==true&&TARGET.HAS_CVMFS_dune_opensciencegrid_org==true&&TARGET.HAS_CVMFS_larsoft_opensciencegrid_org==true&&TARGET.CVMFS_dune_opensciencegrid_org_REVISION>=1105)' -e GFAL_PLUGIN_DIR=/usr/lib64/gfal2-plugins -e GFAL_CONFIG_DIR=/etc/gfal2.d file:///exp/dune/app/users/kherner/submission_test_singularity.sh
7676
~~~
7777

7878
If all goes well you should see something like this:
@@ -180,11 +180,11 @@ There are many ways of doing this but by far the best is to use the Rapid Code D
180180
If you have finished up the LArSoft follow-up and want to use your own code for this next attempt, feel free to tar it up (you don't need anything besides the localProducts* and work directories) and use your own tar ball in lieu of the one in this example.
181181
You will have to change the last line with your own submit file instead of the pre-made one.
182182

183-
First, we should make a tarball. Here is what we can do (assuming you are starting from /dune/app/users/username/):
183+
First, we should make a tarball. Here is what we can do (assuming you are starting from /exp/dune/app/users/username/):
184184

185185
```bash
186-
cp /dune/app/users/kherner/setupmay2023tutorial-grid.sh /dune/app/users/${USER}/
187-
cp /dune/app/users/kherner/may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof/setup-grid /dune/app/users/${USER}/may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof/setup-grid
186+
cp /exp/dune/app/users/kherner/setupmay2023tutorial-grid.sh /exp/dune/app/users/${USER}/
187+
cp /exp/dune/app/users/kherner/may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof/setup-grid /exp/dune/app/users/${USER}/may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof/setup-grid
188188
```
189189

190190
Before we continue, let's examine these files a bit. We will source the first one in our job script, and it will set up the environment for us.
@@ -210,17 +210,17 @@ mrbslp
210210

211211

212212
Now let's look at the difference between the setup-grid script and the plain setup script.
213-
Assuming you are currently in the /dune/app/users/username directory:
213+
Assuming you are currently in the /exp/dune/app/users/username directory:
214214

215215
```bash
216216
diff may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof/setup may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof/setup-grid
217217
```
218218

219219
~~~
220-
< setenv MRB_TOP "/dune/app/users/<username>/may2023tutorial"
221-
< setenv MRB_TOP_BUILD "/dune/app/users/<username>/may2023tutorial"
222-
< setenv MRB_SOURCE "/dune/app/users/<username>/may2023tutorial/srcs"
223-
< setenv MRB_INSTALL "/dune/app/users/<username>/may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof"
220+
< setenv MRB_TOP "/exp/dune/app/users/<username>/may2023tutorial"
221+
< setenv MRB_TOP_BUILD "/exp/dune/app/users/<username>/may2023tutorial"
222+
< setenv MRB_SOURCE "/exp/dune/app/users/<username>/may2023tutorial/srcs"
223+
< setenv MRB_INSTALL "/exp/dune/app/users/<username>/may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof"
224224
---
225225
> setenv MRB_TOP "${INPUT_TAR_DIR_LOCAL}/may2023tutorial"
226226
> setenv MRB_TOP_BUILD "${INPUT_TAR_DIR_LOCAL}/may2023tutorial"
@@ -229,7 +229,7 @@ diff may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof/setup may2023tutor
229229
~~~
230230

231231
As you can see, we have switched from the hard-coded directories to directories defined by environment variables; the `INPUT_TAR_DIR_LOCAL` variable will be set for us (see below).
232-
Now, let's actually create our tar file. Again assuming you are in `/dune/app/users/kherner/may2023tutorial/`:
232+
Now, let's actually create our tar file. Again assuming you are in `/exp/dune/app/users/kherner/may2023tutorial/`:
233233
```bash
234234
tar --exclude '.git' -czf may2023tutorial.tar.gz may2023tutorial/localProducts_larsoft_v09_72_01_e20_prof may2023tutorial/work setupmay2023tutorial-grid.sh
235235
```
@@ -238,7 +238,7 @@ Note how we have excluded the contents of ".git" directories in the various pack
238238
Then submit another job (in the following we keep the same submit file as above):
239239

240240
```bash
241-
jobsub_submit -G dune --mail_always -N 1 --memory=2500MB --disk=2GB --expected-lifetime=3h --cpu=1 --tar_file_name=dropbox:///dune/app/users/<username>/may2023tutorial.tar.gz --singularity-image /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest --append_condor_requirements='(TARGET.HAS_Singularity==true&&TARGET.HAS_CVMFS_dune_opensciencegrid_org==true&&TARGET.HAS_CVMFS_larsoft_opensciencegrid_org==true&&TARGET.CVMFS_dune_opensciencegrid_org_REVISION>=1105&&TARGET.HAS_CVMFS_fifeuser1_opensciencegrid_org==true&&TARGET.HAS_CVMFS_fifeuser2_opensciencegrid_org==true&&TARGET.HAS_CVMFS_fifeuser3_opensciencegrid_org==true&&TARGET.HAS_CVMFS_fifeuser4_opensciencegrid_org==true)' -e GFAL_PLUGIN_DIR=/usr/lib64/gfal2-plugins -e GFAL_CONFIG_DIR=/etc/gfal2.d file:///dune/app/users/kherner/run_may2023tutorial.sh
241+
jobsub_submit -G dune --mail_always -N 1 --memory=2500MB --disk=2GB --expected-lifetime=3h --cpu=1 --tar_file_name=dropbox:///exp/dune/app/users/<username>/may2023tutorial.tar.gz --singularity-image /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest --append_condor_requirements='(TARGET.HAS_Singularity==true&&TARGET.HAS_CVMFS_dune_opensciencegrid_org==true&&TARGET.HAS_CVMFS_larsoft_opensciencegrid_org==true&&TARGET.CVMFS_dune_opensciencegrid_org_REVISION>=1105&&TARGET.HAS_CVMFS_fifeuser1_opensciencegrid_org==true&&TARGET.HAS_CVMFS_fifeuser2_opensciencegrid_org==true&&TARGET.HAS_CVMFS_fifeuser3_opensciencegrid_org==true&&TARGET.HAS_CVMFS_fifeuser4_opensciencegrid_org==true)' -e GFAL_PLUGIN_DIR=/usr/lib64/gfal2-plugins -e GFAL_CONFIG_DIR=/etc/gfal2.d file:///exp/dune/app/users/kherner/run_may2023tutorial.sh
242242
```
243243

244244
You'll see this is very similar to the previous case, but there are some new options:

0 commit comments

Comments
 (0)