Changes between Version 13 and Version 14 of QCG-AdvancedClient

Timestamp:

11/18/12 21:29:42 (12 years ago)

Author:

mmamonski

Comment:

--

QCG-AdvancedClient

@@ -126 +126 @@
 </qcgJob>
 }}}
- * In the above example we:
+ In the above example we:
    * run the simulation on the two clusters using advance reservations created  automatically by the QCG-Broker (in the co-allocation process) on two clusters: inula and zeus (`<candidateHosts>`),
    * we requested 30 minutes of maximum job walltime (`<executionDuration>`),
    * we specify the kernels to be run in the `processesId` attribute of the `<processes>` element (multiple kernels must be separated with a colon ":"),
    * we specify the number of processes to be allocated
+   * we give the module name: `<variable name="QCG_MODULES_LIST">Fusion/Turbulence</variable>` that has to be loaded before starting MUSCLE
+   * we specify pre and post process scripts. Example scripts:
+{{{
+$cat fusion-preprocess.sh 
+#!/bin/bash
+#copy all file from the data dir into current directory:
+cp data/* .
+$cat fusion-postprocess.sh 
+#!/bin/bash
+#copy all CPOs into the `out` directory
+mkdir -p out
+cp *.cpo out
+}}}
+   * provide staging directives
+ * Example session:
+{{{
+#submit
+qcg-sub fusion.xml QCG
+
+https://elder7.man.poznan.pl:8443/qcg/services/
+/C=PL/O=GRID/O=PSNC/CN=qcg-broker/qcg-broker.man.poznan.pl
+UserDN = /C=PL/O=GRID/O=PSNC/CN=Mariusz Mamonski
+ProxyLifetime = 23 Days 18 Hours 12 Minutes 0 Seconds
+jobId = J1353272598993_MAPPER_0845
+
+#get info
+qcg-info J1353272598993_MAPPER_0845
+
+https://elder7.man.poznan.pl:8443/qcg/services/
+/C=PL/O=GRID/O=PSNC/CN=qcg-broker/qcg-broker.man.poznan.pl
+UserDN = /C=PL/O=GRID/O=PSNC/CN=Mariusz Mamonski
+ProxyLifetime = 23 Days 18 Hours 11 Minutes 50 Seconds
+
+Note: 
+TaskType: MAPPER
+SubmissionTime: Sun Nov 18 22:03:20 CET 2012
+FinishTime: 
+ProxyLifetime: P23DT18H11M47S
+Status: QUEUED
+StatusDesc: 
+ReservedTimeSlot: Sun Nov 18 22:04:00 CET 2012 - Sun Nov 18 22:35:00 CET 2012
+StartTime: 
+
+Allocation: 
+HostName: inula.man.poznan.pl
+ProcessesCount: 1
+ProcessesGroupId: init:transp:dupCorep:turb
+Status: UNCOMMITTED
+StatusDescription: 
+SubmissionTime: Sun Nov 18 22:03:24 CET 2012
+FinishTime: 
+LocalSubmissionTime: 
+LocalStartTime: 
+LocalFinishTime: 
+
+}}}
+
+#peek output
+qcg-peek J1353272598993_MAPPER_0845
+https://elder7.man.poznan.pl:8443/qcg/services/
+/C=PL/O=GRID/O=PSNC/CN=qcg-broker/qcg-broker.man.poznan.pl
+UserDN = /C=PL/O=GRID/O=PSNC/CN=Mariusz Mamonski
+ProxyLifetime = 23 Days 18 Hours 9 Minutes 43 Seconds
+
+openmpi/openmpi-open64_4.5.2-1.4.5-2 load complete.
+Fusion/Turbulence load complete.
+openmpi/openmpi-open64_4.5.2-1.4.5-2 load complete.
+Running both MUSCLE2 Simulation Manager and the Simulation
+=== Running MUSCLE2 Simulation Manager ===
+Executing: java -server -Xms20m -Xmx100m -classpath /home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/muscle.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/oncrpc.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/platform.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/JadeLeap.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/jmml-util-0.1.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/jna.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/junit-4.10.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/msgpack-0.6.6.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/jsr-275-1.0-beta-2.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/javassist-3.15.0-GA.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/json_simple-1.1.jar:/home/plgrid-groups/plggmuscle/2.0/devel-debug/share/muscle/java/thirdparty/jcommander-1.17.jar -Dpl.psnc.muscle.socket.factory=muscle.net.CrossSocketFactory -Dpl.psnc.mapper.muscle.mto.address=192.168.11.102 -Dpl.psnc.map
+
+#when the job is finished
+[qcg] /home/plgrid/plgmamonski/reef/MAPPER > qcg-info J1353272598993_MAPPER_0845
+https://elder7.man.poznan.pl:8443/qcg/services/
+/C=PL/O=GRID/O=PSNC/CN=qcg-broker/qcg-broker.man.poznan.pl
+UserDN = /C=PL/O=GRID/O=PSNC/CN=Mariusz Mamonski
+ProxyLifetime = 23 Days 18 Hours 8 Minutes 57 Seconds
+
+Note: 
+TaskType: MAPPER
+SubmissionTime: Sun Nov 18 22:03:20 CET 2012
+FinishTime: Sun Nov 18 22:04:37 CET 2012
+ProxyLifetime: P23DT18H8M54S
+Status: FINISHED
+StatusDesc: 
+ReservedTimeSlot: Sun Nov 18 22:04:00 CET 2012 - Sun Nov 18 22:35:00 CET 2012
+StartTime: Sun Nov 18 22:03:32 CET 2012
+
+Allocation: 
+HostName: inula.man.poznan.pl
+ProcessesCount: 1
+ProcessesGroupId: init:transp:dupCorep:turb
+Status: FINISHED
+
+
+#we can see the results:
+ ls -l J1353272598993_MAPPER_0845.out/
+total 60608
+-rw-r--r-- 1 plgmamonski plgrid-users 2503411 Nov 18 22:04 bdseq_equilibrium_0000.cpo
+-rw-r--r-- 1 plgmamonski plgrid-users 2503411 Nov 18 22:04 bdseq_equilibrium_0001.cpo
+-rw-r--r-- 1 plgmamonski plgrid-users 2503411 Nov 18 22:04 bdseq_equilibrium_0002.cpo
+-rw-r--r-- 1 plgmamonski plgrid-users 2503411 Nov 18 22:04 bdseq_equilibrium_0003.cpo
+-rw-r--r-- 1 plgmamonski plgrid-users 2503411 Nov 18 22:04 bdseq_equilibrium_0004.cpo
+...