Project

General

Profile

MPI Job with MPIStart

Added by Scardaci Diego almost 14 years ago

Hello,

I need to submit MPI Job using MPIStart using JSAGA on a e-infrastructure based on gLite.

An example of JDL to submit this job type is the following:

  1. mpi-test.jdl
    JobType = "Normal";
    Executable = "/bin/sh";
    CPUNumber = 2
    Arguments = "mpi-start-wrapper.sh mpi-test MPICH";
    StdOutput = "mpi-test.out";
    StdError = "mpi-test.err";
    InputSandbox = {"mpi-start-wrapper.sh","mpi-hooks.sh","mpi-test.c"};
    OutputSandbox = {"mpi-test.err","mpi-test.out"};
    Requirements =
    Member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment)&&
    Member("MPICH2", other.GlueHostApplicationSoftwareRunTimeEnvironment);

How you can see the Job type is "normal" and I need to add the "CPUNumber" parameter. But I haven't found any way to add this parameter in JSaga.

Using the SPMDVariation parameter I can set the job type to MPICH. In this case I can find, in the JDL generetad, the NodeNumber parameter (mapping the NumberOfProcesses SAGA parameter).

This is the only way I found to set the CPUNumber (NodeNumber is the obsolete name of this parameter) but I couldn't submit my mpi job based on MPIStart because the job type is set to "MPICH" instead of "NORMAL".

I used a workaround to submit my job, I updated the gLite WMS adaptor to have a job "Normal" setting "SPMDVariation=MPI".

I know this is not a generic solution and for this reason I'd like to know when you think to add a way to configure the "CPUNumber" JDL parameter from JSAGA API.

Thanks in advance for your help.

Regards,
Diego Scardaci
INFN Catania


Replies (2)

RE: MPI Job with MPIStart - Added by Reynaud Sylvain almost 14 years ago

Hello Diego,

I think that the JDL parameter NodeNumber corresponds to the SAGA parameter NumberOfProcesses and is related to MPI jobs, while the JDL parameter CPUNumber corresponds to the SAGA parameter TotalCPUCount and is related to normal jobs (which is the type of job you want to submit from WMS point of view).

This later parameter was indeed missing in our gLite-WMS plug-in.

This is now fixed in latest snapshot:
http://grid.in2p3.fr/software/jsaga-dev/download.html

Regards,
Sylvain

RE: MPI Job with MPIStart - Added by Scardaci Diego almost 14 years ago

Thanks a lot for your very quick answer.

I'm going to download and use your latest snapshot to test your fix.

Regards,
Diego Scardaci

    (1-2/2)