JSAGA

Hi Riccardo,
I have no idea what this error could be. I can try to reproduce your issue if you give me more information:
- what is the minimum file size from which you see the problem ?
- do you have the same issue with other storage elements ?

I'll have a look asap but not before beginning of next year.

regards
Lionel

Hi Riccardo,

Could you please also provide some piece of code to help us understand how JSAGA is used in your application, because your stack-trace does not contain any class from JSAGA (except the name of the embedding exception at the beginning of the stack-trace).

Thanks and Happy New Year,
Sylvain

Lionel Schwarz wrote:

Hi Riccardo,
I have no idea what this error could be. I can try to reproduce your issue if you give me more information:
- what is the minimum file size from which you see the problem ?

About 1000 byte

- do you have the same issue with other storage elements ?

Yes, my algorithm select a random storage elements among the one available for that VO

Thank you for your help

Riccardo

Sylvain Reynaud wrote:

Hi Riccardo,

Could you please also provide some piece of code to help us understand how JSAGA is used in your application, because your stack-trace does not contain any class from JSAGA (except the name of the embedding exception at the beginning of the stack-trace).

Here is the code we use both for upload and download where I had to catch the exception I mentioned. The code is not complete, I skipped pasting the part regarding the read/write on our database to trace grid interactions:

private String copyFile(URL source, URL destination, String commonName,
            String tcpAddress, int GridInteractionId, String userDescription)
            throws DataError {
        String absoluteStoragePath = null;
        Session session = sessionM.getSession();

try {
            NSEntry entrySource = NSFactory.createNSEntry(session, source);
            log.debug("NSEntry created");
            absoluteStoragePath = destination.getString();

            entrySource.copy(destination);
            log.debug("File copied to storage element!");

            entrySource.close();
            log.debug("NSEntry closed");

        } catch (AlreadyExistsException ex) {
            log.debug("File already exist, changing name");
            String newDestination = destination.getString() + "-1";
            log.debug("New file: " + newDestination);
            URL urlNewDestination = null;
            try {
                urlNewDestination = URLFactory.createURL(newDestination);
            } catch (BadParameterException ex1) {
                Logger.getLogger(JSagaDataManagement.class.getName()).
                        log(Level.SEVERE, null, ex1);
            } catch (NoSuccessException ex1) {
                Logger.getLogger(JSagaDataManagement.class.getName()).
                        log(Level.SEVERE, null, ex1);
            }
            absoluteStoragePath = copyFile(source, urlNewDestination, commonName,
                    tcpAddress, GridInteractionId, userDescription);

            } catch (NoSuccessException ex) {
                List <String> le = ex.getAllMessages();
                if (!le.get(le.size()-1).contains("451 exception during " 
                        + "TransferSinkThread")) {
                    log.error(ex);
                    userTrackingDB.CloseGridInteraction(gIntAct);
                    throw new DataError(ex.getMessage());
                }
                log.debug("DataTransfer ok: 451 " 
                        + "exception during TransferSinkThread");
            } catch (Exception ex) {
            log.error(ex);
            userTrackingDB.CloseGridInteraction(gIntAct);
            throw new DataError(ex.getMessage());
        }
        log.debug("Returning value " + absoluteStoragePath);
        return absoluteStoragePath;
    }

Thank you for your help.

Regards,

Riccardo

Hi Riccardo,
Three things:
- why is there no any JSAGA trace in your stacktrace? Did you cut something between
at org.globus.ftp.dc.TransferSinkThread.run(TransferSinkThread.java:68)
and
at it.infn.ct.GridEngine.Data.JSagaDataManagement.copyFile(JSagaDataManagement.java:360)
?

- What are the source and destination URLs?

- we have build a new snapshot with some fixes in GridFTP adaptor and with upgrade to a more recent Globus API (JGlobus-1.8). Maybe you could try your code with this new snapshot.
http://grid.in2p3.fr/maven2/fr/in2p3/jsaga/jsaga-installer/0.9.15-SNAPSHOT/

Lionel

Hi Riccardo,
I just had a deeper look at your code and it seems there is something wrong in your code. In the case of the destination file already exists, you catch the exception at

entrySource.copy(destination);

But the NSEntry is not closed. Your should close the NSEntry in all cases.

This error could explain your problem when the second try to copy the file (with destination name changed) is a bit longer (on larger files), the connection made at first try might be closed ("pipe closed") due to a timeout.

Hope this helps
Lionel