Backup of user SD card files

[appjaws]

The Duet3D Documentation, SD Card section states:-
"In normal use, you should never need to remove the SD card from its socket. You can transfer files to/from the SD card over the web interface."

Its no problem to load files from my computer but I just cannot see how to copy to a folder on my computer.

I can create a zip file of the sys directory but how do I backup filaments, jobs and macros directories?

[fcwilt]

@appjaws

Due to problems like that I took to maintaining all Duet files using an external text editor that supports FTP.

The Duet firmware can handle an FTP connection.

Here is what the folder tree looks like inside the editor when connected to the Duet via FTP:

Any file can be downloaded or uploaded or edited. When the edited file is saved it is automatically uploaded to the Duet.

The FTP connection can be configured to make a backup on the Duet of any file that is uploaded to the Duet but has changed.

The FTP connection can also be configured to keep backups of all the files on the Duet on the local computer running the Editor.

I find it makes maintaining my Duet files much easier.

Something for you to think about.

Frederick

[deckingman]

@appjaws Hi Paul

There is this - haven't used it myself. https://forum.duet3d.com/topic/10880/rfm-reprapfirmware-filemanager-duetbackup-successor

It might do what you want - not sure.

[jens55]

search for "rfm" in the older comments. The link @deckingman posted will also get you there.
After the developer fixed a bug the other day, I can back up the entire sd card, folder structure and all, in one command.

[appjaws]

@fcwilt
Thank you for the information.
I have installed FileZilla and it appears to be working --- helps if you enter M586 P1 S1 into config

You say that FTP connection can be configured to make a duet backup and to keep backups , could you share how please?

[fcwilt]

@appjaws said in Backup of user SD card files:

You say that FTP connection can be configured to make a duet backup and to keep backups , could you share how please?

Glad to hear you got FileZilla working.

As to your question I was referring to the text editor (EditPad Pro) I am using which allows for that. It is a bit quirky but it has every editing feature you can think of.

FileZilla is a file transfer program and as far as I know does not provide file editing. It can of course download/upload files from/to the Duet.

Glad to answer any questions you may have.

Frederick

[appjaws]

@fcwilt
I thought I would take a look at your backup solution.
I have the plugins installed on my Notepad++ and have connected to the duet via FTP and can see my files.
I get an error when trying to download a file.
How do I set up where the file should be copied to?
How can I download a complete directory?

This may well be easy but I just can't see it, any ideas?

[fcwilt]

@appjaws

I will install NotePad++ and check it out.

I will get back to you when I have determined how to set it up.

Frederick

[fcwilt]

@appjaws

Well I installed NotePad++ and the FTP plugin.

I created a profile according to the online documentation.

It connected OK.
It listed the folders and contents OK
It changed folders OK
It tried to download and ALWAYS failed.

I tried every setting I could think of and nothing worked.

This is not the first time I have encountered an implementation of FTP that didn't work.

As you have observed FileZilla works. My editor, EditPad Pro, works. UltraEdit is flaky as can be and I rarely can open a file on the Duet. DirectoryOpus works but it is not an editor but an amazing replacement for Windows FileExplorer.

So when some programs work and some don't, I suspect the problem is the program, not the implementation of FTP on the Duet.

Perhaps there is a NotePad++ forum you can ask for help?

I will keep trying.

Frederick

[fcwilt]

@KenW

That problem with zero byte files was something I was able to get the Duet developer(s) to find and fix.

So you suspect the problems with NppFTP are in it's code?

Frederick

[Phaedrux]

@fcwilt said in Backup of user SD card files:

NppFTP

Is it making too many requests at once?

[fcwilt]

@Phaedrux said in Backup of user SD card files:

@fcwilt said in Backup of user SD card files:

NppFTP

Is it making too many requests at once?

I have no idea. Today was the first time I ever tried NotePad++.

Frederick

[Phaedrux]

@fcwilt said in Backup of user SD card files:

It tried to download and ALWAYS failed.

This is what makes me think it's the number of concurrent requests since that will make FileZilla fail in the same way if it's not limited to 1 I seem to recall.

[fcwilt]

@Phaedrux said in Backup of user SD card files:

@fcwilt said in Backup of user SD card files:

It tried to download and ALWAYS failed.

This is what makes me think it's the number of concurrent requests since that will make FileZilla fail in the same way if it's not limited to 1 I seem to recall.

Could be. I remember that issue coming up when I first tried to use FTP.

Frederick

[droftarts]

@appjaws Is this solved for you now? If you're running in SBC mode rather than standalone, also take a look at this thread: https://forum.duet3d.com/topic/34220/sbc-plugin-to-backup-duet3d-files

Ian

[appjaws]

@droftarts
No, I wanted to write a script that would run on a schedule to automatically backup the SD card to my windows computer.
At the moment I am mounting the Duet in the windows file system and manually copying all content to a backup location on my PC.

[Phaedrux]

To do that you'd need to setup a command line for RFM and run that on a schedule with windows task scheduler.

https://forum.duet3d.com/topic/10880/rfm-reprapfirmware-filemanager-duetbackup-successor

[stuartofmt]

@appjaws
Hi - I'm curious as to your use-case. Is your need to have the backups on your windows computer for occasional use? e.g. restore / write to an SD card. Or do you have some other use-case.

Part of the reason I ask is that I am the author of the duetBackup plugin and curious if I need / should add additional functionality.