Duet3D Logo Duet3D
    • Tags
    • Documentation
    • Order
    • Register
    • Login

    Full backup

    Scheduled Pinned Locked Moved
    Duet Web Control wishlist
    12
    30
    3.1k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A Former User?
      A Former User
      last edited by

      not super convenient but ftp is relatively easy. could automate with wget.

      1 Reply Last reply Reply Quote 0
      • Exerqtorundefined
        Exerqtor
        last edited by

        Yeah sure i can fire up winscp and do it that way, but since we already spend alot of time inside the DWC i think it's unnecessary having to use another tool to do the same job.

        1 Reply Last reply Reply Quote 0
        • Phaedruxundefined
          Phaedrux Moderator
          last edited by

          I'm not sure, but I think part of the limitation with getting the DWC to do heavy file processing is the relatively weak CPU which is not suited to the task, plus the waiting for SD card reads and folder recursion.

          I think it's impressive that it can do a full folder download as a zip file. Maybe that changes with the Duet 3 and the single board computer since those tasks then become trivial, but for now FTP really is best way to do it at the moment.

          But I totally agree with your request. It would be great to have an automated backup and restore option built in.

          Z-Bot CoreXY Build | Thingiverse Profile

          Exerqtorundefined DocTruckerundefined 2 Replies Last reply Reply Quote 0
          • Exerqtorundefined
            Exerqtor @Phaedrux
            last edited by Exerqtor

            @phaedrux
            True, i don't need the ability to compress it before downloading either. But a function to at least download the whole contet of the sdcard would be so nice.

            When/if something goes titsup like a sdcard corruption or the board dying i don't need the ability to upload/restore it from the DWC. But if i atleast have a full backup laying there it makes the recovery job so much easier. Compared to either downloading it via FTP or pulling out the card and putting it in a PC (getting the card out means having to disasemble the whole board, because my enclosure don't have access slots).

            1 Reply Last reply Reply Quote 0
            • A Former User?
              A Former User
              last edited by

              wget is pretty simple: wget -X /gcodes -r ftp://10.10.0.169/* downloads everything except the gcodes folder into a 10.10.0.169 folder locally.

              but yes, it'd be a nice to have feature in the DWC, but while you wait ☝

              Exerqtorundefined DonStaufferundefined 2 Replies Last reply Reply Quote 1
              • Exerqtorundefined
                Exerqtor @A Former User
                last edited by

                @bearer Never used or heard of wget before so thanks for the pointer 😁

                Would still be awesome with a backup utility though 😂 Don't know how into networking HW you guys here are, but take the Ubiquiti UNIFI/CloudKey setup. The CloudKey does a backup of the entire sdcard content at a set time intervall. That way one atleast have something to revert to if something goes horribly wrong. Dosn't help much if the sdcard f's up. But it's something, and the backup could be stored in the /sys/ whos's easily accessable for if one want to fetch it.

                1 Reply Last reply Reply Quote 0
                • A Former User?
                  A Former User
                  last edited by

                  add cron or a scheduled task in windows and you have regular backups. toss git in there and you have revision control, potentially offsite with bitbucket/github/whatnot.

                  might not be a one-click solution, but you only need to set it up once.

                  1 Reply Last reply Reply Quote 0
                  • Phaedruxundefined
                    Phaedrux Moderator
                    last edited by

                    Well you can down load the whole sys folder and each macro folder from the DWC. So that's pretty much all you need for a recovery.

                    Z-Bot CoreXY Build | Thingiverse Profile

                    1 Reply Last reply Reply Quote 0
                    • DocTruckerundefined
                      DocTrucker @Phaedrux
                      last edited by DocTrucker

                      @phaedrux said in Full backup:

                      I'm not sure, but I think part of the limitation with getting the DWC to do heavy file processing is the relatively weak CPU which is not suited to the task, plus the waiting for SD card reads and folder recursion.

                      I didn't think the duet was doing much of the leg work with regards to the website. I thought that the web page files were served to the browsing computer then they ran on that computer, commumicating with the duet using gcode, ftp, and maybe telnet?

                      Running 3 P3Steel with Duet 2. Duet 3 on the shelf looking for a suitable machine. One first generation Duet in a Logo/Turtle style robot!

                      Phaedruxundefined 1 Reply Last reply Reply Quote 0
                      • Phaedruxundefined
                        Phaedrux Moderator @DocTrucker
                        last edited by

                        @doctrucker Right, but to packup the files into a zip file and send it to you has to be done by the Duet.

                        Z-Bot CoreXY Build | Thingiverse Profile

                        dc42undefined 1 Reply Last reply Reply Quote 0
                        • dc42undefined
                          dc42 administrators @Phaedrux
                          last edited by

                          @phaedrux said in Full backup:

                          @doctrucker Right, but to packup the files into a zip file and send it to you has to be done by the Duet.

                          What happens with the existing backup of /sys and /macros is that DWC downloads each file individually and then zips them up.

                          Duet WiFi hardware designer and firmware engineer
                          Please do not ask me for Duet support via PM or email, use the forum
                          http://www.escher3d.com, https://miscsolutions.wordpress.com

                          DocTruckerundefined Phaedruxundefined 2 Replies Last reply Reply Quote 0
                          • DocTruckerundefined
                            DocTrucker @dc42
                            last edited by DocTrucker

                            @dc42 ...and the processing is done on the remote computer rather than the duet right?

                            That's how I understood it anyway. All duet is doing is serving individual files to the remote computer.

                            Running 3 P3Steel with Duet 2. Duet 3 on the shelf looking for a suitable machine. One first generation Duet in a Logo/Turtle style robot!

                            1 Reply Last reply Reply Quote 0
                            • Phaedruxundefined
                              Phaedrux Moderator @dc42
                              last edited by

                              @dc42 said in Full backup:

                              @phaedrux said in Full backup:

                              @doctrucker Right, but to packup the files into a zip file and send it to you has to be done by the Duet.

                              What happens with the existing backup of /sys and /macros is that DWC downloads each file individually and then zips them up.

                              Ah I see. In that case, would it be possible to download the entire contents of the card and zip it up in the same way?

                              Z-Bot CoreXY Build | Thingiverse Profile

                              1 Reply Last reply Reply Quote 0
                              • DocTruckerundefined
                                DocTrucker
                                last edited by DocTrucker

                                Possible, it's just a feature request for DWC as far as I can see.

                                I agree it would be useful!

                                Running 3 P3Steel with Duet 2. Duet 3 on the shelf looking for a suitable machine. One first generation Duet in a Logo/Turtle style robot!

                                1 Reply Last reply Reply Quote 0
                                • Danalundefined
                                  Danal
                                  last edited by

                                  Until this is implemented, going to the 3 places for gcode, system, and macros, then check all files and right click download zip, will be a yield a fairly complete protection of invested work.

                                  Delta / Kossel printer fanatic

                                  dc42undefined 1 Reply Last reply Reply Quote 0
                                  • A Former User?
                                    A Former User
                                    last edited by

                                    and /menu if using 12864 display.

                                    I'll stick with wget, if it gets a http url to hit instead that gets all the files, great, but ftp will also work as is.

                                    1 Reply Last reply Reply Quote 0
                                    • Danalundefined
                                      Danal
                                      last edited by Danal

                                      Also, just verified in github that DWC is pulling individual files from Duet, and zipping them on the browser (dwc) side. As everyone was saying above. Definitely works this way.

                                      DWC is using a unique service call, namely "rr_download,name=", so that it can get text or binary or whatever and add them to the zip.

                                      Therefore, implementing this is a matter of adding a button somewhere, adding code to 'walk' the entire directory tree of the SD, and the body of that code would be identical to what zips gcode or macros or whatever today. Absolutely no changes to Duet/RepRap firmware needed.

                                      Easy for Chris, and/or if there is enough commentary, I could give it a shot, and do it so that Chris can later pull it on git.

                                      Delta / Kossel printer fanatic

                                      1 Reply Last reply Reply Quote 0
                                      • dc42undefined
                                        dc42 administrators @Danal
                                        last edited by

                                        @danal said in Full backup:

                                        Until this is implemented, going to the 3 places for gcode, system, and macros, then check all files and right click download zip, will be a yield a fairly complete protection of invested work.

                                        And Display if you are using a Duet Maestro.

                                        Duet WiFi hardware designer and firmware engineer
                                        Please do not ask me for Duet support via PM or email, use the forum
                                        http://www.escher3d.com, https://miscsolutions.wordpress.com

                                        1 Reply Last reply Reply Quote 0
                                        • XTLundefined
                                          XTL
                                          last edited by

                                          Recursive wget (and probably curl, automated browsers and many download managers) would also work great with http. Almost certainly better since the protocol is far more sane than ftp. All that would be required is some url with an html page with one link per file. Or one page per directory for a whole tree.

                                          Something that looks like the view you get when opening a directory or a web server served directory. Especially if you leave out sort columns or parent directory links so they don't need to be filtered out from the spider.

                                          resamundefined 1 Reply Last reply Reply Quote 0
                                          • resamundefined
                                            resam @XTL
                                            last edited by

                                            @xtl FYI, I'm using this to backup my printer:
                                            wget -r -nH ftp://username@myprinter.local/{macros,sys,www}

                                            pawPrinterundefined DonStaufferundefined 2 Replies Last reply Reply Quote 1
                                            • First post
                                              Last post
                                            Unless otherwise noted, all forum content is licensed under CC-BY-SA