ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s

    Scheduled Pinned Locked Moved IT Discussion
    56 Posts 9 Posters 4.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • black3dynamiteB
      black3dynamite @krisleslie
      last edited by

      @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

      @black3dynamite Scott has been begging me for a while to switch over to KVM 🙂 I have enough servers at home to give it a try. What are you using for host management? Last I saw, Kimichi(sp?) was hot.

      For host management, it will be Cockpit. Just make sure cockpit-machines plugin is installed.
      sudo dnf install cockpit cockpit-storaged cockpit-machines

      K 1 Reply Last reply Reply Quote 2
      • K
        krisleslie @bnrstnr
        last edited by

        @bnrstnr well hate to tell you but you hit the nail on the head. It's literally 1000's of small files between 100-500k.

        DashrenderD 1 Reply Last reply Reply Quote 0
        • K
          krisleslie @black3dynamite
          last edited by

          @black3dynamite thats why you the man, I sure will.

          1 Reply Last reply Reply Quote 0
          • DashrenderD
            Dashrender @krisleslie
            last edited by

            @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

            @bnrstnr well hate to tell you but you hit the nail on the head. It's literally 1000's of small files between 100-500k.

            Try zipping them into a single, or multiple large files, then transfer.

            I have found that transferring via xcopy is much faster for small files than just drag and drop in windows.

            B 1 Reply Last reply Reply Quote 1
            • B
              bnrstnr @Dashrender
              last edited by

              @Dashrender said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

              I have found that transferring via xcopy is much faster for small files than just drag and drop in windows.

              I use Robocopy, I believe it's more powerful, but I think it's a little more complex too. Either will be way better at handling all of those small files than copying them in explorer.

              DashrenderD 1 Reply Last reply Reply Quote 1
              • DashrenderD
                Dashrender @bnrstnr
                last edited by

                @bnrstnr said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                @Dashrender said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                I have found that transferring via xcopy is much faster for small files than just drag and drop in windows.

                I use Robocopy, I believe it's more powerful, but I think it's a little more complex too. Either will be way better at handling all of those small files than copying them in explorer.

                yeah, xcopy when it's a simple copy.. Robo when you need more power.

                K 1 Reply Last reply Reply Quote 1
                • K
                  krisleslie @Dashrender
                  last edited by

                  @Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.

                  DashrenderD B 2 Replies Last reply Reply Quote 0
                  • DashrenderD
                    Dashrender @krisleslie
                    last edited by

                    @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                    @Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.

                    well, small files.

                    Now, make 500 1 GB files and see how fast it goes.

                    scottalanmillerS 1 Reply Last reply Reply Quote 2
                    • scottalanmillerS
                      scottalanmiller @Dashrender
                      last edited by

                      @Dashrender said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                      @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                      @Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.

                      well, small files.

                      Now, make 500 1 GB files and see how fast it goes.

                      Or 1 500GB file. Even better.

                      1 Reply Last reply Reply Quote 0
                      • B
                        bnrstnr @krisleslie
                        last edited by

                        @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                        @Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.

                        Did you add the switch to use Multiple CPU threads?

                        1 Reply Last reply Reply Quote 0
                        • K
                          krisleslie
                          last edited by

                          The data is from one of my Ubiquiti UniFi Video (NVR) server. So the files are not really big. So are you proposing like maybe zipping the files into one file then transferring?

                          scottalanmillerS 1 Reply Last reply Reply Quote 0
                          • K
                            krisleslie
                            last edited by

                            @bnrstnr That I did not, I'll look back over the command tomorrow. I have one of my servers home and will be testing the BIOS settings change.

                            1 Reply Last reply Reply Quote 0
                            • scottalanmillerS
                              scottalanmiller @krisleslie
                              last edited by

                              @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                              The data is from one of my Ubiquiti UniFi Video (NVR) server. So the files are not really big. So are you proposing like maybe zipping the files into one file then transferring?

                              If they are pre-compressed, then just tar them, don't zip them.

                              1 Reply Last reply Reply Quote 1
                              • 1
                              • 2
                              • 3
                              • 2 / 3
                              • First post
                                Last post