PlanetSquires Forums

Please login or register.

Login with username, password and session length
Advanced search  

Author Topic: W10 backup/storage  (Read 500 times)

raymw

  • Senior Member
  • ***
  • Posts: 363
W10 backup/storage
« on: September 30, 2019, 09:32:53 AM »

Maybe it is not the best way to solve a problem, but perhaps different opinions may give me some ideas.
 
At the moment, I have three pc's and a windows tablet, all running w10, the majority r1809, on my network. They are backed up automatically each day by a hp server, running windows server 12 R2. However the latest w10 (1903) does not connect with the server, but can access files there. At the moment, w10(1903) is only on one pc, that does not need backing up much, it only has a few programs and the operating system, but the laptop and desktop pc will be updated sometime soon to 1903. Microsoft are not supporting the server software, anymore, afaik, wanting users to update to server 19. The advantage of the server is that it just works, (within the limits of hp hardware and MS software) and the 8 mirrored sata drives are written in ntfs format, so can be read, if server fails, by another windows pc.

Many years ago, I used 'sync back pro', from 2bright sparks, backing up files to other pc's, and I'm thinking about doing that again. I could sort of software mirror files to two independent usb drives. That gives most options for recovery, if one drive fails, I can read the other via one of my other pcs. I was thinking of using Nas, but afaik, they use proprietary formats, e.g. not purely ntfs, and if the unit fails, then I have to either get it repaired, or have another identical unit to get at the data files. I believe usb 3 is quite fast enough for what I need, but as my desktop pc does not have usb3, it seems most likely to get a separate pc, just as a file server. Intel do them (nuc) and others, with numerous usb ports, and not much else.

At the moment, I've about 12Tbytes stored, not doing much streaming, no games so speed not too critical. I suppose none of the data is important, my world will not end if it all is lost, but hdd storage is cheap compared to thinking 'if only I'd kept that'.

So, any other ideas? I've not completely decided, but I'll have to fairly soon.
Logged

SeaVipe

  • Senior Member
  • ***
  • Posts: 244
  • Windows 10
Re: W10 backup/storage
« Reply #1 on: September 30, 2019, 01:51:11 PM »

Hi Ray,
Years ago I wrote a (very basic) batch file to do my back ups. Nothing overly complicated, just XCOPY. The batch file creates a unique sub dir name using the date and time like so:


Code: [Select]

REM /E copies directories, /Y suppresses overwrite prompt.
REM Convert the current time (with colons and a decimal)
REM to a string with hyphenated numbers (nn-nn-nn-nn):
set coln=%time%
set coln=%coln::=-%
set coln=%coln:.=-%
set coln=%coln: =0%
REM Copy to new dir with date-time designation:


xcopy /E /Y C:\SRC\TeriBase\*.*    "C:\Users\Clive\OneDrive\BackUp\CRM\SRC\TeriBasebak.%date%-%coln%\" >  E:\BackUp\SRC\CRM\BakFiles.log



ECHO ------------------------------------------ >> E:\BackUp\SRC\CRM\backup.log
ECHO Done with back up.
ECHO TeriBase CRM SRC is backed up as of %date%-%coln% >> E:\BackUp\SRC\CRM\backup.log
ECHO ------------------------------------------ >> E:\BackUp\SRC\CRM\backup.log
TIMEOUT 25


There are multiple source code folders in the above batch file.
I have a built-in back up routine for data that uses a similar algorithm as the above batch file:


Code: [Select]

Dim as String   s_file_name_modifier    = Format( Now, "yyyy-mmm-dd_hhnnss" )
Dim as String   s_source                = "the source folder"
Dim as String   s_destination           = "the destination root" & "\Expired_" & s_file_name_modifier & ".csv"
l_ret_val = FileCopy( s_source, s_destination )


I've left this FF code unmodified since I wrote it in VB in the 90s. It's destined for a makeover with proper error checking etc. when I port it all over to WinFBE.
My main PC has a removable SATA drive caddy (KINGWIN KF-253-bk) with 2.5" and 3.5" trays. Once a drive is full, it goes into storage and replaced with a new, empty drive.


As a further back up destination I use OneDrive (paid version 1 TB), DropBox (free version), Google Drive (free version) and iCloud Photos.
My Blackberry KeyONE (Android - SMS Backup & Restore) backs up all my (emails,) texts and calls to the above cloud drives and also sends an email with back up files as attachments to a gmail account.

Have a look at MirrorFolder here: https://www.techsoftpl.com/backup/index.php. There are a number of options for each "backup" but I mostly use RAID1.
Logged
Clive Richey
There is nothing government can give you that it hasn't already taken from you in the first place. Winston Churchill

raymw

  • Senior Member
  • ***
  • Posts: 363
Re: W10 backup/storage
« Reply #2 on: September 30, 2019, 03:01:10 PM »

Thanks for the ideas, Clive. Not sure how many removed hdd's you have, but it may pay to fire them up once a month, or so, to check they still turn. The advantage of keeping it all on line, is that smart or other systems can detect impending failure. Folk have lost loads of photos by relying on dvds. I'd thought of batch files and writing some fb code to read/wrte binary files. If it is all in ntfs, until something else comes out, then it can be created/recovered in many ways.
Logged

SeaVipe

  • Senior Member
  • ***
  • Posts: 244
  • Windows 10
Re: W10 backup/storage
« Reply #3 on: September 30, 2019, 03:15:44 PM »

Thanks for the "fire them up once a month" idea, Ray. I'll certainly try to get into the habit. The drives vary in size from 500MB to 3TB and the caddy is supposed to be "hot-swap" but Win 10 only recognizes the swapped drive after a reboot.
As for cloud drives, I send identical back-ups to all of them with the exception of iCloud.
When I have time my intention is to write FB code with WinFBE which may include all the files I currently back-up with MirrorFolder.
Logged
Clive Richey
There is nothing government can give you that it hasn't already taken from you in the first place. Winston Churchill

raymw

  • Senior Member
  • ***
  • Posts: 363
Re: W10 backup/storage
« Reply #4 on: October 06, 2019, 12:24:22 PM »

I contacted wd wrt their 'my cloud' and similar Nas. Their software, they said, is based on linux, and they said removing a drive from the unit, it would not be directly readable on a windows PC. So, I'm going down the route of usb3 drive enclosures, attached to a separate windows pc. I've purchased a very cheap mini pc - SMALLRT Mini PC Windows 10 Pro DDR3L 4GBRAM /64GB ROM eMMC Intel x5-Z8350 HD Graphics Desktop Computer,4K/Built-in Dual band WiFi/BT 4.0 /1000Mbps LAN  It's 4 inches square by 1 inch thick, no fans. Not yet powered it up, been milling plastic, instead. It runs w10pro, must be a some really special licensing arrangement from Microsoft (or not), since it is cheaper than buying a normal license. Can't find much info on it, but it will most likely do what I want, if not, It'll be driving a cnc something or other. It weighs so little, I thought Amazon had sent out an empty box.
Logged

raymw

  • Senior Member
  • ***
  • Posts: 363
Re: W10 backup/storage
« Reply #5 on: October 17, 2019, 01:11:08 PM »

So far, it all seems fairly reliable. I'm adding 4 usb3 wd elements drives. Currently, I'm running it headless, using remote desktop connection. I've not finalised exactly what software I will be using for backups, or if I'll bother with image copying of drives. The advantage of the w10 built in file history backup, is that it allows getting back to previous versions, and windows can directly access them. Another system I've looked - backup4all - saves everything zipped up, afaik, and I could not get the email notification working in the trial. I did not like the interface, I think it was written using Delphi. I've used synchback in the past (from 3bright sparks) I like the interface, but not too happy with the log file reports, and other odds and ends, but I'm pretty sure it records all the data without any compression, unless you ask for it. Still, I've plenty of time, well maybe a week or two, until w10 updates to 1903, maybe 1909. Sometimes, I almost wish I'd gone with Linux, after M$ split off from ibm at the end of OS2 joint development. ibm got into bed with red-hat, I've no idea what they are up to now.
Logged