User Tools

Site Tools


other:win10_syncback

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
other:win10_syncback [2020/04/20 09:04]
jypeter [Configuring a mirror backup]
other:win10_syncback [2020/04/29 12:51]
jypeter [Suggested filters when backing up your Windows Home folder]
Line 30: Line 30:
   - **Select the //Mirror// type of backup** and click on //Next//. You can get some information about each available backup type by clicking on the ''?''​ icons\\ {{ :​other:​syncbackfree_004.png?​direct&​500 |}}   - **Select the //Mirror// type of backup** and click on //Next//. You can get some information about each available backup type by clicking on the ''?''​ icons\\ {{ :​other:​syncbackfree_004.png?​direct&​500 |}}
   - The Source (a folder on your computer) and Destination (on the USB disk) folders are both local disks and you don't have to change anything in the //​locations//​ window. Just click //Done//\\ {{ :​other:​syncbackfree_005.png?​direct&​500 |}}   - The Source (a folder on your computer) and Destination (on the USB disk) folders are both local disks and you don't have to change anything in the //​locations//​ window. Just click //Done//\\ {{ :​other:​syncbackfree_005.png?​direct&​500 |}}
-  - A new window ​//Profile Setup// window opens, where you can **specify the Source and the Destination folders**. In this example, we use //Source =// ''​D:​\Users\jypeter''​\\ and //​Destination =//''​F:​\Backup_JYP\Dell_Precision_3420\D_Users_jypeter''​. Once you have filled both fields, a summary of what will be done is displayed in the //​Description of this profile// section. ​Click on //Change Filter// for a more precise control of what will be saved (**this is optional, and you can do it later!**), **or** on //OK// when you are done\\ {{ :​other:​syncbackfree_007_notes.png?​direct |}} +  - A new //Profile Setup// window opens, where you can **specify the Source and the Destination folders**.\\ In this example, we use //Source =// ''​D:​\Users\jypeter''​\\ and //​Destination =// ''​F:​\Backup_JYP\Dell_Precision_3420\D_Users_jypeter''​.\\ Once you have filled both fields, a summary of what will be done is displayed in the //​Description of this profile// section. ​You can click on //Change Filter// for a more precise control of what will be saved (**this is optional, and can be adjusted ​later!**), **or** on //OK// when you are done\\ {{ :​other:​syncbackfree_007_notes.png?​direct |}} 
-  - **If** you choose to **review and update the filters**, with the //Change filter// button, you will get two new windows: the //File & Folder selection// window that you can ignore, and the //Filters// window\\ {{ :​other:​syncbackfree_008.png?​direct |}}\\ You can use the //Add// button below the //​Files/​folders NOT to copy// window to add new rules to the list of files/​folders that should be ignored by SyncBack. Check the //Filters// section for [[#​using_filters|more details about the filters]]\\ {{ :​other:​syncbackfree_009.png?​direct&​500 |}} +  - **If** you choose to **review and update the filters**, with the //Change filter// button, you will get two new windows: the //File & Folder selection// window that you can ignore, and the //Filters// window\\ {{ :​other:​syncbackfree_008.png?​direct |}}\\ You can use the //Add// button below the //​Files/​folders NOT to copy// window to **add new filter ​rules** to the **list of files/​folders that should be ignored by SyncBack**. Check the //Filters// section ​below for [[#​using_filters|more details about the filters]].\\ Note: double-click on an existing filter if you want to change it !\\ {{ :​other:​syncbackfree_009.png?​direct&​500 |}} 
-  - When you have finished adjusting the filters, or if you have directly clicked on //OK// after specifying the Source and the Destination folders, you will get a popup window asking if you want to do a //simulated run//. You can skip this step, as it will be automatically done by default each time you execute this profile\\ {{ :​other:​syncbackfree_010.png?​direct&​500 |}} +  - When you have finished adjusting the filters, or if you have directly clicked on //OK// after specifying the Source and the Destination folders, you will get a popup window asking if you want to do a //simulated run//. You can skip this step, as it will automatically ​be done by default each time you execute this profile\\ {{ :​other:​syncbackfree_010.png?​direct&​500 |}} 
-  - You are now ready to **execute the backup profile**! You can either click on the main //Run// button to launch an //attended run//, or use the other available options\\ {{ :​other:​syncbackfree_011.png?​direct&​500 |}}\\ The //Attended Run// (and the //Simulated Run//) will display a window with the list of planned backup operations. You should **check carefully the content of the //​Differences//​ window** when executing a profile the first few times, especially the files/​folders outlined in red in the right part (the files that will be overwritten or removed). If you see lots of files with random names (screenshot below), they are probably in a //cache// directory that you can remove from the backup by using a [[#​using_filters|filter]].\\ As you can see in the bottom right part of the screenshot below, there are lots of files (7k) to copy because it's a first run, with no expected **Collisions** (when a file in Source is more recent than the matching one in Destination),​ or files **To Delete** (when a file in Source has been removed, and the matching one in Destination will be deleted). The next runs will be faster (less files to copy), but you may want to keep an eye to the files to be deleted...\\ {{ :​other:​syncbackfree_012.png?​direct |}} +  - You are now ready to **execute the backup profile**! You can either click on the main //Run// button to launch an //attended run//, or use the other available options\\ {{ :​other:​syncbackfree_011.png?​direct&​500 |}}\\ The //Attended Run// (and the //Simulated Run//) will display a window with the list of planned backup operations. You should **check carefully the content of the //​Differences//​ window** when executing a profile the first few times, especially the files/​folders outlined in red in the right part (the files that will be overwritten or removed). If you see lots of files with random names (screenshot below), they are probably in a //cache// directory that you can remove from the backup by using a [[#​using_filters|filter]].\\ As you can see in the bottom right part of the screenshot below, there are lots of files (7k) to copy because it's a first run, with no expected **Collisions** (when a file in Source is more recent than the matching one in Destination),​ or files **To Delete** (when a file in Source has been removed, and the matching one in Destination will be deleted). The next runs will be faster (less files to copy), but you may want to keep an eye on the list of files to be deleted...\\ {{ :​other:​syncbackfree_012.png?​direct |}} 
-  - After executing the profile, you will get a popup window (that you can disable after a few runs) telling you if there were some problems (e.g. a file was locked by the system), and then a summary log will open in your browser. You can click on the //Errors// link, or the other links to get details about what happened.\\ {{ :​other:​syncbackfree_013.png?​direct&​400 |}}\\ {{ :​other:​syncbackfree_014_notes.png?​direct&​500 |}}+  - After executing the profile, you will get a popup window (that you can disable after a few runs) telling you if there were some problems (e.g. a file was locked by the system ​and could not be accesses), and then a summary log will open in your browser. You can click on the //Errors// link, or the other links to get details about what happened.\\ {{ :​other:​syncbackfree_013.png?​direct&​400 |}}\\ {{ :​other:​syncbackfree_014_notes.png?​direct&​500 |}}
  
  
 ===== Using Filters ===== ===== Using Filters =====
  
-It can be useful to use some **filters** to disable some of what SyncBack would try to backup otherwise:​ +You can **use filters** to disable some of what SyncBack would try to backup otherwise:​ 
-  * Not backing up useless files/directories ​(e.g temporary files in cache directories) will make SyncBack run faster (and save space on the backup device) +  * Not backing up useless files/folders ​(e.g lots of temporary files with random names in cache folders) will make SyncBack run faster (and save space on the backup device) 
-  * Some files/directories ​can't be backed up because their access is protected by the system (possibly because they are still open) and will generate errors in the log file. Skipping them will make it easier to spot real errors +  * Some files/folders ​can't be backed up because their access is protected by the system (possibly because they are still open) and will generate errors in the log file. Skipping them will make it easier to spot //real// errors 
-    * In order to make a correct backup of everything, it is always better to close the running applications before starting the backup+    * In order to make a correct backup of everything, it is always better to close the running applications ​(if possible) ​before starting the backup
  
 Notes: Notes:
-  * A filter **must** start with ''​\string''​ (''​string''​ will be searched in the root of the source directory) or ''​%%*%%\string''​ (there can be subdirectories ​between the source directory ​and ''​string''​) +  ​* The filters are **paths relative to the //Source// folder** 
-  * A folder name **must** have a trailing slash +  ​* A filter **must** start with ''​\string''​ (''​string''​ will be searched in the root of the Source folder) or ''​%%*%%\string''​ (there can be sub-folders ​between the Source folder ​and ''​string''​) 
-  * To modify an existing filter double-click it+  * A **folder** name **must** have a trailing slash (''​*\some_text_file.txt''​ vs ''​\a_subfolder_somewhere\''​) 
 +  * To modify an existing filter double-click ​on it in the filters'​ list 
 +  * you can use uppercase and lowercase in windows files and folders'​ names, but the filters will ignore the case of the characters (e.g. the ''​*\mixed_case.txt''​ filter would skip ''​mixed_case.txt'',​ ''​Mixed_Case.txt'',​ ''​mixed_CASE.txt'',​ ...)
  
-==== Suggested filters when backing up your Home folder ====+==== Suggested filters when backing up your custom ​Home folder ====
  
-//Home folder// means here ''​ANOTHER_DISK_THAN_C:​\Users\your_login'',​ assuming that you have followed the instructions in [[other:​win10config#​configuring_folders_and_shortcuts|Configuring folders]] to create a //Home folder// distinct from your default //Windows home folder// on ''​C:​\''​+//Custom ​Home folder// means here ''​ANOTHER_DISK_THAN_C:​\Users\your_login'',​ assuming that you have followed the instructions in [[other:​win10config#​configuring_folders_and_shortcuts|Configuring folders]] to create a //Home folder// distinct from your default //Windows home folder// on ''​C:​\''​...
  
-Note: we assume in the filters below that the [[other:​thunderbird#​moving_the_tb_configuration_directory_to_a_specific_directory|Thunderbird and Firefox profiles were moved]] from their default location, to the //Home folder//+Note: we assume in the filters below that the [[other:​thunderbird#​moving_the_tb_configuration_directory_to_a_specific_directory|Thunderbird and Firefox profiles were moved]] from their default location ​on ''​C:​\''​, to the //Home folder//
  
   * Remove Thunderbird and Firefox lock file: ''​%%*%%\parent.lock''​   * Remove Thunderbird and Firefox lock file: ''​%%*%%\parent.lock''​
-  * Try to remove all the obvious cache folders: ''​%%*%%\Cache\'',​ ''​%%*%%\cache2\''​ +  * Try to remove all the obvious cache folders: ''​%%*\*cache*\%%''​ 
-    * The filter rules above will remove cache folders like:\\ ''​%%*%%\Firefox\Profiles\jyp_Firefox_fixe\cache2\'',​\\ ''​%%*%%\Thunderbird\Profiles\jyp_Thunderbird_fixe\Cache\'',​\\ ''​%%*%%\Thunderbird\Profiles\jyp_Thunderbird_fixe\cache2\''​ +    * The filter rules above will remove cache folders like:\\ ''​%%*%%\Firefox\Profiles\jyp_Firefox_fixe\cache2\'',​\\ ''​%%*%%\Thunderbird\Profiles\jyp_Thunderbird_fixe\Cache\'',​\\ ''​%%*%%\Thunderbird\Profiles\jyp_Thunderbird_fixe\cache2\''​\\ ... and many similar folders 
-==== Suggested filters when backing up your Windows folder ====+  * Remove other Thunderbird and Firefox ​ folders with temporary files: ''​%%*\storage\%%'', ​ ''​%%*\datareporting\%%''​
  
-Default Windows folder: ''​C:​\Users\your_login''​ 
  
-  * Remove WSL+Linux from backup: ''​%%*\AppData\Local\Packages\Canonical*Ubuntu*\%%''​ +==== Suggested filters when backing up your Windows Home folder ==== 
-  * Remove the backup of all the settings saved in AppData\Local\Packages''​%%*\AppData\Local\Packages\%%''​ + 
-  * Try to remove all the cache files: ''​*cache*\''​\\ This should take care of cache folders like:+Default Windows Home folder: ''​C:\Users\your_login''​ 
 + 
 +  * Try to remove all the obvious ​cache folders: ''​*\*cache*\''​\\ This should take care of cache folders like:
     * ''​%%*\AppData\Local\Google\Chrome\User Data\Default\*Cache\%%''​     * ''​%%*\AppData\Local\Google\Chrome\User Data\Default\*Cache\%%''​
 +  * Remove [[other:​win10wsl|WSL+Linux]] from backup: ''​%%*\AppData\Local\Packages\Canonical*Ubuntu*\%%''​
 +    * It's probably better to use [[other:​win10wsl#​restoring_a_wsl_backup|wsl export/​import]] for saving/​restoring a full WSL installation,​ or a //tar// file for saving only the Linux ''​home''​ directory
 +    * Remember that WSL+Linux can access Windows folders using ''/​mnt/​some_drive/​some_directory''​.\\ You can put your data files in ''​some_drive:​\some_folder''​ and use SyncBack to save the content of this regular Windows folder!
 +  * Remove the backup of all the settings saved in ''​AppData\Local\Packages'':​ ''​%%*\AppData\Local\Packages\%%''​
   * Remove some Microsoft apps related directories:​ ''​%%*\AppData\Local\Microsoft*\%%''​   * Remove some Microsoft apps related directories:​ ''​%%*\AppData\Local\Microsoft*\%%''​
   * Remove some apps directories that use too much space: ''​%%*\AppData\Local\WebEx\%%'',​ ''​%%*\AppData\Local\GoToMeeting\%%''​   * Remove some apps directories that use too much space: ''​%%*\AppData\Local\WebEx\%%'',​ ''​%%*\AppData\Local\GoToMeeting\%%''​
Line 71: Line 78:
   * Remove misc. files: ''​%%*\ntuser*%%'', ​ ''​%%*\NTUSER*%%'',​ ''​%%*\AppData\Local\Google\Chrome\User Data\Default\Current*%%''​   * Remove misc. files: ''​%%*\ntuser*%%'', ​ ''​%%*\NTUSER*%%'',​ ''​%%*\AppData\Local\Google\Chrome\User Data\Default\Current*%%''​
   * Remove misc. directories:​ ''​%%*\AppData\Local\Comms\%%'',​ ''​%%*\AppData\Roaming\Adobe\%%''​   * Remove misc. directories:​ ''​%%*\AppData\Local\Comms\%%'',​ ''​%%*\AppData\Roaming\Adobe\%%''​
 +
 +==== The side effect of filters ====
 +
 +If you use a filter to specify that something in the //Source// folder should not be backed up to the //​Destination//​ folder, SyncBack will also ignore it in the Destination folder, and it will stay in //​Destination//​ **forever** (if it is already there), unless you remove it by hand!
 +
 +If you have time, you may want to review the custom filters you have added, and **remove the //​filtered//​ folders/​files in Destination by hand**...
 +
 +=== Detailed example ===
 +
 +  * you execute a backup profile, and one of the mirrored folders (in Source) is called ''​datareporting''​\\ => ''​datareporting''​ exists in both Source and Destination after the mirror backup
 +  * you add a ''​%%*\datareporting\%%''​ filter that will skip the ''​datareporting''​ folders the next times you execute the backup profile\\ => ''​datareporting''​ still exists in both Source and Destination
 +    * The ''​datareporting''​ content in Source may change but will be ignored by SyncBack (that'​s what you want!)
 +    * **The ''​datareporting''​ content in //​Destination//​ will stay there and never will change** (the //side effect//... because you don't want to have something in Destination that does not exist in Source, after a mirror backup)
 +  * The only way to get rid of ''​datareporting''​ in Destination is to **remove it by hand**
 +
 +=== Finding and cleaning filtered items ===
 +
 +The easiest way to clean the //​Destination//​ folder is to open it with the file explorer and use the Search field. The screenshot below shows what you get when you look for ''​cache''​. You can then select all the ''​cache''​ folders and remove them (in this case, there were 12k files using 400+ Mb in the deleted folders).
 +
 +{{ :​other:​syncbackfree_030_notes.png?​direct&​500 }}
 +===== Using groups of profiles =====
 +
  
 /* standard page footer */ /* standard page footer */
other/win10_syncback.txt · Last modified: 2020/04/29 14:38 by jypeter