Difference between revisions of "Backup Information"

From Agency Systems Wiki
Jump to navigation Jump to search
(major cleanup; added AWS, maria info years overdo, info on stopping services; removed emptmp exlcusion bc of attachments)
 
(3 intermediate revisions by the same user not shown)
Line 38: Line 38:
 
====What should I do to ensure a successful backup?====
 
====What should I do to ensure a successful backup?====
  
Make sure all users are logged out of Newton.
+
* Make sure all users are logged out of Newton.
 
+
* Temporarily stop the database services: For MariaDB the service will be called "MySQL" or "MariaDB." If the database service is running, files may be actively changed as data is written and updated. Copying during this can lead to an corrupt backup. For InnoDB tables, the state of the buffer pool, transaction logs<!-- i.e. ib_logfile* -->, and data files<!-- i.e. ibdata1 --> must all match. Maria does not automatically flush and lock data when copying files; stopping the service ensures consistency. For Pervasive SQL systems, contact Agency Systems support.  
Temporarily stop the database services: For MariaDB the service will be called "MySQL" or "MariaDB." If the database service is running, files may be actively changed as data is written and updated. Copying during this can lead to an corrupt backup. For InnoDB tables, the state of the buffer pool, transaction logs<!-- i.e. ib_logfile* -->, and data files<!-- i.e. ibdata1 --> must all match. Maria does not automatically flush and lock data when copying files; stopping the service ensures consistency. For Pervasive SQL systems, contact Agency Systems support.  
+
* Copy the Empire directory including all files and subdirectories.
 
+
* Start MariaDB.
Copy the Empire directory including all files and subdirectories.
 
  
 
====What files should I back up for Agency Systems?====
 
====What files should I back up for Agency Systems?====
Line 50: Line 49:
 
   
 
   
 
  '''Required Backup Folders:'''
 
  '''Required Backup Folders:'''
  \Empire\data\                      including subfolders (database files)
+
  \Empire\data\                      include subfolders
 
  \Empire\reports\*.cst
 
  \Empire\reports\*.cst
 
  \Empire\programs\*.ini
 
  \Empire\programs\*.ini
Line 59: Line 58:
 
  It is faster to recover from a disaster if the optional folders are backed up, but not required.
 
  It is faster to recover from a disaster if the optional folders are backed up, but not required.
 
   
 
   
  \Empire\*.*                        (the root of the share contains installers, and possibly some configuration backup files)
+
  \Empire\*.*                        all files in Empire not in a subdirectory
  \Empire\dist\*.*
+
  \Empire\dist\*.*                  
  \Empire\download\*.*              (backup of the processed download files)
+
  \Empire\download\                 include subfolders
  \Empire\emptmp\                    including subfolders
+
  \Empire\emptmp\                    include subfolders
  \Empire\forms\*.*
+
  \Empire\forms\                     include subfolders
  \Empire\programs\                  (everything other than the file types listed above)
+
  \Empire\programs\                  include subfolders if they exist
  \Empire\reports\                  (everything other than the file types listed above)
+
  \Empire\reports\                  include subfolders if they exist
  \Empire\static\
+
  \Empire\static\*.*
  
 
  '''Excluded Backup Folders:'''
 
  '''Excluded Backup Folders:'''
 
  The following folders do not need to be backed up.  
 
  The following folders do not need to be backed up.  
 
   
 
   
  \Empire\archive\*.*                (old data backups from conversions, file recovery, or system updates)
+
  \Empire\archive\                   (old data backups from conversions, file recovery, or system updates)
  \Empire\setup*\*.*                (extracted setup files to reinstall Newton)
+
  \Empire\setup*\                   (extracted setup files to reinstall Newton)
  
 
Some backup systems perform a full backup of only the database files, with incremental or ongoing backups for the attachment directory. Attachments are all individual, and are not as vital to be a “set” as the database files. Attachments are by far the largest portion of your total dataset.
 
Some backup systems perform a full backup of only the database files, with incremental or ongoing backups for the attachment directory. Attachments are all individual, and are not as vital to be a “set” as the database files. Attachments are by far the largest portion of your total dataset.
Line 99: Line 98:
 
====Where should I keep my data?====
 
====Where should I keep my data?====
  
It is always best to keep the backup media in multiple locations. Do not depend solely on off-site backups.  You should always have a backup copy locally since off-site backups are for major events such as fire, flood, or theft.
+
It is always best to keep the backup media in multiple locations. Do not depend solely on off-site backups.  You should always have a backup copy locally since off-site backups are for major events such as fire, flood, or theft. Grandfather backups should be kept off-site in a fireproof safe.
  
 
====How do I know my backup is running properly?====
 
====How do I know my backup is running properly?====

Latest revision as of 18:56, 29 October 2025

Ic description black 24dp.png Newton User Guide: Installation
Related Pages
Related Categories

Creating a system backup is critical to prevent data loss in the event of a disaster. Loss of data can occur due to a computer virus, software failure, hardware failure, theft, fire, and more. It is your responsibility to ensure the backups are done at intervals sufficient to minimize your risk exposure to such an event.

With the help of your computer technician, you must determine the best plan for your agency. There are many options at varying costs offering different degrees of risk protection. It is also your responsibility to verify that your backups are working correctly.

Does Agency Systems provide backup?

Our hosted servers are backed up automatically. For more information on hosting Newton through Amazon Workspaces, please see agencysystems.com/aws

Newton does not provide a backup utility for locally hosted servers. Hardware systems vary, and the company or individual that currently provides technical support to your office is the best resource for outlining a customized backup plan.

What should I do to ensure a successful backup?

  • Make sure all users are logged out of Newton.
  • Temporarily stop the database services: For MariaDB the service will be called "MySQL" or "MariaDB." If the database service is running, files may be actively changed as data is written and updated. Copying during this can lead to an corrupt backup. For InnoDB tables, the state of the buffer pool, transaction logs, and data files must all match. Maria does not automatically flush and lock data when copying files; stopping the service ensures consistency. For Pervasive SQL systems, contact Agency Systems support.
  • Copy the Empire directory including all files and subdirectories.
  • Start MariaDB.

What files should I back up for Agency Systems?

The entire Agency Systems programs, data, images etc are all stored on the master/server machine under the "Empire" folder.

The \Empire\ folder contains all of the data required to perform a full system recovery. Some of the directories within the \Empire\ folder can be excluded from a backup if space or processing time becomes an issue.

Required Backup Folders:
\Empire\data\                      include subfolders
\Empire\reports\*.cst
\Empire\programs\*.ini
\Empire\programs\*.log
Optional Backup Folders:
The optional folders contain the program files which do not store any agency-specific data, or archives of downloads.  
It is faster to recover from a disaster if the optional folders are backed up, but not required.

\Empire\*.*                        all files in Empire not in a subdirectory
\Empire\dist\*.*                   
\Empire\download\                  include subfolders 
\Empire\emptmp\                    include subfolders
\Empire\forms\                     include subfolders
\Empire\programs\                  include subfolders if they exist
\Empire\reports\                   include subfolders if they exist
\Empire\static\*.*
Excluded Backup Folders:
The following folders do not need to be backed up. 

\Empire\archive\                   (old data backups from conversions, file recovery, or system updates)
\Empire\setup*\                    (extracted setup files to reinstall Newton)

Some backup systems perform a full backup of only the database files, with incremental or ongoing backups for the attachment directory. Attachments are all individual, and are not as vital to be a “set” as the database files. Attachments are by far the largest portion of your total dataset.

How often should I back up my data?

The amount of time it takes to back up your data depends entirely on the type of backup you are performing. If each backup is a full copy of all of your data, that could take hours. Most backup systems perform a full backup, with additional backups being increments backing up only what has been changed.

You should deploy a nightly backup, and retain multiple days worth of backups. It is your responsibility to ensure you have backup procedures and equipment that meet your risk tolerance.

What backup programs are available?

There are many different types available to consumers. It is best to have your technician decide which is best for your office. We do recommend commercial grade products, and we recommend verifying the integrity of your backups on a regular basis. Your hardware consultant is the best source to certify your backups.

When choosing a backup system, verify that it has the ability to back up open files. Even if the system you choose does have this feature, it is a best practice to ensure all users are logged out of Agency Systems when performing backups.

There are also automated, remote backup and disaster recovery services.

My backup program offers "Continuous" backup service. Should I use this option?

No.

In most cases, the continuous backup feature will cause severe performance issues on your server. Each Agency Systems database file will update thousands of times a day preventing the the backup from completing. In addition, since many backup services will lock files during the backup process, there is a chance of data corruption.

Nightly backups after operating hours are the standard method.

Where should I keep my data?

It is always best to keep the backup media in multiple locations. Do not depend solely on off-site backups. You should always have a backup copy locally since off-site backups are for major events such as fire, flood, or theft. Grandfather backups should be kept off-site in a fireproof safe.

How do I know my backup is running properly?

Your local technician can verify that the backup is running properly for you. If you cannot be assured that all your files are backed up without error, you do not have an adequate backup solution. If you cannot routinely restore a backup successfully, you do not have an adequate backup solution.

It is critical to understand the restore function of your backup. A test restore of your system, perhaps to a test directory, should be part of your backup solution.

What happens if my backup is not complete and I need to restore?

Although we have utilities that may help in recovering data, the best solution is to restore from a previous backup. Remember, it is your responsibility to ensure backups are performed and are working correctly.

There may be charges if we are involved in a data recovery process where adequate backups were not available.

In the event your data files are compromised due to hardware, virus, or operating system failure, or a disaster, your backups will be required. They should immediately be secured and made available. We will assist you and your technician to ensure you are back to work again with as little downtime as possible.