Getting Started with Multi-Protocol for PeerGFS

Purpose of this Guide

Welcome to the Getting Started with Multi-Protocol for PeerGFS guide. This document introduces PeerGFS’s multi-protocol functionality, explaining how it enables synchronization and replication of data between storage devices using SMB and NFS protocols. It covers key concepts, configuration steps, and best practices for setting up and managing a multi-protocol environment.

This guide assumes you are already familiar with installing and using PeerGFS. It focuses specifically on multi-protocol support and does not cover the broader capabilities of PeerGFS. If you need installation guidance, consult your Peer Software point of contact. For additional features and settings, refer to the PeerGFS User Guide.

The guide is designed to provide a clear, step-by-step approach to configuring PeerGFS for SMB and NFS integration:

• Introducing Multi-Protocol with PeerGFS – Explains how PeerGFS replicates data using both SMB (Windows clients) and NFS (Linux clients).

• Setting Up Access Permissions on Your Storage Device – Covers the required permissions for SMB and NFS to ensure proper connectivity.

• Setting Up Storage Configurations – Guides you through configuring storage connectivity before creating a PeerGFS job.

• Setting Up SMB Access for Linux Agents – Explains how to configure SMB access for Peer Agents running on Linux.

• Setting Up a Multi-Protocol Job – Provides detailed steps for creating file synchronization and file replication jobs that use multi-protocol.

• Understanding SMB and NFS Interactions – Highlights key differences between SMB and NFS, including file name case sensitivity and mixed permissions behavior.

• Troubleshooting Common Issues – Offers solutions for common issues encountered when using PeerGFS in a multi-protocol environment.

Consult the PeerGFS Environmental Requirements and relevant storage prerequisites to ensure that your environment meets the necessary requirements.

Introducing Multi-Protocol with PeerGFS

PeerGFS enables replication of data between NAS devices by monitoring SMB and NFS activity in real-time and triggering a Peer Agent to perform the replication. The multi-protocol functionality allows a single Peer Agent to receive notifications for both Windows and Linux client activity. PeerGFS maintains metadata integrity by using NFS for data transfers and a combination of NFS and SMB for permissions, offering a robust solution for managing data across heterogeneous environments.

Multi-protocol support is beneficial in environments that require the ability to access and modify files from both Windows and Linux systems. Examples include:

• Applications write data via NFS but end users use Windows clients to process the data generated by the applications.

• Organizations have both Windows and Linux clients working with the same data.

Setting Up Access Permissions on Your Storage Device

This section focuses on ensuring that volumes and shares have the correct permissions for use with PeerGFS. While the guidelines are general, the same principles apply regardless of the storage vendor. Proper permissions are essential for configuring multi-protocol support in PeerGFS. Failure to follow the guidance below may result in errors during job validation.

Before configuring storage in PeerGFS, you must verify that your storage device has the appropriate permissions to allow Peer Agents to read and write data as needed for file replication and file synchronization jobs.

This section addressess access permission setup for both SMB and NFS devices.

SMB Access: Setting Up SMB Permissions and Shares

To transfer Windows-style permissions, ensure that the Peer Agent has access to the SMB share(s). To set up access, follow the guidance in the following subsections—Granting SMB Share Permissions and Creating a Root SMB Admin Share—to ensure proper access configuration.

Granting SMB Share Permissions

When configuring an SMB share, grant the Peer Agent’s user account full read and write access, including the ability to modify file permissions and other metadata. For PowerScale storage devices, the account must have root-level access.

The example below shows a Dell PowerScale share named Share1, where the user peeruser has root-level access permissions. Although this example uses a local user, a domain user can be set if the storage device is part of a Windows domain.

Creating a Root SMB Admin Share

Creating a root SMB admin share is optional, but it can simplify access configuration. If you are using NetApp or Dell PowerScale, you may choose to have Peer Agents use an SMB admin share for writing Windows-style permissions. The key advantage is that a single share can be used to access data for all jobs, reducing configuration complexity.

For configuring this share, the options vary depending on the storage platform type:

• NetApp: A predefined admin share called C$ is available and can be configured for use by Peer Agents.

• Dell PowerScale: No admin share is available by default, so you must create one manually. Below is an example of how to create an admin share for Dell PowerScale.

Note: Using an SMB admin share may grant the Peer Agent access to more data than necessary.

The example below shows an admin share created for Dell PowerScale.

NFS Access: Configuring NFS Permissions and Shares

When a Peer Agent connects to a NFS export, it mounts the export as the root user. Since root squash is typically used to prevent the root user from having full access to NFS-mounted file systems, it is important to configure it properly to allow the Peer Agent to function correctly. Configure one of the following options:

1. Disable root squash for these exports: This ensures that the root user on the client system (the Peer Agent in this case) has full access to the NFS export without being restricted by root squash.

2. Map the root user to another user with full read/write access: If you don’t want to disable root squash entirely, you can map the root user to a different user with the necessary permissions, who has full read/write access to the NFS export. If root squash is still enabled and maps the root user to an anonymous user, then that anonymous user must have full read/write access to the NFS export for proper functionality.

For more granular access control, NFS v4 Access Control Lists (ACLs) can be used. However, ACLs are not available in earlier NFS versions.

The following example shows root mapping for Dell PowerScale.

Configuring Storage Platform Settings in PeerGFS

While the Create Job wizard allows you to configure storage platform settings during job creation, setting them up beforehand can streamline the process and minimize potential issues.

To configure storage platform settings in PeerGFS:

1. Open Peer Management Center.

2. Select Open Preferences from the Tools menu.

3. Expand Storage Configuration in the navigation tree, and select Storage Platforms.

4. Expand Storage Platforms.

   

5. Select the appropriate storage platform type.

6. Enter the required values. For more information, see Storage Platform in the Preferences section of the PeerGFS User Guide.

7. Save the configuration.

Setting Up SMB Access for Linux Agents

To transfer Windows-style permissions for a multi-protocol job, the Peer Agent must connect to the SMB share using the configured credentials.

To configure SMB access:

1. Open Peer Management Center.

2. Select Open Preferences from the Tools menu.

3. Expand Storage Configuration in the navigation tree, and then select SMB Access Configuration.

   

4. Click Create to add a new SMB access configuration.

   

5. Enter the required values:

   • Description - A unique description for this configuration, specific to the selected Agent.

   • Domain Username - The username to be used. For non-domain users, this should be in the format host\username.

   • Domain Password - The password associated with the domain username.

6. Click OK.

7. Create other access configurations if needed:

   • If different shares require different credentials, create multiple entries with the appropriate credentials for each share. This ensures each SMB share is accessible with the correct permissions.

   • If a single credential set can access all shares, only one entry is needed. This simplifies setup, but ensure the credentials have the necessary access for all intended shares.

Setting Up a Multi-Protocol Job

This section with guide you through setting up a multi-protocol job in PeerGFS.

PeerGFS supports multi-protocol file synchronization and file replication jobs. However, file collaboration jobs are not currently supported due to the way that file locking is handled with NFS.

Creating a File Synchronization Job

1. Open Peer Management Center.

2. In the Jobs view, right-click File Synchronization, and then select Create File Synchronization Job.

3. Name the job, and then click OK.

4. Select Multi-Protocol (SMB and NFS) in the Protocol dropdown to configure the job for multi-protocol environments.

   

5. Click Add to configure the first participant:

   • Select the Management Agent.

     

   • Select the storage platform for this Agent.

     

   • Select or create the storage credentials.

     

   • Specify the NFS export path, SMB share and access configuration for this Agent to use, and then click Finish.

     

6. Repeat Step 4 for additional participants.

7. After adding all participants, click Next to continue configuring the job.

8. Configure the permission settings as needed.

   • If you selected Windows-style permissions, SMB access must be configured. If it has not been configured, you can do so during the validation process.

   • Mixed permissions is available for Dell PowerScale only.

     

9. Click the Validate button to confirm the Peer Agent can access the required data.

10. Click Finish to complete the job creation.

Creating a File Replication Job

1. Open Peer Management Center.

2. In the Jobs view, right-click File Replication, and then select Create File Replication Job.

3. Name the job, and then click OK.

4. Select Multi-Protocol (SMB and NFS) in the Protocol dropdown to configure the job for multi-protocol environments.

   

5. Configure the Source Agent:

   • Select the Agent that will connect to the source data.

   • Select the storage platform for this Agent.

     

   • Select or create the storage credentials.

     

   • Specify the NFS export path, SMB share, and access configuration for this Agent to use, and then click Finish to complete this participant setup.

6. Configure the Destination Agent:

   • Select the Agent that will connect to the source data.

     

   • Specify the NFS export location in NFS Path, and then select the SMB access configuration from the drop-down.

     

   • Specify the destination share name

   • Specify the SMB path. Leave this blank if replicating to the root of the share.

7. Click Next to continue configuring the job.

8. Configure the permission settings as needed.

   • If you select Windows-style permissions, SMB access must be configured. If it has not been configured, you can do so during the validation process.

   • Mixed permissions is available for Dell PowerScale only.

     

9. Click the Validate button to confirm the Peer Agent can access the required data.

10. Click Finish to complete the job creation.

Understanding SMB and NFS Interactions

When transferring data between NAS devices, the Peer Agent uses NFS to preserve filenames are correctly, as NFS is case-sensitive, while SMB is not. For file permissions and metadata, the Peer Agent uses an SMB to copy Windows-style permissions and NFS to copy Linux-style permissions. The following explains how this affects interactions between NFS and SMB.

• File Name Differences Between SMB and NFS

  • NFS supports case-sensitive file names, so files like report.txt and Report.txt can coexist as distinct files. SMB, being case-insensitive, would consider both file names identical, resulting in an error if both were created.

  • Special characters (e.g., \ / : * ? < > |) allowed in NFS but not in SMB .

  • Storage vendor implementations may handle conflicts differently—refrain from using unsupported file names.

• Mixing Linux and Windows Permissions

  • Peer Software defines mixed permissions as files simultaneously have both Linux (NFS) and Windows (SMB) permissions.

  • Dell PowerScale is the only storage vendor that fully supports this feature. Contact Peer Software for more details.

Troubleshooting Common Issues

If issues arise during configuration or job execution, refer to the following troubleshooting tips:

Job Validation Issues

Job Execution Failures