HubStor Inc.

How To Capture Files From Specific Folders Within A Folder Structure

This article will walk through the process on how to configure a Files connector to capture data that resides within specific folders.  

Before getting started, review the following article which is the recommended method to accomplish this: Using Folder Filters Within a Connector

Consider the following scenario:
  1. The connector Root Path is:  E:\Projects
  2. There is a 'Home' folder under 'Projects' and the following folders exist within the 'Home' folder:
    1.       FolderA
    2.       FolderB
    3.       FolderC
    4.       FolderD
  3. We only want to capture files from folders FolderA, FolderB, FolderC in the 'Home' folder:

Configuring the Write Policy

Open the Connector properties 

Select the 'Write Policy' tab
Click the 'Add Grouping' button

Click the 'Add Clause' button
Enter a name for the Grouping such as 'Home Folders'
In the 'Metadata clause type' drop-down, choose 'MetadataSpecificValue' and click OK

In the 'Metadata Field' drop-down, choose 'ConnectorRelativeFolderPath'
Click 'Add Value'
Enter the first folder name path which is:  home\foldera
      Note: this will only capture data within 'foldera'.  To capture all sub-folders, the path will need to be:   home\foldera\*
Repeat this two more times to add the other two folders (or however many there are). The result will look like the screenshot below. 
Once all folders have been added, click OK. 

The settings should now look as shown below:

Click OK to save the changes, then OK once more to save the connector settings.  
The connector is now ready to crawl the data.  

It is important to note the following.  Even though FolderD should not be captured, the crawler will still scan the folder and contents, and it will appear in HubStor when viewing the Content app in the Admin portal.  However, the folder(s) will be empty.  This is the expected behavior.  If this behavior is not desired, folder exclusions can also be added.  This option is shown below.  When used, these folders will be skipped from the crawl.  


    • Related Articles

    • Using Folder Filters Within a Connector

      This article will discuss how to properly use Folder Filters.  These can come in very handy in a scenario where only specific folders need to be captured and/or excluded within a given workload.   Some examples include: Only capturing some folders ...
    • How to Create Connectors for Files

      This article describes how to configure settings specific to File connectors within the General and Advanced tabs of the connector properties.  The connector must be created before these settings can be applied. For information on creating a ...
    • How to Perform Efficient File Server Recovery with HubStor

      Traditionally, backup systems will make a copy of whatever is on the source system, and in a recovery scenario, the backup system will recover the full copy onto the source system. However, source systems (in this case, enterprise file systems) are ...
    • How To Create EML/MSG Files Connectors

      This article describes how to configure settings specific to EML/MSG file connectors within the General tab of the connector properties. The connector must be created before these settings can be applied. For information on creating a connector, ...
    • Understanding Slack Connector Data

      This article discusses the content captured by the HubStor Slack Connector.  For information on creating or configuring a Slack Connector, refer to the article:  How to Create a Slack Connector For information on restoring data to Slack, refer to the ...