Server File System

Server file system represents the local operating file system on the Compute nodes. The operating file system folder itself can in turn be a mounted network file shares or cloud file systems; or attached disk which are visible on all Compute nodes.

note

Only Ingestion activity supports File based connectors.

Steps to create Datastore for Server file system#

Click on the action button () from the Datastores section in Left Navigation and select Server file system (LFS)** connector. Alternatively user can launch from Create New Datastore **link in Activity authoring UI or Copy Data tool
Enter the Datastore name for the new datastore and click Ok
Update the connection name or leave the default. You can refer to Connection and Environments for more details
Provide the root path of the Server file system.
Save the Datastore config. Optionally you can Test the connection.

note

Ensure the same path is visible on all Driver and Worker nodes for Yarn or Databricks computes you are using.

Interface for Local File service#

Known Limitation#

This datastore is used to fetch data from local machine only.
This datastore is only used in Ingestion activity only.