Couchdrop Blog

Cloud SFTP server for ETL workflows | Couchdrop - Cloud SFTP and MFT

Written by Jayden Bartram | May 19, 2021 5:00:00 AM

A lot of extract, transform, and load (ETL) platforms support SFTP as a data ingress or egress connector. The key challenge is having a scalable, fully featured SFTP server that is low maintenance and works within minutes. You can use Couchdrop’s cloud SFTP server for ETL workflows, which can help with your automated workflows by utilizing its native SFTP service, webhooks, APIcloud storage integrations, and ability to create and lock down users.

ETL Use Cases

  • As a vendor, your clients send you files via SFTP (or another means such as web portal) where you can receive a webhook event on upload to then initiate your ETL process.

  • As a client, you can expose your data to your vendor for them to then process the uploaded file on a webhook event.

Example ETL Platforms

Couchdrop’s SFTP Webhooks

Couchdrop’s SFTP webhooks enable you to be alerted on file upload, download, deletion, rename, or a failure. As you can see below from the example output of a webhook, there is an array of objects that can be used.

Here is an example Couchdrop’s SFTP webhook in JSON output:

So how do you enable these webhooks from within Couchdrop? To enable Couchdrop’s SFTP webhooks, navigate to your Couchdrop SFTP web portal, enable your desired events paste your Webhook URI then save.

Why use Couchdrop as a cloud SFTP server for ETL workflows? 

Couchdrop is an excellent choice if you're looking to use a cloud SFTP server for ETL workflows. It's easy to make additional users, has cloud storage support, and has zero infrastructure for you to manage. 

Additional Users

Couchdrop provides the ability to create additional SFTP users who can be locked down to specific directories and file operations (such as write-only, read-only or read/write). There is also the ability to lock users to certain protocols, IP addresses, etc.

Cloud Storage Support

Although Couchdrop SFTP offers its own hosted storage as a backend, you can also connect your own cloud platform (Amazon S3, Azure Blob, Dropbox, SharePoint, etc.) and have full control or access to your data.

Zero Infrastructure

With Couchdrop, there's no setting up, managing, or maintaining virtual machines or any other infrastructure. Couchdrop is a true SaaS SFTP with zero infrastructure that scales to meet your needs. 

Connecting to ETL platform with Couchdrop

As SFTP is a standardized protocol that is the same regardless of your ETL platform, it is the same to connect. The common required information needed is:

  • SFTP hostname (subdomain.couchdrop.io)
  • SFTP username (Couchdrop user)
  • SFTP password or key
  • (Optional) SFTP root path

And that's it! You can integrate Couchdrop's cloud SFTP server into your ETL workflows for even greater functionality.  To get up and running with Couchdrop’s cloud SFTP server and integrate it into your ETL process, you can register for a 14-day free trial. There's no credit card required and no hoops to jump through. Simply sign up to get started.