<img height="1" width="1" style="display:none;" alt="" src="https://px.ads.linkedin.com/collect/?pid=348068&amp;fmt=gif">

Cloud SFTP server for ETL workflows

Posted by Jayden Bartram on May 19, 2021 5:00:00 PM

A lot of extract, transform, and load (ETL) platforms support SFTP as a data ingress or egress connector. The key challenge is having a scalable, fully featured SFTP server that is low maintenance and works within minutes. You can use Couchdrop’s cloud SFTP server for ETL workflows, which can help with your automated workflows by utilizing its native SFTP service, webhooks, APIcloud storage integrations, and ability to create and lock down users.

Cloud-SFTP-server-for-ETL-workflows

ETL Use Cases

  • As a vendor, your clients send you files via SFTP (or another means such as web portal) where you can receive a webhook event on upload to then initiate your ETL process.

User to SFTP with Webhook to ETL into Database

  • As a client, you can expose your data to your vendor for them to then process the uploaded file on a webhook event.

User Webhook with SFTP and ETL to Database

Example ETL Platforms

Couchdrop’s SFTP Webhooks

Couchdrop’s SFTP webhooks enable you to be alerted on file upload, download, deletion, rename, or a failure. As you can see below from the example output of a webhook, there is an array of objects that can be used.

Here is an example Couchdrop’s SFTP webhook in JSON output:

Couchdrop sample WebHook

So how do you enable these webhooks from within Couchdrop? To enable Couchdrop’s SFTP webhooks, navigate to your Couchdrop SFTP web portal, enable your desired events paste your Webhook URI then save.

WebHook notification on upload

Why use Couchdrop as a cloud SFTP server for ETL workflows? 

Couchdrop is an excellent choice if you're looking to use a cloud SFTP server for ETL workflows. It's easy to make additional users, has cloud storage support, and has zero infrastructure for you to manage. 

Additional Users

Couchdrop provides the ability to create additional SFTP users who can be locked down to specific directories and file operations (such as write-only, read-only or read/write). There is also the ability to lock users to certain protocols, IP addresses, etc.

Additional Couchdrop Users

Cloud Storage Support

Although Couchdrop SFTP offers its own hosted storage as a backend, you can also connect your own cloud platform (Amazon S3, Azure Blob, Dropbox, SharePoint, etc.) and have full control or access to your data.

Couchdrop Virtual File System

Zero Infrastructure

With Couchdrop, there's no setting up, managing, or maintaining virtual machines or any other infrastructure. Couchdrop is a true SaaS SFTP with zero infrastructure that scales to meet your needs. 

Connecting to ETL platform with Couchdrop

As SFTP is a standardized protocol that is the same regardless of your ETL platform, it is the same to connect. The common required information needed is:

  • SFTP hostname (subdomain.couchdrop.io)
  • SFTP username (Couchdrop user)
  • SFTP password or key
  • (Optional) SFTP root path

Microsoft Automate ETL SFTP

And that's it! You can integrate Couchdrop's cloud SFTP server into your ETL workflows for even greater functionality.  To get up and running with Couchdrop’s cloud SFTP server and integrate it into your ETL process, you can register for a 14-day free trial. There's no credit card required and no hoops to jump through. Simply sign up to get started. 

Try Couchdrop free for 14 days, no credit card required.

Launch free trial → Chat with our Team

Need help or have an advanced use case? Book a demo, book technical support or contact us.