SFTP
Detailed technical documentation on the Lemnisk SFTP to get data from SFTP to Lemnisk
Last updated
Detailed technical documentation on the Lemnisk SFTP to get data from SFTP to Lemnisk
Last updated
SFTP is a network protocol that allows you to securely transfer and manage large sizes of confidential data. You can setup SFTP as a data source to get data from SFTP to Lemnisk.
Go to -> Data Pipeline -> Sources
Step 1: Click on + Create New Source
Step 2: Select source type as SFTP and click Proceed
Step 3: Set up the source
Source name: Add a unique name to the source
Authentication: Select basic authentication and click on Create Source
To encrypt the SFTP file with GPG2 encryption, you can download the Public Key from the SFTP source as shown below. You need to encrypt the SFTP file with the public key provided.
The public key will end with .key extension and the contents would look something like this:
Once the key is downloaded, you can perform the below steps to encrypt the key with GPG2 encryption. You can run these commands in a terminal.
List the public keys available
The above command should ideally produce an output like this:
Import the downloaded public key. Replace lemnisk_public_key with the name of the actual downloaded key.
The above command should produce an output like this:
Encrypt the tsv file that you wlll upload. Please take care of the --output format to align with your format so as to not overwrite older files in SFTP. Ideally add a date or timestamp of the filename.
You can replace the content.tsv with the actual file name that you want to upload to Lemnisk. The above command should produce an output like this:
Enter y and press Enter to continue.
Place the encrypted file (content-3Jan2024.gpg2) in the SFTP folder shared with you.
