A CSV file around 1 TB in size is generated daily on an on-premise server A corresponding table. Internal stage, and file format have already been created in Snowflake to facilitate the data loading process
How can the process of bringing the CSV file into Snowflake be automated using the LEAST amount of operational overhead?
This option is the best way to automate the process of bringing the CSV file into Snowflake with the least amount of operational overhead. SnowSQL is a command-line tool that can be used to execute SQL statements and scripts on Snowflake. By scheduling a SQL file that executes a PUT command, the CSV file can be pushed from the on-premise server to the internal stage in Snowflake. Then, by creating a pipe that runs a COPY INTO statement that references the internal stage, Snowpipe can automatically load the file from the internal stage into the table when it detects a new file in the stage. This way, there is no need to manually start or monitor a virtual warehouse or task.
Ruthann
26 days agoReta
27 days agoStephane
10 days agoEllsworth
1 months agoFelice
22 days agoBeckie
27 days agoMiles
29 days agoLavonda
2 months agoHoward
2 months agoSelma
1 months agoTenesha
1 months agoJanine
1 months agoSuzan
2 months agoChaya
2 months agoTonette
2 months agoKimbery
2 months agoChau
2 months ago