Troubleshooting atrocious performance of Azure Blob Storage copy to Azure SQL Database
Troubleshooting atrocious performance of Azure Blob Storage copy to Azure SQL Database
Troubleshooting atrocious performance of Azure Blob Storage copy to Azure SQL Database
Re: Troubleshooting atrocious performance of Azure Blob Storage copy to Azure SQL Database
I assume you are using ADF CopyActivity? This is far from normal. As a gut check try doing the same load via BULK INSERT from Azure Storage from straight T-SQL which will work if you have public facing AzSQL and public facing storage. If you don't you'll need to setup private endpoints for SQL and and ADF IR with network LoS to the private endpoint. BULK INSERT from storage details here: [https://learn.microsoft.com/en-us/sql/relational-databases/import-export/import-bulk-data-by-using-bulk-insert-or-openrowset-bulk-sql-server?view=sql-server-ver16#using-bulk-insert](https://learn.microsoft.com/en-us/sql/relational-databases/import-export/import-bulk-data-by-using-bulk-insert-or-openrowset-bulk-sql-server?view=sql-server-ver16#using-bulk-insert)
If this takes seconds compared to what you are observing with ADF Copy Activity, it's time to call Microsoft Support and ask questions. Easier to do so when you can show another way to accomplish what you are doing that performs just fine. Not that I have been in this particular situation myself before.
If this takes seconds compared to what you are observing with ADF Copy Activity, it's time to call Microsoft Support and ask questions. Easier to do so when you can show another way to accomplish what you are doing that performs just fine. Not that I have been in this particular situation myself before.