Questions tagged [azure-storage-blobs]

1

votes
1

answer
140

Views

Use Azure Function Binding to return list of Blobs in a Container

Perhaps I'm misunderstanding the purpose of Azure Function Input Bindings. But I want to be able to return the list of blobs in a container on a HttpTrigger using a blob input binding. Is this possible or do I need to access the Blob Storage API directly from the Function?
BenBtg
1

votes
1

answer
311

Views

How do I authenticate a user against an Azure storage blob in python?

I'm looking for a way to authenticate a user against an Azure blob container. The sample code (yep, newbie alert) works just fine, using an access key for the storage account, but that feels uncomfortably like giving away full control of the entire storage account to anyone who steals the credential...
zaump
1

votes
1

answer
140

Views

How to get image dimensions when is stored in azure blob storage?

I have image in blob and I want to read image dimensions (width and height) This is my function to read from blob: private static CloudBlockBlob ReadBlockBlob(string input, IConfigurationRoot config) { CloudStorageAccount storageAccount = new CloudStorageAccount( new Microsoft.WindowsAzure.Storage.A...
Raskolnikov
0

votes
0

answer
20

Views

Fastest way to read Azure blob files in parallel

I'm trying to download the blob files from Azure using the below code Download Method : private static async Task GetPriceString(int seriesId) { var maxRetries = 15; var storage = CloudStorageAccount.Parse('Storage Account Connection String'); var blob = storage.CreateCloudBlobClient().GetContainerR...
Pரதீப்
1

votes
2

answer
453

Views

Import excel from Azure blob using R

I have the basic setup done following the link below: http://htmlpreview.github.io/?https://github.com/Microsoft/AzureSMR/blob/master/inst/doc/tutorial.html There is a method 'azureGetBlob' which allows you to retrieve objects from the containers. however, it seems to only allow 'raw' and 'text' fo...
Sunny
1

votes
1

answer
491

Views

Kafka Connect HDFS Sink with Azure Blob Storage

I want to connect to Azure Blob Storage with Kafka HDFS Sink Connector. So far I have done: Set kafka-connect properties: hdfs.url=wasbs:// hadoop.conf.dir={hadoop_3_home}/etc/hadoop/ hadoop.home={hadoop_3_home} And in core-site.xml added support for wasbs: fs.wasbs.impl org.apache.hadoop.fs.azure.N...
zhandosso
1

votes
0

answer
61

Views

Azure Storage Webhook being triggered by historical events

I have an Azure Function which uses the webhook bindings to be triggered by each upload or modification of a blob in an Azure Storage container. This seems to work fine on an empty test container, i.e. when uploading the first blob or modifying one of two or three blobs in the test container. Howeve...
awj
1

votes
1

answer
145

Views

Azure storage is corrupting files after upload?

I'm trying to upload images to azure storage like so: var xhr = new XMLHttpRequest(); xhr.open('GET', blobUrl); xhr.responseType = 'text';//force the HTTP response, response-type header to be blob xhr.onload = function () { blobService.createBlockBlobFromText('taskcontainer', 'myblob', xhr.responseT...
tweetypi
1

votes
1

answer
292

Views

Azure SQL blob storage select

I am attempting to create a temp table to store the values of an xlsx file on my azure blob storage, I have followed numerous Microsoft articles now and I am under the impression that I should be using SELECT * FROM OPENROWSET(), this seems to be working or at least selecting something. Here is my c...
Mike
1

votes
2

answer
1.1k

Views

Downloading file from url and saving to blob

I have an azure function that downloads a file to a temporary file path and then saves the temp file to a blob. I have two questions: 1) Is there a way to manage the temporary files created by the function Path.GetTempFileName(). i.e after the scope of the function delete the temp filename? 2) Is th...
Darth Veder
1

votes
0

answer
62

Views

AzureResourceManager template hook Azure Function to Storage Event

I've got an AzureResourceManager template that's creating both a StorageAccount, as well as AzureFunctions. I want to add a JSON node to subscribe the functions to the Blob storage events. This URL explains how: https://docs.microsoft.com/en-us/azure/event-grid/event-subscription-template But I'm...
Marty
1

votes
1

answer
197

Views

DownloadRangeToByteArrayAsync in .NET Core 2.0 Multithreading/Async Issues

I'm encountering an issue with the DownloadRangeToByteArrayAsync Method in the Microsoft.AzureStorage 9.1 Nuget package on .NET Core 2.0. Whenever I perform DownloadRangeToByteArrayAsync either in Parallel or with async, it causes performance issues with any subsequent time-consuming operation. This...
Throwaway11111
1

votes
1

answer
162

Views

Javascript - Generate thumbnail from video url where store in Microsoft Azure Blob

I use Microsoft Azure Blob Storage to stored my video. How do I generate the thumbnail from the video's url that I get from backend using ajax. axios.post('my-api') .then(function(response) { var videoUrl = response.data.url; // How to generate thumbnail here })
Gary
1

votes
1

answer
39

Views

Unable to notify second device when receive image from blob

I am working a chat application and when when I upload a image with button click then image doesn't received to another device only sender device showing it. MyButton click code: public async void Image_Clicked(object sender, EventArgs e) { try { file = await CrossMedia.Current.PickPhotoAsync(new Pl...
Parmendra
1

votes
0

answer
462

Views

Angular, Azure.CreateBlobService not reading Environmental variables or values passed in?

I'm using this function from the Azure Blob Service library: https://azure.github.io/azure-storage-node/global.html#createBlobService But its not allowing me to, When specifying the environmental variables in environment.ts it throws up this error: ERROR Error: Credentials must be provided when cre...
Rob
1

votes
1

answer
290

Views

Cant upload file ~200mb to azure blob storage by asp.net core server side

I have server part on Asp.net core which receives a file in Content-Type: multipart/form-data format header and send it to azure blob storage in a stream. But when I'm sending file about 200 MB and more I have an error “The request body is too large and exceeds the maximum permissible limit” as...
Artem Danchenko
1

votes
0

answer
270

Views

Convert excel subsheet into individual CSV in Azure storage cloud using Powershell

I am writing a powershell script which should do following things: Take Excel file from Azure blob storage folder 'A' as input Extract subsheets from Excel and converts into the individual CSV Transfer those CSV to same blob storage in folder 'B' I am able to do 1 and 2nd step but in 2nd step I am g...
Mukesh Sakre
1

votes
1

answer
218

Views

Azure storage sync mechanisms

I have a problem that I have been wracking my brain about and figured I would need some perspective and insight from people who are a lot more knowledgeable about this. What I have currently: Web based application hosted in azure uses azure blob store to store files that are generated as part of dat...
Gjohn
1

votes
2

answer
622

Views

ListBlobsSegmentedAsync doesn't return all blob directories

I have a hierarchy-structured blob container with around 12k blobs. --level1 --level21 --level211 --level212 --level22 so currently I have two issues I can not see ListBlobs, even though it occurs in a lot of articles.I know it is weird. but the compiler doesn't pass. https://i.stack.imgur.com/bVnrC...
Luke
1

votes
1

answer
1k

Views

ImportError: No module named azure.storage.blob

I am trying to download a file from Azure onto my local device via python using the following code: from azure.storage.blob import BlockBlobService block_blob_service = BlockBlobService(account_name='account_name', account_key='mykey') block_blob_service.get_blob_to_path('container', 'file', 'out-t...
ElecHertz
1

votes
1

answer
144

Views

Azure Unzip automation

I am looking to do the following in Azure however I should point out that on my local machine I have no visual studio, no admin rights, no IT support and no tools (except SSMS) but I have a VERY strong drive to complete this work if its possible. I have created an Azure blob which receives a file ea...
David Jerome
1

votes
1

answer
203

Views

Copy Azure Append Blob getting a 404

Trying to move a append blob to another container after processing it. I am first just trying to copy it, then I will delete it (unless there is a actual move function?) Using C# I keep getting a 404 : The remote server returned an error: (404) Not Found. ---> System.Net.WebException : The remote se...
Joe Ruder
1

votes
0

answer
70

Views

Azure Table Storage: how to save Unicode symbols during export/import?

I have a table with Unicode symbols. After it exported to JSON (I've tried Table Service REST API and AzCopy) and imported to the new table, symbols are changed. How I can avoid it during export/import?
Evgeniy
1

votes
0

answer
62

Views

Export S3 Bucket To Blob Storage

I'm trying to download, transform and upload an entire S3 bucket to Azure Blob Storage. The task itself, though trivial, became really annoying due to throttling issues. The bucket itself is 4.5TB and contains roughly 700,000,000 keys - my first approach was to create a Lambda to handle a batch of...
vito
1

votes
1

answer
195

Views

ASP.NET MVC Core Azure Blob Image Resizer

I've got an ASP.NET core application that uploads images to Azure. I am attempting to resize an image using Magick.NET before uploading said image to Azure Blob container. So far, I've managed to save the image to a folder in a local hard drive. Is this the correct way of writing this? [HttpPost] [V...
Chris H.
1

votes
1

answer
188

Views

Azure blob storage file being accessed by multiple azure nodes

I have multiple JSON format files which is being pushed to the Azure storage account under a specific container. There are n number of files in the container. And 4 to 8 nodes which will be accessing the Azure storage container to downloaded the files locally, the download code is written in java. S...
Tim
1

votes
1

answer
409

Views

ASP.NET Core delete image blob from azure & from database

I have an ASP.NET application that successfully upload images to an azure container. I am trying to create a function that deletes a specific image in the blob, and delete the image from the database. Deleting it from the database isn't difficult, but attempting to delete it from azure throws an exc...
Chris H.
1

votes
2

answer
892

Views

Static hosting - ReactJS app on Azure Blob storage with Azure CDN

I would like to host my ReactJS app as static on Azure Blob. The problem is Azure Blob doesn't support default document. To overcome this, I have set Azure CDN with URL Rewrite rules for the first source pattern, set to ((?:[^\?]*/)?)($|\?.*) for the first destination pattern, set to $1index.html$2...
ondrej
1

votes
1

answer
219

Views

Data Factory copy activity and ZipDeflate throughput low

I currently have a pipeline comprised of a simple Copy activity which fetches zipped files from a third party's FTP server, unzips the files and copies them to a blob storage container. The throughput is incredibly low (7 KB/s) and simply copying the files without unzipping does not pose any issue (...
Thomas Pouget
1

votes
0

answer
124

Views

Unable to generate 'sas' Token using angular-azure-blob-service

if (fileUpload !== null) { const baseUrl = this.blob.generateBlobUrl(Config,'testBlobUpload'); this.config = { baseUrl: baseUrl, sasToken: Config.sas, blockSize: 1024 * 64, // OPTIONAL, default value is 1024 * 32 file: fileUpload.nativeFile, complete: () => { console.log('Transfer completed...
Vivek Shukla
1

votes
1

answer
148

Views

Https not supported between Usql and Blob Storage, although it seems to be?

I'm finding this works: @searchlog = EXTRACT UserId int, Start DateTime, Region string, Query string, Duration int, Urls string, ClickedUrls string FROM @'wasb://[email protected]/SearchLog.tsv' USING Extractors.T...
Alex KeySmith
1

votes
1

answer
228

Views

Azure Storage service REST API for block Blobs : Content Length Issue

I am trying to use azure storage rest api to push block blob type but issue is about Content Length to be known before hand in order to upload. Do we have a workaround for cases wherein inputStream need to be relayed without having this length info available. String accesskey = 'accesskey'; String...
YogeshORai
1

votes
1

answer
790

Views

Azure Data Factory mapping 2 columns in one column

Can somebody help me solving the error am getting in concatenating the two columns i.e first name and last name from my text file and merging the two columns into one name column in my Azure SQL database as a sink in Azure Data Factory and another question is that I want to choose the first letter o...
sxb1649
1

votes
0

answer
201

Views

Spark AnalysisException: Path does not exist: Azure Blob Storage

I am trying to read data from Blob storage on Azure. I am using IntelliJ IDE. I have installed Azure plugin for IntelliJ. I am trying to read a file from blob storage but getting Path does not exist error. If I read same file from Jupyter notebook then it works without any issue. If I read a default...
Nikhil Redij
1

votes
2

answer
493

Views

Save the Response from HTTP to Blob Storage using Azure Logic App

Is it possible to save the response from the HTTP request(First Step) into the Blob Storage(Second Step) while using Azure Logic App. Thank you.
Rocket Singh
1

votes
2

answer
325

Views

Azure function BlobTrigger not firing on new file in new subfolder

My Azure function becomes unresponsive (new Blob trigger doesn't trigger) overnight, and starts working again when I click on that job in the Azure portal UI. update 9th August 11:17 - it is when $logs creates a new subfolder every hour, the BlobTrigger doesn't get triggered by these new files when...
Dave Mateer
1

votes
1

answer
693

Views

How to send Azure Function logs to blob storage?

I have a working Azure Function and I added a few logs with log (Ilogger instance) and I can see them in the logs console in Azure Portal whenever I test the function or hit the function URL in via browser. I want to send the same logs Azure Blob so I configured the, Diagnostics Logs-> Application L...
Preeti Joshi
1

votes
0

answer
197

Views

Jenkins Azure Blob Storage plugin to copy the contents of Build folder and not build folder to $web azure blob static cotainer

We are using Jenkins Azure Blob plugin to deploy into Azure Blob Storage and have to use $web hosting feature in Azure.what happens is while mentioning the folder like build/* , this is copying the entire build folder into $web container instead of the files inside the build folder. As per the Azure...
user3626234
1

votes
1

answer
107

Views

Azure Storage Service Rest API: Get Container Metadata

Getting the below error while making a call to Get Container Metadata. Response Code : 403 Response Message : Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature. StringToSign = 'GET\n\n\n\n\n\n\n\n\n\n\n\nx-ms-date:' + d...
TechPassionate
1

votes
0

answer
49

Views

How to use placeholder in Azure Storage Blob?

I'll be performing some calls to blobs in Azure Storage. There will be some cases where I'll be calling blobs that don't exist. My question is do I need to check on each call if the blob exists using public static bool BlobExistsOnCloud(CloudBlobClient client, string containerName, string key) { r...
Carlos Alves Jorge

View additional questions